2024-04-19T04:10:19.024 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-19T04:10:19.024 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943 --owner scheduled_teuthology@teuthology --verbose --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/ubuntu_20.04 tasks/admin_socket_objecter_requests thrashosds-health} -- /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943/orig.config.yaml 2024-04-19T04:10:19.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T04:10:19.143 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943 branch: reef description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/ubuntu_20.04 tasks/admin_socket_objecter_requests thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7662943' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: reef ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 2879 sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d sleep_before_teardown: 0 subset: 2/4 suite: powercycle suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d targets: smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi027.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi066.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - radosbench: clients: - client.0 time: 60 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-18_22:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-19T04:10:19.143 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa; will attempt to use it 2024-04-19T04:10:19.144 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa/tasks 2024-04-19T04:10:19.144 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-19T04:10:19.146 INFO:teuthology.task.internal:Checking packages... 2024-04-19T04:10:19.169 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '646b8c7d293d8ec31a40c69f7b3237b19c1be24d' 2024-04-19T04:10:19.170 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-19T04:10:19.170 INFO:teuthology.packaging:ref: None 2024-04-19T04:10:19.170 INFO:teuthology.packaging:tag: None 2024-04-19T04:10:19.170 INFO:teuthology.packaging:branch: reef 2024-04-19T04:10:19.170 INFO:teuthology.packaging:sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T04:10:19.170 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=reef 2024-04-19T04:10:19.503 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1237-g646b8c7d-1focal 2024-04-19T04:10:19.504 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-19T04:10:19.513 INFO:teuthology.task.internal:no buildpackages task found 2024-04-19T04:10:19.513 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-19T04:10:19.527 INFO:teuthology.task.internal:Saving configuration 2024-04-19T04:10:19.541 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-19T04:10:19.622 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-19T04:10:19.646 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 04:02:47.020696', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-04-19T04:10:19.667 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 04:02:47.022030', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-04-19T04:10:19.687 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 04:02:47.023406', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-04-19T04:10:19.709 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 04:02:47.018991', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-04-19T04:10:19.709 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-19T04:10:19.715 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-19T04:10:19.715 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['osd.0'] 2024-04-19T04:10:19.715 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['osd.1'] 2024-04-19T04:10:19.715 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['osd.2'] 2024-04-19T04:10:19.716 INFO:teuthology.run_tasks:Running task console_log... 2024-04-19T04:10:19.854 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbb21f60280>, signals=[15]) 2024-04-19T04:10:19.855 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-19T04:10:19.863 INFO:teuthology.task.internal:Opening connections... 2024-04-19T04:10:19.864 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2024-04-19T04:10:19.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:10:19.955 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi027.front.sepia.ceph.com 2024-04-19T04:10:19.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:10:20.043 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi066.front.sepia.ceph.com 2024-04-19T04:10:20.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:10:20.140 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-04-19T04:10:20.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:10:20.228 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-19T04:10:20.235 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-04-19T04:10:20.243 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-04-19T04:10:20.243 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-04-19T04:10:20.289 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Ubuntu" 2024-04-19T04:10:20.290 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-19T04:10:20.290 INFO:teuthology.orchestra.run.smithi007.stdout:ID=ubuntu 2024-04-19T04:10:20.290 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE=debian 2024-04-19T04:10:20.290 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-19T04:10:20.290 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="20.04" 2024-04-19T04:10:20.290 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T04:10:20.290 INFO:teuthology.orchestra.run.smithi007.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T04:10:20.290 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T04:10:20.290 INFO:teuthology.orchestra.run.smithi007.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T04:10:20.290 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_CODENAME=focal 2024-04-19T04:10:20.290 INFO:teuthology.orchestra.run.smithi007.stdout:UBUNTU_CODENAME=focal 2024-04-19T04:10:20.291 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-04-19T04:10:20.320 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2024-04-19T04:10:20.327 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2024-04-19T04:10:20.327 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2024-04-19T04:10:20.333 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Ubuntu" 2024-04-19T04:10:20.333 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-19T04:10:20.333 INFO:teuthology.orchestra.run.smithi027.stdout:ID=ubuntu 2024-04-19T04:10:20.334 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE=debian 2024-04-19T04:10:20.334 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-19T04:10:20.334 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="20.04" 2024-04-19T04:10:20.334 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T04:10:20.334 INFO:teuthology.orchestra.run.smithi027.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T04:10:20.334 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T04:10:20.334 INFO:teuthology.orchestra.run.smithi027.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T04:10:20.334 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_CODENAME=focal 2024-04-19T04:10:20.334 INFO:teuthology.orchestra.run.smithi027.stdout:UBUNTU_CODENAME=focal 2024-04-19T04:10:20.334 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2024-04-19T04:10:20.353 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2024-04-19T04:10:20.361 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2024-04-19T04:10:20.361 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-04-19T04:10:20.409 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Ubuntu" 2024-04-19T04:10:20.409 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-19T04:10:20.409 INFO:teuthology.orchestra.run.smithi066.stdout:ID=ubuntu 2024-04-19T04:10:20.409 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE=debian 2024-04-19T04:10:20.409 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-19T04:10:20.409 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="20.04" 2024-04-19T04:10:20.409 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T04:10:20.409 INFO:teuthology.orchestra.run.smithi066.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T04:10:20.409 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T04:10:20.410 INFO:teuthology.orchestra.run.smithi066.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T04:10:20.410 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_CODENAME=focal 2024-04-19T04:10:20.410 INFO:teuthology.orchestra.run.smithi066.stdout:UBUNTU_CODENAME=focal 2024-04-19T04:10:20.410 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-04-19T04:10:20.428 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-04-19T04:10:20.435 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-04-19T04:10:20.435 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-04-19T04:10:20.482 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Ubuntu" 2024-04-19T04:10:20.482 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-19T04:10:20.482 INFO:teuthology.orchestra.run.smithi172.stdout:ID=ubuntu 2024-04-19T04:10:20.482 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE=debian 2024-04-19T04:10:20.482 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-19T04:10:20.482 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="20.04" 2024-04-19T04:10:20.482 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T04:10:20.482 INFO:teuthology.orchestra.run.smithi172.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T04:10:20.482 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T04:10:20.483 INFO:teuthology.orchestra.run.smithi172.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T04:10:20.483 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_CODENAME=focal 2024-04-19T04:10:20.483 INFO:teuthology.orchestra.run.smithi172.stdout:UBUNTU_CODENAME=focal 2024-04-19T04:10:20.483 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-04-19T04:10:20.504 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-19T04:10:20.514 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-19T04:10:20.520 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-19T04:10:20.520 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2024-04-19T04:10:20.523 DEBUG:teuthology.orchestra.run.smithi027:> test '!' -e /home/ubuntu/cephtest 2024-04-19T04:10:20.525 DEBUG:teuthology.orchestra.run.smithi066:> test '!' -e /home/ubuntu/cephtest 2024-04-19T04:10:20.527 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-04-19T04:10:20.532 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-19T04:10:20.539 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-19T04:10:20.540 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2024-04-19T04:10:20.543 DEBUG:teuthology.orchestra.run.smithi027:> test -z $(ls -A /var/lib/ceph) 2024-04-19T04:10:20.545 DEBUG:teuthology.orchestra.run.smithi066:> test -z $(ls -A /var/lib/ceph) 2024-04-19T04:10:20.573 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-04-19T04:10:20.600 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-19T04:10:20.697 INFO:teuthology.run_tasks:Running task kernel... 2024-04-19T04:10:20.712 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-19T04:10:20.712 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-19T04:10:20.713 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T04:10:20.713 DEBUG:teuthology.orchestra.run.smithi027:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T04:10:20.714 DEBUG:teuthology.orchestra.run.smithi066:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T04:10:20.714 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T04:10:20.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T04:10:20.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T04:10:20.720 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2024-04-19T04:10:20.721 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2024-04-19T04:10:20.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T04:10:20.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T04:10:20.723 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-04-19T04:10:20.723 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-04-19T04:10:20.727 INFO:teuthology.orchestra.run.smithi027.stdout:5.4.0-124-generic 2024-04-19T04:10:20.727 INFO:teuthology.task.kernel:Running kernel on smithi027: 5.4.0-124-generic 2024-04-19T04:10:20.728 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get clean 2024-04-19T04:10:20.729 INFO:teuthology.orchestra.run.smithi172.stdout:5.4.0-124-generic 2024-04-19T04:10:20.729 INFO:teuthology.task.kernel:Running kernel on smithi172: 5.4.0-124-generic 2024-04-19T04:10:20.729 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get clean 2024-04-19T04:10:20.730 INFO:teuthology.orchestra.run.smithi007.stdout:5.4.0-124-generic 2024-04-19T04:10:20.730 INFO:teuthology.task.kernel:Running kernel on smithi007: 5.4.0-124-generic 2024-04-19T04:10:20.730 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get clean 2024-04-19T04:10:20.769 INFO:teuthology.orchestra.run.smithi066.stdout:5.4.0-124-generic 2024-04-19T04:10:20.769 INFO:teuthology.task.kernel:Running kernel on smithi066: 5.4.0-124-generic 2024-04-19T04:10:20.769 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get clean 2024-04-19T04:10:20.872 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get update 2024-04-19T04:10:20.874 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get update 2024-04-19T04:10:20.896 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get update 2024-04-19T04:10:20.913 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get update 2024-04-19T04:10:21.045 INFO:teuthology.orchestra.run.smithi066.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-04-19T04:10:21.049 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T04:10:21.061 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-04-19T04:10:21.135 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-04-19T04:10:21.195 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T04:10:21.195 INFO:teuthology.orchestra.run.smithi007.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-04-19T04:10:21.211 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T04:10:21.211 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-04-19T04:10:21.248 INFO:teuthology.orchestra.run.smithi007.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-04-19T04:10:21.271 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-04-19T04:10:21.347 INFO:teuthology.orchestra.run.smithi066.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [737 kB] 2024-04-19T04:10:21.425 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-04-19T04:10:21.427 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,266 kB] 2024-04-19T04:10:21.442 INFO:teuthology.orchestra.run.smithi066.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,856 kB] 2024-04-19T04:10:21.494 INFO:teuthology.orchestra.run.smithi066.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [432 kB] 2024-04-19T04:10:21.498 INFO:teuthology.orchestra.run.smithi066.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-04-19T04:10:21.499 INFO:teuthology.orchestra.run.smithi066.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,735 kB] 2024-04-19T04:10:21.535 INFO:teuthology.orchestra.run.smithi066.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-04-19T04:10:21.536 INFO:teuthology.orchestra.run.smithi066.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [381 kB] 2024-04-19T04:10:21.541 INFO:teuthology.orchestra.run.smithi066.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-04-19T04:10:21.541 INFO:teuthology.orchestra.run.smithi066.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [954 kB] 2024-04-19T04:10:21.557 INFO:teuthology.orchestra.run.smithi066.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [656 kB] 2024-04-19T04:10:21.565 INFO:teuthology.orchestra.run.smithi066.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [201 kB] 2024-04-19T04:10:21.567 INFO:teuthology.orchestra.run.smithi066.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-04-19T04:10:21.570 INFO:teuthology.orchestra.run.smithi066.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-04-19T04:10:21.570 INFO:teuthology.orchestra.run.smithi066.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-04-19T04:10:21.571 INFO:teuthology.orchestra.run.smithi066.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-04-19T04:10:21.590 INFO:teuthology.orchestra.run.smithi066.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-04-19T04:10:21.602 INFO:teuthology.orchestra.run.smithi007.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-04-19T04:10:21.615 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-04-19T04:10:21.632 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [967 kB] 2024-04-19T04:10:21.644 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [517 kB] 2024-04-19T04:10:21.650 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-04-19T04:10:21.651 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-04-19T04:10:21.651 INFO:teuthology.orchestra.run.smithi172.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,889 kB] 2024-04-19T04:10:21.672 INFO:teuthology.orchestra.run.smithi007.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [737 kB] 2024-04-19T04:10:21.690 INFO:teuthology.orchestra.run.smithi172.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [403 kB] 2024-04-19T04:10:21.690 INFO:teuthology.orchestra.run.smithi172.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-04-19T04:10:21.690 INFO:teuthology.orchestra.run.smithi172.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [783 kB] 2024-04-19T04:10:21.691 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,856 kB] 2024-04-19T04:10:21.697 INFO:teuthology.orchestra.run.smithi172.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,181 kB] 2024-04-19T04:10:21.712 INFO:teuthology.orchestra.run.smithi172.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [283 kB] 2024-04-19T04:10:21.716 INFO:teuthology.orchestra.run.smithi172.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-04-19T04:10:21.716 INFO:teuthology.orchestra.run.smithi172.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-04-19T04:10:21.716 INFO:teuthology.orchestra.run.smithi172.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-04-19T04:10:21.717 INFO:teuthology.orchestra.run.smithi172.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-04-19T04:10:21.720 INFO:teuthology.orchestra.run.smithi172.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [737 kB] 2024-04-19T04:10:21.727 INFO:teuthology.orchestra.run.smithi172.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-04-19T04:10:21.727 INFO:teuthology.orchestra.run.smithi172.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-04-19T04:10:21.727 INFO:teuthology.orchestra.run.smithi172.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-04-19T04:10:21.728 INFO:teuthology.orchestra.run.smithi172.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-04-19T04:10:21.747 INFO:teuthology.orchestra.run.smithi172.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-04-19T04:10:21.747 INFO:teuthology.orchestra.run.smithi172.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-04-19T04:10:21.747 INFO:teuthology.orchestra.run.smithi172.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-04-19T04:10:21.811 INFO:teuthology.orchestra.run.smithi007.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [967 kB] 2024-04-19T04:10:21.812 INFO:teuthology.orchestra.run.smithi172.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,856 kB] 2024-04-19T04:10:21.821 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:18 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T04:10:21.834 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [967 kB] 2024-04-19T04:10:21.845 INFO:teuthology.orchestra.run.smithi066.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-04-19T04:10:21.876 INFO:teuthology.orchestra.run.smithi172.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [432 kB] 2024-04-19T04:10:21.887 INFO:teuthology.orchestra.run.smithi172.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-04-19T04:10:21.887 INFO:teuthology.orchestra.run.smithi172.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-04-19T04:10:21.887 INFO:teuthology.orchestra.run.smithi172.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,735 kB] 2024-04-19T04:10:21.928 INFO:teuthology.orchestra.run.smithi172.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [381 kB] 2024-04-19T04:10:21.938 INFO:teuthology.orchestra.run.smithi172.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-04-19T04:10:21.938 INFO:teuthology.orchestra.run.smithi172.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [954 kB] 2024-04-19T04:10:21.948 INFO:teuthology.orchestra.run.smithi172.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [656 kB] 2024-04-19T04:10:21.958 INFO:teuthology.orchestra.run.smithi172.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [201 kB] 2024-04-19T04:10:21.965 INFO:teuthology.orchestra.run.smithi172.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-04-19T04:10:21.966 INFO:teuthology.orchestra.run.smithi172.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-04-19T04:10:21.967 INFO:teuthology.orchestra.run.smithi172.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-04-19T04:10:21.967 INFO:teuthology.orchestra.run.smithi172.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-04-19T04:10:21.981 INFO:teuthology.orchestra.run.smithi066.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-04-19T04:10:21.995 INFO:teuthology.orchestra.run.smithi172.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-04-19T04:10:22.038 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,856 kB] 2024-04-19T04:10:22.117 INFO:teuthology.orchestra.run.smithi066.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,266 kB] 2024-04-19T04:10:22.155 INFO:teuthology.orchestra.run.smithi007.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,266 kB] 2024-04-19T04:10:22.190 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,266 kB] 2024-04-19T04:10:22.197 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [737 kB] 2024-04-19T04:10:22.211 INFO:teuthology.orchestra.run.smithi027.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [432 kB] 2024-04-19T04:10:22.220 INFO:teuthology.orchestra.run.smithi027.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-04-19T04:10:22.220 INFO:teuthology.orchestra.run.smithi027.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,735 kB] 2024-04-19T04:10:22.230 INFO:teuthology.orchestra.run.smithi007.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [432 kB] 2024-04-19T04:10:22.245 INFO:teuthology.orchestra.run.smithi007.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-04-19T04:10:22.245 INFO:teuthology.orchestra.run.smithi007.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-04-19T04:10:22.246 INFO:teuthology.orchestra.run.smithi007.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,735 kB] 2024-04-19T04:10:22.295 INFO:teuthology.orchestra.run.smithi066.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [967 kB] 2024-04-19T04:10:22.302 INFO:teuthology.orchestra.run.smithi027.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-04-19T04:10:22.303 INFO:teuthology.orchestra.run.smithi027.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [381 kB] 2024-04-19T04:10:22.309 INFO:teuthology.orchestra.run.smithi066.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [517 kB] 2024-04-19T04:10:22.310 INFO:teuthology.orchestra.run.smithi027.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-04-19T04:10:22.310 INFO:teuthology.orchestra.run.smithi027.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [656 kB] 2024-04-19T04:10:22.317 INFO:teuthology.orchestra.run.smithi066.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-04-19T04:10:22.317 INFO:teuthology.orchestra.run.smithi066.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-04-19T04:10:22.318 INFO:teuthology.orchestra.run.smithi066.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,889 kB] 2024-04-19T04:10:22.321 INFO:teuthology.orchestra.run.smithi007.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [381 kB] 2024-04-19T04:10:22.323 INFO:teuthology.orchestra.run.smithi027.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [954 kB] 2024-04-19T04:10:22.328 INFO:teuthology.orchestra.run.smithi007.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-04-19T04:10:22.328 INFO:teuthology.orchestra.run.smithi007.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [656 kB] 2024-04-19T04:10:22.337 INFO:teuthology.orchestra.run.smithi007.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [517 kB] 2024-04-19T04:10:22.350 INFO:teuthology.orchestra.run.smithi007.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-04-19T04:10:22.350 INFO:teuthology.orchestra.run.smithi007.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,889 kB] 2024-04-19T04:10:22.360 INFO:teuthology.orchestra.run.smithi007.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [954 kB] 2024-04-19T04:10:22.371 INFO:teuthology.orchestra.run.smithi027.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [517 kB] 2024-04-19T04:10:22.377 INFO:teuthology.orchestra.run.smithi066.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [403 kB] 2024-04-19T04:10:22.381 INFO:teuthology.orchestra.run.smithi066.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-04-19T04:10:22.382 INFO:teuthology.orchestra.run.smithi066.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,181 kB] 2024-04-19T04:10:22.384 INFO:teuthology.orchestra.run.smithi027.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-04-19T04:10:22.384 INFO:teuthology.orchestra.run.smithi027.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-04-19T04:10:22.385 INFO:teuthology.orchestra.run.smithi027.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,889 kB] 2024-04-19T04:10:22.406 INFO:teuthology.orchestra.run.smithi066.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [783 kB] 2024-04-19T04:10:22.426 INFO:teuthology.orchestra.run.smithi007.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-04-19T04:10:22.426 INFO:teuthology.orchestra.run.smithi066.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [283 kB] 2024-04-19T04:10:22.427 INFO:teuthology.orchestra.run.smithi007.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [403 kB] 2024-04-19T04:10:22.429 INFO:teuthology.orchestra.run.smithi066.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-04-19T04:10:22.429 INFO:teuthology.orchestra.run.smithi066.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-04-19T04:10:22.430 INFO:teuthology.orchestra.run.smithi066.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-04-19T04:10:22.430 INFO:teuthology.orchestra.run.smithi066.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-04-19T04:10:22.446 INFO:teuthology.orchestra.run.smithi007.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-04-19T04:10:22.460 INFO:teuthology.orchestra.run.smithi066.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-04-19T04:10:22.460 INFO:teuthology.orchestra.run.smithi066.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-04-19T04:10:22.461 INFO:teuthology.orchestra.run.smithi066.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-04-19T04:10:22.461 INFO:teuthology.orchestra.run.smithi027.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [403 kB] 2024-04-19T04:10:22.462 INFO:teuthology.orchestra.run.smithi066.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-04-19T04:10:22.480 INFO:teuthology.orchestra.run.smithi027.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-04-19T04:10:22.487 INFO:teuthology.orchestra.run.smithi066.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-04-19T04:10:22.488 INFO:teuthology.orchestra.run.smithi066.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-04-19T04:10:22.488 INFO:teuthology.orchestra.run.smithi066.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-04-19T04:10:22.503 INFO:teuthology.orchestra.run.smithi027.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [201 kB] 2024-04-19T04:10:22.539 INFO:teuthology.orchestra.run.smithi007.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [201 kB] 2024-04-19T04:10:22.609 INFO:teuthology.orchestra.run.smithi007.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [783 kB] 2024-04-19T04:10:22.644 INFO:teuthology.orchestra.run.smithi027.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,181 kB] 2024-04-19T04:10:22.936 INFO:teuthology.orchestra.run.smithi027.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-04-19T04:10:22.941 INFO:teuthology.orchestra.run.smithi027.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-04-19T04:10:22.943 INFO:teuthology.orchestra.run.smithi027.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-04-19T04:10:22.950 INFO:teuthology.orchestra.run.smithi027.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-04-19T04:10:22.952 INFO:teuthology.orchestra.run.smithi027.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-04-19T04:10:22.974 INFO:teuthology.orchestra.run.smithi007.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-04-19T04:10:22.980 INFO:teuthology.orchestra.run.smithi007.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-04-19T04:10:22.987 INFO:teuthology.orchestra.run.smithi007.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-04-19T04:10:22.989 INFO:teuthology.orchestra.run.smithi007.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-04-19T04:10:22.991 INFO:teuthology.orchestra.run.smithi007.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-04-19T04:10:23.209 INFO:teuthology.orchestra.run.smithi007.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,181 kB] 2024-04-19T04:10:23.290 INFO:teuthology.orchestra.run.smithi027.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [783 kB] 2024-04-19T04:10:23.319 INFO:teuthology.orchestra.run.smithi007.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [283 kB] 2024-04-19T04:10:23.328 INFO:teuthology.orchestra.run.smithi027.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [283 kB] 2024-04-19T04:10:23.340 INFO:teuthology.orchestra.run.smithi007.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-04-19T04:10:23.341 INFO:teuthology.orchestra.run.smithi027.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-04-19T04:10:23.342 INFO:teuthology.orchestra.run.smithi007.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-04-19T04:10:23.343 INFO:teuthology.orchestra.run.smithi027.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-04-19T04:10:23.343 INFO:teuthology.orchestra.run.smithi027.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-04-19T04:10:23.344 INFO:teuthology.orchestra.run.smithi007.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-04-19T04:10:23.344 INFO:teuthology.orchestra.run.smithi027.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-04-19T04:10:23.345 INFO:teuthology.orchestra.run.smithi027.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-04-19T04:10:23.345 INFO:teuthology.orchestra.run.smithi027.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-04-19T04:10:23.345 INFO:teuthology.orchestra.run.smithi007.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-04-19T04:10:23.345 INFO:teuthology.orchestra.run.smithi007.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-04-19T04:10:23.346 INFO:teuthology.orchestra.run.smithi007.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-04-19T04:10:23.346 INFO:teuthology.orchestra.run.smithi027.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-04-19T04:10:23.348 INFO:teuthology.orchestra.run.smithi007.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-04-19T04:10:23.349 INFO:teuthology.orchestra.run.smithi007.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-04-19T04:10:23.372 INFO:teuthology.orchestra.run.smithi027.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-04-19T04:10:23.514 INFO:teuthology.orchestra.run.smithi007.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-04-19T04:10:23.537 INFO:teuthology.orchestra.run.smithi027.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-04-19T04:10:23.703 INFO:teuthology.orchestra.run.smithi007.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-04-19T04:10:23.706 INFO:teuthology.orchestra.run.smithi027.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-04-19T04:10:23.725 INFO:teuthology.orchestra.run.smithi007.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-04-19T04:10:23.755 INFO:teuthology.orchestra.run.smithi027.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-04-19T04:10:25.818 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 19.9 MB in 3s (6,822 kB/s) 2024-04-19T04:10:26.041 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 19.9 MB in 3s (7,015 kB/s) 2024-04-19T04:10:26.306 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 19.9 MB in 3s (5,747 kB/s) 2024-04-19T04:10:26.416 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 19.9 MB in 3s (5,788 kB/s) 2024-04-19T04:10:27.321 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-04-19T04:10:27.349 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T04:10:27.427 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-04-19T04:10:27.541 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2024-04-19T04:10:27.568 DEBUG:teuthology.orchestra.run.smithi066:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T04:10:27.638 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2024-04-19T04:10:27.638 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2024-04-19T04:10:27.642 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2024-04-19T04:10:27.834 INFO:teuthology.orchestra.run.smithi172.stdout:The following additional packages will be installed: 2024-04-19T04:10:27.834 INFO:teuthology.orchestra.run.smithi172.stdout: linux-generic linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-19T04:10:27.834 INFO:teuthology.orchestra.run.smithi172.stdout: linux-headers-generic linux-image-5.4.0-177-generic 2024-04-19T04:10:27.834 INFO:teuthology.orchestra.run.smithi172.stdout: linux-modules-5.4.0-177-generic linux-modules-extra-5.4.0-177-generic 2024-04-19T04:10:27.835 INFO:teuthology.orchestra.run.smithi172.stdout:Suggested packages: 2024-04-19T04:10:27.835 INFO:teuthology.orchestra.run.smithi172.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-04-19T04:10:27.835 INFO:teuthology.orchestra.run.smithi172.stdout:Recommended packages: 2024-04-19T04:10:27.835 INFO:teuthology.orchestra.run.smithi172.stdout: thermald 2024-04-19T04:10:27.862 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2024-04-19T04:10:27.863 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2024-04-19T04:10:27.885 INFO:teuthology.orchestra.run.smithi172.stdout:The following NEW packages will be installed: 2024-04-19T04:10:27.886 INFO:teuthology.orchestra.run.smithi172.stdout: linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-19T04:10:27.886 INFO:teuthology.orchestra.run.smithi172.stdout: linux-image-5.4.0-177-generic linux-modules-5.4.0-177-generic 2024-04-19T04:10:27.886 INFO:teuthology.orchestra.run.smithi172.stdout: linux-modules-extra-5.4.0-177-generic 2024-04-19T04:10:27.886 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages will be upgraded: 2024-04-19T04:10:27.887 INFO:teuthology.orchestra.run.smithi172.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-19T04:10:27.904 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-04-19T04:10:27.918 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-04-19T04:10:27.929 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T04:10:27.946 DEBUG:teuthology.orchestra.run.smithi007:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T04:10:27.955 INFO:teuthology.orchestra.run.smithi172.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-04-19T04:10:27.955 INFO:teuthology.orchestra.run.smithi172.stdout:Need to get 77.1 MB of archives. 2024-04-19T04:10:27.955 INFO:teuthology.orchestra.run.smithi172.stdout:After this operation, 380 MB of additional disk space will be used. 2024-04-19T04:10:27.955 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-177-generic amd64 5.4.0-177.197 [15.0 MB] 2024-04-19T04:10:28.012 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-04-19T04:10:28.016 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-04-19T04:10:28.075 INFO:teuthology.orchestra.run.smithi066.stdout:The following additional packages will be installed: 2024-04-19T04:10:28.075 INFO:teuthology.orchestra.run.smithi066.stdout: linux-generic linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-19T04:10:28.075 INFO:teuthology.orchestra.run.smithi066.stdout: linux-headers-generic linux-image-5.4.0-177-generic 2024-04-19T04:10:28.076 INFO:teuthology.orchestra.run.smithi066.stdout: linux-modules-5.4.0-177-generic linux-modules-extra-5.4.0-177-generic 2024-04-19T04:10:28.077 INFO:teuthology.orchestra.run.smithi066.stdout:Suggested packages: 2024-04-19T04:10:28.077 INFO:teuthology.orchestra.run.smithi066.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-04-19T04:10:28.077 INFO:teuthology.orchestra.run.smithi066.stdout:Recommended packages: 2024-04-19T04:10:28.077 INFO:teuthology.orchestra.run.smithi066.stdout: thermald 2024-04-19T04:10:28.129 INFO:teuthology.orchestra.run.smithi066.stdout:The following NEW packages will be installed: 2024-04-19T04:10:28.129 INFO:teuthology.orchestra.run.smithi066.stdout: linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-19T04:10:28.129 INFO:teuthology.orchestra.run.smithi066.stdout: linux-image-5.4.0-177-generic linux-modules-5.4.0-177-generic 2024-04-19T04:10:28.129 INFO:teuthology.orchestra.run.smithi066.stdout: linux-modules-extra-5.4.0-177-generic 2024-04-19T04:10:28.131 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be upgraded: 2024-04-19T04:10:28.131 INFO:teuthology.orchestra.run.smithi066.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-19T04:10:28.228 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2024-04-19T04:10:28.229 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2024-04-19T04:10:28.232 INFO:teuthology.orchestra.run.smithi066.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-04-19T04:10:28.233 INFO:teuthology.orchestra.run.smithi066.stdout:Need to get 77.1 MB of archives. 2024-04-19T04:10:28.233 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 380 MB of additional disk space will be used. 2024-04-19T04:10:28.233 INFO:teuthology.orchestra.run.smithi066.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-177-generic amd64 5.4.0-177.197 [15.0 MB] 2024-04-19T04:10:28.233 INFO:teuthology.orchestra.run.smithi007.stdout:Building dependency tree... 2024-04-19T04:10:28.233 INFO:teuthology.orchestra.run.smithi007.stdout:Reading state information... 2024-04-19T04:10:28.439 INFO:teuthology.orchestra.run.smithi027.stdout:The following additional packages will be installed: 2024-04-19T04:10:28.439 INFO:teuthology.orchestra.run.smithi027.stdout: linux-generic linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-19T04:10:28.439 INFO:teuthology.orchestra.run.smithi027.stdout: linux-headers-generic linux-image-5.4.0-177-generic 2024-04-19T04:10:28.439 INFO:teuthology.orchestra.run.smithi027.stdout: linux-modules-5.4.0-177-generic linux-modules-extra-5.4.0-177-generic 2024-04-19T04:10:28.440 INFO:teuthology.orchestra.run.smithi027.stdout:Suggested packages: 2024-04-19T04:10:28.440 INFO:teuthology.orchestra.run.smithi027.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-04-19T04:10:28.440 INFO:teuthology.orchestra.run.smithi027.stdout:Recommended packages: 2024-04-19T04:10:28.440 INFO:teuthology.orchestra.run.smithi027.stdout: thermald 2024-04-19T04:10:28.441 INFO:teuthology.orchestra.run.smithi007.stdout:The following additional packages will be installed: 2024-04-19T04:10:28.441 INFO:teuthology.orchestra.run.smithi007.stdout: linux-generic linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-19T04:10:28.441 INFO:teuthology.orchestra.run.smithi007.stdout: linux-headers-generic linux-image-5.4.0-177-generic 2024-04-19T04:10:28.442 INFO:teuthology.orchestra.run.smithi007.stdout: linux-modules-5.4.0-177-generic linux-modules-extra-5.4.0-177-generic 2024-04-19T04:10:28.443 INFO:teuthology.orchestra.run.smithi007.stdout:Suggested packages: 2024-04-19T04:10:28.443 INFO:teuthology.orchestra.run.smithi007.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-04-19T04:10:28.443 INFO:teuthology.orchestra.run.smithi007.stdout:Recommended packages: 2024-04-19T04:10:28.443 INFO:teuthology.orchestra.run.smithi007.stdout: thermald 2024-04-19T04:10:28.460 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-177-generic amd64 5.4.0-177.197 [10.5 MB] 2024-04-19T04:10:28.488 INFO:teuthology.orchestra.run.smithi027.stdout:The following NEW packages will be installed: 2024-04-19T04:10:28.488 INFO:teuthology.orchestra.run.smithi027.stdout: linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-19T04:10:28.488 INFO:teuthology.orchestra.run.smithi027.stdout: linux-image-5.4.0-177-generic linux-modules-5.4.0-177-generic 2024-04-19T04:10:28.488 INFO:teuthology.orchestra.run.smithi027.stdout: linux-modules-extra-5.4.0-177-generic 2024-04-19T04:10:28.490 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages will be upgraded: 2024-04-19T04:10:28.491 INFO:teuthology.orchestra.run.smithi027.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-19T04:10:28.496 INFO:teuthology.orchestra.run.smithi007.stdout:The following NEW packages will be installed: 2024-04-19T04:10:28.497 INFO:teuthology.orchestra.run.smithi007.stdout: linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-19T04:10:28.497 INFO:teuthology.orchestra.run.smithi007.stdout: linux-image-5.4.0-177-generic linux-modules-5.4.0-177-generic 2024-04-19T04:10:28.497 INFO:teuthology.orchestra.run.smithi007.stdout: linux-modules-extra-5.4.0-177-generic 2024-04-19T04:10:28.499 INFO:teuthology.orchestra.run.smithi007.stdout:The following packages will be upgraded: 2024-04-19T04:10:28.499 INFO:teuthology.orchestra.run.smithi007.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-19T04:10:28.630 INFO:teuthology.orchestra.run.smithi027.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-04-19T04:10:28.630 INFO:teuthology.orchestra.run.smithi027.stdout:Need to get 77.1 MB of archives. 2024-04-19T04:10:28.630 INFO:teuthology.orchestra.run.smithi027.stdout:After this operation, 380 MB of additional disk space will be used. 2024-04-19T04:10:28.631 INFO:teuthology.orchestra.run.smithi027.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-177-generic amd64 5.4.0-177.197 [15.0 MB] 2024-04-19T04:10:28.631 INFO:teuthology.orchestra.run.smithi007.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-04-19T04:10:28.631 INFO:teuthology.orchestra.run.smithi007.stdout:Need to get 77.1 MB of archives. 2024-04-19T04:10:28.631 INFO:teuthology.orchestra.run.smithi007.stdout:After this operation, 380 MB of additional disk space will be used. 2024-04-19T04:10:28.631 INFO:teuthology.orchestra.run.smithi007.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-177-generic amd64 5.4.0-177.197 [15.0 MB] 2024-04-19T04:10:28.649 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-177-generic amd64 5.4.0-177.197 [39.2 MB] 2024-04-19T04:10:29.086 INFO:teuthology.orchestra.run.smithi066.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-177-generic amd64 5.4.0-177.197 [10.5 MB] 2024-04-19T04:10:29.446 INFO:teuthology.orchestra.run.smithi066.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-177-generic amd64 5.4.0-177.197 [39.2 MB] 2024-04-19T04:10:29.688 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-177-generic amd64 5.4.0-177.197 [10.5 MB] 2024-04-19T04:10:29.776 INFO:teuthology.orchestra.run.smithi007.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-177-generic amd64 5.4.0-177.197 [10.5 MB] 2024-04-19T04:10:29.882 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.177.175 [1,900 B] 2024-04-19T04:10:29.883 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.177.175 [2,612 B] 2024-04-19T04:10:29.883 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177 all 5.4.0-177.197 [11.0 MB] 2024-04-19T04:10:30.116 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-177-generic amd64 5.4.0-177.197 [39.2 MB] 2024-04-19T04:10:30.212 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177-generic amd64 5.4.0-177.197 [1,377 kB] 2024-04-19T04:10:30.289 INFO:teuthology.orchestra.run.smithi007.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-177-generic amd64 5.4.0-177.197 [39.2 MB] 2024-04-19T04:10:30.335 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.177.175 [2,480 B] 2024-04-19T04:10:30.891 INFO:teuthology.orchestra.run.smithi066.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.177.175 [1,900 B] 2024-04-19T04:10:30.892 INFO:teuthology.orchestra.run.smithi066.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.177.175 [2,612 B] 2024-04-19T04:10:30.892 INFO:teuthology.orchestra.run.smithi066.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177 all 5.4.0-177.197 [11.0 MB] 2024-04-19T04:10:30.992 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 77.1 MB in 2s (31.6 MB/s) 2024-04-19T04:10:31.192 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-modules-5.4.0-177-generic. 2024-04-19T04:10:31.282 INFO:teuthology.orchestra.run.smithi066.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177-generic amd64 5.4.0-177.197 [1,377 kB] 2024-04-19T04:10:31.448 INFO:teuthology.orchestra.run.smithi066.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.177.175 [2,480 B] 2024-04-19T04:10:31.931 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.177.175 [1,900 B] 2024-04-19T04:10:31.931 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.177.175 [2,612 B] 2024-04-19T04:10:31.932 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177 all 5.4.0-177.197 [11.0 MB] 2024-04-19T04:10:31.961 INFO:teuthology.orchestra.run.smithi007.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.177.175 [1,900 B] 2024-04-19T04:10:31.961 INFO:teuthology.orchestra.run.smithi007.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.177.175 [2,612 B] 2024-04-19T04:10:31.962 INFO:teuthology.orchestra.run.smithi007.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177 all 5.4.0-177.197 [11.0 MB] 2024-04-19T04:10:32.145 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177-generic amd64 5.4.0-177.197 [1,377 kB] 2024-04-19T04:10:32.150 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177-generic amd64 5.4.0-177.197 [1,377 kB] 2024-04-19T04:10:32.171 INFO:teuthology.orchestra.run.smithi007.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.177.175 [2,480 B] 2024-04-19T04:10:32.182 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.177.175 [2,480 B] 2024-04-19T04:10:32.190 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 77.1 MB in 3s (23.3 MB/s) 2024-04-19T04:10:32.413 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-modules-5.4.0-177-generic. 2024-04-19T04:10:32.899 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 77.1 MB in 4s (21.0 MB/s) 2024-04-19T04:10:32.899 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-04-19T04:10:32.899 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 77.1 MB in 4s (20.9 MB/s) 2024-04-19T04:10:32.903 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../0-linux-modules-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T04:10:32.989 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:33.087 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-modules-5.4.0-177-generic. 2024-04-19T04:10:33.123 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package linux-modules-5.4.0-177-generic. 2024-04-19T04:10:34.191 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-04-19T04:10:34.196 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../0-linux-modules-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T04:10:34.402 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:34.879 INFO:teuthology.orchestra.run.smithi007.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-04-19T04:10:34.884 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../0-linux-modules-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T04:10:34.889 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-image-5.4.0-177-generic. 2024-04-19T04:10:34.906 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../1-linux-image-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T04:10:34.907 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-04-19T04:10:34.912 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../0-linux-modules-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T04:10:35.022 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:35.039 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:35.117 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:36.118 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-177-generic. 2024-04-19T04:10:36.130 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T04:10:36.167 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:36.444 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-image-5.4.0-177-generic. 2024-04-19T04:10:36.460 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../1-linux-image-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T04:10:36.569 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:37.017 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-image-5.4.0-177-generic. 2024-04-19T04:10:37.030 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../1-linux-image-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T04:10:37.065 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package linux-image-5.4.0-177-generic. 2024-04-19T04:10:37.082 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../1-linux-image-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T04:10:37.168 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:37.188 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:37.731 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-177-generic. 2024-04-19T04:10:37.747 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T04:10:37.808 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:38.270 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-177-generic. 2024-04-19T04:10:38.283 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T04:10:38.320 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:38.343 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-177-generic. 2024-04-19T04:10:38.357 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T04:10:38.402 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:41.021 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../3-linux-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T04:10:41.148 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T04:10:41.447 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T04:10:41.551 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-image-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T04:10:41.896 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-headers-5.4.0-177. 2024-04-19T04:10:41.910 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../5-linux-headers-5.4.0-177_5.4.0-177.197_all.deb ... 2024-04-19T04:10:41.954 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-19T04:10:42.726 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../3-linux-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T04:10:42.852 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T04:10:43.080 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../3-linux-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T04:10:43.207 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T04:10:43.245 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T04:10:43.350 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../3-linux-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T04:10:43.406 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-image-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T04:10:43.451 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T04:10:43.534 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T04:10:43.636 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-image-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T04:10:43.784 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-headers-5.4.0-177. 2024-04-19T04:10:43.798 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../5-linux-headers-5.4.0-177_5.4.0-177.197_all.deb ... 2024-04-19T04:10:43.802 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T04:10:43.842 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-19T04:10:43.946 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-image-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T04:10:43.989 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-headers-5.4.0-177. 2024-04-19T04:10:44.003 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../5-linux-headers-5.4.0-177_5.4.0-177.197_all.deb ... 2024-04-19T04:10:44.047 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-19T04:10:44.291 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package linux-headers-5.4.0-177. 2024-04-19T04:10:44.305 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../5-linux-headers-5.4.0-177_5.4.0-177.197_all.deb ... 2024-04-19T04:10:44.349 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-19T04:10:47.121 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-headers-5.4.0-177-generic. 2024-04-19T04:10:47.142 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../6-linux-headers-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T04:10:47.187 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:49.475 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-headers-5.4.0-177-generic. 2024-04-19T04:10:49.497 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../6-linux-headers-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T04:10:49.533 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:49.837 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T04:10:49.888 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package linux-headers-5.4.0-177-generic. 2024-04-19T04:10:49.909 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../6-linux-headers-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T04:10:49.970 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:49.980 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-headers-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T04:10:50.001 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-headers-5.4.0-177-generic. 2024-04-19T04:10:50.022 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../6-linux-headers-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T04:10:50.093 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:50.305 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:51.545 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-19T04:10:51.671 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:51.797 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:52.299 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T04:10:52.428 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-headers-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T04:10:52.756 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:52.978 INFO:teuthology.orchestra.run.smithi172.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-177-generic 2024-04-19T04:10:52.978 INFO:teuthology.orchestra.run.smithi172.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-177-generic 2024-04-19T04:10:53.113 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T04:10:53.115 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-headers-generic (5.4.0.177.175) ... 2024-04-19T04:10:53.240 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-headers-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T04:10:53.250 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:53.302 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T04:10:53.439 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-headers-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T04:10:53.634 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:53.778 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:54.009 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-19T04:10:54.135 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:54.271 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:54.451 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-image-generic (5.4.0.177.175) ... 2024-04-19T04:10:54.602 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-generic (5.4.0.177.175) ... 2024-04-19T04:10:54.729 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:54.802 INFO:teuthology.orchestra.run.smithi172.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-19T04:10:54.802 INFO:teuthology.orchestra.run.smithi172.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-177-generic 2024-04-19T04:10:55.037 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-19T04:10:55.163 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:55.289 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:55.973 INFO:teuthology.orchestra.run.smithi027.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-177-generic 2024-04-19T04:10:55.973 INFO:teuthology.orchestra.run.smithi027.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-177-generic 2024-04-19T04:10:56.013 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-19T04:10:56.113 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-headers-generic (5.4.0.177.175) ... 2024-04-19T04:10:56.122 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:56.231 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:56.240 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:57.065 INFO:teuthology.orchestra.run.smithi007.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-177-generic 2024-04-19T04:10:57.066 INFO:teuthology.orchestra.run.smithi007.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-177-generic 2024-04-19T04:10:57.274 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-headers-generic (5.4.0.177.175) ... 2024-04-19T04:10:57.407 INFO:teuthology.orchestra.run.smithi066.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-177-generic 2024-04-19T04:10:57.407 INFO:teuthology.orchestra.run.smithi066.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-177-generic 2024-04-19T04:10:57.425 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:57.482 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-image-generic (5.4.0.177.175) ... 2024-04-19T04:10:57.558 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-headers-generic (5.4.0.177.175) ... 2024-04-19T04:10:57.608 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-generic (5.4.0.177.175) ... 2024-04-19T04:10:57.701 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:57.727 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:57.798 INFO:teuthology.orchestra.run.smithi027.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-19T04:10:57.798 INFO:teuthology.orchestra.run.smithi027.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-177-generic 2024-04-19T04:10:58.626 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-image-generic (5.4.0.177.175) ... 2024-04-19T04:10:58.786 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-generic (5.4.0.177.175) ... 2024-04-19T04:10:58.921 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:58.944 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-image-generic (5.4.0.177.175) ... 2024-04-19T04:10:58.994 INFO:teuthology.orchestra.run.smithi007.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-19T04:10:58.994 INFO:teuthology.orchestra.run.smithi007.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-177-generic 2024-04-19T04:10:59.045 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-generic (5.4.0.177.175) ... 2024-04-19T04:10:59.172 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T04:10:59.235 INFO:teuthology.orchestra.run.smithi066.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-19T04:10:59.235 INFO:teuthology.orchestra.run.smithi066.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-177-generic 2024-04-19T04:11:17.223 INFO:teuthology.orchestra.run.smithi172.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-19T04:11:17.223 INFO:teuthology.orchestra.run.smithi172.stdout:Sourcing file `/etc/default/grub' 2024-04-19T04:11:17.235 INFO:teuthology.orchestra.run.smithi172.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T04:11:17.255 INFO:teuthology.orchestra.run.smithi172.stdout:Generating grub configuration file ... 2024-04-19T04:11:17.573 INFO:teuthology.orchestra.run.smithi172.stdout:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-19T04:11:17.595 INFO:teuthology.orchestra.run.smithi172.stdout:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-19T04:11:17.983 INFO:teuthology.orchestra.run.smithi172.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-19T04:11:17.994 INFO:teuthology.orchestra.run.smithi172.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-19T04:11:19.988 INFO:teuthology.orchestra.run.smithi172.stdout:done 2024-04-19T04:11:20.018 INFO:teuthology.orchestra.run.smithi027.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-19T04:11:20.018 INFO:teuthology.orchestra.run.smithi027.stdout:Sourcing file `/etc/default/grub' 2024-04-19T04:11:20.032 INFO:teuthology.orchestra.run.smithi027.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T04:11:20.099 INFO:teuthology.orchestra.run.smithi027.stdout:Generating grub configuration file ... 2024-04-19T04:11:20.367 DEBUG:teuthology.orchestra.run.smithi172:> dpkg -s linux-image-generic 2024-04-19T04:11:20.415 INFO:teuthology.orchestra.run.smithi172.stdout:Package: linux-image-generic 2024-04-19T04:11:20.416 INFO:teuthology.orchestra.run.smithi172.stdout:Status: install ok installed 2024-04-19T04:11:20.416 INFO:teuthology.orchestra.run.smithi172.stdout:Priority: optional 2024-04-19T04:11:20.416 INFO:teuthology.orchestra.run.smithi172.stdout:Section: kernel 2024-04-19T04:11:20.416 INFO:teuthology.orchestra.run.smithi172.stdout:Installed-Size: 20 2024-04-19T04:11:20.416 INFO:teuthology.orchestra.run.smithi172.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T04:11:20.416 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: amd64 2024-04-19T04:11:20.416 INFO:teuthology.orchestra.run.smithi172.stdout:Source: linux-meta 2024-04-19T04:11:20.416 INFO:teuthology.orchestra.run.smithi172.stdout:Version: 5.4.0.177.175 2024-04-19T04:11:20.416 INFO:teuthology.orchestra.run.smithi172.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-19T04:11:20.416 INFO:teuthology.orchestra.run.smithi172.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T04:11:20.417 INFO:teuthology.orchestra.run.smithi172.stdout:Recommends: thermald 2024-04-19T04:11:20.417 INFO:teuthology.orchestra.run.smithi172.stdout:Description: Generic Linux kernel image 2024-04-19T04:11:20.417 INFO:teuthology.orchestra.run.smithi172.stdout: This package will always depend on the latest generic kernel image 2024-04-19T04:11:20.417 INFO:teuthology.orchestra.run.smithi172.stdout: available. 2024-04-19T04:11:20.418 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-177-generic 2024-04-19T04:11:20.418 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T04:11:20.418 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T04:11:20.418 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-04-19T04:11:20.418 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi172.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T04:11:20.418 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get clean 2024-04-19T04:11:20.483 INFO:teuthology.orchestra.run.smithi027.stdout:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-19T04:11:20.494 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get update 2024-04-19T04:11:20.504 INFO:teuthology.orchestra.run.smithi027.stdout:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-19T04:11:20.764 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-19T04:11:20.764 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T04:11:20.799 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-19T04:11:20.837 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-19T04:11:20.913 INFO:teuthology.orchestra.run.smithi027.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-19T04:11:20.925 INFO:teuthology.orchestra.run.smithi027.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-19T04:11:21.625 INFO:teuthology.orchestra.run.smithi007.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-19T04:11:21.625 INFO:teuthology.orchestra.run.smithi007.stdout:Sourcing file `/etc/default/grub' 2024-04-19T04:11:21.635 INFO:teuthology.orchestra.run.smithi007.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T04:11:21.653 INFO:teuthology.orchestra.run.smithi007.stdout:Generating grub configuration file ... 2024-04-19T04:11:21.845 INFO:teuthology.orchestra.run.smithi066.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-19T04:11:21.845 INFO:teuthology.orchestra.run.smithi066.stdout:Sourcing file `/etc/default/grub' 2024-04-19T04:11:21.850 INFO:teuthology.orchestra.run.smithi066.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T04:11:21.873 INFO:teuthology.orchestra.run.smithi066.stdout:Generating grub configuration file ... 2024-04-19T04:11:21.962 INFO:teuthology.orchestra.run.smithi007.stdout:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-19T04:11:21.980 INFO:teuthology.orchestra.run.smithi007.stdout:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-19T04:11:22.201 INFO:teuthology.orchestra.run.smithi066.stdout:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-19T04:11:22.233 INFO:teuthology.orchestra.run.smithi066.stdout:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-19T04:11:22.395 INFO:teuthology.orchestra.run.smithi007.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-19T04:11:22.405 INFO:teuthology.orchestra.run.smithi007.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-19T04:11:22.572 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-04-19T04:11:22.599 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T04:11:22.671 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-04-19T04:11:22.675 INFO:teuthology.orchestra.run.smithi066.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-19T04:11:22.686 INFO:teuthology.orchestra.run.smithi066.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-19T04:11:22.883 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2024-04-19T04:11:22.884 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2024-04-19T04:11:22.922 INFO:teuthology.orchestra.run.smithi027.stdout:done 2024-04-19T04:11:23.111 INFO:teuthology.orchestra.run.smithi172.stdout:linux-image-generic is already the newest version (5.4.0.177.175). 2024-04-19T04:11:23.111 INFO:teuthology.orchestra.run.smithi172.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-04-19T04:11:23.113 DEBUG:teuthology.orchestra.run.smithi172:> dpkg -s linux-image-generic 2024-04-19T04:11:23.133 INFO:teuthology.orchestra.run.smithi172.stdout:Package: linux-image-generic 2024-04-19T04:11:23.134 INFO:teuthology.orchestra.run.smithi172.stdout:Status: install ok installed 2024-04-19T04:11:23.134 INFO:teuthology.orchestra.run.smithi172.stdout:Priority: optional 2024-04-19T04:11:23.134 INFO:teuthology.orchestra.run.smithi172.stdout:Section: kernel 2024-04-19T04:11:23.134 INFO:teuthology.orchestra.run.smithi172.stdout:Installed-Size: 20 2024-04-19T04:11:23.134 INFO:teuthology.orchestra.run.smithi172.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T04:11:23.134 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: amd64 2024-04-19T04:11:23.134 INFO:teuthology.orchestra.run.smithi172.stdout:Source: linux-meta 2024-04-19T04:11:23.134 INFO:teuthology.orchestra.run.smithi172.stdout:Version: 5.4.0.177.175 2024-04-19T04:11:23.134 INFO:teuthology.orchestra.run.smithi172.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-19T04:11:23.134 INFO:teuthology.orchestra.run.smithi172.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T04:11:23.134 INFO:teuthology.orchestra.run.smithi172.stdout:Recommends: thermald 2024-04-19T04:11:23.135 INFO:teuthology.orchestra.run.smithi172.stdout:Description: Generic Linux kernel image 2024-04-19T04:11:23.135 INFO:teuthology.orchestra.run.smithi172.stdout: This package will always depend on the latest generic kernel image 2024-04-19T04:11:23.135 INFO:teuthology.orchestra.run.smithi172.stdout: available. 2024-04-19T04:11:23.135 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-04-19T04:11:23.141 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.jryIDfOjua 2024-04-19T04:11:23.142 DEBUG:teuthology.orchestra.run.smithi172:> sudo cp /boot/grub/grub.cfg /tmp/tmp.jryIDfOjua 2024-04-19T04:11:23.171 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.jryIDfOjua 2024-04-19T04:11:23.252 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.jryIDfOjua is 9KB 2024-04-19T04:11:23.266 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.jryIDfOjua 2024-04-19T04:11:23.272 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-19T04:11:23.321 DEBUG:teuthology.orchestra.run.smithi027:> dpkg -s linux-image-generic 2024-04-19T04:11:23.327 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-19T04:11:23.327 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-19T04:11:23.327 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-19T04:11:23.361 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-177-generic 2024-04-19T04:11:23.361 DEBUG:teuthology.orchestra.run.smithi172:> sudo update-grub 2024-04-19T04:11:23.372 INFO:teuthology.orchestra.run.smithi027.stdout:Package: linux-image-generic 2024-04-19T04:11:23.372 INFO:teuthology.orchestra.run.smithi027.stdout:Status: install ok installed 2024-04-19T04:11:23.372 INFO:teuthology.orchestra.run.smithi027.stdout:Priority: optional 2024-04-19T04:11:23.372 INFO:teuthology.orchestra.run.smithi027.stdout:Section: kernel 2024-04-19T04:11:23.372 INFO:teuthology.orchestra.run.smithi027.stdout:Installed-Size: 20 2024-04-19T04:11:23.372 INFO:teuthology.orchestra.run.smithi027.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T04:11:23.372 INFO:teuthology.orchestra.run.smithi027.stdout:Architecture: amd64 2024-04-19T04:11:23.373 INFO:teuthology.orchestra.run.smithi027.stdout:Source: linux-meta 2024-04-19T04:11:23.373 INFO:teuthology.orchestra.run.smithi027.stdout:Version: 5.4.0.177.175 2024-04-19T04:11:23.373 INFO:teuthology.orchestra.run.smithi027.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-19T04:11:23.373 INFO:teuthology.orchestra.run.smithi027.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T04:11:23.373 INFO:teuthology.orchestra.run.smithi027.stdout:Recommends: thermald 2024-04-19T04:11:23.373 INFO:teuthology.orchestra.run.smithi027.stdout:Description: Generic Linux kernel image 2024-04-19T04:11:23.373 INFO:teuthology.orchestra.run.smithi027.stdout: This package will always depend on the latest generic kernel image 2024-04-19T04:11:23.373 INFO:teuthology.orchestra.run.smithi027.stdout: available. 2024-04-19T04:11:23.373 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-177-generic 2024-04-19T04:11:23.373 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T04:11:23.373 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T04:11:23.373 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-04-19T04:11:23.374 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi027.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T04:11:23.374 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get clean 2024-04-19T04:11:23.472 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get update 2024-04-19T04:11:23.729 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-19T04:11:23.730 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T04:11:23.800 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-19T04:11:23.882 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-19T04:11:24.219 INFO:teuthology.orchestra.run.smithi007.stdout:done 2024-04-19T04:11:24.657 INFO:teuthology.orchestra.run.smithi172.stderr:Sourcing file `/etc/default/grub' 2024-04-19T04:11:24.666 INFO:teuthology.orchestra.run.smithi172.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T04:11:24.677 DEBUG:teuthology.orchestra.run.smithi007:> dpkg -s linux-image-generic 2024-04-19T04:11:24.678 INFO:teuthology.orchestra.run.smithi172.stderr:Generating grub configuration file ... 2024-04-19T04:11:24.722 INFO:teuthology.orchestra.run.smithi007.stdout:Package: linux-image-generic 2024-04-19T04:11:24.722 INFO:teuthology.orchestra.run.smithi007.stdout:Status: install ok installed 2024-04-19T04:11:24.722 INFO:teuthology.orchestra.run.smithi007.stdout:Priority: optional 2024-04-19T04:11:24.722 INFO:teuthology.orchestra.run.smithi007.stdout:Section: kernel 2024-04-19T04:11:24.722 INFO:teuthology.orchestra.run.smithi007.stdout:Installed-Size: 20 2024-04-19T04:11:24.722 INFO:teuthology.orchestra.run.smithi007.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T04:11:24.722 INFO:teuthology.orchestra.run.smithi007.stdout:Architecture: amd64 2024-04-19T04:11:24.722 INFO:teuthology.orchestra.run.smithi007.stdout:Source: linux-meta 2024-04-19T04:11:24.722 INFO:teuthology.orchestra.run.smithi007.stdout:Version: 5.4.0.177.175 2024-04-19T04:11:24.722 INFO:teuthology.orchestra.run.smithi007.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-19T04:11:24.723 INFO:teuthology.orchestra.run.smithi007.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T04:11:24.723 INFO:teuthology.orchestra.run.smithi007.stdout:Recommends: thermald 2024-04-19T04:11:24.723 INFO:teuthology.orchestra.run.smithi007.stdout:Description: Generic Linux kernel image 2024-04-19T04:11:24.723 INFO:teuthology.orchestra.run.smithi007.stdout: This package will always depend on the latest generic kernel image 2024-04-19T04:11:24.723 INFO:teuthology.orchestra.run.smithi007.stdout: available. 2024-04-19T04:11:24.723 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-177-generic 2024-04-19T04:11:24.723 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T04:11:24.723 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T04:11:24.723 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-19T04:11:24.723 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi007.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T04:11:24.723 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get clean 2024-04-19T04:11:24.828 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get update 2024-04-19T04:11:24.920 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-19T04:11:24.932 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-19T04:11:25.009 INFO:teuthology.orchestra.run.smithi066.stdout:done 2024-04-19T04:11:25.091 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-19T04:11:25.091 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T04:11:25.161 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-19T04:11:25.243 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-19T04:11:25.283 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-19T04:11:25.294 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-19T04:11:25.483 DEBUG:teuthology.orchestra.run.smithi066:> dpkg -s linux-image-generic 2024-04-19T04:11:25.531 INFO:teuthology.orchestra.run.smithi066.stdout:Package: linux-image-generic 2024-04-19T04:11:25.531 INFO:teuthology.orchestra.run.smithi066.stdout:Status: install ok installed 2024-04-19T04:11:25.532 INFO:teuthology.orchestra.run.smithi066.stdout:Priority: optional 2024-04-19T04:11:25.532 INFO:teuthology.orchestra.run.smithi066.stdout:Section: kernel 2024-04-19T04:11:25.532 INFO:teuthology.orchestra.run.smithi066.stdout:Installed-Size: 20 2024-04-19T04:11:25.532 INFO:teuthology.orchestra.run.smithi066.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T04:11:25.532 INFO:teuthology.orchestra.run.smithi066.stdout:Architecture: amd64 2024-04-19T04:11:25.532 INFO:teuthology.orchestra.run.smithi066.stdout:Source: linux-meta 2024-04-19T04:11:25.532 INFO:teuthology.orchestra.run.smithi066.stdout:Version: 5.4.0.177.175 2024-04-19T04:11:25.532 INFO:teuthology.orchestra.run.smithi066.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-19T04:11:25.532 INFO:teuthology.orchestra.run.smithi066.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T04:11:25.532 INFO:teuthology.orchestra.run.smithi066.stdout:Recommends: thermald 2024-04-19T04:11:25.532 INFO:teuthology.orchestra.run.smithi066.stdout:Description: Generic Linux kernel image 2024-04-19T04:11:25.532 INFO:teuthology.orchestra.run.smithi066.stdout: This package will always depend on the latest generic kernel image 2024-04-19T04:11:25.532 INFO:teuthology.orchestra.run.smithi066.stdout: available. 2024-04-19T04:11:25.533 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-177-generic 2024-04-19T04:11:25.533 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T04:11:25.533 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T04:11:25.533 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-04-19T04:11:25.533 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi066.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T04:11:25.533 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get clean 2024-04-19T04:11:25.607 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-04-19T04:11:25.612 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get update 2024-04-19T04:11:25.635 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T04:11:25.703 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-04-19T04:11:25.747 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T04:11:25.755 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-19T04:11:25.775 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-19T04:11:25.860 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-19T04:11:25.922 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2024-04-19T04:11:25.923 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2024-04-19T04:11:26.160 INFO:teuthology.orchestra.run.smithi027.stdout:linux-image-generic is already the newest version (5.4.0.177.175). 2024-04-19T04:11:26.160 INFO:teuthology.orchestra.run.smithi027.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-04-19T04:11:26.163 DEBUG:teuthology.orchestra.run.smithi027:> dpkg -s linux-image-generic 2024-04-19T04:11:26.181 INFO:teuthology.orchestra.run.smithi027.stdout:Package: linux-image-generic 2024-04-19T04:11:26.181 INFO:teuthology.orchestra.run.smithi027.stdout:Status: install ok installed 2024-04-19T04:11:26.181 INFO:teuthology.orchestra.run.smithi027.stdout:Priority: optional 2024-04-19T04:11:26.181 INFO:teuthology.orchestra.run.smithi027.stdout:Section: kernel 2024-04-19T04:11:26.181 INFO:teuthology.orchestra.run.smithi027.stdout:Installed-Size: 20 2024-04-19T04:11:26.181 INFO:teuthology.orchestra.run.smithi027.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T04:11:26.181 INFO:teuthology.orchestra.run.smithi027.stdout:Architecture: amd64 2024-04-19T04:11:26.181 INFO:teuthology.orchestra.run.smithi027.stdout:Source: linux-meta 2024-04-19T04:11:26.181 INFO:teuthology.orchestra.run.smithi027.stdout:Version: 5.4.0.177.175 2024-04-19T04:11:26.181 INFO:teuthology.orchestra.run.smithi027.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-19T04:11:26.181 INFO:teuthology.orchestra.run.smithi027.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T04:11:26.181 INFO:teuthology.orchestra.run.smithi027.stdout:Recommends: thermald 2024-04-19T04:11:26.182 INFO:teuthology.orchestra.run.smithi027.stdout:Description: Generic Linux kernel image 2024-04-19T04:11:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: This package will always depend on the latest generic kernel image 2024-04-19T04:11:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: available. 2024-04-19T04:11:26.182 DEBUG:teuthology.orchestra.run.smithi027:> mktemp 2024-04-19T04:11:26.226 INFO:teuthology.orchestra.run.smithi027.stdout:/tmp/tmp.gqzrmPf2o7 2024-04-19T04:11:26.226 DEBUG:teuthology.orchestra.run.smithi027:> sudo cp /boot/grub/grub.cfg /tmp/tmp.gqzrmPf2o7 2024-04-19T04:11:26.242 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0666 /tmp/tmp.gqzrmPf2o7 2024-04-19T04:11:26.261 INFO:teuthology.orchestra.run.smithi172.stderr:done 2024-04-19T04:11:26.264 DEBUG:teuthology.orchestra.run.smithi172:> sudo shutdown -r now 2024-04-19T04:11:26.280 DEBUG:teuthology.orchestra.remote:smithi027:/tmp/tmp.gqzrmPf2o7 is 9KB 2024-04-19T04:11:26.293 DEBUG:teuthology.orchestra.run.smithi027:> rm -fr /tmp/tmp.gqzrmPf2o7 2024-04-19T04:11:26.299 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-19T04:11:26.354 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-04-19T04:11:26.354 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-19T04:11:26.354 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-19T04:11:26.391 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-177-generic 2024-04-19T04:11:26.391 DEBUG:teuthology.orchestra.run.smithi027:> sudo update-grub 2024-04-19T04:11:26.955 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-04-19T04:11:26.982 DEBUG:teuthology.orchestra.run.smithi007:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T04:11:27.051 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-04-19T04:11:27.245 INFO:teuthology.orchestra.run.smithi007.stdout:Building dependency tree... 2024-04-19T04:11:27.246 INFO:teuthology.orchestra.run.smithi007.stdout:Reading state information... 2024-04-19T04:11:27.479 INFO:teuthology.orchestra.run.smithi007.stdout:linux-image-generic is already the newest version (5.4.0.177.175). 2024-04-19T04:11:27.480 INFO:teuthology.orchestra.run.smithi007.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-04-19T04:11:27.481 DEBUG:teuthology.orchestra.run.smithi007:> dpkg -s linux-image-generic 2024-04-19T04:11:27.500 INFO:teuthology.orchestra.run.smithi007.stdout:Package: linux-image-generic 2024-04-19T04:11:27.500 INFO:teuthology.orchestra.run.smithi007.stdout:Status: install ok installed 2024-04-19T04:11:27.500 INFO:teuthology.orchestra.run.smithi007.stdout:Priority: optional 2024-04-19T04:11:27.500 INFO:teuthology.orchestra.run.smithi007.stdout:Section: kernel 2024-04-19T04:11:27.500 INFO:teuthology.orchestra.run.smithi007.stdout:Installed-Size: 20 2024-04-19T04:11:27.500 INFO:teuthology.orchestra.run.smithi007.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T04:11:27.500 INFO:teuthology.orchestra.run.smithi007.stdout:Architecture: amd64 2024-04-19T04:11:27.500 INFO:teuthology.orchestra.run.smithi007.stdout:Source: linux-meta 2024-04-19T04:11:27.500 INFO:teuthology.orchestra.run.smithi007.stdout:Version: 5.4.0.177.175 2024-04-19T04:11:27.500 INFO:teuthology.orchestra.run.smithi007.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-19T04:11:27.501 INFO:teuthology.orchestra.run.smithi007.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T04:11:27.501 INFO:teuthology.orchestra.run.smithi007.stdout:Recommends: thermald 2024-04-19T04:11:27.501 INFO:teuthology.orchestra.run.smithi007.stdout:Description: Generic Linux kernel image 2024-04-19T04:11:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: This package will always depend on the latest generic kernel image 2024-04-19T04:11:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: available. 2024-04-19T04:11:27.501 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-04-19T04:11:27.550 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.icDOIaLFJb 2024-04-19T04:11:27.550 DEBUG:teuthology.orchestra.run.smithi007:> sudo cp /boot/grub/grub.cfg /tmp/tmp.icDOIaLFJb 2024-04-19T04:11:27.566 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.icDOIaLFJb 2024-04-19T04:11:27.602 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2024-04-19T04:11:27.629 DEBUG:teuthology.orchestra.run.smithi066:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T04:11:27.639 INFO:teuthology.orchestra.run.smithi027.stderr:Sourcing file `/etc/default/grub' 2024-04-19T04:11:27.648 INFO:teuthology.orchestra.run.smithi027.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T04:11:27.665 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.icDOIaLFJb is 9KB 2024-04-19T04:11:27.678 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.icDOIaLFJb 2024-04-19T04:11:27.683 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-19T04:11:27.696 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2024-04-19T04:11:27.698 INFO:teuthology.orchestra.run.smithi027.stderr:Generating grub configuration file ... 2024-04-19T04:11:27.739 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-19T04:11:27.739 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-19T04:11:27.739 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-19T04:11:27.774 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-177-generic 2024-04-19T04:11:27.774 DEBUG:teuthology.orchestra.run.smithi007:> sudo update-grub 2024-04-19T04:11:27.914 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2024-04-19T04:11:27.914 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2024-04-19T04:11:27.995 INFO:teuthology.orchestra.run.smithi027.stderr:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-19T04:11:28.006 INFO:teuthology.orchestra.run.smithi027.stderr:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-19T04:11:28.150 INFO:teuthology.orchestra.run.smithi066.stdout:linux-image-generic is already the newest version (5.4.0.177.175). 2024-04-19T04:11:28.150 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-04-19T04:11:28.152 DEBUG:teuthology.orchestra.run.smithi066:> dpkg -s linux-image-generic 2024-04-19T04:11:28.172 INFO:teuthology.orchestra.run.smithi066.stdout:Package: linux-image-generic 2024-04-19T04:11:28.172 INFO:teuthology.orchestra.run.smithi066.stdout:Status: install ok installed 2024-04-19T04:11:28.172 INFO:teuthology.orchestra.run.smithi066.stdout:Priority: optional 2024-04-19T04:11:28.172 INFO:teuthology.orchestra.run.smithi066.stdout:Section: kernel 2024-04-19T04:11:28.172 INFO:teuthology.orchestra.run.smithi066.stdout:Installed-Size: 20 2024-04-19T04:11:28.172 INFO:teuthology.orchestra.run.smithi066.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T04:11:28.172 INFO:teuthology.orchestra.run.smithi066.stdout:Architecture: amd64 2024-04-19T04:11:28.173 INFO:teuthology.orchestra.run.smithi066.stdout:Source: linux-meta 2024-04-19T04:11:28.173 INFO:teuthology.orchestra.run.smithi066.stdout:Version: 5.4.0.177.175 2024-04-19T04:11:28.173 INFO:teuthology.orchestra.run.smithi066.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-19T04:11:28.173 INFO:teuthology.orchestra.run.smithi066.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T04:11:28.173 INFO:teuthology.orchestra.run.smithi066.stdout:Recommends: thermald 2024-04-19T04:11:28.173 INFO:teuthology.orchestra.run.smithi066.stdout:Description: Generic Linux kernel image 2024-04-19T04:11:28.173 INFO:teuthology.orchestra.run.smithi066.stdout: This package will always depend on the latest generic kernel image 2024-04-19T04:11:28.173 INFO:teuthology.orchestra.run.smithi066.stdout: available. 2024-04-19T04:11:28.173 DEBUG:teuthology.orchestra.run.smithi066:> mktemp 2024-04-19T04:11:28.177 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.nj3tewScZB 2024-04-19T04:11:28.178 DEBUG:teuthology.orchestra.run.smithi066:> sudo cp /boot/grub/grub.cfg /tmp/tmp.nj3tewScZB 2024-04-19T04:11:28.235 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.nj3tewScZB 2024-04-19T04:11:28.271 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.nj3tewScZB is 9KB 2024-04-19T04:11:28.284 DEBUG:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.nj3tewScZB 2024-04-19T04:11:28.290 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-19T04:11:28.351 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-04-19T04:11:28.351 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-19T04:11:28.351 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-19T04:11:28.384 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-177-generic 2024-04-19T04:11:28.384 DEBUG:teuthology.orchestra.run.smithi066:> sudo update-grub 2024-04-19T04:11:28.404 INFO:teuthology.orchestra.run.smithi027.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-19T04:11:28.415 INFO:teuthology.orchestra.run.smithi027.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-19T04:11:29.173 INFO:teuthology.orchestra.run.smithi007.stderr:Sourcing file `/etc/default/grub' 2024-04-19T04:11:29.185 INFO:teuthology.orchestra.run.smithi007.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T04:11:29.199 INFO:teuthology.orchestra.run.smithi007.stderr:Generating grub configuration file ... 2024-04-19T04:11:29.438 INFO:teuthology.orchestra.run.smithi027.stderr:done 2024-04-19T04:11:29.440 DEBUG:teuthology.orchestra.run.smithi027:> sudo shutdown -r now 2024-04-19T04:11:29.499 INFO:teuthology.orchestra.run.smithi007.stderr:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-19T04:11:29.511 INFO:teuthology.orchestra.run.smithi007.stderr:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-19T04:11:29.805 INFO:teuthology.orchestra.run.smithi066.stderr:Sourcing file `/etc/default/grub' 2024-04-19T04:11:29.812 INFO:teuthology.orchestra.run.smithi066.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T04:11:29.822 INFO:teuthology.orchestra.run.smithi066.stderr:Generating grub configuration file ... 2024-04-19T04:11:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-19T04:11:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-19T04:11:30.242 INFO:teuthology.orchestra.run.smithi066.stderr:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-19T04:11:30.253 INFO:teuthology.orchestra.run.smithi066.stderr:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-19T04:11:30.643 INFO:teuthology.orchestra.run.smithi066.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-19T04:11:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-19T04:11:30.810 INFO:teuthology.orchestra.run.smithi007.stderr:done 2024-04-19T04:11:30.812 DEBUG:teuthology.orchestra.run.smithi007:> sudo shutdown -r now 2024-04-19T04:11:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:done 2024-04-19T04:11:31.783 DEBUG:teuthology.orchestra.run.smithi066:> sudo shutdown -r now 2024-04-19T04:11:56.290 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-04-19T04:11:56.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-19T04:11:56.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:11:59.446 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-04-19T04:11:59.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-04-19T04:11:59.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:12:00.816 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-19T04:12:00.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-04-19T04:12:00.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:12:01.786 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-04-19T04:12:01.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-04-19T04:12:01.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:12:30.879 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-19T04:12:33.950 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-04-19T04:12:36.254 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-19T04:12:39.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-19T04:12:39.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:12:42.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-04-19T04:12:42.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:12:45.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-04-19T04:12:45.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:12:46.014 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-04-19T04:12:48.318 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-19T04:12:58.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-04-19T04:12:58.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:12:58.274 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-19T04:13:00.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-04-19T04:13:00.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:13:00.820 DEBUG:teuthology.orchestra.remote:timed out 2024-04-19T04:13:01.090 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-04-19T04:13:09.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-04-19T04:13:09.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:13:09.829 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-04-19T04:13:10.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-19T04:13:10.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:13:10.664 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-04-19T04:13:11.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-19T04:13:11.587 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.4.0-177-generic"... 2024-04-19T04:13:11.588 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-04-19T04:13:11.637 INFO:teuthology.orchestra.run.smithi172.stdout:5.4.0-177-generic 2024-04-19T04:13:11.637 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-177-generic vs 5.4.0-177-generic 2024-04-19T04:13:11.637 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T04:13:11.637 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-19T04:13:12.638 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-19T04:13:12.638 DEBUG:teuthology.orchestra.run.smithi172:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T04:13:12.767 INFO:teuthology.orchestra.run.smithi172.stdout:ttyS1 2024-04-19T04:13:12.789 DEBUG:teuthology.parallel:result is None 2024-04-19T04:13:16.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-04-19T04:13:16.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:13:21.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-04-19T04:13:21.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:13:22.107 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-04-19T04:13:22.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-04-19T04:13:22.680 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-177-generic"... 2024-04-19T04:13:22.681 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-04-19T04:13:22.687 INFO:teuthology.orchestra.run.smithi007.stdout:5.4.0-177-generic 2024-04-19T04:13:22.687 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-177-generic vs 5.4.0-177-generic 2024-04-19T04:13:22.688 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T04:13:22.688 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-19T04:13:23.688 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-19T04:13:23.689 DEBUG:teuthology.orchestra.run.smithi007:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T04:13:23.768 INFO:teuthology.orchestra.run.smithi007.stdout:ttyS1 2024-04-19T04:13:23.806 DEBUG:teuthology.parallel:result is None 2024-04-19T04:13:31.810 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-19T04:13:34.626 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-04-19T04:13:46.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-04-19T04:13:46.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:13:47.056 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-04-19T04:13:47.676 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-04-19T04:13:47.676 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.4.0-177-generic"... 2024-04-19T04:13:47.677 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2024-04-19T04:13:47.725 INFO:teuthology.orchestra.run.smithi066.stdout:5.4.0-177-generic 2024-04-19T04:13:47.725 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-177-generic vs 5.4.0-177-generic 2024-04-19T04:13:47.725 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T04:13:47.725 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-19T04:13:48.726 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-19T04:13:48.726 DEBUG:teuthology.orchestra.run.smithi066:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T04:13:48.813 INFO:teuthology.orchestra.run.smithi066.stdout:ttyS1 2024-04-19T04:13:48.845 DEBUG:teuthology.parallel:result is None 2024-04-19T04:13:52.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-04-19T04:13:52.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:13:53.630 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-04-19T04:14:14.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-04-19T04:14:14.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:14:14.880 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-04-19T04:14:15.450 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-04-19T04:14:15.450 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.4.0-177-generic"... 2024-04-19T04:14:15.450 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2024-04-19T04:14:15.457 INFO:teuthology.orchestra.run.smithi027.stdout:5.4.0-177-generic 2024-04-19T04:14:15.457 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-177-generic vs 5.4.0-177-generic 2024-04-19T04:14:15.457 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T04:14:15.457 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-19T04:14:16.458 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-19T04:14:16.458 DEBUG:teuthology.orchestra.run.smithi027:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T04:14:16.559 INFO:teuthology.orchestra.run.smithi027.stdout:ttyS1 2024-04-19T04:14:16.584 DEBUG:teuthology.parallel:result is None 2024-04-19T04:14:16.584 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-19T04:14:16.594 INFO:teuthology.task.internal:Creating test directory... 2024-04-19T04:14:16.594 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T04:14:16.597 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T04:14:16.599 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T04:14:16.601 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T04:14:16.609 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-19T04:14:16.615 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-19T04:14:16.623 INFO:teuthology.task.internal:Creating archive directory... 2024-04-19T04:14:16.623 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T04:14:16.645 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T04:14:16.648 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T04:14:16.650 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T04:14:16.668 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-19T04:14:16.675 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-19T04:14:16.675 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T04:14:16.677 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T04:14:16.680 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T04:14:16.682 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T04:14:16.694 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T04:14:16.699 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T04:14:16.705 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T04:14:16.706 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T04:14:16.707 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T04:14:16.710 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T04:14:16.717 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T04:14:16.717 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T04:14:16.720 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-19T04:14:16.726 INFO:teuthology.task.internal:Configuring sudo... 2024-04-19T04:14:16.727 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T04:14:16.729 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T04:14:16.751 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T04:14:16.753 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T04:14:16.769 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-19T04:14:16.777 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-19T04:14:16.778 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T04:14:16.785 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T04:14:16.787 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T04:14:16.813 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T04:14:16.820 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T04:14:16.828 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T04:14:16.835 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-19T04:14:16.835 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T04:14:16.903 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T04:14:16.910 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T04:14:16.960 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-04-19T04:14:16.960 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T04:14:16.983 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T04:14:16.991 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T04:14:16.998 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-04-19T04:14:16.998 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T04:14:17.028 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T04:14:17.035 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T04:14:17.085 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-19T04:14:17.085 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T04:14:17.105 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2024-04-19T04:14:17.108 DEBUG:teuthology.orchestra.run.smithi027:> sudo service rsyslog restart 2024-04-19T04:14:17.110 DEBUG:teuthology.orchestra.run.smithi066:> sudo service rsyslog restart 2024-04-19T04:14:17.113 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-04-19T04:14:17.169 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-19T04:14:17.177 INFO:teuthology.task.internal:Starting timer... 2024-04-19T04:14:17.177 INFO:teuthology.run_tasks:Running task pcp... 2024-04-19T04:14:17.186 INFO:teuthology.run_tasks:Running task selinux... 2024-04-19T04:14:17.195 DEBUG:teuthology.task.selinux:Excluding smithi007: OS 'ubuntu' does not support SELinux 2024-04-19T04:14:17.195 DEBUG:teuthology.task.selinux:Excluding smithi027: OS 'ubuntu' does not support SELinux 2024-04-19T04:14:17.195 DEBUG:teuthology.task.selinux:Excluding smithi066: OS 'ubuntu' does not support SELinux 2024-04-19T04:14:17.195 DEBUG:teuthology.task.selinux:Excluding smithi172: OS 'ubuntu' does not support SELinux 2024-04-19T04:14:17.196 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-19T04:14:17.196 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-19T04:14:17.196 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-19T04:14:17.196 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-19T04:14:17.205 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-19T04:14:17.210 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-19T04:14:17.339 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-19T04:14:17.357 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-19T04:14:17.359 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com,smithi027.front.sepia.ceph.com,smithi066.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-19T04:20:37.667 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi027.front.sepia.ceph.com'), Remote(name='ubuntu@smithi066.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-04-19T04:20:37.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-04-19T04:20:37.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:20:37.767 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-04-19T04:20:37.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-04-19T04:20:37.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-04-19T04:20:37.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:20:37.994 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-04-19T04:20:38.118 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-04-19T04:20:38.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-04-19T04:20:38.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:20:38.228 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-04-19T04:20:38.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-04-19T04:20:38.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-19T04:20:38.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:20:38.447 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-04-19T04:20:38.571 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-19T04:20:38.573 INFO:teuthology.run_tasks:Running task clock... 2024-04-19T04:20:38.584 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-19T04:20:38.584 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T04:20:38.585 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T04:20:38.587 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T04:20:38.587 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T04:20:38.589 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T04:20:38.590 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T04:20:38.592 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T04:20:38.592 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T04:20:38.622 INFO:teuthology.orchestra.run.smithi007.stdout:19 Apr 04:20:38 ntpd[12903]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-04-19T04:20:38.622 INFO:teuthology.orchestra.run.smithi007.stdout:19 Apr 04:20:38 ntpd[12903]: Command line: ntpd -gq 2024-04-19T04:20:38.623 INFO:teuthology.orchestra.run.smithi027.stdout:19 Apr 04:20:38 ntpd[12941]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-04-19T04:20:38.623 INFO:teuthology.orchestra.run.smithi027.stdout:19 Apr 04:20:38 ntpd[12941]: Command line: ntpd -gq 2024-04-19T04:20:38.624 INFO:teuthology.orchestra.run.smithi007.stdout:19 Apr 04:20:38 ntpd[12903]: proto: precision = 0.120 usec (-23) 2024-04-19T04:20:38.625 INFO:teuthology.orchestra.run.smithi027.stdout:19 Apr 04:20:38 ntpd[12941]: proto: precision = 0.123 usec (-23) 2024-04-19T04:20:38.625 INFO:teuthology.orchestra.run.smithi007.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T04:20:38.625 INFO:teuthology.orchestra.run.smithi007.stdout:19 Apr 04:20:38 ntpd[12903]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T04:20:38.626 INFO:teuthology.orchestra.run.smithi007.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-19T04:20:38.627 INFO:teuthology.orchestra.run.smithi007.stdout:19 Apr 04:20:38 ntpd[12903]: restrict ::: KOD does nothing without LIMITED. 2024-04-19T04:20:38.627 INFO:teuthology.orchestra.run.smithi007.stdout:19 Apr 04:20:38 ntpd[12903]: Listen and drop on 0 v6wildcard [::]:123 2024-04-19T04:20:38.627 INFO:teuthology.orchestra.run.smithi007.stdout:19 Apr 04:20:38 ntpd[12903]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-19T04:20:38.627 INFO:teuthology.orchestra.run.smithi007.stdout:19 Apr 04:20:38 ntpd[12903]: Listen normally on 2 lo 127.0.0.1:123 2024-04-19T04:20:38.627 INFO:teuthology.orchestra.run.smithi007.stdout:19 Apr 04:20:38 ntpd[12903]: Listen normally on 3 ens1f0 172.21.15.7:123 2024-04-19T04:20:38.627 INFO:teuthology.orchestra.run.smithi007.stdout:19 Apr 04:20:38 ntpd[12903]: Listen normally on 4 lo [::1]:123 2024-04-19T04:20:38.627 INFO:teuthology.orchestra.run.smithi007.stdout:19 Apr 04:20:38 ntpd[12903]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15ea%4]:123 2024-04-19T04:20:38.627 INFO:teuthology.orchestra.run.smithi007.stdout:19 Apr 04:20:38 ntpd[12903]: Listening on routing socket on fd #22 for interface updates 2024-04-19T04:20:38.628 INFO:teuthology.orchestra.run.smithi027.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T04:20:38.629 INFO:teuthology.orchestra.run.smithi066.stdout:19 Apr 04:20:38 ntpd[13012]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-04-19T04:20:38.629 INFO:teuthology.orchestra.run.smithi066.stdout:19 Apr 04:20:38 ntpd[13012]: Command line: ntpd -gq 2024-04-19T04:20:38.629 INFO:teuthology.orchestra.run.smithi066.stdout:19 Apr 04:20:38 ntpd[13012]: proto: precision = 0.096 usec (-23) 2024-04-19T04:20:38.629 INFO:teuthology.orchestra.run.smithi027.stdout:19 Apr 04:20:38 ntpd[12941]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T04:20:38.629 INFO:teuthology.orchestra.run.smithi066.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T04:20:38.629 INFO:teuthology.orchestra.run.smithi172.stdout:19 Apr 04:20:38 ntpd[12942]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-04-19T04:20:38.629 INFO:teuthology.orchestra.run.smithi172.stdout:19 Apr 04:20:38 ntpd[12942]: Command line: ntpd -gq 2024-04-19T04:20:38.630 INFO:teuthology.orchestra.run.smithi172.stdout:19 Apr 04:20:38 ntpd[12942]: proto: precision = 0.240 usec (-22) 2024-04-19T04:20:38.630 INFO:teuthology.orchestra.run.smithi172.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T04:20:38.630 INFO:teuthology.orchestra.run.smithi027.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-19T04:20:38.631 INFO:teuthology.orchestra.run.smithi066.stdout:19 Apr 04:20:38 ntpd[13012]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T04:20:38.631 INFO:teuthology.orchestra.run.smithi066.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-19T04:20:38.631 INFO:teuthology.orchestra.run.smithi172.stdout:19 Apr 04:20:38 ntpd[12942]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T04:20:38.632 INFO:teuthology.orchestra.run.smithi172.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-19T04:20:38.633 INFO:teuthology.orchestra.run.smithi027.stdout:19 Apr 04:20:38 ntpd[12941]: restrict ::: KOD does nothing without LIMITED. 2024-04-19T04:20:38.633 INFO:teuthology.orchestra.run.smithi027.stdout:19 Apr 04:20:38 ntpd[12941]: Listen and drop on 0 v6wildcard [::]:123 2024-04-19T04:20:38.633 INFO:teuthology.orchestra.run.smithi027.stdout:19 Apr 04:20:38 ntpd[12941]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-19T04:20:38.633 INFO:teuthology.orchestra.run.smithi027.stdout:19 Apr 04:20:38 ntpd[12941]: Listen normally on 2 lo 127.0.0.1:123 2024-04-19T04:20:38.633 INFO:teuthology.orchestra.run.smithi027.stdout:19 Apr 04:20:38 ntpd[12941]: Listen normally on 3 ens1f0 172.21.15.27:123 2024-04-19T04:20:38.633 INFO:teuthology.orchestra.run.smithi027.stdout:19 Apr 04:20:38 ntpd[12941]: Listen normally on 4 lo [::1]:123 2024-04-19T04:20:38.634 INFO:teuthology.orchestra.run.smithi027.stdout:19 Apr 04:20:38 ntpd[12941]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:395a%3]:123 2024-04-19T04:20:38.634 INFO:teuthology.orchestra.run.smithi027.stdout:19 Apr 04:20:38 ntpd[12941]: Listening on routing socket on fd #22 for interface updates 2024-04-19T04:20:38.634 INFO:teuthology.orchestra.run.smithi066.stdout:19 Apr 04:20:38 ntpd[13012]: restrict ::: KOD does nothing without LIMITED. 2024-04-19T04:20:38.635 INFO:teuthology.orchestra.run.smithi066.stdout:19 Apr 04:20:38 ntpd[13012]: Listen and drop on 0 v6wildcard [::]:123 2024-04-19T04:20:38.635 INFO:teuthology.orchestra.run.smithi066.stdout:19 Apr 04:20:38 ntpd[13012]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-19T04:20:38.635 INFO:teuthology.orchestra.run.smithi066.stdout:19 Apr 04:20:38 ntpd[13012]: Listen normally on 2 lo 127.0.0.1:123 2024-04-19T04:20:38.635 INFO:teuthology.orchestra.run.smithi066.stdout:19 Apr 04:20:38 ntpd[13012]: Listen normally on 3 enp3s0f1 172.21.15.66:123 2024-04-19T04:20:38.635 INFO:teuthology.orchestra.run.smithi066.stdout:19 Apr 04:20:38 ntpd[13012]: Listen normally on 4 lo [::1]:123 2024-04-19T04:20:38.635 INFO:teuthology.orchestra.run.smithi066.stdout:19 Apr 04:20:38 ntpd[13012]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:f8bd%5]:123 2024-04-19T04:20:38.635 INFO:teuthology.orchestra.run.smithi066.stdout:19 Apr 04:20:38 ntpd[13012]: Listening on routing socket on fd #22 for interface updates 2024-04-19T04:20:38.635 INFO:teuthology.orchestra.run.smithi172.stdout:19 Apr 04:20:38 ntpd[12942]: restrict ::: KOD does nothing without LIMITED. 2024-04-19T04:20:38.635 INFO:teuthology.orchestra.run.smithi172.stdout:19 Apr 04:20:38 ntpd[12942]: Listen and drop on 0 v6wildcard [::]:123 2024-04-19T04:20:38.635 INFO:teuthology.orchestra.run.smithi172.stdout:19 Apr 04:20:38 ntpd[12942]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-19T04:20:38.635 INFO:teuthology.orchestra.run.smithi172.stdout:19 Apr 04:20:38 ntpd[12942]: Listen normally on 2 lo 127.0.0.1:123 2024-04-19T04:20:38.636 INFO:teuthology.orchestra.run.smithi172.stdout:19 Apr 04:20:38 ntpd[12942]: Listen normally on 3 enp3s0f1 172.21.15.172:123 2024-04-19T04:20:38.636 INFO:teuthology.orchestra.run.smithi172.stdout:19 Apr 04:20:38 ntpd[12942]: Listen normally on 4 lo [::1]:123 2024-04-19T04:20:38.636 INFO:teuthology.orchestra.run.smithi172.stdout:19 Apr 04:20:38 ntpd[12942]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f91%5]:123 2024-04-19T04:20:38.636 INFO:teuthology.orchestra.run.smithi172.stdout:19 Apr 04:20:38 ntpd[12942]: Listening on routing socket on fd #22 for interface updates 2024-04-19T04:20:39.626 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:39 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:39.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:39 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:39.627 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:39 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:39.627 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:39 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:39.628 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:39 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:39.628 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:39 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:39.628 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:39 ntpd[13012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:39.628 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:39 ntpd[13012]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:40.624 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:40 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:40.624 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:40 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:40.624 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:40 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:40.624 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:40 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:40.624 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:40 ntpd[12941]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:40.624 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:40 ntpd[12941]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:40.626 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:40 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:40.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:40 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:40.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:40 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:40.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:40 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:40.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:40 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:40.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:40 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:41.624 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:41 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:41.624 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:41 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:41.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:41 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:41.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:41 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:41.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:41 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:41.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:41 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:41.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:41 ntpd[12941]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:41.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:41 ntpd[12941]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:41.626 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:41 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:41.626 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:41 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:41.626 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:41 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:41.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:41 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:41.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:41 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:41.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:41 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:41.628 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:41 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:41.628 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:41 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:41.628 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:41 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:41.628 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:41 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:41.628 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:41 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:41.628 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:41 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:41.628 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:41 ntpd[13012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:41.629 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:41 ntpd[13012]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:41.629 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:41 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:41.629 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:41 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:41.629 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:41 ntpd[13012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:41.629 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:41 ntpd[13012]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:42 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:42 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:42 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:42 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:42 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:42 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:42 ntpd[12903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:42.625 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:42 ntpd[12903]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:42.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:42 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:42.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:42 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:42.626 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:42 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:42.626 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:42 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:42.626 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:42 ntpd[12941]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:42.626 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:42 ntpd[12941]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:42.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:42 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:42.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:42 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:42.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:42 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:42.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:42 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:42.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:42 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:42.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:42 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:42.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:42 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:42.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:42 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:42.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:42 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:42.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:42 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:42.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:42 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:42.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:42 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:42.629 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:42 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:42.629 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:42 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:42.630 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:42 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:42.630 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:42 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:42.630 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:42 ntpd[13012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:42.630 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:42 ntpd[13012]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:43.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:43 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:43.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:43 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:43.625 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:43 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:43.625 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:43 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:43.625 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:43 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:43.625 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:43 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:43.625 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:43 ntpd[12903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:43.625 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:43 ntpd[12903]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:43.625 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:43 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:43.625 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:43 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:43.625 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:43 ntpd[12903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:43.625 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:43 ntpd[12903]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:43.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:43 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:43.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:43 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:43.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:43 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:43.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:43 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:43.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:43 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:43.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:43 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:43.629 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:43 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:43.629 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:43 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:43.629 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:43 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:43.629 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:43 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:43.629 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:43 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:43.629 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:43 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:43.629 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:43 ntpd[12941]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:43.629 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:43 ntpd[12941]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:43.629 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:43 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:43.629 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:43 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:43.630 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:43 ntpd[12941]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:43.630 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:43 ntpd[12941]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:43.631 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:43 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:43.631 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:43 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:43.631 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:43 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:43.631 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:43 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:43.632 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:43 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:43.632 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:43 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:43.632 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:43 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:43.632 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:43 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:43.632 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:43 ntpd[13012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:43.632 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:43 ntpd[13012]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:43.632 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:43 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:43.633 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:43 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:43.633 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:43 ntpd[13012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:43.633 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:43 ntpd[13012]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:44 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:44 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:44 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:44 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:44 ntpd[12903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:44 ntpd[12903]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:44.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:44 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:44.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:44 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:44.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:44 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:44.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:44 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:44.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:44 ntpd[12941]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:44.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:44 ntpd[12941]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:44.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:44 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:44.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:44 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:44.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:44 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:44.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:44 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:44.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:44 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:44.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:44 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:44.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:44 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:44.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:44 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:44.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:44 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:44.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:44 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:44.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:44 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:44.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:44 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:44.628 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:44 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:44.628 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:44 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:44.629 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:44 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:44.629 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:44 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:44.629 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:44 ntpd[13012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:44.629 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:44 ntpd[13012]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:45.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:45 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:45.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:45 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:45.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:45 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:45.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:45 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:45.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:45 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:45.625 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:45 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:45.625 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:45 ntpd[12903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:45.625 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:45 ntpd[12903]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:45.625 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:45 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:45.625 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:45 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:45.625 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:45 ntpd[12903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:45.625 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:45 ntpd[12903]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:45.627 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:45 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:45.627 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:45 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:45.627 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:45 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:45.627 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:45 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:45.627 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:45 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:45.627 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:45 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:45.627 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:45 ntpd[12941]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:45.627 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:45 ntpd[12941]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:45.627 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:45 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:45.627 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:45 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:45.627 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:45 ntpd[12941]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:45.628 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:45 ntpd[12941]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:45.629 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:45 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:45.629 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:45 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:45.629 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:45 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:45.629 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:45 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:45.629 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:45 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:45.630 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:45 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:45.630 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:45 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:45.630 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:45 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:45.630 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:45 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:45.630 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:45 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:45.631 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:45 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:45.631 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:45 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:45.631 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:45 ntpd[13012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:45.631 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:45 ntpd[13012]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:45.631 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:45 ntpd[13012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:45.631 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:45 ntpd[13012]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:45.631 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:45 ntpd[13012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:45.631 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:45 ntpd[13012]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:45.631 INFO:teuthology.orchestra.run.smithi066.stdout:19 Apr 04:20:45 ntpd[13012]: ntpd: time slew -0.000603 s 2024-04-19T04:20:45.631 INFO:teuthology.orchestra.run.smithi066.stdout:ntpd: time slew -0.000603s 2024-04-19T04:20:45.632 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:45 ntpd[13012]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-19T04:20:45.632 INFO:teuthology.orchestra.run.smithi066.stderr:19 Apr 04:20:45 ntpd[13012]: can't open /var/log/ntpstats/loopstats.20240419: Permission denied 2024-04-19T04:20:45.698 INFO:teuthology.orchestra.run.smithi066.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T04:20:45.698 INFO:teuthology.orchestra.run.smithi066.stdout:============================================================================== 2024-04-19T04:20:45.698 INFO:teuthology.orchestra.run.smithi066.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T04:20:45.698 INFO:teuthology.orchestra.run.smithi066.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T04:20:45.698 INFO:teuthology.orchestra.run.smithi066.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T04:20:45.698 INFO:teuthology.orchestra.run.smithi066.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T04:20:46.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:46 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:46.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:46 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:46.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:46 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:46.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:46 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:46.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:46 ntpd[12903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:46.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:46 ntpd[12903]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:46.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:46 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:46.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:46 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:46.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:46 ntpd[12941]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:46.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:46 ntpd[12941]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:46.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:46 ntpd[12941]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:46.625 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:46 ntpd[12941]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:46.626 INFO:teuthology.orchestra.run.smithi027.stdout:19 Apr 04:20:46 ntpd[12941]: ntpd: time slew -0.000510 s 2024-04-19T04:20:46.626 INFO:teuthology.orchestra.run.smithi027.stdout:ntpd: time slew -0.000510s 2024-04-19T04:20:46.626 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:46 ntpd[12941]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-19T04:20:46.626 INFO:teuthology.orchestra.run.smithi027.stderr:19 Apr 04:20:46 ntpd[12941]: can't open /var/log/ntpstats/loopstats.20240419: Permission denied 2024-04-19T04:20:46.627 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:46 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:46.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:46 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:46.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:46 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:46.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:46 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:46.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:46 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:46.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:46 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:46.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:46 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:46.628 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:46 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:46.628 INFO:teuthology.orchestra.run.smithi172.stdout:19 Apr 04:20:46 ntpd[12942]: ntpd: time slew -0.000255 s 2024-04-19T04:20:46.628 INFO:teuthology.orchestra.run.smithi172.stdout:ntpd: time slew -0.000255s 2024-04-19T04:20:46.629 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:46 ntpd[12942]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-19T04:20:46.629 INFO:teuthology.orchestra.run.smithi172.stderr:19 Apr 04:20:46 ntpd[12942]: can't open /var/log/ntpstats/loopstats.20240419: Permission denied 2024-04-19T04:20:46.697 INFO:teuthology.orchestra.run.smithi172.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T04:20:46.697 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================== 2024-04-19T04:20:46.697 INFO:teuthology.orchestra.run.smithi172.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T04:20:46.698 INFO:teuthology.orchestra.run.smithi172.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T04:20:46.698 INFO:teuthology.orchestra.run.smithi172.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T04:20:46.698 INFO:teuthology.orchestra.run.smithi172.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T04:20:46.699 INFO:teuthology.orchestra.run.smithi027.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T04:20:46.699 INFO:teuthology.orchestra.run.smithi027.stdout:============================================================================== 2024-04-19T04:20:46.699 INFO:teuthology.orchestra.run.smithi027.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T04:20:46.699 INFO:teuthology.orchestra.run.smithi027.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T04:20:46.699 INFO:teuthology.orchestra.run.smithi027.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T04:20:46.699 INFO:teuthology.orchestra.run.smithi027.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T04:20:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:47 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:47 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:47 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:47 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:47 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:47 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:47 ntpd[12903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:47 ntpd[12903]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:47 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:47 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:47 ntpd[12903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:47 ntpd[12903]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:48.623 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:48 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:48.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:48 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:48.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:48 ntpd[12903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T04:20:48.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:48 ntpd[12903]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T04:20:48.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:48 ntpd[12903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T04:20:48.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:48 ntpd[12903]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T04:20:48.624 INFO:teuthology.orchestra.run.smithi007.stdout:19 Apr 04:20:48 ntpd[12903]: ntpd: time slew +0.001960 s 2024-04-19T04:20:48.624 INFO:teuthology.orchestra.run.smithi007.stdout:ntpd: time slew +0.001960s 2024-04-19T04:20:48.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:48 ntpd[12903]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-19T04:20:48.624 INFO:teuthology.orchestra.run.smithi007.stderr:19 Apr 04:20:48 ntpd[12903]: can't open /var/log/ntpstats/loopstats.20240419: Permission denied 2024-04-19T04:20:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T04:20:48.692 INFO:teuthology.orchestra.run.smithi007.stdout:============================================================================== 2024-04-19T04:20:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T04:20:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T04:20:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T04:20:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T04:20:48.693 INFO:teuthology.run_tasks:Running task install... 2024-04-19T04:20:48.702 DEBUG:teuthology.task.install:project ceph 2024-04-19T04:20:48.703 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}} 2024-04-19T04:20:48.703 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'} 2024-04-19T04:20:48.703 INFO:teuthology.task.install:Using flavor: default 2024-04-19T04:20:48.708 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-19T04:20:48.709 INFO:teuthology.task.install:extra packages: [] 2024-04-19T04:20:48.709 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-key list | grep Ceph 2024-04-19T04:20:48.710 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-key list | grep Ceph 2024-04-19T04:20:48.710 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-key list | grep Ceph 2024-04-19T04:20:48.710 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-key list | grep Ceph 2024-04-19T04:20:48.808 INFO:teuthology.orchestra.run.smithi066.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-04-19T04:20:48.812 INFO:teuthology.orchestra.run.smithi172.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-04-19T04:20:48.815 INFO:teuthology.orchestra.run.smithi027.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-04-19T04:20:48.835 INFO:teuthology.orchestra.run.smithi007.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-04-19T04:20:48.868 INFO:teuthology.orchestra.run.smithi066.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-19T04:20:48.869 INFO:teuthology.orchestra.run.smithi066.stdout:uid [ unknown] Ceph.com (release key) 2024-04-19T04:20:48.870 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-19T04:20:48.870 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-19T04:20:48.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T04:20:48.875 INFO:teuthology.orchestra.run.smithi172.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-19T04:20:48.875 INFO:teuthology.orchestra.run.smithi172.stdout:uid [ unknown] Ceph.com (release key) 2024-04-19T04:20:48.876 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-19T04:20:48.876 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-19T04:20:48.876 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T04:20:48.880 INFO:teuthology.orchestra.run.smithi027.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-19T04:20:48.880 INFO:teuthology.orchestra.run.smithi027.stdout:uid [ unknown] Ceph.com (release key) 2024-04-19T04:20:48.881 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-19T04:20:48.881 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-19T04:20:48.881 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T04:20:48.898 INFO:teuthology.orchestra.run.smithi007.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-19T04:20:48.898 INFO:teuthology.orchestra.run.smithi007.stdout:uid [ unknown] Ceph.com (release key) 2024-04-19T04:20:48.899 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-19T04:20:48.899 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-19T04:20:48.899 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T04:20:49.018 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default/ 2024-04-19T04:20:49.019 INFO:teuthology.task.install.deb:Package version is 18.2.2-1237-g646b8c7d-1focal 2024-04-19T04:20:49.031 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default/ 2024-04-19T04:20:49.031 INFO:teuthology.task.install.deb:Package version is 18.2.2-1237-g646b8c7d-1focal 2024-04-19T04:20:49.108 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default/ 2024-04-19T04:20:49.108 INFO:teuthology.task.install.deb:Package version is 18.2.2-1237-g646b8c7d-1focal 2024-04-19T04:20:49.120 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default/ 2024-04-19T04:20:49.120 INFO:teuthology.task.install.deb:Package version is 18.2.2-1237-g646b8c7d-1focal 2024-04-19T04:20:49.132 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-19T04:20:49.132 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-19T04:20:49.156 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get update 2024-04-19T04:20:49.222 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-04-19T04:20:49.222 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-19T04:20:49.225 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-04-19T04:20:49.225 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-19T04:20:49.241 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get update 2024-04-19T04:20:49.242 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get update 2024-04-19T04:20:49.295 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-19T04:20:49.295 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-19T04:20:49.312 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get update 2024-04-19T04:20:49.390 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T04:20:49.390 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-19T04:20:49.399 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-19T04:20:49.420 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-19T04:20:49.470 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-19T04:20:49.471 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T04:20:49.471 INFO:teuthology.orchestra.run.smithi172.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal InRelease 2024-04-19T04:20:49.483 INFO:teuthology.orchestra.run.smithi027.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal InRelease 2024-04-19T04:20:49.505 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-04-19T04:20:49.511 INFO:teuthology.orchestra.run.smithi066.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal InRelease 2024-04-19T04:20:49.517 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-04-19T04:20:49.528 INFO:teuthology.orchestra.run.smithi027.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal Release.gpg 2024-04-19T04:20:49.540 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-19T04:20:49.556 INFO:teuthology.orchestra.run.smithi066.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-04-19T04:20:49.558 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-19T04:20:49.558 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T04:20:49.558 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main i386 Packages [3,427 B] 2024-04-19T04:20:49.569 INFO:teuthology.orchestra.run.smithi172.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal Release.gpg 2024-04-19T04:20:49.586 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T04:20:49.586 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-19T04:20:49.591 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2024-04-19T04:20:49.598 INFO:teuthology.orchestra.run.smithi007.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal InRelease 2024-04-19T04:20:49.604 INFO:teuthology.orchestra.run.smithi066.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal Release.gpg 2024-04-19T04:20:49.616 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2024-04-19T04:20:49.627 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-19T04:20:49.628 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-19T04:20:49.638 INFO:teuthology.orchestra.run.smithi007.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-04-19T04:20:49.644 INFO:teuthology.orchestra.run.smithi066.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main i386 Packages [3,427 B] 2024-04-19T04:20:49.655 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-19T04:20:49.665 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main i386 Packages [3,427 B] 2024-04-19T04:20:49.678 INFO:teuthology.orchestra.run.smithi007.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal Release.gpg 2024-04-19T04:20:49.694 INFO:teuthology.orchestra.run.smithi066.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2024-04-19T04:20:49.711 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-19T04:20:49.715 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2024-04-19T04:20:49.737 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-19T04:20:49.764 INFO:teuthology.orchestra.run.smithi007.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main i386 Packages [3,427 B] 2024-04-19T04:20:50.057 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 28.4 kB in 1s (44.1 kB/s) 2024-04-19T04:20:50.103 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 28.4 kB in 1s (38.3 kB/s) 2024-04-19T04:20:50.223 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 28.4 kB in 1s (37.1 kB/s) 2024-04-19T04:20:50.243 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 28.4 kB in 1s (37.3 kB/s) 2024-04-19T04:20:51.205 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2024-04-19T04:20:51.233 DEBUG:teuthology.orchestra.run.smithi066:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1237-g646b8c7d-1focal cephadm=18.2.2-1237-g646b8c7d-1focal ceph-mds=18.2.2-1237-g646b8c7d-1focal ceph-mgr=18.2.2-1237-g646b8c7d-1focal ceph-common=18.2.2-1237-g646b8c7d-1focal ceph-fuse=18.2.2-1237-g646b8c7d-1focal ceph-test=18.2.2-1237-g646b8c7d-1focal ceph-volume=18.2.2-1237-g646b8c7d-1focal radosgw=18.2.2-1237-g646b8c7d-1focal python3-rados=18.2.2-1237-g646b8c7d-1focal python3-rgw=18.2.2-1237-g646b8c7d-1focal python3-cephfs=18.2.2-1237-g646b8c7d-1focal python3-rbd=18.2.2-1237-g646b8c7d-1focal libcephfs2=18.2.2-1237-g646b8c7d-1focal libcephfs-dev=18.2.2-1237-g646b8c7d-1focal librados2=18.2.2-1237-g646b8c7d-1focal librbd1=18.2.2-1237-g646b8c7d-1focal rbd-fuse=18.2.2-1237-g646b8c7d-1focal 2024-04-19T04:20:51.303 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2024-04-19T04:20:51.319 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-04-19T04:20:51.347 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1237-g646b8c7d-1focal cephadm=18.2.2-1237-g646b8c7d-1focal ceph-mds=18.2.2-1237-g646b8c7d-1focal ceph-mgr=18.2.2-1237-g646b8c7d-1focal ceph-common=18.2.2-1237-g646b8c7d-1focal ceph-fuse=18.2.2-1237-g646b8c7d-1focal ceph-test=18.2.2-1237-g646b8c7d-1focal ceph-volume=18.2.2-1237-g646b8c7d-1focal radosgw=18.2.2-1237-g646b8c7d-1focal python3-rados=18.2.2-1237-g646b8c7d-1focal python3-rgw=18.2.2-1237-g646b8c7d-1focal python3-cephfs=18.2.2-1237-g646b8c7d-1focal python3-rbd=18.2.2-1237-g646b8c7d-1focal libcephfs2=18.2.2-1237-g646b8c7d-1focal libcephfs-dev=18.2.2-1237-g646b8c7d-1focal librados2=18.2.2-1237-g646b8c7d-1focal librbd1=18.2.2-1237-g646b8c7d-1focal rbd-fuse=18.2.2-1237-g646b8c7d-1focal 2024-04-19T04:20:51.370 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-04-19T04:20:51.397 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1237-g646b8c7d-1focal cephadm=18.2.2-1237-g646b8c7d-1focal ceph-mds=18.2.2-1237-g646b8c7d-1focal ceph-mgr=18.2.2-1237-g646b8c7d-1focal ceph-common=18.2.2-1237-g646b8c7d-1focal ceph-fuse=18.2.2-1237-g646b8c7d-1focal ceph-test=18.2.2-1237-g646b8c7d-1focal ceph-volume=18.2.2-1237-g646b8c7d-1focal radosgw=18.2.2-1237-g646b8c7d-1focal python3-rados=18.2.2-1237-g646b8c7d-1focal python3-rgw=18.2.2-1237-g646b8c7d-1focal python3-cephfs=18.2.2-1237-g646b8c7d-1focal python3-rbd=18.2.2-1237-g646b8c7d-1focal libcephfs2=18.2.2-1237-g646b8c7d-1focal libcephfs-dev=18.2.2-1237-g646b8c7d-1focal librados2=18.2.2-1237-g646b8c7d-1focal librbd1=18.2.2-1237-g646b8c7d-1focal rbd-fuse=18.2.2-1237-g646b8c7d-1focal 2024-04-19T04:20:51.397 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-04-19T04:20:51.416 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-04-19T04:20:51.423 DEBUG:teuthology.orchestra.run.smithi007:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1237-g646b8c7d-1focal cephadm=18.2.2-1237-g646b8c7d-1focal ceph-mds=18.2.2-1237-g646b8c7d-1focal ceph-mgr=18.2.2-1237-g646b8c7d-1focal ceph-common=18.2.2-1237-g646b8c7d-1focal ceph-fuse=18.2.2-1237-g646b8c7d-1focal ceph-test=18.2.2-1237-g646b8c7d-1focal ceph-volume=18.2.2-1237-g646b8c7d-1focal radosgw=18.2.2-1237-g646b8c7d-1focal python3-rados=18.2.2-1237-g646b8c7d-1focal python3-rgw=18.2.2-1237-g646b8c7d-1focal python3-cephfs=18.2.2-1237-g646b8c7d-1focal python3-rbd=18.2.2-1237-g646b8c7d-1focal libcephfs2=18.2.2-1237-g646b8c7d-1focal libcephfs-dev=18.2.2-1237-g646b8c7d-1focal librados2=18.2.2-1237-g646b8c7d-1focal librbd1=18.2.2-1237-g646b8c7d-1focal rbd-fuse=18.2.2-1237-g646b8c7d-1focal 2024-04-19T04:20:51.470 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-04-19T04:20:51.493 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-04-19T04:20:51.523 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2024-04-19T04:20:51.524 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2024-04-19T04:20:51.625 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2024-04-19T04:20:51.626 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2024-04-19T04:20:51.687 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2024-04-19T04:20:51.687 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2024-04-19T04:20:51.710 INFO:teuthology.orchestra.run.smithi007.stdout:Building dependency tree... 2024-04-19T04:20:51.711 INFO:teuthology.orchestra.run.smithi007.stdout:Reading state information... 2024-04-19T04:20:51.728 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T04:20:51.729 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-19T04:20:51.730 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T04:20:51.730 INFO:teuthology.orchestra.run.smithi066.stdout:The following additional packages will be installed: 2024-04-19T04:20:51.730 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-19T04:20:51.730 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-04-19T04:20:51.730 INFO:teuthology.orchestra.run.smithi066.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-04-19T04:20:51.730 INFO:teuthology.orchestra.run.smithi066.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-04-19T04:20:51.730 INFO:teuthology.orchestra.run.smithi066.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-04-19T04:20:51.735 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-04-19T04:20:51.735 INFO:teuthology.orchestra.run.smithi066.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-19T04:20:51.735 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-19T04:20:51.735 INFO:teuthology.orchestra.run.smithi066.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-19T04:20:51.735 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-04-19T04:20:51.735 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-04-19T04:20:51.735 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-19T04:20:51.735 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-19T04:20:51.736 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-19T04:20:51.736 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-19T04:20:51.736 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-19T04:20:51.736 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-04-19T04:20:51.736 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-19T04:20:51.736 INFO:teuthology.orchestra.run.smithi066.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-19T04:20:51.736 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-19T04:20:51.736 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-19T04:20:51.736 INFO:teuthology.orchestra.run.smithi066.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-19T04:20:51.736 INFO:teuthology.orchestra.run.smithi066.stdout:Suggested packages: 2024-04-19T04:20:51.736 INFO:teuthology.orchestra.run.smithi066.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-04-19T04:20:51.736 INFO:teuthology.orchestra.run.smithi066.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-04-19T04:20:51.736 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-04-19T04:20:51.736 INFO:teuthology.orchestra.run.smithi066.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-04-19T04:20:51.737 INFO:teuthology.orchestra.run.smithi066.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-04-19T04:20:51.737 INFO:teuthology.orchestra.run.smithi066.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-04-19T04:20:51.737 INFO:teuthology.orchestra.run.smithi066.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-04-19T04:20:51.737 INFO:teuthology.orchestra.run.smithi066.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-19T04:20:51.737 INFO:teuthology.orchestra.run.smithi066.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-04-19T04:20:51.737 INFO:teuthology.orchestra.run.smithi066.stdout:Recommended packages: 2024-04-19T04:20:51.737 INFO:teuthology.orchestra.run.smithi066.stdout: btrfs-tools 2024-04-19T04:20:51.809 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T04:20:51.810 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-19T04:20:51.811 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T04:20:51.811 INFO:teuthology.orchestra.run.smithi172.stdout:The following additional packages will be installed: 2024-04-19T04:20:51.811 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-19T04:20:51.811 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-04-19T04:20:51.811 INFO:teuthology.orchestra.run.smithi172.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-04-19T04:20:51.811 INFO:teuthology.orchestra.run.smithi172.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-04-19T04:20:51.811 INFO:teuthology.orchestra.run.smithi172.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-04-19T04:20:51.813 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-04-19T04:20:51.813 INFO:teuthology.orchestra.run.smithi172.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-19T04:20:51.813 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-19T04:20:51.813 INFO:teuthology.orchestra.run.smithi172.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-19T04:20:51.813 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-04-19T04:20:51.813 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-04-19T04:20:51.813 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-19T04:20:51.813 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-19T04:20:51.813 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-19T04:20:51.814 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-19T04:20:51.814 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-19T04:20:51.814 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-04-19T04:20:51.814 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-19T04:20:51.814 INFO:teuthology.orchestra.run.smithi172.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-19T04:20:51.814 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-19T04:20:51.814 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-19T04:20:51.814 INFO:teuthology.orchestra.run.smithi172.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-19T04:20:51.814 INFO:teuthology.orchestra.run.smithi172.stdout:Suggested packages: 2024-04-19T04:20:51.814 INFO:teuthology.orchestra.run.smithi172.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-04-19T04:20:51.814 INFO:teuthology.orchestra.run.smithi172.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-04-19T04:20:51.814 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-04-19T04:20:51.814 INFO:teuthology.orchestra.run.smithi172.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-04-19T04:20:51.814 INFO:teuthology.orchestra.run.smithi172.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-04-19T04:20:51.815 INFO:teuthology.orchestra.run.smithi172.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-04-19T04:20:51.815 INFO:teuthology.orchestra.run.smithi172.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-04-19T04:20:51.815 INFO:teuthology.orchestra.run.smithi172.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-19T04:20:51.815 INFO:teuthology.orchestra.run.smithi172.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-04-19T04:20:51.815 INFO:teuthology.orchestra.run.smithi172.stdout:Recommended packages: 2024-04-19T04:20:51.815 INFO:teuthology.orchestra.run.smithi172.stdout: btrfs-tools 2024-04-19T04:20:51.850 INFO:teuthology.orchestra.run.smithi066.stdout:The following NEW packages will be installed: 2024-04-19T04:20:51.850 INFO:teuthology.orchestra.run.smithi066.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-19T04:20:51.850 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-19T04:20:51.850 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-19T04:20:51.850 INFO:teuthology.orchestra.run.smithi066.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-04-19T04:20:51.850 INFO:teuthology.orchestra.run.smithi066.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-04-19T04:20:51.850 INFO:teuthology.orchestra.run.smithi066.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-19T04:20:51.850 INFO:teuthology.orchestra.run.smithi066.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-04-19T04:20:51.851 INFO:teuthology.orchestra.run.smithi066.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-04-19T04:20:51.851 INFO:teuthology.orchestra.run.smithi066.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-04-19T04:20:51.851 INFO:teuthology.orchestra.run.smithi066.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-04-19T04:20:51.851 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-19T04:20:51.852 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-04-19T04:20:51.852 INFO:teuthology.orchestra.run.smithi066.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-04-19T04:20:51.852 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-19T04:20:51.852 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-19T04:20:51.852 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-19T04:20:51.852 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-19T04:20:51.852 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-19T04:20:51.852 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-04-19T04:20:51.852 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-04-19T04:20:51.852 INFO:teuthology.orchestra.run.smithi066.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-19T04:20:51.852 INFO:teuthology.orchestra.run.smithi066.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-04-19T04:20:51.852 INFO:teuthology.orchestra.run.smithi066.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-04-19T04:20:51.852 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-04-19T04:20:51.852 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet 2024-04-19T04:20:51.853 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be upgraded: 2024-04-19T04:20:51.853 INFO:teuthology.orchestra.run.smithi066.stdout: librados2 librbd1 2024-04-19T04:20:51.888 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T04:20:51.889 INFO:teuthology.orchestra.run.smithi027.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-19T04:20:51.889 INFO:teuthology.orchestra.run.smithi027.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T04:20:51.889 INFO:teuthology.orchestra.run.smithi027.stdout:The following additional packages will be installed: 2024-04-19T04:20:51.889 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-19T04:20:51.890 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-04-19T04:20:51.890 INFO:teuthology.orchestra.run.smithi027.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-04-19T04:20:51.890 INFO:teuthology.orchestra.run.smithi027.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-04-19T04:20:51.891 INFO:teuthology.orchestra.run.smithi027.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-04-19T04:20:51.891 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-04-19T04:20:51.891 INFO:teuthology.orchestra.run.smithi027.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-19T04:20:51.891 INFO:teuthology.orchestra.run.smithi027.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-19T04:20:51.891 INFO:teuthology.orchestra.run.smithi027.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-19T04:20:51.891 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-04-19T04:20:51.891 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-04-19T04:20:51.891 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-19T04:20:51.891 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-19T04:20:51.891 INFO:teuthology.orchestra.run.smithi027.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-19T04:20:51.891 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-19T04:20:51.891 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-19T04:20:51.891 INFO:teuthology.orchestra.run.smithi027.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-04-19T04:20:51.891 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-19T04:20:51.892 INFO:teuthology.orchestra.run.smithi027.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-19T04:20:51.892 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-19T04:20:51.892 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-19T04:20:51.892 INFO:teuthology.orchestra.run.smithi027.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-19T04:20:51.892 INFO:teuthology.orchestra.run.smithi027.stdout:Suggested packages: 2024-04-19T04:20:51.892 INFO:teuthology.orchestra.run.smithi027.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-04-19T04:20:51.892 INFO:teuthology.orchestra.run.smithi027.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-04-19T04:20:51.892 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-04-19T04:20:51.892 INFO:teuthology.orchestra.run.smithi027.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-04-19T04:20:51.892 INFO:teuthology.orchestra.run.smithi027.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-04-19T04:20:51.892 INFO:teuthology.orchestra.run.smithi027.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-04-19T04:20:51.893 INFO:teuthology.orchestra.run.smithi027.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-04-19T04:20:51.893 INFO:teuthology.orchestra.run.smithi027.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-19T04:20:51.893 INFO:teuthology.orchestra.run.smithi027.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-04-19T04:20:51.893 INFO:teuthology.orchestra.run.smithi027.stdout:Recommended packages: 2024-04-19T04:20:51.893 INFO:teuthology.orchestra.run.smithi027.stdout: btrfs-tools 2024-04-19T04:20:51.920 INFO:teuthology.orchestra.run.smithi007.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T04:20:51.922 INFO:teuthology.orchestra.run.smithi007.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-19T04:20:51.922 INFO:teuthology.orchestra.run.smithi007.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T04:20:51.922 INFO:teuthology.orchestra.run.smithi007.stdout:The following additional packages will be installed: 2024-04-19T04:20:51.922 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-19T04:20:51.922 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-04-19T04:20:51.922 INFO:teuthology.orchestra.run.smithi007.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-04-19T04:20:51.922 INFO:teuthology.orchestra.run.smithi007.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-04-19T04:20:51.922 INFO:teuthology.orchestra.run.smithi007.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-04-19T04:20:51.923 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-04-19T04:20:51.924 INFO:teuthology.orchestra.run.smithi007.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-19T04:20:51.924 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-19T04:20:51.924 INFO:teuthology.orchestra.run.smithi007.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-19T04:20:51.924 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-04-19T04:20:51.924 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-04-19T04:20:51.924 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-19T04:20:51.924 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-19T04:20:51.924 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-19T04:20:51.924 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-19T04:20:51.924 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-19T04:20:51.924 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-04-19T04:20:51.924 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-19T04:20:51.924 INFO:teuthology.orchestra.run.smithi007.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-19T04:20:51.925 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-19T04:20:51.925 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-19T04:20:51.925 INFO:teuthology.orchestra.run.smithi007.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-19T04:20:51.925 INFO:teuthology.orchestra.run.smithi007.stdout:Suggested packages: 2024-04-19T04:20:51.925 INFO:teuthology.orchestra.run.smithi007.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-04-19T04:20:51.925 INFO:teuthology.orchestra.run.smithi007.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-04-19T04:20:51.925 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-04-19T04:20:51.925 INFO:teuthology.orchestra.run.smithi007.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-04-19T04:20:51.926 INFO:teuthology.orchestra.run.smithi007.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-04-19T04:20:51.926 INFO:teuthology.orchestra.run.smithi007.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-04-19T04:20:51.926 INFO:teuthology.orchestra.run.smithi007.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-04-19T04:20:51.926 INFO:teuthology.orchestra.run.smithi007.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-19T04:20:51.926 INFO:teuthology.orchestra.run.smithi007.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-04-19T04:20:51.926 INFO:teuthology.orchestra.run.smithi007.stdout:Recommended packages: 2024-04-19T04:20:51.926 INFO:teuthology.orchestra.run.smithi007.stdout: btrfs-tools 2024-04-19T04:20:51.927 INFO:teuthology.orchestra.run.smithi172.stdout:The following NEW packages will be installed: 2024-04-19T04:20:51.927 INFO:teuthology.orchestra.run.smithi172.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-19T04:20:51.927 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-19T04:20:51.927 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-19T04:20:51.927 INFO:teuthology.orchestra.run.smithi172.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-04-19T04:20:51.928 INFO:teuthology.orchestra.run.smithi172.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-04-19T04:20:51.928 INFO:teuthology.orchestra.run.smithi172.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-19T04:20:51.928 INFO:teuthology.orchestra.run.smithi172.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-04-19T04:20:51.929 INFO:teuthology.orchestra.run.smithi172.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-04-19T04:20:51.930 INFO:teuthology.orchestra.run.smithi172.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-04-19T04:20:51.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-04-19T04:20:51.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-19T04:20:51.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-04-19T04:20:51.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-04-19T04:20:51.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-19T04:20:51.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-19T04:20:51.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-19T04:20:51.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-19T04:20:51.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-19T04:20:51.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-04-19T04:20:51.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-04-19T04:20:51.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-19T04:20:51.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-04-19T04:20:51.931 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-04-19T04:20:51.931 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-04-19T04:20:51.931 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet 2024-04-19T04:20:51.931 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages will be upgraded: 2024-04-19T04:20:51.931 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 librbd1 2024-04-19T04:20:52.003 INFO:teuthology.orchestra.run.smithi066.stdout:2 upgraded, 110 newly installed, 0 to remove and 277 not upgraded. 2024-04-19T04:20:52.003 INFO:teuthology.orchestra.run.smithi066.stdout:Need to get 198 MB of archives. 2024-04-19T04:20:52.003 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 975 MB of additional disk space will be used. 2024-04-19T04:20:52.003 INFO:teuthology.orchestra.run.smithi066.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1237-g646b8c7d-1focal [3,444 kB] 2024-04-19T04:20:52.015 INFO:teuthology.orchestra.run.smithi027.stdout:The following NEW packages will be installed: 2024-04-19T04:20:52.016 INFO:teuthology.orchestra.run.smithi027.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-19T04:20:52.016 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-19T04:20:52.016 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-19T04:20:52.016 INFO:teuthology.orchestra.run.smithi027.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-04-19T04:20:52.016 INFO:teuthology.orchestra.run.smithi027.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-04-19T04:20:52.016 INFO:teuthology.orchestra.run.smithi027.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-19T04:20:52.016 INFO:teuthology.orchestra.run.smithi027.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-04-19T04:20:52.017 INFO:teuthology.orchestra.run.smithi027.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-04-19T04:20:52.017 INFO:teuthology.orchestra.run.smithi027.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-04-19T04:20:52.017 INFO:teuthology.orchestra.run.smithi027.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-04-19T04:20:52.017 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-19T04:20:52.017 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-04-19T04:20:52.017 INFO:teuthology.orchestra.run.smithi027.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-04-19T04:20:52.018 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-19T04:20:52.018 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-19T04:20:52.018 INFO:teuthology.orchestra.run.smithi027.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-19T04:20:52.018 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-19T04:20:52.018 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-19T04:20:52.018 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-04-19T04:20:52.018 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-04-19T04:20:52.018 INFO:teuthology.orchestra.run.smithi027.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-19T04:20:52.018 INFO:teuthology.orchestra.run.smithi027.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-04-19T04:20:52.018 INFO:teuthology.orchestra.run.smithi027.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-04-19T04:20:52.018 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-04-19T04:20:52.018 INFO:teuthology.orchestra.run.smithi027.stdout: xmlstarlet 2024-04-19T04:20:52.018 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages will be upgraded: 2024-04-19T04:20:52.019 INFO:teuthology.orchestra.run.smithi027.stdout: librados2 librbd1 2024-04-19T04:20:52.045 INFO:teuthology.orchestra.run.smithi066.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-04-19T04:20:52.045 INFO:teuthology.orchestra.run.smithi007.stdout:The following NEW packages will be installed: 2024-04-19T04:20:52.045 INFO:teuthology.orchestra.run.smithi007.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-19T04:20:52.045 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-19T04:20:52.045 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-19T04:20:52.047 INFO:teuthology.orchestra.run.smithi007.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-04-19T04:20:52.047 INFO:teuthology.orchestra.run.smithi007.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-04-19T04:20:52.048 INFO:teuthology.orchestra.run.smithi007.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-19T04:20:52.048 INFO:teuthology.orchestra.run.smithi007.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-04-19T04:20:52.048 INFO:teuthology.orchestra.run.smithi007.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-04-19T04:20:52.048 INFO:teuthology.orchestra.run.smithi007.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-04-19T04:20:52.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-04-19T04:20:52.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-19T04:20:52.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-04-19T04:20:52.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-04-19T04:20:52.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-19T04:20:52.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-19T04:20:52.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-19T04:20:52.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-19T04:20:52.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-19T04:20:52.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-04-19T04:20:52.049 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-04-19T04:20:52.049 INFO:teuthology.orchestra.run.smithi007.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-19T04:20:52.049 INFO:teuthology.orchestra.run.smithi007.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-04-19T04:20:52.049 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-04-19T04:20:52.049 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-04-19T04:20:52.049 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet 2024-04-19T04:20:52.049 INFO:teuthology.orchestra.run.smithi007.stdout:The following packages will be upgraded: 2024-04-19T04:20:52.050 INFO:teuthology.orchestra.run.smithi007.stdout: librados2 librbd1 2024-04-19T04:20:52.091 INFO:teuthology.orchestra.run.smithi027.stdout:2 upgraded, 110 newly installed, 0 to remove and 277 not upgraded. 2024-04-19T04:20:52.091 INFO:teuthology.orchestra.run.smithi027.stdout:Need to get 198 MB of archives. 2024-04-19T04:20:52.091 INFO:teuthology.orchestra.run.smithi027.stdout:After this operation, 975 MB of additional disk space will be used. 2024-04-19T04:20:52.091 INFO:teuthology.orchestra.run.smithi027.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-04-19T04:20:52.120 INFO:teuthology.orchestra.run.smithi007.stdout:2 upgraded, 110 newly installed, 0 to remove and 277 not upgraded. 2024-04-19T04:20:52.120 INFO:teuthology.orchestra.run.smithi007.stdout:Need to get 198 MB of archives. 2024-04-19T04:20:52.120 INFO:teuthology.orchestra.run.smithi007.stdout:After this operation, 975 MB of additional disk space will be used. 2024-04-19T04:20:52.121 INFO:teuthology.orchestra.run.smithi007.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-04-19T04:20:52.123 INFO:teuthology.orchestra.run.smithi172.stdout:2 upgraded, 110 newly installed, 0 to remove and 277 not upgraded. 2024-04-19T04:20:52.123 INFO:teuthology.orchestra.run.smithi172.stdout:Need to get 198 MB of archives. 2024-04-19T04:20:52.123 INFO:teuthology.orchestra.run.smithi172.stdout:After this operation, 975 MB of additional disk space will be used. 2024-04-19T04:20:52.123 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-04-19T04:20:52.166 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1237-g646b8c7d-1focal [3,444 kB] 2024-04-19T04:20:52.194 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-04-19T04:20:52.195 INFO:teuthology.orchestra.run.smithi007.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1237-g646b8c7d-1focal [3,444 kB] 2024-04-19T04:20:52.198 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-04-19T04:20:52.216 INFO:teuthology.orchestra.run.smithi066.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1237-g646b8c7d-1focal [4,030 kB] 2024-04-19T04:20:52.219 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-04-19T04:20:52.222 INFO:teuthology.orchestra.run.smithi007.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-04-19T04:20:52.226 INFO:teuthology.orchestra.run.smithi007.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-04-19T04:20:52.248 INFO:teuthology.orchestra.run.smithi007.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-04-19T04:20:52.249 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1237-g646b8c7d-1focal [3,444 kB] 2024-04-19T04:20:52.304 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-04-19T04:20:52.308 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-04-19T04:20:52.327 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-04-19T04:20:52.333 INFO:teuthology.orchestra.run.smithi027.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-04-19T04:20:52.334 INFO:teuthology.orchestra.run.smithi027.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-04-19T04:20:52.335 INFO:teuthology.orchestra.run.smithi027.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-04-19T04:20:52.336 INFO:teuthology.orchestra.run.smithi027.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-04-19T04:20:52.344 INFO:teuthology.orchestra.run.smithi027.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-04-19T04:20:52.347 INFO:teuthology.orchestra.run.smithi027.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-04-19T04:20:52.357 INFO:teuthology.orchestra.run.smithi027.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-04-19T04:20:52.364 INFO:teuthology.orchestra.run.smithi007.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-04-19T04:20:52.373 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-04-19T04:20:52.398 INFO:teuthology.orchestra.run.smithi007.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-04-19T04:20:52.400 INFO:teuthology.orchestra.run.smithi027.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-04-19T04:20:52.401 INFO:teuthology.orchestra.run.smithi027.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-04-19T04:20:52.402 INFO:teuthology.orchestra.run.smithi027.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-04-19T04:20:52.404 INFO:teuthology.orchestra.run.smithi027.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-19T04:20:52.404 INFO:teuthology.orchestra.run.smithi027.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-04-19T04:20:52.405 INFO:teuthology.orchestra.run.smithi027.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-04-19T04:20:52.407 INFO:teuthology.orchestra.run.smithi027.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-04-19T04:20:52.407 INFO:teuthology.orchestra.run.smithi007.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-04-19T04:20:52.407 INFO:teuthology.orchestra.run.smithi007.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-04-19T04:20:52.408 INFO:teuthology.orchestra.run.smithi027.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-04-19T04:20:52.411 INFO:teuthology.orchestra.run.smithi027.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-04-19T04:20:52.413 INFO:teuthology.orchestra.run.smithi007.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-04-19T04:20:52.413 INFO:teuthology.orchestra.run.smithi066.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1237-g646b8c7d-1focal [744 kB] 2024-04-19T04:20:52.416 INFO:teuthology.orchestra.run.smithi007.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-04-19T04:20:52.430 INFO:teuthology.orchestra.run.smithi007.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-04-19T04:20:52.431 INFO:teuthology.orchestra.run.smithi007.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-04-19T04:20:52.433 INFO:teuthology.orchestra.run.smithi007.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-04-19T04:20:52.451 INFO:teuthology.orchestra.run.smithi066.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-04-19T04:20:52.454 INFO:teuthology.orchestra.run.smithi027.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-04-19T04:20:52.455 INFO:teuthology.orchestra.run.smithi027.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-04-19T04:20:52.460 INFO:teuthology.orchestra.run.smithi066.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1237-g646b8c7d-1focal [387 kB] 2024-04-19T04:20:52.464 INFO:teuthology.orchestra.run.smithi066.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-04-19T04:20:52.465 INFO:teuthology.orchestra.run.smithi027.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-04-19T04:20:52.465 INFO:teuthology.orchestra.run.smithi027.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-04-19T04:20:52.466 INFO:teuthology.orchestra.run.smithi027.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-04-19T04:20:52.466 INFO:teuthology.orchestra.run.smithi027.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-04-19T04:20:52.467 INFO:teuthology.orchestra.run.smithi027.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-04-19T04:20:52.469 INFO:teuthology.orchestra.run.smithi007.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-04-19T04:20:52.469 INFO:teuthology.orchestra.run.smithi027.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-04-19T04:20:52.470 INFO:teuthology.orchestra.run.smithi007.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-04-19T04:20:52.471 INFO:teuthology.orchestra.run.smithi007.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-04-19T04:20:52.473 INFO:teuthology.orchestra.run.smithi027.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-04-19T04:20:52.473 INFO:teuthology.orchestra.run.smithi007.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-19T04:20:52.474 INFO:teuthology.orchestra.run.smithi007.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-04-19T04:20:52.475 INFO:teuthology.orchestra.run.smithi007.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-04-19T04:20:52.476 INFO:teuthology.orchestra.run.smithi066.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1237-g646b8c7d-1focal [31.9 kB] 2024-04-19T04:20:52.477 INFO:teuthology.orchestra.run.smithi066.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1237-g646b8c7d-1focal [200 kB] 2024-04-19T04:20:52.500 INFO:teuthology.orchestra.run.smithi066.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1237-g646b8c7d-1focal [62.4 kB] 2024-04-19T04:20:52.502 INFO:teuthology.orchestra.run.smithi066.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1237-g646b8c7d-1focal [364 kB] 2024-04-19T04:20:52.506 INFO:teuthology.orchestra.run.smithi027.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-04-19T04:20:52.510 INFO:teuthology.orchestra.run.smithi027.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-04-19T04:20:52.514 INFO:teuthology.orchestra.run.smithi066.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1237-g646b8c7d-1focal [6,591 kB] 2024-04-19T04:20:52.515 INFO:teuthology.orchestra.run.smithi007.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-04-19T04:20:52.516 INFO:teuthology.orchestra.run.smithi007.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-04-19T04:20:52.518 INFO:teuthology.orchestra.run.smithi007.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-04-19T04:20:52.519 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-04-19T04:20:52.520 INFO:teuthology.orchestra.run.smithi007.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-04-19T04:20:52.533 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-04-19T04:20:52.549 INFO:teuthology.orchestra.run.smithi027.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-04-19T04:20:52.549 INFO:teuthology.orchestra.run.smithi066.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-04-19T04:20:52.550 INFO:teuthology.orchestra.run.smithi027.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-04-19T04:20:52.554 INFO:teuthology.orchestra.run.smithi027.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-04-19T04:20:52.554 INFO:teuthology.orchestra.run.smithi027.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-04-19T04:20:52.554 INFO:teuthology.orchestra.run.smithi027.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-04-19T04:20:52.555 INFO:teuthology.orchestra.run.smithi027.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-04-19T04:20:52.556 INFO:teuthology.orchestra.run.smithi027.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-04-19T04:20:52.557 INFO:teuthology.orchestra.run.smithi027.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-04-19T04:20:52.558 INFO:teuthology.orchestra.run.smithi007.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-04-19T04:20:52.568 INFO:teuthology.orchestra.run.smithi007.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-04-19T04:20:52.569 INFO:teuthology.orchestra.run.smithi007.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-04-19T04:20:52.570 INFO:teuthology.orchestra.run.smithi007.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-04-19T04:20:52.570 INFO:teuthology.orchestra.run.smithi007.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-04-19T04:20:52.571 INFO:teuthology.orchestra.run.smithi007.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-04-19T04:20:52.600 INFO:teuthology.orchestra.run.smithi027.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-04-19T04:20:52.604 INFO:teuthology.orchestra.run.smithi027.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-19T04:20:52.607 INFO:teuthology.orchestra.run.smithi007.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-04-19T04:20:52.613 INFO:teuthology.orchestra.run.smithi007.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-04-19T04:20:52.614 INFO:teuthology.orchestra.run.smithi007.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-04-19T04:20:52.617 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-04-19T04:20:52.618 INFO:teuthology.orchestra.run.smithi007.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-04-19T04:20:52.637 INFO:teuthology.orchestra.run.smithi007.stdout:Get:36 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1237-g646b8c7d-1focal [4,030 kB] 2024-04-19T04:20:52.650 INFO:teuthology.orchestra.run.smithi027.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-04-19T04:20:52.653 INFO:teuthology.orchestra.run.smithi027.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-04-19T04:20:52.655 INFO:teuthology.orchestra.run.smithi027.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-04-19T04:20:52.658 INFO:teuthology.orchestra.run.smithi027.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-04-19T04:20:52.658 INFO:teuthology.orchestra.run.smithi027.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-04-19T04:20:52.659 INFO:teuthology.orchestra.run.smithi027.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-04-19T04:20:52.660 INFO:teuthology.orchestra.run.smithi007.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-04-19T04:20:52.662 INFO:teuthology.orchestra.run.smithi007.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-04-19T04:20:52.663 INFO:teuthology.orchestra.run.smithi007.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-04-19T04:20:52.664 INFO:teuthology.orchestra.run.smithi007.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-04-19T04:20:52.665 INFO:teuthology.orchestra.run.smithi007.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-04-19T04:20:52.667 INFO:teuthology.orchestra.run.smithi007.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-04-19T04:20:52.721 INFO:teuthology.orchestra.run.smithi007.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-04-19T04:20:52.722 INFO:teuthology.orchestra.run.smithi007.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-04-19T04:20:52.723 INFO:teuthology.orchestra.run.smithi007.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-04-19T04:20:52.727 INFO:teuthology.orchestra.run.smithi007.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-19T04:20:52.766 INFO:teuthology.orchestra.run.smithi007.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-04-19T04:20:52.769 INFO:teuthology.orchestra.run.smithi007.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-04-19T04:20:52.772 INFO:teuthology.orchestra.run.smithi007.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-04-19T04:20:52.775 INFO:teuthology.orchestra.run.smithi007.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-04-19T04:20:52.776 INFO:teuthology.orchestra.run.smithi007.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-04-19T04:20:52.777 INFO:teuthology.orchestra.run.smithi007.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-04-19T04:20:52.792 INFO:teuthology.orchestra.run.smithi066.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-04-19T04:20:52.802 INFO:teuthology.orchestra.run.smithi066.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-04-19T04:20:52.830 INFO:teuthology.orchestra.run.smithi066.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-04-19T04:20:52.839 INFO:teuthology.orchestra.run.smithi066.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-04-19T04:20:52.839 INFO:teuthology.orchestra.run.smithi066.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-04-19T04:20:52.843 INFO:teuthology.orchestra.run.smithi066.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-04-19T04:20:52.844 INFO:teuthology.orchestra.run.smithi066.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-04-19T04:20:52.860 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-04-19T04:20:52.871 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-04-19T04:20:52.875 INFO:teuthology.orchestra.run.smithi066.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1237-g646b8c7d-1focal [113 kB] 2024-04-19T04:20:52.879 INFO:teuthology.orchestra.run.smithi066.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1237-g646b8c7d-1focal [476 kB] 2024-04-19T04:20:52.899 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-04-19T04:20:52.908 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-04-19T04:20:52.908 INFO:teuthology.orchestra.run.smithi172.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-04-19T04:20:52.912 INFO:teuthology.orchestra.run.smithi172.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-04-19T04:20:52.913 INFO:teuthology.orchestra.run.smithi172.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-04-19T04:20:52.918 INFO:teuthology.orchestra.run.smithi066.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1237-g646b8c7d-1focal [25.1 MB] 2024-04-19T04:20:52.977 INFO:teuthology.orchestra.run.smithi027.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-04-19T04:20:53.020 INFO:teuthology.orchestra.run.smithi066.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-04-19T04:20:53.040 INFO:teuthology.orchestra.run.smithi007.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1237-g646b8c7d-1focal [744 kB] 2024-04-19T04:20:53.042 INFO:teuthology.orchestra.run.smithi027.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-19T04:20:53.048 INFO:teuthology.orchestra.run.smithi027.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-04-19T04:20:53.089 INFO:teuthology.orchestra.run.smithi172.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-04-19T04:20:53.105 INFO:teuthology.orchestra.run.smithi027.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-04-19T04:20:53.105 INFO:teuthology.orchestra.run.smithi027.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-04-19T04:20:53.106 INFO:teuthology.orchestra.run.smithi027.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-04-19T04:20:53.107 INFO:teuthology.orchestra.run.smithi027.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-04-19T04:20:53.108 INFO:teuthology.orchestra.run.smithi027.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-04-19T04:20:53.109 INFO:teuthology.orchestra.run.smithi027.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-04-19T04:20:53.110 INFO:teuthology.orchestra.run.smithi027.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-04-19T04:20:53.111 INFO:teuthology.orchestra.run.smithi007.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-04-19T04:20:53.112 INFO:teuthology.orchestra.run.smithi027.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-04-19T04:20:53.113 INFO:teuthology.orchestra.run.smithi007.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1237-g646b8c7d-1focal [387 kB] 2024-04-19T04:20:53.131 INFO:teuthology.orchestra.run.smithi007.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1237-g646b8c7d-1focal [31.9 kB] 2024-04-19T04:20:53.132 INFO:teuthology.orchestra.run.smithi007.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1237-g646b8c7d-1focal [200 kB] 2024-04-19T04:20:53.133 INFO:teuthology.orchestra.run.smithi027.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-04-19T04:20:53.151 INFO:teuthology.orchestra.run.smithi027.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-04-19T04:20:53.159 INFO:teuthology.orchestra.run.smithi027.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-04-19T04:20:53.161 INFO:teuthology.orchestra.run.smithi007.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-19T04:20:53.163 INFO:teuthology.orchestra.run.smithi027.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-04-19T04:20:53.166 INFO:teuthology.orchestra.run.smithi007.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-04-19T04:20:53.170 INFO:teuthology.orchestra.run.smithi027.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-04-19T04:20:53.170 INFO:teuthology.orchestra.run.smithi027.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-04-19T04:20:53.176 INFO:teuthology.orchestra.run.smithi027.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-04-19T04:20:53.183 INFO:teuthology.orchestra.run.smithi027.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-04-19T04:20:53.187 INFO:teuthology.orchestra.run.smithi007.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1237-g646b8c7d-1focal [62.4 kB] 2024-04-19T04:20:53.189 INFO:teuthology.orchestra.run.smithi007.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1237-g646b8c7d-1focal [364 kB] 2024-04-19T04:20:53.205 INFO:teuthology.orchestra.run.smithi007.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1237-g646b8c7d-1focal [6,591 kB] 2024-04-19T04:20:53.223 INFO:teuthology.orchestra.run.smithi007.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-04-19T04:20:53.223 INFO:teuthology.orchestra.run.smithi007.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-04-19T04:20:53.224 INFO:teuthology.orchestra.run.smithi007.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-04-19T04:20:53.224 INFO:teuthology.orchestra.run.smithi007.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-04-19T04:20:53.225 INFO:teuthology.orchestra.run.smithi007.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-04-19T04:20:53.226 INFO:teuthology.orchestra.run.smithi007.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-04-19T04:20:53.226 INFO:teuthology.orchestra.run.smithi007.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-04-19T04:20:53.228 INFO:teuthology.orchestra.run.smithi007.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-04-19T04:20:53.237 INFO:teuthology.orchestra.run.smithi027.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-04-19T04:20:53.242 INFO:teuthology.orchestra.run.smithi027.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-04-19T04:20:53.246 INFO:teuthology.orchestra.run.smithi027.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-04-19T04:20:53.261 INFO:teuthology.orchestra.run.smithi007.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-04-19T04:20:53.268 INFO:teuthology.orchestra.run.smithi066.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-04-19T04:20:53.271 INFO:teuthology.orchestra.run.smithi007.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-04-19T04:20:53.278 INFO:teuthology.orchestra.run.smithi007.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-04-19T04:20:53.283 INFO:teuthology.orchestra.run.smithi007.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-04-19T04:20:53.286 INFO:teuthology.orchestra.run.smithi007.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-04-19T04:20:53.287 INFO:teuthology.orchestra.run.smithi007.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-04-19T04:20:53.297 INFO:teuthology.orchestra.run.smithi007.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-04-19T04:20:53.305 INFO:teuthology.orchestra.run.smithi007.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-04-19T04:20:53.344 INFO:teuthology.orchestra.run.smithi172.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-04-19T04:20:53.367 INFO:teuthology.orchestra.run.smithi007.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-04-19T04:20:53.374 INFO:teuthology.orchestra.run.smithi007.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-04-19T04:20:53.381 INFO:teuthology.orchestra.run.smithi007.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-04-19T04:20:53.389 INFO:teuthology.orchestra.run.smithi027.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-04-19T04:20:53.392 INFO:teuthology.orchestra.run.smithi027.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-04-19T04:20:53.392 INFO:teuthology.orchestra.run.smithi027.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-04-19T04:20:53.395 INFO:teuthology.orchestra.run.smithi027.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-04-19T04:20:53.428 INFO:teuthology.orchestra.run.smithi027.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-19T04:20:53.429 INFO:teuthology.orchestra.run.smithi027.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-04-19T04:20:53.433 INFO:teuthology.orchestra.run.smithi027.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-04-19T04:20:53.438 INFO:teuthology.orchestra.run.smithi027.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-04-19T04:20:53.439 INFO:teuthology.orchestra.run.smithi027.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-04-19T04:20:53.439 INFO:teuthology.orchestra.run.smithi066.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-04-19T04:20:53.452 INFO:teuthology.orchestra.run.smithi066.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-04-19T04:20:53.460 INFO:teuthology.orchestra.run.smithi066.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-04-19T04:20:53.466 INFO:teuthology.orchestra.run.smithi066.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-04-19T04:20:53.493 INFO:teuthology.orchestra.run.smithi066.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-19T04:20:53.498 INFO:teuthology.orchestra.run.smithi066.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-04-19T04:20:53.501 INFO:teuthology.orchestra.run.smithi066.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-04-19T04:20:53.517 INFO:teuthology.orchestra.run.smithi007.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-04-19T04:20:53.518 INFO:teuthology.orchestra.run.smithi172.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-04-19T04:20:53.519 INFO:teuthology.orchestra.run.smithi007.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-04-19T04:20:53.519 INFO:teuthology.orchestra.run.smithi007.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-04-19T04:20:53.520 INFO:teuthology.orchestra.run.smithi007.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-04-19T04:20:53.532 INFO:teuthology.orchestra.run.smithi172.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-04-19T04:20:53.532 INFO:teuthology.orchestra.run.smithi066.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-04-19T04:20:53.540 INFO:teuthology.orchestra.run.smithi066.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-04-19T04:20:53.540 INFO:teuthology.orchestra.run.smithi172.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-04-19T04:20:53.548 INFO:teuthology.orchestra.run.smithi172.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-04-19T04:20:53.553 INFO:teuthology.orchestra.run.smithi007.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-19T04:20:53.554 INFO:teuthology.orchestra.run.smithi007.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-04-19T04:20:53.557 INFO:teuthology.orchestra.run.smithi007.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-04-19T04:20:53.558 INFO:teuthology.orchestra.run.smithi007.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-04-19T04:20:53.558 INFO:teuthology.orchestra.run.smithi007.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-04-19T04:20:53.576 INFO:teuthology.orchestra.run.smithi172.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-19T04:20:53.582 INFO:teuthology.orchestra.run.smithi172.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-04-19T04:20:53.584 INFO:teuthology.orchestra.run.smithi172.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-04-19T04:20:53.614 INFO:teuthology.orchestra.run.smithi172.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-04-19T04:20:53.622 INFO:teuthology.orchestra.run.smithi172.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-04-19T04:20:53.723 INFO:teuthology.orchestra.run.smithi066.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-04-19T04:20:53.799 INFO:teuthology.orchestra.run.smithi007.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1237-g646b8c7d-1focal [113 kB] 2024-04-19T04:20:53.801 INFO:teuthology.orchestra.run.smithi007.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1237-g646b8c7d-1focal [476 kB] 2024-04-19T04:20:53.805 INFO:teuthology.orchestra.run.smithi172.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-04-19T04:20:53.807 INFO:teuthology.orchestra.run.smithi007.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1237-g646b8c7d-1focal [25.1 MB] 2024-04-19T04:20:53.937 INFO:teuthology.orchestra.run.smithi172.stdout:Get:25 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1237-g646b8c7d-1focal [4,030 kB] 2024-04-19T04:20:54.034 INFO:teuthology.orchestra.run.smithi066.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-04-19T04:20:54.046 INFO:teuthology.orchestra.run.smithi066.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-04-19T04:20:54.118 INFO:teuthology.orchestra.run.smithi172.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-04-19T04:20:54.130 INFO:teuthology.orchestra.run.smithi172.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-04-19T04:20:54.279 INFO:teuthology.orchestra.run.smithi066.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-04-19T04:20:54.280 INFO:teuthology.orchestra.run.smithi066.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-04-19T04:20:54.287 INFO:teuthology.orchestra.run.smithi066.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-04-19T04:20:54.294 INFO:teuthology.orchestra.run.smithi066.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-04-19T04:20:54.310 INFO:teuthology.orchestra.run.smithi066.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-04-19T04:20:54.337 INFO:teuthology.orchestra.run.smithi066.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-04-19T04:20:54.362 INFO:teuthology.orchestra.run.smithi066.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-04-19T04:20:54.364 INFO:teuthology.orchestra.run.smithi172.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-04-19T04:20:54.365 INFO:teuthology.orchestra.run.smithi172.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-04-19T04:20:54.368 INFO:teuthology.orchestra.run.smithi066.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-04-19T04:20:54.372 INFO:teuthology.orchestra.run.smithi172.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-04-19T04:20:54.379 INFO:teuthology.orchestra.run.smithi172.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-04-19T04:20:54.395 INFO:teuthology.orchestra.run.smithi172.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-04-19T04:20:54.422 INFO:teuthology.orchestra.run.smithi172.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-04-19T04:20:54.447 INFO:teuthology.orchestra.run.smithi172.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-04-19T04:20:54.453 INFO:teuthology.orchestra.run.smithi172.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-04-19T04:20:54.548 INFO:teuthology.orchestra.run.smithi066.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-04-19T04:20:54.634 INFO:teuthology.orchestra.run.smithi172.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-04-19T04:20:54.730 INFO:teuthology.orchestra.run.smithi066.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1237-g646b8c7d-1focal [9,603 kB] 2024-04-19T04:20:54.891 INFO:teuthology.orchestra.run.smithi066.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-04-19T04:20:54.910 INFO:teuthology.orchestra.run.smithi066.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-04-19T04:20:54.922 INFO:teuthology.orchestra.run.smithi066.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-04-19T04:20:54.942 INFO:teuthology.orchestra.run.smithi066.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-04-19T04:20:54.955 INFO:teuthology.orchestra.run.smithi066.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-04-19T04:20:54.980 INFO:teuthology.orchestra.run.smithi172.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-04-19T04:20:54.999 INFO:teuthology.orchestra.run.smithi172.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-04-19T04:20:55.007 INFO:teuthology.orchestra.run.smithi066.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-04-19T04:20:55.011 INFO:teuthology.orchestra.run.smithi172.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-04-19T04:20:55.012 INFO:teuthology.orchestra.run.smithi066.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-04-19T04:20:55.027 INFO:teuthology.orchestra.run.smithi066.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-04-19T04:20:55.031 INFO:teuthology.orchestra.run.smithi172.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-04-19T04:20:55.037 INFO:teuthology.orchestra.run.smithi066.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-04-19T04:20:55.044 INFO:teuthology.orchestra.run.smithi172.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-04-19T04:20:55.091 INFO:teuthology.orchestra.run.smithi066.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-19T04:20:55.097 INFO:teuthology.orchestra.run.smithi172.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-04-19T04:20:55.102 INFO:teuthology.orchestra.run.smithi172.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-04-19T04:20:55.118 INFO:teuthology.orchestra.run.smithi172.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-04-19T04:20:55.127 INFO:teuthology.orchestra.run.smithi172.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-04-19T04:20:55.181 INFO:teuthology.orchestra.run.smithi172.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-19T04:20:55.258 INFO:teuthology.orchestra.run.smithi066.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-04-19T04:20:55.348 INFO:teuthology.orchestra.run.smithi172.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-04-19T04:20:55.398 INFO:teuthology.orchestra.run.smithi066.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1237-g646b8c7d-1focal [238 kB] 2024-04-19T04:20:55.410 INFO:teuthology.orchestra.run.smithi066.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1237-g646b8c7d-1focal [147 kB] 2024-04-19T04:20:55.416 INFO:teuthology.orchestra.run.smithi066.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1237-g646b8c7d-1focal [1,572 kB] 2024-04-19T04:20:55.428 INFO:teuthology.orchestra.run.smithi027.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1237-g646b8c7d-1focal [4,030 kB] 2024-04-19T04:20:55.544 INFO:teuthology.orchestra.run.smithi066.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1237-g646b8c7d-1focal [6,636 kB] 2024-04-19T04:20:55.606 INFO:teuthology.orchestra.run.smithi066.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-04-19T04:20:55.634 INFO:teuthology.orchestra.run.smithi007.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1237-g646b8c7d-1focal [9,603 kB] 2024-04-19T04:20:55.664 INFO:teuthology.orchestra.run.smithi066.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-04-19T04:20:55.700 INFO:teuthology.orchestra.run.smithi172.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-04-19T04:20:55.730 INFO:teuthology.orchestra.run.smithi066.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-04-19T04:20:55.736 INFO:teuthology.orchestra.run.smithi066.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-04-19T04:20:55.752 INFO:teuthology.orchestra.run.smithi066.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-04-19T04:20:55.759 INFO:teuthology.orchestra.run.smithi172.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-04-19T04:20:55.824 INFO:teuthology.orchestra.run.smithi172.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-04-19T04:20:55.832 INFO:teuthology.orchestra.run.smithi172.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-04-19T04:20:55.847 INFO:teuthology.orchestra.run.smithi172.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-04-19T04:20:55.918 INFO:teuthology.orchestra.run.smithi172.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1237-g646b8c7d-1focal [744 kB] 2024-04-19T04:20:56.048 INFO:teuthology.orchestra.run.smithi066.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1237-g646b8c7d-1focal [24.5 MB] 2024-04-19T04:20:56.270 INFO:teuthology.orchestra.run.smithi172.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1237-g646b8c7d-1focal [387 kB] 2024-04-19T04:20:56.273 INFO:teuthology.orchestra.run.smithi007.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1237-g646b8c7d-1focal [238 kB] 2024-04-19T04:20:56.277 INFO:teuthology.orchestra.run.smithi007.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1237-g646b8c7d-1focal [147 kB] 2024-04-19T04:20:56.281 INFO:teuthology.orchestra.run.smithi007.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1237-g646b8c7d-1focal [1,572 kB] 2024-04-19T04:20:56.324 INFO:teuthology.orchestra.run.smithi066.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-04-19T04:20:56.347 INFO:teuthology.orchestra.run.smithi066.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-19T04:20:56.349 INFO:teuthology.orchestra.run.smithi066.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-04-19T04:20:56.354 INFO:teuthology.orchestra.run.smithi007.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1237-g646b8c7d-1focal [6,636 kB] 2024-04-19T04:20:56.372 INFO:teuthology.orchestra.run.smithi172.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-04-19T04:20:56.427 INFO:teuthology.orchestra.run.smithi172.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-19T04:20:56.429 INFO:teuthology.orchestra.run.smithi172.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-04-19T04:20:56.430 INFO:teuthology.orchestra.run.smithi066.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-04-19T04:20:56.430 INFO:teuthology.orchestra.run.smithi066.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-04-19T04:20:56.453 INFO:teuthology.orchestra.run.smithi172.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1237-g646b8c7d-1focal [31.9 kB] 2024-04-19T04:20:56.461 INFO:teuthology.orchestra.run.smithi172.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1237-g646b8c7d-1focal [200 kB] 2024-04-19T04:20:56.500 INFO:teuthology.orchestra.run.smithi172.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-04-19T04:20:56.500 INFO:teuthology.orchestra.run.smithi172.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-04-19T04:20:56.557 INFO:teuthology.orchestra.run.smithi172.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1237-g646b8c7d-1focal [62.4 kB] 2024-04-19T04:20:56.595 INFO:teuthology.orchestra.run.smithi066.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-04-19T04:20:56.596 INFO:teuthology.orchestra.run.smithi172.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1237-g646b8c7d-1focal [364 kB] 2024-04-19T04:20:56.664 INFO:teuthology.orchestra.run.smithi172.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-04-19T04:20:56.788 INFO:teuthology.orchestra.run.smithi172.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1237-g646b8c7d-1focal [6,591 kB] 2024-04-19T04:20:56.792 INFO:teuthology.orchestra.run.smithi066.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-04-19T04:20:56.832 INFO:teuthology.orchestra.run.smithi007.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1237-g646b8c7d-1focal [24.5 MB] 2024-04-19T04:20:56.835 INFO:teuthology.orchestra.run.smithi066.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-04-19T04:20:56.867 INFO:teuthology.orchestra.run.smithi172.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-04-19T04:20:56.899 INFO:teuthology.orchestra.run.smithi066.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-04-19T04:20:56.912 INFO:teuthology.orchestra.run.smithi172.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-04-19T04:20:56.918 INFO:teuthology.orchestra.run.smithi066.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-04-19T04:20:56.981 INFO:teuthology.orchestra.run.smithi172.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-04-19T04:20:56.997 INFO:teuthology.orchestra.run.smithi066.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-04-19T04:20:57.007 INFO:teuthology.orchestra.run.smithi066.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-04-19T04:20:57.009 INFO:teuthology.orchestra.run.smithi172.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-04-19T04:20:57.026 INFO:teuthology.orchestra.run.smithi066.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-04-19T04:20:57.085 INFO:teuthology.orchestra.run.smithi172.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-04-19T04:20:57.095 INFO:teuthology.orchestra.run.smithi172.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-04-19T04:20:57.117 INFO:teuthology.orchestra.run.smithi172.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-04-19T04:20:57.123 INFO:teuthology.orchestra.run.smithi066.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-04-19T04:20:57.153 INFO:teuthology.orchestra.run.smithi066.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-04-19T04:20:57.174 INFO:teuthology.orchestra.run.smithi066.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-04-19T04:20:57.212 INFO:teuthology.orchestra.run.smithi172.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-04-19T04:20:57.242 INFO:teuthology.orchestra.run.smithi172.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-04-19T04:20:57.264 INFO:teuthology.orchestra.run.smithi172.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-04-19T04:20:57.347 INFO:teuthology.orchestra.run.smithi066.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-04-19T04:20:57.437 INFO:teuthology.orchestra.run.smithi172.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-04-19T04:20:57.832 INFO:teuthology.orchestra.run.smithi066.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-04-19T04:20:57.882 INFO:teuthology.orchestra.run.smithi066.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-04-19T04:20:57.928 INFO:teuthology.orchestra.run.smithi172.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-04-19T04:20:57.977 INFO:teuthology.orchestra.run.smithi172.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-04-19T04:20:58.156 INFO:teuthology.orchestra.run.smithi066.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-04-19T04:20:58.157 INFO:teuthology.orchestra.run.smithi066.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1237-g646b8c7d-1focal [13.7 kB] 2024-04-19T04:20:58.157 INFO:teuthology.orchestra.run.smithi066.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1237-g646b8c7d-1focal [853 kB] 2024-04-19T04:20:58.164 INFO:teuthology.orchestra.run.smithi066.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-04-19T04:20:58.167 INFO:teuthology.orchestra.run.smithi066.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1237-g646b8c7d-1focal [2,290 kB] 2024-04-19T04:20:58.169 INFO:teuthology.orchestra.run.smithi066.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-04-19T04:20:58.206 INFO:teuthology.orchestra.run.smithi172.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-04-19T04:20:58.217 INFO:teuthology.orchestra.run.smithi172.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-04-19T04:20:58.227 INFO:teuthology.orchestra.run.smithi172.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-04-19T04:20:58.314 INFO:teuthology.orchestra.run.smithi066.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-04-19T04:20:58.316 INFO:teuthology.orchestra.run.smithi066.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-04-19T04:20:58.316 INFO:teuthology.orchestra.run.smithi066.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-04-19T04:20:58.318 INFO:teuthology.orchestra.run.smithi066.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-04-19T04:20:58.347 INFO:teuthology.orchestra.run.smithi066.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-19T04:20:58.383 INFO:teuthology.orchestra.run.smithi172.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-04-19T04:20:58.384 INFO:teuthology.orchestra.run.smithi172.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-04-19T04:20:58.385 INFO:teuthology.orchestra.run.smithi172.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-04-19T04:20:58.386 INFO:teuthology.orchestra.run.smithi172.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-04-19T04:20:58.394 INFO:teuthology.orchestra.run.smithi066.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1237-g646b8c7d-1focal [237 kB] 2024-04-19T04:20:58.415 INFO:teuthology.orchestra.run.smithi066.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1237-g646b8c7d-1focal [142 kB] 2024-04-19T04:20:58.420 INFO:teuthology.orchestra.run.smithi066.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1237-g646b8c7d-1focal [7,011 kB] 2024-04-19T04:20:58.434 INFO:teuthology.orchestra.run.smithi172.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-19T04:20:58.512 INFO:teuthology.orchestra.run.smithi066.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-04-19T04:20:58.599 INFO:teuthology.orchestra.run.smithi172.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-04-19T04:20:58.899 INFO:teuthology.orchestra.run.smithi066.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-04-19T04:20:58.910 INFO:teuthology.orchestra.run.smithi066.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-04-19T04:20:58.931 INFO:teuthology.orchestra.run.smithi066.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-04-19T04:20:58.987 INFO:teuthology.orchestra.run.smithi172.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-04-19T04:20:58.996 INFO:teuthology.orchestra.run.smithi172.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-04-19T04:20:59.018 INFO:teuthology.orchestra.run.smithi172.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-04-19T04:20:59.023 INFO:teuthology.orchestra.run.smithi027.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1237-g646b8c7d-1focal [744 kB] 2024-04-19T04:20:59.150 INFO:teuthology.orchestra.run.smithi066.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1237-g646b8c7d-1focal [7,891 kB] 2024-04-19T04:20:59.322 INFO:teuthology.orchestra.run.smithi007.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1237-g646b8c7d-1focal [13.7 kB] 2024-04-19T04:20:59.323 INFO:teuthology.orchestra.run.smithi007.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1237-g646b8c7d-1focal [853 kB] 2024-04-19T04:20:59.345 INFO:teuthology.orchestra.run.smithi007.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1237-g646b8c7d-1focal [2,290 kB] 2024-04-19T04:20:59.654 INFO:teuthology.orchestra.run.smithi007.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1237-g646b8c7d-1focal [237 kB] 2024-04-19T04:20:59.696 INFO:teuthology.orchestra.run.smithi007.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1237-g646b8c7d-1focal [142 kB] 2024-04-19T04:20:59.700 INFO:teuthology.orchestra.run.smithi007.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1237-g646b8c7d-1focal [7,011 kB] 2024-04-19T04:20:59.965 INFO:teuthology.orchestra.run.smithi066.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1237-g646b8c7d-1focal [13.8 kB] 2024-04-19T04:20:59.966 INFO:teuthology.orchestra.run.smithi066.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1237-g646b8c7d-1focal [46.7 MB] 2024-04-19T04:21:00.023 INFO:teuthology.orchestra.run.smithi027.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1237-g646b8c7d-1focal [387 kB] 2024-04-19T04:21:00.516 INFO:teuthology.orchestra.run.smithi007.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1237-g646b8c7d-1focal [7,891 kB] 2024-04-19T04:21:00.636 INFO:teuthology.orchestra.run.smithi027.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1237-g646b8c7d-1focal [31.9 kB] 2024-04-19T04:21:00.698 INFO:teuthology.orchestra.run.smithi027.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1237-g646b8c7d-1focal [200 kB] 2024-04-19T04:21:00.984 INFO:teuthology.orchestra.run.smithi027.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1237-g646b8c7d-1focal [62.4 kB] 2024-04-19T04:21:01.103 INFO:teuthology.orchestra.run.smithi027.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1237-g646b8c7d-1focal [364 kB] 2024-04-19T04:21:01.375 INFO:teuthology.orchestra.run.smithi007.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1237-g646b8c7d-1focal [13.8 kB] 2024-04-19T04:21:01.376 INFO:teuthology.orchestra.run.smithi007.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1237-g646b8c7d-1focal [46.7 MB] 2024-04-19T04:21:01.612 INFO:teuthology.orchestra.run.smithi027.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1237-g646b8c7d-1focal [6,591 kB] 2024-04-19T04:21:02.723 INFO:teuthology.orchestra.run.smithi172.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1237-g646b8c7d-1focal [113 kB] 2024-04-19T04:21:02.806 INFO:teuthology.orchestra.run.smithi172.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1237-g646b8c7d-1focal [476 kB] 2024-04-19T04:21:03.243 INFO:teuthology.orchestra.run.smithi172.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1237-g646b8c7d-1focal [25.1 MB] 2024-04-19T04:21:06.108 INFO:teuthology.orchestra.run.smithi066.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1237-g646b8c7d-1focal [119 kB] 2024-04-19T04:21:06.110 INFO:teuthology.orchestra.run.smithi066.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1237-g646b8c7d-1focal [37.4 kB] 2024-04-19T04:21:06.111 INFO:teuthology.orchestra.run.smithi066.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1237-g646b8c7d-1focal [13.4 MB] 2024-04-19T04:21:07.034 INFO:teuthology.orchestra.run.smithi007.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1237-g646b8c7d-1focal [119 kB] 2024-04-19T04:21:07.036 INFO:teuthology.orchestra.run.smithi007.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1237-g646b8c7d-1focal [37.4 kB] 2024-04-19T04:21:07.037 INFO:teuthology.orchestra.run.smithi007.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1237-g646b8c7d-1focal [13.4 MB] 2024-04-19T04:21:07.570 INFO:teuthology.orchestra.run.smithi027.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1237-g646b8c7d-1focal [113 kB] 2024-04-19T04:21:07.668 INFO:teuthology.orchestra.run.smithi027.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1237-g646b8c7d-1focal [476 kB] 2024-04-19T04:21:08.024 INFO:teuthology.orchestra.run.smithi027.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1237-g646b8c7d-1focal [25.1 MB] 2024-04-19T04:21:08.390 INFO:teuthology.orchestra.run.smithi007.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1237-g646b8c7d-1focal [107 kB] 2024-04-19T04:21:08.644 INFO:teuthology.orchestra.run.smithi066.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1237-g646b8c7d-1focal [107 kB] 2024-04-19T04:21:09.045 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 198 MB in 16s (12.2 MB/s) 2024-04-19T04:21:09.221 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-04-19T04:21:09.278 INFO:teuthology.orchestra.run.smithi007.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-04-19T04:21:09.282 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-04-19T04:21:09.297 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 198 MB in 17s (11.8 MB/s) 2024-04-19T04:21:09.370 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-19T04:21:09.466 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-04-19T04:21:09.523 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-04-19T04:21:09.527 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-04-19T04:21:09.615 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-19T04:21:09.706 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-19T04:21:09.726 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-04-19T04:21:09.765 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-19T04:21:10.093 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-19T04:21:10.109 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-04-19T04:21:10.119 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-19T04:21:10.135 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-04-19T04:21:10.151 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-19T04:21:10.177 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-19T04:21:10.496 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-19T04:21:10.512 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-04-19T04:21:10.554 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-19T04:21:10.638 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-19T04:21:10.654 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T04:21:10.707 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:21:11.033 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-19T04:21:11.050 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T04:21:11.102 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:21:11.191 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-19T04:21:11.209 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T04:21:11.249 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:21:11.611 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-19T04:21:11.627 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T04:21:11.636 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-19T04:21:11.653 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T04:21:11.669 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:21:11.695 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:21:11.998 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-19T04:21:12.017 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T04:21:12.056 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:21:12.057 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-04-19T04:21:12.073 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-04-19T04:21:12.115 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-19T04:21:12.451 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-04-19T04:21:12.467 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-04-19T04:21:12.493 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../007-librbd1_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:12.509 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-19T04:21:12.629 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librbd1 (18.2.2-1237-g646b8c7d-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-19T04:21:12.865 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../007-librbd1_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:12.988 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librbd1 (18.2.2-1237-g646b8c7d-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-19T04:21:13.314 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../008-librados2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:13.456 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librados2 (18.2.2-1237-g646b8c7d-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-19T04:21:13.691 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../008-librados2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:13.817 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librados2 (18.2.2-1237-g646b8c7d-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-19T04:21:14.144 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libcephfs2. 2024-04-19T04:21:14.164 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../009-libcephfs2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:14.202 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libcephfs2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:14.554 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libcephfs2. 2024-04-19T04:21:14.555 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rados. 2024-04-19T04:21:14.570 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../009-libcephfs2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:14.571 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../010-python3-rados_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:14.612 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libcephfs2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:14.613 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rados (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:14.915 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-rados. 2024-04-19T04:21:14.934 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../010-python3-rados_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:14.966 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-19T04:21:14.973 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-rados (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:14.984 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:21:15.024 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-ceph-argparse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:15.285 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cephfs. 2024-04-19T04:21:15.301 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../012-python3-cephfs_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:15.309 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-19T04:21:15.329 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:21:15.352 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cephfs (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:15.367 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-ceph-argparse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:15.468 INFO:teuthology.orchestra.run.smithi172.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1237-g646b8c7d-1focal [9,603 kB] 2024-04-19T04:21:15.603 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-cephfs. 2024-04-19T04:21:15.621 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../012-python3-cephfs_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:15.661 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-cephfs (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:15.688 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-19T04:21:15.707 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:21:15.746 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:16.014 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-19T04:21:16.031 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:21:16.072 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:16.074 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-prettytable. 2024-04-19T04:21:16.090 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-04-19T04:21:16.132 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-04-19T04:21:16.394 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rbd. 2024-04-19T04:21:16.400 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-prettytable. 2024-04-19T04:21:16.410 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../015-python3-rbd_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:16.420 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-04-19T04:21:16.458 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-04-19T04:21:16.477 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rbd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:16.703 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-rbd. 2024-04-19T04:21:16.721 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../015-python3-rbd_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:16.761 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-rbd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:16.821 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-04-19T04:21:16.837 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-04-19T04:21:16.879 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-19T04:21:17.097 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-04-19T04:21:17.117 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-04-19T04:21:17.156 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-19T04:21:17.216 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-04-19T04:21:17.232 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-04-19T04:21:17.266 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-04-19T04:21:17.500 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-04-19T04:21:17.518 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-04-19T04:21:17.558 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-04-19T04:21:17.611 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-19T04:21:17.631 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-04-19T04:21:17.669 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-19T04:21:17.895 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-19T04:21:17.911 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-04-19T04:21:17.953 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-19T04:21:17.981 INFO:teuthology.orchestra.run.smithi027.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1237-g646b8c7d-1focal [9,603 kB] 2024-04-19T04:21:18.014 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package librgw2. 2024-04-19T04:21:18.030 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../019-librgw2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:18.072 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librgw2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:18.289 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package librgw2. 2024-04-19T04:21:18.309 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../019-librgw2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:18.330 INFO:teuthology.orchestra.run.smithi172.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1237-g646b8c7d-1focal [238 kB] 2024-04-19T04:21:18.347 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librgw2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:18.400 INFO:teuthology.orchestra.run.smithi172.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1237-g646b8c7d-1focal [147 kB] 2024-04-19T04:21:18.454 INFO:teuthology.orchestra.run.smithi172.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1237-g646b8c7d-1focal [1,572 kB] 2024-04-19T04:21:18.884 INFO:teuthology.orchestra.run.smithi172.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1237-g646b8c7d-1focal [6,636 kB] 2024-04-19T04:21:18.949 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rgw. 2024-04-19T04:21:18.965 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:19.007 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:19.233 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-rgw. 2024-04-19T04:21:19.250 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:19.307 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-rgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:19.352 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package liboath0. 2024-04-19T04:21:19.369 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-04-19T04:21:19.410 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-04-19T04:21:19.653 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package liboath0. 2024-04-19T04:21:19.669 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-04-19T04:21:19.711 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-04-19T04:21:19.755 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libradosstriper1. 2024-04-19T04:21:19.775 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:19.813 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libradosstriper1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:19.972 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libradosstriper1. 2024-04-19T04:21:19.990 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:20.021 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libradosstriper1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:20.267 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-common. 2024-04-19T04:21:20.287 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:20.316 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:20.383 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-common. 2024-04-19T04:21:20.401 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:20.458 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:20.674 INFO:teuthology.orchestra.run.smithi172.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1237-g646b8c7d-1focal [24.5 MB] 2024-04-19T04:21:21.235 INFO:teuthology.orchestra.run.smithi027.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1237-g646b8c7d-1focal [238 kB] 2024-04-19T04:21:21.361 INFO:teuthology.orchestra.run.smithi027.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1237-g646b8c7d-1focal [147 kB] 2024-04-19T04:21:21.447 INFO:teuthology.orchestra.run.smithi027.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1237-g646b8c7d-1focal [1,572 kB] 2024-04-19T04:21:22.320 INFO:teuthology.orchestra.run.smithi027.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1237-g646b8c7d-1focal [6,636 kB] 2024-04-19T04:21:23.514 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-base. 2024-04-19T04:21:23.531 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:23.583 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-base (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:23.730 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-base. 2024-04-19T04:21:23.747 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:23.799 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-base (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:24.827 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-19T04:21:24.843 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-04-19T04:21:24.885 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-04-19T04:21:25.001 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-19T04:21:25.020 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-04-19T04:21:25.059 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-04-19T04:21:25.247 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-natsort. 2024-04-19T04:21:25.265 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-04-19T04:21:25.305 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-04-19T04:21:25.388 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-natsort. 2024-04-19T04:21:25.407 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-04-19T04:21:25.446 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-04-19T04:21:25.558 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-logutils. 2024-04-19T04:21:25.576 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-04-19T04:21:25.608 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-04-19T04:21:25.757 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-logutils. 2024-04-19T04:21:25.774 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-04-19T04:21:25.815 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-04-19T04:21:25.920 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-19T04:21:25.939 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-04-19T04:21:25.978 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-04-19T04:21:26.102 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-19T04:21:26.121 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-04-19T04:21:26.169 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-04-19T04:21:26.264 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-mako. 2024-04-19T04:21:26.281 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-04-19T04:21:26.322 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-19T04:21:26.496 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-mako. 2024-04-19T04:21:26.512 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-04-19T04:21:26.554 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-19T04:21:26.650 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-19T04:21:26.668 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-19T04:21:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-19T04:21:26.883 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-19T04:21:26.899 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-19T04:21:26.941 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-19T04:21:26.970 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-19T04:21:26.986 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-04-19T04:21:27.020 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-04-19T04:21:27.285 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-19T04:21:27.298 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-webob. 2024-04-19T04:21:27.302 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-04-19T04:21:27.314 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2024-04-19T04:21:27.346 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-04-19T04:21:27.356 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-04-19T04:21:27.657 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-webob. 2024-04-19T04:21:27.675 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2024-04-19T04:21:27.706 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-04-19T04:21:27.709 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-soupsieve. 2024-04-19T04:21:27.726 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-04-19T04:21:27.767 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-19T04:21:28.009 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-soupsieve. 2024-04-19T04:21:28.029 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-04-19T04:21:28.047 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-bs4. 2024-04-19T04:21:28.063 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-04-19T04:21:28.067 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-19T04:21:28.097 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-04-19T04:21:28.354 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-bs4. 2024-04-19T04:21:28.373 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-04-19T04:21:28.412 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-04-19T04:21:28.425 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-waitress. 2024-04-19T04:21:28.442 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-04-19T04:21:28.486 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-19T04:21:28.796 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-waitress. 2024-04-19T04:21:28.814 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-04-19T04:21:28.828 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-tempita. 2024-04-19T04:21:28.845 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-04-19T04:21:28.859 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-19T04:21:28.895 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-04-19T04:21:29.185 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-tempita. 2024-04-19T04:21:29.198 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-paste. 2024-04-19T04:21:29.201 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-04-19T04:21:29.216 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-04-19T04:21:29.243 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-04-19T04:21:29.256 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-04-19T04:21:29.262 INFO:teuthology.orchestra.run.smithi027.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1237-g646b8c7d-1focal [24.5 MB] 2024-04-19T04:21:29.537 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-paste. 2024-04-19T04:21:29.557 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-04-19T04:21:29.584 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-19T04:21:29.595 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-04-19T04:21:29.601 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-04-19T04:21:29.643 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-04-19T04:21:29.915 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-19T04:21:29.933 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-04-19T04:21:29.971 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-19T04:21:29.987 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-04-19T04:21:29.998 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-04-19T04:21:30.029 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-04-19T04:21:30.301 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-19T04:21:30.316 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-webtest. 2024-04-19T04:21:30.317 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-04-19T04:21:30.335 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-04-19T04:21:30.359 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-04-19T04:21:30.374 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-04-19T04:21:30.646 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-webtest. 2024-04-19T04:21:30.662 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-04-19T04:21:30.693 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pecan. 2024-04-19T04:21:30.704 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-04-19T04:21:30.710 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-04-19T04:21:30.776 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-04-19T04:21:31.015 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pecan. 2024-04-19T04:21:31.031 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-04-19T04:21:31.073 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-04-19T04:21:31.140 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-19T04:21:31.157 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-04-19T04:21:31.198 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-19T04:21:31.453 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-19T04:21:31.473 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-04-19T04:21:31.485 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-19T04:21:31.504 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:21:31.511 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-19T04:21:31.543 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:31.797 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-19T04:21:31.815 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:21:31.855 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:31.923 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-19T04:21:31.943 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:31.998 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:32.227 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-19T04:21:32.243 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:32.285 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:32.317 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cryptography. 2024-04-19T04:21:32.334 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-04-19T04:21:32.375 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-19T04:21:32.638 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-cryptography. 2024-04-19T04:21:32.657 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-04-19T04:21:32.704 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-19T04:21:32.738 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-openssl. 2024-04-19T04:21:32.756 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2024-04-19T04:21:32.796 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-04-19T04:21:33.083 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-openssl. 2024-04-19T04:21:33.099 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2024-04-19T04:21:33.141 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-04-19T04:21:33.141 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr. 2024-04-19T04:21:33.160 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../047-ceph-mgr_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:33.199 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:33.477 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr. 2024-04-19T04:21:33.494 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../047-ceph-mgr_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:33.536 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:33.694 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mon. 2024-04-19T04:21:33.711 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../048-ceph-mon_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:33.752 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mon (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:34.022 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mon. 2024-04-19T04:21:34.039 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../048-ceph-mon_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:34.080 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mon (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:34.664 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-osd. 2024-04-19T04:21:34.683 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../049-ceph-osd_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:34.722 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-osd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:34.819 INFO:teuthology.orchestra.run.smithi172.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1237-g646b8c7d-1focal [13.7 kB] 2024-04-19T04:21:34.819 INFO:teuthology.orchestra.run.smithi172.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1237-g646b8c7d-1focal [853 kB] 2024-04-19T04:21:34.963 INFO:teuthology.orchestra.run.smithi172.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1237-g646b8c7d-1focal [2,290 kB] 2024-04-19T04:21:35.067 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-osd. 2024-04-19T04:21:35.083 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../049-ceph-osd_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:35.125 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-osd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:35.466 INFO:teuthology.orchestra.run.smithi172.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1237-g646b8c7d-1focal [237 kB] 2024-04-19T04:21:35.534 INFO:teuthology.orchestra.run.smithi172.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1237-g646b8c7d-1focal [142 kB] 2024-04-19T04:21:35.541 INFO:teuthology.orchestra.run.smithi172.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1237-g646b8c7d-1focal [7,011 kB] 2024-04-19T04:21:36.527 INFO:teuthology.orchestra.run.smithi027.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1237-g646b8c7d-1focal [13.7 kB] 2024-04-19T04:21:36.528 INFO:teuthology.orchestra.run.smithi027.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1237-g646b8c7d-1focal [853 kB] 2024-04-19T04:21:36.601 INFO:teuthology.orchestra.run.smithi027.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1237-g646b8c7d-1focal [2,290 kB] 2024-04-19T04:21:36.821 INFO:teuthology.orchestra.run.smithi172.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1237-g646b8c7d-1focal [7,891 kB] 2024-04-19T04:21:36.956 INFO:teuthology.orchestra.run.smithi027.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1237-g646b8c7d-1focal [237 kB] 2024-04-19T04:21:36.990 INFO:teuthology.orchestra.run.smithi027.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1237-g646b8c7d-1focal [142 kB] 2024-04-19T04:21:36.996 INFO:teuthology.orchestra.run.smithi027.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1237-g646b8c7d-1focal [7,011 kB] 2024-04-19T04:21:37.026 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph. 2024-04-19T04:21:37.042 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../050-ceph_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:37.084 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:37.412 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph. 2024-04-19T04:21:37.428 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../050-ceph_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:37.437 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-fuse. 2024-04-19T04:21:37.454 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../051-ceph-fuse_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:37.461 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:37.503 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:37.766 INFO:teuthology.orchestra.run.smithi172.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1237-g646b8c7d-1focal [13.8 kB] 2024-04-19T04:21:37.767 INFO:teuthology.orchestra.run.smithi172.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1237-g646b8c7d-1focal [46.7 MB] 2024-04-19T04:21:37.789 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-fuse. 2024-04-19T04:21:37.807 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../051-ceph-fuse_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:37.824 INFO:teuthology.orchestra.run.smithi027.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1237-g646b8c7d-1focal [7,891 kB] 2024-04-19T04:21:37.848 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:37.915 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mds. 2024-04-19T04:21:37.933 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../052-ceph-mds_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:37.982 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mds (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:38.251 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mds. 2024-04-19T04:21:38.270 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../052-ceph-mds_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:38.309 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mds (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:38.510 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package cephadm. 2024-04-19T04:21:38.526 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../053-cephadm_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:38.568 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:38.583 INFO:teuthology.orchestra.run.smithi027.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1237-g646b8c7d-1focal [13.8 kB] 2024-04-19T04:21:38.584 INFO:teuthology.orchestra.run.smithi027.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1237-g646b8c7d-1focal [46.7 MB] 2024-04-19T04:21:38.845 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package cephadm. 2024-04-19T04:21:38.861 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../053-cephadm_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:38.888 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-19T04:21:38.895 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:38.907 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2024-04-19T04:21:38.966 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-04-19T04:21:39.164 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-19T04:21:39.182 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2024-04-19T04:21:39.214 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-04-19T04:21:39.324 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jinja2. 2024-04-19T04:21:39.341 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-04-19T04:21:39.382 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-19T04:21:39.500 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-jinja2. 2024-04-19T04:21:39.516 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-04-19T04:21:39.550 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-19T04:21:39.710 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-19T04:21:39.726 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:21:39.768 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:39.911 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-19T04:21:39.927 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:21:39.969 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:40.147 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-19T04:21:40.165 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-04-19T04:21:40.205 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-19T04:21:40.331 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-19T04:21:40.347 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-04-19T04:21:40.389 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-19T04:21:40.508 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jwt. 2024-04-19T04:21:40.525 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-04-19T04:21:40.566 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-19T04:21:40.675 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-jwt. 2024-04-19T04:21:40.692 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-04-19T04:21:40.733 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-19T04:21:40.877 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-attr. 2024-04-19T04:21:40.894 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-04-19T04:21:40.935 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-04-19T04:21:41.061 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-attr. 2024-04-19T04:21:41.081 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-04-19T04:21:41.119 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-04-19T04:21:41.272 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pluggy. 2024-04-19T04:21:41.288 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-04-19T04:21:41.330 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-04-19T04:21:41.431 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pluggy. 2024-04-19T04:21:41.450 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-04-19T04:21:41.489 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-04-19T04:21:41.560 INFO:teuthology.orchestra.run.smithi172.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1237-g646b8c7d-1focal [119 kB] 2024-04-19T04:21:41.562 INFO:teuthology.orchestra.run.smithi172.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1237-g646b8c7d-1focal [37.4 kB] 2024-04-19T04:21:41.563 INFO:teuthology.orchestra.run.smithi172.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1237-g646b8c7d-1focal [13.4 MB] 2024-04-19T04:21:41.683 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-py. 2024-04-19T04:21:41.703 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-04-19T04:21:41.741 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-04-19T04:21:41.791 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-py. 2024-04-19T04:21:41.807 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-04-19T04:21:41.849 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-04-19T04:21:42.094 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-atomicwrites. 2024-04-19T04:21:42.098 INFO:teuthology.orchestra.run.smithi027.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1237-g646b8c7d-1focal [119 kB] 2024-04-19T04:21:42.100 INFO:teuthology.orchestra.run.smithi027.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1237-g646b8c7d-1focal [37.4 kB] 2024-04-19T04:21:42.110 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-04-19T04:21:42.152 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-04-19T04:21:42.167 INFO:teuthology.orchestra.run.smithi027.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1237-g646b8c7d-1focal [13.4 MB] 2024-04-19T04:21:42.211 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-atomicwrites. 2024-04-19T04:21:42.230 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-04-19T04:21:42.231 INFO:teuthology.orchestra.run.smithi172.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1237-g646b8c7d-1focal [107 kB] 2024-04-19T04:21:42.269 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-04-19T04:21:42.455 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-packaging. 2024-04-19T04:21:42.471 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-04-19T04:21:42.513 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-packaging (20.3-1) ... 2024-04-19T04:21:42.554 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-packaging. 2024-04-19T04:21:42.571 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-04-19T04:21:42.602 INFO:teuthology.orchestra.run.smithi027.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1237-g646b8c7d-1focal [107 kB] 2024-04-19T04:21:42.621 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-packaging (20.3-1) ... 2024-04-19T04:21:42.877 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 198 MB in 50s (3,946 kB/s) 2024-04-19T04:21:42.941 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-19T04:21:42.957 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-04-19T04:21:42.974 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-19T04:21:42.991 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-04-19T04:21:42.999 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-19T04:21:43.032 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-19T04:21:43.081 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-04-19T04:21:43.136 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-04-19T04:21:43.141 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-04-19T04:21:43.221 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-19T04:21:43.247 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 198 MB in 51s (3,924 kB/s) 2024-04-19T04:21:43.336 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pytest. 2024-04-19T04:21:43.347 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pytest. 2024-04-19T04:21:43.353 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-04-19T04:21:43.364 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-04-19T04:21:43.406 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-04-19T04:21:43.410 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-04-19T04:21:43.428 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-04-19T04:21:43.469 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-04-19T04:21:43.473 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-04-19T04:21:43.559 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-19T04:21:43.607 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-19T04:21:43.623 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-04-19T04:21:43.665 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-19T04:21:43.760 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-19T04:21:43.763 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-19T04:21:43.776 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-04-19T04:21:43.781 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-04-19T04:21:43.818 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-19T04:21:43.822 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-19T04:21:43.954 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-19T04:21:43.972 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-04-19T04:21:43.985 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-19T04:21:44.004 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-19T04:21:44.004 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-04-19T04:21:44.041 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libjs-underscore. 2024-04-19T04:21:44.043 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-19T04:21:44.060 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-04-19T04:21:44.070 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libjs-underscore. 2024-04-19T04:21:44.090 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-04-19T04:21:44.116 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-19T04:21:44.129 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-19T04:21:44.365 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-19T04:21:44.383 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-04-19T04:21:44.385 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-04-19T04:21:44.403 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-04-19T04:21:44.423 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-19T04:21:44.439 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-04-19T04:21:44.443 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-19T04:21:44.457 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-04-19T04:21:44.506 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-19T04:21:44.522 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-19T04:21:44.538 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T04:21:44.590 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:21:44.755 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-routes. 2024-04-19T04:21:44.774 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-04-19T04:21:44.813 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-04-19T04:21:44.825 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-routes. 2024-04-19T04:21:44.843 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-04-19T04:21:44.883 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-04-19T04:21:44.900 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-19T04:21:44.902 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T04:21:44.954 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:21:45.091 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-19T04:21:45.108 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T04:21:45.149 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:21:45.166 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-19T04:21:45.182 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:21:45.211 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-19T04:21:45.224 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:45.228 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:21:45.269 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:45.455 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-19T04:21:45.474 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T04:21:45.513 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:21:45.527 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-19T04:21:45.545 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T04:21:45.585 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:21:45.883 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-19T04:21:45.900 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T04:21:45.939 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-04-19T04:21:45.959 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-04-19T04:21:45.966 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:21:45.997 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-19T04:21:46.344 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-04-19T04:21:46.358 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../007-librbd1_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:46.360 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-04-19T04:21:46.402 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-19T04:21:46.509 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librbd1 (18.2.2-1237-g646b8c7d-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-19T04:21:46.571 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-decorator. 2024-04-19T04:21:46.592 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-04-19T04:21:46.638 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-04-19T04:21:46.685 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-decorator. 2024-04-19T04:21:46.705 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-04-19T04:21:46.750 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-04-19T04:21:46.767 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../007-librbd1_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:46.923 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librbd1 (18.2.2-1237-g646b8c7d-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-19T04:21:46.941 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-04-19T04:21:46.958 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-04-19T04:21:46.999 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-19T04:21:47.052 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-04-19T04:21:47.068 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-04-19T04:21:47.111 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-19T04:21:47.195 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../008-librados2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:47.296 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librados2 (18.2.2-1237-g646b8c7d-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-19T04:21:47.352 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-scipy. 2024-04-19T04:21:47.369 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-04-19T04:21:47.401 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-scipy. 2024-04-19T04:21:47.410 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-04-19T04:21:47.417 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-04-19T04:21:47.458 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-04-19T04:21:47.618 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../008-librados2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:47.744 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librados2 (18.2.2-1237-g646b8c7d-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-19T04:21:48.000 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libcephfs2. 2024-04-19T04:21:48.019 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../009-libcephfs2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:48.058 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libcephfs2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:48.427 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rados. 2024-04-19T04:21:48.443 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../010-python3-rados_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:48.475 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libcephfs2. 2024-04-19T04:21:48.485 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rados (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:48.492 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../009-libcephfs2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:48.533 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libcephfs2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:48.715 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-04-19T04:21:48.733 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-04-19T04:21:48.749 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-04-19T04:21:48.769 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-04-19T04:21:48.773 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-19T04:21:48.807 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-19T04:21:48.855 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-19T04:21:48.875 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:21:48.910 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rados. 2024-04-19T04:21:48.913 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-ceph-argparse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:48.927 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../010-python3-rados_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:48.968 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rados (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:49.132 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cephfs. 2024-04-19T04:21:49.148 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../012-python3-cephfs_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:49.182 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cephfs (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:49.318 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-joblib. 2024-04-19T04:21:49.321 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-19T04:21:49.337 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-04-19T04:21:49.341 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:21:49.352 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-joblib. 2024-04-19T04:21:49.368 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-04-19T04:21:49.376 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-04-19T04:21:49.379 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-ceph-argparse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:49.410 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-04-19T04:21:49.526 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-19T04:21:49.542 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:21:49.584 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:49.657 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cephfs. 2024-04-19T04:21:49.673 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../012-python3-cephfs_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:49.715 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cephfs (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:49.730 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-sklearn. 2024-04-19T04:21:49.749 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-04-19T04:21:49.780 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-sklearn. 2024-04-19T04:21:49.788 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-19T04:21:49.798 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-04-19T04:21:49.838 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-19T04:21:49.937 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-prettytable. 2024-04-19T04:21:49.956 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-04-19T04:21:49.995 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-04-19T04:21:50.027 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-19T04:21:50.046 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:21:50.085 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:50.248 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rbd. 2024-04-19T04:21:50.264 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../015-python3-rbd_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:50.306 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rbd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:50.421 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-prettytable. 2024-04-19T04:21:50.437 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-04-19T04:21:50.479 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-04-19T04:21:50.514 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-19T04:21:50.533 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:21:50.547 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-19T04:21:50.564 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:21:50.572 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:50.605 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:50.675 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-04-19T04:21:50.691 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-04-19T04:21:50.734 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-19T04:21:50.748 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rbd. 2024-04-19T04:21:50.764 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../015-python3-rbd_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:50.806 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rbd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:51.120 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-04-19T04:21:51.137 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-04-19T04:21:51.176 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-04-19T04:21:51.186 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-04-19T04:21:51.193 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-04-19T04:21:51.234 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-19T04:21:51.523 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-19T04:21:51.541 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-04-19T04:21:51.581 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-19T04:21:51.612 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-04-19T04:21:51.629 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-04-19T04:21:51.671 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-04-19T04:21:51.709 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cachetools. 2024-04-19T04:21:51.726 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-04-19T04:21:51.766 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-cachetools. 2024-04-19T04:21:51.767 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-04-19T04:21:51.784 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-04-19T04:21:51.824 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-04-19T04:21:51.958 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librgw2. 2024-04-19T04:21:51.976 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../019-librgw2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:51.998 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-19T04:21:52.016 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-04-19T04:21:52.017 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librgw2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:52.057 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-19T04:21:52.070 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-19T04:21:52.086 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-04-19T04:21:52.119 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-19T04:21:52.128 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-04-19T04:21:52.136 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-04-19T04:21:52.169 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-04-19T04:21:52.423 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librgw2. 2024-04-19T04:21:52.440 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../019-librgw2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:52.480 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-19T04:21:52.485 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librgw2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:52.490 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-19T04:21:52.499 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-04-19T04:21:52.508 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-04-19T04:21:52.538 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-19T04:21:52.548 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-19T04:21:52.919 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rgw. 2024-04-19T04:21:52.935 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:52.945 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rsa. 2024-04-19T04:21:52.952 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-rsa. 2024-04-19T04:21:52.964 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-04-19T04:21:52.968 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-04-19T04:21:52.985 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:53.003 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rsa (4.0-3) ... 2024-04-19T04:21:53.010 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-rsa (4.0-3) ... 2024-04-19T04:21:53.305 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-google-auth. 2024-04-19T04:21:53.325 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-04-19T04:21:53.340 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-google-auth. 2024-04-19T04:21:53.347 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liboath0. 2024-04-19T04:21:53.360 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-04-19T04:21:53.363 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-04-19T04:21:53.367 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-04-19T04:21:53.404 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rgw. 2024-04-19T04:21:53.407 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-04-19T04:21:53.413 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-04-19T04:21:53.420 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:53.462 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:53.659 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-blinker. 2024-04-19T04:21:53.678 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-04-19T04:21:53.709 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-19T04:21:53.716 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libradosstriper1. 2024-04-19T04:21:53.732 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:53.774 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libradosstriper1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:53.807 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liboath0. 2024-04-19T04:21:53.824 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-04-19T04:21:53.865 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-04-19T04:21:53.986 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-blinker. 2024-04-19T04:21:54.005 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-04-19T04:21:54.044 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-19T04:21:54.045 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-oauthlib. 2024-04-19T04:21:54.061 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-04-19T04:21:54.103 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-19T04:21:54.185 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libradosstriper1. 2024-04-19T04:21:54.201 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:54.243 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libradosstriper1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:54.244 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-common. 2024-04-19T04:21:54.263 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:54.302 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:54.398 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-oauthlib. 2024-04-19T04:21:54.416 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-04-19T04:21:54.433 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-19T04:21:54.449 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-04-19T04:21:54.456 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-19T04:21:54.491 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-19T04:21:54.705 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-common. 2024-04-19T04:21:54.722 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:54.760 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-19T04:21:54.762 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:54.780 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-04-19T04:21:54.786 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-websocket. 2024-04-19T04:21:54.806 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-04-19T04:21:54.818 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-19T04:21:54.844 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-04-19T04:21:55.147 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-websocket. 2024-04-19T04:21:55.167 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-04-19T04:21:55.197 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-19T04:21:55.213 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-04-19T04:21:55.214 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-04-19T04:21:55.255 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-04-19T04:21:55.551 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-19T04:21:55.569 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-04-19T04:21:55.609 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-04-19T04:21:55.743 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-19T04:21:55.761 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:21:55.801 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:56.129 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-19T04:21:56.145 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-04-19T04:21:56.164 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-19T04:21:56.181 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:21:56.187 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-04-19T04:21:56.222 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:56.548 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-19T04:21:56.565 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-19T04:21:56.575 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-19T04:21:56.592 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-04-19T04:21:56.606 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-19T04:21:56.633 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-04-19T04:21:56.808 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-base. 2024-04-19T04:21:56.825 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:56.868 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package jq. 2024-04-19T04:21:56.876 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-base (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:56.886 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-19T04:21:56.926 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-04-19T04:21:56.986 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-19T04:21:57.003 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-19T04:21:57.044 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-19T04:21:57.170 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package socat. 2024-04-19T04:21:57.187 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-04-19T04:21:57.228 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking socat (1.7.3.3-2) ... 2024-04-19T04:21:57.235 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-base. 2024-04-19T04:21:57.251 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:57.303 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-base (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:57.306 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package jq. 2024-04-19T04:21:57.325 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-19T04:21:57.364 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-04-19T04:21:57.565 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package xmlstarlet. 2024-04-19T04:21:57.583 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-04-19T04:21:57.623 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-04-19T04:21:57.642 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package socat. 2024-04-19T04:21:57.661 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-04-19T04:21:57.700 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking socat (1.7.3.3-2) ... 2024-04-19T04:21:57.935 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-test. 2024-04-19T04:21:57.954 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../094-ceph-test_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:57.993 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-test (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:58.012 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package xmlstarlet. 2024-04-19T04:21:58.032 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-04-19T04:21:58.070 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-04-19T04:21:58.112 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-19T04:21:58.131 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-04-19T04:21:58.162 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-04-19T04:21:58.408 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-test. 2024-04-19T04:21:58.426 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../094-ceph-test_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:21:58.465 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-natsort. 2024-04-19T04:21:58.481 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-04-19T04:21:58.491 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-test (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:21:58.514 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-04-19T04:21:58.531 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-19T04:21:58.548 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-04-19T04:21:58.589 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-04-19T04:21:58.792 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-logutils. 2024-04-19T04:21:58.812 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-04-19T04:21:58.850 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-04-19T04:21:58.917 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-natsort. 2024-04-19T04:21:58.934 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-04-19T04:21:58.992 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-04-19T04:21:59.162 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-19T04:21:59.178 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-04-19T04:21:59.245 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-04-19T04:21:59.304 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-logutils. 2024-04-19T04:21:59.320 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-04-19T04:21:59.362 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-04-19T04:21:59.548 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-mako. 2024-04-19T04:21:59.564 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-04-19T04:21:59.606 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-19T04:21:59.664 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-19T04:21:59.683 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-04-19T04:21:59.723 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-04-19T04:21:59.909 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-19T04:21:59.928 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-19T04:21:59.967 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-19T04:22:00.009 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-mako. 2024-04-19T04:22:00.027 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-04-19T04:22:00.058 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-19T04:22:00.279 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-19T04:22:00.296 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-04-19T04:22:00.370 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-04-19T04:22:00.395 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-19T04:22:00.412 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-19T04:22:00.453 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-19T04:22:00.656 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-webob. 2024-04-19T04:22:00.675 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2024-04-19T04:22:00.714 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-04-19T04:22:00.748 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-19T04:22:00.764 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-04-19T04:22:00.839 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-04-19T04:22:01.075 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-soupsieve. 2024-04-19T04:22:01.091 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-04-19T04:22:01.133 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-19T04:22:01.134 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-webob. 2024-04-19T04:22:01.154 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2024-04-19T04:22:01.192 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-04-19T04:22:01.436 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-bs4. 2024-04-19T04:22:01.453 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-04-19T04:22:01.512 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-soupsieve. 2024-04-19T04:22:01.519 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-04-19T04:22:01.528 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-04-19T04:22:01.570 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-19T04:22:01.872 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-waitress. 2024-04-19T04:22:01.889 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-04-19T04:22:01.889 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-bs4. 2024-04-19T04:22:01.908 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-04-19T04:22:01.933 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-19T04:22:01.947 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-04-19T04:22:02.098 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-volume. 2024-04-19T04:22:02.115 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../095-ceph-volume_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:22:02.180 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-volume (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:02.284 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-tempita. 2024-04-19T04:22:02.301 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-04-19T04:22:02.301 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-waitress. 2024-04-19T04:22:02.317 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-04-19T04:22:02.342 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-04-19T04:22:02.362 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-19T04:22:02.459 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package fonts-mathjax. 2024-04-19T04:22:02.479 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-19T04:22:02.518 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-19T04:22:02.637 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-volume. 2024-04-19T04:22:02.656 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../095-ceph-volume_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:22:02.669 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-paste. 2024-04-19T04:22:02.686 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-04-19T04:22:02.695 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-volume (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:02.696 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-tempita. 2024-04-19T04:22:02.715 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-04-19T04:22:02.727 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-04-19T04:22:02.754 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-04-19T04:22:02.979 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-19T04:22:02.993 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package fonts-mathjax. 2024-04-19T04:22:02.996 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:03.012 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-19T04:22:03.037 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libcephfs-dev (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:03.040 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-paste. 2024-04-19T04:22:03.048 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-19T04:22:03.050 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-19T04:22:03.056 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-04-19T04:22:03.063 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-04-19T04:22:03.098 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-04-19T04:22:03.105 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-04-19T04:22:03.418 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-19T04:22:03.438 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-04-19T04:22:03.450 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-19T04:22:03.468 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-04-19T04:22:03.476 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-04-19T04:22:03.483 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package nvme-cli. 2024-04-19T04:22:03.500 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-04-19T04:22:03.508 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-04-19T04:22:03.559 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-04-19T04:22:03.687 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-19T04:22:03.705 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:03.745 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libcephfs-dev (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:03.813 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-19T04:22:03.829 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-04-19T04:22:03.836 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-webtest. 2024-04-19T04:22:03.852 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-04-19T04:22:03.871 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-04-19T04:22:03.887 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-19T04:22:03.894 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-04-19T04:22:03.906 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-04-19T04:22:03.945 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-04-19T04:22:04.115 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package nvme-cli. 2024-04-19T04:22:04.135 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-04-19T04:22:04.174 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-webtest. 2024-04-19T04:22:04.190 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-04-19T04:22:04.191 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-04-19T04:22:04.214 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pecan. 2024-04-19T04:22:04.230 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-04-19T04:22:04.232 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-04-19T04:22:04.272 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-04-19T04:22:04.323 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libjs-mathjax. 2024-04-19T04:22:04.341 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-19T04:22:04.381 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-19T04:22:04.504 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-19T04:22:04.521 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-04-19T04:22:04.562 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-04-19T04:22:04.577 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pecan. 2024-04-19T04:22:04.593 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-04-19T04:22:04.635 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-04-19T04:22:04.643 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-19T04:22:04.659 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-04-19T04:22:04.701 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-19T04:22:04.948 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libjs-mathjax. 2024-04-19T04:22:04.968 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-19T04:22:04.973 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-19T04:22:04.993 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-04-19T04:22:05.006 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-19T04:22:05.030 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-19T04:22:05.031 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-19T04:22:05.045 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:22:05.087 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:05.318 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-19T04:22:05.334 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:22:05.376 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:05.476 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-19T04:22:05.493 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:05.559 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:05.887 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cryptography. 2024-04-19T04:22:05.905 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-19T04:22:05.907 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-04-19T04:22:05.926 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:05.953 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-19T04:22:05.963 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:05.987 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python-natsort-doc. 2024-04-19T04:22:06.006 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-04-19T04:22:06.045 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-04-19T04:22:06.266 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cryptography. 2024-04-19T04:22:06.286 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-04-19T04:22:06.324 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-19T04:22:06.340 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-openssl. 2024-04-19T04:22:06.359 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2024-04-19T04:22:06.383 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-webencodings. 2024-04-19T04:22:06.398 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-04-19T04:22:06.401 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-04-19T04:22:06.441 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-19T04:22:06.678 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python-natsort-doc. 2024-04-19T04:22:06.698 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-04-19T04:22:06.718 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-html5lib. 2024-04-19T04:22:06.720 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-openssl. 2024-04-19T04:22:06.735 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-04-19T04:22:06.736 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2024-04-19T04:22:06.739 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-04-19T04:22:06.759 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr. 2024-04-19T04:22:06.776 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-04-19T04:22:06.777 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../047-ceph-mgr_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:06.778 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-04-19T04:22:06.817 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:07.074 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-webencodings. 2024-04-19T04:22:07.091 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-04-19T04:22:07.131 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-19T04:22:07.140 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-04-19T04:22:07.160 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-04-19T04:22:07.199 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-19T04:22:07.288 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mon. 2024-04-19T04:22:07.303 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../048-ceph-mon_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:07.337 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mon (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:07.390 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr. 2024-04-19T04:22:07.406 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../047-ceph-mgr_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:07.435 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-html5lib. 2024-04-19T04:22:07.447 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:07.455 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-04-19T04:22:07.484 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-04-19T04:22:07.678 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pastescript. 2024-04-19T04:22:07.695 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-04-19T04:22:07.735 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-19T04:22:07.863 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-04-19T04:22:07.884 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-04-19T04:22:07.921 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-19T04:22:07.943 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mon. 2024-04-19T04:22:07.960 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../048-ceph-mon_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:08.001 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mon (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:08.089 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-psutil. 2024-04-19T04:22:08.111 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-04-19T04:22:08.155 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-04-19T04:22:08.282 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-osd. 2024-04-19T04:22:08.298 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../049-ceph-osd_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:08.378 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pastescript. 2024-04-19T04:22:08.395 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-04-19T04:22:08.407 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-osd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:08.435 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-19T04:22:08.610 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-19T04:22:08.629 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-04-19T04:22:08.668 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-19T04:22:08.781 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-psutil. 2024-04-19T04:22:08.799 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-04-19T04:22:08.839 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-04-19T04:22:08.954 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-osd. 2024-04-19T04:22:08.974 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../049-ceph-osd_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:08.988 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-simplejson. 2024-04-19T04:22:09.005 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-04-19T04:22:09.012 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-osd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:09.046 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-19T04:22:09.158 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-19T04:22:09.175 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-04-19T04:22:09.216 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-19T04:22:09.332 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-19T04:22:09.350 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-04-19T04:22:09.390 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-19T04:22:09.646 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-simplejson. 2024-04-19T04:22:09.666 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-04-19T04:22:09.729 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-19T04:22:10.007 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-19T04:22:10.021 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-04-19T04:22:10.035 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package radosgw. 2024-04-19T04:22:10.055 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../110-radosgw_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:10.065 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-19T04:22:10.093 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking radosgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:10.677 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph. 2024-04-19T04:22:10.695 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../050-ceph_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:10.735 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:10.750 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package radosgw. 2024-04-19T04:22:10.769 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../110-radosgw_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:10.810 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking radosgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:11.096 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-fuse. 2024-04-19T04:22:11.113 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../051-ceph-fuse_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:11.154 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:11.224 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph. 2024-04-19T04:22:11.243 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../050-ceph_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:11.282 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:11.471 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package rbd-fuse. 2024-04-19T04:22:11.488 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../111-rbd-fuse_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:11.529 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking rbd-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:11.607 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mds. 2024-04-19T04:22:11.618 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-fuse. 2024-04-19T04:22:11.622 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../052-ceph-mds_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:11.635 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../051-ceph-fuse_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:11.665 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mds (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:11.676 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:11.859 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-attr (19.3.0-2) ... 2024-04-19T04:22:12.121 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mds. 2024-04-19T04:22:12.137 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../052-ceph-mds_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:12.150 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-04-19T04:22:12.179 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mds (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:12.201 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package cephadm. 2024-04-19T04:22:12.213 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package rbd-fuse. 2024-04-19T04:22:12.218 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../053-cephadm_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:12.233 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../111-rbd-fuse_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:12.259 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:12.271 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking rbd-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:12.276 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-19T04:22:12.402 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-04-19T04:22:12.578 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-attr (19.3.0-2) ... 2024-04-19T04:22:12.595 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-19T04:22:12.596 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:12.612 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2024-04-19T04:22:12.653 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-04-19T04:22:12.757 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package cephadm. 2024-04-19T04:22:12.774 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../053-cephadm_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:12.815 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:12.909 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-04-19T04:22:13.006 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jinja2. 2024-04-19T04:22:13.022 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-04-19T04:22:13.035 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-19T04:22:13.089 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-19T04:22:13.155 INFO:teuthology.orchestra.run.smithi066.stdout:Adding system user cephadm....done 2024-04-19T04:22:13.161 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-04-19T04:22:13.170 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-19T04:22:13.185 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2024-04-19T04:22:13.226 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-04-19T04:22:13.318 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-19T04:22:13.363 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:13.417 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-19T04:22:13.433 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:22:13.444 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-19T04:22:13.582 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jinja2. 2024-04-19T04:22:13.592 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:13.596 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-04-19T04:22:13.637 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-19T04:22:13.796 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-19T04:22:13.930 INFO:teuthology.orchestra.run.smithi007.stdout:Adding system user cephadm....done 2024-04-19T04:22:13.990 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-19T04:22:14.008 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:22:14.048 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:14.077 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-19T04:22:14.097 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-19T04:22:14.104 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-19T04:22:14.123 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-04-19T04:22:14.162 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-19T04:22:14.203 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-19T04:22:14.223 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-04-19T04:22:14.332 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-04-19T04:22:14.394 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-19T04:22:14.413 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-04-19T04:22:14.443 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-19T04:22:14.489 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jwt. 2024-04-19T04:22:14.505 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-04-19T04:22:14.547 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-19T04:22:14.555 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-19T04:22:14.659 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-04-19T04:22:14.771 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jwt. 2024-04-19T04:22:14.788 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-04-19T04:22:14.829 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-19T04:22:14.881 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-19T04:22:14.884 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-attr. 2024-04-19T04:22:14.901 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-04-19T04:22:14.942 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-04-19T04:22:15.010 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-04-19T04:22:15.052 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-19T04:22:15.133 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-04-19T04:22:15.140 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-attr. 2024-04-19T04:22:15.157 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-04-19T04:22:15.199 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-04-19T04:22:15.286 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pluggy. 2024-04-19T04:22:15.304 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-04-19T04:22:15.345 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-04-19T04:22:15.361 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-04-19T04:22:15.459 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-04-19T04:22:15.510 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pluggy. 2024-04-19T04:22:15.530 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-04-19T04:22:15.577 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-04-19T04:22:15.647 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-19T04:22:15.672 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-py. 2024-04-19T04:22:15.691 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-04-19T04:22:15.722 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-04-19T04:22:15.904 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-py. 2024-04-19T04:22:15.911 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-19T04:22:15.921 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-04-19T04:22:15.922 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-19T04:22:15.963 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-04-19T04:22:16.067 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-atomicwrites. 2024-04-19T04:22:16.083 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-04-19T04:22:16.125 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-04-19T04:22:16.188 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-04-19T04:22:16.215 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-ceph-argparse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:16.274 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-atomicwrites. 2024-04-19T04:22:16.290 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-04-19T04:22:16.323 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-04-19T04:22:16.427 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-packaging. 2024-04-19T04:22:16.443 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-04-19T04:22:16.472 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-19T04:22:16.485 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-packaging (20.3-1) ... 2024-04-19T04:22:16.508 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-19T04:22:16.634 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-04-19T04:22:16.643 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-packaging. 2024-04-19T04:22:16.660 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-04-19T04:22:16.701 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-packaging (20.3-1) ... 2024-04-19T04:22:16.749 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-19T04:22:16.823 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-19T04:22:16.841 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-04-19T04:22:16.881 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-19T04:22:16.935 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-19T04:22:17.004 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-19T04:22:17.021 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-04-19T04:22:17.033 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-ceph-argparse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:17.062 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-19T04:22:17.184 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pytest. 2024-04-19T04:22:17.203 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-04-19T04:22:17.228 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-19T04:22:17.242 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-04-19T04:22:17.323 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pytest. 2024-04-19T04:22:17.334 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-19T04:22:17.342 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-04-19T04:22:17.353 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-04-19T04:22:17.373 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-04-19T04:22:17.460 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-04-19T04:22:17.579 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-19T04:22:17.599 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-04-19T04:22:17.637 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-19T04:22:17.727 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-19T04:22:17.738 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-04-19T04:22:17.778 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-19T04:22:17.795 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-04-19T04:22:17.835 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-19T04:22:17.923 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libjs-underscore. 2024-04-19T04:22:17.939 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-04-19T04:22:17.977 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-19T04:22:18.012 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-19T04:22:18.031 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-04-19T04:22:18.088 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libjs-underscore. 2024-04-19T04:22:18.104 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-04-19T04:22:18.138 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-04-19T04:22:18.146 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-19T04:22:18.230 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-04-19T04:22:18.247 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-04-19T04:22:18.299 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-19T04:22:18.313 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-19T04:22:18.480 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-04-19T04:22:18.497 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-04-19T04:22:18.514 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-04-19T04:22:18.537 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-19T04:22:18.624 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-routes. 2024-04-19T04:22:18.633 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-04-19T04:22:18.640 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-04-19T04:22:18.682 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-04-19T04:22:18.807 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-04-19T04:22:18.857 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-routes. 2024-04-19T04:22:18.874 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-04-19T04:22:18.915 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-04-19T04:22:18.942 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-19T04:22:19.035 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-19T04:22:19.054 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:22:19.091 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-19T04:22:19.093 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:19.227 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-19T04:22:19.243 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:22:19.260 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-04-19T04:22:19.284 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:19.459 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-04-19T04:22:19.544 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-packaging (20.3-1) ... 2024-04-19T04:22:19.751 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-19T04:22:19.837 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-04-19T04:22:19.988 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-19T04:22:20.078 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-04-19T04:22:20.114 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-19T04:22:20.354 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-packaging (20.3-1) ... 2024-04-19T04:22:20.415 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-04-19T04:22:20.490 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-decorator. 2024-04-19T04:22:20.508 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-04-19T04:22:20.548 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-04-19T04:22:20.655 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-04-19T04:22:20.740 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-decorator. 2024-04-19T04:22:20.759 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-04-19T04:22:20.781 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-19T04:22:20.798 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-04-19T04:22:20.800 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-19T04:22:20.876 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-04-19T04:22:20.893 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-04-19T04:22:20.906 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-19T04:22:20.934 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-19T04:22:21.101 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-04-19T04:22:21.117 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-04-19T04:22:21.159 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-19T04:22:21.160 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-19T04:22:21.216 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-04-19T04:22:21.270 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-scipy. 2024-04-19T04:22:21.288 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-04-19T04:22:21.328 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-04-19T04:22:21.512 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-scipy. 2024-04-19T04:22:21.519 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up socat (1.7.3.3-2) ... 2024-04-19T04:22:21.529 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-04-19T04:22:21.570 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-04-19T04:22:21.642 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-19T04:22:21.654 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:21.980 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:22:22.052 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-19T04:22:22.131 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-04-19T04:22:22.421 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up socat (1.7.3.3-2) ... 2024-04-19T04:22:22.474 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-19T04:22:22.547 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:22.575 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-04-19T04:22:22.641 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-04-19T04:22:22.658 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-04-19T04:22:22.701 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-04-19T04:22:22.715 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-19T04:22:22.865 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:22:22.891 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-04-19T04:22:22.909 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-04-19T04:22:22.949 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-19T04:22:22.974 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-04-19T04:22:22.985 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-19T04:22:23.294 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-joblib. 2024-04-19T04:22:23.303 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:22:23.310 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-04-19T04:22:23.334 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-19T04:22:23.350 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-04-19T04:22:23.463 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-19T04:22:23.468 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-04-19T04:22:23.511 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-joblib. 2024-04-19T04:22:23.528 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-04-19T04:22:23.569 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-04-19T04:22:23.589 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-04-19T04:22:23.594 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-04-19T04:22:23.746 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-sklearn. 2024-04-19T04:22:23.762 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-04-19T04:22:23.803 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-19T04:22:23.901 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-04-19T04:22:23.904 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-19T04:22:23.964 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-sklearn. 2024-04-19T04:22:23.980 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-04-19T04:22:24.046 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-19T04:22:24.169 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-04-19T04:22:24.230 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:22:24.348 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-19T04:22:24.449 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-04-19T04:22:24.461 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-19T04:22:24.562 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-19T04:22:24.578 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:22:24.596 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-19T04:22:24.645 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:24.697 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-19T04:22:24.713 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:22:24.755 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:24.897 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-04-19T04:22:25.042 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-04-19T04:22:25.181 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-19T04:22:25.363 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-04-19T04:22:25.491 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-04-19T04:22:25.672 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-19T04:22:25.707 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cachetools. 2024-04-19T04:22:25.722 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-04-19T04:22:25.764 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-04-19T04:22:25.781 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-19T04:22:25.892 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cachetools. 2024-04-19T04:22:25.908 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-04-19T04:22:25.912 INFO:teuthology.orchestra.run.smithi066.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-04-19T04:22:25.949 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-04-19T04:22:26.057 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-04-19T04:22:26.067 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-19T04:22:26.087 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-04-19T04:22:26.125 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-04-19T04:22:26.177 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-04-19T04:22:26.252 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-19T04:22:26.271 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-04-19T04:22:26.286 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-19T04:22:26.312 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-04-19T04:22:26.392 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-19T04:22:26.495 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-19T04:22:26.513 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-04-19T04:22:26.553 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-19T04:22:26.595 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-04-19T04:22:26.641 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-19T04:22:26.659 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-04-19T04:22:26.699 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-19T04:22:26.709 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-04-19T04:22:26.963 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-19T04:22:26.992 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rsa. 2024-04-19T04:22:27.009 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-04-19T04:22:27.050 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rsa (4.0-3) ... 2024-04-19T04:22:27.068 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-04-19T04:22:27.115 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-19T04:22:27.137 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rsa. 2024-04-19T04:22:27.158 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-04-19T04:22:27.195 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rsa (4.0-3) ... 2024-04-19T04:22:27.284 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-04-19T04:22:27.321 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-04-19T04:22:27.362 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-google-auth. 2024-04-19T04:22:27.378 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-04-19T04:22:27.420 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-04-19T04:22:27.446 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-19T04:22:27.525 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-google-auth. 2024-04-19T04:22:27.543 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-04-19T04:22:27.583 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-04-19T04:22:27.610 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-19T04:22:27.774 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-blinker. 2024-04-19T04:22:27.781 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-04-19T04:22:27.790 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-04-19T04:22:27.832 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-19T04:22:27.886 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-04-19T04:22:27.928 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-blinker. 2024-04-19T04:22:27.945 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-04-19T04:22:27.986 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-19T04:22:28.160 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-oauthlib. 2024-04-19T04:22:28.174 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-19T04:22:28.177 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-04-19T04:22:28.218 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-19T04:22:28.298 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-oauthlib. 2024-04-19T04:22:28.300 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-19T04:22:28.316 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-04-19T04:22:28.356 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-19T04:22:28.427 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-04-19T04:22:28.538 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-19T04:22:28.554 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-04-19T04:22:28.596 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-19T04:22:28.710 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-19T04:22:28.728 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-04-19T04:22:28.754 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-19T04:22:28.768 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-19T04:22:28.916 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-websocket. 2024-04-19T04:22:28.936 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-04-19T04:22:28.974 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-04-19T04:22:29.056 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-04-19T04:22:29.079 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-websocket. 2024-04-19T04:22:29.098 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-04-19T04:22:29.137 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-04-19T04:22:29.312 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-19T04:22:29.328 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-04-19T04:22:29.370 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-04-19T04:22:29.417 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-19T04:22:29.449 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-19T04:22:29.467 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-04-19T04:22:29.507 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-04-19T04:22:29.534 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-04-19T04:22:29.904 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-04-19T04:22:29.959 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-19T04:22:29.975 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:22:30.016 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:30.130 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-19T04:22:30.151 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:22:30.188 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:30.213 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-04-19T04:22:30.344 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-19T04:22:30.360 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-04-19T04:22:30.402 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-04-19T04:22:30.514 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:22:30.524 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-19T04:22:30.543 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-04-19T04:22:30.569 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-19T04:22:30.583 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-04-19T04:22:30.665 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-04-19T04:22:30.695 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-04-19T04:22:30.789 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-19T04:22:30.806 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-19T04:22:30.846 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-19T04:22:30.936 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-19T04:22:30.952 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-19T04:22:30.992 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-19T04:22:30.993 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-19T04:22:31.072 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-04-19T04:22:31.158 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package jq. 2024-04-19T04:22:31.174 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-19T04:22:31.216 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-04-19T04:22:31.263 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package jq. 2024-04-19T04:22:31.280 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-19T04:22:31.310 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-04-19T04:22:31.321 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-04-19T04:22:31.366 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-04-19T04:22:31.477 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package socat. 2024-04-19T04:22:31.493 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-04-19T04:22:31.535 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking socat (1.7.3.3-2) ... 2024-04-19T04:22:31.591 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package socat. 2024-04-19T04:22:31.608 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-04-19T04:22:31.649 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking socat (1.7.3.3-2) ... 2024-04-19T04:22:31.658 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:22:31.686 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-19T04:22:31.784 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-04-19T04:22:31.897 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package xmlstarlet. 2024-04-19T04:22:31.913 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-04-19T04:22:31.946 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-04-19T04:22:31.952 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package xmlstarlet. 2024-04-19T04:22:31.969 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-04-19T04:22:32.010 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-04-19T04:22:32.045 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-19T04:22:32.144 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-19T04:22:32.309 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-test. 2024-04-19T04:22:32.326 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../094-ceph-test_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:32.367 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-test (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:32.390 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-test. 2024-04-19T04:22:32.406 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../094-ceph-test_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:32.447 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-test (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:32.479 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-04-19T04:22:32.855 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-19T04:22:33.117 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-19T04:22:33.173 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-19T04:22:33.243 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-04-19T04:22:33.369 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-04-19T04:22:33.495 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-rsa (4.0-3) ... 2024-04-19T04:22:33.805 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-19T04:22:33.922 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-04-19T04:22:34.223 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-19T04:22:34.314 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-19T04:22:34.440 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-04-19T04:22:34.566 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-04-19T04:22:34.683 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-19T04:22:34.692 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rsa (4.0-3) ... 2024-04-19T04:22:34.993 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-19T04:22:35.009 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-04-19T04:22:35.119 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-04-19T04:22:35.369 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librados2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:35.421 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-19T04:22:35.495 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-04-19T04:22:35.613 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librgw2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:35.722 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-19T04:22:35.722 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:35.934 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libcephfs2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:36.040 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-04-19T04:22:36.059 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-routes (2.4.1-2) ... 2024-04-19T04:22:36.352 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libradosstriper1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:36.408 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librados2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:36.478 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-04-19T04:22:36.534 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-04-19T04:22:36.537 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-volume. 2024-04-19T04:22:36.543 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-volume. 2024-04-19T04:22:36.554 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../095-ceph-volume_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:22:36.560 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../095-ceph-volume_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T04:22:36.595 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-volume (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:36.601 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-volume (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:36.652 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librgw2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:36.778 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:36.815 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librbd1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:36.880 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package fonts-mathjax. 2024-04-19T04:22:36.882 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package fonts-mathjax. 2024-04-19T04:22:36.901 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-19T04:22:36.901 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-19T04:22:36.938 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-19T04:22:36.941 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:36.961 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-19T04:22:36.998 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libcephfs2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:37.067 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:37.124 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-routes (2.4.1-2) ... 2024-04-19T04:22:37.293 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T04:22:37.293 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T04:22:37.426 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libradosstriper1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:37.486 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-19T04:22:37.503 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:37.552 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-04-19T04:22:37.569 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libcephfs-dev (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:37.575 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-19T04:22:37.592 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:37.633 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libcephfs-dev (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:37.744 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libcephfs-dev (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:37.854 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librbd1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:37.870 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-rados (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:37.947 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package nvme-cli. 2024-04-19T04:22:37.967 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-04-19T04:22:37.980 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:37.996 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-04-19T04:22:38.022 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-04-19T04:22:38.061 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package nvme-cli. 2024-04-19T04:22:38.078 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-04-19T04:22:38.106 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:38.136 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-04-19T04:22:38.336 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T04:22:38.336 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T04:22:38.343 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-19T04:22:38.361 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-04-19T04:22:38.402 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-04-19T04:22:38.775 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-19T04:22:38.792 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-04-19T04:22:38.799 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libcephfs-dev (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:38.805 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libjs-mathjax. 2024-04-19T04:22:38.824 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-19T04:22:38.854 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-04-19T04:22:38.863 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-19T04:22:38.925 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-rbd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:38.925 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rados (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:39.051 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up rbd-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:39.068 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-04-19T04:22:39.177 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-rgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:39.220 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libjs-mathjax. 2024-04-19T04:22:39.239 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-19T04:22:39.278 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-19T04:22:39.303 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-cephfs (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:39.445 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:39.965 INFO:teuthology.orchestra.run.smithi066.stdout:Adding group ceph....done 2024-04-19T04:22:40.005 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rbd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:40.106 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up rbd-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:40.216 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:40.341 INFO:teuthology.orchestra.run.smithi066.stdout:Adding system user ceph....done 2024-04-19T04:22:40.342 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cephfs (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:40.493 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:40.500 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python-natsort-doc. 2024-04-19T04:22:40.509 INFO:teuthology.orchestra.run.smithi066.stdout:Setting system user ceph properties....done 2024-04-19T04:22:40.519 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-04-19T04:22:40.529 INFO:teuthology.orchestra.run.smithi066.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-19T04:22:40.558 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-04-19T04:22:40.681 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-19T04:22:40.904 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-webencodings. 2024-04-19T04:22:40.921 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-04-19T04:22:40.942 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python-natsort-doc. 2024-04-19T04:22:40.962 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-19T04:22:40.963 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-04-19T04:22:40.999 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-19T04:22:40.999 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-04-19T04:22:41.021 INFO:teuthology.orchestra.run.smithi007.stdout:Adding group ceph....done 2024-04-19T04:22:41.282 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-html5lib. 2024-04-19T04:22:41.299 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-04-19T04:22:41.336 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-webencodings. 2024-04-19T04:22:41.340 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-04-19T04:22:41.356 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-04-19T04:22:41.356 INFO:teuthology.orchestra.run.smithi007.stdout:Adding system user ceph....done 2024-04-19T04:22:41.394 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-19T04:22:41.447 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-test (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:41.547 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up radosgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:41.549 INFO:teuthology.orchestra.run.smithi007.stdout:Setting system user ceph properties....done 2024-04-19T04:22:41.574 INFO:teuthology.orchestra.run.smithi007.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-19T04:22:41.714 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-html5lib. 2024-04-19T04:22:41.720 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-04-19T04:22:41.726 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-19T04:22:41.732 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-04-19T04:22:41.738 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-04-19T04:22:41.772 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-04-19T04:22:41.778 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-19T04:22:41.997 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T04:22:41.997 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T04:22:42.058 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-19T04:22:42.136 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-04-19T04:22:42.156 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-04-19T04:22:42.194 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-19T04:22:42.282 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pastescript. 2024-04-19T04:22:42.298 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-04-19T04:22:42.339 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-19T04:22:42.474 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-base (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:42.528 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-test (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:42.663 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up radosgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:42.673 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pastescript. 2024-04-19T04:22:42.679 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-psutil. 2024-04-19T04:22:42.692 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-04-19T04:22:42.698 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-04-19T04:22:42.731 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-19T04:22:42.762 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-04-19T04:22:42.862 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-19T04:22:43.051 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-psutil. 2024-04-19T04:22:43.069 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-04-19T04:22:43.099 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-19T04:22:43.117 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-04-19T04:22:43.119 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-04-19T04:22:43.151 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T04:22:43.151 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T04:22:43.165 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-19T04:22:43.301 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mds (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:43.465 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-19T04:22:43.486 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-04-19T04:22:43.501 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-simplejson. 2024-04-19T04:22:43.518 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-04-19T04:22:43.529 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T04:22:43.529 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T04:22:43.531 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-19T04:22:43.559 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-19T04:22:43.623 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-base (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:43.831 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-19T04:22:43.851 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-04-19T04:22:43.885 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-simplejson. 2024-04-19T04:22:43.902 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-04-19T04:22:43.914 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-19T04:22:43.943 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-19T04:22:43.961 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:44.016 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-19T04:22:44.190 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T04:22:44.190 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T04:22:44.204 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-19T04:22:44.223 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-04-19T04:22:44.262 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-19T04:22:44.458 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mds (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:44.637 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-osd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:44.728 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T04:22:44.728 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T04:22:44.926 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package radosgw. 2024-04-19T04:22:44.935 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package radosgw. 2024-04-19T04:22:44.943 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../110-radosgw_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:44.953 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../110-radosgw_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:44.984 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking radosgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:44.993 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking radosgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:45.090 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T04:22:45.090 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T04:22:45.185 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:45.414 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T04:22:45.414 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T04:22:45.582 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:45.708 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:45.850 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mon (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:45.879 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-osd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:46.067 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T04:22:46.067 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T04:22:46.357 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T04:22:46.357 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T04:22:46.379 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package rbd-fuse. 2024-04-19T04:22:46.397 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../111-rbd-fuse_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:46.412 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package rbd-fuse. 2024-04-19T04:22:46.430 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../111-rbd-fuse_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T04:22:46.437 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking rbd-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:46.470 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking rbd-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:46.543 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:46.686 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:46.740 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-attr (19.3.0-2) ... 2024-04-19T04:22:46.781 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:46.781 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-attr (19.3.0-2) ... 2024-04-19T04:22:46.812 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:46.882 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:46.946 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-volume (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:47.008 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mon (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:47.043 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-04-19T04:22:47.109 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-04-19T04:22:47.169 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-19T04:22:47.234 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-19T04:22:47.239 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T04:22:47.239 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T04:22:47.299 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-19T04:22:47.320 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-04-19T04:22:47.393 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-04-19T04:22:47.451 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-19T04:22:47.521 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:47.588 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:47.676 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:47.727 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-19T04:22:47.818 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:47.945 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:48.064 INFO:teuthology.orchestra.run.smithi027.stdout:Adding system user cephadm....done 2024-04-19T04:22:48.087 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-volume (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:48.163 INFO:teuthology.orchestra.run.smithi172.stdout:Adding system user cephadm....done 2024-04-19T04:22:48.244 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-19T04:22:48.326 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-19T04:22:48.370 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-19T04:22:48.461 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-19T04:22:48.466 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-19T04:22:48.642 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-19T04:22:48.713 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-19T04:22:48.796 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-19T04:22:48.952 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-19T04:22:49.023 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-19T04:22:49.072 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-19T04:22:49.166 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-04-19T04:22:49.206 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-04-19T04:22:49.292 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-04-19T04:22:49.340 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-04-19T04:22:49.602 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-04-19T04:22:49.667 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-04-19T04:22:50.062 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-19T04:22:50.103 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-19T04:22:50.380 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-04-19T04:22:50.395 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-04-19T04:22:50.646 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-04-19T04:22:50.664 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-19T04:22:50.680 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-19T04:22:50.973 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-19T04:22:50.973 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-19T04:22:51.263 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T04:22:51.266 DEBUG:teuthology.orchestra.run.smithi066:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-19T04:22:51.267 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-ceph-argparse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:51.283 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-ceph-argparse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:51.340 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2024-04-19T04:22:51.560 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2024-04-19T04:22:51.560 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2024-04-19T04:22:51.566 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-19T04:22:51.584 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-19T04:22:51.692 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-04-19T04:22:51.702 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-04-19T04:22:51.784 INFO:teuthology.orchestra.run.smithi066.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-04-19T04:22:51.784 INFO:teuthology.orchestra.run.smithi066.stdout:flex is already the newest version (2.6.4-6.2). 2024-04-19T04:22:51.784 INFO:teuthology.orchestra.run.smithi066.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-04-19T04:22:51.784 INFO:teuthology.orchestra.run.smithi066.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-04-19T04:22:51.784 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T04:22:51.785 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-19T04:22:51.785 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T04:22:51.786 INFO:teuthology.orchestra.run.smithi066.stdout:Suggested packages: 2024-04-19T04:22:51.787 INFO:teuthology.orchestra.run.smithi066.stdout: libssl-doc 2024-04-19T04:22:51.814 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-04-19T04:22:51.828 INFO:teuthology.orchestra.run.smithi066.stdout:The following NEW packages will be installed: 2024-04-19T04:22:51.829 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-dev libelf-dev libssl-dev 2024-04-19T04:22:51.830 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be upgraded: 2024-04-19T04:22:51.831 INFO:teuthology.orchestra.run.smithi066.stdout: libdw1 libelf1 libssl1.1 libuuid1 uuid-dev 2024-04-19T04:22:51.985 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-19T04:22:52.003 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-19T04:22:52.017 INFO:teuthology.orchestra.run.smithi066.stdout:5 upgraded, 3 newly installed, 0 to remove and 272 not upgraded. 2024-04-19T04:22:52.017 INFO:teuthology.orchestra.run.smithi066.stdout:Need to get 3,303 kB of archives. 2024-04-19T04:22:52.017 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 8,471 kB of additional disk space will be used. 2024-04-19T04:22:52.017 INFO:teuthology.orchestra.run.smithi066.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-04-19T04:22:52.219 INFO:teuthology.orchestra.run.smithi066.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-04-19T04:22:52.251 INFO:teuthology.orchestra.run.smithi066.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-04-19T04:22:52.304 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-19T04:22:52.311 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-19T04:22:52.375 INFO:teuthology.orchestra.run.smithi007.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T04:22:52.378 DEBUG:teuthology.orchestra.run.smithi007:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-19T04:22:52.430 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-04-19T04:22:52.437 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-04-19T04:22:52.449 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-04-19T04:22:52.473 INFO:teuthology.orchestra.run.smithi066.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-04-19T04:22:52.494 INFO:teuthology.orchestra.run.smithi066.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-04-19T04:22:52.667 INFO:teuthology.orchestra.run.smithi007.stdout:Building dependency tree... 2024-04-19T04:22:52.668 INFO:teuthology.orchestra.run.smithi007.stdout:Reading state information... 2024-04-19T04:22:52.688 INFO:teuthology.orchestra.run.smithi066.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-04-19T04:22:52.690 INFO:teuthology.orchestra.run.smithi066.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-04-19T04:22:52.694 INFO:teuthology.orchestra.run.smithi066.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-04-19T04:22:52.813 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-04-19T04:22:52.840 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-04-19T04:22:52.889 INFO:teuthology.orchestra.run.smithi007.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-04-19T04:22:52.889 INFO:teuthology.orchestra.run.smithi007.stdout:flex is already the newest version (2.6.4-6.2). 2024-04-19T04:22:52.889 INFO:teuthology.orchestra.run.smithi007.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-04-19T04:22:52.889 INFO:teuthology.orchestra.run.smithi007.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-04-19T04:22:52.889 INFO:teuthology.orchestra.run.smithi007.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T04:22:52.889 INFO:teuthology.orchestra.run.smithi007.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-19T04:22:52.890 INFO:teuthology.orchestra.run.smithi007.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T04:22:52.891 INFO:teuthology.orchestra.run.smithi007.stdout:Suggested packages: 2024-04-19T04:22:52.891 INFO:teuthology.orchestra.run.smithi007.stdout: libssl-doc 2024-04-19T04:22:52.931 INFO:teuthology.orchestra.run.smithi007.stdout:The following NEW packages will be installed: 2024-04-19T04:22:52.932 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-dev libelf-dev libssl-dev 2024-04-19T04:22:52.933 INFO:teuthology.orchestra.run.smithi007.stdout:The following packages will be upgraded: 2024-04-19T04:22:52.934 INFO:teuthology.orchestra.run.smithi007.stdout: libdw1 libelf1 libssl1.1 libuuid1 uuid-dev 2024-04-19T04:22:52.995 INFO:teuthology.orchestra.run.smithi007.stdout:5 upgraded, 3 newly installed, 0 to remove and 272 not upgraded. 2024-04-19T04:22:52.995 INFO:teuthology.orchestra.run.smithi007.stdout:Need to get 3,303 kB of archives. 2024-04-19T04:22:52.995 INFO:teuthology.orchestra.run.smithi007.stdout:After this operation, 8,471 kB of additional disk space will be used. 2024-04-19T04:22:52.995 INFO:teuthology.orchestra.run.smithi007.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-04-19T04:22:53.046 INFO:teuthology.orchestra.run.smithi007.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-04-19T04:22:53.061 INFO:teuthology.orchestra.run.smithi007.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-04-19T04:22:53.093 INFO:teuthology.orchestra.run.smithi066.stdout:Preconfiguring packages ... 2024-04-19T04:22:53.114 INFO:teuthology.orchestra.run.smithi007.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-04-19T04:22:53.116 INFO:teuthology.orchestra.run.smithi007.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-04-19T04:22:53.123 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-04-19T04:22:53.133 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-04-19T04:22:53.179 INFO:teuthology.orchestra.run.smithi007.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-04-19T04:22:53.180 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-04-19T04:22:53.181 INFO:teuthology.orchestra.run.smithi007.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-04-19T04:22:53.251 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 3,303 kB in 1s (3,544 kB/s) 2024-04-19T04:22:53.405 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-19T04:22:53.410 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-19T04:22:53.417 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-19T04:22:53.441 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-19T04:22:53.534 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-19T04:22:53.547 INFO:teuthology.orchestra.run.smithi007.stdout:Preconfiguring packages ... 2024-04-19T04:22:53.682 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 3,303 kB in 0s (11.7 MB/s) 2024-04-19T04:22:53.769 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-04-19T04:22:53.808 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-04-19T04:22:53.853 INFO:teuthology.orchestra.run.smithi007.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-19T04:22:53.858 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-19T04:22:53.966 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-19T04:22:53.985 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-19T04:22:54.061 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-19T04:22:54.093 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-19T04:22:54.132 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-19T04:22:54.396 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-04-19T04:22:54.425 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-19T04:22:54.436 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-04-19T04:22:54.476 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-19T04:22:54.600 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-19T04:22:54.697 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-packaging (20.3-1) ... 2024-04-19T04:22:54.737 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-packaging (20.3-1) ... 2024-04-19T04:22:54.910 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-19T04:22:54.915 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../0-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T04:22:54.969 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-19T04:22:54.998 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-04-19T04:22:55.021 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-04-19T04:22:55.114 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-19T04:22:55.124 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-19T04:22:55.147 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-19T04:22:55.250 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-19T04:22:55.273 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-19T04:22:55.387 INFO:teuthology.orchestra.run.smithi007.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-19T04:22:55.392 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../0-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T04:22:55.524 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-19T04:22:55.543 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-04-19T04:22:55.564 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../1-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T04:22:55.574 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-04-19T04:22:55.729 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-19T04:22:55.961 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-19T04:22:55.992 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-19T04:22:56.209 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../2-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-19T04:22:56.342 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-04-19T04:22:56.354 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-19T04:22:56.394 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-19T04:22:56.674 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../1-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T04:22:56.720 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-19T04:22:56.723 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up socat (1.7.3.3-2) ... 2024-04-19T04:22:56.740 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../3-libaio-dev_0.3.112-5_amd64.deb ... 2024-04-19T04:22:56.773 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up socat (1.7.3.3-2) ... 2024-04-19T04:22:56.801 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-04-19T04:22:56.827 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-19T04:22:56.849 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:56.896 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:22:57.040 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-19T04:22:57.059 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../4-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T04:22:57.098 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T04:22:57.177 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:22:57.247 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:22:57.303 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../2-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-19T04:22:57.312 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-04-19T04:22:57.376 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-19T04:22:57.382 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-04-19T04:22:57.394 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../5-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-19T04:22:57.434 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T04:22:57.437 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-04-19T04:22:57.672 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-19T04:22:57.734 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-19T04:22:57.798 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-04-19T04:22:57.815 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-19T04:22:57.833 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../3-libaio-dev_0.3.112-5_amd64.deb ... 2024-04-19T04:22:57.882 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-04-19T04:22:57.884 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-04-19T04:22:57.896 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T04:22:57.923 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-04-19T04:22:58.019 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-04-19T04:22:58.135 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-19T04:22:58.152 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../4-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T04:22:58.193 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T04:22:58.225 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-19T04:22:58.239 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-04-19T04:22:58.312 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-19T04:22:58.382 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-19T04:22:58.463 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-19T04:22:58.483 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T04:22:58.483 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../5-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-19T04:22:58.521 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T04:22:58.551 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:22:58.584 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T04:22:58.655 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:22:58.660 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-19T04:22:58.701 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T04:22:58.780 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-19T04:22:58.786 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-04-19T04:22:58.827 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T04:22:58.906 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-04-19T04:22:58.954 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-19T04:22:58.991 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T04:22:59.121 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-04-19T04:22:59.250 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-04-19T04:22:59.302 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-04-19T04:22:59.389 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-04-19T04:22:59.419 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-19T04:22:59.545 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T04:22:59.567 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-04-19T04:22:59.682 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-19T04:22:59.761 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T04:22:59.803 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-19T04:22:59.877 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-19T04:22:59.948 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T04:23:00.003 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-19T04:23:00.074 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T04:23:00.079 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-04-19T04:23:00.201 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-19T04:23:00.282 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-04-19T04:23:00.380 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-19T04:23:00.491 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-19T04:23:00.616 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-19T04:23:00.689 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-04-19T04:23:00.934 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T04:23:00.939 DEBUG:teuthology.parallel:result is None 2024-04-19T04:23:00.950 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-04-19T04:23:01.033 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-04-19T04:23:01.275 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-04-19T04:23:01.351 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-04-19T04:23:01.401 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-19T04:23:01.603 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-04-19T04:23:01.729 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-19T04:23:01.736 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-04-19T04:23:02.038 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-19T04:23:02.039 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-04-19T04:23:02.112 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-19T04:23:02.238 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-19T04:23:02.364 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-04-19T04:23:02.390 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-19T04:23:02.480 INFO:teuthology.orchestra.run.smithi007.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T04:23:02.484 DEBUG:teuthology.parallel:result is None 2024-04-19T04:23:02.549 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-19T04:23:02.675 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-04-19T04:23:02.690 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-19T04:23:02.983 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-04-19T04:23:03.035 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-19T04:23:03.345 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-04-19T04:23:04.524 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-19T04:23:04.650 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-04-19T04:23:04.852 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-19T04:23:04.978 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-04-19T04:23:05.035 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-04-19T04:23:05.336 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-04-19T04:23:05.355 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-04-19T04:23:05.629 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:23:05.647 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-04-19T04:23:05.755 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-04-19T04:23:05.940 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T04:23:06.066 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-04-19T04:23:06.132 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-19T04:23:06.401 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-19T04:23:06.467 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-04-19T04:23:06.787 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-04-19T04:23:06.844 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-19T04:23:07.170 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-19T04:23:07.180 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-19T04:23:07.506 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-19T04:23:08.234 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-19T04:23:08.476 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-04-19T04:23:08.587 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-19T04:23:08.627 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-04-19T04:23:08.713 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-04-19T04:23:08.753 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rsa (4.0-3) ... 2024-04-19T04:23:08.872 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-04-19T04:23:08.998 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rsa (4.0-3) ... 2024-04-19T04:23:09.054 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-19T04:23:09.180 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-04-19T04:23:09.291 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-19T04:23:09.442 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-04-19T04:23:09.743 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-19T04:23:09.964 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-19T04:23:10.052 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-19T04:23:10.266 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-19T04:23:10.379 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-04-19T04:23:10.592 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-04-19T04:23:10.747 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librados2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:10.873 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-04-19T04:23:10.961 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librados2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:10.999 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librgw2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:11.087 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-04-19T04:23:11.142 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:11.204 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librgw2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:11.330 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:11.345 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libcephfs2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:11.488 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-routes (2.4.1-2) ... 2024-04-19T04:23:11.558 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libcephfs2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:11.684 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-routes (2.4.1-2) ... 2024-04-19T04:23:11.797 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libradosstriper1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:11.923 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-04-19T04:23:12.094 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libradosstriper1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:12.220 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-04-19T04:23:12.259 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librbd1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:12.385 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:12.502 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:12.538 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librbd1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:12.664 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:12.729 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T04:23:12.729 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T04:23:12.790 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:13.019 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T04:23:13.019 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T04:23:13.179 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libcephfs-dev (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:13.306 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rados (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:13.457 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-04-19T04:23:13.467 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libcephfs-dev (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:13.593 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rados (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:13.744 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-04-19T04:23:14.386 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rbd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:14.511 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up rbd-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:14.671 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:14.714 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rbd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:14.797 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cephfs (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:14.832 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up rbd-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:14.923 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:14.958 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:15.084 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cephfs (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:15.243 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:15.788 INFO:teuthology.orchestra.run.smithi027.stdout:Adding group ceph....done 2024-04-19T04:23:15.812 INFO:teuthology.orchestra.run.smithi172.stdout:Adding group ceph....done 2024-04-19T04:23:16.177 INFO:teuthology.orchestra.run.smithi172.stdout:Adding system user ceph....done 2024-04-19T04:23:16.197 INFO:teuthology.orchestra.run.smithi027.stdout:Adding system user ceph....done 2024-04-19T04:23:16.366 INFO:teuthology.orchestra.run.smithi027.stdout:Setting system user ceph properties....done 2024-04-19T04:23:16.370 INFO:teuthology.orchestra.run.smithi172.stdout:Setting system user ceph properties....done 2024-04-19T04:23:16.391 INFO:teuthology.orchestra.run.smithi027.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-19T04:23:16.393 INFO:teuthology.orchestra.run.smithi172.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-19T04:23:16.544 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-19T04:23:16.544 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-19T04:23:16.868 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-19T04:23:16.877 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-19T04:23:17.328 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-test (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:17.341 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-test (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:17.454 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up radosgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:17.492 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up radosgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:17.960 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T04:23:17.960 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T04:23:17.961 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T04:23:17.961 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T04:23:18.394 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-base (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:18.406 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-base (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:18.778 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-19T04:23:18.798 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-19T04:23:19.229 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mds (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:19.241 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mds (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:19.458 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T04:23:19.459 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T04:23:19.462 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T04:23:19.462 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T04:23:19.914 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:19.917 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:20.151 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T04:23:20.152 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T04:23:20.261 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T04:23:20.261 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T04:23:20.606 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-osd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:20.728 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-osd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:21.108 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T04:23:21.108 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T04:23:21.229 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T04:23:21.229 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T04:23:21.567 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:21.679 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:21.701 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:21.805 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:21.844 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mon (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:21.948 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mon (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:22.071 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T04:23:22.071 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T04:23:22.179 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T04:23:22.179 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T04:23:22.520 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:22.616 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:22.680 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:22.759 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:22.797 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:22.884 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:22.923 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-volume (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:23.036 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-volume (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T04:23:23.268 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-19T04:23:23.397 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-19T04:23:23.428 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-19T04:23:23.565 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-19T04:23:23.713 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-19T04:23:23.850 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-19T04:23:26.632 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-04-19T04:23:26.744 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-04-19T04:23:27.215 INFO:teuthology.orchestra.run.smithi172.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T04:23:27.218 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-19T04:23:27.291 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-04-19T04:23:27.427 INFO:teuthology.orchestra.run.smithi027.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T04:23:27.429 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-19T04:23:27.499 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-04-19T04:23:27.505 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2024-04-19T04:23:27.505 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2024-04-19T04:23:27.715 INFO:teuthology.orchestra.run.smithi172.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-04-19T04:23:27.715 INFO:teuthology.orchestra.run.smithi172.stdout:flex is already the newest version (2.6.4-6.2). 2024-04-19T04:23:27.715 INFO:teuthology.orchestra.run.smithi172.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-04-19T04:23:27.716 INFO:teuthology.orchestra.run.smithi172.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-04-19T04:23:27.716 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T04:23:27.716 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-19T04:23:27.716 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T04:23:27.717 INFO:teuthology.orchestra.run.smithi172.stdout:Suggested packages: 2024-04-19T04:23:27.718 INFO:teuthology.orchestra.run.smithi172.stdout: libssl-doc 2024-04-19T04:23:27.718 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2024-04-19T04:23:27.718 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2024-04-19T04:23:27.756 INFO:teuthology.orchestra.run.smithi172.stdout:The following NEW packages will be installed: 2024-04-19T04:23:27.757 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-dev libelf-dev libssl-dev 2024-04-19T04:23:27.758 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages will be upgraded: 2024-04-19T04:23:27.759 INFO:teuthology.orchestra.run.smithi172.stdout: libdw1 libelf1 libssl1.1 libuuid1 uuid-dev 2024-04-19T04:23:27.864 INFO:teuthology.orchestra.run.smithi172.stdout:5 upgraded, 3 newly installed, 0 to remove and 272 not upgraded. 2024-04-19T04:23:27.864 INFO:teuthology.orchestra.run.smithi172.stdout:Need to get 3,303 kB of archives. 2024-04-19T04:23:27.864 INFO:teuthology.orchestra.run.smithi172.stdout:After this operation, 8,471 kB of additional disk space will be used. 2024-04-19T04:23:27.865 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-04-19T04:23:27.940 INFO:teuthology.orchestra.run.smithi027.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-04-19T04:23:27.940 INFO:teuthology.orchestra.run.smithi027.stdout:flex is already the newest version (2.6.4-6.2). 2024-04-19T04:23:27.940 INFO:teuthology.orchestra.run.smithi027.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-04-19T04:23:27.940 INFO:teuthology.orchestra.run.smithi027.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-04-19T04:23:27.940 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T04:23:27.940 INFO:teuthology.orchestra.run.smithi027.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-19T04:23:27.941 INFO:teuthology.orchestra.run.smithi027.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T04:23:27.942 INFO:teuthology.orchestra.run.smithi027.stdout:Suggested packages: 2024-04-19T04:23:27.942 INFO:teuthology.orchestra.run.smithi027.stdout: libssl-doc 2024-04-19T04:23:27.970 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-04-19T04:23:27.981 INFO:teuthology.orchestra.run.smithi027.stdout:The following NEW packages will be installed: 2024-04-19T04:23:27.982 INFO:teuthology.orchestra.run.smithi027.stdout: libaio-dev libelf-dev libssl-dev 2024-04-19T04:23:27.983 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages will be upgraded: 2024-04-19T04:23:27.985 INFO:teuthology.orchestra.run.smithi027.stdout: libdw1 libelf1 libssl1.1 libuuid1 uuid-dev 2024-04-19T04:23:27.986 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-04-19T04:23:28.103 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-04-19T04:23:28.113 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-04-19T04:23:28.170 INFO:teuthology.orchestra.run.smithi027.stdout:5 upgraded, 3 newly installed, 0 to remove and 272 not upgraded. 2024-04-19T04:23:28.170 INFO:teuthology.orchestra.run.smithi027.stdout:Need to get 3,303 kB of archives. 2024-04-19T04:23:28.170 INFO:teuthology.orchestra.run.smithi027.stdout:After this operation, 8,471 kB of additional disk space will be used. 2024-04-19T04:23:28.170 INFO:teuthology.orchestra.run.smithi027.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-04-19T04:23:28.224 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-04-19T04:23:28.226 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-04-19T04:23:28.230 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-04-19T04:23:28.371 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-04-19T04:23:28.403 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-04-19T04:23:28.625 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-04-19T04:23:28.645 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-04-19T04:23:28.839 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-04-19T04:23:28.840 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-04-19T04:23:28.844 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-04-19T04:23:29.034 INFO:teuthology.orchestra.run.smithi172.stdout:Preconfiguring packages ... 2024-04-19T04:23:29.175 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 3,303 kB in 1s (3,472 kB/s) 2024-04-19T04:23:29.245 INFO:teuthology.orchestra.run.smithi027.stdout:Preconfiguring packages ... 2024-04-19T04:23:29.325 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-19T04:23:29.330 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-19T04:23:29.385 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 3,303 kB in 1s (3,558 kB/s) 2024-04-19T04:23:29.444 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-19T04:23:29.536 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-19T04:23:29.541 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-19T04:23:29.673 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-19T04:23:29.910 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-19T04:23:30.084 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-19T04:23:30.158 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-19T04:23:30.330 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-19T04:23:30.446 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-19T04:23:30.724 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-19T04:23:30.887 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-19T04:23:30.891 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../0-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T04:23:31.024 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-19T04:23:31.175 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-19T04:23:31.180 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../0-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T04:23:31.321 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-19T04:23:31.515 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../1-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T04:23:31.763 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../1-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T04:23:31.900 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-19T04:23:31.919 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-19T04:23:32.390 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../2-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-19T04:23:32.400 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../2-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-19T04:23:32.540 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-04-19T04:23:32.555 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-04-19T04:23:32.952 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-19T04:23:32.958 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-19T04:23:32.969 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../3-libaio-dev_0.3.112-5_amd64.deb ... 2024-04-19T04:23:32.979 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../3-libaio-dev_0.3.112-5_amd64.deb ... 2024-04-19T04:23:33.010 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-04-19T04:23:33.042 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-04-19T04:23:33.272 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-19T04:23:33.291 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../4-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T04:23:33.312 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-19T04:23:33.329 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../4-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T04:23:33.330 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T04:23:33.370 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T04:23:33.608 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-19T04:23:33.625 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../5-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-19T04:23:33.665 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-19T04:23:33.682 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../5-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-19T04:23:33.690 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T04:23:33.723 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T04:23:34.160 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T04:23:34.209 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T04:23:34.528 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-04-19T04:23:34.621 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-04-19T04:23:34.654 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-19T04:23:34.747 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-19T04:23:34.805 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T04:23:34.873 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T04:23:34.931 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T04:23:34.974 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T04:23:35.057 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T04:23:35.074 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T04:23:35.175 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T04:23:35.183 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T04:23:35.294 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-19T04:23:35.333 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-19T04:23:36.814 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-19T04:23:36.830 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-19T04:23:37.258 INFO:teuthology.orchestra.run.smithi027.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T04:23:37.262 DEBUG:teuthology.parallel:result is None 2024-04-19T04:23:37.457 INFO:teuthology.orchestra.run.smithi172.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T04:23:37.461 DEBUG:teuthology.parallel:result is None 2024-04-19T04:23:37.462 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T04:23:37.784 DEBUG:teuthology.orchestra.run.smithi007:> dpkg-query -W -f '${Version}' ceph 2024-04-19T04:23:37.808 INFO:teuthology.orchestra.run.smithi007.stdout:18.2.2-1237-g646b8c7d-1focal 2024-04-19T04:23:37.808 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237-g646b8c7d-1focal 2024-04-19T04:23:37.808 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237-g646b8c7d-1focal is installed. 2024-04-19T04:23:37.810 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T04:23:37.950 DEBUG:teuthology.orchestra.run.smithi027:> dpkg-query -W -f '${Version}' ceph 2024-04-19T04:23:37.973 INFO:teuthology.orchestra.run.smithi027.stdout:18.2.2-1237-g646b8c7d-1focal 2024-04-19T04:23:37.973 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237-g646b8c7d-1focal 2024-04-19T04:23:37.973 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237-g646b8c7d-1focal is installed. 2024-04-19T04:23:37.975 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T04:23:38.282 DEBUG:teuthology.orchestra.run.smithi066:> dpkg-query -W -f '${Version}' ceph 2024-04-19T04:23:38.307 INFO:teuthology.orchestra.run.smithi066.stdout:18.2.2-1237-g646b8c7d-1focal 2024-04-19T04:23:38.307 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237-g646b8c7d-1focal 2024-04-19T04:23:38.307 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237-g646b8c7d-1focal is installed. 2024-04-19T04:23:38.310 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T04:23:38.646 DEBUG:teuthology.orchestra.run.smithi172:> dpkg-query -W -f '${Version}' ceph 2024-04-19T04:23:38.671 INFO:teuthology.orchestra.run.smithi172.stdout:18.2.2-1237-g646b8c7d-1focal 2024-04-19T04:23:38.671 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237-g646b8c7d-1focal 2024-04-19T04:23:38.671 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237-g646b8c7d-1focal is installed. 2024-04-19T04:23:38.673 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-19T04:23:38.673 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-19T04:23:38.673 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T04:23:38.690 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-04-19T04:23:38.690 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T04:23:38.708 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-04-19T04:23:38.708 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T04:23:38.725 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-19T04:23:38.725 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T04:23:38.742 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-19T04:23:38.743 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-19T04:23:38.743 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T04:23:38.760 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T04:23:38.773 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-04-19T04:23:38.773 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T04:23:38.790 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T04:23:38.848 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-04-19T04:23:38.848 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T04:23:38.864 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T04:23:38.874 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-19T04:23:38.874 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T04:23:38.889 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T04:23:38.900 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-19T04:23:38.900 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-19T04:23:38.900 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T04:23:38.916 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T04:23:38.973 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-04-19T04:23:38.973 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T04:23:38.989 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T04:23:39.047 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-04-19T04:23:39.047 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T04:23:39.062 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T04:23:39.120 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-19T04:23:39.120 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T04:23:39.136 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T04:23:39.145 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-19T04:23:39.146 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-19T04:23:39.146 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T04:23:39.162 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T04:23:39.171 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-04-19T04:23:39.171 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T04:23:39.187 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T04:23:39.248 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-04-19T04:23:39.248 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T04:23:39.265 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T04:23:39.281 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-19T04:23:39.281 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T04:23:39.298 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T04:23:39.308 INFO:teuthology.run_tasks:Running task ceph... 2024-04-19T04:23:39.419 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-19T04:23:39.420 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /var/log/ceph 2024-04-19T04:23:39.422 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 777 /var/log/ceph 2024-04-19T04:23:39.424 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 777 /var/log/ceph 2024-04-19T04:23:39.426 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /var/log/ceph 2024-04-19T04:23:39.442 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-19T04:23:39.442 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T04:23:39.444 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T04:23:39.446 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T04:23:39.448 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T04:23:39.500 INFO:tasks.ceph:Creating extra log directories... 2024-04-19T04:23:39.501 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T04:23:39.503 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T04:23:39.505 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T04:23:39.507 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T04:23:39.531 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-19T04:23:39.532 INFO:tasks.ceph:config {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-19T04:23:39.532 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943', 'branch': 'reef', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/ubuntu_20.04 tasks/admin_socket_objecter_requests thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7662943', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 2879, 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'sleep_before_teardown': 0, 'subset': '2/4', 'suite': 'powercycle', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'targets': {'smithi007.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi027.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi066.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi172.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'radosbench': {'clients': ['client.0'], 'time': 60}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-18_22:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-19T04:23:39.532 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T04:23:39.534 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T04:23:39.536 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T04:23:39.538 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T04:23:39.568 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T04:23:39.570 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T04:23:39.585 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T04:23:39.587 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T04:23:39.602 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-04-19T04:23:39.602 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T04:23:39.606 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T04:23:39.606 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_1 2024-04-19T04:23:39.612 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T04:23:39.612 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T04:23:39.612 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 361 Links: 1 2024-04-19T04:23:39.612 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T04:23:39.612 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-04-19 04:18:22.360739301 +0000 2024-04-19T04:23:39.612 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-04-19 04:18:22.152744097 +0000 2024-04-19T04:23:39.612 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-04-19 04:18:22.152744097 +0000 2024-04-19T04:23:39.612 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2024-04-19T04:23:39.612 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T04:23:39.622 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-04-19T04:23:39.623 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-04-19T04:23:39.623 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000432464 s, 1.2 MB/s 2024-04-19T04:23:39.624 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T04:23:39.676 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_2 2024-04-19T04:23:39.683 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T04:23:39.683 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T04:23:39.684 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 368 Links: 1 2024-04-19T04:23:39.684 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T04:23:39.684 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-04-19 04:18:22.796729246 +0000 2024-04-19T04:23:39.684 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-04-19 04:18:22.564734596 +0000 2024-04-19T04:23:39.684 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-04-19 04:18:22.564734596 +0000 2024-04-19T04:23:39.684 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2024-04-19T04:23:39.684 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T04:23:39.698 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-04-19T04:23:39.698 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-04-19T04:23:39.698 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000435791 s, 1.2 MB/s 2024-04-19T04:23:39.699 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T04:23:39.748 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_3 2024-04-19T04:23:39.755 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T04:23:39.755 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T04:23:39.755 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 371 Links: 1 2024-04-19T04:23:39.755 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T04:23:39.755 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-04-19 04:18:23.024723988 +0000 2024-04-19T04:23:39.755 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-04-19 04:18:23.020724080 +0000 2024-04-19T04:23:39.755 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-04-19 04:18:23.020724080 +0000 2024-04-19T04:23:39.755 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2024-04-19T04:23:39.755 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T04:23:39.767 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-04-19T04:23:39.767 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-04-19T04:23:39.767 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000413478 s, 1.2 MB/s 2024-04-19T04:23:39.768 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T04:23:39.776 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_4 2024-04-19T04:23:39.782 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T04:23:39.782 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T04:23:39.782 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 377 Links: 1 2024-04-19T04:23:39.782 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T04:23:39.782 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-04-19 04:18:23.668709137 +0000 2024-04-19T04:23:39.782 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-04-19 04:18:23.464713842 +0000 2024-04-19T04:23:39.782 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-04-19 04:18:23.464713842 +0000 2024-04-19T04:23:39.782 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2024-04-19T04:23:39.783 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T04:23:39.838 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-04-19T04:23:39.838 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-04-19T04:23:39.838 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000371292 s, 1.4 MB/s 2024-04-19T04:23:39.840 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T04:23:39.847 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-19T04:23:39.848 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-04-19T04:23:39.848 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T04:23:39.854 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T04:23:39.854 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_1 2024-04-19T04:23:39.862 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T04:23:39.862 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T04:23:39.862 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 359 Links: 1 2024-04-19T04:23:39.862 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T04:23:39.862 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-04-19 04:18:36.211317447 +0000 2024-04-19T04:23:39.862 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-04-19 04:18:35.991322511 +0000 2024-04-19T04:23:39.862 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-04-19 04:18:35.991322511 +0000 2024-04-19T04:23:39.862 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2024-04-19T04:23:39.862 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T04:23:39.919 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-04-19T04:23:39.919 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-04-19T04:23:39.919 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000434991 s, 1.2 MB/s 2024-04-19T04:23:39.921 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T04:23:39.930 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_2 2024-04-19T04:23:39.940 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T04:23:39.940 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T04:23:39.941 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 366 Links: 1 2024-04-19T04:23:39.941 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T04:23:39.941 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-04-19 04:18:36.683306583 +0000 2024-04-19T04:23:39.941 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-04-19 04:18:36.455311830 +0000 2024-04-19T04:23:39.941 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-04-19 04:18:36.455311830 +0000 2024-04-19T04:23:39.941 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2024-04-19T04:23:39.941 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T04:23:39.995 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-04-19T04:23:39.996 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-04-19T04:23:39.996 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000396012 s, 1.3 MB/s 2024-04-19T04:23:39.997 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T04:23:40.005 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_3 2024-04-19T04:23:40.012 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T04:23:40.012 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T04:23:40.012 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 372 Links: 1 2024-04-19T04:23:40.012 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T04:23:40.013 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-04-19 04:18:37.131296271 +0000 2024-04-19T04:23:40.013 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-04-19 04:18:36.899301611 +0000 2024-04-19T04:23:40.013 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-04-19 04:18:36.899301611 +0000 2024-04-19T04:23:40.013 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2024-04-19T04:23:40.013 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T04:23:40.027 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-04-19T04:23:40.027 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-04-19T04:23:40.028 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000415512 s, 1.2 MB/s 2024-04-19T04:23:40.028 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T04:23:40.077 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_4 2024-04-19T04:23:40.084 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T04:23:40.084 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T04:23:40.084 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 378 Links: 1 2024-04-19T04:23:40.084 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T04:23:40.085 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-04-19 04:18:37.591285682 +0000 2024-04-19T04:23:40.085 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-04-19 04:18:37.367290839 +0000 2024-04-19T04:23:40.085 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-04-19 04:18:37.367290839 +0000 2024-04-19T04:23:40.085 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2024-04-19T04:23:40.085 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T04:23:40.097 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-04-19T04:23:40.097 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-04-19T04:23:40.097 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000370889 s, 1.4 MB/s 2024-04-19T04:23:40.098 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T04:23:40.149 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-19T04:23:40.150 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-19T04:23:40.150 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T04:23:40.157 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T04:23:40.157 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-04-19T04:23:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T04:23:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T04:23:40.164 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 360 Links: 1 2024-04-19T04:23:40.164 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T04:23:40.164 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-19 04:18:23.368214869 +0000 2024-04-19T04:23:40.165 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-19 04:18:23.172219387 +0000 2024-04-19T04:23:40.165 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-19 04:18:23.172219387 +0000 2024-04-19T04:23:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2024-04-19T04:23:40.165 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T04:23:40.175 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-19T04:23:40.175 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-19T04:23:40.175 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.00043551 s, 1.2 MB/s 2024-04-19T04:23:40.176 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T04:23:40.226 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-04-19T04:23:40.234 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T04:23:40.234 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T04:23:40.234 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 367 Links: 1 2024-04-19T04:23:40.234 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T04:23:40.234 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-19 04:18:23.592209707 +0000 2024-04-19T04:23:40.234 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-19 04:18:23.588209798 +0000 2024-04-19T04:23:40.234 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-19 04:18:23.588209798 +0000 2024-04-19T04:23:40.234 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2024-04-19T04:23:40.235 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T04:23:40.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-19T04:23:40.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-19T04:23:40.247 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000403908 s, 1.3 MB/s 2024-04-19T04:23:40.248 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T04:23:40.256 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-04-19T04:23:40.263 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T04:23:40.263 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T04:23:40.263 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 374 Links: 1 2024-04-19T04:23:40.263 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T04:23:40.263 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-19 04:18:24.252194493 +0000 2024-04-19T04:23:40.263 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-19 04:18:24.040199381 +0000 2024-04-19T04:23:40.264 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-19 04:18:24.040199381 +0000 2024-04-19T04:23:40.264 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2024-04-19T04:23:40.264 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T04:23:40.275 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-19T04:23:40.275 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-19T04:23:40.275 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000385261 s, 1.3 MB/s 2024-04-19T04:23:40.276 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T04:23:40.284 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-04-19T04:23:40.332 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T04:23:40.332 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T04:23:40.332 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 380 Links: 1 2024-04-19T04:23:40.332 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T04:23:40.332 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-19 04:18:24.684184535 +0000 2024-04-19T04:23:40.333 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-19 04:18:24.456189791 +0000 2024-04-19T04:23:40.333 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-19 04:18:24.456189791 +0000 2024-04-19T04:23:40.333 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2024-04-19T04:23:40.333 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T04:23:40.348 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-19T04:23:40.348 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-19T04:23:40.348 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000381025 s, 1.3 MB/s 2024-04-19T04:23:40.349 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T04:23:40.357 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-19T04:23:40.357 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi027.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi066.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-19T04:23:40.357 INFO:tasks.ceph:Generating config... 2024-04-19T04:23:40.359 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2024-04-19T04:23:40.359 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-19T04:23:40.359 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-19T04:23:40.359 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-19T04:23:40.359 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-19T04:23:40.359 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-19T04:23:40.359 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-19T04:23:40.359 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-04-19T04:23:40.359 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-19T04:23:40.359 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-19T04:23:40.359 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-19T04:23:40.359 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-19T04:23:40.359 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-19T04:23:40.360 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-19T04:23:40.360 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-19T04:23:40.360 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-19T04:23:40.360 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-19T04:23:40.360 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-19T04:23:40.360 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-19T04:23:40.360 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-19T04:23:40.360 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-19T04:23:40.360 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-19T04:23:40.360 INFO:tasks.ceph:Setting up mon.a... 2024-04-19T04:23:40.360 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-19T04:23:40.403 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.keyring 2024-04-19T04:23:40.415 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-19T04:23:40.455 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T04:23:40.470 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.7'), ('mon.b', '[v2:172.21.15.7:3301,v1:172.21.15.7:6790]'), ('mon.c', '[v2:172.21.15.7:3302,v1:172.21.15.7:6791]')] 2024-04-19T04:23:40.471 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],[v2:172.21.15.7:3302,v1:172.21.15.7:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}} 2024-04-19T04:23:40.471 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-19T04:23:40.472 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-19T04:23:40.476 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.7 --addv b '[v2:172.21.15.7:3301,v1:172.21.15.7:6790]' --addv c '[v2:172.21.15.7:3302,v1:172.21.15.7:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-19T04:23:40.564 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-19T04:23:40.565 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: generated fsid 7aba6173-85fe-4265-947d-27b4a313af4e 2024-04-19T04:23:40.565 INFO:teuthology.orchestra.run.smithi007.stdout:setting min_mon_release = pacific 2024-04-19T04:23:40.565 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 0 2024-04-19T04:23:40.565 INFO:teuthology.orchestra.run.smithi007.stdout:fsid 7aba6173-85fe-4265-947d-27b4a313af4e 2024-04-19T04:23:40.565 INFO:teuthology.orchestra.run.smithi007.stdout:last_changed 2024-04-19T04:23:40.565357+0000 2024-04-19T04:23:40.565 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-04-19T04:23:40.565357+0000 2024-04-19T04:23:40.565 INFO:teuthology.orchestra.run.smithi007.stdout:min_mon_release 16 (pacific) 2024-04-19T04:23:40.565 INFO:teuthology.orchestra.run.smithi007.stdout:election_strategy: 1 2024-04-19T04:23:40.565 INFO:teuthology.orchestra.run.smithi007.stdout:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-04-19T04:23:40.565 INFO:teuthology.orchestra.run.smithi007.stdout:1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.b 2024-04-19T04:23:40.566 INFO:teuthology.orchestra.run.smithi007.stdout:2: [v2:172.21.15.7:3302/0,v1:172.21.15.7:6791/0] mon.c 2024-04-19T04:23:40.566 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-19T04:23:40.567 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-19T04:23:40.574 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7aba6173-85fe-4265-947d-27b4a313af4e... 2024-04-19T04:23:40.574 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T04:23:40.616 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T04:23:40.618 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T04:23:40.620 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T04:23:40.649 INFO:teuthology.orchestra.run.smithi027.stdout:[global] 2024-04-19T04:23:40.649 INFO:teuthology.orchestra.run.smithi027.stdout: chdir = "" 2024-04-19T04:23:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T04:23:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: auth supported = cephx 2024-04-19T04:23:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: filestore xattr use omap = true 2024-04-19T04:23:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: mon clock drift allowed = 1.000 2024-04-19T04:23:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: osd crush chooseleaf type = 0 2024-04-19T04:23:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: auth debug = true 2024-04-19T04:23:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on old message = true 2024-04-19T04:23:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on bug = true 2024-04-19T04:23:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T04:23:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: mon pg warn max object skew = 0 2024-04-19T04:23:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T04:23:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T04:23:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default size = 2 2024-04-19T04:23:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd allow primary affinity = true 2024-04-19T04:23:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd allow pg remap = true 2024-04-19T04:23:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on legacy crush tunables = false 2024-04-19T04:23:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on crush straw calc version zero = false 2024-04-19T04:23:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on no sortbitwise = false 2024-04-19T04:23:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on osd down out interval zero = false 2024-04-19T04:23:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on too few osds = false 2024-04-19T04:23:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T04:23:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T04:23:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: mon_allow_pool_size_one = true 2024-04-19T04:23:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T04:23:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: osd default data pool replay window = 5 2024-04-19T04:23:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: mon allow pool delete = true 2024-04-19T04:23:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: mon cluster log file level = debug 2024-04-19T04:23:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: debug asserts on shutdown = true 2024-04-19T04:23:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: mon health detail to clog = false 2024-04-19T04:23:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: mon host = "172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],[v2:172.21.15.7:3302,v1:172.21.15.7:6791]" 2024-04-19T04:23:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: fsid = 7aba6173-85fe-4265-947d-27b4a313af4e 2024-04-19T04:23:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.653 INFO:teuthology.orchestra.run.smithi027.stdout:[osd] 2024-04-19T04:23:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: osd journal size = 100 2024-04-19T04:23:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: osd scrub load threshold = 5.0 2024-04-19T04:23:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: osd scrub max interval = 600 2024-04-19T04:23:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: osd mclock profile = high_recovery_ops 2024-04-19T04:23:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: osd recover clone overlap = true 2024-04-19T04:23:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: osd recovery max chunk = 1048576 2024-04-19T04:23:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug shutdown = true 2024-04-19T04:23:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug op order = true 2024-04-19T04:23:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug verify stray on activate = true 2024-04-19T04:23:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: osd open classes on start = true 2024-04-19T04:23:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug pg log writeout = true 2024-04-19T04:23:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: osd deep scrub update digest min age = 30 2024-04-19T04:23:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: osd map max advance = 10 2024-04-19T04:23:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: journal zero on create = true 2024-04-19T04:23:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: filestore ondisk finisher threads = 3 2024-04-19T04:23:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: filestore apply finisher threads = 3 2024-04-19T04:23:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: bdev debug aio = true 2024-04-19T04:23:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug misdirected ops = true 2024-04-19T04:23:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore block size = 96636764160 2024-04-19T04:23:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore compression algorithm = snappy 2024-04-19T04:23:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore compression mode = aggressive 2024-04-19T04:23:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore fsck on mount = True 2024-04-19T04:23:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: debug bluefs = 1/20 2024-04-19T04:23:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: debug bluestore = 1/20 2024-04-19T04:23:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2024-04-19T04:23:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: debug osd = 20 2024-04-19T04:23:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: debug rocksdb = 4/10 2024-04-19T04:23:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T04:23:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd full ratio = 0.9 2024-04-19T04:23:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd nearfull ratio = 0.8 2024-04-19T04:23:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: osd blocked scrub grace period = 3600 2024-04-19T04:23:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: osd failsafe full ratio = 0.95 2024-04-19T04:23:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: osd max markdown count = 1000 2024-04-19T04:23:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: osd objectstore = bluestore 2024-04-19T04:23:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.656 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr] 2024-04-19T04:23:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2024-04-19T04:23:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: debug mgr = 20 2024-04-19T04:23:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: debug mon = 20 2024-04-19T04:23:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: debug auth = 20 2024-04-19T04:23:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min pgs per osd = 4 2024-04-19T04:23:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min bytes per osd = 10 2024-04-19T04:23:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: mgr/telemetry/nag = false 2024-04-19T04:23:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.657 INFO:teuthology.orchestra.run.smithi027.stdout:[mon] 2024-04-19T04:23:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2024-04-19T04:23:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: debug mon = 20 2024-04-19T04:23:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: debug paxos = 20 2024-04-19T04:23:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: debug auth = 20 2024-04-19T04:23:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: mon data avail warn = 5 2024-04-19T04:23:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: mon mgr mkfs grace = 240 2024-04-19T04:23:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min pgs per osd = 4 2024-04-19T04:23:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd reporter subtree level = osd 2024-04-19T04:23:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd prime pg temp = true 2024-04-19T04:23:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min bytes per osd = 10 2024-04-19T04:23:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T04:23:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T04:23:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T04:23:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T04:23:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T04:23:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T04:23:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: # 1m isn't quite enough 2024-04-19T04:23:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: mon_down_mkfs_grace = 2m 2024-04-19T04:23:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_filestore_osds = false 2024-04-19T04:23:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-04-19T04:23:40.659 INFO:teuthology.orchestra.run.smithi027.stdout:[client] 2024-04-19T04:23:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: rgw cache enabled = true 2024-04-19T04:23:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: rgw enable ops log = true 2024-04-19T04:23:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: rgw enable usage log = true 2024-04-19T04:23:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T04:23:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T04:23:40.659 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.a] 2024-04-19T04:23:40.659 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.b] 2024-04-19T04:23:40.659 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.c] 2024-04-19T04:23:40.659 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.a] 2024-04-19T04:23:40.659 INFO:teuthology.orchestra.run.smithi027.stdout:[client.0] 2024-04-19T04:23:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-19T04:23:40.660 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2024-04-19T04:23:40.661 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2024-04-19T04:23:40.661 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T04:23:40.661 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2024-04-19T04:23:40.661 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.661 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2024-04-19T04:23:40.661 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.661 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2024-04-19T04:23:40.661 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.661 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2024-04-19T04:23:40.661 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2024-04-19T04:23:40.661 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.661 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2024-04-19T04:23:40.661 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2024-04-19T04:23:40.661 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.662 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T04:23:40.662 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2024-04-19T04:23:40.662 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.662 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T04:23:40.662 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T04:23:40.662 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.662 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2024-04-19T04:23:40.662 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.662 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2024-04-19T04:23:40.662 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2024-04-19T04:23:40.662 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2024-04-19T04:23:40.662 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2024-04-19T04:23:40.662 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2024-04-19T04:23:40.663 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2024-04-19T04:23:40.663 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2024-04-19T04:23:40.663 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T04:23:40.663 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T04:23:40.663 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2024-04-19T04:23:40.663 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.663 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T04:23:40.663 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.663 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2024-04-19T04:23:40.664 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.664 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2024-04-19T04:23:40.664 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.664 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2024-04-19T04:23:40.664 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2024-04-19T04:23:40.664 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2024-04-19T04:23:40.664 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = "172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],[v2:172.21.15.7:3302,v1:172.21.15.7:6791]" 2024-04-19T04:23:40.664 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = 7aba6173-85fe-4265-947d-27b4a313af4e 2024-04-19T04:23:40.664 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.664 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2024-04-19T04:23:40.664 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2024-04-19T04:23:40.664 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.664 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2024-04-19T04:23:40.664 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2024-04-19T04:23:40.665 INFO:teuthology.orchestra.run.smithi172.stdout: osd mclock profile = high_recovery_ops 2024-04-19T04:23:40.665 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.665 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2024-04-19T04:23:40.665 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2024-04-19T04:23:40.665 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.665 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2024-04-19T04:23:40.665 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2024-04-19T04:23:40.665 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2024-04-19T04:23:40.665 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.665 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2024-04-19T04:23:40.665 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2024-04-19T04:23:40.665 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.665 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2024-04-19T04:23:40.665 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.666 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2024-04-19T04:23:40.666 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.666 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2024-04-19T04:23:40.666 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.666 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2024-04-19T04:23:40.666 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2024-04-19T04:23:40.666 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.666 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2024-04-19T04:23:40.666 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2024-04-19T04:23:40.666 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2024-04-19T04:23:40.666 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore compression algorithm = snappy 2024-04-19T04:23:40.666 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore compression mode = aggressive 2024-04-19T04:23:40.666 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2024-04-19T04:23:40.666 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 1/20 2024-04-19T04:23:40.667 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 1/20 2024-04-19T04:23:40.667 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-19T04:23:40.667 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2024-04-19T04:23:40.667 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 4/10 2024-04-19T04:23:40.667 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T04:23:40.667 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2024-04-19T04:23:40.667 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2024-04-19T04:23:40.667 INFO:teuthology.orchestra.run.smithi172.stdout: osd blocked scrub grace period = 3600 2024-04-19T04:23:40.667 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2024-04-19T04:23:40.667 INFO:teuthology.orchestra.run.smithi172.stdout: osd max markdown count = 1000 2024-04-19T04:23:40.667 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2024-04-19T04:23:40.667 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.667 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2024-04-19T04:23:40.667 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-19T04:23:40.667 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2024-04-19T04:23:40.668 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-19T04:23:40.668 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-19T04:23:40.668 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-19T04:23:40.668 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-19T04:23:40.668 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2024-04-19T04:23:40.668 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.668 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2024-04-19T04:23:40.668 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-19T04:23:40.668 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-19T04:23:40.668 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2024-04-19T04:23:40.668 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-19T04:23:40.668 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2024-04-19T04:23:40.668 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2024-04-19T04:23:40.668 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-19T04:23:40.668 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2024-04-19T04:23:40.669 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2024-04-19T04:23:40.669 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-19T04:23:40.669 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.669 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T04:23:40.669 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T04:23:40.669 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T04:23:40.669 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.669 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T04:23:40.669 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T04:23:40.669 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T04:23:40.669 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.669 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2024-04-19T04:23:40.669 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2024-04-19T04:23:40.669 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.670 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2024-04-19T04:23:40.670 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-19T04:23:40.670 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2024-04-19T04:23:40.670 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2024-04-19T04:23:40.670 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2024-04-19T04:23:40.670 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2024-04-19T04:23:40.670 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T04:23:40.670 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T04:23:40.670 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2024-04-19T04:23:40.670 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.b] 2024-04-19T04:23:40.670 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.c] 2024-04-19T04:23:40.671 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2024-04-19T04:23:40.671 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2024-04-19T04:23:40.671 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-19T04:23:40.671 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2024-04-19T04:23:40.671 INFO:teuthology.orchestra.run.smithi066.stdout: chdir = "" 2024-04-19T04:23:40.671 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T04:23:40.671 INFO:teuthology.orchestra.run.smithi066.stdout: auth supported = cephx 2024-04-19T04:23:40.671 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.671 INFO:teuthology.orchestra.run.smithi066.stdout: filestore xattr use omap = true 2024-04-19T04:23:40.671 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.671 INFO:teuthology.orchestra.run.smithi066.stdout: mon clock drift allowed = 1.000 2024-04-19T04:23:40.671 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.671 INFO:teuthology.orchestra.run.smithi066.stdout: osd crush chooseleaf type = 0 2024-04-19T04:23:40.671 INFO:teuthology.orchestra.run.smithi066.stdout: auth debug = true 2024-04-19T04:23:40.672 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.672 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on old message = true 2024-04-19T04:23:40.672 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on bug = true 2024-04-19T04:23:40.672 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.672 INFO:teuthology.orchestra.run.smithi066.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T04:23:40.672 INFO:teuthology.orchestra.run.smithi066.stdout: mon pg warn max object skew = 0 2024-04-19T04:23:40.672 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.672 INFO:teuthology.orchestra.run.smithi066.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T04:23:40.672 INFO:teuthology.orchestra.run.smithi066.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T04:23:40.672 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.672 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default size = 2 2024-04-19T04:23:40.672 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.672 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow primary affinity = true 2024-04-19T04:23:40.672 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow pg remap = true 2024-04-19T04:23:40.672 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on legacy crush tunables = false 2024-04-19T04:23:40.673 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on crush straw calc version zero = false 2024-04-19T04:23:40.673 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on no sortbitwise = false 2024-04-19T04:23:40.673 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on osd down out interval zero = false 2024-04-19T04:23:40.673 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on too few osds = false 2024-04-19T04:23:40.673 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T04:23:40.673 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T04:23:40.673 INFO:teuthology.orchestra.run.smithi066.stdout: mon_allow_pool_size_one = true 2024-04-19T04:23:40.673 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.673 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T04:23:40.673 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.673 INFO:teuthology.orchestra.run.smithi066.stdout: osd default data pool replay window = 5 2024-04-19T04:23:40.673 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.674 INFO:teuthology.orchestra.run.smithi066.stdout: mon allow pool delete = true 2024-04-19T04:23:40.674 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.674 INFO:teuthology.orchestra.run.smithi066.stdout: mon cluster log file level = debug 2024-04-19T04:23:40.674 INFO:teuthology.orchestra.run.smithi066.stdout: debug asserts on shutdown = true 2024-04-19T04:23:40.674 INFO:teuthology.orchestra.run.smithi066.stdout: mon health detail to clog = false 2024-04-19T04:23:40.674 INFO:teuthology.orchestra.run.smithi066.stdout: mon host = "172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],[v2:172.21.15.7:3302,v1:172.21.15.7:6791]" 2024-04-19T04:23:40.674 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = 7aba6173-85fe-4265-947d-27b4a313af4e 2024-04-19T04:23:40.674 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.674 INFO:teuthology.orchestra.run.smithi066.stdout:[osd] 2024-04-19T04:23:40.674 INFO:teuthology.orchestra.run.smithi066.stdout: osd journal size = 100 2024-04-19T04:23:40.675 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.675 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub load threshold = 5.0 2024-04-19T04:23:40.675 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub max interval = 600 2024-04-19T04:23:40.675 INFO:teuthology.orchestra.run.smithi066.stdout: osd mclock profile = high_recovery_ops 2024-04-19T04:23:40.675 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.675 INFO:teuthology.orchestra.run.smithi066.stdout: osd recover clone overlap = true 2024-04-19T04:23:40.675 INFO:teuthology.orchestra.run.smithi066.stdout: osd recovery max chunk = 1048576 2024-04-19T04:23:40.675 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.675 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug shutdown = true 2024-04-19T04:23:40.675 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug op order = true 2024-04-19T04:23:40.675 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug verify stray on activate = true 2024-04-19T04:23:40.675 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.675 INFO:teuthology.orchestra.run.smithi066.stdout: osd open classes on start = true 2024-04-19T04:23:40.675 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug pg log writeout = true 2024-04-19T04:23:40.675 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.676 INFO:teuthology.orchestra.run.smithi066.stdout: osd deep scrub update digest min age = 30 2024-04-19T04:23:40.676 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.676 INFO:teuthology.orchestra.run.smithi066.stdout: osd map max advance = 10 2024-04-19T04:23:40.676 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.676 INFO:teuthology.orchestra.run.smithi066.stdout: journal zero on create = true 2024-04-19T04:23:40.676 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.676 INFO:teuthology.orchestra.run.smithi066.stdout: filestore ondisk finisher threads = 3 2024-04-19T04:23:40.676 INFO:teuthology.orchestra.run.smithi066.stdout: filestore apply finisher threads = 3 2024-04-19T04:23:40.676 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.676 INFO:teuthology.orchestra.run.smithi066.stdout: bdev debug aio = true 2024-04-19T04:23:40.676 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug misdirected ops = true 2024-04-19T04:23:40.676 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore block size = 96636764160 2024-04-19T04:23:40.677 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore compression algorithm = snappy 2024-04-19T04:23:40.677 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore compression mode = aggressive 2024-04-19T04:23:40.677 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore fsck on mount = True 2024-04-19T04:23:40.677 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluefs = 1/20 2024-04-19T04:23:40.677 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluestore = 1/20 2024-04-19T04:23:40.677 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-04-19T04:23:40.677 INFO:teuthology.orchestra.run.smithi066.stdout: debug osd = 20 2024-04-19T04:23:40.677 INFO:teuthology.orchestra.run.smithi066.stdout: debug rocksdb = 4/10 2024-04-19T04:23:40.677 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T04:23:40.677 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd full ratio = 0.9 2024-04-19T04:23:40.677 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd nearfull ratio = 0.8 2024-04-19T04:23:40.677 INFO:teuthology.orchestra.run.smithi066.stdout: osd blocked scrub grace period = 3600 2024-04-19T04:23:40.677 INFO:teuthology.orchestra.run.smithi066.stdout: osd failsafe full ratio = 0.95 2024-04-19T04:23:40.677 INFO:teuthology.orchestra.run.smithi066.stdout: osd max markdown count = 1000 2024-04-19T04:23:40.677 INFO:teuthology.orchestra.run.smithi066.stdout: osd objectstore = bluestore 2024-04-19T04:23:40.678 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.678 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr] 2024-04-19T04:23:40.678 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-04-19T04:23:40.678 INFO:teuthology.orchestra.run.smithi066.stdout: debug mgr = 20 2024-04-19T04:23:40.678 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2024-04-19T04:23:40.678 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2024-04-19T04:23:40.678 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2024-04-19T04:23:40.678 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2024-04-19T04:23:40.678 INFO:teuthology.orchestra.run.smithi066.stdout: mgr/telemetry/nag = false 2024-04-19T04:23:40.678 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.678 INFO:teuthology.orchestra.run.smithi066.stdout:[mon] 2024-04-19T04:23:40.678 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-04-19T04:23:40.678 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2024-04-19T04:23:40.678 INFO:teuthology.orchestra.run.smithi066.stdout: debug paxos = 20 2024-04-19T04:23:40.679 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2024-04-19T04:23:40.679 INFO:teuthology.orchestra.run.smithi066.stdout: mon data avail warn = 5 2024-04-19T04:23:40.679 INFO:teuthology.orchestra.run.smithi066.stdout: mon mgr mkfs grace = 240 2024-04-19T04:23:40.679 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2024-04-19T04:23:40.679 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd reporter subtree level = osd 2024-04-19T04:23:40.679 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd prime pg temp = true 2024-04-19T04:23:40.679 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2024-04-19T04:23:40.679 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.679 INFO:teuthology.orchestra.run.smithi066.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T04:23:40.679 INFO:teuthology.orchestra.run.smithi066.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T04:23:40.679 INFO:teuthology.orchestra.run.smithi066.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T04:23:40.679 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.679 INFO:teuthology.orchestra.run.smithi066.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T04:23:40.680 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T04:23:40.680 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T04:23:40.680 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.680 INFO:teuthology.orchestra.run.smithi066.stdout: # 1m isn't quite enough 2024-04-19T04:23:40.680 INFO:teuthology.orchestra.run.smithi066.stdout: mon_down_mkfs_grace = 2m 2024-04-19T04:23:40.680 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.680 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_filestore_osds = false 2024-04-19T04:23:40.680 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-04-19T04:23:40.680 INFO:teuthology.orchestra.run.smithi066.stdout:[client] 2024-04-19T04:23:40.680 INFO:teuthology.orchestra.run.smithi066.stdout: rgw cache enabled = true 2024-04-19T04:23:40.680 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable ops log = true 2024-04-19T04:23:40.680 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable usage log = true 2024-04-19T04:23:40.680 INFO:teuthology.orchestra.run.smithi066.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T04:23:40.680 INFO:teuthology.orchestra.run.smithi066.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T04:23:40.680 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.a] 2024-04-19T04:23:40.681 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.b] 2024-04-19T04:23:40.681 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.c] 2024-04-19T04:23:40.681 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2024-04-19T04:23:40.681 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2024-04-19T04:23:40.681 INFO:teuthology.orchestra.run.smithi066.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-19T04:23:40.682 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2024-04-19T04:23:40.682 INFO:teuthology.orchestra.run.smithi007.stdout: chdir = "" 2024-04-19T04:23:40.682 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T04:23:40.682 INFO:teuthology.orchestra.run.smithi007.stdout: auth supported = cephx 2024-04-19T04:23:40.682 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.682 INFO:teuthology.orchestra.run.smithi007.stdout: filestore xattr use omap = true 2024-04-19T04:23:40.682 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.682 INFO:teuthology.orchestra.run.smithi007.stdout: mon clock drift allowed = 1.000 2024-04-19T04:23:40.682 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.682 INFO:teuthology.orchestra.run.smithi007.stdout: osd crush chooseleaf type = 0 2024-04-19T04:23:40.682 INFO:teuthology.orchestra.run.smithi007.stdout: auth debug = true 2024-04-19T04:23:40.683 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.683 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on old message = true 2024-04-19T04:23:40.683 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on bug = true 2024-04-19T04:23:40.683 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.683 INFO:teuthology.orchestra.run.smithi007.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T04:23:40.683 INFO:teuthology.orchestra.run.smithi007.stdout: mon pg warn max object skew = 0 2024-04-19T04:23:40.683 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.683 INFO:teuthology.orchestra.run.smithi007.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T04:23:40.683 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T04:23:40.683 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.683 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default size = 2 2024-04-19T04:23:40.683 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.683 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow primary affinity = true 2024-04-19T04:23:40.683 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow pg remap = true 2024-04-19T04:23:40.683 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on legacy crush tunables = false 2024-04-19T04:23:40.684 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on crush straw calc version zero = false 2024-04-19T04:23:40.684 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on no sortbitwise = false 2024-04-19T04:23:40.684 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on osd down out interval zero = false 2024-04-19T04:23:40.684 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on too few osds = false 2024-04-19T04:23:40.684 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T04:23:40.684 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T04:23:40.684 INFO:teuthology.orchestra.run.smithi007.stdout: mon_allow_pool_size_one = true 2024-04-19T04:23:40.684 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.684 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T04:23:40.684 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.684 INFO:teuthology.orchestra.run.smithi007.stdout: osd default data pool replay window = 5 2024-04-19T04:23:40.684 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.684 INFO:teuthology.orchestra.run.smithi007.stdout: mon allow pool delete = true 2024-04-19T04:23:40.684 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.684 INFO:teuthology.orchestra.run.smithi007.stdout: mon cluster log file level = debug 2024-04-19T04:23:40.685 INFO:teuthology.orchestra.run.smithi007.stdout: debug asserts on shutdown = true 2024-04-19T04:23:40.685 INFO:teuthology.orchestra.run.smithi007.stdout: mon health detail to clog = false 2024-04-19T04:23:40.685 INFO:teuthology.orchestra.run.smithi007.stdout: mon host = "172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],[v2:172.21.15.7:3302,v1:172.21.15.7:6791]" 2024-04-19T04:23:40.685 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = 7aba6173-85fe-4265-947d-27b4a313af4e 2024-04-19T04:23:40.685 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.685 INFO:teuthology.orchestra.run.smithi007.stdout:[osd] 2024-04-19T04:23:40.685 INFO:teuthology.orchestra.run.smithi007.stdout: osd journal size = 100 2024-04-19T04:23:40.685 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.685 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub load threshold = 5.0 2024-04-19T04:23:40.685 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub max interval = 600 2024-04-19T04:23:40.685 INFO:teuthology.orchestra.run.smithi007.stdout: osd mclock profile = high_recovery_ops 2024-04-19T04:23:40.685 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.685 INFO:teuthology.orchestra.run.smithi007.stdout: osd recover clone overlap = true 2024-04-19T04:23:40.685 INFO:teuthology.orchestra.run.smithi007.stdout: osd recovery max chunk = 1048576 2024-04-19T04:23:40.686 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.686 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug shutdown = true 2024-04-19T04:23:40.686 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug op order = true 2024-04-19T04:23:40.686 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify stray on activate = true 2024-04-19T04:23:40.686 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.686 INFO:teuthology.orchestra.run.smithi007.stdout: osd open classes on start = true 2024-04-19T04:23:40.686 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug pg log writeout = true 2024-04-19T04:23:40.686 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.686 INFO:teuthology.orchestra.run.smithi007.stdout: osd deep scrub update digest min age = 30 2024-04-19T04:23:40.686 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.686 INFO:teuthology.orchestra.run.smithi007.stdout: osd map max advance = 10 2024-04-19T04:23:40.686 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.687 INFO:teuthology.orchestra.run.smithi007.stdout: journal zero on create = true 2024-04-19T04:23:40.687 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.687 INFO:teuthology.orchestra.run.smithi007.stdout: filestore ondisk finisher threads = 3 2024-04-19T04:23:40.687 INFO:teuthology.orchestra.run.smithi007.stdout: filestore apply finisher threads = 3 2024-04-19T04:23:40.687 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.687 INFO:teuthology.orchestra.run.smithi007.stdout: bdev debug aio = true 2024-04-19T04:23:40.687 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug misdirected ops = true 2024-04-19T04:23:40.687 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore block size = 96636764160 2024-04-19T04:23:40.687 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore compression algorithm = snappy 2024-04-19T04:23:40.687 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore compression mode = aggressive 2024-04-19T04:23:40.687 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore fsck on mount = True 2024-04-19T04:23:40.687 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluefs = 1/20 2024-04-19T04:23:40.687 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluestore = 1/20 2024-04-19T04:23:40.687 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-19T04:23:40.688 INFO:teuthology.orchestra.run.smithi007.stdout: debug osd = 20 2024-04-19T04:23:40.688 INFO:teuthology.orchestra.run.smithi007.stdout: debug rocksdb = 4/10 2024-04-19T04:23:40.688 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T04:23:40.688 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd full ratio = 0.9 2024-04-19T04:23:40.688 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd nearfull ratio = 0.8 2024-04-19T04:23:40.688 INFO:teuthology.orchestra.run.smithi007.stdout: osd blocked scrub grace period = 3600 2024-04-19T04:23:40.688 INFO:teuthology.orchestra.run.smithi007.stdout: osd failsafe full ratio = 0.95 2024-04-19T04:23:40.688 INFO:teuthology.orchestra.run.smithi007.stdout: osd max markdown count = 1000 2024-04-19T04:23:40.688 INFO:teuthology.orchestra.run.smithi007.stdout: osd objectstore = bluestore 2024-04-19T04:23:40.688 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.688 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr] 2024-04-19T04:23:40.688 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-19T04:23:40.688 INFO:teuthology.orchestra.run.smithi007.stdout: debug mgr = 20 2024-04-19T04:23:40.688 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-04-19T04:23:40.689 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-04-19T04:23:40.689 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-04-19T04:23:40.689 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-04-19T04:23:40.689 INFO:teuthology.orchestra.run.smithi007.stdout: mgr/telemetry/nag = false 2024-04-19T04:23:40.689 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.689 INFO:teuthology.orchestra.run.smithi007.stdout:[mon] 2024-04-19T04:23:40.689 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-19T04:23:40.689 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-04-19T04:23:40.689 INFO:teuthology.orchestra.run.smithi007.stdout: debug paxos = 20 2024-04-19T04:23:40.689 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-04-19T04:23:40.689 INFO:teuthology.orchestra.run.smithi007.stdout: mon data avail warn = 5 2024-04-19T04:23:40.689 INFO:teuthology.orchestra.run.smithi007.stdout: mon mgr mkfs grace = 240 2024-04-19T04:23:40.689 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-04-19T04:23:40.689 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd reporter subtree level = osd 2024-04-19T04:23:40.689 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd prime pg temp = true 2024-04-19T04:23:40.690 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-04-19T04:23:40.690 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.690 INFO:teuthology.orchestra.run.smithi007.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T04:23:40.690 INFO:teuthology.orchestra.run.smithi007.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T04:23:40.690 INFO:teuthology.orchestra.run.smithi007.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T04:23:40.690 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.690 INFO:teuthology.orchestra.run.smithi007.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T04:23:40.690 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T04:23:40.690 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T04:23:40.690 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.690 INFO:teuthology.orchestra.run.smithi007.stdout: # 1m isn't quite enough 2024-04-19T04:23:40.690 INFO:teuthology.orchestra.run.smithi007.stdout: mon_down_mkfs_grace = 2m 2024-04-19T04:23:40.690 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.690 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_filestore_osds = false 2024-04-19T04:23:40.690 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:23:40.691 INFO:teuthology.orchestra.run.smithi007.stdout:[client] 2024-04-19T04:23:40.691 INFO:teuthology.orchestra.run.smithi007.stdout: rgw cache enabled = true 2024-04-19T04:23:40.691 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable ops log = true 2024-04-19T04:23:40.691 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable usage log = true 2024-04-19T04:23:40.691 INFO:teuthology.orchestra.run.smithi007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T04:23:40.691 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T04:23:40.691 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.a] 2024-04-19T04:23:40.691 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.b] 2024-04-19T04:23:40.691 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.c] 2024-04-19T04:23:40.691 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2024-04-19T04:23:40.691 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-04-19T04:23:40.691 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-19T04:23:40.692 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-19T04:23:40.693 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-19T04:23:40.749 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-19T04:23:40.749 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-19T04:23:40.749 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-19T04:23:40.755 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-19T04:23:40.755 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-19T04:23:40.760 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi007.front.sepia.ceph.com 2024-04-19T04:23:40.760 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-19T04:23:40.760 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T04:23:40.760 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T04:23:40.785 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-19T04:23:40.785 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T04:23:40.791 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi027.front.sepia.ceph.com 2024-04-19T04:23:40.791 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-04-19T04:23:40.791 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T04:23:40.791 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T04:23:40.818 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-04-19T04:23:40.818 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T04:23:40.823 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi066.front.sepia.ceph.com 2024-04-19T04:23:40.823 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-04-19T04:23:40.823 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T04:23:40.823 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T04:23:40.850 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-04-19T04:23:40.850 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T04:23:40.856 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi172.front.sepia.ceph.com 2024-04-19T04:23:40.856 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-19T04:23:40.856 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T04:23:40.857 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T04:23:40.882 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-19T04:23:40.883 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T04:23:40.889 INFO:tasks.ceph:Setting up mon nodes... 2024-04-19T04:23:40.889 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-19T04:23:40.890 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-19T04:23:40.940 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-19T04:23:40.943 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-19T04:23:40.988 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-19T04:23:40.991 INFO:tasks.ceph:Setting up mds nodes... 2024-04-19T04:23:40.991 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-19T04:23:41.036 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-19T04:23:41.039 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-19T04:23:41.049 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-19T04:23:41.050 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-19T04:23:41.089 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-19T04:23:41.102 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-19T04:23:41.102 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi027.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi066.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-19T04:23:41.103 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-19T04:23:41.119 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-19T04:23:41.119 INFO:tasks.ceph:role: osd.0 2024-04-19T04:23:41.119 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi027.front.sepia.ceph.com 2024-04-19T04:23:41.119 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-19T04:23:41.683 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T04:23:41.684 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T04:23:41.684 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T04:23:41.684 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 2024-04-19T04:23:41.684 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T04:23:41.684 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2024-04-19T04:23:41.684 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T04:23:41.684 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T04:23:41.684 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T04:23:41.684 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T04:23:41.685 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2024-04-19T04:23:41.686 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-19T04:23:41.777 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-19T04:23:41.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T04:23:41.790 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: /sbin/restorecon: command not found 2024-04-19T04:23:41.790 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T04:23:41.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-04-19T04:23:41.880+0000 7f37889f5880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-19T04:23:41.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-04-19T04:23:41.884+0000 7f37889f5880 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-19T04:23:41.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-04-19T04:23:41.884+0000 7f37889f5880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-19T04:23:41.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-04-19T04:23:41.884+0000 7f37889f5880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-19T04:23:41.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-04-19T04:23:41.884+0000 7f37889f5880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-19T04:23:41.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-04-19T04:23:41.892+0000 7f37889f5880 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-19T04:23:44.956 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-19T04:23:44.972 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-19T04:23:44.989 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-19T04:23:44.989 INFO:tasks.ceph:role: osd.1 2024-04-19T04:23:44.989 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi066.front.sepia.ceph.com 2024-04-19T04:23:44.989 DEBUG:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-19T04:23:45.562 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T04:23:45.562 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T04:23:45.563 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T04:23:45.563 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 2024-04-19T04:23:45.563 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T04:23:45.563 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2024-04-19T04:23:45.563 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T04:23:45.563 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T04:23:45.563 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T04:23:45.563 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T04:23:45.564 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2024-04-19T04:23:45.564 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-19T04:23:45.651 DEBUG:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-19T04:23:45.663 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: /sbin/restorecon: command not found 2024-04-19T04:23:45.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T04:23:45.664 DEBUG:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T04:23:45.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-04-19T04:23:45.729+0000 7f5573a8d880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-19T04:23:45.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-04-19T04:23:45.733+0000 7f5573a8d880 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-19T04:23:45.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-04-19T04:23:45.733+0000 7f5573a8d880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-19T04:23:45.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-04-19T04:23:45.733+0000 7f5573a8d880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-19T04:23:45.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-04-19T04:23:45.733+0000 7f5573a8d880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-19T04:23:45.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-04-19T04:23:45.737+0000 7f5573a8d880 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-19T04:23:48.750 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-19T04:23:48.763 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-19T04:23:48.780 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-19T04:23:48.780 INFO:tasks.ceph:role: osd.2 2024-04-19T04:23:48.780 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-19T04:23:48.780 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-19T04:23:49.336 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T04:23:49.337 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T04:23:49.337 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T04:23:49.337 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 2024-04-19T04:23:49.337 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T04:23:49.337 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-04-19T04:23:49.337 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T04:23:49.337 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T04:23:49.337 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T04:23:49.337 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T04:23:49.339 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-04-19T04:23:49.339 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-19T04:23:49.441 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-19T04:23:49.453 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: /sbin/restorecon: command not found 2024-04-19T04:23:49.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T04:23:49.454 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T04:23:49.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-19T04:23:49.520+0000 7f2aa5755880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-19T04:23:49.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-19T04:23:49.520+0000 7f2aa5755880 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-19T04:23:49.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-19T04:23:49.520+0000 7f2aa5755880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-19T04:23:49.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-19T04:23:49.520+0000 7f2aa5755880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-19T04:23:49.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-19T04:23:49.520+0000 7f2aa5755880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-19T04:23:49.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-19T04:23:49.528+0000 7f2aa5755880 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-19T04:23:52.545 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-19T04:23:52.560 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-19T04:23:52.561 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-19T04:23:52.561 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-19T04:23:52.578 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-19T04:23:52.578 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-19T04:23:52.634 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-19T04:23:52.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-19T04:23:52.645 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-04-19T04:23:52.645 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-19T04:23:52.662 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-04-19T04:23:52.663 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-19T04:23:52.679 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-19T04:23:52.679 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-19T04:23:52.695 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-19T04:23:52.696 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-19T04:23:52.702 INFO:tasks.ceph:Adding keys to all mons... 2024-04-19T04:23:52.703 DEBUG:teuthology.orchestra.run.smithi007:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-19T04:23:52.761 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.x] 2024-04-19T04:23:52.761 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQDM8SFmpQsWOBAAzS/SCvJyXf9meR2qFXQfiQ== 2024-04-19T04:23:52.761 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.y] 2024-04-19T04:23:52.761 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQDM8SFmcR70OhAAcnFgq7csdbuFwaCqOm9dTA== 2024-04-19T04:23:52.761 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2024-04-19T04:23:52.761 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQDN8SFmRrc6AhAACBme1VErnCM6dJXjkabeog== 2024-04-19T04:23:52.761 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.0] 2024-04-19T04:23:52.762 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQDN8SFm4RO1NBAAeJhga7Xh/Z2vNmGzga2Ajg== 2024-04-19T04:23:52.762 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.1] 2024-04-19T04:23:52.762 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQDR8SFmmDKnKxAAr3hDkYmCgajWfFOBOCmHsQ== 2024-04-19T04:23:52.762 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.2] 2024-04-19T04:23:52.762 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQDV8SFmHXI0HxAAOyTxLHDeHvzz2PEi+OAbiw== 2024-04-19T04:23:52.762 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-04-19T04:23:52.762 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQDN8SFmS/hjBRAAeWy86LIilHTKHdeZccwP4g== 2024-04-19T04:23:52.763 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-19T04:23:52.811 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-19T04:23:52.857 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-19T04:23:52.910 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T04:23:52.993 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T04:23:53.039 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T04:23:53.085 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-19T04:23:53.133 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-19T04:23:53.133 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-19T04:23:53.146 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-19T04:23:53.252 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-19T04:23:53.269 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-19T04:23:53.279 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-19T04:23:53.357 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-19T04:23:53.372 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-19T04:23:53.383 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-19T04:23:53.465 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-19T04:23:53.480 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-19T04:23:53.487 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-19T04:23:53.487 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-19T04:23:53.487 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-19T04:23:53.489 INFO:tasks.ceph.mon.a:Started 2024-04-19T04:23:53.490 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-19T04:23:53.490 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-19T04:23:53.492 INFO:tasks.ceph.mon.b:Started 2024-04-19T04:23:53.492 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-19T04:23:53.492 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-19T04:23:53.494 INFO:tasks.ceph.mon.c:Started 2024-04-19T04:23:53.494 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-19T04:23:53.494 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-19T04:23:53.494 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-19T04:23:53.497 INFO:tasks.ceph.mgr.x:Started 2024-04-19T04:23:53.497 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-19T04:23:53.497 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-19T04:23:53.499 INFO:tasks.ceph.mgr.y:Started 2024-04-19T04:23:53.499 INFO:tasks.ceph:Setting crush tunables to default 2024-04-19T04:23:53.499 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd crush tunables default 2024-04-19T04:23:59.724 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2024-04-19T04:23:59.739 INFO:tasks.ceph:check_enable_crimson: False 2024-04-19T04:23:59.739 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-19T04:23:59.739 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-04-19T04:23:59.739 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-19T04:23:59.755 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-04-19T04:23:59.756 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-19T04:23:59.772 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-19T04:23:59.772 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-19T04:23:59.789 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 28ba89d9-eaaf-4fb5-86bc-783b607a4cba 0 2024-04-19T04:23:59.824 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:23:59.823+0000 7faae356d2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-19T04:23:59.830 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:23:59.827+0000 7fd7243dd2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-19T04:24:00.002 INFO:teuthology.orchestra.run.smithi172.stdout:0 2024-04-19T04:24:00.017 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 9d5408b5-b74c-4e5e-858c-e0c8b593204e 1 2024-04-19T04:24:00.218 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-19T04:24:00.233 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 9b600dc4-4425-4873-82d8-5434ca838bc1 2 2024-04-19T04:24:00.443 INFO:teuthology.orchestra.run.smithi172.stdout:2 2024-04-19T04:24:00.457 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-19T04:24:00.457 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-19T04:24:00.459 INFO:tasks.ceph.osd.0:Started 2024-04-19T04:24:00.459 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-19T04:24:00.459 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-19T04:24:00.463 INFO:tasks.ceph.osd.1:Started 2024-04-19T04:24:00.463 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-19T04:24:00.463 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-19T04:24:00.465 INFO:tasks.ceph.osd.2:Started 2024-04-19T04:24:00.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T04:24:00.484 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:00.483+0000 7faae356d2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-19T04:24:00.484 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:00.483+0000 7fd7243dd2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-19T04:24:00.546 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:00.543+0000 7fd7243dd2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-19T04:24:00.548 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:00.547+0000 7faae356d2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-19T04:24:00.650 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:00.650 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","created":"2024-04-19T04:23:58.837304+0000","modified":"2024-04-19T04:24:00.437672+0000","last_up_change":"0.000000","last_in_change":"2024-04-19T04:24:00.437672+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"28ba89d9-eaaf-4fb5-86bc-783b607a4cba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d5408b5-b74c-4e5e-858c-e0c8b593204e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9b600dc4-4425-4873-82d8-5434ca838bc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T04:24:00.665 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-19T04:24:00.665 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-19T04:24:00.727 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:00.727+0000 7faae356d2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-19T04:24:00.729 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:00.727+0000 7fd7243dd2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-19T04:24:00.954 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:00.951+0000 7faae356d2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-19T04:24:00.954 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:00.951+0000 7fd7243dd2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-19T04:24:00.967 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-19T04:24:01.007 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:01.007+0000 7fd7243dd2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-19T04:24:01.008 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:01.007+0000 7faae356d2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-19T04:24:01.075 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:01.072+0000 7effb4345880 -1 Falling back to public interface 2024-04-19T04:24:01.083 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:01.077+0000 7f492afdc880 -1 Falling back to public interface 2024-04-19T04:24:01.086 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:01.084+0000 7f4fb5c6f880 -1 Falling back to public interface 2024-04-19T04:24:01.134 INFO:teuthology.misc.health.smithi007.stdout: 2024-04-19T04:24:01.134 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":5,"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","created":"2024-04-19T04:23:58.837304+0000","modified":"2024-04-19T04:24:00.437672+0000","last_up_change":"0.000000","last_in_change":"2024-04-19T04:24:00.437672+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"28ba89d9-eaaf-4fb5-86bc-783b607a4cba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d5408b5-b74c-4e5e-858c-e0c8b593204e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9b600dc4-4425-4873-82d8-5434ca838bc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T04:24:01.144 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-19T04:24:01.199 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:01.199+0000 7fd7243dd2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-19T04:24:01.201 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:01.199+0000 7faae356d2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-19T04:24:01.267 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:01.267+0000 7fd7243dd2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-19T04:24:01.267 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:01.267+0000 7faae356d2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-19T04:24:01.335 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:01.335+0000 7faae356d2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-19T04:24:01.336 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:01.335+0000 7fd7243dd2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-19T04:24:01.771 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:01.771+0000 7faae356d2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-19T04:24:01.771 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:01.771+0000 7fd7243dd2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-19T04:24:01.895 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:01.895+0000 7faae356d2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-19T04:24:01.897 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:01.895+0000 7fd7243dd2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-19T04:24:02.249 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:02.247+0000 7faae356d2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-19T04:24:02.254 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:02.255+0000 7fd7243dd2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-19T04:24:02.449 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:02.443+0000 7faae356d2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-19T04:24:02.450 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:02.447+0000 7fd7243dd2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-19T04:24:02.519 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:02.519+0000 7faae356d2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-19T04:24:02.519 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:02.519+0000 7fd7243dd2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-19T04:24:02.689 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:02.687+0000 7faae356d2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-19T04:24:02.689 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:02.687+0000 7fd7243dd2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-19T04:24:03.375 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:03.375+0000 7fd7243dd2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-19T04:24:03.375 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:03.375+0000 7faae356d2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-19T04:24:03.451 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:03.447+0000 7faae356d2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-19T04:24:03.451 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:03.447+0000 7fd7243dd2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-19T04:24:03.617 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:03.615+0000 7fd7243dd2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-19T04:24:03.618 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:03.615+0000 7faae356d2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-19T04:24:03.687 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:03.687+0000 7fd7243dd2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-19T04:24:03.689 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:03.687+0000 7faae356d2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-19T04:24:03.765 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:03.763+0000 7fd7243dd2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-19T04:24:03.766 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:03.763+0000 7faae356d2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-19T04:24:04.075 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:04.075+0000 7fd7243dd2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-19T04:24:04.081 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:04.079+0000 7faae356d2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-19T04:24:04.150 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:04.147+0000 7fd7243dd2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-19T04:24:04.150 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:04.151+0000 7faae356d2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-19T04:24:04.539 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:04.533+0000 7f492afdc880 -1 osd.1 0 log_to_monitors true 2024-04-19T04:24:04.787 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:04.784+0000 7f4fb5c6f880 -1 osd.0 0 log_to_monitors true 2024-04-19T04:24:04.796 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:04.792+0000 7effb4345880 -1 osd.2 0 log_to_monitors true 2024-04-19T04:24:04.853 INFO:tasks.ceph.mgr.x.smithi007.stderr:2024-04-19T04:24:04.851+0000 7fd7243dd2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-19T04:24:04.853 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:04.851+0000 7faae356d2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-19T04:24:05.881 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:05.879+0000 7faaca0e3700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-19T04:24:05.881 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-19T04:24:05.879+0000 7faaca0e3700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-19T04:24:07.077 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:07.069+0000 7f4926e1b700 -1 osd.1 0 waiting for initial osdmap 2024-04-19T04:24:07.081 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:07.077+0000 7f491e8ca700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T04:24:07.446 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-19T04:24:07.757 INFO:teuthology.misc.health.smithi007.stdout: 2024-04-19T04:24:07.757 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":8,"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","created":"2024-04-19T04:23:58.837304+0000","modified":"2024-04-19T04:24:06.611340+0000","last_up_change":"0.000000","last_in_change":"2024-04-19T04:24:00.437672+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"28ba89d9-eaaf-4fb5-86bc-783b607a4cba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d5408b5-b74c-4e5e-858c-e0c8b593204e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9b600dc4-4425-4873-82d8-5434ca838bc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T04:24:07.772 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-19T04:24:07.852 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:07.848+0000 7effb0b0b700 -1 osd.2 0 waiting for initial osdmap 2024-04-19T04:24:07.859 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:07.856+0000 7effa7c33700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T04:24:08.008 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:08.008+0000 7f4fb1aae700 -1 osd.0 0 waiting for initial osdmap 2024-04-19T04:24:08.012 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:08.012+0000 7f4fa955d700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T04:24:14.074 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-19T04:24:14.372 INFO:teuthology.misc.health.smithi007.stdout: 2024-04-19T04:24:14.373 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":12,"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","created":"2024-04-19T04:23:58.837304+0000","modified":"2024-04-19T04:24:11.103268+0000","last_up_change":"2024-04-19T04:24:08.081123+0000","last_in_change":"2024-04-19T04:24:00.437672+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T04:24:08.928860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28ba89d9-eaaf-4fb5-86bc-783b607a4cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":18128},{"type":"v1","addr":"172.21.15.27:6801","nonce":18128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":18128},{"type":"v1","addr":"172.21.15.27:6803","nonce":18128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":18128},{"type":"v1","addr":"172.21.15.27:6807","nonce":18128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":18128},{"type":"v1","addr":"172.21.15.27:6805","nonce":18128}]},"public_addr":"172.21.15.27:6801/18128","cluster_addr":"172.21.15.27:6803/18128","heartbeat_back_addr":"172.21.15.27:6807/18128","heartbeat_front_addr":"172.21.15.27:6805/18128","state":["exists","up"]},{"osd":1,"uuid":"9d5408b5-b74c-4e5e-858c-e0c8b593204e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":18186},{"type":"v1","addr":"172.21.15.66:6801","nonce":18186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":18186},{"type":"v1","addr":"172.21.15.66:6803","nonce":18186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":18186},{"type":"v1","addr":"172.21.15.66:6807","nonce":18186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":18186},{"type":"v1","addr":"172.21.15.66:6805","nonce":18186}]},"public_addr":"172.21.15.66:6801/18186","cluster_addr":"172.21.15.66:6803/18186","heartbeat_back_addr":"172.21.15.66:6807/18186","heartbeat_front_addr":"172.21.15.66:6805/18186","state":["exists","up"]},{"osd":2,"uuid":"9b600dc4-4425-4873-82d8-5434ca838bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":18250},{"type":"v1","addr":"172.21.15.172:6801","nonce":18250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":18250},{"type":"v1","addr":"172.21.15.172:6803","nonce":18250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":18250},{"type":"v1","addr":"172.21.15.172:6807","nonce":18250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":18250},{"type":"v1","addr":"172.21.15.172:6805","nonce":18250}]},"public_addr":"172.21.15.172:6801/18250","cluster_addr":"172.21.15.172:6803/18250","heartbeat_back_addr":"172.21.15.172:6807/18250","heartbeat_front_addr":"172.21.15.172:6805/18250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.749539+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.573103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.812945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T04:24:14.386 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-19T04:24:14.386 INFO:tasks.ceph:Creating RBD pool 2024-04-19T04:24:14.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-19T04:24:15.138 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'rbd' created 2024-04-19T04:24:15.147 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-19T04:24:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-19T04:24:16.153 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-19T04:24:16.153 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-19T04:24:16.153 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-19T04:24:16.155 INFO:tasks.ceph.mds.a:Started 2024-04-19T04:24:16.155 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-19T04:24:16.156 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T04:24:16.229 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-19T04:24:16.453 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:16.453 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":14,"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","created":"2024-04-19T04:23:58.837304+0000","modified":"2024-04-19T04:24:16.126750+0000","last_up_change":"2024-04-19T04:24:08.081123+0000","last_in_change":"2024-04-19T04:24:00.437672+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T04:24:08.928860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T04:24:14.725769+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28ba89d9-eaaf-4fb5-86bc-783b607a4cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":18128},{"type":"v1","addr":"172.21.15.27:6801","nonce":18128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":18128},{"type":"v1","addr":"172.21.15.27:6803","nonce":18128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":18128},{"type":"v1","addr":"172.21.15.27:6807","nonce":18128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":18128},{"type":"v1","addr":"172.21.15.27:6805","nonce":18128}]},"public_addr":"172.21.15.27:6801/18128","cluster_addr":"172.21.15.27:6803/18128","heartbeat_back_addr":"172.21.15.27:6807/18128","heartbeat_front_addr":"172.21.15.27:6805/18128","state":["exists","up"]},{"osd":1,"uuid":"9d5408b5-b74c-4e5e-858c-e0c8b593204e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":18186},{"type":"v1","addr":"172.21.15.66:6801","nonce":18186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":18186},{"type":"v1","addr":"172.21.15.66:6803","nonce":18186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":18186},{"type":"v1","addr":"172.21.15.66:6807","nonce":18186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":18186},{"type":"v1","addr":"172.21.15.66:6805","nonce":18186}]},"public_addr":"172.21.15.66:6801/18186","cluster_addr":"172.21.15.66:6803/18186","heartbeat_back_addr":"172.21.15.66:6807/18186","heartbeat_front_addr":"172.21.15.66:6805/18186","state":["exists","up"]},{"osd":2,"uuid":"9b600dc4-4425-4873-82d8-5434ca838bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":18250},{"type":"v1","addr":"172.21.15.172:6801","nonce":18250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":18250},{"type":"v1","addr":"172.21.15.172:6803","nonce":18250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":18250},{"type":"v1","addr":"172.21.15.172:6807","nonce":18250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":18250},{"type":"v1","addr":"172.21.15.172:6805","nonce":18250}]},"public_addr":"172.21.15.172:6801/18250","cluster_addr":"172.21.15.172:6803/18250","heartbeat_back_addr":"172.21.15.172:6807/18250","heartbeat_front_addr":"172.21.15.172:6805/18250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.749539+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.573103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.812945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T04:24:16.467 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T04:24:08.928860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T04:24:14.725769+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T04:24:16.468 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T04:24:16.775 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-19T04:24:16.790 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T04:24:17.095 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2024-04-19T04:24:17.110 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T04:24:17.449 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:17.449 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6803/1858240019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1858240019},{"type":"v1","addr":"172.21.15.7:6803","nonce":1858240019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-19T04:24:17.453 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 2 2024-04-19T04:24:17.464 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T04:24:17.769 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:17.769 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":15,"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","created":"2024-04-19T04:23:58.837304+0000","modified":"2024-04-19T04:24:17.136429+0000","last_up_change":"2024-04-19T04:24:08.081123+0000","last_in_change":"2024-04-19T04:24:00.437672+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T04:24:08.928860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T04:24:14.725769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28ba89d9-eaaf-4fb5-86bc-783b607a4cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":18128},{"type":"v1","addr":"172.21.15.27:6801","nonce":18128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":18128},{"type":"v1","addr":"172.21.15.27:6803","nonce":18128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":18128},{"type":"v1","addr":"172.21.15.27:6807","nonce":18128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":18128},{"type":"v1","addr":"172.21.15.27:6805","nonce":18128}]},"public_addr":"172.21.15.27:6801/18128","cluster_addr":"172.21.15.27:6803/18128","heartbeat_back_addr":"172.21.15.27:6807/18128","heartbeat_front_addr":"172.21.15.27:6805/18128","state":["exists","up"]},{"osd":1,"uuid":"9d5408b5-b74c-4e5e-858c-e0c8b593204e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":18186},{"type":"v1","addr":"172.21.15.66:6801","nonce":18186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":18186},{"type":"v1","addr":"172.21.15.66:6803","nonce":18186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":18186},{"type":"v1","addr":"172.21.15.66:6807","nonce":18186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":18186},{"type":"v1","addr":"172.21.15.66:6805","nonce":18186}]},"public_addr":"172.21.15.66:6801/18186","cluster_addr":"172.21.15.66:6803/18186","heartbeat_back_addr":"172.21.15.66:6807/18186","heartbeat_front_addr":"172.21.15.66:6805/18186","state":["exists","up"]},{"osd":2,"uuid":"9b600dc4-4425-4873-82d8-5434ca838bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":18250},{"type":"v1","addr":"172.21.15.172:6801","nonce":18250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":18250},{"type":"v1","addr":"172.21.15.172:6803","nonce":18250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":18250},{"type":"v1","addr":"172.21.15.172:6807","nonce":18250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":18250},{"type":"v1","addr":"172.21.15.172:6805","nonce":18250}]},"public_addr":"172.21.15.172:6801/18250","cluster_addr":"172.21.15.172:6803/18250","heartbeat_back_addr":"172.21.15.172:6807/18250","heartbeat_front_addr":"172.21.15.172:6805/18250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.749539+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.573103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.812945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T04:24:17.783 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T04:24:08.928860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T04:24:14.725769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T04:24:17.784 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T04:24:18.095 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-19T04:24:18.110 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T04:24:18.412 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2024-04-19T04:24:18.426 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-19T04:24:18.728 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:18.728 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-04-19T04:24:18.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-19T04:24:18.728 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-04-19T04:24:18.728 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-04-19T04:24:18.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-19T04:24:18.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-19T04:24:18.728 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 2, 2024-04-19T04:24:18.728 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": "rbd" 2024-04-19T04:24:18.729 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-19T04:24:18.729 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-04-19T04:24:18.742 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-19T04:24:18.743 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-19T04:24:19.165 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-04-19T04:24:19.177 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-19T04:24:20.171 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-04-19T04:24:20.185 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-19T04:24:20.538 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 3 and data pool 4 2024-04-19T04:24:20.550 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T04:24:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:20.842 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":18,"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","created":"2024-04-19T04:23:58.837304+0000","modified":"2024-04-19T04:24:20.524753+0000","last_up_change":"2024-04-19T04:24:08.081123+0000","last_in_change":"2024-04-19T04:24:00.437672+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T04:24:08.928860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T04:24:14.725769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T04:24:19.096707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T04:24:19.528844+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28ba89d9-eaaf-4fb5-86bc-783b607a4cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":18128},{"type":"v1","addr":"172.21.15.27:6801","nonce":18128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":18128},{"type":"v1","addr":"172.21.15.27:6803","nonce":18128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":18128},{"type":"v1","addr":"172.21.15.27:6807","nonce":18128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":18128},{"type":"v1","addr":"172.21.15.27:6805","nonce":18128}]},"public_addr":"172.21.15.27:6801/18128","cluster_addr":"172.21.15.27:6803/18128","heartbeat_back_addr":"172.21.15.27:6807/18128","heartbeat_front_addr":"172.21.15.27:6805/18128","state":["exists","up"]},{"osd":1,"uuid":"9d5408b5-b74c-4e5e-858c-e0c8b593204e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":18186},{"type":"v1","addr":"172.21.15.66:6801","nonce":18186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":18186},{"type":"v1","addr":"172.21.15.66:6803","nonce":18186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":18186},{"type":"v1","addr":"172.21.15.66:6807","nonce":18186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":18186},{"type":"v1","addr":"172.21.15.66:6805","nonce":18186}]},"public_addr":"172.21.15.66:6801/18186","cluster_addr":"172.21.15.66:6803/18186","heartbeat_back_addr":"172.21.15.66:6807/18186","heartbeat_front_addr":"172.21.15.66:6805/18186","state":["exists","up"]},{"osd":2,"uuid":"9b600dc4-4425-4873-82d8-5434ca838bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":18250},{"type":"v1","addr":"172.21.15.172:6801","nonce":18250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":18250},{"type":"v1","addr":"172.21.15.172:6803","nonce":18250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":18250},{"type":"v1","addr":"172.21.15.172:6807","nonce":18250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":18250},{"type":"v1","addr":"172.21.15.172:6805","nonce":18250}]},"public_addr":"172.21.15.172:6801/18250","cluster_addr":"172.21.15.172:6803/18250","heartbeat_back_addr":"172.21.15.172:6807/18250","heartbeat_front_addr":"172.21.15.172:6805/18250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.749539+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.573103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.812945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T04:24:20.859 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T04:24:21.163 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:21.163 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":18,"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","created":"2024-04-19T04:23:58.837304+0000","modified":"2024-04-19T04:24:20.524753+0000","last_up_change":"2024-04-19T04:24:08.081123+0000","last_in_change":"2024-04-19T04:24:00.437672+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T04:24:08.928860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T04:24:14.725769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T04:24:19.096707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T04:24:19.528844+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28ba89d9-eaaf-4fb5-86bc-783b607a4cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":18128},{"type":"v1","addr":"172.21.15.27:6801","nonce":18128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":18128},{"type":"v1","addr":"172.21.15.27:6803","nonce":18128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":18128},{"type":"v1","addr":"172.21.15.27:6807","nonce":18128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":18128},{"type":"v1","addr":"172.21.15.27:6805","nonce":18128}]},"public_addr":"172.21.15.27:6801/18128","cluster_addr":"172.21.15.27:6803/18128","heartbeat_back_addr":"172.21.15.27:6807/18128","heartbeat_front_addr":"172.21.15.27:6805/18128","state":["exists","up"]},{"osd":1,"uuid":"9d5408b5-b74c-4e5e-858c-e0c8b593204e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":18186},{"type":"v1","addr":"172.21.15.66:6801","nonce":18186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":18186},{"type":"v1","addr":"172.21.15.66:6803","nonce":18186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":18186},{"type":"v1","addr":"172.21.15.66:6807","nonce":18186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":18186},{"type":"v1","addr":"172.21.15.66:6805","nonce":18186}]},"public_addr":"172.21.15.66:6801/18186","cluster_addr":"172.21.15.66:6803/18186","heartbeat_back_addr":"172.21.15.66:6807/18186","heartbeat_front_addr":"172.21.15.66:6805/18186","state":["exists","up"]},{"osd":2,"uuid":"9b600dc4-4425-4873-82d8-5434ca838bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":18250},{"type":"v1","addr":"172.21.15.172:6801","nonce":18250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":18250},{"type":"v1","addr":"172.21.15.172:6803","nonce":18250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":18250},{"type":"v1","addr":"172.21.15.172:6807","nonce":18250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":18250},{"type":"v1","addr":"172.21.15.172:6805","nonce":18250}]},"public_addr":"172.21.15.172:6801/18250","cluster_addr":"172.21.15.172:6803/18250","heartbeat_back_addr":"172.21.15.172:6807/18250","heartbeat_front_addr":"172.21.15.172:6805/18250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.749539+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.573103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.812945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T04:24:21.178 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-19T04:24:21.556 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-19T04:24:21.557 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-19T04:24:22.559 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-19T04:24:22.559 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T04:24:22.893 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:22.893 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T04:24:20.525070+0000","modified":"2024-04-19T04:24:22.534106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6803/1858240019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1858240019},{"type":"v1","addr":"172.21.15.7:6803","nonce":1858240019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T04:24:22.897 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 5 2024-04-19T04:24:22.908 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T04:24:23.207 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:23.207 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":19,"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","created":"2024-04-19T04:23:58.837304+0000","modified":"2024-04-19T04:24:21.527750+0000","last_up_change":"2024-04-19T04:24:08.081123+0000","last_in_change":"2024-04-19T04:24:00.437672+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T04:24:08.928860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T04:24:14.725769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T04:24:19.096707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T04:24:19.528844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28ba89d9-eaaf-4fb5-86bc-783b607a4cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":18128},{"type":"v1","addr":"172.21.15.27:6801","nonce":18128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":18128},{"type":"v1","addr":"172.21.15.27:6803","nonce":18128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":18128},{"type":"v1","addr":"172.21.15.27:6807","nonce":18128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":18128},{"type":"v1","addr":"172.21.15.27:6805","nonce":18128}]},"public_addr":"172.21.15.27:6801/18128","cluster_addr":"172.21.15.27:6803/18128","heartbeat_back_addr":"172.21.15.27:6807/18128","heartbeat_front_addr":"172.21.15.27:6805/18128","state":["exists","up"]},{"osd":1,"uuid":"9d5408b5-b74c-4e5e-858c-e0c8b593204e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":18186},{"type":"v1","addr":"172.21.15.66:6801","nonce":18186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":18186},{"type":"v1","addr":"172.21.15.66:6803","nonce":18186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":18186},{"type":"v1","addr":"172.21.15.66:6807","nonce":18186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":18186},{"type":"v1","addr":"172.21.15.66:6805","nonce":18186}]},"public_addr":"172.21.15.66:6801/18186","cluster_addr":"172.21.15.66:6803/18186","heartbeat_back_addr":"172.21.15.66:6807/18186","heartbeat_front_addr":"172.21.15.66:6805/18186","state":["exists","up"]},{"osd":2,"uuid":"9b600dc4-4425-4873-82d8-5434ca838bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":18250},{"type":"v1","addr":"172.21.15.172:6801","nonce":18250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":18250},{"type":"v1","addr":"172.21.15.172:6803","nonce":18250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":18250},{"type":"v1","addr":"172.21.15.172:6807","nonce":18250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":18250},{"type":"v1","addr":"172.21.15.172:6805","nonce":18250}]},"public_addr":"172.21.15.172:6801/18250","cluster_addr":"172.21.15.172:6803/18250","heartbeat_back_addr":"172.21.15.172:6807/18250","heartbeat_front_addr":"172.21.15.172:6805/18250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.749539+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.573103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.812945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T04:24:23.221 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-19T04:24:23.221 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:24:23.537 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:23.543 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:24:23.556 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-19T04:24:22.870746+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":93868,"kb_used_data":504,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021652,"statfs":{"total":289910292480,"available":289814171648,"internally_reserved":0,"allocated":516096,"data_stored":1293537,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000815"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":209,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T04:24:16.140210+0000","last_change":"2024-04-19T04:24:10.106278+0000","last_active":"2024-04-19T04:24:16.140210+0000","last_peered":"2024-04-19T04:24:16.140210+0000","last_clean":"2024-04-19T04:24:16.140210+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:24:16.140210+0000","last_undegraded":"2024-04-19T04:24:16.140210+0000","last_fullsized":"2024-04-19T04:24:16.140210+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_clean_scrub_stamp":"2024-04-19T04:24:09.083488+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.144195+0000","last_change":"2024-04-19T04:24:16.144872+0000","last_active":"2024-04-19T04:24:17.144195+0000","last_peered":"2024-04-19T04:24:17.144195+0000","last_clean":"2024-04-19T04:24:17.144195+0000","last_became_active":"2024-04-19T04:24:16.143778+0000","last_became_peered":"2024-04-19T04:24:16.143778+0000","last_unstale":"2024-04-19T04:24:17.144195+0000","last_undegraded":"2024-04-19T04:24:17.144195+0000","last_fullsized":"2024-04-19T04:24:17.144195+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:26:06.303713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.144142+0000","last_change":"2024-04-19T04:24:16.144482+0000","last_active":"2024-04-19T04:24:17.144142+0000","last_peered":"2024-04-19T04:24:17.144142+0000","last_clean":"2024-04-19T04:24:17.144142+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:24:17.144142+0000","last_undegraded":"2024-04-19T04:24:17.144142+0000","last_fullsized":"2024-04-19T04:24:17.144142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:15.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.139821+0000","last_change":"2024-04-19T04:24:16.135584+0000","last_active":"2024-04-19T04:24:17.139821+0000","last_peered":"2024-04-19T04:24:17.139821+0000","last_clean":"2024-04-19T04:24:17.139821+0000","last_became_active":"2024-04-19T04:24:16.134799+0000","last_became_peered":"2024-04-19T04:24:16.134799+0000","last_unstale":"2024-04-19T04:24:17.139821+0000","last_undegraded":"2024-04-19T04:24:17.139821+0000","last_fullsized":"2024-04-19T04:24:17.139821+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:55:57.442649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.144192+0000","last_change":"2024-04-19T04:24:16.145124+0000","last_active":"2024-04-19T04:24:17.144192+0000","last_peered":"2024-04-19T04:24:17.144192+0000","last_clean":"2024-04-19T04:24:17.144192+0000","last_became_active":"2024-04-19T04:24:16.143949+0000","last_became_peered":"2024-04-19T04:24:16.143949+0000","last_unstale":"2024-04-19T04:24:17.144192+0000","last_undegraded":"2024-04-19T04:24:17.144192+0000","last_fullsized":"2024-04-19T04:24:17.144192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:18.901615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.139930+0000","last_change":"2024-04-19T04:24:16.136119+0000","last_active":"2024-04-19T04:24:17.139930+0000","last_peered":"2024-04-19T04:24:17.139930+0000","last_clean":"2024-04-19T04:24:17.139930+0000","last_became_active":"2024-04-19T04:24:16.135272+0000","last_became_peered":"2024-04-19T04:24:16.135272+0000","last_unstale":"2024-04-19T04:24:17.139930+0000","last_undegraded":"2024-04-19T04:24:17.139930+0000","last_fullsized":"2024-04-19T04:24:17.139930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:07:14.180095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:18.446800+0000","last_change":"2024-04-19T04:24:16.141899+0000","last_active":"2024-04-19T04:24:18.446800+0000","last_peered":"2024-04-19T04:24:18.446800+0000","last_clean":"2024-04-19T04:24:18.446800+0000","last_became_active":"2024-04-19T04:24:16.141508+0000","last_became_peered":"2024-04-19T04:24:16.141508+0000","last_unstale":"2024-04-19T04:24:18.446800+0000","last_undegraded":"2024-04-19T04:24:18.446800+0000","last_fullsized":"2024-04-19T04:24:18.446800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:31.719446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.139921+0000","last_change":"2024-04-19T04:24:16.135892+0000","last_active":"2024-04-19T04:24:17.139921+0000","last_peered":"2024-04-19T04:24:17.139921+0000","last_clean":"2024-04-19T04:24:17.139921+0000","last_became_active":"2024-04-19T04:24:16.135385+0000","last_became_peered":"2024-04-19T04:24:16.135385+0000","last_unstale":"2024-04-19T04:24:17.139921+0000","last_undegraded":"2024-04-19T04:24:17.139921+0000","last_fullsized":"2024-04-19T04:24:17.139921+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:37.110319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.144133+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:24:17.144133+0000","last_peered":"2024-04-19T04:24:17.144133+0000","last_clean":"2024-04-19T04:24:17.144133+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:24:17.144133+0000","last_undegraded":"2024-04-19T04:24:17.144133+0000","last_fullsized":"2024-04-19T04:24:17.144133+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:45.574813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31304,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340536,"statfs":{"total":96636764160,"available":96604708864,"internally_reserved":0,"allocated":188416,"data_stored":625503,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31248,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340592,"statfs":{"total":96636764160,"available":96604766208,"internally_reserved":0,"allocated":131072,"data_stored":38833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":196608,"data_stored":629201,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:24:23.561 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:24:23.931 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:24:23.947 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-19T04:24:22.870746+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":93868,"kb_used_data":504,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021652,"statfs":{"total":289910292480,"available":289814171648,"internally_reserved":0,"allocated":516096,"data_stored":1293537,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000815"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":209,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T04:24:16.140210+0000","last_change":"2024-04-19T04:24:10.106278+0000","last_active":"2024-04-19T04:24:16.140210+0000","last_peered":"2024-04-19T04:24:16.140210+0000","last_clean":"2024-04-19T04:24:16.140210+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:24:16.140210+0000","last_undegraded":"2024-04-19T04:24:16.140210+0000","last_fullsized":"2024-04-19T04:24:16.140210+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_clean_scrub_stamp":"2024-04-19T04:24:09.083488+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.144195+0000","last_change":"2024-04-19T04:24:16.144872+0000","last_active":"2024-04-19T04:24:17.144195+0000","last_peered":"2024-04-19T04:24:17.144195+0000","last_clean":"2024-04-19T04:24:17.144195+0000","last_became_active":"2024-04-19T04:24:16.143778+0000","last_became_peered":"2024-04-19T04:24:16.143778+0000","last_unstale":"2024-04-19T04:24:17.144195+0000","last_undegraded":"2024-04-19T04:24:17.144195+0000","last_fullsized":"2024-04-19T04:24:17.144195+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:26:06.303713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.144142+0000","last_change":"2024-04-19T04:24:16.144482+0000","last_active":"2024-04-19T04:24:17.144142+0000","last_peered":"2024-04-19T04:24:17.144142+0000","last_clean":"2024-04-19T04:24:17.144142+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:24:17.144142+0000","last_undegraded":"2024-04-19T04:24:17.144142+0000","last_fullsized":"2024-04-19T04:24:17.144142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:15.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.139821+0000","last_change":"2024-04-19T04:24:16.135584+0000","last_active":"2024-04-19T04:24:17.139821+0000","last_peered":"2024-04-19T04:24:17.139821+0000","last_clean":"2024-04-19T04:24:17.139821+0000","last_became_active":"2024-04-19T04:24:16.134799+0000","last_became_peered":"2024-04-19T04:24:16.134799+0000","last_unstale":"2024-04-19T04:24:17.139821+0000","last_undegraded":"2024-04-19T04:24:17.139821+0000","last_fullsized":"2024-04-19T04:24:17.139821+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:55:57.442649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.144192+0000","last_change":"2024-04-19T04:24:16.145124+0000","last_active":"2024-04-19T04:24:17.144192+0000","last_peered":"2024-04-19T04:24:17.144192+0000","last_clean":"2024-04-19T04:24:17.144192+0000","last_became_active":"2024-04-19T04:24:16.143949+0000","last_became_peered":"2024-04-19T04:24:16.143949+0000","last_unstale":"2024-04-19T04:24:17.144192+0000","last_undegraded":"2024-04-19T04:24:17.144192+0000","last_fullsized":"2024-04-19T04:24:17.144192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:18.901615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.139930+0000","last_change":"2024-04-19T04:24:16.136119+0000","last_active":"2024-04-19T04:24:17.139930+0000","last_peered":"2024-04-19T04:24:17.139930+0000","last_clean":"2024-04-19T04:24:17.139930+0000","last_became_active":"2024-04-19T04:24:16.135272+0000","last_became_peered":"2024-04-19T04:24:16.135272+0000","last_unstale":"2024-04-19T04:24:17.139930+0000","last_undegraded":"2024-04-19T04:24:17.139930+0000","last_fullsized":"2024-04-19T04:24:17.139930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:07:14.180095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:18.446800+0000","last_change":"2024-04-19T04:24:16.141899+0000","last_active":"2024-04-19T04:24:18.446800+0000","last_peered":"2024-04-19T04:24:18.446800+0000","last_clean":"2024-04-19T04:24:18.446800+0000","last_became_active":"2024-04-19T04:24:16.141508+0000","last_became_peered":"2024-04-19T04:24:16.141508+0000","last_unstale":"2024-04-19T04:24:18.446800+0000","last_undegraded":"2024-04-19T04:24:18.446800+0000","last_fullsized":"2024-04-19T04:24:18.446800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:31.719446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.139921+0000","last_change":"2024-04-19T04:24:16.135892+0000","last_active":"2024-04-19T04:24:17.139921+0000","last_peered":"2024-04-19T04:24:17.139921+0000","last_clean":"2024-04-19T04:24:17.139921+0000","last_became_active":"2024-04-19T04:24:16.135385+0000","last_became_peered":"2024-04-19T04:24:16.135385+0000","last_unstale":"2024-04-19T04:24:17.139921+0000","last_undegraded":"2024-04-19T04:24:17.139921+0000","last_fullsized":"2024-04-19T04:24:17.139921+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:37.110319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.144133+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:24:17.144133+0000","last_peered":"2024-04-19T04:24:17.144133+0000","last_clean":"2024-04-19T04:24:17.144133+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:24:17.144133+0000","last_undegraded":"2024-04-19T04:24:17.144133+0000","last_fullsized":"2024-04-19T04:24:17.144133+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:45.574813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31304,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340536,"statfs":{"total":96636764160,"available":96604708864,"internally_reserved":0,"allocated":188416,"data_stored":625503,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31248,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340592,"statfs":{"total":96636764160,"available":96604766208,"internally_reserved":0,"allocated":131072,"data_stored":38833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":196608,"data_stored":629201,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:24:23.951 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:24:24.264 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:24.266 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:24:24.279 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-19T04:24:22.870746+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":93868,"kb_used_data":504,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021652,"statfs":{"total":289910292480,"available":289814171648,"internally_reserved":0,"allocated":516096,"data_stored":1293537,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000815"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":209,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T04:24:16.140210+0000","last_change":"2024-04-19T04:24:10.106278+0000","last_active":"2024-04-19T04:24:16.140210+0000","last_peered":"2024-04-19T04:24:16.140210+0000","last_clean":"2024-04-19T04:24:16.140210+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:24:16.140210+0000","last_undegraded":"2024-04-19T04:24:16.140210+0000","last_fullsized":"2024-04-19T04:24:16.140210+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_clean_scrub_stamp":"2024-04-19T04:24:09.083488+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.144195+0000","last_change":"2024-04-19T04:24:16.144872+0000","last_active":"2024-04-19T04:24:17.144195+0000","last_peered":"2024-04-19T04:24:17.144195+0000","last_clean":"2024-04-19T04:24:17.144195+0000","last_became_active":"2024-04-19T04:24:16.143778+0000","last_became_peered":"2024-04-19T04:24:16.143778+0000","last_unstale":"2024-04-19T04:24:17.144195+0000","last_undegraded":"2024-04-19T04:24:17.144195+0000","last_fullsized":"2024-04-19T04:24:17.144195+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:26:06.303713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.144142+0000","last_change":"2024-04-19T04:24:16.144482+0000","last_active":"2024-04-19T04:24:17.144142+0000","last_peered":"2024-04-19T04:24:17.144142+0000","last_clean":"2024-04-19T04:24:17.144142+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:24:17.144142+0000","last_undegraded":"2024-04-19T04:24:17.144142+0000","last_fullsized":"2024-04-19T04:24:17.144142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:15.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.139821+0000","last_change":"2024-04-19T04:24:16.135584+0000","last_active":"2024-04-19T04:24:17.139821+0000","last_peered":"2024-04-19T04:24:17.139821+0000","last_clean":"2024-04-19T04:24:17.139821+0000","last_became_active":"2024-04-19T04:24:16.134799+0000","last_became_peered":"2024-04-19T04:24:16.134799+0000","last_unstale":"2024-04-19T04:24:17.139821+0000","last_undegraded":"2024-04-19T04:24:17.139821+0000","last_fullsized":"2024-04-19T04:24:17.139821+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:55:57.442649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.144192+0000","last_change":"2024-04-19T04:24:16.145124+0000","last_active":"2024-04-19T04:24:17.144192+0000","last_peered":"2024-04-19T04:24:17.144192+0000","last_clean":"2024-04-19T04:24:17.144192+0000","last_became_active":"2024-04-19T04:24:16.143949+0000","last_became_peered":"2024-04-19T04:24:16.143949+0000","last_unstale":"2024-04-19T04:24:17.144192+0000","last_undegraded":"2024-04-19T04:24:17.144192+0000","last_fullsized":"2024-04-19T04:24:17.144192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:18.901615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.139930+0000","last_change":"2024-04-19T04:24:16.136119+0000","last_active":"2024-04-19T04:24:17.139930+0000","last_peered":"2024-04-19T04:24:17.139930+0000","last_clean":"2024-04-19T04:24:17.139930+0000","last_became_active":"2024-04-19T04:24:16.135272+0000","last_became_peered":"2024-04-19T04:24:16.135272+0000","last_unstale":"2024-04-19T04:24:17.139930+0000","last_undegraded":"2024-04-19T04:24:17.139930+0000","last_fullsized":"2024-04-19T04:24:17.139930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:07:14.180095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:18.446800+0000","last_change":"2024-04-19T04:24:16.141899+0000","last_active":"2024-04-19T04:24:18.446800+0000","last_peered":"2024-04-19T04:24:18.446800+0000","last_clean":"2024-04-19T04:24:18.446800+0000","last_became_active":"2024-04-19T04:24:16.141508+0000","last_became_peered":"2024-04-19T04:24:16.141508+0000","last_unstale":"2024-04-19T04:24:18.446800+0000","last_undegraded":"2024-04-19T04:24:18.446800+0000","last_fullsized":"2024-04-19T04:24:18.446800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:31.719446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.139921+0000","last_change":"2024-04-19T04:24:16.135892+0000","last_active":"2024-04-19T04:24:17.139921+0000","last_peered":"2024-04-19T04:24:17.139921+0000","last_clean":"2024-04-19T04:24:17.139921+0000","last_became_active":"2024-04-19T04:24:16.135385+0000","last_became_peered":"2024-04-19T04:24:16.135385+0000","last_unstale":"2024-04-19T04:24:17.139921+0000","last_undegraded":"2024-04-19T04:24:17.139921+0000","last_fullsized":"2024-04-19T04:24:17.139921+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:37.110319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T04:24:17.144133+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:24:17.144133+0000","last_peered":"2024-04-19T04:24:17.144133+0000","last_clean":"2024-04-19T04:24:17.144133+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:24:17.144133+0000","last_undegraded":"2024-04-19T04:24:17.144133+0000","last_fullsized":"2024-04-19T04:24:17.144133+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:45.574813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:20.154964+0000","last_change":"2024-04-19T04:24:20.154964+0000","last_active":"2024-04-19T04:24:20.154964+0000","last_peered":"2024-04-19T04:24:20.154964+0000","last_clean":"2024-04-19T04:24:20.154964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:20.154964+0000","last_undegraded":"2024-04-19T04:24:20.154964+0000","last_fullsized":"2024-04-19T04:24:20.154964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T04:24:19.147033+0000","last_change":"2024-04-19T04:24:19.147033+0000","last_active":"2024-04-19T04:24:19.147033+0000","last_peered":"2024-04-19T04:24:19.147033+0000","last_clean":"2024-04-19T04:24:19.147033+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T04:24:19.147033+0000","last_undegraded":"2024-04-19T04:24:19.147033+0000","last_fullsized":"2024-04-19T04:24:19.147033+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31304,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340536,"statfs":{"total":96636764160,"available":96604708864,"internally_reserved":0,"allocated":188416,"data_stored":625503,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31248,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340592,"statfs":{"total":96636764160,"available":96604766208,"internally_reserved":0,"allocated":131072,"data_stored":38833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":196608,"data_stored":629201,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:24:24.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-04-19T04:24:24.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-04-19T04:24:24.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-04-19T04:24:24.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-04-19T04:24:24.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-04-19T04:24:24.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-04-19T04:24:24.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-04-19T04:24:24.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-04-19T04:24:24.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-04-19T04:24:24.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-04-19T04:24:24.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-04-19T04:24:24.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-04-19T04:24:24.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-04-19T04:24:24.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-04-19T04:24:24.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-04-19T04:24:24.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-04-19T04:24:24.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-04-19T04:24:24.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-04-19T04:24:24.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-04-19T04:24:24.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-04-19T04:24:24.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-04-19T04:24:24.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-04-19T04:24:24.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-04-19T04:24:24.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-04-19T04:24:24.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-04-19T04:24:24.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-04-19T04:24:24.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-04-19T04:24:24.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-04-19T04:24:24.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-04-19T04:24:24.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-04-19T04:24:24.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-04-19T04:24:24.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-04-19T04:24:24.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-19T04:24:24.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-04-19T04:24:24.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-19T04:24:24.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-04-19T04:24:24.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-19T04:24:24.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-04-19T04:24:24.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-19T04:24:24.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-04-19T04:24:24.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-04-19T04:24:24.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-19T04:24:24.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-04-19T04:24:24.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-19T04:24:24.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-04-19T04:24:24.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-19T04:24:24.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-04-19T04:24:24.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-19T04:24:24.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-04-19T04:24:24.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-19T04:24:24.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-04-19T04:24:24.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-19T04:24:24.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-04-19T04:24:24.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-19T04:24:24.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-04-19T04:24:24.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-19T04:24:24.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-19T04:24:24.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-19T04:24:24.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-04-19T04:24:24.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-19T04:24:24.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-04-19T04:24:24.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-19T04:24:24.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-04-19T04:24:24.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-19T04:24:24.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-04-19T04:24:24.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-19T04:24:24.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-19T04:24:24.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-19T04:24:24.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-19T04:24:24.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-19T04:24:24.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-19T04:24:24.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-19T04:24:24.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-19T04:24:24.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-04-19T04:24:24.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-19T04:24:24.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-04-19T04:24:24.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-04-19T04:24:24.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-19T04:24:24.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-04-19T04:24:24.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-19T04:24:24.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-19T04:24:24.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-04-19T04:24:24.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-19T04:24:24.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-19T04:24:24.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-19T04:24:24.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-04-19T04:24:24.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-19T04:24:24.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-04-19T04:24:24.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-19T04:24:24.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-04-19T04:24:24.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-19T04:24:24.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-04-19T04:24:24.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-19T04:24:24.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-04-19T04:24:24.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-19T04:24:24.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:20.154964+0000', 'last_change': '2024-04-19T04:24:20.154964+0000', 'last_active': '2024-04-19T04:24:20.154964+0000', 'last_peered': '2024-04-19T04:24:20.154964+0000', 'last_clean': '2024-04-19T04:24:20.154964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:20.154964+0000', 'last_undegraded': '2024-04-19T04:24:20.154964+0000', 'last_fullsized': '2024-04-19T04:24:20.154964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:20.154964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-04-19T04:24:24.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T04:24:19.147033+0000', 'last_change': '2024-04-19T04:24:19.147033+0000', 'last_active': '2024-04-19T04:24:19.147033+0000', 'last_peered': '2024-04-19T04:24:19.147033+0000', 'last_clean': '2024-04-19T04:24:19.147033+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T04:24:19.147033+0000', 'last_undegraded': '2024-04-19T04:24:19.147033+0000', 'last_fullsized': '2024-04-19T04:24:19.147033+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'last_clean_scrub_stamp': '2024-04-19T04:24:19.147033+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T04:24:24.305 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T04:24:24.674 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:24.674 INFO:teuthology.orchestra.run.smithi007.stdout:{"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":25,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":19,"num_osds":3,"num_up_osds":3,"osd_up_since":1713500648,"num_in_osds":3,"osd_in_since":1713500640,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":96120832,"bytes_avail":289814171648,"bytes_total":289910292480,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4239}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-19T04:23:58.840048+0000","services":{}},"progress_events":{}} 2024-04-19T04:24:24.689 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-19T04:24:24.689 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:24:25.017 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:25.019 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:24:25.031 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-19T04:24:24.871417+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94032,"kb_used_data":672,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021488,"statfs":{"total":289910292480,"available":289814003712,"internally_reserved":0,"allocated":688128,"data_stored":1356856,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.715435"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541340+0000","last_change":"2024-04-19T04:24:20.550082+0000","last_active":"2024-04-19T04:24:21.541340+0000","last_peered":"2024-04-19T04:24:21.541340+0000","last_clean":"2024-04-19T04:24:21.541340+0000","last_became_active":"2024-04-19T04:24:20.549529+0000","last_became_peered":"2024-04-19T04:24:20.549529+0000","last_unstale":"2024-04-19T04:24:21.541340+0000","last_undegraded":"2024-04-19T04:24:21.541340+0000","last_fullsized":"2024-04-19T04:24:21.541340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:27.393720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540906+0000","last_change":"2024-04-19T04:24:20.545709+0000","last_active":"2024-04-19T04:24:21.540906+0000","last_peered":"2024-04-19T04:24:21.540906+0000","last_clean":"2024-04-19T04:24:21.540906+0000","last_became_active":"2024-04-19T04:24:20.544962+0000","last_became_peered":"2024-04-19T04:24:20.544962+0000","last_unstale":"2024-04-19T04:24:21.540906+0000","last_undegraded":"2024-04-19T04:24:21.540906+0000","last_fullsized":"2024-04-19T04:24:21.540906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:06.452910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608479+0000","last_change":"2024-04-19T04:24:20.556199+0000","last_active":"2024-04-19T04:24:21.608479+0000","last_peered":"2024-04-19T04:24:21.608479+0000","last_clean":"2024-04-19T04:24:21.608479+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:24:21.608479+0000","last_undegraded":"2024-04-19T04:24:21.608479+0000","last_fullsized":"2024-04-19T04:24:21.608479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:14.348910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608071+0000","last_change":"2024-04-19T04:24:20.552787+0000","last_active":"2024-04-19T04:24:21.608071+0000","last_peered":"2024-04-19T04:24:21.608071+0000","last_clean":"2024-04-19T04:24:21.608071+0000","last_became_active":"2024-04-19T04:24:20.551784+0000","last_became_peered":"2024-04-19T04:24:20.551784+0000","last_unstale":"2024-04-19T04:24:21.608071+0000","last_undegraded":"2024-04-19T04:24:21.608071+0000","last_fullsized":"2024-04-19T04:24:21.608071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:21.734428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541302+0000","last_change":"2024-04-19T04:24:20.550112+0000","last_active":"2024-04-19T04:24:21.541302+0000","last_peered":"2024-04-19T04:24:21.541302+0000","last_clean":"2024-04-19T04:24:21.541302+0000","last_became_active":"2024-04-19T04:24:20.549620+0000","last_became_peered":"2024-04-19T04:24:20.549620+0000","last_unstale":"2024-04-19T04:24:21.541302+0000","last_undegraded":"2024-04-19T04:24:21.541302+0000","last_fullsized":"2024-04-19T04:24:21.541302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:03:50.416299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607265+0000","last_change":"2024-04-19T04:24:20.551576+0000","last_active":"2024-04-19T04:24:21.607265+0000","last_peered":"2024-04-19T04:24:21.607265+0000","last_clean":"2024-04-19T04:24:21.607265+0000","last_became_active":"2024-04-19T04:24:20.548600+0000","last_became_peered":"2024-04-19T04:24:20.548600+0000","last_unstale":"2024-04-19T04:24:21.607265+0000","last_undegraded":"2024-04-19T04:24:21.607265+0000","last_fullsized":"2024-04-19T04:24:21.607265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:39.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607230+0000","last_change":"2024-04-19T04:24:20.550337+0000","last_active":"2024-04-19T04:24:21.607230+0000","last_peered":"2024-04-19T04:24:21.607230+0000","last_clean":"2024-04-19T04:24:21.607230+0000","last_became_active":"2024-04-19T04:24:20.548514+0000","last_became_peered":"2024-04-19T04:24:20.548514+0000","last_unstale":"2024-04-19T04:24:21.607230+0000","last_undegraded":"2024-04-19T04:24:21.607230+0000","last_fullsized":"2024-04-19T04:24:21.607230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:14.194572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606529+0000","last_change":"2024-04-19T04:24:20.553787+0000","last_active":"2024-04-19T04:24:21.606529+0000","last_peered":"2024-04-19T04:24:21.606529+0000","last_clean":"2024-04-19T04:24:21.606529+0000","last_became_active":"2024-04-19T04:24:20.553410+0000","last_became_peered":"2024-04-19T04:24:20.553410+0000","last_unstale":"2024-04-19T04:24:21.606529+0000","last_undegraded":"2024-04-19T04:24:21.606529+0000","last_fullsized":"2024-04-19T04:24:21.606529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:00.475711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538444+0000","last_change":"2024-04-19T04:24:20.547585+0000","last_active":"2024-04-19T04:24:21.538444+0000","last_peered":"2024-04-19T04:24:21.538444+0000","last_clean":"2024-04-19T04:24:21.538444+0000","last_became_active":"2024-04-19T04:24:20.547395+0000","last_became_peered":"2024-04-19T04:24:20.547395+0000","last_unstale":"2024-04-19T04:24:21.538444+0000","last_undegraded":"2024-04-19T04:24:21.538444+0000","last_fullsized":"2024-04-19T04:24:21.538444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:15.398090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540977+0000","last_change":"2024-04-19T04:24:20.546893+0000","last_active":"2024-04-19T04:24:21.540977+0000","last_peered":"2024-04-19T04:24:21.540977+0000","last_clean":"2024-04-19T04:24:21.540977+0000","last_became_active":"2024-04-19T04:24:20.546257+0000","last_became_peered":"2024-04-19T04:24:20.546257+0000","last_unstale":"2024-04-19T04:24:21.540977+0000","last_undegraded":"2024-04-19T04:24:21.540977+0000","last_fullsized":"2024-04-19T04:24:21.540977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:47.327841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608401+0000","last_change":"2024-04-19T04:24:20.556382+0000","last_active":"2024-04-19T04:24:21.608401+0000","last_peered":"2024-04-19T04:24:21.608401+0000","last_clean":"2024-04-19T04:24:21.608401+0000","last_became_active":"2024-04-19T04:24:20.555246+0000","last_became_peered":"2024-04-19T04:24:20.555246+0000","last_unstale":"2024-04-19T04:24:21.608401+0000","last_undegraded":"2024-04-19T04:24:21.608401+0000","last_fullsized":"2024-04-19T04:24:21.608401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:37:15.332493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540961+0000","last_change":"2024-04-19T04:24:20.558886+0000","last_active":"2024-04-19T04:24:21.540961+0000","last_peered":"2024-04-19T04:24:21.540961+0000","last_clean":"2024-04-19T04:24:21.540961+0000","last_became_active":"2024-04-19T04:24:20.558293+0000","last_became_peered":"2024-04-19T04:24:20.558293+0000","last_unstale":"2024-04-19T04:24:21.540961+0000","last_undegraded":"2024-04-19T04:24:21.540961+0000","last_fullsized":"2024-04-19T04:24:21.540961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:37:15.332493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540418+0000","last_change":"2024-04-19T04:24:20.545891+0000","last_active":"2024-04-19T04:24:21.540418+0000","last_peered":"2024-04-19T04:24:21.540418+0000","last_clean":"2024-04-19T04:24:21.540418+0000","last_became_active":"2024-04-19T04:24:20.545422+0000","last_became_peered":"2024-04-19T04:24:20.545422+0000","last_unstale":"2024-04-19T04:24:21.540418+0000","last_undegraded":"2024-04-19T04:24:21.540418+0000","last_fullsized":"2024-04-19T04:24:21.540418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:31:52.562663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607344+0000","last_change":"2024-04-19T04:24:20.552690+0000","last_active":"2024-04-19T04:24:21.607344+0000","last_peered":"2024-04-19T04:24:21.607344+0000","last_clean":"2024-04-19T04:24:21.607344+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:24:21.607344+0000","last_undegraded":"2024-04-19T04:24:21.607344+0000","last_fullsized":"2024-04-19T04:24:21.607344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:53:16.890992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607404+0000","last_change":"2024-04-19T04:24:20.551809+0000","last_active":"2024-04-19T04:24:21.607404+0000","last_peered":"2024-04-19T04:24:21.607404+0000","last_clean":"2024-04-19T04:24:21.607404+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:24:21.607404+0000","last_undegraded":"2024-04-19T04:24:21.607404+0000","last_fullsized":"2024-04-19T04:24:21.607404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:43:31.281765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606723+0000","last_change":"2024-04-19T04:24:20.552758+0000","last_active":"2024-04-19T04:24:21.606723+0000","last_peered":"2024-04-19T04:24:21.606723+0000","last_clean":"2024-04-19T04:24:21.606723+0000","last_became_active":"2024-04-19T04:24:20.548882+0000","last_became_peered":"2024-04-19T04:24:20.548882+0000","last_unstale":"2024-04-19T04:24:21.606723+0000","last_undegraded":"2024-04-19T04:24:21.606723+0000","last_fullsized":"2024-04-19T04:24:21.606723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:56.738569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539114+0000","last_change":"2024-04-19T04:24:20.546173+0000","last_active":"2024-04-19T04:24:21.539114+0000","last_peered":"2024-04-19T04:24:21.539114+0000","last_clean":"2024-04-19T04:24:21.539114+0000","last_became_active":"2024-04-19T04:24:20.545582+0000","last_became_peered":"2024-04-19T04:24:20.545582+0000","last_unstale":"2024-04-19T04:24:21.539114+0000","last_undegraded":"2024-04-19T04:24:21.539114+0000","last_fullsized":"2024-04-19T04:24:21.539114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:55.955786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541323+0000","last_change":"2024-04-19T04:24:20.549835+0000","last_active":"2024-04-19T04:24:21.541323+0000","last_peered":"2024-04-19T04:24:21.541323+0000","last_clean":"2024-04-19T04:24:21.541323+0000","last_became_active":"2024-04-19T04:24:20.549411+0000","last_became_peered":"2024-04-19T04:24:20.549411+0000","last_unstale":"2024-04-19T04:24:21.541323+0000","last_undegraded":"2024-04-19T04:24:21.541323+0000","last_fullsized":"2024-04-19T04:24:21.541323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:31:11.088424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538186+0000","last_change":"2024-04-19T04:24:20.546517+0000","last_active":"2024-04-19T04:24:21.538186+0000","last_peered":"2024-04-19T04:24:21.538186+0000","last_clean":"2024-04-19T04:24:21.538186+0000","last_became_active":"2024-04-19T04:24:20.546116+0000","last_became_peered":"2024-04-19T04:24:20.546116+0000","last_unstale":"2024-04-19T04:24:21.538186+0000","last_undegraded":"2024-04-19T04:24:21.538186+0000","last_fullsized":"2024-04-19T04:24:21.538186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:28:06.813455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608191+0000","last_change":"2024-04-19T04:24:20.551326+0000","last_active":"2024-04-19T04:24:21.608191+0000","last_peered":"2024-04-19T04:24:21.608191+0000","last_clean":"2024-04-19T04:24:21.608191+0000","last_became_active":"2024-04-19T04:24:20.550246+0000","last_became_peered":"2024-04-19T04:24:20.550246+0000","last_unstale":"2024-04-19T04:24:21.608191+0000","last_undegraded":"2024-04-19T04:24:21.608191+0000","last_fullsized":"2024-04-19T04:24:21.608191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:12.211801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608194+0000","last_change":"2024-04-19T04:24:20.556352+0000","last_active":"2024-04-19T04:24:21.608194+0000","last_peered":"2024-04-19T04:24:21.608194+0000","last_clean":"2024-04-19T04:24:21.608194+0000","last_became_active":"2024-04-19T04:24:20.554294+0000","last_became_peered":"2024-04-19T04:24:20.554294+0000","last_unstale":"2024-04-19T04:24:21.608194+0000","last_undegraded":"2024-04-19T04:24:21.608194+0000","last_fullsized":"2024-04-19T04:24:21.608194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:06.452910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540048+0000","last_change":"2024-04-19T04:24:20.555257+0000","last_active":"2024-04-19T04:24:21.540048+0000","last_peered":"2024-04-19T04:24:21.540048+0000","last_clean":"2024-04-19T04:24:21.540048+0000","last_became_active":"2024-04-19T04:24:20.554895+0000","last_became_peered":"2024-04-19T04:24:20.554895+0000","last_unstale":"2024-04-19T04:24:21.540048+0000","last_undegraded":"2024-04-19T04:24:21.540048+0000","last_fullsized":"2024-04-19T04:24:21.540048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:39.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536664+0000","last_change":"2024-04-19T04:24:20.549936+0000","last_active":"2024-04-19T04:24:21.536664+0000","last_peered":"2024-04-19T04:24:21.536664+0000","last_clean":"2024-04-19T04:24:21.536664+0000","last_became_active":"2024-04-19T04:24:20.549428+0000","last_became_peered":"2024-04-19T04:24:20.549428+0000","last_unstale":"2024-04-19T04:24:21.536664+0000","last_undegraded":"2024-04-19T04:24:21.536664+0000","last_fullsized":"2024-04-19T04:24:21.536664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:44:47.158480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539602+0000","last_change":"2024-04-19T04:24:20.546315+0000","last_active":"2024-04-19T04:24:21.539602+0000","last_peered":"2024-04-19T04:24:21.539602+0000","last_clean":"2024-04-19T04:24:21.539602+0000","last_became_active":"2024-04-19T04:24:20.545851+0000","last_became_peered":"2024-04-19T04:24:20.545851+0000","last_unstale":"2024-04-19T04:24:21.539602+0000","last_undegraded":"2024-04-19T04:24:21.539602+0000","last_fullsized":"2024-04-19T04:24:21.539602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:07:48.905896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541518+0000","last_change":"2024-04-19T04:24:20.554855+0000","last_active":"2024-04-19T04:24:21.541518+0000","last_peered":"2024-04-19T04:24:21.541518+0000","last_clean":"2024-04-19T04:24:21.541518+0000","last_became_active":"2024-04-19T04:24:20.554383+0000","last_became_peered":"2024-04-19T04:24:20.554383+0000","last_unstale":"2024-04-19T04:24:21.541518+0000","last_undegraded":"2024-04-19T04:24:21.541518+0000","last_fullsized":"2024-04-19T04:24:21.541518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:18:50.807364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538534+0000","last_change":"2024-04-19T04:24:20.546410+0000","last_active":"2024-04-19T04:24:21.538534+0000","last_peered":"2024-04-19T04:24:21.538534+0000","last_clean":"2024-04-19T04:24:21.538534+0000","last_became_active":"2024-04-19T04:24:20.545607+0000","last_became_peered":"2024-04-19T04:24:20.545607+0000","last_unstale":"2024-04-19T04:24:21.538534+0000","last_undegraded":"2024-04-19T04:24:21.538534+0000","last_fullsized":"2024-04-19T04:24:21.538534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:03.482984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608645+0000","last_change":"2024-04-19T04:24:20.554885+0000","last_active":"2024-04-19T04:24:21.608645+0000","last_peered":"2024-04-19T04:24:21.608645+0000","last_clean":"2024-04-19T04:24:21.608645+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:24:21.608645+0000","last_undegraded":"2024-04-19T04:24:21.608645+0000","last_fullsized":"2024-04-19T04:24:21.608645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:44:08.285518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541646+0000","last_change":"2024-04-19T04:24:20.558702+0000","last_active":"2024-04-19T04:24:21.541646+0000","last_peered":"2024-04-19T04:24:21.541646+0000","last_clean":"2024-04-19T04:24:21.541646+0000","last_became_active":"2024-04-19T04:24:20.558202+0000","last_became_peered":"2024-04-19T04:24:20.558202+0000","last_unstale":"2024-04-19T04:24:21.541646+0000","last_undegraded":"2024-04-19T04:24:21.541646+0000","last_fullsized":"2024-04-19T04:24:21.541646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:56.738569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537991+0000","last_change":"2024-04-19T04:24:20.543906+0000","last_active":"2024-04-19T04:24:21.537991+0000","last_peered":"2024-04-19T04:24:21.537991+0000","last_clean":"2024-04-19T04:24:21.537991+0000","last_became_active":"2024-04-19T04:24:20.543531+0000","last_became_peered":"2024-04-19T04:24:20.543531+0000","last_unstale":"2024-04-19T04:24:21.537991+0000","last_undegraded":"2024-04-19T04:24:21.537991+0000","last_fullsized":"2024-04-19T04:24:21.537991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:28:04.850289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540345+0000","last_change":"2024-04-19T04:24:20.554847+0000","last_active":"2024-04-19T04:24:21.540345+0000","last_peered":"2024-04-19T04:24:21.540345+0000","last_clean":"2024-04-19T04:24:21.540345+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:24:21.540345+0000","last_undegraded":"2024-04-19T04:24:21.540345+0000","last_fullsized":"2024-04-19T04:24:21.540345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:00.475711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536735+0000","last_change":"2024-04-19T04:24:20.546826+0000","last_active":"2024-04-19T04:24:21.536735+0000","last_peered":"2024-04-19T04:24:21.536735+0000","last_clean":"2024-04-19T04:24:21.536735+0000","last_became_active":"2024-04-19T04:24:20.546065+0000","last_became_peered":"2024-04-19T04:24:20.546065+0000","last_unstale":"2024-04-19T04:24:21.536735+0000","last_undegraded":"2024-04-19T04:24:21.536735+0000","last_fullsized":"2024-04-19T04:24:21.536735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:47.956234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606802+0000","last_change":"2024-04-19T04:24:20.552289+0000","last_active":"2024-04-19T04:24:21.606802+0000","last_peered":"2024-04-19T04:24:21.606802+0000","last_clean":"2024-04-19T04:24:21.606802+0000","last_became_active":"2024-04-19T04:24:20.548755+0000","last_became_peered":"2024-04-19T04:24:20.548755+0000","last_unstale":"2024-04-19T04:24:21.606802+0000","last_undegraded":"2024-04-19T04:24:21.606802+0000","last_fullsized":"2024-04-19T04:24:21.606802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541554+0000","last_change":"2024-04-19T04:24:20.546223+0000","last_active":"2024-04-19T04:24:21.541554+0000","last_peered":"2024-04-19T04:24:21.541554+0000","last_clean":"2024-04-19T04:24:21.541554+0000","last_became_active":"2024-04-19T04:24:20.545807+0000","last_became_peered":"2024-04-19T04:24:20.545807+0000","last_unstale":"2024-04-19T04:24:21.541554+0000","last_undegraded":"2024-04-19T04:24:21.541554+0000","last_fullsized":"2024-04-19T04:24:21.541554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:19.894104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608609+0000","last_change":"2024-04-19T04:24:20.184870+0000","last_active":"2024-04-19T04:24:21.608609+0000","last_peered":"2024-04-19T04:24:21.608609+0000","last_clean":"2024-04-19T04:24:21.608609+0000","last_became_active":"2024-04-19T04:24:20.183615+0000","last_became_peered":"2024-04-19T04:24:20.183615+0000","last_unstale":"2024-04-19T04:24:21.608609+0000","last_undegraded":"2024-04-19T04:24:21.608609+0000","last_fullsized":"2024-04-19T04:24:21.608609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:52:38.272121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541893+0000","last_change":"2024-04-19T04:24:20.547475+0000","last_active":"2024-04-19T04:24:21.541893+0000","last_peered":"2024-04-19T04:24:21.541893+0000","last_clean":"2024-04-19T04:24:21.541893+0000","last_became_active":"2024-04-19T04:24:20.546615+0000","last_became_peered":"2024-04-19T04:24:20.546615+0000","last_unstale":"2024-04-19T04:24:21.541893+0000","last_undegraded":"2024-04-19T04:24:21.541893+0000","last_fullsized":"2024-04-19T04:24:21.541893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:24.049904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537755+0000","last_change":"2024-04-19T04:24:20.177739+0000","last_active":"2024-04-19T04:24:21.537755+0000","last_peered":"2024-04-19T04:24:21.537755+0000","last_clean":"2024-04-19T04:24:21.537755+0000","last_became_active":"2024-04-19T04:24:20.177328+0000","last_became_peered":"2024-04-19T04:24:20.177328+0000","last_unstale":"2024-04-19T04:24:21.537755+0000","last_undegraded":"2024-04-19T04:24:21.537755+0000","last_fullsized":"2024-04-19T04:24:21.537755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:27.902190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538848+0000","last_change":"2024-04-19T04:24:20.547144+0000","last_active":"2024-04-19T04:24:21.538848+0000","last_peered":"2024-04-19T04:24:21.538848+0000","last_clean":"2024-04-19T04:24:21.538848+0000","last_became_active":"2024-04-19T04:24:20.546814+0000","last_became_peered":"2024-04-19T04:24:20.546814+0000","last_unstale":"2024-04-19T04:24:21.538848+0000","last_undegraded":"2024-04-19T04:24:21.538848+0000","last_fullsized":"2024-04-19T04:24:21.538848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:04.710943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540345+0000","last_change":"2024-04-19T04:24:20.183855+0000","last_active":"2024-04-19T04:24:21.540345+0000","last_peered":"2024-04-19T04:24:21.540345+0000","last_clean":"2024-04-19T04:24:21.540345+0000","last_became_active":"2024-04-19T04:24:20.183272+0000","last_became_peered":"2024-04-19T04:24:20.183272+0000","last_unstale":"2024-04-19T04:24:21.540345+0000","last_undegraded":"2024-04-19T04:24:21.540345+0000","last_fullsized":"2024-04-19T04:24:21.540345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:54.737330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538578+0000","last_change":"2024-04-19T04:24:20.551347+0000","last_active":"2024-04-19T04:24:21.538578+0000","last_peered":"2024-04-19T04:24:21.538578+0000","last_clean":"2024-04-19T04:24:21.538578+0000","last_became_active":"2024-04-19T04:24:20.550917+0000","last_became_peered":"2024-04-19T04:24:20.550917+0000","last_unstale":"2024-04-19T04:24:21.538578+0000","last_undegraded":"2024-04-19T04:24:21.538578+0000","last_fullsized":"2024-04-19T04:24:21.538578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:47.732617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606983+0000","last_change":"2024-04-19T04:24:20.187299+0000","last_active":"2024-04-19T04:24:21.606983+0000","last_peered":"2024-04-19T04:24:21.606983+0000","last_clean":"2024-04-19T04:24:21.606983+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:24:21.606983+0000","last_undegraded":"2024-04-19T04:24:21.606983+0000","last_fullsized":"2024-04-19T04:24:21.606983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:49:37.812125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609542+0000","last_change":"2024-04-19T04:24:20.186029+0000","last_active":"2024-04-19T04:24:21.609542+0000","last_peered":"2024-04-19T04:24:21.609542+0000","last_clean":"2024-04-19T04:24:21.609542+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:24:21.609542+0000","last_undegraded":"2024-04-19T04:24:21.609542+0000","last_fullsized":"2024-04-19T04:24:21.609542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:49.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539569+0000","last_change":"2024-04-19T04:24:20.555751+0000","last_active":"2024-04-19T04:24:21.539569+0000","last_peered":"2024-04-19T04:24:21.539569+0000","last_clean":"2024-04-19T04:24:21.539569+0000","last_became_active":"2024-04-19T04:24:20.555501+0000","last_became_peered":"2024-04-19T04:24:20.555501+0000","last_unstale":"2024-04-19T04:24:21.539569+0000","last_undegraded":"2024-04-19T04:24:21.539569+0000","last_fullsized":"2024-04-19T04:24:21.539569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:57.839930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541919+0000","last_change":"2024-04-19T04:24:20.184142+0000","last_active":"2024-04-19T04:24:21.541919+0000","last_peered":"2024-04-19T04:24:21.541919+0000","last_clean":"2024-04-19T04:24:21.541919+0000","last_became_active":"2024-04-19T04:24:20.183546+0000","last_became_peered":"2024-04-19T04:24:20.183546+0000","last_unstale":"2024-04-19T04:24:21.541919+0000","last_undegraded":"2024-04-19T04:24:21.541919+0000","last_fullsized":"2024-04-19T04:24:21.541919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:17.280977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539845+0000","last_change":"2024-04-19T04:24:20.545490+0000","last_active":"2024-04-19T04:24:21.539845+0000","last_peered":"2024-04-19T04:24:21.539845+0000","last_clean":"2024-04-19T04:24:21.539845+0000","last_became_active":"2024-04-19T04:24:20.544898+0000","last_became_peered":"2024-04-19T04:24:20.544898+0000","last_unstale":"2024-04-19T04:24:21.539845+0000","last_undegraded":"2024-04-19T04:24:21.539845+0000","last_fullsized":"2024-04-19T04:24:21.539845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:40:02.138518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609093+0000","last_change":"2024-04-19T04:24:20.186044+0000","last_active":"2024-04-19T04:24:21.609093+0000","last_peered":"2024-04-19T04:24:21.609093+0000","last_clean":"2024-04-19T04:24:21.609093+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:24:21.609093+0000","last_undegraded":"2024-04-19T04:24:21.609093+0000","last_fullsized":"2024-04-19T04:24:21.609093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.432692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607445+0000","last_change":"2024-04-19T04:24:20.552828+0000","last_active":"2024-04-19T04:24:21.607445+0000","last_peered":"2024-04-19T04:24:21.607445+0000","last_clean":"2024-04-19T04:24:21.607445+0000","last_became_active":"2024-04-19T04:24:20.551927+0000","last_became_peered":"2024-04-19T04:24:20.551927+0000","last_unstale":"2024-04-19T04:24:21.607445+0000","last_undegraded":"2024-04-19T04:24:21.607445+0000","last_fullsized":"2024-04-19T04:24:21.607445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:41.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608700+0000","last_change":"2024-04-19T04:24:20.179238+0000","last_active":"2024-04-19T04:24:21.608700+0000","last_peered":"2024-04-19T04:24:21.608700+0000","last_clean":"2024-04-19T04:24:21.608700+0000","last_became_active":"2024-04-19T04:24:20.178758+0000","last_became_peered":"2024-04-19T04:24:20.178758+0000","last_unstale":"2024-04-19T04:24:21.608700+0000","last_undegraded":"2024-04-19T04:24:21.608700+0000","last_fullsized":"2024-04-19T04:24:21.608700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:18:24.789775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537600+0000","last_change":"2024-04-19T04:24:20.554969+0000","last_active":"2024-04-19T04:24:21.537600+0000","last_peered":"2024-04-19T04:24:21.537600+0000","last_clean":"2024-04-19T04:24:21.537600+0000","last_became_active":"2024-04-19T04:24:20.554604+0000","last_became_peered":"2024-04-19T04:24:20.554604+0000","last_unstale":"2024-04-19T04:24:21.537600+0000","last_undegraded":"2024-04-19T04:24:21.537600+0000","last_fullsized":"2024-04-19T04:24:21.537600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:58:47.703110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538228+0000","last_change":"2024-04-19T04:24:20.178602+0000","last_active":"2024-04-19T04:24:21.538228+0000","last_peered":"2024-04-19T04:24:21.538228+0000","last_clean":"2024-04-19T04:24:21.538228+0000","last_became_active":"2024-04-19T04:24:20.177976+0000","last_became_peered":"2024-04-19T04:24:20.177976+0000","last_unstale":"2024-04-19T04:24:21.538228+0000","last_undegraded":"2024-04-19T04:24:21.538228+0000","last_fullsized":"2024-04-19T04:24:21.538228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:15.883790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608409+0000","last_change":"2024-04-19T04:24:20.548296+0000","last_active":"2024-04-19T04:24:21.608409+0000","last_peered":"2024-04-19T04:24:21.608409+0000","last_clean":"2024-04-19T04:24:21.608409+0000","last_became_active":"2024-04-19T04:24:20.547457+0000","last_became_peered":"2024-04-19T04:24:20.547457+0000","last_unstale":"2024-04-19T04:24:21.608409+0000","last_undegraded":"2024-04-19T04:24:21.608409+0000","last_fullsized":"2024-04-19T04:24:21.608409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:57.839930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607638+0000","last_change":"2024-04-19T04:24:20.184338+0000","last_active":"2024-04-19T04:24:21.607638+0000","last_peered":"2024-04-19T04:24:21.607638+0000","last_clean":"2024-04-19T04:24:21.607638+0000","last_became_active":"2024-04-19T04:24:20.183511+0000","last_became_peered":"2024-04-19T04:24:20.183511+0000","last_unstale":"2024-04-19T04:24:21.607638+0000","last_undegraded":"2024-04-19T04:24:21.607638+0000","last_fullsized":"2024-04-19T04:24:21.607638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:14.235823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608849+0000","last_change":"2024-04-19T04:24:20.555922+0000","last_active":"2024-04-19T04:24:21.608849+0000","last_peered":"2024-04-19T04:24:21.608849+0000","last_clean":"2024-04-19T04:24:21.608849+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:24:21.608849+0000","last_undegraded":"2024-04-19T04:24:21.608849+0000","last_fullsized":"2024-04-19T04:24:21.608849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:06:53.595149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540165+0000","last_change":"2024-04-19T04:24:20.183944+0000","last_active":"2024-04-19T04:24:21.540165+0000","last_peered":"2024-04-19T04:24:21.540165+0000","last_clean":"2024-04-19T04:24:21.540165+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:24:21.540165+0000","last_undegraded":"2024-04-19T04:24:21.540165+0000","last_fullsized":"2024-04-19T04:24:21.540165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:42.018487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608707+0000","last_change":"2024-04-19T04:24:20.553085+0000","last_active":"2024-04-19T04:24:21.608707+0000","last_peered":"2024-04-19T04:24:21.608707+0000","last_clean":"2024-04-19T04:24:21.608707+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:24:21.608707+0000","last_undegraded":"2024-04-19T04:24:21.608707+0000","last_fullsized":"2024-04-19T04:24:21.608707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:07:21.467758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539831+0000","last_change":"2024-04-19T04:24:20.180834+0000","last_active":"2024-04-19T04:24:21.539831+0000","last_peered":"2024-04-19T04:24:21.539831+0000","last_clean":"2024-04-19T04:24:21.539831+0000","last_became_active":"2024-04-19T04:24:20.180522+0000","last_became_peered":"2024-04-19T04:24:20.180522+0000","last_unstale":"2024-04-19T04:24:21.539831+0000","last_undegraded":"2024-04-19T04:24:21.539831+0000","last_fullsized":"2024-04-19T04:24:21.539831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:38:28.208268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538763+0000","last_change":"2024-04-19T04:24:20.547313+0000","last_active":"2024-04-19T04:24:21.538763+0000","last_peered":"2024-04-19T04:24:21.538763+0000","last_clean":"2024-04-19T04:24:21.538763+0000","last_became_active":"2024-04-19T04:24:20.545692+0000","last_became_peered":"2024-04-19T04:24:20.545692+0000","last_unstale":"2024-04-19T04:24:21.538763+0000","last_undegraded":"2024-04-19T04:24:21.538763+0000","last_fullsized":"2024-04-19T04:24:21.538763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:24:42.844961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.547904+0000","last_change":"2024-04-19T04:24:10.106278+0000","last_active":"2024-04-19T04:24:20.547904+0000","last_peered":"2024-04-19T04:24:20.547904+0000","last_clean":"2024-04-19T04:24:20.547904+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:24:20.547904+0000","last_undegraded":"2024-04-19T04:24:20.547904+0000","last_fullsized":"2024-04-19T04:24:20.547904+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_clean_scrub_stamp":"2024-04-19T04:24:09.083488+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.549706+0000","last_change":"2024-04-19T04:24:16.144872+0000","last_active":"2024-04-19T04:24:20.549706+0000","last_peered":"2024-04-19T04:24:20.549706+0000","last_clean":"2024-04-19T04:24:20.549706+0000","last_became_active":"2024-04-19T04:24:16.143778+0000","last_became_peered":"2024-04-19T04:24:16.143778+0000","last_unstale":"2024-04-19T04:24:20.549706+0000","last_undegraded":"2024-04-19T04:24:20.549706+0000","last_fullsized":"2024-04-19T04:24:20.549706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:26:06.303713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538038+0000","last_change":"2024-04-19T04:24:20.174958+0000","last_active":"2024-04-19T04:24:21.538038+0000","last_peered":"2024-04-19T04:24:21.538038+0000","last_clean":"2024-04-19T04:24:21.538038+0000","last_became_active":"2024-04-19T04:24:20.174643+0000","last_became_peered":"2024-04-19T04:24:20.174643+0000","last_unstale":"2024-04-19T04:24:21.538038+0000","last_undegraded":"2024-04-19T04:24:21.538038+0000","last_fullsized":"2024-04-19T04:24:21.538038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:37.752236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608950+0000","last_change":"2024-04-19T04:24:20.553999+0000","last_active":"2024-04-19T04:24:21.608950+0000","last_peered":"2024-04-19T04:24:21.608950+0000","last_clean":"2024-04-19T04:24:21.608950+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:24:21.608950+0000","last_undegraded":"2024-04-19T04:24:21.608950+0000","last_fullsized":"2024-04-19T04:24:21.608950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:13:53.306369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.546806+0000","last_change":"2024-04-19T04:24:16.144482+0000","last_active":"2024-04-19T04:24:20.546806+0000","last_peered":"2024-04-19T04:24:20.546806+0000","last_clean":"2024-04-19T04:24:20.546806+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:24:20.546806+0000","last_undegraded":"2024-04-19T04:24:20.546806+0000","last_fullsized":"2024-04-19T04:24:20.546806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:15.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537224+0000","last_change":"2024-04-19T04:24:20.179129+0000","last_active":"2024-04-19T04:24:21.537224+0000","last_peered":"2024-04-19T04:24:21.537224+0000","last_clean":"2024-04-19T04:24:21.537224+0000","last_became_active":"2024-04-19T04:24:20.178247+0000","last_became_peered":"2024-04-19T04:24:20.178247+0000","last_unstale":"2024-04-19T04:24:21.537224+0000","last_undegraded":"2024-04-19T04:24:21.537224+0000","last_fullsized":"2024-04-19T04:24:21.537224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:51.616306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541152+0000","last_change":"2024-04-19T04:24:20.550166+0000","last_active":"2024-04-19T04:24:21.541152+0000","last_peered":"2024-04-19T04:24:21.541152+0000","last_clean":"2024-04-19T04:24:21.541152+0000","last_became_active":"2024-04-19T04:24:20.549606+0000","last_became_peered":"2024-04-19T04:24:20.549606+0000","last_unstale":"2024-04-19T04:24:21.541152+0000","last_undegraded":"2024-04-19T04:24:21.541152+0000","last_fullsized":"2024-04-19T04:24:21.541152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:41.685120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.533460+0000","last_change":"2024-04-19T04:24:16.135584+0000","last_active":"2024-04-19T04:24:20.533460+0000","last_peered":"2024-04-19T04:24:20.533460+0000","last_clean":"2024-04-19T04:24:20.533460+0000","last_became_active":"2024-04-19T04:24:16.134799+0000","last_became_peered":"2024-04-19T04:24:16.134799+0000","last_unstale":"2024-04-19T04:24:20.533460+0000","last_undegraded":"2024-04-19T04:24:20.533460+0000","last_fullsized":"2024-04-19T04:24:20.533460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:55:57.442649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539948+0000","last_change":"2024-04-19T04:24:20.183933+0000","last_active":"2024-04-19T04:24:21.539948+0000","last_peered":"2024-04-19T04:24:21.539948+0000","last_clean":"2024-04-19T04:24:21.539948+0000","last_became_active":"2024-04-19T04:24:20.183490+0000","last_became_peered":"2024-04-19T04:24:20.183490+0000","last_unstale":"2024-04-19T04:24:21.539948+0000","last_undegraded":"2024-04-19T04:24:21.539948+0000","last_fullsized":"2024-04-19T04:24:21.539948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:43.869727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538758+0000","last_change":"2024-04-19T04:24:20.544687+0000","last_active":"2024-04-19T04:24:21.538758+0000","last_peered":"2024-04-19T04:24:21.538758+0000","last_clean":"2024-04-19T04:24:21.538758+0000","last_became_active":"2024-04-19T04:24:20.544430+0000","last_became_peered":"2024-04-19T04:24:20.544430+0000","last_unstale":"2024-04-19T04:24:21.538758+0000","last_undegraded":"2024-04-19T04:24:21.538758+0000","last_fullsized":"2024-04-19T04:24:21.538758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:11:22.765812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.548059+0000","last_change":"2024-04-19T04:24:16.145124+0000","last_active":"2024-04-19T04:24:20.548059+0000","last_peered":"2024-04-19T04:24:20.548059+0000","last_clean":"2024-04-19T04:24:20.548059+0000","last_became_active":"2024-04-19T04:24:16.143949+0000","last_became_peered":"2024-04-19T04:24:16.143949+0000","last_unstale":"2024-04-19T04:24:20.548059+0000","last_undegraded":"2024-04-19T04:24:20.548059+0000","last_fullsized":"2024-04-19T04:24:20.548059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:18.901615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608836+0000","last_change":"2024-04-19T04:24:20.179004+0000","last_active":"2024-04-19T04:24:21.608836+0000","last_peered":"2024-04-19T04:24:21.608836+0000","last_clean":"2024-04-19T04:24:21.608836+0000","last_became_active":"2024-04-19T04:24:20.178123+0000","last_became_peered":"2024-04-19T04:24:20.178123+0000","last_unstale":"2024-04-19T04:24:21.608836+0000","last_undegraded":"2024-04-19T04:24:21.608836+0000","last_fullsized":"2024-04-19T04:24:21.608836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:35:25.084528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538611+0000","last_change":"2024-04-19T04:24:20.544312+0000","last_active":"2024-04-19T04:24:21.538611+0000","last_peered":"2024-04-19T04:24:21.538611+0000","last_clean":"2024-04-19T04:24:21.538611+0000","last_became_active":"2024-04-19T04:24:20.543738+0000","last_became_peered":"2024-04-19T04:24:20.543738+0000","last_unstale":"2024-04-19T04:24:21.538611+0000","last_undegraded":"2024-04-19T04:24:21.538611+0000","last_fullsized":"2024-04-19T04:24:21.538611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:23.486532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609184+0000","last_change":"2024-04-19T04:24:20.184349+0000","last_active":"2024-04-19T04:24:21.609184+0000","last_peered":"2024-04-19T04:24:21.609184+0000","last_clean":"2024-04-19T04:24:21.609184+0000","last_became_active":"2024-04-19T04:24:20.183495+0000","last_became_peered":"2024-04-19T04:24:20.183495+0000","last_unstale":"2024-04-19T04:24:21.609184+0000","last_undegraded":"2024-04-19T04:24:21.609184+0000","last_fullsized":"2024-04-19T04:24:21.609184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:16:09.571178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.531994+0000","last_change":"2024-04-19T04:24:16.136119+0000","last_active":"2024-04-19T04:24:20.531994+0000","last_peered":"2024-04-19T04:24:20.531994+0000","last_clean":"2024-04-19T04:24:20.531994+0000","last_became_active":"2024-04-19T04:24:16.135272+0000","last_became_peered":"2024-04-19T04:24:16.135272+0000","last_unstale":"2024-04-19T04:24:20.531994+0000","last_undegraded":"2024-04-19T04:24:20.531994+0000","last_fullsized":"2024-04-19T04:24:20.531994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:07:14.180095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540172+0000","last_change":"2024-04-19T04:24:20.555116+0000","last_active":"2024-04-19T04:24:21.540172+0000","last_peered":"2024-04-19T04:24:21.540172+0000","last_clean":"2024-04-19T04:24:21.540172+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:24:21.540172+0000","last_undegraded":"2024-04-19T04:24:21.540172+0000","last_fullsized":"2024-04-19T04:24:21.540172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:21.734428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538645+0000","last_change":"2024-04-19T04:24:20.174833+0000","last_active":"2024-04-19T04:24:21.538645+0000","last_peered":"2024-04-19T04:24:21.538645+0000","last_clean":"2024-04-19T04:24:21.538645+0000","last_became_active":"2024-04-19T04:24:20.174517+0000","last_became_peered":"2024-04-19T04:24:20.174517+0000","last_unstale":"2024-04-19T04:24:21.538645+0000","last_undegraded":"2024-04-19T04:24:21.538645+0000","last_fullsized":"2024-04-19T04:24:21.538645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:51.699530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.536090+0000","last_change":"2024-04-19T04:24:16.141899+0000","last_active":"2024-04-19T04:24:20.536090+0000","last_peered":"2024-04-19T04:24:20.536090+0000","last_clean":"2024-04-19T04:24:20.536090+0000","last_became_active":"2024-04-19T04:24:16.141508+0000","last_became_peered":"2024-04-19T04:24:16.141508+0000","last_unstale":"2024-04-19T04:24:20.536090+0000","last_undegraded":"2024-04-19T04:24:20.536090+0000","last_fullsized":"2024-04-19T04:24:20.536090+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:31.719446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540502+0000","last_change":"2024-04-19T04:24:20.558559+0000","last_active":"2024-04-19T04:24:21.540502+0000","last_peered":"2024-04-19T04:24:21.540502+0000","last_clean":"2024-04-19T04:24:21.540502+0000","last_became_active":"2024-04-19T04:24:20.558215+0000","last_became_peered":"2024-04-19T04:24:20.558215+0000","last_unstale":"2024-04-19T04:24:21.540502+0000","last_undegraded":"2024-04-19T04:24:21.540502+0000","last_fullsized":"2024-04-19T04:24:21.540502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:41.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539118+0000","last_change":"2024-04-19T04:24:20.175205+0000","last_active":"2024-04-19T04:24:21.539118+0000","last_peered":"2024-04-19T04:24:21.539118+0000","last_clean":"2024-04-19T04:24:21.539118+0000","last_became_active":"2024-04-19T04:24:20.174912+0000","last_became_peered":"2024-04-19T04:24:20.174912+0000","last_unstale":"2024-04-19T04:24:21.539118+0000","last_undegraded":"2024-04-19T04:24:21.539118+0000","last_fullsized":"2024-04-19T04:24:21.539118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:21:37.681287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.533233+0000","last_change":"2024-04-19T04:24:16.135892+0000","last_active":"2024-04-19T04:24:20.533233+0000","last_peered":"2024-04-19T04:24:20.533233+0000","last_clean":"2024-04-19T04:24:20.533233+0000","last_became_active":"2024-04-19T04:24:16.135385+0000","last_became_peered":"2024-04-19T04:24:16.135385+0000","last_unstale":"2024-04-19T04:24:20.533233+0000","last_undegraded":"2024-04-19T04:24:20.533233+0000","last_fullsized":"2024-04-19T04:24:20.533233+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:37.110319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536977+0000","last_change":"2024-04-19T04:24:20.553486+0000","last_active":"2024-04-19T04:24:21.536977+0000","last_peered":"2024-04-19T04:24:21.536977+0000","last_clean":"2024-04-19T04:24:21.536977+0000","last_became_active":"2024-04-19T04:24:20.553206+0000","last_became_peered":"2024-04-19T04:24:20.553206+0000","last_unstale":"2024-04-19T04:24:21.536977+0000","last_undegraded":"2024-04-19T04:24:21.536977+0000","last_fullsized":"2024-04-19T04:24:21.536977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:32.648637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538916+0000","last_change":"2024-04-19T04:24:20.178880+0000","last_active":"2024-04-19T04:24:21.538916+0000","last_peered":"2024-04-19T04:24:21.538916+0000","last_clean":"2024-04-19T04:24:21.538916+0000","last_became_active":"2024-04-19T04:24:20.177593+0000","last_became_peered":"2024-04-19T04:24:20.177593+0000","last_unstale":"2024-04-19T04:24:21.538916+0000","last_undegraded":"2024-04-19T04:24:21.538916+0000","last_fullsized":"2024-04-19T04:24:21.538916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:58:32.732477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.549281+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:24:20.549281+0000","last_peered":"2024-04-19T04:24:20.549281+0000","last_clean":"2024-04-19T04:24:20.549281+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:24:20.549281+0000","last_undegraded":"2024-04-19T04:24:20.549281+0000","last_fullsized":"2024-04-19T04:24:20.549281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:45.574813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539891+0000","last_change":"2024-04-19T04:24:20.554721+0000","last_active":"2024-04-19T04:24:21.539891+0000","last_peered":"2024-04-19T04:24:21.539891+0000","last_clean":"2024-04-19T04:24:21.539891+0000","last_became_active":"2024-04-19T04:24:20.554286+0000","last_became_peered":"2024-04-19T04:24:20.554286+0000","last_unstale":"2024-04-19T04:24:21.539891+0000","last_undegraded":"2024-04-19T04:24:21.539891+0000","last_fullsized":"2024-04-19T04:24:21.539891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:14.194572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608106+0000","last_change":"2024-04-19T04:24:20.555406+0000","last_active":"2024-04-19T04:24:21.608106+0000","last_peered":"2024-04-19T04:24:21.608106+0000","last_clean":"2024-04-19T04:24:21.608106+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:24:21.608106+0000","last_undegraded":"2024-04-19T04:24:21.608106+0000","last_fullsized":"2024-04-19T04:24:21.608106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:10.453970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608703+0000","last_change":"2024-04-19T04:24:20.185978+0000","last_active":"2024-04-19T04:24:21.608703+0000","last_peered":"2024-04-19T04:24:21.608703+0000","last_clean":"2024-04-19T04:24:21.608703+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:24:21.608703+0000","last_undegraded":"2024-04-19T04:24:21.608703+0000","last_fullsized":"2024-04-19T04:24:21.608703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:48.158805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537416+0000","last_change":"2024-04-19T04:24:20.544323+0000","last_active":"2024-04-19T04:24:21.537416+0000","last_peered":"2024-04-19T04:24:21.537416+0000","last_clean":"2024-04-19T04:24:21.537416+0000","last_became_active":"2024-04-19T04:24:20.543893+0000","last_became_peered":"2024-04-19T04:24:20.543893+0000","last_unstale":"2024-04-19T04:24:21.537416+0000","last_undegraded":"2024-04-19T04:24:21.537416+0000","last_fullsized":"2024-04-19T04:24:21.537416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:01.587027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.542097+0000","last_change":"2024-04-19T04:24:20.184342+0000","last_active":"2024-04-19T04:24:21.542097+0000","last_peered":"2024-04-19T04:24:21.542097+0000","last_clean":"2024-04-19T04:24:21.542097+0000","last_became_active":"2024-04-19T04:24:20.183970+0000","last_became_peered":"2024-04-19T04:24:20.183970+0000","last_unstale":"2024-04-19T04:24:21.542097+0000","last_undegraded":"2024-04-19T04:24:21.542097+0000","last_fullsized":"2024-04-19T04:24:21.542097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:46.956957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609216+0000","last_change":"2024-04-19T04:24:20.184508+0000","last_active":"2024-04-19T04:24:21.609216+0000","last_peered":"2024-04-19T04:24:21.609216+0000","last_clean":"2024-04-19T04:24:21.609216+0000","last_became_active":"2024-04-19T04:24:20.184060+0000","last_became_peered":"2024-04-19T04:24:20.184060+0000","last_unstale":"2024-04-19T04:24:21.609216+0000","last_undegraded":"2024-04-19T04:24:21.609216+0000","last_fullsized":"2024-04-19T04:24:21.609216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:14:57.634877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537342+0000","last_change":"2024-04-19T04:24:20.546949+0000","last_active":"2024-04-19T04:24:21.537342+0000","last_peered":"2024-04-19T04:24:21.537342+0000","last_clean":"2024-04-19T04:24:21.537342+0000","last_became_active":"2024-04-19T04:24:20.546029+0000","last_became_peered":"2024-04-19T04:24:20.546029+0000","last_unstale":"2024-04-19T04:24:21.537342+0000","last_undegraded":"2024-04-19T04:24:21.537342+0000","last_fullsized":"2024-04-19T04:24:21.537342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:22:06.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539031+0000","last_change":"2024-04-19T04:24:20.178672+0000","last_active":"2024-04-19T04:24:21.539031+0000","last_peered":"2024-04-19T04:24:21.539031+0000","last_clean":"2024-04-19T04:24:21.539031+0000","last_became_active":"2024-04-19T04:24:20.177921+0000","last_became_peered":"2024-04-19T04:24:20.177921+0000","last_unstale":"2024-04-19T04:24:21.539031+0000","last_undegraded":"2024-04-19T04:24:21.539031+0000","last_fullsized":"2024-04-19T04:24:21.539031+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:21.042990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536875+0000","last_change":"2024-04-19T04:24:20.546616+0000","last_active":"2024-04-19T04:24:21.536875+0000","last_peered":"2024-04-19T04:24:21.536875+0000","last_clean":"2024-04-19T04:24:21.536875+0000","last_became_active":"2024-04-19T04:24:20.546032+0000","last_became_peered":"2024-04-19T04:24:20.546032+0000","last_unstale":"2024-04-19T04:24:21.536875+0000","last_undegraded":"2024-04-19T04:24:21.536875+0000","last_fullsized":"2024-04-19T04:24:21.536875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:02:20.398899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541610+0000","last_change":"2024-04-19T04:24:20.552644+0000","last_active":"2024-04-19T04:24:21.541610+0000","last_peered":"2024-04-19T04:24:21.541610+0000","last_clean":"2024-04-19T04:24:21.541610+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:24:21.541610+0000","last_undegraded":"2024-04-19T04:24:21.541610+0000","last_fullsized":"2024-04-19T04:24:21.541610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537050+0000","last_change":"2024-04-19T04:24:20.174912+0000","last_active":"2024-04-19T04:24:21.537050+0000","last_peered":"2024-04-19T04:24:21.537050+0000","last_clean":"2024-04-19T04:24:21.537050+0000","last_became_active":"2024-04-19T04:24:20.174629+0000","last_became_peered":"2024-04-19T04:24:20.174629+0000","last_unstale":"2024-04-19T04:24:21.537050+0000","last_undegraded":"2024-04-19T04:24:21.537050+0000","last_fullsized":"2024-04-19T04:24:21.537050+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:09:12.929115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538272+0000","last_change":"2024-04-19T04:24:20.549484+0000","last_active":"2024-04-19T04:24:21.538272+0000","last_peered":"2024-04-19T04:24:21.538272+0000","last_clean":"2024-04-19T04:24:21.538272+0000","last_became_active":"2024-04-19T04:24:20.549149+0000","last_became_peered":"2024-04-19T04:24:20.549149+0000","last_unstale":"2024-04-19T04:24:21.538272+0000","last_undegraded":"2024-04-19T04:24:21.538272+0000","last_fullsized":"2024-04-19T04:24:21.538272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:49.148982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537100+0000","last_change":"2024-04-19T04:24:20.178730+0000","last_active":"2024-04-19T04:24:21.537100+0000","last_peered":"2024-04-19T04:24:21.537100+0000","last_clean":"2024-04-19T04:24:21.537100+0000","last_became_active":"2024-04-19T04:24:20.177996+0000","last_became_peered":"2024-04-19T04:24:20.177996+0000","last_unstale":"2024-04-19T04:24:21.537100+0000","last_undegraded":"2024-04-19T04:24:21.537100+0000","last_fullsized":"2024-04-19T04:24:21.537100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:27:46.704368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541658+0000","last_change":"2024-04-19T04:24:20.556092+0000","last_active":"2024-04-19T04:24:21.541658+0000","last_peered":"2024-04-19T04:24:21.541658+0000","last_clean":"2024-04-19T04:24:21.541658+0000","last_became_active":"2024-04-19T04:24:20.555928+0000","last_became_peered":"2024-04-19T04:24:20.555928+0000","last_unstale":"2024-04-19T04:24:21.541658+0000","last_undegraded":"2024-04-19T04:24:21.541658+0000","last_fullsized":"2024-04-19T04:24:21.541658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:12.211801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540632+0000","last_change":"2024-04-19T04:24:20.179779+0000","last_active":"2024-04-19T04:24:21.540632+0000","last_peered":"2024-04-19T04:24:21.540632+0000","last_clean":"2024-04-19T04:24:21.540632+0000","last_became_active":"2024-04-19T04:24:20.179457+0000","last_became_peered":"2024-04-19T04:24:20.179457+0000","last_unstale":"2024-04-19T04:24:21.540632+0000","last_undegraded":"2024-04-19T04:24:21.540632+0000","last_fullsized":"2024-04-19T04:24:21.540632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:27:04.757759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541223+0000","last_change":"2024-04-19T04:24:20.546222+0000","last_active":"2024-04-19T04:24:21.541223+0000","last_peered":"2024-04-19T04:24:21.541223+0000","last_clean":"2024-04-19T04:24:21.541223+0000","last_became_active":"2024-04-19T04:24:20.545395+0000","last_became_peered":"2024-04-19T04:24:20.545395+0000","last_unstale":"2024-04-19T04:24:21.541223+0000","last_undegraded":"2024-04-19T04:24:21.541223+0000","last_fullsized":"2024-04-19T04:24:21.541223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:56.201003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540715+0000","last_change":"2024-04-19T04:24:20.184108+0000","last_active":"2024-04-19T04:24:21.540715+0000","last_peered":"2024-04-19T04:24:21.540715+0000","last_clean":"2024-04-19T04:24:21.540715+0000","last_became_active":"2024-04-19T04:24:20.183677+0000","last_became_peered":"2024-04-19T04:24:20.183677+0000","last_unstale":"2024-04-19T04:24:21.540715+0000","last_undegraded":"2024-04-19T04:24:21.540715+0000","last_fullsized":"2024-04-19T04:24:21.540715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:06.185573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607906+0000","last_change":"2024-04-19T04:24:20.556556+0000","last_active":"2024-04-19T04:24:21.607906+0000","last_peered":"2024-04-19T04:24:21.607906+0000","last_clean":"2024-04-19T04:24:21.607906+0000","last_became_active":"2024-04-19T04:24:20.555286+0000","last_became_peered":"2024-04-19T04:24:20.555286+0000","last_unstale":"2024-04-19T04:24:21.607906+0000","last_undegraded":"2024-04-19T04:24:21.607906+0000","last_fullsized":"2024-04-19T04:24:21.607906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:18:50.807364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608430+0000","last_change":"2024-04-19T04:24:20.184583+0000","last_active":"2024-04-19T04:24:21.608430+0000","last_peered":"2024-04-19T04:24:21.608430+0000","last_clean":"2024-04-19T04:24:21.608430+0000","last_became_active":"2024-04-19T04:24:20.183933+0000","last_became_peered":"2024-04-19T04:24:20.183933+0000","last_unstale":"2024-04-19T04:24:21.608430+0000","last_undegraded":"2024-04-19T04:24:21.608430+0000","last_fullsized":"2024-04-19T04:24:21.608430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:24.424300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607603+0000","last_change":"2024-04-19T04:24:20.550606+0000","last_active":"2024-04-19T04:24:21.607603+0000","last_peered":"2024-04-19T04:24:21.607603+0000","last_clean":"2024-04-19T04:24:21.607603+0000","last_became_active":"2024-04-19T04:24:20.548990+0000","last_became_peered":"2024-04-19T04:24:20.548990+0000","last_unstale":"2024-04-19T04:24:21.607603+0000","last_undegraded":"2024-04-19T04:24:21.607603+0000","last_fullsized":"2024-04-19T04:24:21.607603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:31:52.562663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541997+0000","last_change":"2024-04-19T04:24:20.184190+0000","last_active":"2024-04-19T04:24:21.541997+0000","last_peered":"2024-04-19T04:24:21.541997+0000","last_clean":"2024-04-19T04:24:21.541997+0000","last_became_active":"2024-04-19T04:24:20.183869+0000","last_became_peered":"2024-04-19T04:24:20.183869+0000","last_unstale":"2024-04-19T04:24:21.541997+0000","last_undegraded":"2024-04-19T04:24:21.541997+0000","last_fullsized":"2024-04-19T04:24:21.541997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:13:48.624837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540713+0000","last_change":"2024-04-19T04:24:20.546603+0000","last_active":"2024-04-19T04:24:21.540713+0000","last_peered":"2024-04-19T04:24:21.540713+0000","last_clean":"2024-04-19T04:24:21.540713+0000","last_became_active":"2024-04-19T04:24:20.546136+0000","last_became_peered":"2024-04-19T04:24:20.546136+0000","last_unstale":"2024-04-19T04:24:21.540713+0000","last_undegraded":"2024-04-19T04:24:21.540713+0000","last_fullsized":"2024-04-19T04:24:21.540713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:20.610726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538747+0000","last_change":"2024-04-19T04:24:20.178148+0000","last_active":"2024-04-19T04:24:21.538747+0000","last_peered":"2024-04-19T04:24:21.538747+0000","last_clean":"2024-04-19T04:24:21.538747+0000","last_became_active":"2024-04-19T04:24:20.177382+0000","last_became_peered":"2024-04-19T04:24:20.177382+0000","last_unstale":"2024-04-19T04:24:21.538747+0000","last_undegraded":"2024-04-19T04:24:21.538747+0000","last_fullsized":"2024-04-19T04:24:21.538747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:03.585052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607131+0000","last_change":"2024-04-19T04:24:20.556288+0000","last_active":"2024-04-19T04:24:21.607131+0000","last_peered":"2024-04-19T04:24:21.607131+0000","last_clean":"2024-04-19T04:24:21.607131+0000","last_became_active":"2024-04-19T04:24:20.554960+0000","last_became_peered":"2024-04-19T04:24:20.554960+0000","last_unstale":"2024-04-19T04:24:21.607131+0000","last_undegraded":"2024-04-19T04:24:21.607131+0000","last_fullsized":"2024-04-19T04:24:21.607131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:27.393720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538917+0000","last_change":"2024-04-19T04:24:20.180873+0000","last_active":"2024-04-19T04:24:21.538917+0000","last_peered":"2024-04-19T04:24:21.538917+0000","last_clean":"2024-04-19T04:24:21.538917+0000","last_became_active":"2024-04-19T04:24:20.180584+0000","last_became_peered":"2024-04-19T04:24:20.180584+0000","last_unstale":"2024-04-19T04:24:21.538917+0000","last_undegraded":"2024-04-19T04:24:21.538917+0000","last_fullsized":"2024-04-19T04:24:21.538917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:43:03.367159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":253952,"data_stored":649246,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31296,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340544,"statfs":{"total":96636764160,"available":96604717056,"internally_reserved":0,"allocated":172032,"data_stored":57748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":649862,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:24:28.037 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:24:28.358 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:28.360 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:24:28.371 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-19T04:24:26.872254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94032,"kb_used_data":672,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021488,"statfs":{"total":289910292480,"available":289814003712,"internally_reserved":0,"allocated":688128,"data_stored":1356856,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.711999"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541340+0000","last_change":"2024-04-19T04:24:20.550082+0000","last_active":"2024-04-19T04:24:21.541340+0000","last_peered":"2024-04-19T04:24:21.541340+0000","last_clean":"2024-04-19T04:24:21.541340+0000","last_became_active":"2024-04-19T04:24:20.549529+0000","last_became_peered":"2024-04-19T04:24:20.549529+0000","last_unstale":"2024-04-19T04:24:21.541340+0000","last_undegraded":"2024-04-19T04:24:21.541340+0000","last_fullsized":"2024-04-19T04:24:21.541340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:27.393720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540906+0000","last_change":"2024-04-19T04:24:20.545709+0000","last_active":"2024-04-19T04:24:21.540906+0000","last_peered":"2024-04-19T04:24:21.540906+0000","last_clean":"2024-04-19T04:24:21.540906+0000","last_became_active":"2024-04-19T04:24:20.544962+0000","last_became_peered":"2024-04-19T04:24:20.544962+0000","last_unstale":"2024-04-19T04:24:21.540906+0000","last_undegraded":"2024-04-19T04:24:21.540906+0000","last_fullsized":"2024-04-19T04:24:21.540906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:06.452910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608479+0000","last_change":"2024-04-19T04:24:20.556199+0000","last_active":"2024-04-19T04:24:21.608479+0000","last_peered":"2024-04-19T04:24:21.608479+0000","last_clean":"2024-04-19T04:24:21.608479+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:24:21.608479+0000","last_undegraded":"2024-04-19T04:24:21.608479+0000","last_fullsized":"2024-04-19T04:24:21.608479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:14.348910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608071+0000","last_change":"2024-04-19T04:24:20.552787+0000","last_active":"2024-04-19T04:24:21.608071+0000","last_peered":"2024-04-19T04:24:21.608071+0000","last_clean":"2024-04-19T04:24:21.608071+0000","last_became_active":"2024-04-19T04:24:20.551784+0000","last_became_peered":"2024-04-19T04:24:20.551784+0000","last_unstale":"2024-04-19T04:24:21.608071+0000","last_undegraded":"2024-04-19T04:24:21.608071+0000","last_fullsized":"2024-04-19T04:24:21.608071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:21.734428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541302+0000","last_change":"2024-04-19T04:24:20.550112+0000","last_active":"2024-04-19T04:24:21.541302+0000","last_peered":"2024-04-19T04:24:21.541302+0000","last_clean":"2024-04-19T04:24:21.541302+0000","last_became_active":"2024-04-19T04:24:20.549620+0000","last_became_peered":"2024-04-19T04:24:20.549620+0000","last_unstale":"2024-04-19T04:24:21.541302+0000","last_undegraded":"2024-04-19T04:24:21.541302+0000","last_fullsized":"2024-04-19T04:24:21.541302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:03:50.416299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607265+0000","last_change":"2024-04-19T04:24:20.551576+0000","last_active":"2024-04-19T04:24:21.607265+0000","last_peered":"2024-04-19T04:24:21.607265+0000","last_clean":"2024-04-19T04:24:21.607265+0000","last_became_active":"2024-04-19T04:24:20.548600+0000","last_became_peered":"2024-04-19T04:24:20.548600+0000","last_unstale":"2024-04-19T04:24:21.607265+0000","last_undegraded":"2024-04-19T04:24:21.607265+0000","last_fullsized":"2024-04-19T04:24:21.607265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:39.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607230+0000","last_change":"2024-04-19T04:24:20.550337+0000","last_active":"2024-04-19T04:24:21.607230+0000","last_peered":"2024-04-19T04:24:21.607230+0000","last_clean":"2024-04-19T04:24:21.607230+0000","last_became_active":"2024-04-19T04:24:20.548514+0000","last_became_peered":"2024-04-19T04:24:20.548514+0000","last_unstale":"2024-04-19T04:24:21.607230+0000","last_undegraded":"2024-04-19T04:24:21.607230+0000","last_fullsized":"2024-04-19T04:24:21.607230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:14.194572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606529+0000","last_change":"2024-04-19T04:24:20.553787+0000","last_active":"2024-04-19T04:24:21.606529+0000","last_peered":"2024-04-19T04:24:21.606529+0000","last_clean":"2024-04-19T04:24:21.606529+0000","last_became_active":"2024-04-19T04:24:20.553410+0000","last_became_peered":"2024-04-19T04:24:20.553410+0000","last_unstale":"2024-04-19T04:24:21.606529+0000","last_undegraded":"2024-04-19T04:24:21.606529+0000","last_fullsized":"2024-04-19T04:24:21.606529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:00.475711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538444+0000","last_change":"2024-04-19T04:24:20.547585+0000","last_active":"2024-04-19T04:24:21.538444+0000","last_peered":"2024-04-19T04:24:21.538444+0000","last_clean":"2024-04-19T04:24:21.538444+0000","last_became_active":"2024-04-19T04:24:20.547395+0000","last_became_peered":"2024-04-19T04:24:20.547395+0000","last_unstale":"2024-04-19T04:24:21.538444+0000","last_undegraded":"2024-04-19T04:24:21.538444+0000","last_fullsized":"2024-04-19T04:24:21.538444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:15.398090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540977+0000","last_change":"2024-04-19T04:24:20.546893+0000","last_active":"2024-04-19T04:24:21.540977+0000","last_peered":"2024-04-19T04:24:21.540977+0000","last_clean":"2024-04-19T04:24:21.540977+0000","last_became_active":"2024-04-19T04:24:20.546257+0000","last_became_peered":"2024-04-19T04:24:20.546257+0000","last_unstale":"2024-04-19T04:24:21.540977+0000","last_undegraded":"2024-04-19T04:24:21.540977+0000","last_fullsized":"2024-04-19T04:24:21.540977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:47.327841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608401+0000","last_change":"2024-04-19T04:24:20.556382+0000","last_active":"2024-04-19T04:24:21.608401+0000","last_peered":"2024-04-19T04:24:21.608401+0000","last_clean":"2024-04-19T04:24:21.608401+0000","last_became_active":"2024-04-19T04:24:20.555246+0000","last_became_peered":"2024-04-19T04:24:20.555246+0000","last_unstale":"2024-04-19T04:24:21.608401+0000","last_undegraded":"2024-04-19T04:24:21.608401+0000","last_fullsized":"2024-04-19T04:24:21.608401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:37:15.332493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540961+0000","last_change":"2024-04-19T04:24:20.558886+0000","last_active":"2024-04-19T04:24:21.540961+0000","last_peered":"2024-04-19T04:24:21.540961+0000","last_clean":"2024-04-19T04:24:21.540961+0000","last_became_active":"2024-04-19T04:24:20.558293+0000","last_became_peered":"2024-04-19T04:24:20.558293+0000","last_unstale":"2024-04-19T04:24:21.540961+0000","last_undegraded":"2024-04-19T04:24:21.540961+0000","last_fullsized":"2024-04-19T04:24:21.540961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:37:15.332493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540418+0000","last_change":"2024-04-19T04:24:20.545891+0000","last_active":"2024-04-19T04:24:21.540418+0000","last_peered":"2024-04-19T04:24:21.540418+0000","last_clean":"2024-04-19T04:24:21.540418+0000","last_became_active":"2024-04-19T04:24:20.545422+0000","last_became_peered":"2024-04-19T04:24:20.545422+0000","last_unstale":"2024-04-19T04:24:21.540418+0000","last_undegraded":"2024-04-19T04:24:21.540418+0000","last_fullsized":"2024-04-19T04:24:21.540418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:31:52.562663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607344+0000","last_change":"2024-04-19T04:24:20.552690+0000","last_active":"2024-04-19T04:24:21.607344+0000","last_peered":"2024-04-19T04:24:21.607344+0000","last_clean":"2024-04-19T04:24:21.607344+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:24:21.607344+0000","last_undegraded":"2024-04-19T04:24:21.607344+0000","last_fullsized":"2024-04-19T04:24:21.607344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:53:16.890992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607404+0000","last_change":"2024-04-19T04:24:20.551809+0000","last_active":"2024-04-19T04:24:21.607404+0000","last_peered":"2024-04-19T04:24:21.607404+0000","last_clean":"2024-04-19T04:24:21.607404+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:24:21.607404+0000","last_undegraded":"2024-04-19T04:24:21.607404+0000","last_fullsized":"2024-04-19T04:24:21.607404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:43:31.281765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606723+0000","last_change":"2024-04-19T04:24:20.552758+0000","last_active":"2024-04-19T04:24:21.606723+0000","last_peered":"2024-04-19T04:24:21.606723+0000","last_clean":"2024-04-19T04:24:21.606723+0000","last_became_active":"2024-04-19T04:24:20.548882+0000","last_became_peered":"2024-04-19T04:24:20.548882+0000","last_unstale":"2024-04-19T04:24:21.606723+0000","last_undegraded":"2024-04-19T04:24:21.606723+0000","last_fullsized":"2024-04-19T04:24:21.606723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:56.738569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539114+0000","last_change":"2024-04-19T04:24:20.546173+0000","last_active":"2024-04-19T04:24:21.539114+0000","last_peered":"2024-04-19T04:24:21.539114+0000","last_clean":"2024-04-19T04:24:21.539114+0000","last_became_active":"2024-04-19T04:24:20.545582+0000","last_became_peered":"2024-04-19T04:24:20.545582+0000","last_unstale":"2024-04-19T04:24:21.539114+0000","last_undegraded":"2024-04-19T04:24:21.539114+0000","last_fullsized":"2024-04-19T04:24:21.539114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:55.955786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541323+0000","last_change":"2024-04-19T04:24:20.549835+0000","last_active":"2024-04-19T04:24:21.541323+0000","last_peered":"2024-04-19T04:24:21.541323+0000","last_clean":"2024-04-19T04:24:21.541323+0000","last_became_active":"2024-04-19T04:24:20.549411+0000","last_became_peered":"2024-04-19T04:24:20.549411+0000","last_unstale":"2024-04-19T04:24:21.541323+0000","last_undegraded":"2024-04-19T04:24:21.541323+0000","last_fullsized":"2024-04-19T04:24:21.541323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:31:11.088424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538186+0000","last_change":"2024-04-19T04:24:20.546517+0000","last_active":"2024-04-19T04:24:21.538186+0000","last_peered":"2024-04-19T04:24:21.538186+0000","last_clean":"2024-04-19T04:24:21.538186+0000","last_became_active":"2024-04-19T04:24:20.546116+0000","last_became_peered":"2024-04-19T04:24:20.546116+0000","last_unstale":"2024-04-19T04:24:21.538186+0000","last_undegraded":"2024-04-19T04:24:21.538186+0000","last_fullsized":"2024-04-19T04:24:21.538186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:28:06.813455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608191+0000","last_change":"2024-04-19T04:24:20.551326+0000","last_active":"2024-04-19T04:24:21.608191+0000","last_peered":"2024-04-19T04:24:21.608191+0000","last_clean":"2024-04-19T04:24:21.608191+0000","last_became_active":"2024-04-19T04:24:20.550246+0000","last_became_peered":"2024-04-19T04:24:20.550246+0000","last_unstale":"2024-04-19T04:24:21.608191+0000","last_undegraded":"2024-04-19T04:24:21.608191+0000","last_fullsized":"2024-04-19T04:24:21.608191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:12.211801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608194+0000","last_change":"2024-04-19T04:24:20.556352+0000","last_active":"2024-04-19T04:24:21.608194+0000","last_peered":"2024-04-19T04:24:21.608194+0000","last_clean":"2024-04-19T04:24:21.608194+0000","last_became_active":"2024-04-19T04:24:20.554294+0000","last_became_peered":"2024-04-19T04:24:20.554294+0000","last_unstale":"2024-04-19T04:24:21.608194+0000","last_undegraded":"2024-04-19T04:24:21.608194+0000","last_fullsized":"2024-04-19T04:24:21.608194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:06.452910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540048+0000","last_change":"2024-04-19T04:24:20.555257+0000","last_active":"2024-04-19T04:24:21.540048+0000","last_peered":"2024-04-19T04:24:21.540048+0000","last_clean":"2024-04-19T04:24:21.540048+0000","last_became_active":"2024-04-19T04:24:20.554895+0000","last_became_peered":"2024-04-19T04:24:20.554895+0000","last_unstale":"2024-04-19T04:24:21.540048+0000","last_undegraded":"2024-04-19T04:24:21.540048+0000","last_fullsized":"2024-04-19T04:24:21.540048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:39.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536664+0000","last_change":"2024-04-19T04:24:20.549936+0000","last_active":"2024-04-19T04:24:21.536664+0000","last_peered":"2024-04-19T04:24:21.536664+0000","last_clean":"2024-04-19T04:24:21.536664+0000","last_became_active":"2024-04-19T04:24:20.549428+0000","last_became_peered":"2024-04-19T04:24:20.549428+0000","last_unstale":"2024-04-19T04:24:21.536664+0000","last_undegraded":"2024-04-19T04:24:21.536664+0000","last_fullsized":"2024-04-19T04:24:21.536664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:44:47.158480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539602+0000","last_change":"2024-04-19T04:24:20.546315+0000","last_active":"2024-04-19T04:24:21.539602+0000","last_peered":"2024-04-19T04:24:21.539602+0000","last_clean":"2024-04-19T04:24:21.539602+0000","last_became_active":"2024-04-19T04:24:20.545851+0000","last_became_peered":"2024-04-19T04:24:20.545851+0000","last_unstale":"2024-04-19T04:24:21.539602+0000","last_undegraded":"2024-04-19T04:24:21.539602+0000","last_fullsized":"2024-04-19T04:24:21.539602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:07:48.905896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541518+0000","last_change":"2024-04-19T04:24:20.554855+0000","last_active":"2024-04-19T04:24:21.541518+0000","last_peered":"2024-04-19T04:24:21.541518+0000","last_clean":"2024-04-19T04:24:21.541518+0000","last_became_active":"2024-04-19T04:24:20.554383+0000","last_became_peered":"2024-04-19T04:24:20.554383+0000","last_unstale":"2024-04-19T04:24:21.541518+0000","last_undegraded":"2024-04-19T04:24:21.541518+0000","last_fullsized":"2024-04-19T04:24:21.541518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:18:50.807364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538534+0000","last_change":"2024-04-19T04:24:20.546410+0000","last_active":"2024-04-19T04:24:21.538534+0000","last_peered":"2024-04-19T04:24:21.538534+0000","last_clean":"2024-04-19T04:24:21.538534+0000","last_became_active":"2024-04-19T04:24:20.545607+0000","last_became_peered":"2024-04-19T04:24:20.545607+0000","last_unstale":"2024-04-19T04:24:21.538534+0000","last_undegraded":"2024-04-19T04:24:21.538534+0000","last_fullsized":"2024-04-19T04:24:21.538534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:03.482984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608645+0000","last_change":"2024-04-19T04:24:20.554885+0000","last_active":"2024-04-19T04:24:21.608645+0000","last_peered":"2024-04-19T04:24:21.608645+0000","last_clean":"2024-04-19T04:24:21.608645+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:24:21.608645+0000","last_undegraded":"2024-04-19T04:24:21.608645+0000","last_fullsized":"2024-04-19T04:24:21.608645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:44:08.285518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541646+0000","last_change":"2024-04-19T04:24:20.558702+0000","last_active":"2024-04-19T04:24:21.541646+0000","last_peered":"2024-04-19T04:24:21.541646+0000","last_clean":"2024-04-19T04:24:21.541646+0000","last_became_active":"2024-04-19T04:24:20.558202+0000","last_became_peered":"2024-04-19T04:24:20.558202+0000","last_unstale":"2024-04-19T04:24:21.541646+0000","last_undegraded":"2024-04-19T04:24:21.541646+0000","last_fullsized":"2024-04-19T04:24:21.541646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:56.738569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537991+0000","last_change":"2024-04-19T04:24:20.543906+0000","last_active":"2024-04-19T04:24:21.537991+0000","last_peered":"2024-04-19T04:24:21.537991+0000","last_clean":"2024-04-19T04:24:21.537991+0000","last_became_active":"2024-04-19T04:24:20.543531+0000","last_became_peered":"2024-04-19T04:24:20.543531+0000","last_unstale":"2024-04-19T04:24:21.537991+0000","last_undegraded":"2024-04-19T04:24:21.537991+0000","last_fullsized":"2024-04-19T04:24:21.537991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:28:04.850289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540345+0000","last_change":"2024-04-19T04:24:20.554847+0000","last_active":"2024-04-19T04:24:21.540345+0000","last_peered":"2024-04-19T04:24:21.540345+0000","last_clean":"2024-04-19T04:24:21.540345+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:24:21.540345+0000","last_undegraded":"2024-04-19T04:24:21.540345+0000","last_fullsized":"2024-04-19T04:24:21.540345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:00.475711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536735+0000","last_change":"2024-04-19T04:24:20.546826+0000","last_active":"2024-04-19T04:24:21.536735+0000","last_peered":"2024-04-19T04:24:21.536735+0000","last_clean":"2024-04-19T04:24:21.536735+0000","last_became_active":"2024-04-19T04:24:20.546065+0000","last_became_peered":"2024-04-19T04:24:20.546065+0000","last_unstale":"2024-04-19T04:24:21.536735+0000","last_undegraded":"2024-04-19T04:24:21.536735+0000","last_fullsized":"2024-04-19T04:24:21.536735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:47.956234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606802+0000","last_change":"2024-04-19T04:24:20.552289+0000","last_active":"2024-04-19T04:24:21.606802+0000","last_peered":"2024-04-19T04:24:21.606802+0000","last_clean":"2024-04-19T04:24:21.606802+0000","last_became_active":"2024-04-19T04:24:20.548755+0000","last_became_peered":"2024-04-19T04:24:20.548755+0000","last_unstale":"2024-04-19T04:24:21.606802+0000","last_undegraded":"2024-04-19T04:24:21.606802+0000","last_fullsized":"2024-04-19T04:24:21.606802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541554+0000","last_change":"2024-04-19T04:24:20.546223+0000","last_active":"2024-04-19T04:24:21.541554+0000","last_peered":"2024-04-19T04:24:21.541554+0000","last_clean":"2024-04-19T04:24:21.541554+0000","last_became_active":"2024-04-19T04:24:20.545807+0000","last_became_peered":"2024-04-19T04:24:20.545807+0000","last_unstale":"2024-04-19T04:24:21.541554+0000","last_undegraded":"2024-04-19T04:24:21.541554+0000","last_fullsized":"2024-04-19T04:24:21.541554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:19.894104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608609+0000","last_change":"2024-04-19T04:24:20.184870+0000","last_active":"2024-04-19T04:24:21.608609+0000","last_peered":"2024-04-19T04:24:21.608609+0000","last_clean":"2024-04-19T04:24:21.608609+0000","last_became_active":"2024-04-19T04:24:20.183615+0000","last_became_peered":"2024-04-19T04:24:20.183615+0000","last_unstale":"2024-04-19T04:24:21.608609+0000","last_undegraded":"2024-04-19T04:24:21.608609+0000","last_fullsized":"2024-04-19T04:24:21.608609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:52:38.272121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541893+0000","last_change":"2024-04-19T04:24:20.547475+0000","last_active":"2024-04-19T04:24:21.541893+0000","last_peered":"2024-04-19T04:24:21.541893+0000","last_clean":"2024-04-19T04:24:21.541893+0000","last_became_active":"2024-04-19T04:24:20.546615+0000","last_became_peered":"2024-04-19T04:24:20.546615+0000","last_unstale":"2024-04-19T04:24:21.541893+0000","last_undegraded":"2024-04-19T04:24:21.541893+0000","last_fullsized":"2024-04-19T04:24:21.541893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:24.049904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537755+0000","last_change":"2024-04-19T04:24:20.177739+0000","last_active":"2024-04-19T04:24:21.537755+0000","last_peered":"2024-04-19T04:24:21.537755+0000","last_clean":"2024-04-19T04:24:21.537755+0000","last_became_active":"2024-04-19T04:24:20.177328+0000","last_became_peered":"2024-04-19T04:24:20.177328+0000","last_unstale":"2024-04-19T04:24:21.537755+0000","last_undegraded":"2024-04-19T04:24:21.537755+0000","last_fullsized":"2024-04-19T04:24:21.537755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:27.902190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538848+0000","last_change":"2024-04-19T04:24:20.547144+0000","last_active":"2024-04-19T04:24:21.538848+0000","last_peered":"2024-04-19T04:24:21.538848+0000","last_clean":"2024-04-19T04:24:21.538848+0000","last_became_active":"2024-04-19T04:24:20.546814+0000","last_became_peered":"2024-04-19T04:24:20.546814+0000","last_unstale":"2024-04-19T04:24:21.538848+0000","last_undegraded":"2024-04-19T04:24:21.538848+0000","last_fullsized":"2024-04-19T04:24:21.538848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:04.710943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540345+0000","last_change":"2024-04-19T04:24:20.183855+0000","last_active":"2024-04-19T04:24:21.540345+0000","last_peered":"2024-04-19T04:24:21.540345+0000","last_clean":"2024-04-19T04:24:21.540345+0000","last_became_active":"2024-04-19T04:24:20.183272+0000","last_became_peered":"2024-04-19T04:24:20.183272+0000","last_unstale":"2024-04-19T04:24:21.540345+0000","last_undegraded":"2024-04-19T04:24:21.540345+0000","last_fullsized":"2024-04-19T04:24:21.540345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:54.737330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538578+0000","last_change":"2024-04-19T04:24:20.551347+0000","last_active":"2024-04-19T04:24:21.538578+0000","last_peered":"2024-04-19T04:24:21.538578+0000","last_clean":"2024-04-19T04:24:21.538578+0000","last_became_active":"2024-04-19T04:24:20.550917+0000","last_became_peered":"2024-04-19T04:24:20.550917+0000","last_unstale":"2024-04-19T04:24:21.538578+0000","last_undegraded":"2024-04-19T04:24:21.538578+0000","last_fullsized":"2024-04-19T04:24:21.538578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:47.732617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606983+0000","last_change":"2024-04-19T04:24:20.187299+0000","last_active":"2024-04-19T04:24:21.606983+0000","last_peered":"2024-04-19T04:24:21.606983+0000","last_clean":"2024-04-19T04:24:21.606983+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:24:21.606983+0000","last_undegraded":"2024-04-19T04:24:21.606983+0000","last_fullsized":"2024-04-19T04:24:21.606983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:49:37.812125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609542+0000","last_change":"2024-04-19T04:24:20.186029+0000","last_active":"2024-04-19T04:24:21.609542+0000","last_peered":"2024-04-19T04:24:21.609542+0000","last_clean":"2024-04-19T04:24:21.609542+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:24:21.609542+0000","last_undegraded":"2024-04-19T04:24:21.609542+0000","last_fullsized":"2024-04-19T04:24:21.609542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:49.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539569+0000","last_change":"2024-04-19T04:24:20.555751+0000","last_active":"2024-04-19T04:24:21.539569+0000","last_peered":"2024-04-19T04:24:21.539569+0000","last_clean":"2024-04-19T04:24:21.539569+0000","last_became_active":"2024-04-19T04:24:20.555501+0000","last_became_peered":"2024-04-19T04:24:20.555501+0000","last_unstale":"2024-04-19T04:24:21.539569+0000","last_undegraded":"2024-04-19T04:24:21.539569+0000","last_fullsized":"2024-04-19T04:24:21.539569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:57.839930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541919+0000","last_change":"2024-04-19T04:24:20.184142+0000","last_active":"2024-04-19T04:24:21.541919+0000","last_peered":"2024-04-19T04:24:21.541919+0000","last_clean":"2024-04-19T04:24:21.541919+0000","last_became_active":"2024-04-19T04:24:20.183546+0000","last_became_peered":"2024-04-19T04:24:20.183546+0000","last_unstale":"2024-04-19T04:24:21.541919+0000","last_undegraded":"2024-04-19T04:24:21.541919+0000","last_fullsized":"2024-04-19T04:24:21.541919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:17.280977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539845+0000","last_change":"2024-04-19T04:24:20.545490+0000","last_active":"2024-04-19T04:24:21.539845+0000","last_peered":"2024-04-19T04:24:21.539845+0000","last_clean":"2024-04-19T04:24:21.539845+0000","last_became_active":"2024-04-19T04:24:20.544898+0000","last_became_peered":"2024-04-19T04:24:20.544898+0000","last_unstale":"2024-04-19T04:24:21.539845+0000","last_undegraded":"2024-04-19T04:24:21.539845+0000","last_fullsized":"2024-04-19T04:24:21.539845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:40:02.138518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609093+0000","last_change":"2024-04-19T04:24:20.186044+0000","last_active":"2024-04-19T04:24:21.609093+0000","last_peered":"2024-04-19T04:24:21.609093+0000","last_clean":"2024-04-19T04:24:21.609093+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:24:21.609093+0000","last_undegraded":"2024-04-19T04:24:21.609093+0000","last_fullsized":"2024-04-19T04:24:21.609093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.432692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607445+0000","last_change":"2024-04-19T04:24:20.552828+0000","last_active":"2024-04-19T04:24:21.607445+0000","last_peered":"2024-04-19T04:24:21.607445+0000","last_clean":"2024-04-19T04:24:21.607445+0000","last_became_active":"2024-04-19T04:24:20.551927+0000","last_became_peered":"2024-04-19T04:24:20.551927+0000","last_unstale":"2024-04-19T04:24:21.607445+0000","last_undegraded":"2024-04-19T04:24:21.607445+0000","last_fullsized":"2024-04-19T04:24:21.607445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:41.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608700+0000","last_change":"2024-04-19T04:24:20.179238+0000","last_active":"2024-04-19T04:24:21.608700+0000","last_peered":"2024-04-19T04:24:21.608700+0000","last_clean":"2024-04-19T04:24:21.608700+0000","last_became_active":"2024-04-19T04:24:20.178758+0000","last_became_peered":"2024-04-19T04:24:20.178758+0000","last_unstale":"2024-04-19T04:24:21.608700+0000","last_undegraded":"2024-04-19T04:24:21.608700+0000","last_fullsized":"2024-04-19T04:24:21.608700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:18:24.789775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537600+0000","last_change":"2024-04-19T04:24:20.554969+0000","last_active":"2024-04-19T04:24:21.537600+0000","last_peered":"2024-04-19T04:24:21.537600+0000","last_clean":"2024-04-19T04:24:21.537600+0000","last_became_active":"2024-04-19T04:24:20.554604+0000","last_became_peered":"2024-04-19T04:24:20.554604+0000","last_unstale":"2024-04-19T04:24:21.537600+0000","last_undegraded":"2024-04-19T04:24:21.537600+0000","last_fullsized":"2024-04-19T04:24:21.537600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:58:47.703110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538228+0000","last_change":"2024-04-19T04:24:20.178602+0000","last_active":"2024-04-19T04:24:21.538228+0000","last_peered":"2024-04-19T04:24:21.538228+0000","last_clean":"2024-04-19T04:24:21.538228+0000","last_became_active":"2024-04-19T04:24:20.177976+0000","last_became_peered":"2024-04-19T04:24:20.177976+0000","last_unstale":"2024-04-19T04:24:21.538228+0000","last_undegraded":"2024-04-19T04:24:21.538228+0000","last_fullsized":"2024-04-19T04:24:21.538228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:15.883790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608409+0000","last_change":"2024-04-19T04:24:20.548296+0000","last_active":"2024-04-19T04:24:21.608409+0000","last_peered":"2024-04-19T04:24:21.608409+0000","last_clean":"2024-04-19T04:24:21.608409+0000","last_became_active":"2024-04-19T04:24:20.547457+0000","last_became_peered":"2024-04-19T04:24:20.547457+0000","last_unstale":"2024-04-19T04:24:21.608409+0000","last_undegraded":"2024-04-19T04:24:21.608409+0000","last_fullsized":"2024-04-19T04:24:21.608409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:57.839930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607638+0000","last_change":"2024-04-19T04:24:20.184338+0000","last_active":"2024-04-19T04:24:21.607638+0000","last_peered":"2024-04-19T04:24:21.607638+0000","last_clean":"2024-04-19T04:24:21.607638+0000","last_became_active":"2024-04-19T04:24:20.183511+0000","last_became_peered":"2024-04-19T04:24:20.183511+0000","last_unstale":"2024-04-19T04:24:21.607638+0000","last_undegraded":"2024-04-19T04:24:21.607638+0000","last_fullsized":"2024-04-19T04:24:21.607638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:14.235823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608849+0000","last_change":"2024-04-19T04:24:20.555922+0000","last_active":"2024-04-19T04:24:21.608849+0000","last_peered":"2024-04-19T04:24:21.608849+0000","last_clean":"2024-04-19T04:24:21.608849+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:24:21.608849+0000","last_undegraded":"2024-04-19T04:24:21.608849+0000","last_fullsized":"2024-04-19T04:24:21.608849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:06:53.595149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540165+0000","last_change":"2024-04-19T04:24:20.183944+0000","last_active":"2024-04-19T04:24:21.540165+0000","last_peered":"2024-04-19T04:24:21.540165+0000","last_clean":"2024-04-19T04:24:21.540165+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:24:21.540165+0000","last_undegraded":"2024-04-19T04:24:21.540165+0000","last_fullsized":"2024-04-19T04:24:21.540165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:42.018487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608707+0000","last_change":"2024-04-19T04:24:20.553085+0000","last_active":"2024-04-19T04:24:21.608707+0000","last_peered":"2024-04-19T04:24:21.608707+0000","last_clean":"2024-04-19T04:24:21.608707+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:24:21.608707+0000","last_undegraded":"2024-04-19T04:24:21.608707+0000","last_fullsized":"2024-04-19T04:24:21.608707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:07:21.467758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539831+0000","last_change":"2024-04-19T04:24:20.180834+0000","last_active":"2024-04-19T04:24:21.539831+0000","last_peered":"2024-04-19T04:24:21.539831+0000","last_clean":"2024-04-19T04:24:21.539831+0000","last_became_active":"2024-04-19T04:24:20.180522+0000","last_became_peered":"2024-04-19T04:24:20.180522+0000","last_unstale":"2024-04-19T04:24:21.539831+0000","last_undegraded":"2024-04-19T04:24:21.539831+0000","last_fullsized":"2024-04-19T04:24:21.539831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:38:28.208268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538763+0000","last_change":"2024-04-19T04:24:20.547313+0000","last_active":"2024-04-19T04:24:21.538763+0000","last_peered":"2024-04-19T04:24:21.538763+0000","last_clean":"2024-04-19T04:24:21.538763+0000","last_became_active":"2024-04-19T04:24:20.545692+0000","last_became_peered":"2024-04-19T04:24:20.545692+0000","last_unstale":"2024-04-19T04:24:21.538763+0000","last_undegraded":"2024-04-19T04:24:21.538763+0000","last_fullsized":"2024-04-19T04:24:21.538763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:24:42.844961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.547904+0000","last_change":"2024-04-19T04:24:10.106278+0000","last_active":"2024-04-19T04:24:20.547904+0000","last_peered":"2024-04-19T04:24:20.547904+0000","last_clean":"2024-04-19T04:24:20.547904+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:24:20.547904+0000","last_undegraded":"2024-04-19T04:24:20.547904+0000","last_fullsized":"2024-04-19T04:24:20.547904+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_clean_scrub_stamp":"2024-04-19T04:24:09.083488+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.549706+0000","last_change":"2024-04-19T04:24:16.144872+0000","last_active":"2024-04-19T04:24:20.549706+0000","last_peered":"2024-04-19T04:24:20.549706+0000","last_clean":"2024-04-19T04:24:20.549706+0000","last_became_active":"2024-04-19T04:24:16.143778+0000","last_became_peered":"2024-04-19T04:24:16.143778+0000","last_unstale":"2024-04-19T04:24:20.549706+0000","last_undegraded":"2024-04-19T04:24:20.549706+0000","last_fullsized":"2024-04-19T04:24:20.549706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:26:06.303713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538038+0000","last_change":"2024-04-19T04:24:20.174958+0000","last_active":"2024-04-19T04:24:21.538038+0000","last_peered":"2024-04-19T04:24:21.538038+0000","last_clean":"2024-04-19T04:24:21.538038+0000","last_became_active":"2024-04-19T04:24:20.174643+0000","last_became_peered":"2024-04-19T04:24:20.174643+0000","last_unstale":"2024-04-19T04:24:21.538038+0000","last_undegraded":"2024-04-19T04:24:21.538038+0000","last_fullsized":"2024-04-19T04:24:21.538038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:37.752236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608950+0000","last_change":"2024-04-19T04:24:20.553999+0000","last_active":"2024-04-19T04:24:21.608950+0000","last_peered":"2024-04-19T04:24:21.608950+0000","last_clean":"2024-04-19T04:24:21.608950+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:24:21.608950+0000","last_undegraded":"2024-04-19T04:24:21.608950+0000","last_fullsized":"2024-04-19T04:24:21.608950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:13:53.306369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.546806+0000","last_change":"2024-04-19T04:24:16.144482+0000","last_active":"2024-04-19T04:24:20.546806+0000","last_peered":"2024-04-19T04:24:20.546806+0000","last_clean":"2024-04-19T04:24:20.546806+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:24:20.546806+0000","last_undegraded":"2024-04-19T04:24:20.546806+0000","last_fullsized":"2024-04-19T04:24:20.546806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:15.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537224+0000","last_change":"2024-04-19T04:24:20.179129+0000","last_active":"2024-04-19T04:24:21.537224+0000","last_peered":"2024-04-19T04:24:21.537224+0000","last_clean":"2024-04-19T04:24:21.537224+0000","last_became_active":"2024-04-19T04:24:20.178247+0000","last_became_peered":"2024-04-19T04:24:20.178247+0000","last_unstale":"2024-04-19T04:24:21.537224+0000","last_undegraded":"2024-04-19T04:24:21.537224+0000","last_fullsized":"2024-04-19T04:24:21.537224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:51.616306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541152+0000","last_change":"2024-04-19T04:24:20.550166+0000","last_active":"2024-04-19T04:24:21.541152+0000","last_peered":"2024-04-19T04:24:21.541152+0000","last_clean":"2024-04-19T04:24:21.541152+0000","last_became_active":"2024-04-19T04:24:20.549606+0000","last_became_peered":"2024-04-19T04:24:20.549606+0000","last_unstale":"2024-04-19T04:24:21.541152+0000","last_undegraded":"2024-04-19T04:24:21.541152+0000","last_fullsized":"2024-04-19T04:24:21.541152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:41.685120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.533460+0000","last_change":"2024-04-19T04:24:16.135584+0000","last_active":"2024-04-19T04:24:20.533460+0000","last_peered":"2024-04-19T04:24:20.533460+0000","last_clean":"2024-04-19T04:24:20.533460+0000","last_became_active":"2024-04-19T04:24:16.134799+0000","last_became_peered":"2024-04-19T04:24:16.134799+0000","last_unstale":"2024-04-19T04:24:20.533460+0000","last_undegraded":"2024-04-19T04:24:20.533460+0000","last_fullsized":"2024-04-19T04:24:20.533460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:55:57.442649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539948+0000","last_change":"2024-04-19T04:24:20.183933+0000","last_active":"2024-04-19T04:24:21.539948+0000","last_peered":"2024-04-19T04:24:21.539948+0000","last_clean":"2024-04-19T04:24:21.539948+0000","last_became_active":"2024-04-19T04:24:20.183490+0000","last_became_peered":"2024-04-19T04:24:20.183490+0000","last_unstale":"2024-04-19T04:24:21.539948+0000","last_undegraded":"2024-04-19T04:24:21.539948+0000","last_fullsized":"2024-04-19T04:24:21.539948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:43.869727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538758+0000","last_change":"2024-04-19T04:24:20.544687+0000","last_active":"2024-04-19T04:24:21.538758+0000","last_peered":"2024-04-19T04:24:21.538758+0000","last_clean":"2024-04-19T04:24:21.538758+0000","last_became_active":"2024-04-19T04:24:20.544430+0000","last_became_peered":"2024-04-19T04:24:20.544430+0000","last_unstale":"2024-04-19T04:24:21.538758+0000","last_undegraded":"2024-04-19T04:24:21.538758+0000","last_fullsized":"2024-04-19T04:24:21.538758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:11:22.765812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.548059+0000","last_change":"2024-04-19T04:24:16.145124+0000","last_active":"2024-04-19T04:24:20.548059+0000","last_peered":"2024-04-19T04:24:20.548059+0000","last_clean":"2024-04-19T04:24:20.548059+0000","last_became_active":"2024-04-19T04:24:16.143949+0000","last_became_peered":"2024-04-19T04:24:16.143949+0000","last_unstale":"2024-04-19T04:24:20.548059+0000","last_undegraded":"2024-04-19T04:24:20.548059+0000","last_fullsized":"2024-04-19T04:24:20.548059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:18.901615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608836+0000","last_change":"2024-04-19T04:24:20.179004+0000","last_active":"2024-04-19T04:24:21.608836+0000","last_peered":"2024-04-19T04:24:21.608836+0000","last_clean":"2024-04-19T04:24:21.608836+0000","last_became_active":"2024-04-19T04:24:20.178123+0000","last_became_peered":"2024-04-19T04:24:20.178123+0000","last_unstale":"2024-04-19T04:24:21.608836+0000","last_undegraded":"2024-04-19T04:24:21.608836+0000","last_fullsized":"2024-04-19T04:24:21.608836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:35:25.084528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538611+0000","last_change":"2024-04-19T04:24:20.544312+0000","last_active":"2024-04-19T04:24:21.538611+0000","last_peered":"2024-04-19T04:24:21.538611+0000","last_clean":"2024-04-19T04:24:21.538611+0000","last_became_active":"2024-04-19T04:24:20.543738+0000","last_became_peered":"2024-04-19T04:24:20.543738+0000","last_unstale":"2024-04-19T04:24:21.538611+0000","last_undegraded":"2024-04-19T04:24:21.538611+0000","last_fullsized":"2024-04-19T04:24:21.538611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:23.486532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609184+0000","last_change":"2024-04-19T04:24:20.184349+0000","last_active":"2024-04-19T04:24:21.609184+0000","last_peered":"2024-04-19T04:24:21.609184+0000","last_clean":"2024-04-19T04:24:21.609184+0000","last_became_active":"2024-04-19T04:24:20.183495+0000","last_became_peered":"2024-04-19T04:24:20.183495+0000","last_unstale":"2024-04-19T04:24:21.609184+0000","last_undegraded":"2024-04-19T04:24:21.609184+0000","last_fullsized":"2024-04-19T04:24:21.609184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:16:09.571178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.531994+0000","last_change":"2024-04-19T04:24:16.136119+0000","last_active":"2024-04-19T04:24:20.531994+0000","last_peered":"2024-04-19T04:24:20.531994+0000","last_clean":"2024-04-19T04:24:20.531994+0000","last_became_active":"2024-04-19T04:24:16.135272+0000","last_became_peered":"2024-04-19T04:24:16.135272+0000","last_unstale":"2024-04-19T04:24:20.531994+0000","last_undegraded":"2024-04-19T04:24:20.531994+0000","last_fullsized":"2024-04-19T04:24:20.531994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:07:14.180095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540172+0000","last_change":"2024-04-19T04:24:20.555116+0000","last_active":"2024-04-19T04:24:21.540172+0000","last_peered":"2024-04-19T04:24:21.540172+0000","last_clean":"2024-04-19T04:24:21.540172+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:24:21.540172+0000","last_undegraded":"2024-04-19T04:24:21.540172+0000","last_fullsized":"2024-04-19T04:24:21.540172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:21.734428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538645+0000","last_change":"2024-04-19T04:24:20.174833+0000","last_active":"2024-04-19T04:24:21.538645+0000","last_peered":"2024-04-19T04:24:21.538645+0000","last_clean":"2024-04-19T04:24:21.538645+0000","last_became_active":"2024-04-19T04:24:20.174517+0000","last_became_peered":"2024-04-19T04:24:20.174517+0000","last_unstale":"2024-04-19T04:24:21.538645+0000","last_undegraded":"2024-04-19T04:24:21.538645+0000","last_fullsized":"2024-04-19T04:24:21.538645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:51.699530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.536090+0000","last_change":"2024-04-19T04:24:16.141899+0000","last_active":"2024-04-19T04:24:20.536090+0000","last_peered":"2024-04-19T04:24:20.536090+0000","last_clean":"2024-04-19T04:24:20.536090+0000","last_became_active":"2024-04-19T04:24:16.141508+0000","last_became_peered":"2024-04-19T04:24:16.141508+0000","last_unstale":"2024-04-19T04:24:20.536090+0000","last_undegraded":"2024-04-19T04:24:20.536090+0000","last_fullsized":"2024-04-19T04:24:20.536090+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:31.719446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540502+0000","last_change":"2024-04-19T04:24:20.558559+0000","last_active":"2024-04-19T04:24:21.540502+0000","last_peered":"2024-04-19T04:24:21.540502+0000","last_clean":"2024-04-19T04:24:21.540502+0000","last_became_active":"2024-04-19T04:24:20.558215+0000","last_became_peered":"2024-04-19T04:24:20.558215+0000","last_unstale":"2024-04-19T04:24:21.540502+0000","last_undegraded":"2024-04-19T04:24:21.540502+0000","last_fullsized":"2024-04-19T04:24:21.540502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:41.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539118+0000","last_change":"2024-04-19T04:24:20.175205+0000","last_active":"2024-04-19T04:24:21.539118+0000","last_peered":"2024-04-19T04:24:21.539118+0000","last_clean":"2024-04-19T04:24:21.539118+0000","last_became_active":"2024-04-19T04:24:20.174912+0000","last_became_peered":"2024-04-19T04:24:20.174912+0000","last_unstale":"2024-04-19T04:24:21.539118+0000","last_undegraded":"2024-04-19T04:24:21.539118+0000","last_fullsized":"2024-04-19T04:24:21.539118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:21:37.681287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.533233+0000","last_change":"2024-04-19T04:24:16.135892+0000","last_active":"2024-04-19T04:24:20.533233+0000","last_peered":"2024-04-19T04:24:20.533233+0000","last_clean":"2024-04-19T04:24:20.533233+0000","last_became_active":"2024-04-19T04:24:16.135385+0000","last_became_peered":"2024-04-19T04:24:16.135385+0000","last_unstale":"2024-04-19T04:24:20.533233+0000","last_undegraded":"2024-04-19T04:24:20.533233+0000","last_fullsized":"2024-04-19T04:24:20.533233+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:37.110319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536977+0000","last_change":"2024-04-19T04:24:20.553486+0000","last_active":"2024-04-19T04:24:21.536977+0000","last_peered":"2024-04-19T04:24:21.536977+0000","last_clean":"2024-04-19T04:24:21.536977+0000","last_became_active":"2024-04-19T04:24:20.553206+0000","last_became_peered":"2024-04-19T04:24:20.553206+0000","last_unstale":"2024-04-19T04:24:21.536977+0000","last_undegraded":"2024-04-19T04:24:21.536977+0000","last_fullsized":"2024-04-19T04:24:21.536977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:32.648637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538916+0000","last_change":"2024-04-19T04:24:20.178880+0000","last_active":"2024-04-19T04:24:21.538916+0000","last_peered":"2024-04-19T04:24:21.538916+0000","last_clean":"2024-04-19T04:24:21.538916+0000","last_became_active":"2024-04-19T04:24:20.177593+0000","last_became_peered":"2024-04-19T04:24:20.177593+0000","last_unstale":"2024-04-19T04:24:21.538916+0000","last_undegraded":"2024-04-19T04:24:21.538916+0000","last_fullsized":"2024-04-19T04:24:21.538916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:58:32.732477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.549281+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:24:20.549281+0000","last_peered":"2024-04-19T04:24:20.549281+0000","last_clean":"2024-04-19T04:24:20.549281+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:24:20.549281+0000","last_undegraded":"2024-04-19T04:24:20.549281+0000","last_fullsized":"2024-04-19T04:24:20.549281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:45.574813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539891+0000","last_change":"2024-04-19T04:24:20.554721+0000","last_active":"2024-04-19T04:24:21.539891+0000","last_peered":"2024-04-19T04:24:21.539891+0000","last_clean":"2024-04-19T04:24:21.539891+0000","last_became_active":"2024-04-19T04:24:20.554286+0000","last_became_peered":"2024-04-19T04:24:20.554286+0000","last_unstale":"2024-04-19T04:24:21.539891+0000","last_undegraded":"2024-04-19T04:24:21.539891+0000","last_fullsized":"2024-04-19T04:24:21.539891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:14.194572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608106+0000","last_change":"2024-04-19T04:24:20.555406+0000","last_active":"2024-04-19T04:24:21.608106+0000","last_peered":"2024-04-19T04:24:21.608106+0000","last_clean":"2024-04-19T04:24:21.608106+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:24:21.608106+0000","last_undegraded":"2024-04-19T04:24:21.608106+0000","last_fullsized":"2024-04-19T04:24:21.608106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:10.453970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608703+0000","last_change":"2024-04-19T04:24:20.185978+0000","last_active":"2024-04-19T04:24:21.608703+0000","last_peered":"2024-04-19T04:24:21.608703+0000","last_clean":"2024-04-19T04:24:21.608703+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:24:21.608703+0000","last_undegraded":"2024-04-19T04:24:21.608703+0000","last_fullsized":"2024-04-19T04:24:21.608703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:48.158805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537416+0000","last_change":"2024-04-19T04:24:20.544323+0000","last_active":"2024-04-19T04:24:21.537416+0000","last_peered":"2024-04-19T04:24:21.537416+0000","last_clean":"2024-04-19T04:24:21.537416+0000","last_became_active":"2024-04-19T04:24:20.543893+0000","last_became_peered":"2024-04-19T04:24:20.543893+0000","last_unstale":"2024-04-19T04:24:21.537416+0000","last_undegraded":"2024-04-19T04:24:21.537416+0000","last_fullsized":"2024-04-19T04:24:21.537416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:01.587027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.542097+0000","last_change":"2024-04-19T04:24:20.184342+0000","last_active":"2024-04-19T04:24:21.542097+0000","last_peered":"2024-04-19T04:24:21.542097+0000","last_clean":"2024-04-19T04:24:21.542097+0000","last_became_active":"2024-04-19T04:24:20.183970+0000","last_became_peered":"2024-04-19T04:24:20.183970+0000","last_unstale":"2024-04-19T04:24:21.542097+0000","last_undegraded":"2024-04-19T04:24:21.542097+0000","last_fullsized":"2024-04-19T04:24:21.542097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:46.956957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609216+0000","last_change":"2024-04-19T04:24:20.184508+0000","last_active":"2024-04-19T04:24:21.609216+0000","last_peered":"2024-04-19T04:24:21.609216+0000","last_clean":"2024-04-19T04:24:21.609216+0000","last_became_active":"2024-04-19T04:24:20.184060+0000","last_became_peered":"2024-04-19T04:24:20.184060+0000","last_unstale":"2024-04-19T04:24:21.609216+0000","last_undegraded":"2024-04-19T04:24:21.609216+0000","last_fullsized":"2024-04-19T04:24:21.609216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:14:57.634877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537342+0000","last_change":"2024-04-19T04:24:20.546949+0000","last_active":"2024-04-19T04:24:21.537342+0000","last_peered":"2024-04-19T04:24:21.537342+0000","last_clean":"2024-04-19T04:24:21.537342+0000","last_became_active":"2024-04-19T04:24:20.546029+0000","last_became_peered":"2024-04-19T04:24:20.546029+0000","last_unstale":"2024-04-19T04:24:21.537342+0000","last_undegraded":"2024-04-19T04:24:21.537342+0000","last_fullsized":"2024-04-19T04:24:21.537342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:22:06.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539031+0000","last_change":"2024-04-19T04:24:20.178672+0000","last_active":"2024-04-19T04:24:21.539031+0000","last_peered":"2024-04-19T04:24:21.539031+0000","last_clean":"2024-04-19T04:24:21.539031+0000","last_became_active":"2024-04-19T04:24:20.177921+0000","last_became_peered":"2024-04-19T04:24:20.177921+0000","last_unstale":"2024-04-19T04:24:21.539031+0000","last_undegraded":"2024-04-19T04:24:21.539031+0000","last_fullsized":"2024-04-19T04:24:21.539031+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:21.042990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536875+0000","last_change":"2024-04-19T04:24:20.546616+0000","last_active":"2024-04-19T04:24:21.536875+0000","last_peered":"2024-04-19T04:24:21.536875+0000","last_clean":"2024-04-19T04:24:21.536875+0000","last_became_active":"2024-04-19T04:24:20.546032+0000","last_became_peered":"2024-04-19T04:24:20.546032+0000","last_unstale":"2024-04-19T04:24:21.536875+0000","last_undegraded":"2024-04-19T04:24:21.536875+0000","last_fullsized":"2024-04-19T04:24:21.536875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:02:20.398899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541610+0000","last_change":"2024-04-19T04:24:20.552644+0000","last_active":"2024-04-19T04:24:21.541610+0000","last_peered":"2024-04-19T04:24:21.541610+0000","last_clean":"2024-04-19T04:24:21.541610+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:24:21.541610+0000","last_undegraded":"2024-04-19T04:24:21.541610+0000","last_fullsized":"2024-04-19T04:24:21.541610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537050+0000","last_change":"2024-04-19T04:24:20.174912+0000","last_active":"2024-04-19T04:24:21.537050+0000","last_peered":"2024-04-19T04:24:21.537050+0000","last_clean":"2024-04-19T04:24:21.537050+0000","last_became_active":"2024-04-19T04:24:20.174629+0000","last_became_peered":"2024-04-19T04:24:20.174629+0000","last_unstale":"2024-04-19T04:24:21.537050+0000","last_undegraded":"2024-04-19T04:24:21.537050+0000","last_fullsized":"2024-04-19T04:24:21.537050+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:09:12.929115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538272+0000","last_change":"2024-04-19T04:24:20.549484+0000","last_active":"2024-04-19T04:24:21.538272+0000","last_peered":"2024-04-19T04:24:21.538272+0000","last_clean":"2024-04-19T04:24:21.538272+0000","last_became_active":"2024-04-19T04:24:20.549149+0000","last_became_peered":"2024-04-19T04:24:20.549149+0000","last_unstale":"2024-04-19T04:24:21.538272+0000","last_undegraded":"2024-04-19T04:24:21.538272+0000","last_fullsized":"2024-04-19T04:24:21.538272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:49.148982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537100+0000","last_change":"2024-04-19T04:24:20.178730+0000","last_active":"2024-04-19T04:24:21.537100+0000","last_peered":"2024-04-19T04:24:21.537100+0000","last_clean":"2024-04-19T04:24:21.537100+0000","last_became_active":"2024-04-19T04:24:20.177996+0000","last_became_peered":"2024-04-19T04:24:20.177996+0000","last_unstale":"2024-04-19T04:24:21.537100+0000","last_undegraded":"2024-04-19T04:24:21.537100+0000","last_fullsized":"2024-04-19T04:24:21.537100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:27:46.704368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541658+0000","last_change":"2024-04-19T04:24:20.556092+0000","last_active":"2024-04-19T04:24:21.541658+0000","last_peered":"2024-04-19T04:24:21.541658+0000","last_clean":"2024-04-19T04:24:21.541658+0000","last_became_active":"2024-04-19T04:24:20.555928+0000","last_became_peered":"2024-04-19T04:24:20.555928+0000","last_unstale":"2024-04-19T04:24:21.541658+0000","last_undegraded":"2024-04-19T04:24:21.541658+0000","last_fullsized":"2024-04-19T04:24:21.541658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:12.211801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540632+0000","last_change":"2024-04-19T04:24:20.179779+0000","last_active":"2024-04-19T04:24:21.540632+0000","last_peered":"2024-04-19T04:24:21.540632+0000","last_clean":"2024-04-19T04:24:21.540632+0000","last_became_active":"2024-04-19T04:24:20.179457+0000","last_became_peered":"2024-04-19T04:24:20.179457+0000","last_unstale":"2024-04-19T04:24:21.540632+0000","last_undegraded":"2024-04-19T04:24:21.540632+0000","last_fullsized":"2024-04-19T04:24:21.540632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:27:04.757759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541223+0000","last_change":"2024-04-19T04:24:20.546222+0000","last_active":"2024-04-19T04:24:21.541223+0000","last_peered":"2024-04-19T04:24:21.541223+0000","last_clean":"2024-04-19T04:24:21.541223+0000","last_became_active":"2024-04-19T04:24:20.545395+0000","last_became_peered":"2024-04-19T04:24:20.545395+0000","last_unstale":"2024-04-19T04:24:21.541223+0000","last_undegraded":"2024-04-19T04:24:21.541223+0000","last_fullsized":"2024-04-19T04:24:21.541223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:56.201003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540715+0000","last_change":"2024-04-19T04:24:20.184108+0000","last_active":"2024-04-19T04:24:21.540715+0000","last_peered":"2024-04-19T04:24:21.540715+0000","last_clean":"2024-04-19T04:24:21.540715+0000","last_became_active":"2024-04-19T04:24:20.183677+0000","last_became_peered":"2024-04-19T04:24:20.183677+0000","last_unstale":"2024-04-19T04:24:21.540715+0000","last_undegraded":"2024-04-19T04:24:21.540715+0000","last_fullsized":"2024-04-19T04:24:21.540715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:06.185573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607906+0000","last_change":"2024-04-19T04:24:20.556556+0000","last_active":"2024-04-19T04:24:21.607906+0000","last_peered":"2024-04-19T04:24:21.607906+0000","last_clean":"2024-04-19T04:24:21.607906+0000","last_became_active":"2024-04-19T04:24:20.555286+0000","last_became_peered":"2024-04-19T04:24:20.555286+0000","last_unstale":"2024-04-19T04:24:21.607906+0000","last_undegraded":"2024-04-19T04:24:21.607906+0000","last_fullsized":"2024-04-19T04:24:21.607906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:18:50.807364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608430+0000","last_change":"2024-04-19T04:24:20.184583+0000","last_active":"2024-04-19T04:24:21.608430+0000","last_peered":"2024-04-19T04:24:21.608430+0000","last_clean":"2024-04-19T04:24:21.608430+0000","last_became_active":"2024-04-19T04:24:20.183933+0000","last_became_peered":"2024-04-19T04:24:20.183933+0000","last_unstale":"2024-04-19T04:24:21.608430+0000","last_undegraded":"2024-04-19T04:24:21.608430+0000","last_fullsized":"2024-04-19T04:24:21.608430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:24.424300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607603+0000","last_change":"2024-04-19T04:24:20.550606+0000","last_active":"2024-04-19T04:24:21.607603+0000","last_peered":"2024-04-19T04:24:21.607603+0000","last_clean":"2024-04-19T04:24:21.607603+0000","last_became_active":"2024-04-19T04:24:20.548990+0000","last_became_peered":"2024-04-19T04:24:20.548990+0000","last_unstale":"2024-04-19T04:24:21.607603+0000","last_undegraded":"2024-04-19T04:24:21.607603+0000","last_fullsized":"2024-04-19T04:24:21.607603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:31:52.562663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541997+0000","last_change":"2024-04-19T04:24:20.184190+0000","last_active":"2024-04-19T04:24:21.541997+0000","last_peered":"2024-04-19T04:24:21.541997+0000","last_clean":"2024-04-19T04:24:21.541997+0000","last_became_active":"2024-04-19T04:24:20.183869+0000","last_became_peered":"2024-04-19T04:24:20.183869+0000","last_unstale":"2024-04-19T04:24:21.541997+0000","last_undegraded":"2024-04-19T04:24:21.541997+0000","last_fullsized":"2024-04-19T04:24:21.541997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:13:48.624837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540713+0000","last_change":"2024-04-19T04:24:20.546603+0000","last_active":"2024-04-19T04:24:21.540713+0000","last_peered":"2024-04-19T04:24:21.540713+0000","last_clean":"2024-04-19T04:24:21.540713+0000","last_became_active":"2024-04-19T04:24:20.546136+0000","last_became_peered":"2024-04-19T04:24:20.546136+0000","last_unstale":"2024-04-19T04:24:21.540713+0000","last_undegraded":"2024-04-19T04:24:21.540713+0000","last_fullsized":"2024-04-19T04:24:21.540713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:20.610726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538747+0000","last_change":"2024-04-19T04:24:20.178148+0000","last_active":"2024-04-19T04:24:21.538747+0000","last_peered":"2024-04-19T04:24:21.538747+0000","last_clean":"2024-04-19T04:24:21.538747+0000","last_became_active":"2024-04-19T04:24:20.177382+0000","last_became_peered":"2024-04-19T04:24:20.177382+0000","last_unstale":"2024-04-19T04:24:21.538747+0000","last_undegraded":"2024-04-19T04:24:21.538747+0000","last_fullsized":"2024-04-19T04:24:21.538747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:03.585052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607131+0000","last_change":"2024-04-19T04:24:20.556288+0000","last_active":"2024-04-19T04:24:21.607131+0000","last_peered":"2024-04-19T04:24:21.607131+0000","last_clean":"2024-04-19T04:24:21.607131+0000","last_became_active":"2024-04-19T04:24:20.554960+0000","last_became_peered":"2024-04-19T04:24:20.554960+0000","last_unstale":"2024-04-19T04:24:21.607131+0000","last_undegraded":"2024-04-19T04:24:21.607131+0000","last_fullsized":"2024-04-19T04:24:21.607131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:27.393720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538917+0000","last_change":"2024-04-19T04:24:20.180873+0000","last_active":"2024-04-19T04:24:21.538917+0000","last_peered":"2024-04-19T04:24:21.538917+0000","last_clean":"2024-04-19T04:24:21.538917+0000","last_became_active":"2024-04-19T04:24:20.180584+0000","last_became_peered":"2024-04-19T04:24:20.180584+0000","last_unstale":"2024-04-19T04:24:21.538917+0000","last_undegraded":"2024-04-19T04:24:21.538917+0000","last_fullsized":"2024-04-19T04:24:21.538917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:43:03.367159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":253952,"data_stored":649246,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31296,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340544,"statfs":{"total":96636764160,"available":96604717056,"internally_reserved":0,"allocated":172032,"data_stored":57748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":649862,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:24:28.375 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-19T04:24:28.376 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-19T04:24:28.376 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-19T04:24:28.376 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-19T04:24:28.376 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-19T04:24:28.735 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:28.750 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"flags":0,"active_gid":4111,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":17147},{"type":"v1","addr":"172.21.15.7:6801","nonce":17147}]},"active_addr":"172.21.15.7:6801/17147","active_change":"2024-04-19T04:24:04.857621+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":667496154}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":1235519030}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":403547255}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":2291408199}]}]} 2024-04-19T04:24:28.754 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-19T04:24:28.754 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-19T04:24:28.754 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T04:24:29.064 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:29.064 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":19,"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","created":"2024-04-19T04:23:58.837304+0000","modified":"2024-04-19T04:24:21.527750+0000","last_up_change":"2024-04-19T04:24:08.081123+0000","last_in_change":"2024-04-19T04:24:00.437672+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T04:24:08.928860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T04:24:14.725769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T04:24:19.096707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T04:24:19.528844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28ba89d9-eaaf-4fb5-86bc-783b607a4cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":18128},{"type":"v1","addr":"172.21.15.27:6801","nonce":18128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":18128},{"type":"v1","addr":"172.21.15.27:6803","nonce":18128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":18128},{"type":"v1","addr":"172.21.15.27:6807","nonce":18128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":18128},{"type":"v1","addr":"172.21.15.27:6805","nonce":18128}]},"public_addr":"172.21.15.27:6801/18128","cluster_addr":"172.21.15.27:6803/18128","heartbeat_back_addr":"172.21.15.27:6807/18128","heartbeat_front_addr":"172.21.15.27:6805/18128","state":["exists","up"]},{"osd":1,"uuid":"9d5408b5-b74c-4e5e-858c-e0c8b593204e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":18186},{"type":"v1","addr":"172.21.15.66:6801","nonce":18186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":18186},{"type":"v1","addr":"172.21.15.66:6803","nonce":18186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":18186},{"type":"v1","addr":"172.21.15.66:6807","nonce":18186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":18186},{"type":"v1","addr":"172.21.15.66:6805","nonce":18186}]},"public_addr":"172.21.15.66:6801/18186","cluster_addr":"172.21.15.66:6803/18186","heartbeat_back_addr":"172.21.15.66:6807/18186","heartbeat_front_addr":"172.21.15.66:6805/18186","state":["exists","up"]},{"osd":2,"uuid":"9b600dc4-4425-4873-82d8-5434ca838bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":18250},{"type":"v1","addr":"172.21.15.172:6801","nonce":18250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":18250},{"type":"v1","addr":"172.21.15.172:6803","nonce":18250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":18250},{"type":"v1","addr":"172.21.15.172:6807","nonce":18250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":18250},{"type":"v1","addr":"172.21.15.172:6805","nonce":18250}]},"public_addr":"172.21.15.172:6801/18250","cluster_addr":"172.21.15.172:6803/18250","heartbeat_back_addr":"172.21.15.172:6807/18250","heartbeat_front_addr":"172.21.15.172:6805/18250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.749539+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.573103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.812945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T04:24:29.079 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-19T04:24:29.079 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T04:24:29.382 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:29.382 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":19,"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","created":"2024-04-19T04:23:58.837304+0000","modified":"2024-04-19T04:24:21.527750+0000","last_up_change":"2024-04-19T04:24:08.081123+0000","last_in_change":"2024-04-19T04:24:00.437672+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T04:24:08.928860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T04:24:14.725769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T04:24:19.096707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T04:24:19.528844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28ba89d9-eaaf-4fb5-86bc-783b607a4cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":18128},{"type":"v1","addr":"172.21.15.27:6801","nonce":18128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":18128},{"type":"v1","addr":"172.21.15.27:6803","nonce":18128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":18128},{"type":"v1","addr":"172.21.15.27:6807","nonce":18128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":18128},{"type":"v1","addr":"172.21.15.27:6805","nonce":18128}]},"public_addr":"172.21.15.27:6801/18128","cluster_addr":"172.21.15.27:6803/18128","heartbeat_back_addr":"172.21.15.27:6807/18128","heartbeat_front_addr":"172.21.15.27:6805/18128","state":["exists","up"]},{"osd":1,"uuid":"9d5408b5-b74c-4e5e-858c-e0c8b593204e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":18186},{"type":"v1","addr":"172.21.15.66:6801","nonce":18186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":18186},{"type":"v1","addr":"172.21.15.66:6803","nonce":18186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":18186},{"type":"v1","addr":"172.21.15.66:6807","nonce":18186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":18186},{"type":"v1","addr":"172.21.15.66:6805","nonce":18186}]},"public_addr":"172.21.15.66:6801/18186","cluster_addr":"172.21.15.66:6803/18186","heartbeat_back_addr":"172.21.15.66:6807/18186","heartbeat_front_addr":"172.21.15.66:6805/18186","state":["exists","up"]},{"osd":2,"uuid":"9b600dc4-4425-4873-82d8-5434ca838bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":18250},{"type":"v1","addr":"172.21.15.172:6801","nonce":18250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":18250},{"type":"v1","addr":"172.21.15.172:6803","nonce":18250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":18250},{"type":"v1","addr":"172.21.15.172:6807","nonce":18250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":18250},{"type":"v1","addr":"172.21.15.172:6805","nonce":18250}]},"public_addr":"172.21.15.172:6801/18250","cluster_addr":"172.21.15.172:6803/18250","heartbeat_back_addr":"172.21.15.172:6807/18250","heartbeat_front_addr":"172.21.15.172:6805/18250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.749539+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.573103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.812945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T04:24:29.398 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-19T04:24:29.398 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-19T04:24:29.399 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-19T04:24:29.560 INFO:teuthology.orchestra.run.smithi007.stdout:38654705672 2024-04-19T04:24:29.560 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T04:24:29.575 INFO:teuthology.orchestra.run.smithi007.stdout:38654705672 2024-04-19T04:24:29.575 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T04:24:29.586 INFO:teuthology.orchestra.run.smithi007.stdout:38654705672 2024-04-19T04:24:29.586 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T04:24:29.855 INFO:teuthology.orchestra.run.smithi007.stdout:38654705670 2024-04-19T04:24:29.869 INFO:teuthology.orchestra.run.smithi007.stdout:38654705671 2024-04-19T04:24:29.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705670 for osd.1 2024-04-19T04:24:29.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705671 for osd.2 2024-04-19T04:24:29.925 INFO:teuthology.orchestra.run.smithi007.stdout:38654705671 2024-04-19T04:24:29.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705671 for osd.0 2024-04-19T04:24:30.870 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T04:24:30.885 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T04:24:30.942 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T04:24:31.186 INFO:teuthology.orchestra.run.smithi007.stdout:38654705671 2024-04-19T04:24:31.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705671 for osd.2 2024-04-19T04:24:31.212 INFO:teuthology.orchestra.run.smithi007.stdout:38654705670 2024-04-19T04:24:31.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705670 for osd.1 2024-04-19T04:24:31.249 INFO:teuthology.orchestra.run.smithi007.stdout:38654705671 2024-04-19T04:24:31.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705671 for osd.0 2024-04-19T04:24:32.200 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T04:24:32.227 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T04:24:32.265 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T04:24:32.521 INFO:teuthology.orchestra.run.smithi007.stdout:38654705672 2024-04-19T04:24:32.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.1 2024-04-19T04:24:32.534 DEBUG:teuthology.parallel:result is None 2024-04-19T04:24:32.551 INFO:teuthology.orchestra.run.smithi007.stdout:38654705672 2024-04-19T04:24:32.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.2 2024-04-19T04:24:32.565 DEBUG:teuthology.parallel:result is None 2024-04-19T04:24:32.580 INFO:teuthology.orchestra.run.smithi007.stdout:38654705672 2024-04-19T04:24:32.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.0 2024-04-19T04:24:32.595 DEBUG:teuthology.parallel:result is None 2024-04-19T04:24:32.595 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-19T04:24:32.595 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:24:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:32.915 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:24:32.928 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-04-19T04:24:32.874554+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94032,"kb_used_data":672,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021488,"statfs":{"total":289910292480,"available":289814003712,"internally_reserved":0,"allocated":688128,"data_stored":1356856,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.339410"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541340+0000","last_change":"2024-04-19T04:24:20.550082+0000","last_active":"2024-04-19T04:24:21.541340+0000","last_peered":"2024-04-19T04:24:21.541340+0000","last_clean":"2024-04-19T04:24:21.541340+0000","last_became_active":"2024-04-19T04:24:20.549529+0000","last_became_peered":"2024-04-19T04:24:20.549529+0000","last_unstale":"2024-04-19T04:24:21.541340+0000","last_undegraded":"2024-04-19T04:24:21.541340+0000","last_fullsized":"2024-04-19T04:24:21.541340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:27.393720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540906+0000","last_change":"2024-04-19T04:24:20.545709+0000","last_active":"2024-04-19T04:24:21.540906+0000","last_peered":"2024-04-19T04:24:21.540906+0000","last_clean":"2024-04-19T04:24:21.540906+0000","last_became_active":"2024-04-19T04:24:20.544962+0000","last_became_peered":"2024-04-19T04:24:20.544962+0000","last_unstale":"2024-04-19T04:24:21.540906+0000","last_undegraded":"2024-04-19T04:24:21.540906+0000","last_fullsized":"2024-04-19T04:24:21.540906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:06.452910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608479+0000","last_change":"2024-04-19T04:24:20.556199+0000","last_active":"2024-04-19T04:24:21.608479+0000","last_peered":"2024-04-19T04:24:21.608479+0000","last_clean":"2024-04-19T04:24:21.608479+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:24:21.608479+0000","last_undegraded":"2024-04-19T04:24:21.608479+0000","last_fullsized":"2024-04-19T04:24:21.608479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:14.348910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608071+0000","last_change":"2024-04-19T04:24:20.552787+0000","last_active":"2024-04-19T04:24:21.608071+0000","last_peered":"2024-04-19T04:24:21.608071+0000","last_clean":"2024-04-19T04:24:21.608071+0000","last_became_active":"2024-04-19T04:24:20.551784+0000","last_became_peered":"2024-04-19T04:24:20.551784+0000","last_unstale":"2024-04-19T04:24:21.608071+0000","last_undegraded":"2024-04-19T04:24:21.608071+0000","last_fullsized":"2024-04-19T04:24:21.608071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:21.734428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541302+0000","last_change":"2024-04-19T04:24:20.550112+0000","last_active":"2024-04-19T04:24:21.541302+0000","last_peered":"2024-04-19T04:24:21.541302+0000","last_clean":"2024-04-19T04:24:21.541302+0000","last_became_active":"2024-04-19T04:24:20.549620+0000","last_became_peered":"2024-04-19T04:24:20.549620+0000","last_unstale":"2024-04-19T04:24:21.541302+0000","last_undegraded":"2024-04-19T04:24:21.541302+0000","last_fullsized":"2024-04-19T04:24:21.541302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:03:50.416299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607265+0000","last_change":"2024-04-19T04:24:20.551576+0000","last_active":"2024-04-19T04:24:21.607265+0000","last_peered":"2024-04-19T04:24:21.607265+0000","last_clean":"2024-04-19T04:24:21.607265+0000","last_became_active":"2024-04-19T04:24:20.548600+0000","last_became_peered":"2024-04-19T04:24:20.548600+0000","last_unstale":"2024-04-19T04:24:21.607265+0000","last_undegraded":"2024-04-19T04:24:21.607265+0000","last_fullsized":"2024-04-19T04:24:21.607265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:39.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607230+0000","last_change":"2024-04-19T04:24:20.550337+0000","last_active":"2024-04-19T04:24:21.607230+0000","last_peered":"2024-04-19T04:24:21.607230+0000","last_clean":"2024-04-19T04:24:21.607230+0000","last_became_active":"2024-04-19T04:24:20.548514+0000","last_became_peered":"2024-04-19T04:24:20.548514+0000","last_unstale":"2024-04-19T04:24:21.607230+0000","last_undegraded":"2024-04-19T04:24:21.607230+0000","last_fullsized":"2024-04-19T04:24:21.607230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:14.194572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606529+0000","last_change":"2024-04-19T04:24:20.553787+0000","last_active":"2024-04-19T04:24:21.606529+0000","last_peered":"2024-04-19T04:24:21.606529+0000","last_clean":"2024-04-19T04:24:21.606529+0000","last_became_active":"2024-04-19T04:24:20.553410+0000","last_became_peered":"2024-04-19T04:24:20.553410+0000","last_unstale":"2024-04-19T04:24:21.606529+0000","last_undegraded":"2024-04-19T04:24:21.606529+0000","last_fullsized":"2024-04-19T04:24:21.606529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:00.475711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538444+0000","last_change":"2024-04-19T04:24:20.547585+0000","last_active":"2024-04-19T04:24:21.538444+0000","last_peered":"2024-04-19T04:24:21.538444+0000","last_clean":"2024-04-19T04:24:21.538444+0000","last_became_active":"2024-04-19T04:24:20.547395+0000","last_became_peered":"2024-04-19T04:24:20.547395+0000","last_unstale":"2024-04-19T04:24:21.538444+0000","last_undegraded":"2024-04-19T04:24:21.538444+0000","last_fullsized":"2024-04-19T04:24:21.538444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:15.398090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540977+0000","last_change":"2024-04-19T04:24:20.546893+0000","last_active":"2024-04-19T04:24:21.540977+0000","last_peered":"2024-04-19T04:24:21.540977+0000","last_clean":"2024-04-19T04:24:21.540977+0000","last_became_active":"2024-04-19T04:24:20.546257+0000","last_became_peered":"2024-04-19T04:24:20.546257+0000","last_unstale":"2024-04-19T04:24:21.540977+0000","last_undegraded":"2024-04-19T04:24:21.540977+0000","last_fullsized":"2024-04-19T04:24:21.540977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:47.327841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608401+0000","last_change":"2024-04-19T04:24:20.556382+0000","last_active":"2024-04-19T04:24:21.608401+0000","last_peered":"2024-04-19T04:24:21.608401+0000","last_clean":"2024-04-19T04:24:21.608401+0000","last_became_active":"2024-04-19T04:24:20.555246+0000","last_became_peered":"2024-04-19T04:24:20.555246+0000","last_unstale":"2024-04-19T04:24:21.608401+0000","last_undegraded":"2024-04-19T04:24:21.608401+0000","last_fullsized":"2024-04-19T04:24:21.608401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:37:15.332493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540961+0000","last_change":"2024-04-19T04:24:20.558886+0000","last_active":"2024-04-19T04:24:21.540961+0000","last_peered":"2024-04-19T04:24:21.540961+0000","last_clean":"2024-04-19T04:24:21.540961+0000","last_became_active":"2024-04-19T04:24:20.558293+0000","last_became_peered":"2024-04-19T04:24:20.558293+0000","last_unstale":"2024-04-19T04:24:21.540961+0000","last_undegraded":"2024-04-19T04:24:21.540961+0000","last_fullsized":"2024-04-19T04:24:21.540961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:37:15.332493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540418+0000","last_change":"2024-04-19T04:24:20.545891+0000","last_active":"2024-04-19T04:24:21.540418+0000","last_peered":"2024-04-19T04:24:21.540418+0000","last_clean":"2024-04-19T04:24:21.540418+0000","last_became_active":"2024-04-19T04:24:20.545422+0000","last_became_peered":"2024-04-19T04:24:20.545422+0000","last_unstale":"2024-04-19T04:24:21.540418+0000","last_undegraded":"2024-04-19T04:24:21.540418+0000","last_fullsized":"2024-04-19T04:24:21.540418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:31:52.562663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607344+0000","last_change":"2024-04-19T04:24:20.552690+0000","last_active":"2024-04-19T04:24:21.607344+0000","last_peered":"2024-04-19T04:24:21.607344+0000","last_clean":"2024-04-19T04:24:21.607344+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:24:21.607344+0000","last_undegraded":"2024-04-19T04:24:21.607344+0000","last_fullsized":"2024-04-19T04:24:21.607344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:53:16.890992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607404+0000","last_change":"2024-04-19T04:24:20.551809+0000","last_active":"2024-04-19T04:24:21.607404+0000","last_peered":"2024-04-19T04:24:21.607404+0000","last_clean":"2024-04-19T04:24:21.607404+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:24:21.607404+0000","last_undegraded":"2024-04-19T04:24:21.607404+0000","last_fullsized":"2024-04-19T04:24:21.607404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:43:31.281765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606723+0000","last_change":"2024-04-19T04:24:20.552758+0000","last_active":"2024-04-19T04:24:21.606723+0000","last_peered":"2024-04-19T04:24:21.606723+0000","last_clean":"2024-04-19T04:24:21.606723+0000","last_became_active":"2024-04-19T04:24:20.548882+0000","last_became_peered":"2024-04-19T04:24:20.548882+0000","last_unstale":"2024-04-19T04:24:21.606723+0000","last_undegraded":"2024-04-19T04:24:21.606723+0000","last_fullsized":"2024-04-19T04:24:21.606723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:56.738569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539114+0000","last_change":"2024-04-19T04:24:20.546173+0000","last_active":"2024-04-19T04:24:21.539114+0000","last_peered":"2024-04-19T04:24:21.539114+0000","last_clean":"2024-04-19T04:24:21.539114+0000","last_became_active":"2024-04-19T04:24:20.545582+0000","last_became_peered":"2024-04-19T04:24:20.545582+0000","last_unstale":"2024-04-19T04:24:21.539114+0000","last_undegraded":"2024-04-19T04:24:21.539114+0000","last_fullsized":"2024-04-19T04:24:21.539114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:55.955786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541323+0000","last_change":"2024-04-19T04:24:20.549835+0000","last_active":"2024-04-19T04:24:21.541323+0000","last_peered":"2024-04-19T04:24:21.541323+0000","last_clean":"2024-04-19T04:24:21.541323+0000","last_became_active":"2024-04-19T04:24:20.549411+0000","last_became_peered":"2024-04-19T04:24:20.549411+0000","last_unstale":"2024-04-19T04:24:21.541323+0000","last_undegraded":"2024-04-19T04:24:21.541323+0000","last_fullsized":"2024-04-19T04:24:21.541323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:31:11.088424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538186+0000","last_change":"2024-04-19T04:24:20.546517+0000","last_active":"2024-04-19T04:24:21.538186+0000","last_peered":"2024-04-19T04:24:21.538186+0000","last_clean":"2024-04-19T04:24:21.538186+0000","last_became_active":"2024-04-19T04:24:20.546116+0000","last_became_peered":"2024-04-19T04:24:20.546116+0000","last_unstale":"2024-04-19T04:24:21.538186+0000","last_undegraded":"2024-04-19T04:24:21.538186+0000","last_fullsized":"2024-04-19T04:24:21.538186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:28:06.813455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608191+0000","last_change":"2024-04-19T04:24:20.551326+0000","last_active":"2024-04-19T04:24:21.608191+0000","last_peered":"2024-04-19T04:24:21.608191+0000","last_clean":"2024-04-19T04:24:21.608191+0000","last_became_active":"2024-04-19T04:24:20.550246+0000","last_became_peered":"2024-04-19T04:24:20.550246+0000","last_unstale":"2024-04-19T04:24:21.608191+0000","last_undegraded":"2024-04-19T04:24:21.608191+0000","last_fullsized":"2024-04-19T04:24:21.608191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:12.211801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608194+0000","last_change":"2024-04-19T04:24:20.556352+0000","last_active":"2024-04-19T04:24:21.608194+0000","last_peered":"2024-04-19T04:24:21.608194+0000","last_clean":"2024-04-19T04:24:21.608194+0000","last_became_active":"2024-04-19T04:24:20.554294+0000","last_became_peered":"2024-04-19T04:24:20.554294+0000","last_unstale":"2024-04-19T04:24:21.608194+0000","last_undegraded":"2024-04-19T04:24:21.608194+0000","last_fullsized":"2024-04-19T04:24:21.608194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:06.452910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540048+0000","last_change":"2024-04-19T04:24:20.555257+0000","last_active":"2024-04-19T04:24:21.540048+0000","last_peered":"2024-04-19T04:24:21.540048+0000","last_clean":"2024-04-19T04:24:21.540048+0000","last_became_active":"2024-04-19T04:24:20.554895+0000","last_became_peered":"2024-04-19T04:24:20.554895+0000","last_unstale":"2024-04-19T04:24:21.540048+0000","last_undegraded":"2024-04-19T04:24:21.540048+0000","last_fullsized":"2024-04-19T04:24:21.540048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:39.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536664+0000","last_change":"2024-04-19T04:24:20.549936+0000","last_active":"2024-04-19T04:24:21.536664+0000","last_peered":"2024-04-19T04:24:21.536664+0000","last_clean":"2024-04-19T04:24:21.536664+0000","last_became_active":"2024-04-19T04:24:20.549428+0000","last_became_peered":"2024-04-19T04:24:20.549428+0000","last_unstale":"2024-04-19T04:24:21.536664+0000","last_undegraded":"2024-04-19T04:24:21.536664+0000","last_fullsized":"2024-04-19T04:24:21.536664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:44:47.158480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539602+0000","last_change":"2024-04-19T04:24:20.546315+0000","last_active":"2024-04-19T04:24:21.539602+0000","last_peered":"2024-04-19T04:24:21.539602+0000","last_clean":"2024-04-19T04:24:21.539602+0000","last_became_active":"2024-04-19T04:24:20.545851+0000","last_became_peered":"2024-04-19T04:24:20.545851+0000","last_unstale":"2024-04-19T04:24:21.539602+0000","last_undegraded":"2024-04-19T04:24:21.539602+0000","last_fullsized":"2024-04-19T04:24:21.539602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:07:48.905896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541518+0000","last_change":"2024-04-19T04:24:20.554855+0000","last_active":"2024-04-19T04:24:21.541518+0000","last_peered":"2024-04-19T04:24:21.541518+0000","last_clean":"2024-04-19T04:24:21.541518+0000","last_became_active":"2024-04-19T04:24:20.554383+0000","last_became_peered":"2024-04-19T04:24:20.554383+0000","last_unstale":"2024-04-19T04:24:21.541518+0000","last_undegraded":"2024-04-19T04:24:21.541518+0000","last_fullsized":"2024-04-19T04:24:21.541518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:18:50.807364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538534+0000","last_change":"2024-04-19T04:24:20.546410+0000","last_active":"2024-04-19T04:24:21.538534+0000","last_peered":"2024-04-19T04:24:21.538534+0000","last_clean":"2024-04-19T04:24:21.538534+0000","last_became_active":"2024-04-19T04:24:20.545607+0000","last_became_peered":"2024-04-19T04:24:20.545607+0000","last_unstale":"2024-04-19T04:24:21.538534+0000","last_undegraded":"2024-04-19T04:24:21.538534+0000","last_fullsized":"2024-04-19T04:24:21.538534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:03.482984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608645+0000","last_change":"2024-04-19T04:24:20.554885+0000","last_active":"2024-04-19T04:24:21.608645+0000","last_peered":"2024-04-19T04:24:21.608645+0000","last_clean":"2024-04-19T04:24:21.608645+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:24:21.608645+0000","last_undegraded":"2024-04-19T04:24:21.608645+0000","last_fullsized":"2024-04-19T04:24:21.608645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:44:08.285518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541646+0000","last_change":"2024-04-19T04:24:20.558702+0000","last_active":"2024-04-19T04:24:21.541646+0000","last_peered":"2024-04-19T04:24:21.541646+0000","last_clean":"2024-04-19T04:24:21.541646+0000","last_became_active":"2024-04-19T04:24:20.558202+0000","last_became_peered":"2024-04-19T04:24:20.558202+0000","last_unstale":"2024-04-19T04:24:21.541646+0000","last_undegraded":"2024-04-19T04:24:21.541646+0000","last_fullsized":"2024-04-19T04:24:21.541646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:56.738569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537991+0000","last_change":"2024-04-19T04:24:20.543906+0000","last_active":"2024-04-19T04:24:21.537991+0000","last_peered":"2024-04-19T04:24:21.537991+0000","last_clean":"2024-04-19T04:24:21.537991+0000","last_became_active":"2024-04-19T04:24:20.543531+0000","last_became_peered":"2024-04-19T04:24:20.543531+0000","last_unstale":"2024-04-19T04:24:21.537991+0000","last_undegraded":"2024-04-19T04:24:21.537991+0000","last_fullsized":"2024-04-19T04:24:21.537991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:28:04.850289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540345+0000","last_change":"2024-04-19T04:24:20.554847+0000","last_active":"2024-04-19T04:24:21.540345+0000","last_peered":"2024-04-19T04:24:21.540345+0000","last_clean":"2024-04-19T04:24:21.540345+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:24:21.540345+0000","last_undegraded":"2024-04-19T04:24:21.540345+0000","last_fullsized":"2024-04-19T04:24:21.540345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:00.475711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536735+0000","last_change":"2024-04-19T04:24:20.546826+0000","last_active":"2024-04-19T04:24:21.536735+0000","last_peered":"2024-04-19T04:24:21.536735+0000","last_clean":"2024-04-19T04:24:21.536735+0000","last_became_active":"2024-04-19T04:24:20.546065+0000","last_became_peered":"2024-04-19T04:24:20.546065+0000","last_unstale":"2024-04-19T04:24:21.536735+0000","last_undegraded":"2024-04-19T04:24:21.536735+0000","last_fullsized":"2024-04-19T04:24:21.536735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:47.956234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606802+0000","last_change":"2024-04-19T04:24:20.552289+0000","last_active":"2024-04-19T04:24:21.606802+0000","last_peered":"2024-04-19T04:24:21.606802+0000","last_clean":"2024-04-19T04:24:21.606802+0000","last_became_active":"2024-04-19T04:24:20.548755+0000","last_became_peered":"2024-04-19T04:24:20.548755+0000","last_unstale":"2024-04-19T04:24:21.606802+0000","last_undegraded":"2024-04-19T04:24:21.606802+0000","last_fullsized":"2024-04-19T04:24:21.606802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541554+0000","last_change":"2024-04-19T04:24:20.546223+0000","last_active":"2024-04-19T04:24:21.541554+0000","last_peered":"2024-04-19T04:24:21.541554+0000","last_clean":"2024-04-19T04:24:21.541554+0000","last_became_active":"2024-04-19T04:24:20.545807+0000","last_became_peered":"2024-04-19T04:24:20.545807+0000","last_unstale":"2024-04-19T04:24:21.541554+0000","last_undegraded":"2024-04-19T04:24:21.541554+0000","last_fullsized":"2024-04-19T04:24:21.541554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:19.894104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608609+0000","last_change":"2024-04-19T04:24:20.184870+0000","last_active":"2024-04-19T04:24:21.608609+0000","last_peered":"2024-04-19T04:24:21.608609+0000","last_clean":"2024-04-19T04:24:21.608609+0000","last_became_active":"2024-04-19T04:24:20.183615+0000","last_became_peered":"2024-04-19T04:24:20.183615+0000","last_unstale":"2024-04-19T04:24:21.608609+0000","last_undegraded":"2024-04-19T04:24:21.608609+0000","last_fullsized":"2024-04-19T04:24:21.608609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:52:38.272121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541893+0000","last_change":"2024-04-19T04:24:20.547475+0000","last_active":"2024-04-19T04:24:21.541893+0000","last_peered":"2024-04-19T04:24:21.541893+0000","last_clean":"2024-04-19T04:24:21.541893+0000","last_became_active":"2024-04-19T04:24:20.546615+0000","last_became_peered":"2024-04-19T04:24:20.546615+0000","last_unstale":"2024-04-19T04:24:21.541893+0000","last_undegraded":"2024-04-19T04:24:21.541893+0000","last_fullsized":"2024-04-19T04:24:21.541893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:24.049904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537755+0000","last_change":"2024-04-19T04:24:20.177739+0000","last_active":"2024-04-19T04:24:21.537755+0000","last_peered":"2024-04-19T04:24:21.537755+0000","last_clean":"2024-04-19T04:24:21.537755+0000","last_became_active":"2024-04-19T04:24:20.177328+0000","last_became_peered":"2024-04-19T04:24:20.177328+0000","last_unstale":"2024-04-19T04:24:21.537755+0000","last_undegraded":"2024-04-19T04:24:21.537755+0000","last_fullsized":"2024-04-19T04:24:21.537755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:27.902190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538848+0000","last_change":"2024-04-19T04:24:20.547144+0000","last_active":"2024-04-19T04:24:21.538848+0000","last_peered":"2024-04-19T04:24:21.538848+0000","last_clean":"2024-04-19T04:24:21.538848+0000","last_became_active":"2024-04-19T04:24:20.546814+0000","last_became_peered":"2024-04-19T04:24:20.546814+0000","last_unstale":"2024-04-19T04:24:21.538848+0000","last_undegraded":"2024-04-19T04:24:21.538848+0000","last_fullsized":"2024-04-19T04:24:21.538848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:04.710943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540345+0000","last_change":"2024-04-19T04:24:20.183855+0000","last_active":"2024-04-19T04:24:21.540345+0000","last_peered":"2024-04-19T04:24:21.540345+0000","last_clean":"2024-04-19T04:24:21.540345+0000","last_became_active":"2024-04-19T04:24:20.183272+0000","last_became_peered":"2024-04-19T04:24:20.183272+0000","last_unstale":"2024-04-19T04:24:21.540345+0000","last_undegraded":"2024-04-19T04:24:21.540345+0000","last_fullsized":"2024-04-19T04:24:21.540345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:54.737330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538578+0000","last_change":"2024-04-19T04:24:20.551347+0000","last_active":"2024-04-19T04:24:21.538578+0000","last_peered":"2024-04-19T04:24:21.538578+0000","last_clean":"2024-04-19T04:24:21.538578+0000","last_became_active":"2024-04-19T04:24:20.550917+0000","last_became_peered":"2024-04-19T04:24:20.550917+0000","last_unstale":"2024-04-19T04:24:21.538578+0000","last_undegraded":"2024-04-19T04:24:21.538578+0000","last_fullsized":"2024-04-19T04:24:21.538578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:47.732617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606983+0000","last_change":"2024-04-19T04:24:20.187299+0000","last_active":"2024-04-19T04:24:21.606983+0000","last_peered":"2024-04-19T04:24:21.606983+0000","last_clean":"2024-04-19T04:24:21.606983+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:24:21.606983+0000","last_undegraded":"2024-04-19T04:24:21.606983+0000","last_fullsized":"2024-04-19T04:24:21.606983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:49:37.812125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609542+0000","last_change":"2024-04-19T04:24:20.186029+0000","last_active":"2024-04-19T04:24:21.609542+0000","last_peered":"2024-04-19T04:24:21.609542+0000","last_clean":"2024-04-19T04:24:21.609542+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:24:21.609542+0000","last_undegraded":"2024-04-19T04:24:21.609542+0000","last_fullsized":"2024-04-19T04:24:21.609542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:49.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539569+0000","last_change":"2024-04-19T04:24:20.555751+0000","last_active":"2024-04-19T04:24:21.539569+0000","last_peered":"2024-04-19T04:24:21.539569+0000","last_clean":"2024-04-19T04:24:21.539569+0000","last_became_active":"2024-04-19T04:24:20.555501+0000","last_became_peered":"2024-04-19T04:24:20.555501+0000","last_unstale":"2024-04-19T04:24:21.539569+0000","last_undegraded":"2024-04-19T04:24:21.539569+0000","last_fullsized":"2024-04-19T04:24:21.539569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:57.839930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541919+0000","last_change":"2024-04-19T04:24:20.184142+0000","last_active":"2024-04-19T04:24:21.541919+0000","last_peered":"2024-04-19T04:24:21.541919+0000","last_clean":"2024-04-19T04:24:21.541919+0000","last_became_active":"2024-04-19T04:24:20.183546+0000","last_became_peered":"2024-04-19T04:24:20.183546+0000","last_unstale":"2024-04-19T04:24:21.541919+0000","last_undegraded":"2024-04-19T04:24:21.541919+0000","last_fullsized":"2024-04-19T04:24:21.541919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:17.280977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539845+0000","last_change":"2024-04-19T04:24:20.545490+0000","last_active":"2024-04-19T04:24:21.539845+0000","last_peered":"2024-04-19T04:24:21.539845+0000","last_clean":"2024-04-19T04:24:21.539845+0000","last_became_active":"2024-04-19T04:24:20.544898+0000","last_became_peered":"2024-04-19T04:24:20.544898+0000","last_unstale":"2024-04-19T04:24:21.539845+0000","last_undegraded":"2024-04-19T04:24:21.539845+0000","last_fullsized":"2024-04-19T04:24:21.539845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:40:02.138518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609093+0000","last_change":"2024-04-19T04:24:20.186044+0000","last_active":"2024-04-19T04:24:21.609093+0000","last_peered":"2024-04-19T04:24:21.609093+0000","last_clean":"2024-04-19T04:24:21.609093+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:24:21.609093+0000","last_undegraded":"2024-04-19T04:24:21.609093+0000","last_fullsized":"2024-04-19T04:24:21.609093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.432692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607445+0000","last_change":"2024-04-19T04:24:20.552828+0000","last_active":"2024-04-19T04:24:21.607445+0000","last_peered":"2024-04-19T04:24:21.607445+0000","last_clean":"2024-04-19T04:24:21.607445+0000","last_became_active":"2024-04-19T04:24:20.551927+0000","last_became_peered":"2024-04-19T04:24:20.551927+0000","last_unstale":"2024-04-19T04:24:21.607445+0000","last_undegraded":"2024-04-19T04:24:21.607445+0000","last_fullsized":"2024-04-19T04:24:21.607445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:41.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608700+0000","last_change":"2024-04-19T04:24:20.179238+0000","last_active":"2024-04-19T04:24:21.608700+0000","last_peered":"2024-04-19T04:24:21.608700+0000","last_clean":"2024-04-19T04:24:21.608700+0000","last_became_active":"2024-04-19T04:24:20.178758+0000","last_became_peered":"2024-04-19T04:24:20.178758+0000","last_unstale":"2024-04-19T04:24:21.608700+0000","last_undegraded":"2024-04-19T04:24:21.608700+0000","last_fullsized":"2024-04-19T04:24:21.608700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:18:24.789775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537600+0000","last_change":"2024-04-19T04:24:20.554969+0000","last_active":"2024-04-19T04:24:21.537600+0000","last_peered":"2024-04-19T04:24:21.537600+0000","last_clean":"2024-04-19T04:24:21.537600+0000","last_became_active":"2024-04-19T04:24:20.554604+0000","last_became_peered":"2024-04-19T04:24:20.554604+0000","last_unstale":"2024-04-19T04:24:21.537600+0000","last_undegraded":"2024-04-19T04:24:21.537600+0000","last_fullsized":"2024-04-19T04:24:21.537600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:58:47.703110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538228+0000","last_change":"2024-04-19T04:24:20.178602+0000","last_active":"2024-04-19T04:24:21.538228+0000","last_peered":"2024-04-19T04:24:21.538228+0000","last_clean":"2024-04-19T04:24:21.538228+0000","last_became_active":"2024-04-19T04:24:20.177976+0000","last_became_peered":"2024-04-19T04:24:20.177976+0000","last_unstale":"2024-04-19T04:24:21.538228+0000","last_undegraded":"2024-04-19T04:24:21.538228+0000","last_fullsized":"2024-04-19T04:24:21.538228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:15.883790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608409+0000","last_change":"2024-04-19T04:24:20.548296+0000","last_active":"2024-04-19T04:24:21.608409+0000","last_peered":"2024-04-19T04:24:21.608409+0000","last_clean":"2024-04-19T04:24:21.608409+0000","last_became_active":"2024-04-19T04:24:20.547457+0000","last_became_peered":"2024-04-19T04:24:20.547457+0000","last_unstale":"2024-04-19T04:24:21.608409+0000","last_undegraded":"2024-04-19T04:24:21.608409+0000","last_fullsized":"2024-04-19T04:24:21.608409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:57.839930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607638+0000","last_change":"2024-04-19T04:24:20.184338+0000","last_active":"2024-04-19T04:24:21.607638+0000","last_peered":"2024-04-19T04:24:21.607638+0000","last_clean":"2024-04-19T04:24:21.607638+0000","last_became_active":"2024-04-19T04:24:20.183511+0000","last_became_peered":"2024-04-19T04:24:20.183511+0000","last_unstale":"2024-04-19T04:24:21.607638+0000","last_undegraded":"2024-04-19T04:24:21.607638+0000","last_fullsized":"2024-04-19T04:24:21.607638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:14.235823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608849+0000","last_change":"2024-04-19T04:24:20.555922+0000","last_active":"2024-04-19T04:24:21.608849+0000","last_peered":"2024-04-19T04:24:21.608849+0000","last_clean":"2024-04-19T04:24:21.608849+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:24:21.608849+0000","last_undegraded":"2024-04-19T04:24:21.608849+0000","last_fullsized":"2024-04-19T04:24:21.608849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:06:53.595149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540165+0000","last_change":"2024-04-19T04:24:20.183944+0000","last_active":"2024-04-19T04:24:21.540165+0000","last_peered":"2024-04-19T04:24:21.540165+0000","last_clean":"2024-04-19T04:24:21.540165+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:24:21.540165+0000","last_undegraded":"2024-04-19T04:24:21.540165+0000","last_fullsized":"2024-04-19T04:24:21.540165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:42.018487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608707+0000","last_change":"2024-04-19T04:24:20.553085+0000","last_active":"2024-04-19T04:24:21.608707+0000","last_peered":"2024-04-19T04:24:21.608707+0000","last_clean":"2024-04-19T04:24:21.608707+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:24:21.608707+0000","last_undegraded":"2024-04-19T04:24:21.608707+0000","last_fullsized":"2024-04-19T04:24:21.608707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:07:21.467758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539831+0000","last_change":"2024-04-19T04:24:20.180834+0000","last_active":"2024-04-19T04:24:21.539831+0000","last_peered":"2024-04-19T04:24:21.539831+0000","last_clean":"2024-04-19T04:24:21.539831+0000","last_became_active":"2024-04-19T04:24:20.180522+0000","last_became_peered":"2024-04-19T04:24:20.180522+0000","last_unstale":"2024-04-19T04:24:21.539831+0000","last_undegraded":"2024-04-19T04:24:21.539831+0000","last_fullsized":"2024-04-19T04:24:21.539831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:38:28.208268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538763+0000","last_change":"2024-04-19T04:24:20.547313+0000","last_active":"2024-04-19T04:24:21.538763+0000","last_peered":"2024-04-19T04:24:21.538763+0000","last_clean":"2024-04-19T04:24:21.538763+0000","last_became_active":"2024-04-19T04:24:20.545692+0000","last_became_peered":"2024-04-19T04:24:20.545692+0000","last_unstale":"2024-04-19T04:24:21.538763+0000","last_undegraded":"2024-04-19T04:24:21.538763+0000","last_fullsized":"2024-04-19T04:24:21.538763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:24:42.844961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.547904+0000","last_change":"2024-04-19T04:24:10.106278+0000","last_active":"2024-04-19T04:24:20.547904+0000","last_peered":"2024-04-19T04:24:20.547904+0000","last_clean":"2024-04-19T04:24:20.547904+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:24:20.547904+0000","last_undegraded":"2024-04-19T04:24:20.547904+0000","last_fullsized":"2024-04-19T04:24:20.547904+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_clean_scrub_stamp":"2024-04-19T04:24:09.083488+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.549706+0000","last_change":"2024-04-19T04:24:16.144872+0000","last_active":"2024-04-19T04:24:20.549706+0000","last_peered":"2024-04-19T04:24:20.549706+0000","last_clean":"2024-04-19T04:24:20.549706+0000","last_became_active":"2024-04-19T04:24:16.143778+0000","last_became_peered":"2024-04-19T04:24:16.143778+0000","last_unstale":"2024-04-19T04:24:20.549706+0000","last_undegraded":"2024-04-19T04:24:20.549706+0000","last_fullsized":"2024-04-19T04:24:20.549706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:26:06.303713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538038+0000","last_change":"2024-04-19T04:24:20.174958+0000","last_active":"2024-04-19T04:24:21.538038+0000","last_peered":"2024-04-19T04:24:21.538038+0000","last_clean":"2024-04-19T04:24:21.538038+0000","last_became_active":"2024-04-19T04:24:20.174643+0000","last_became_peered":"2024-04-19T04:24:20.174643+0000","last_unstale":"2024-04-19T04:24:21.538038+0000","last_undegraded":"2024-04-19T04:24:21.538038+0000","last_fullsized":"2024-04-19T04:24:21.538038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:37.752236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608950+0000","last_change":"2024-04-19T04:24:20.553999+0000","last_active":"2024-04-19T04:24:21.608950+0000","last_peered":"2024-04-19T04:24:21.608950+0000","last_clean":"2024-04-19T04:24:21.608950+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:24:21.608950+0000","last_undegraded":"2024-04-19T04:24:21.608950+0000","last_fullsized":"2024-04-19T04:24:21.608950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:13:53.306369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.546806+0000","last_change":"2024-04-19T04:24:16.144482+0000","last_active":"2024-04-19T04:24:20.546806+0000","last_peered":"2024-04-19T04:24:20.546806+0000","last_clean":"2024-04-19T04:24:20.546806+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:24:20.546806+0000","last_undegraded":"2024-04-19T04:24:20.546806+0000","last_fullsized":"2024-04-19T04:24:20.546806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:15.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537224+0000","last_change":"2024-04-19T04:24:20.179129+0000","last_active":"2024-04-19T04:24:21.537224+0000","last_peered":"2024-04-19T04:24:21.537224+0000","last_clean":"2024-04-19T04:24:21.537224+0000","last_became_active":"2024-04-19T04:24:20.178247+0000","last_became_peered":"2024-04-19T04:24:20.178247+0000","last_unstale":"2024-04-19T04:24:21.537224+0000","last_undegraded":"2024-04-19T04:24:21.537224+0000","last_fullsized":"2024-04-19T04:24:21.537224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:51.616306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541152+0000","last_change":"2024-04-19T04:24:20.550166+0000","last_active":"2024-04-19T04:24:21.541152+0000","last_peered":"2024-04-19T04:24:21.541152+0000","last_clean":"2024-04-19T04:24:21.541152+0000","last_became_active":"2024-04-19T04:24:20.549606+0000","last_became_peered":"2024-04-19T04:24:20.549606+0000","last_unstale":"2024-04-19T04:24:21.541152+0000","last_undegraded":"2024-04-19T04:24:21.541152+0000","last_fullsized":"2024-04-19T04:24:21.541152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:41.685120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.533460+0000","last_change":"2024-04-19T04:24:16.135584+0000","last_active":"2024-04-19T04:24:20.533460+0000","last_peered":"2024-04-19T04:24:20.533460+0000","last_clean":"2024-04-19T04:24:20.533460+0000","last_became_active":"2024-04-19T04:24:16.134799+0000","last_became_peered":"2024-04-19T04:24:16.134799+0000","last_unstale":"2024-04-19T04:24:20.533460+0000","last_undegraded":"2024-04-19T04:24:20.533460+0000","last_fullsized":"2024-04-19T04:24:20.533460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:55:57.442649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539948+0000","last_change":"2024-04-19T04:24:20.183933+0000","last_active":"2024-04-19T04:24:21.539948+0000","last_peered":"2024-04-19T04:24:21.539948+0000","last_clean":"2024-04-19T04:24:21.539948+0000","last_became_active":"2024-04-19T04:24:20.183490+0000","last_became_peered":"2024-04-19T04:24:20.183490+0000","last_unstale":"2024-04-19T04:24:21.539948+0000","last_undegraded":"2024-04-19T04:24:21.539948+0000","last_fullsized":"2024-04-19T04:24:21.539948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:43.869727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538758+0000","last_change":"2024-04-19T04:24:20.544687+0000","last_active":"2024-04-19T04:24:21.538758+0000","last_peered":"2024-04-19T04:24:21.538758+0000","last_clean":"2024-04-19T04:24:21.538758+0000","last_became_active":"2024-04-19T04:24:20.544430+0000","last_became_peered":"2024-04-19T04:24:20.544430+0000","last_unstale":"2024-04-19T04:24:21.538758+0000","last_undegraded":"2024-04-19T04:24:21.538758+0000","last_fullsized":"2024-04-19T04:24:21.538758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:11:22.765812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.548059+0000","last_change":"2024-04-19T04:24:16.145124+0000","last_active":"2024-04-19T04:24:20.548059+0000","last_peered":"2024-04-19T04:24:20.548059+0000","last_clean":"2024-04-19T04:24:20.548059+0000","last_became_active":"2024-04-19T04:24:16.143949+0000","last_became_peered":"2024-04-19T04:24:16.143949+0000","last_unstale":"2024-04-19T04:24:20.548059+0000","last_undegraded":"2024-04-19T04:24:20.548059+0000","last_fullsized":"2024-04-19T04:24:20.548059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:18.901615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608836+0000","last_change":"2024-04-19T04:24:20.179004+0000","last_active":"2024-04-19T04:24:21.608836+0000","last_peered":"2024-04-19T04:24:21.608836+0000","last_clean":"2024-04-19T04:24:21.608836+0000","last_became_active":"2024-04-19T04:24:20.178123+0000","last_became_peered":"2024-04-19T04:24:20.178123+0000","last_unstale":"2024-04-19T04:24:21.608836+0000","last_undegraded":"2024-04-19T04:24:21.608836+0000","last_fullsized":"2024-04-19T04:24:21.608836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:35:25.084528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538611+0000","last_change":"2024-04-19T04:24:20.544312+0000","last_active":"2024-04-19T04:24:21.538611+0000","last_peered":"2024-04-19T04:24:21.538611+0000","last_clean":"2024-04-19T04:24:21.538611+0000","last_became_active":"2024-04-19T04:24:20.543738+0000","last_became_peered":"2024-04-19T04:24:20.543738+0000","last_unstale":"2024-04-19T04:24:21.538611+0000","last_undegraded":"2024-04-19T04:24:21.538611+0000","last_fullsized":"2024-04-19T04:24:21.538611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:23.486532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609184+0000","last_change":"2024-04-19T04:24:20.184349+0000","last_active":"2024-04-19T04:24:21.609184+0000","last_peered":"2024-04-19T04:24:21.609184+0000","last_clean":"2024-04-19T04:24:21.609184+0000","last_became_active":"2024-04-19T04:24:20.183495+0000","last_became_peered":"2024-04-19T04:24:20.183495+0000","last_unstale":"2024-04-19T04:24:21.609184+0000","last_undegraded":"2024-04-19T04:24:21.609184+0000","last_fullsized":"2024-04-19T04:24:21.609184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:16:09.571178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.531994+0000","last_change":"2024-04-19T04:24:16.136119+0000","last_active":"2024-04-19T04:24:20.531994+0000","last_peered":"2024-04-19T04:24:20.531994+0000","last_clean":"2024-04-19T04:24:20.531994+0000","last_became_active":"2024-04-19T04:24:16.135272+0000","last_became_peered":"2024-04-19T04:24:16.135272+0000","last_unstale":"2024-04-19T04:24:20.531994+0000","last_undegraded":"2024-04-19T04:24:20.531994+0000","last_fullsized":"2024-04-19T04:24:20.531994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:07:14.180095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540172+0000","last_change":"2024-04-19T04:24:20.555116+0000","last_active":"2024-04-19T04:24:21.540172+0000","last_peered":"2024-04-19T04:24:21.540172+0000","last_clean":"2024-04-19T04:24:21.540172+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:24:21.540172+0000","last_undegraded":"2024-04-19T04:24:21.540172+0000","last_fullsized":"2024-04-19T04:24:21.540172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:21.734428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538645+0000","last_change":"2024-04-19T04:24:20.174833+0000","last_active":"2024-04-19T04:24:21.538645+0000","last_peered":"2024-04-19T04:24:21.538645+0000","last_clean":"2024-04-19T04:24:21.538645+0000","last_became_active":"2024-04-19T04:24:20.174517+0000","last_became_peered":"2024-04-19T04:24:20.174517+0000","last_unstale":"2024-04-19T04:24:21.538645+0000","last_undegraded":"2024-04-19T04:24:21.538645+0000","last_fullsized":"2024-04-19T04:24:21.538645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:51.699530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.536090+0000","last_change":"2024-04-19T04:24:16.141899+0000","last_active":"2024-04-19T04:24:20.536090+0000","last_peered":"2024-04-19T04:24:20.536090+0000","last_clean":"2024-04-19T04:24:20.536090+0000","last_became_active":"2024-04-19T04:24:16.141508+0000","last_became_peered":"2024-04-19T04:24:16.141508+0000","last_unstale":"2024-04-19T04:24:20.536090+0000","last_undegraded":"2024-04-19T04:24:20.536090+0000","last_fullsized":"2024-04-19T04:24:20.536090+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:31.719446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540502+0000","last_change":"2024-04-19T04:24:20.558559+0000","last_active":"2024-04-19T04:24:21.540502+0000","last_peered":"2024-04-19T04:24:21.540502+0000","last_clean":"2024-04-19T04:24:21.540502+0000","last_became_active":"2024-04-19T04:24:20.558215+0000","last_became_peered":"2024-04-19T04:24:20.558215+0000","last_unstale":"2024-04-19T04:24:21.540502+0000","last_undegraded":"2024-04-19T04:24:21.540502+0000","last_fullsized":"2024-04-19T04:24:21.540502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:41.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539118+0000","last_change":"2024-04-19T04:24:20.175205+0000","last_active":"2024-04-19T04:24:21.539118+0000","last_peered":"2024-04-19T04:24:21.539118+0000","last_clean":"2024-04-19T04:24:21.539118+0000","last_became_active":"2024-04-19T04:24:20.174912+0000","last_became_peered":"2024-04-19T04:24:20.174912+0000","last_unstale":"2024-04-19T04:24:21.539118+0000","last_undegraded":"2024-04-19T04:24:21.539118+0000","last_fullsized":"2024-04-19T04:24:21.539118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:21:37.681287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.533233+0000","last_change":"2024-04-19T04:24:16.135892+0000","last_active":"2024-04-19T04:24:20.533233+0000","last_peered":"2024-04-19T04:24:20.533233+0000","last_clean":"2024-04-19T04:24:20.533233+0000","last_became_active":"2024-04-19T04:24:16.135385+0000","last_became_peered":"2024-04-19T04:24:16.135385+0000","last_unstale":"2024-04-19T04:24:20.533233+0000","last_undegraded":"2024-04-19T04:24:20.533233+0000","last_fullsized":"2024-04-19T04:24:20.533233+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:37.110319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536977+0000","last_change":"2024-04-19T04:24:20.553486+0000","last_active":"2024-04-19T04:24:21.536977+0000","last_peered":"2024-04-19T04:24:21.536977+0000","last_clean":"2024-04-19T04:24:21.536977+0000","last_became_active":"2024-04-19T04:24:20.553206+0000","last_became_peered":"2024-04-19T04:24:20.553206+0000","last_unstale":"2024-04-19T04:24:21.536977+0000","last_undegraded":"2024-04-19T04:24:21.536977+0000","last_fullsized":"2024-04-19T04:24:21.536977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:32.648637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:23.878567+0000","last_change":"2024-04-19T04:24:20.178880+0000","last_active":"2024-04-19T04:24:23.878567+0000","last_peered":"2024-04-19T04:24:23.878567+0000","last_clean":"2024-04-19T04:24:23.878567+0000","last_became_active":"2024-04-19T04:24:20.177593+0000","last_became_peered":"2024-04-19T04:24:20.177593+0000","last_unstale":"2024-04-19T04:24:23.878567+0000","last_undegraded":"2024-04-19T04:24:23.878567+0000","last_fullsized":"2024-04-19T04:24:23.878567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:58:32.732477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.549281+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:24:20.549281+0000","last_peered":"2024-04-19T04:24:20.549281+0000","last_clean":"2024-04-19T04:24:20.549281+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:24:20.549281+0000","last_undegraded":"2024-04-19T04:24:20.549281+0000","last_fullsized":"2024-04-19T04:24:20.549281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:45.574813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539891+0000","last_change":"2024-04-19T04:24:20.554721+0000","last_active":"2024-04-19T04:24:21.539891+0000","last_peered":"2024-04-19T04:24:21.539891+0000","last_clean":"2024-04-19T04:24:21.539891+0000","last_became_active":"2024-04-19T04:24:20.554286+0000","last_became_peered":"2024-04-19T04:24:20.554286+0000","last_unstale":"2024-04-19T04:24:21.539891+0000","last_undegraded":"2024-04-19T04:24:21.539891+0000","last_fullsized":"2024-04-19T04:24:21.539891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:14.194572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608106+0000","last_change":"2024-04-19T04:24:20.555406+0000","last_active":"2024-04-19T04:24:21.608106+0000","last_peered":"2024-04-19T04:24:21.608106+0000","last_clean":"2024-04-19T04:24:21.608106+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:24:21.608106+0000","last_undegraded":"2024-04-19T04:24:21.608106+0000","last_fullsized":"2024-04-19T04:24:21.608106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:10.453970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608703+0000","last_change":"2024-04-19T04:24:20.185978+0000","last_active":"2024-04-19T04:24:21.608703+0000","last_peered":"2024-04-19T04:24:21.608703+0000","last_clean":"2024-04-19T04:24:21.608703+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:24:21.608703+0000","last_undegraded":"2024-04-19T04:24:21.608703+0000","last_fullsized":"2024-04-19T04:24:21.608703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:48.158805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537416+0000","last_change":"2024-04-19T04:24:20.544323+0000","last_active":"2024-04-19T04:24:21.537416+0000","last_peered":"2024-04-19T04:24:21.537416+0000","last_clean":"2024-04-19T04:24:21.537416+0000","last_became_active":"2024-04-19T04:24:20.543893+0000","last_became_peered":"2024-04-19T04:24:20.543893+0000","last_unstale":"2024-04-19T04:24:21.537416+0000","last_undegraded":"2024-04-19T04:24:21.537416+0000","last_fullsized":"2024-04-19T04:24:21.537416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:01.587027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.542097+0000","last_change":"2024-04-19T04:24:20.184342+0000","last_active":"2024-04-19T04:24:21.542097+0000","last_peered":"2024-04-19T04:24:21.542097+0000","last_clean":"2024-04-19T04:24:21.542097+0000","last_became_active":"2024-04-19T04:24:20.183970+0000","last_became_peered":"2024-04-19T04:24:20.183970+0000","last_unstale":"2024-04-19T04:24:21.542097+0000","last_undegraded":"2024-04-19T04:24:21.542097+0000","last_fullsized":"2024-04-19T04:24:21.542097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:46.956957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609216+0000","last_change":"2024-04-19T04:24:20.184508+0000","last_active":"2024-04-19T04:24:21.609216+0000","last_peered":"2024-04-19T04:24:21.609216+0000","last_clean":"2024-04-19T04:24:21.609216+0000","last_became_active":"2024-04-19T04:24:20.184060+0000","last_became_peered":"2024-04-19T04:24:20.184060+0000","last_unstale":"2024-04-19T04:24:21.609216+0000","last_undegraded":"2024-04-19T04:24:21.609216+0000","last_fullsized":"2024-04-19T04:24:21.609216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:14:57.634877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537342+0000","last_change":"2024-04-19T04:24:20.546949+0000","last_active":"2024-04-19T04:24:21.537342+0000","last_peered":"2024-04-19T04:24:21.537342+0000","last_clean":"2024-04-19T04:24:21.537342+0000","last_became_active":"2024-04-19T04:24:20.546029+0000","last_became_peered":"2024-04-19T04:24:20.546029+0000","last_unstale":"2024-04-19T04:24:21.537342+0000","last_undegraded":"2024-04-19T04:24:21.537342+0000","last_fullsized":"2024-04-19T04:24:21.537342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:22:06.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539031+0000","last_change":"2024-04-19T04:24:20.178672+0000","last_active":"2024-04-19T04:24:21.539031+0000","last_peered":"2024-04-19T04:24:21.539031+0000","last_clean":"2024-04-19T04:24:21.539031+0000","last_became_active":"2024-04-19T04:24:20.177921+0000","last_became_peered":"2024-04-19T04:24:20.177921+0000","last_unstale":"2024-04-19T04:24:21.539031+0000","last_undegraded":"2024-04-19T04:24:21.539031+0000","last_fullsized":"2024-04-19T04:24:21.539031+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:21.042990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536875+0000","last_change":"2024-04-19T04:24:20.546616+0000","last_active":"2024-04-19T04:24:21.536875+0000","last_peered":"2024-04-19T04:24:21.536875+0000","last_clean":"2024-04-19T04:24:21.536875+0000","last_became_active":"2024-04-19T04:24:20.546032+0000","last_became_peered":"2024-04-19T04:24:20.546032+0000","last_unstale":"2024-04-19T04:24:21.536875+0000","last_undegraded":"2024-04-19T04:24:21.536875+0000","last_fullsized":"2024-04-19T04:24:21.536875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:02:20.398899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541610+0000","last_change":"2024-04-19T04:24:20.552644+0000","last_active":"2024-04-19T04:24:21.541610+0000","last_peered":"2024-04-19T04:24:21.541610+0000","last_clean":"2024-04-19T04:24:21.541610+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:24:21.541610+0000","last_undegraded":"2024-04-19T04:24:21.541610+0000","last_fullsized":"2024-04-19T04:24:21.541610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537050+0000","last_change":"2024-04-19T04:24:20.174912+0000","last_active":"2024-04-19T04:24:21.537050+0000","last_peered":"2024-04-19T04:24:21.537050+0000","last_clean":"2024-04-19T04:24:21.537050+0000","last_became_active":"2024-04-19T04:24:20.174629+0000","last_became_peered":"2024-04-19T04:24:20.174629+0000","last_unstale":"2024-04-19T04:24:21.537050+0000","last_undegraded":"2024-04-19T04:24:21.537050+0000","last_fullsized":"2024-04-19T04:24:21.537050+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:09:12.929115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538272+0000","last_change":"2024-04-19T04:24:20.549484+0000","last_active":"2024-04-19T04:24:21.538272+0000","last_peered":"2024-04-19T04:24:21.538272+0000","last_clean":"2024-04-19T04:24:21.538272+0000","last_became_active":"2024-04-19T04:24:20.549149+0000","last_became_peered":"2024-04-19T04:24:20.549149+0000","last_unstale":"2024-04-19T04:24:21.538272+0000","last_undegraded":"2024-04-19T04:24:21.538272+0000","last_fullsized":"2024-04-19T04:24:21.538272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:49.148982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537100+0000","last_change":"2024-04-19T04:24:20.178730+0000","last_active":"2024-04-19T04:24:21.537100+0000","last_peered":"2024-04-19T04:24:21.537100+0000","last_clean":"2024-04-19T04:24:21.537100+0000","last_became_active":"2024-04-19T04:24:20.177996+0000","last_became_peered":"2024-04-19T04:24:20.177996+0000","last_unstale":"2024-04-19T04:24:21.537100+0000","last_undegraded":"2024-04-19T04:24:21.537100+0000","last_fullsized":"2024-04-19T04:24:21.537100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:27:46.704368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541658+0000","last_change":"2024-04-19T04:24:20.556092+0000","last_active":"2024-04-19T04:24:21.541658+0000","last_peered":"2024-04-19T04:24:21.541658+0000","last_clean":"2024-04-19T04:24:21.541658+0000","last_became_active":"2024-04-19T04:24:20.555928+0000","last_became_peered":"2024-04-19T04:24:20.555928+0000","last_unstale":"2024-04-19T04:24:21.541658+0000","last_undegraded":"2024-04-19T04:24:21.541658+0000","last_fullsized":"2024-04-19T04:24:21.541658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:12.211801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540632+0000","last_change":"2024-04-19T04:24:20.179779+0000","last_active":"2024-04-19T04:24:21.540632+0000","last_peered":"2024-04-19T04:24:21.540632+0000","last_clean":"2024-04-19T04:24:21.540632+0000","last_became_active":"2024-04-19T04:24:20.179457+0000","last_became_peered":"2024-04-19T04:24:20.179457+0000","last_unstale":"2024-04-19T04:24:21.540632+0000","last_undegraded":"2024-04-19T04:24:21.540632+0000","last_fullsized":"2024-04-19T04:24:21.540632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:27:04.757759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541223+0000","last_change":"2024-04-19T04:24:20.546222+0000","last_active":"2024-04-19T04:24:21.541223+0000","last_peered":"2024-04-19T04:24:21.541223+0000","last_clean":"2024-04-19T04:24:21.541223+0000","last_became_active":"2024-04-19T04:24:20.545395+0000","last_became_peered":"2024-04-19T04:24:20.545395+0000","last_unstale":"2024-04-19T04:24:21.541223+0000","last_undegraded":"2024-04-19T04:24:21.541223+0000","last_fullsized":"2024-04-19T04:24:21.541223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:56.201003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540715+0000","last_change":"2024-04-19T04:24:20.184108+0000","last_active":"2024-04-19T04:24:21.540715+0000","last_peered":"2024-04-19T04:24:21.540715+0000","last_clean":"2024-04-19T04:24:21.540715+0000","last_became_active":"2024-04-19T04:24:20.183677+0000","last_became_peered":"2024-04-19T04:24:20.183677+0000","last_unstale":"2024-04-19T04:24:21.540715+0000","last_undegraded":"2024-04-19T04:24:21.540715+0000","last_fullsized":"2024-04-19T04:24:21.540715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:06.185573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607906+0000","last_change":"2024-04-19T04:24:20.556556+0000","last_active":"2024-04-19T04:24:21.607906+0000","last_peered":"2024-04-19T04:24:21.607906+0000","last_clean":"2024-04-19T04:24:21.607906+0000","last_became_active":"2024-04-19T04:24:20.555286+0000","last_became_peered":"2024-04-19T04:24:20.555286+0000","last_unstale":"2024-04-19T04:24:21.607906+0000","last_undegraded":"2024-04-19T04:24:21.607906+0000","last_fullsized":"2024-04-19T04:24:21.607906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:18:50.807364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608430+0000","last_change":"2024-04-19T04:24:20.184583+0000","last_active":"2024-04-19T04:24:21.608430+0000","last_peered":"2024-04-19T04:24:21.608430+0000","last_clean":"2024-04-19T04:24:21.608430+0000","last_became_active":"2024-04-19T04:24:20.183933+0000","last_became_peered":"2024-04-19T04:24:20.183933+0000","last_unstale":"2024-04-19T04:24:21.608430+0000","last_undegraded":"2024-04-19T04:24:21.608430+0000","last_fullsized":"2024-04-19T04:24:21.608430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:24.424300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607603+0000","last_change":"2024-04-19T04:24:20.550606+0000","last_active":"2024-04-19T04:24:21.607603+0000","last_peered":"2024-04-19T04:24:21.607603+0000","last_clean":"2024-04-19T04:24:21.607603+0000","last_became_active":"2024-04-19T04:24:20.548990+0000","last_became_peered":"2024-04-19T04:24:20.548990+0000","last_unstale":"2024-04-19T04:24:21.607603+0000","last_undegraded":"2024-04-19T04:24:21.607603+0000","last_fullsized":"2024-04-19T04:24:21.607603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:31:52.562663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541997+0000","last_change":"2024-04-19T04:24:20.184190+0000","last_active":"2024-04-19T04:24:21.541997+0000","last_peered":"2024-04-19T04:24:21.541997+0000","last_clean":"2024-04-19T04:24:21.541997+0000","last_became_active":"2024-04-19T04:24:20.183869+0000","last_became_peered":"2024-04-19T04:24:20.183869+0000","last_unstale":"2024-04-19T04:24:21.541997+0000","last_undegraded":"2024-04-19T04:24:21.541997+0000","last_fullsized":"2024-04-19T04:24:21.541997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:13:48.624837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540713+0000","last_change":"2024-04-19T04:24:20.546603+0000","last_active":"2024-04-19T04:24:21.540713+0000","last_peered":"2024-04-19T04:24:21.540713+0000","last_clean":"2024-04-19T04:24:21.540713+0000","last_became_active":"2024-04-19T04:24:20.546136+0000","last_became_peered":"2024-04-19T04:24:20.546136+0000","last_unstale":"2024-04-19T04:24:21.540713+0000","last_undegraded":"2024-04-19T04:24:21.540713+0000","last_fullsized":"2024-04-19T04:24:21.540713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:20.610726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538747+0000","last_change":"2024-04-19T04:24:20.178148+0000","last_active":"2024-04-19T04:24:21.538747+0000","last_peered":"2024-04-19T04:24:21.538747+0000","last_clean":"2024-04-19T04:24:21.538747+0000","last_became_active":"2024-04-19T04:24:20.177382+0000","last_became_peered":"2024-04-19T04:24:20.177382+0000","last_unstale":"2024-04-19T04:24:21.538747+0000","last_undegraded":"2024-04-19T04:24:21.538747+0000","last_fullsized":"2024-04-19T04:24:21.538747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:03.585052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607131+0000","last_change":"2024-04-19T04:24:20.556288+0000","last_active":"2024-04-19T04:24:21.607131+0000","last_peered":"2024-04-19T04:24:21.607131+0000","last_clean":"2024-04-19T04:24:21.607131+0000","last_became_active":"2024-04-19T04:24:20.554960+0000","last_became_peered":"2024-04-19T04:24:20.554960+0000","last_unstale":"2024-04-19T04:24:21.607131+0000","last_undegraded":"2024-04-19T04:24:21.607131+0000","last_fullsized":"2024-04-19T04:24:21.607131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:27.393720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538917+0000","last_change":"2024-04-19T04:24:20.180873+0000","last_active":"2024-04-19T04:24:21.538917+0000","last_peered":"2024-04-19T04:24:21.538917+0000","last_clean":"2024-04-19T04:24:21.538917+0000","last_became_active":"2024-04-19T04:24:20.180584+0000","last_became_peered":"2024-04-19T04:24:20.180584+0000","last_unstale":"2024-04-19T04:24:21.538917+0000","last_undegraded":"2024-04-19T04:24:21.538917+0000","last_fullsized":"2024-04-19T04:24:21.538917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:43:03.367159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":253952,"data_stored":649246,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31296,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340544,"statfs":{"total":96636764160,"available":96604717056,"internally_reserved":0,"allocated":172032,"data_stored":57748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":649862,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:24:32.933 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:24:33.298 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:33.301 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:24:33.312 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-04-19T04:24:32.874554+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94032,"kb_used_data":672,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021488,"statfs":{"total":289910292480,"available":289814003712,"internally_reserved":0,"allocated":688128,"data_stored":1356856,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.339410"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541340+0000","last_change":"2024-04-19T04:24:20.550082+0000","last_active":"2024-04-19T04:24:21.541340+0000","last_peered":"2024-04-19T04:24:21.541340+0000","last_clean":"2024-04-19T04:24:21.541340+0000","last_became_active":"2024-04-19T04:24:20.549529+0000","last_became_peered":"2024-04-19T04:24:20.549529+0000","last_unstale":"2024-04-19T04:24:21.541340+0000","last_undegraded":"2024-04-19T04:24:21.541340+0000","last_fullsized":"2024-04-19T04:24:21.541340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:27.393720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540906+0000","last_change":"2024-04-19T04:24:20.545709+0000","last_active":"2024-04-19T04:24:21.540906+0000","last_peered":"2024-04-19T04:24:21.540906+0000","last_clean":"2024-04-19T04:24:21.540906+0000","last_became_active":"2024-04-19T04:24:20.544962+0000","last_became_peered":"2024-04-19T04:24:20.544962+0000","last_unstale":"2024-04-19T04:24:21.540906+0000","last_undegraded":"2024-04-19T04:24:21.540906+0000","last_fullsized":"2024-04-19T04:24:21.540906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:06.452910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608479+0000","last_change":"2024-04-19T04:24:20.556199+0000","last_active":"2024-04-19T04:24:21.608479+0000","last_peered":"2024-04-19T04:24:21.608479+0000","last_clean":"2024-04-19T04:24:21.608479+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:24:21.608479+0000","last_undegraded":"2024-04-19T04:24:21.608479+0000","last_fullsized":"2024-04-19T04:24:21.608479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:14.348910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608071+0000","last_change":"2024-04-19T04:24:20.552787+0000","last_active":"2024-04-19T04:24:21.608071+0000","last_peered":"2024-04-19T04:24:21.608071+0000","last_clean":"2024-04-19T04:24:21.608071+0000","last_became_active":"2024-04-19T04:24:20.551784+0000","last_became_peered":"2024-04-19T04:24:20.551784+0000","last_unstale":"2024-04-19T04:24:21.608071+0000","last_undegraded":"2024-04-19T04:24:21.608071+0000","last_fullsized":"2024-04-19T04:24:21.608071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:21.734428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541302+0000","last_change":"2024-04-19T04:24:20.550112+0000","last_active":"2024-04-19T04:24:21.541302+0000","last_peered":"2024-04-19T04:24:21.541302+0000","last_clean":"2024-04-19T04:24:21.541302+0000","last_became_active":"2024-04-19T04:24:20.549620+0000","last_became_peered":"2024-04-19T04:24:20.549620+0000","last_unstale":"2024-04-19T04:24:21.541302+0000","last_undegraded":"2024-04-19T04:24:21.541302+0000","last_fullsized":"2024-04-19T04:24:21.541302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:03:50.416299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607265+0000","last_change":"2024-04-19T04:24:20.551576+0000","last_active":"2024-04-19T04:24:21.607265+0000","last_peered":"2024-04-19T04:24:21.607265+0000","last_clean":"2024-04-19T04:24:21.607265+0000","last_became_active":"2024-04-19T04:24:20.548600+0000","last_became_peered":"2024-04-19T04:24:20.548600+0000","last_unstale":"2024-04-19T04:24:21.607265+0000","last_undegraded":"2024-04-19T04:24:21.607265+0000","last_fullsized":"2024-04-19T04:24:21.607265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:39.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607230+0000","last_change":"2024-04-19T04:24:20.550337+0000","last_active":"2024-04-19T04:24:21.607230+0000","last_peered":"2024-04-19T04:24:21.607230+0000","last_clean":"2024-04-19T04:24:21.607230+0000","last_became_active":"2024-04-19T04:24:20.548514+0000","last_became_peered":"2024-04-19T04:24:20.548514+0000","last_unstale":"2024-04-19T04:24:21.607230+0000","last_undegraded":"2024-04-19T04:24:21.607230+0000","last_fullsized":"2024-04-19T04:24:21.607230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:14.194572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606529+0000","last_change":"2024-04-19T04:24:20.553787+0000","last_active":"2024-04-19T04:24:21.606529+0000","last_peered":"2024-04-19T04:24:21.606529+0000","last_clean":"2024-04-19T04:24:21.606529+0000","last_became_active":"2024-04-19T04:24:20.553410+0000","last_became_peered":"2024-04-19T04:24:20.553410+0000","last_unstale":"2024-04-19T04:24:21.606529+0000","last_undegraded":"2024-04-19T04:24:21.606529+0000","last_fullsized":"2024-04-19T04:24:21.606529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:00.475711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538444+0000","last_change":"2024-04-19T04:24:20.547585+0000","last_active":"2024-04-19T04:24:21.538444+0000","last_peered":"2024-04-19T04:24:21.538444+0000","last_clean":"2024-04-19T04:24:21.538444+0000","last_became_active":"2024-04-19T04:24:20.547395+0000","last_became_peered":"2024-04-19T04:24:20.547395+0000","last_unstale":"2024-04-19T04:24:21.538444+0000","last_undegraded":"2024-04-19T04:24:21.538444+0000","last_fullsized":"2024-04-19T04:24:21.538444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:15.398090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540977+0000","last_change":"2024-04-19T04:24:20.546893+0000","last_active":"2024-04-19T04:24:21.540977+0000","last_peered":"2024-04-19T04:24:21.540977+0000","last_clean":"2024-04-19T04:24:21.540977+0000","last_became_active":"2024-04-19T04:24:20.546257+0000","last_became_peered":"2024-04-19T04:24:20.546257+0000","last_unstale":"2024-04-19T04:24:21.540977+0000","last_undegraded":"2024-04-19T04:24:21.540977+0000","last_fullsized":"2024-04-19T04:24:21.540977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:47.327841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608401+0000","last_change":"2024-04-19T04:24:20.556382+0000","last_active":"2024-04-19T04:24:21.608401+0000","last_peered":"2024-04-19T04:24:21.608401+0000","last_clean":"2024-04-19T04:24:21.608401+0000","last_became_active":"2024-04-19T04:24:20.555246+0000","last_became_peered":"2024-04-19T04:24:20.555246+0000","last_unstale":"2024-04-19T04:24:21.608401+0000","last_undegraded":"2024-04-19T04:24:21.608401+0000","last_fullsized":"2024-04-19T04:24:21.608401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:37:15.332493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540961+0000","last_change":"2024-04-19T04:24:20.558886+0000","last_active":"2024-04-19T04:24:21.540961+0000","last_peered":"2024-04-19T04:24:21.540961+0000","last_clean":"2024-04-19T04:24:21.540961+0000","last_became_active":"2024-04-19T04:24:20.558293+0000","last_became_peered":"2024-04-19T04:24:20.558293+0000","last_unstale":"2024-04-19T04:24:21.540961+0000","last_undegraded":"2024-04-19T04:24:21.540961+0000","last_fullsized":"2024-04-19T04:24:21.540961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:37:15.332493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540418+0000","last_change":"2024-04-19T04:24:20.545891+0000","last_active":"2024-04-19T04:24:21.540418+0000","last_peered":"2024-04-19T04:24:21.540418+0000","last_clean":"2024-04-19T04:24:21.540418+0000","last_became_active":"2024-04-19T04:24:20.545422+0000","last_became_peered":"2024-04-19T04:24:20.545422+0000","last_unstale":"2024-04-19T04:24:21.540418+0000","last_undegraded":"2024-04-19T04:24:21.540418+0000","last_fullsized":"2024-04-19T04:24:21.540418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:31:52.562663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607344+0000","last_change":"2024-04-19T04:24:20.552690+0000","last_active":"2024-04-19T04:24:21.607344+0000","last_peered":"2024-04-19T04:24:21.607344+0000","last_clean":"2024-04-19T04:24:21.607344+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:24:21.607344+0000","last_undegraded":"2024-04-19T04:24:21.607344+0000","last_fullsized":"2024-04-19T04:24:21.607344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:53:16.890992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607404+0000","last_change":"2024-04-19T04:24:20.551809+0000","last_active":"2024-04-19T04:24:21.607404+0000","last_peered":"2024-04-19T04:24:21.607404+0000","last_clean":"2024-04-19T04:24:21.607404+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:24:21.607404+0000","last_undegraded":"2024-04-19T04:24:21.607404+0000","last_fullsized":"2024-04-19T04:24:21.607404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:43:31.281765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606723+0000","last_change":"2024-04-19T04:24:20.552758+0000","last_active":"2024-04-19T04:24:21.606723+0000","last_peered":"2024-04-19T04:24:21.606723+0000","last_clean":"2024-04-19T04:24:21.606723+0000","last_became_active":"2024-04-19T04:24:20.548882+0000","last_became_peered":"2024-04-19T04:24:20.548882+0000","last_unstale":"2024-04-19T04:24:21.606723+0000","last_undegraded":"2024-04-19T04:24:21.606723+0000","last_fullsized":"2024-04-19T04:24:21.606723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:56.738569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539114+0000","last_change":"2024-04-19T04:24:20.546173+0000","last_active":"2024-04-19T04:24:21.539114+0000","last_peered":"2024-04-19T04:24:21.539114+0000","last_clean":"2024-04-19T04:24:21.539114+0000","last_became_active":"2024-04-19T04:24:20.545582+0000","last_became_peered":"2024-04-19T04:24:20.545582+0000","last_unstale":"2024-04-19T04:24:21.539114+0000","last_undegraded":"2024-04-19T04:24:21.539114+0000","last_fullsized":"2024-04-19T04:24:21.539114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:55.955786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541323+0000","last_change":"2024-04-19T04:24:20.549835+0000","last_active":"2024-04-19T04:24:21.541323+0000","last_peered":"2024-04-19T04:24:21.541323+0000","last_clean":"2024-04-19T04:24:21.541323+0000","last_became_active":"2024-04-19T04:24:20.549411+0000","last_became_peered":"2024-04-19T04:24:20.549411+0000","last_unstale":"2024-04-19T04:24:21.541323+0000","last_undegraded":"2024-04-19T04:24:21.541323+0000","last_fullsized":"2024-04-19T04:24:21.541323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:31:11.088424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538186+0000","last_change":"2024-04-19T04:24:20.546517+0000","last_active":"2024-04-19T04:24:21.538186+0000","last_peered":"2024-04-19T04:24:21.538186+0000","last_clean":"2024-04-19T04:24:21.538186+0000","last_became_active":"2024-04-19T04:24:20.546116+0000","last_became_peered":"2024-04-19T04:24:20.546116+0000","last_unstale":"2024-04-19T04:24:21.538186+0000","last_undegraded":"2024-04-19T04:24:21.538186+0000","last_fullsized":"2024-04-19T04:24:21.538186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:28:06.813455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608191+0000","last_change":"2024-04-19T04:24:20.551326+0000","last_active":"2024-04-19T04:24:21.608191+0000","last_peered":"2024-04-19T04:24:21.608191+0000","last_clean":"2024-04-19T04:24:21.608191+0000","last_became_active":"2024-04-19T04:24:20.550246+0000","last_became_peered":"2024-04-19T04:24:20.550246+0000","last_unstale":"2024-04-19T04:24:21.608191+0000","last_undegraded":"2024-04-19T04:24:21.608191+0000","last_fullsized":"2024-04-19T04:24:21.608191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:12.211801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608194+0000","last_change":"2024-04-19T04:24:20.556352+0000","last_active":"2024-04-19T04:24:21.608194+0000","last_peered":"2024-04-19T04:24:21.608194+0000","last_clean":"2024-04-19T04:24:21.608194+0000","last_became_active":"2024-04-19T04:24:20.554294+0000","last_became_peered":"2024-04-19T04:24:20.554294+0000","last_unstale":"2024-04-19T04:24:21.608194+0000","last_undegraded":"2024-04-19T04:24:21.608194+0000","last_fullsized":"2024-04-19T04:24:21.608194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:06.452910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540048+0000","last_change":"2024-04-19T04:24:20.555257+0000","last_active":"2024-04-19T04:24:21.540048+0000","last_peered":"2024-04-19T04:24:21.540048+0000","last_clean":"2024-04-19T04:24:21.540048+0000","last_became_active":"2024-04-19T04:24:20.554895+0000","last_became_peered":"2024-04-19T04:24:20.554895+0000","last_unstale":"2024-04-19T04:24:21.540048+0000","last_undegraded":"2024-04-19T04:24:21.540048+0000","last_fullsized":"2024-04-19T04:24:21.540048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:39.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536664+0000","last_change":"2024-04-19T04:24:20.549936+0000","last_active":"2024-04-19T04:24:21.536664+0000","last_peered":"2024-04-19T04:24:21.536664+0000","last_clean":"2024-04-19T04:24:21.536664+0000","last_became_active":"2024-04-19T04:24:20.549428+0000","last_became_peered":"2024-04-19T04:24:20.549428+0000","last_unstale":"2024-04-19T04:24:21.536664+0000","last_undegraded":"2024-04-19T04:24:21.536664+0000","last_fullsized":"2024-04-19T04:24:21.536664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:44:47.158480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539602+0000","last_change":"2024-04-19T04:24:20.546315+0000","last_active":"2024-04-19T04:24:21.539602+0000","last_peered":"2024-04-19T04:24:21.539602+0000","last_clean":"2024-04-19T04:24:21.539602+0000","last_became_active":"2024-04-19T04:24:20.545851+0000","last_became_peered":"2024-04-19T04:24:20.545851+0000","last_unstale":"2024-04-19T04:24:21.539602+0000","last_undegraded":"2024-04-19T04:24:21.539602+0000","last_fullsized":"2024-04-19T04:24:21.539602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:07:48.905896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541518+0000","last_change":"2024-04-19T04:24:20.554855+0000","last_active":"2024-04-19T04:24:21.541518+0000","last_peered":"2024-04-19T04:24:21.541518+0000","last_clean":"2024-04-19T04:24:21.541518+0000","last_became_active":"2024-04-19T04:24:20.554383+0000","last_became_peered":"2024-04-19T04:24:20.554383+0000","last_unstale":"2024-04-19T04:24:21.541518+0000","last_undegraded":"2024-04-19T04:24:21.541518+0000","last_fullsized":"2024-04-19T04:24:21.541518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:18:50.807364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538534+0000","last_change":"2024-04-19T04:24:20.546410+0000","last_active":"2024-04-19T04:24:21.538534+0000","last_peered":"2024-04-19T04:24:21.538534+0000","last_clean":"2024-04-19T04:24:21.538534+0000","last_became_active":"2024-04-19T04:24:20.545607+0000","last_became_peered":"2024-04-19T04:24:20.545607+0000","last_unstale":"2024-04-19T04:24:21.538534+0000","last_undegraded":"2024-04-19T04:24:21.538534+0000","last_fullsized":"2024-04-19T04:24:21.538534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:03.482984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608645+0000","last_change":"2024-04-19T04:24:20.554885+0000","last_active":"2024-04-19T04:24:21.608645+0000","last_peered":"2024-04-19T04:24:21.608645+0000","last_clean":"2024-04-19T04:24:21.608645+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:24:21.608645+0000","last_undegraded":"2024-04-19T04:24:21.608645+0000","last_fullsized":"2024-04-19T04:24:21.608645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:44:08.285518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541646+0000","last_change":"2024-04-19T04:24:20.558702+0000","last_active":"2024-04-19T04:24:21.541646+0000","last_peered":"2024-04-19T04:24:21.541646+0000","last_clean":"2024-04-19T04:24:21.541646+0000","last_became_active":"2024-04-19T04:24:20.558202+0000","last_became_peered":"2024-04-19T04:24:20.558202+0000","last_unstale":"2024-04-19T04:24:21.541646+0000","last_undegraded":"2024-04-19T04:24:21.541646+0000","last_fullsized":"2024-04-19T04:24:21.541646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:56.738569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537991+0000","last_change":"2024-04-19T04:24:20.543906+0000","last_active":"2024-04-19T04:24:21.537991+0000","last_peered":"2024-04-19T04:24:21.537991+0000","last_clean":"2024-04-19T04:24:21.537991+0000","last_became_active":"2024-04-19T04:24:20.543531+0000","last_became_peered":"2024-04-19T04:24:20.543531+0000","last_unstale":"2024-04-19T04:24:21.537991+0000","last_undegraded":"2024-04-19T04:24:21.537991+0000","last_fullsized":"2024-04-19T04:24:21.537991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:28:04.850289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540345+0000","last_change":"2024-04-19T04:24:20.554847+0000","last_active":"2024-04-19T04:24:21.540345+0000","last_peered":"2024-04-19T04:24:21.540345+0000","last_clean":"2024-04-19T04:24:21.540345+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:24:21.540345+0000","last_undegraded":"2024-04-19T04:24:21.540345+0000","last_fullsized":"2024-04-19T04:24:21.540345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:00.475711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536735+0000","last_change":"2024-04-19T04:24:20.546826+0000","last_active":"2024-04-19T04:24:21.536735+0000","last_peered":"2024-04-19T04:24:21.536735+0000","last_clean":"2024-04-19T04:24:21.536735+0000","last_became_active":"2024-04-19T04:24:20.546065+0000","last_became_peered":"2024-04-19T04:24:20.546065+0000","last_unstale":"2024-04-19T04:24:21.536735+0000","last_undegraded":"2024-04-19T04:24:21.536735+0000","last_fullsized":"2024-04-19T04:24:21.536735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:47.956234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606802+0000","last_change":"2024-04-19T04:24:20.552289+0000","last_active":"2024-04-19T04:24:21.606802+0000","last_peered":"2024-04-19T04:24:21.606802+0000","last_clean":"2024-04-19T04:24:21.606802+0000","last_became_active":"2024-04-19T04:24:20.548755+0000","last_became_peered":"2024-04-19T04:24:20.548755+0000","last_unstale":"2024-04-19T04:24:21.606802+0000","last_undegraded":"2024-04-19T04:24:21.606802+0000","last_fullsized":"2024-04-19T04:24:21.606802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541554+0000","last_change":"2024-04-19T04:24:20.546223+0000","last_active":"2024-04-19T04:24:21.541554+0000","last_peered":"2024-04-19T04:24:21.541554+0000","last_clean":"2024-04-19T04:24:21.541554+0000","last_became_active":"2024-04-19T04:24:20.545807+0000","last_became_peered":"2024-04-19T04:24:20.545807+0000","last_unstale":"2024-04-19T04:24:21.541554+0000","last_undegraded":"2024-04-19T04:24:21.541554+0000","last_fullsized":"2024-04-19T04:24:21.541554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:19.894104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608609+0000","last_change":"2024-04-19T04:24:20.184870+0000","last_active":"2024-04-19T04:24:21.608609+0000","last_peered":"2024-04-19T04:24:21.608609+0000","last_clean":"2024-04-19T04:24:21.608609+0000","last_became_active":"2024-04-19T04:24:20.183615+0000","last_became_peered":"2024-04-19T04:24:20.183615+0000","last_unstale":"2024-04-19T04:24:21.608609+0000","last_undegraded":"2024-04-19T04:24:21.608609+0000","last_fullsized":"2024-04-19T04:24:21.608609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:52:38.272121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541893+0000","last_change":"2024-04-19T04:24:20.547475+0000","last_active":"2024-04-19T04:24:21.541893+0000","last_peered":"2024-04-19T04:24:21.541893+0000","last_clean":"2024-04-19T04:24:21.541893+0000","last_became_active":"2024-04-19T04:24:20.546615+0000","last_became_peered":"2024-04-19T04:24:20.546615+0000","last_unstale":"2024-04-19T04:24:21.541893+0000","last_undegraded":"2024-04-19T04:24:21.541893+0000","last_fullsized":"2024-04-19T04:24:21.541893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:24.049904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537755+0000","last_change":"2024-04-19T04:24:20.177739+0000","last_active":"2024-04-19T04:24:21.537755+0000","last_peered":"2024-04-19T04:24:21.537755+0000","last_clean":"2024-04-19T04:24:21.537755+0000","last_became_active":"2024-04-19T04:24:20.177328+0000","last_became_peered":"2024-04-19T04:24:20.177328+0000","last_unstale":"2024-04-19T04:24:21.537755+0000","last_undegraded":"2024-04-19T04:24:21.537755+0000","last_fullsized":"2024-04-19T04:24:21.537755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:27.902190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538848+0000","last_change":"2024-04-19T04:24:20.547144+0000","last_active":"2024-04-19T04:24:21.538848+0000","last_peered":"2024-04-19T04:24:21.538848+0000","last_clean":"2024-04-19T04:24:21.538848+0000","last_became_active":"2024-04-19T04:24:20.546814+0000","last_became_peered":"2024-04-19T04:24:20.546814+0000","last_unstale":"2024-04-19T04:24:21.538848+0000","last_undegraded":"2024-04-19T04:24:21.538848+0000","last_fullsized":"2024-04-19T04:24:21.538848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:04.710943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540345+0000","last_change":"2024-04-19T04:24:20.183855+0000","last_active":"2024-04-19T04:24:21.540345+0000","last_peered":"2024-04-19T04:24:21.540345+0000","last_clean":"2024-04-19T04:24:21.540345+0000","last_became_active":"2024-04-19T04:24:20.183272+0000","last_became_peered":"2024-04-19T04:24:20.183272+0000","last_unstale":"2024-04-19T04:24:21.540345+0000","last_undegraded":"2024-04-19T04:24:21.540345+0000","last_fullsized":"2024-04-19T04:24:21.540345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:54.737330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538578+0000","last_change":"2024-04-19T04:24:20.551347+0000","last_active":"2024-04-19T04:24:21.538578+0000","last_peered":"2024-04-19T04:24:21.538578+0000","last_clean":"2024-04-19T04:24:21.538578+0000","last_became_active":"2024-04-19T04:24:20.550917+0000","last_became_peered":"2024-04-19T04:24:20.550917+0000","last_unstale":"2024-04-19T04:24:21.538578+0000","last_undegraded":"2024-04-19T04:24:21.538578+0000","last_fullsized":"2024-04-19T04:24:21.538578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:47.732617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606983+0000","last_change":"2024-04-19T04:24:20.187299+0000","last_active":"2024-04-19T04:24:21.606983+0000","last_peered":"2024-04-19T04:24:21.606983+0000","last_clean":"2024-04-19T04:24:21.606983+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:24:21.606983+0000","last_undegraded":"2024-04-19T04:24:21.606983+0000","last_fullsized":"2024-04-19T04:24:21.606983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:49:37.812125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609542+0000","last_change":"2024-04-19T04:24:20.186029+0000","last_active":"2024-04-19T04:24:21.609542+0000","last_peered":"2024-04-19T04:24:21.609542+0000","last_clean":"2024-04-19T04:24:21.609542+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:24:21.609542+0000","last_undegraded":"2024-04-19T04:24:21.609542+0000","last_fullsized":"2024-04-19T04:24:21.609542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:49.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539569+0000","last_change":"2024-04-19T04:24:20.555751+0000","last_active":"2024-04-19T04:24:21.539569+0000","last_peered":"2024-04-19T04:24:21.539569+0000","last_clean":"2024-04-19T04:24:21.539569+0000","last_became_active":"2024-04-19T04:24:20.555501+0000","last_became_peered":"2024-04-19T04:24:20.555501+0000","last_unstale":"2024-04-19T04:24:21.539569+0000","last_undegraded":"2024-04-19T04:24:21.539569+0000","last_fullsized":"2024-04-19T04:24:21.539569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:57.839930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541919+0000","last_change":"2024-04-19T04:24:20.184142+0000","last_active":"2024-04-19T04:24:21.541919+0000","last_peered":"2024-04-19T04:24:21.541919+0000","last_clean":"2024-04-19T04:24:21.541919+0000","last_became_active":"2024-04-19T04:24:20.183546+0000","last_became_peered":"2024-04-19T04:24:20.183546+0000","last_unstale":"2024-04-19T04:24:21.541919+0000","last_undegraded":"2024-04-19T04:24:21.541919+0000","last_fullsized":"2024-04-19T04:24:21.541919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:17.280977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539845+0000","last_change":"2024-04-19T04:24:20.545490+0000","last_active":"2024-04-19T04:24:21.539845+0000","last_peered":"2024-04-19T04:24:21.539845+0000","last_clean":"2024-04-19T04:24:21.539845+0000","last_became_active":"2024-04-19T04:24:20.544898+0000","last_became_peered":"2024-04-19T04:24:20.544898+0000","last_unstale":"2024-04-19T04:24:21.539845+0000","last_undegraded":"2024-04-19T04:24:21.539845+0000","last_fullsized":"2024-04-19T04:24:21.539845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:40:02.138518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609093+0000","last_change":"2024-04-19T04:24:20.186044+0000","last_active":"2024-04-19T04:24:21.609093+0000","last_peered":"2024-04-19T04:24:21.609093+0000","last_clean":"2024-04-19T04:24:21.609093+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:24:21.609093+0000","last_undegraded":"2024-04-19T04:24:21.609093+0000","last_fullsized":"2024-04-19T04:24:21.609093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.432692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607445+0000","last_change":"2024-04-19T04:24:20.552828+0000","last_active":"2024-04-19T04:24:21.607445+0000","last_peered":"2024-04-19T04:24:21.607445+0000","last_clean":"2024-04-19T04:24:21.607445+0000","last_became_active":"2024-04-19T04:24:20.551927+0000","last_became_peered":"2024-04-19T04:24:20.551927+0000","last_unstale":"2024-04-19T04:24:21.607445+0000","last_undegraded":"2024-04-19T04:24:21.607445+0000","last_fullsized":"2024-04-19T04:24:21.607445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:41.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608700+0000","last_change":"2024-04-19T04:24:20.179238+0000","last_active":"2024-04-19T04:24:21.608700+0000","last_peered":"2024-04-19T04:24:21.608700+0000","last_clean":"2024-04-19T04:24:21.608700+0000","last_became_active":"2024-04-19T04:24:20.178758+0000","last_became_peered":"2024-04-19T04:24:20.178758+0000","last_unstale":"2024-04-19T04:24:21.608700+0000","last_undegraded":"2024-04-19T04:24:21.608700+0000","last_fullsized":"2024-04-19T04:24:21.608700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:18:24.789775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537600+0000","last_change":"2024-04-19T04:24:20.554969+0000","last_active":"2024-04-19T04:24:21.537600+0000","last_peered":"2024-04-19T04:24:21.537600+0000","last_clean":"2024-04-19T04:24:21.537600+0000","last_became_active":"2024-04-19T04:24:20.554604+0000","last_became_peered":"2024-04-19T04:24:20.554604+0000","last_unstale":"2024-04-19T04:24:21.537600+0000","last_undegraded":"2024-04-19T04:24:21.537600+0000","last_fullsized":"2024-04-19T04:24:21.537600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:58:47.703110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538228+0000","last_change":"2024-04-19T04:24:20.178602+0000","last_active":"2024-04-19T04:24:21.538228+0000","last_peered":"2024-04-19T04:24:21.538228+0000","last_clean":"2024-04-19T04:24:21.538228+0000","last_became_active":"2024-04-19T04:24:20.177976+0000","last_became_peered":"2024-04-19T04:24:20.177976+0000","last_unstale":"2024-04-19T04:24:21.538228+0000","last_undegraded":"2024-04-19T04:24:21.538228+0000","last_fullsized":"2024-04-19T04:24:21.538228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:15.883790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608409+0000","last_change":"2024-04-19T04:24:20.548296+0000","last_active":"2024-04-19T04:24:21.608409+0000","last_peered":"2024-04-19T04:24:21.608409+0000","last_clean":"2024-04-19T04:24:21.608409+0000","last_became_active":"2024-04-19T04:24:20.547457+0000","last_became_peered":"2024-04-19T04:24:20.547457+0000","last_unstale":"2024-04-19T04:24:21.608409+0000","last_undegraded":"2024-04-19T04:24:21.608409+0000","last_fullsized":"2024-04-19T04:24:21.608409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:57.839930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607638+0000","last_change":"2024-04-19T04:24:20.184338+0000","last_active":"2024-04-19T04:24:21.607638+0000","last_peered":"2024-04-19T04:24:21.607638+0000","last_clean":"2024-04-19T04:24:21.607638+0000","last_became_active":"2024-04-19T04:24:20.183511+0000","last_became_peered":"2024-04-19T04:24:20.183511+0000","last_unstale":"2024-04-19T04:24:21.607638+0000","last_undegraded":"2024-04-19T04:24:21.607638+0000","last_fullsized":"2024-04-19T04:24:21.607638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:14.235823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608849+0000","last_change":"2024-04-19T04:24:20.555922+0000","last_active":"2024-04-19T04:24:21.608849+0000","last_peered":"2024-04-19T04:24:21.608849+0000","last_clean":"2024-04-19T04:24:21.608849+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:24:21.608849+0000","last_undegraded":"2024-04-19T04:24:21.608849+0000","last_fullsized":"2024-04-19T04:24:21.608849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:06:53.595149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540165+0000","last_change":"2024-04-19T04:24:20.183944+0000","last_active":"2024-04-19T04:24:21.540165+0000","last_peered":"2024-04-19T04:24:21.540165+0000","last_clean":"2024-04-19T04:24:21.540165+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:24:21.540165+0000","last_undegraded":"2024-04-19T04:24:21.540165+0000","last_fullsized":"2024-04-19T04:24:21.540165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:42.018487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608707+0000","last_change":"2024-04-19T04:24:20.553085+0000","last_active":"2024-04-19T04:24:21.608707+0000","last_peered":"2024-04-19T04:24:21.608707+0000","last_clean":"2024-04-19T04:24:21.608707+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:24:21.608707+0000","last_undegraded":"2024-04-19T04:24:21.608707+0000","last_fullsized":"2024-04-19T04:24:21.608707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:07:21.467758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539831+0000","last_change":"2024-04-19T04:24:20.180834+0000","last_active":"2024-04-19T04:24:21.539831+0000","last_peered":"2024-04-19T04:24:21.539831+0000","last_clean":"2024-04-19T04:24:21.539831+0000","last_became_active":"2024-04-19T04:24:20.180522+0000","last_became_peered":"2024-04-19T04:24:20.180522+0000","last_unstale":"2024-04-19T04:24:21.539831+0000","last_undegraded":"2024-04-19T04:24:21.539831+0000","last_fullsized":"2024-04-19T04:24:21.539831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:38:28.208268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538763+0000","last_change":"2024-04-19T04:24:20.547313+0000","last_active":"2024-04-19T04:24:21.538763+0000","last_peered":"2024-04-19T04:24:21.538763+0000","last_clean":"2024-04-19T04:24:21.538763+0000","last_became_active":"2024-04-19T04:24:20.545692+0000","last_became_peered":"2024-04-19T04:24:20.545692+0000","last_unstale":"2024-04-19T04:24:21.538763+0000","last_undegraded":"2024-04-19T04:24:21.538763+0000","last_fullsized":"2024-04-19T04:24:21.538763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:24:42.844961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.547904+0000","last_change":"2024-04-19T04:24:10.106278+0000","last_active":"2024-04-19T04:24:20.547904+0000","last_peered":"2024-04-19T04:24:20.547904+0000","last_clean":"2024-04-19T04:24:20.547904+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:24:20.547904+0000","last_undegraded":"2024-04-19T04:24:20.547904+0000","last_fullsized":"2024-04-19T04:24:20.547904+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_clean_scrub_stamp":"2024-04-19T04:24:09.083488+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.549706+0000","last_change":"2024-04-19T04:24:16.144872+0000","last_active":"2024-04-19T04:24:20.549706+0000","last_peered":"2024-04-19T04:24:20.549706+0000","last_clean":"2024-04-19T04:24:20.549706+0000","last_became_active":"2024-04-19T04:24:16.143778+0000","last_became_peered":"2024-04-19T04:24:16.143778+0000","last_unstale":"2024-04-19T04:24:20.549706+0000","last_undegraded":"2024-04-19T04:24:20.549706+0000","last_fullsized":"2024-04-19T04:24:20.549706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:26:06.303713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538038+0000","last_change":"2024-04-19T04:24:20.174958+0000","last_active":"2024-04-19T04:24:21.538038+0000","last_peered":"2024-04-19T04:24:21.538038+0000","last_clean":"2024-04-19T04:24:21.538038+0000","last_became_active":"2024-04-19T04:24:20.174643+0000","last_became_peered":"2024-04-19T04:24:20.174643+0000","last_unstale":"2024-04-19T04:24:21.538038+0000","last_undegraded":"2024-04-19T04:24:21.538038+0000","last_fullsized":"2024-04-19T04:24:21.538038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:37.752236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608950+0000","last_change":"2024-04-19T04:24:20.553999+0000","last_active":"2024-04-19T04:24:21.608950+0000","last_peered":"2024-04-19T04:24:21.608950+0000","last_clean":"2024-04-19T04:24:21.608950+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:24:21.608950+0000","last_undegraded":"2024-04-19T04:24:21.608950+0000","last_fullsized":"2024-04-19T04:24:21.608950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:13:53.306369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.546806+0000","last_change":"2024-04-19T04:24:16.144482+0000","last_active":"2024-04-19T04:24:20.546806+0000","last_peered":"2024-04-19T04:24:20.546806+0000","last_clean":"2024-04-19T04:24:20.546806+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:24:20.546806+0000","last_undegraded":"2024-04-19T04:24:20.546806+0000","last_fullsized":"2024-04-19T04:24:20.546806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:15.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537224+0000","last_change":"2024-04-19T04:24:20.179129+0000","last_active":"2024-04-19T04:24:21.537224+0000","last_peered":"2024-04-19T04:24:21.537224+0000","last_clean":"2024-04-19T04:24:21.537224+0000","last_became_active":"2024-04-19T04:24:20.178247+0000","last_became_peered":"2024-04-19T04:24:20.178247+0000","last_unstale":"2024-04-19T04:24:21.537224+0000","last_undegraded":"2024-04-19T04:24:21.537224+0000","last_fullsized":"2024-04-19T04:24:21.537224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:51.616306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541152+0000","last_change":"2024-04-19T04:24:20.550166+0000","last_active":"2024-04-19T04:24:21.541152+0000","last_peered":"2024-04-19T04:24:21.541152+0000","last_clean":"2024-04-19T04:24:21.541152+0000","last_became_active":"2024-04-19T04:24:20.549606+0000","last_became_peered":"2024-04-19T04:24:20.549606+0000","last_unstale":"2024-04-19T04:24:21.541152+0000","last_undegraded":"2024-04-19T04:24:21.541152+0000","last_fullsized":"2024-04-19T04:24:21.541152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:41.685120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.533460+0000","last_change":"2024-04-19T04:24:16.135584+0000","last_active":"2024-04-19T04:24:20.533460+0000","last_peered":"2024-04-19T04:24:20.533460+0000","last_clean":"2024-04-19T04:24:20.533460+0000","last_became_active":"2024-04-19T04:24:16.134799+0000","last_became_peered":"2024-04-19T04:24:16.134799+0000","last_unstale":"2024-04-19T04:24:20.533460+0000","last_undegraded":"2024-04-19T04:24:20.533460+0000","last_fullsized":"2024-04-19T04:24:20.533460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:55:57.442649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539948+0000","last_change":"2024-04-19T04:24:20.183933+0000","last_active":"2024-04-19T04:24:21.539948+0000","last_peered":"2024-04-19T04:24:21.539948+0000","last_clean":"2024-04-19T04:24:21.539948+0000","last_became_active":"2024-04-19T04:24:20.183490+0000","last_became_peered":"2024-04-19T04:24:20.183490+0000","last_unstale":"2024-04-19T04:24:21.539948+0000","last_undegraded":"2024-04-19T04:24:21.539948+0000","last_fullsized":"2024-04-19T04:24:21.539948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:43.869727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538758+0000","last_change":"2024-04-19T04:24:20.544687+0000","last_active":"2024-04-19T04:24:21.538758+0000","last_peered":"2024-04-19T04:24:21.538758+0000","last_clean":"2024-04-19T04:24:21.538758+0000","last_became_active":"2024-04-19T04:24:20.544430+0000","last_became_peered":"2024-04-19T04:24:20.544430+0000","last_unstale":"2024-04-19T04:24:21.538758+0000","last_undegraded":"2024-04-19T04:24:21.538758+0000","last_fullsized":"2024-04-19T04:24:21.538758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:11:22.765812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.548059+0000","last_change":"2024-04-19T04:24:16.145124+0000","last_active":"2024-04-19T04:24:20.548059+0000","last_peered":"2024-04-19T04:24:20.548059+0000","last_clean":"2024-04-19T04:24:20.548059+0000","last_became_active":"2024-04-19T04:24:16.143949+0000","last_became_peered":"2024-04-19T04:24:16.143949+0000","last_unstale":"2024-04-19T04:24:20.548059+0000","last_undegraded":"2024-04-19T04:24:20.548059+0000","last_fullsized":"2024-04-19T04:24:20.548059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:18.901615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608836+0000","last_change":"2024-04-19T04:24:20.179004+0000","last_active":"2024-04-19T04:24:21.608836+0000","last_peered":"2024-04-19T04:24:21.608836+0000","last_clean":"2024-04-19T04:24:21.608836+0000","last_became_active":"2024-04-19T04:24:20.178123+0000","last_became_peered":"2024-04-19T04:24:20.178123+0000","last_unstale":"2024-04-19T04:24:21.608836+0000","last_undegraded":"2024-04-19T04:24:21.608836+0000","last_fullsized":"2024-04-19T04:24:21.608836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:35:25.084528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538611+0000","last_change":"2024-04-19T04:24:20.544312+0000","last_active":"2024-04-19T04:24:21.538611+0000","last_peered":"2024-04-19T04:24:21.538611+0000","last_clean":"2024-04-19T04:24:21.538611+0000","last_became_active":"2024-04-19T04:24:20.543738+0000","last_became_peered":"2024-04-19T04:24:20.543738+0000","last_unstale":"2024-04-19T04:24:21.538611+0000","last_undegraded":"2024-04-19T04:24:21.538611+0000","last_fullsized":"2024-04-19T04:24:21.538611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:23.486532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609184+0000","last_change":"2024-04-19T04:24:20.184349+0000","last_active":"2024-04-19T04:24:21.609184+0000","last_peered":"2024-04-19T04:24:21.609184+0000","last_clean":"2024-04-19T04:24:21.609184+0000","last_became_active":"2024-04-19T04:24:20.183495+0000","last_became_peered":"2024-04-19T04:24:20.183495+0000","last_unstale":"2024-04-19T04:24:21.609184+0000","last_undegraded":"2024-04-19T04:24:21.609184+0000","last_fullsized":"2024-04-19T04:24:21.609184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:16:09.571178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.531994+0000","last_change":"2024-04-19T04:24:16.136119+0000","last_active":"2024-04-19T04:24:20.531994+0000","last_peered":"2024-04-19T04:24:20.531994+0000","last_clean":"2024-04-19T04:24:20.531994+0000","last_became_active":"2024-04-19T04:24:16.135272+0000","last_became_peered":"2024-04-19T04:24:16.135272+0000","last_unstale":"2024-04-19T04:24:20.531994+0000","last_undegraded":"2024-04-19T04:24:20.531994+0000","last_fullsized":"2024-04-19T04:24:20.531994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:07:14.180095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540172+0000","last_change":"2024-04-19T04:24:20.555116+0000","last_active":"2024-04-19T04:24:21.540172+0000","last_peered":"2024-04-19T04:24:21.540172+0000","last_clean":"2024-04-19T04:24:21.540172+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:24:21.540172+0000","last_undegraded":"2024-04-19T04:24:21.540172+0000","last_fullsized":"2024-04-19T04:24:21.540172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:21.734428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538645+0000","last_change":"2024-04-19T04:24:20.174833+0000","last_active":"2024-04-19T04:24:21.538645+0000","last_peered":"2024-04-19T04:24:21.538645+0000","last_clean":"2024-04-19T04:24:21.538645+0000","last_became_active":"2024-04-19T04:24:20.174517+0000","last_became_peered":"2024-04-19T04:24:20.174517+0000","last_unstale":"2024-04-19T04:24:21.538645+0000","last_undegraded":"2024-04-19T04:24:21.538645+0000","last_fullsized":"2024-04-19T04:24:21.538645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:51.699530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.536090+0000","last_change":"2024-04-19T04:24:16.141899+0000","last_active":"2024-04-19T04:24:20.536090+0000","last_peered":"2024-04-19T04:24:20.536090+0000","last_clean":"2024-04-19T04:24:20.536090+0000","last_became_active":"2024-04-19T04:24:16.141508+0000","last_became_peered":"2024-04-19T04:24:16.141508+0000","last_unstale":"2024-04-19T04:24:20.536090+0000","last_undegraded":"2024-04-19T04:24:20.536090+0000","last_fullsized":"2024-04-19T04:24:20.536090+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:31.719446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540502+0000","last_change":"2024-04-19T04:24:20.558559+0000","last_active":"2024-04-19T04:24:21.540502+0000","last_peered":"2024-04-19T04:24:21.540502+0000","last_clean":"2024-04-19T04:24:21.540502+0000","last_became_active":"2024-04-19T04:24:20.558215+0000","last_became_peered":"2024-04-19T04:24:20.558215+0000","last_unstale":"2024-04-19T04:24:21.540502+0000","last_undegraded":"2024-04-19T04:24:21.540502+0000","last_fullsized":"2024-04-19T04:24:21.540502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:41.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539118+0000","last_change":"2024-04-19T04:24:20.175205+0000","last_active":"2024-04-19T04:24:21.539118+0000","last_peered":"2024-04-19T04:24:21.539118+0000","last_clean":"2024-04-19T04:24:21.539118+0000","last_became_active":"2024-04-19T04:24:20.174912+0000","last_became_peered":"2024-04-19T04:24:20.174912+0000","last_unstale":"2024-04-19T04:24:21.539118+0000","last_undegraded":"2024-04-19T04:24:21.539118+0000","last_fullsized":"2024-04-19T04:24:21.539118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:21:37.681287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.533233+0000","last_change":"2024-04-19T04:24:16.135892+0000","last_active":"2024-04-19T04:24:20.533233+0000","last_peered":"2024-04-19T04:24:20.533233+0000","last_clean":"2024-04-19T04:24:20.533233+0000","last_became_active":"2024-04-19T04:24:16.135385+0000","last_became_peered":"2024-04-19T04:24:16.135385+0000","last_unstale":"2024-04-19T04:24:20.533233+0000","last_undegraded":"2024-04-19T04:24:20.533233+0000","last_fullsized":"2024-04-19T04:24:20.533233+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:37.110319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536977+0000","last_change":"2024-04-19T04:24:20.553486+0000","last_active":"2024-04-19T04:24:21.536977+0000","last_peered":"2024-04-19T04:24:21.536977+0000","last_clean":"2024-04-19T04:24:21.536977+0000","last_became_active":"2024-04-19T04:24:20.553206+0000","last_became_peered":"2024-04-19T04:24:20.553206+0000","last_unstale":"2024-04-19T04:24:21.536977+0000","last_undegraded":"2024-04-19T04:24:21.536977+0000","last_fullsized":"2024-04-19T04:24:21.536977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:32.648637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:23.878567+0000","last_change":"2024-04-19T04:24:20.178880+0000","last_active":"2024-04-19T04:24:23.878567+0000","last_peered":"2024-04-19T04:24:23.878567+0000","last_clean":"2024-04-19T04:24:23.878567+0000","last_became_active":"2024-04-19T04:24:20.177593+0000","last_became_peered":"2024-04-19T04:24:20.177593+0000","last_unstale":"2024-04-19T04:24:23.878567+0000","last_undegraded":"2024-04-19T04:24:23.878567+0000","last_fullsized":"2024-04-19T04:24:23.878567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:58:32.732477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.549281+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:24:20.549281+0000","last_peered":"2024-04-19T04:24:20.549281+0000","last_clean":"2024-04-19T04:24:20.549281+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:24:20.549281+0000","last_undegraded":"2024-04-19T04:24:20.549281+0000","last_fullsized":"2024-04-19T04:24:20.549281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:45.574813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539891+0000","last_change":"2024-04-19T04:24:20.554721+0000","last_active":"2024-04-19T04:24:21.539891+0000","last_peered":"2024-04-19T04:24:21.539891+0000","last_clean":"2024-04-19T04:24:21.539891+0000","last_became_active":"2024-04-19T04:24:20.554286+0000","last_became_peered":"2024-04-19T04:24:20.554286+0000","last_unstale":"2024-04-19T04:24:21.539891+0000","last_undegraded":"2024-04-19T04:24:21.539891+0000","last_fullsized":"2024-04-19T04:24:21.539891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:14.194572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608106+0000","last_change":"2024-04-19T04:24:20.555406+0000","last_active":"2024-04-19T04:24:21.608106+0000","last_peered":"2024-04-19T04:24:21.608106+0000","last_clean":"2024-04-19T04:24:21.608106+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:24:21.608106+0000","last_undegraded":"2024-04-19T04:24:21.608106+0000","last_fullsized":"2024-04-19T04:24:21.608106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:10.453970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608703+0000","last_change":"2024-04-19T04:24:20.185978+0000","last_active":"2024-04-19T04:24:21.608703+0000","last_peered":"2024-04-19T04:24:21.608703+0000","last_clean":"2024-04-19T04:24:21.608703+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:24:21.608703+0000","last_undegraded":"2024-04-19T04:24:21.608703+0000","last_fullsized":"2024-04-19T04:24:21.608703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:48.158805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537416+0000","last_change":"2024-04-19T04:24:20.544323+0000","last_active":"2024-04-19T04:24:21.537416+0000","last_peered":"2024-04-19T04:24:21.537416+0000","last_clean":"2024-04-19T04:24:21.537416+0000","last_became_active":"2024-04-19T04:24:20.543893+0000","last_became_peered":"2024-04-19T04:24:20.543893+0000","last_unstale":"2024-04-19T04:24:21.537416+0000","last_undegraded":"2024-04-19T04:24:21.537416+0000","last_fullsized":"2024-04-19T04:24:21.537416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:01.587027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.542097+0000","last_change":"2024-04-19T04:24:20.184342+0000","last_active":"2024-04-19T04:24:21.542097+0000","last_peered":"2024-04-19T04:24:21.542097+0000","last_clean":"2024-04-19T04:24:21.542097+0000","last_became_active":"2024-04-19T04:24:20.183970+0000","last_became_peered":"2024-04-19T04:24:20.183970+0000","last_unstale":"2024-04-19T04:24:21.542097+0000","last_undegraded":"2024-04-19T04:24:21.542097+0000","last_fullsized":"2024-04-19T04:24:21.542097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:46.956957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609216+0000","last_change":"2024-04-19T04:24:20.184508+0000","last_active":"2024-04-19T04:24:21.609216+0000","last_peered":"2024-04-19T04:24:21.609216+0000","last_clean":"2024-04-19T04:24:21.609216+0000","last_became_active":"2024-04-19T04:24:20.184060+0000","last_became_peered":"2024-04-19T04:24:20.184060+0000","last_unstale":"2024-04-19T04:24:21.609216+0000","last_undegraded":"2024-04-19T04:24:21.609216+0000","last_fullsized":"2024-04-19T04:24:21.609216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:14:57.634877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537342+0000","last_change":"2024-04-19T04:24:20.546949+0000","last_active":"2024-04-19T04:24:21.537342+0000","last_peered":"2024-04-19T04:24:21.537342+0000","last_clean":"2024-04-19T04:24:21.537342+0000","last_became_active":"2024-04-19T04:24:20.546029+0000","last_became_peered":"2024-04-19T04:24:20.546029+0000","last_unstale":"2024-04-19T04:24:21.537342+0000","last_undegraded":"2024-04-19T04:24:21.537342+0000","last_fullsized":"2024-04-19T04:24:21.537342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:22:06.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539031+0000","last_change":"2024-04-19T04:24:20.178672+0000","last_active":"2024-04-19T04:24:21.539031+0000","last_peered":"2024-04-19T04:24:21.539031+0000","last_clean":"2024-04-19T04:24:21.539031+0000","last_became_active":"2024-04-19T04:24:20.177921+0000","last_became_peered":"2024-04-19T04:24:20.177921+0000","last_unstale":"2024-04-19T04:24:21.539031+0000","last_undegraded":"2024-04-19T04:24:21.539031+0000","last_fullsized":"2024-04-19T04:24:21.539031+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:21.042990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536875+0000","last_change":"2024-04-19T04:24:20.546616+0000","last_active":"2024-04-19T04:24:21.536875+0000","last_peered":"2024-04-19T04:24:21.536875+0000","last_clean":"2024-04-19T04:24:21.536875+0000","last_became_active":"2024-04-19T04:24:20.546032+0000","last_became_peered":"2024-04-19T04:24:20.546032+0000","last_unstale":"2024-04-19T04:24:21.536875+0000","last_undegraded":"2024-04-19T04:24:21.536875+0000","last_fullsized":"2024-04-19T04:24:21.536875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:02:20.398899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541610+0000","last_change":"2024-04-19T04:24:20.552644+0000","last_active":"2024-04-19T04:24:21.541610+0000","last_peered":"2024-04-19T04:24:21.541610+0000","last_clean":"2024-04-19T04:24:21.541610+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:24:21.541610+0000","last_undegraded":"2024-04-19T04:24:21.541610+0000","last_fullsized":"2024-04-19T04:24:21.541610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537050+0000","last_change":"2024-04-19T04:24:20.174912+0000","last_active":"2024-04-19T04:24:21.537050+0000","last_peered":"2024-04-19T04:24:21.537050+0000","last_clean":"2024-04-19T04:24:21.537050+0000","last_became_active":"2024-04-19T04:24:20.174629+0000","last_became_peered":"2024-04-19T04:24:20.174629+0000","last_unstale":"2024-04-19T04:24:21.537050+0000","last_undegraded":"2024-04-19T04:24:21.537050+0000","last_fullsized":"2024-04-19T04:24:21.537050+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:09:12.929115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538272+0000","last_change":"2024-04-19T04:24:20.549484+0000","last_active":"2024-04-19T04:24:21.538272+0000","last_peered":"2024-04-19T04:24:21.538272+0000","last_clean":"2024-04-19T04:24:21.538272+0000","last_became_active":"2024-04-19T04:24:20.549149+0000","last_became_peered":"2024-04-19T04:24:20.549149+0000","last_unstale":"2024-04-19T04:24:21.538272+0000","last_undegraded":"2024-04-19T04:24:21.538272+0000","last_fullsized":"2024-04-19T04:24:21.538272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:49.148982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537100+0000","last_change":"2024-04-19T04:24:20.178730+0000","last_active":"2024-04-19T04:24:21.537100+0000","last_peered":"2024-04-19T04:24:21.537100+0000","last_clean":"2024-04-19T04:24:21.537100+0000","last_became_active":"2024-04-19T04:24:20.177996+0000","last_became_peered":"2024-04-19T04:24:20.177996+0000","last_unstale":"2024-04-19T04:24:21.537100+0000","last_undegraded":"2024-04-19T04:24:21.537100+0000","last_fullsized":"2024-04-19T04:24:21.537100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:27:46.704368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541658+0000","last_change":"2024-04-19T04:24:20.556092+0000","last_active":"2024-04-19T04:24:21.541658+0000","last_peered":"2024-04-19T04:24:21.541658+0000","last_clean":"2024-04-19T04:24:21.541658+0000","last_became_active":"2024-04-19T04:24:20.555928+0000","last_became_peered":"2024-04-19T04:24:20.555928+0000","last_unstale":"2024-04-19T04:24:21.541658+0000","last_undegraded":"2024-04-19T04:24:21.541658+0000","last_fullsized":"2024-04-19T04:24:21.541658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:12.211801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540632+0000","last_change":"2024-04-19T04:24:20.179779+0000","last_active":"2024-04-19T04:24:21.540632+0000","last_peered":"2024-04-19T04:24:21.540632+0000","last_clean":"2024-04-19T04:24:21.540632+0000","last_became_active":"2024-04-19T04:24:20.179457+0000","last_became_peered":"2024-04-19T04:24:20.179457+0000","last_unstale":"2024-04-19T04:24:21.540632+0000","last_undegraded":"2024-04-19T04:24:21.540632+0000","last_fullsized":"2024-04-19T04:24:21.540632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:27:04.757759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541223+0000","last_change":"2024-04-19T04:24:20.546222+0000","last_active":"2024-04-19T04:24:21.541223+0000","last_peered":"2024-04-19T04:24:21.541223+0000","last_clean":"2024-04-19T04:24:21.541223+0000","last_became_active":"2024-04-19T04:24:20.545395+0000","last_became_peered":"2024-04-19T04:24:20.545395+0000","last_unstale":"2024-04-19T04:24:21.541223+0000","last_undegraded":"2024-04-19T04:24:21.541223+0000","last_fullsized":"2024-04-19T04:24:21.541223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:56.201003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540715+0000","last_change":"2024-04-19T04:24:20.184108+0000","last_active":"2024-04-19T04:24:21.540715+0000","last_peered":"2024-04-19T04:24:21.540715+0000","last_clean":"2024-04-19T04:24:21.540715+0000","last_became_active":"2024-04-19T04:24:20.183677+0000","last_became_peered":"2024-04-19T04:24:20.183677+0000","last_unstale":"2024-04-19T04:24:21.540715+0000","last_undegraded":"2024-04-19T04:24:21.540715+0000","last_fullsized":"2024-04-19T04:24:21.540715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:06.185573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607906+0000","last_change":"2024-04-19T04:24:20.556556+0000","last_active":"2024-04-19T04:24:21.607906+0000","last_peered":"2024-04-19T04:24:21.607906+0000","last_clean":"2024-04-19T04:24:21.607906+0000","last_became_active":"2024-04-19T04:24:20.555286+0000","last_became_peered":"2024-04-19T04:24:20.555286+0000","last_unstale":"2024-04-19T04:24:21.607906+0000","last_undegraded":"2024-04-19T04:24:21.607906+0000","last_fullsized":"2024-04-19T04:24:21.607906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:18:50.807364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608430+0000","last_change":"2024-04-19T04:24:20.184583+0000","last_active":"2024-04-19T04:24:21.608430+0000","last_peered":"2024-04-19T04:24:21.608430+0000","last_clean":"2024-04-19T04:24:21.608430+0000","last_became_active":"2024-04-19T04:24:20.183933+0000","last_became_peered":"2024-04-19T04:24:20.183933+0000","last_unstale":"2024-04-19T04:24:21.608430+0000","last_undegraded":"2024-04-19T04:24:21.608430+0000","last_fullsized":"2024-04-19T04:24:21.608430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:24.424300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607603+0000","last_change":"2024-04-19T04:24:20.550606+0000","last_active":"2024-04-19T04:24:21.607603+0000","last_peered":"2024-04-19T04:24:21.607603+0000","last_clean":"2024-04-19T04:24:21.607603+0000","last_became_active":"2024-04-19T04:24:20.548990+0000","last_became_peered":"2024-04-19T04:24:20.548990+0000","last_unstale":"2024-04-19T04:24:21.607603+0000","last_undegraded":"2024-04-19T04:24:21.607603+0000","last_fullsized":"2024-04-19T04:24:21.607603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:31:52.562663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541997+0000","last_change":"2024-04-19T04:24:20.184190+0000","last_active":"2024-04-19T04:24:21.541997+0000","last_peered":"2024-04-19T04:24:21.541997+0000","last_clean":"2024-04-19T04:24:21.541997+0000","last_became_active":"2024-04-19T04:24:20.183869+0000","last_became_peered":"2024-04-19T04:24:20.183869+0000","last_unstale":"2024-04-19T04:24:21.541997+0000","last_undegraded":"2024-04-19T04:24:21.541997+0000","last_fullsized":"2024-04-19T04:24:21.541997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:13:48.624837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540713+0000","last_change":"2024-04-19T04:24:20.546603+0000","last_active":"2024-04-19T04:24:21.540713+0000","last_peered":"2024-04-19T04:24:21.540713+0000","last_clean":"2024-04-19T04:24:21.540713+0000","last_became_active":"2024-04-19T04:24:20.546136+0000","last_became_peered":"2024-04-19T04:24:20.546136+0000","last_unstale":"2024-04-19T04:24:21.540713+0000","last_undegraded":"2024-04-19T04:24:21.540713+0000","last_fullsized":"2024-04-19T04:24:21.540713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:20.610726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538747+0000","last_change":"2024-04-19T04:24:20.178148+0000","last_active":"2024-04-19T04:24:21.538747+0000","last_peered":"2024-04-19T04:24:21.538747+0000","last_clean":"2024-04-19T04:24:21.538747+0000","last_became_active":"2024-04-19T04:24:20.177382+0000","last_became_peered":"2024-04-19T04:24:20.177382+0000","last_unstale":"2024-04-19T04:24:21.538747+0000","last_undegraded":"2024-04-19T04:24:21.538747+0000","last_fullsized":"2024-04-19T04:24:21.538747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:03.585052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607131+0000","last_change":"2024-04-19T04:24:20.556288+0000","last_active":"2024-04-19T04:24:21.607131+0000","last_peered":"2024-04-19T04:24:21.607131+0000","last_clean":"2024-04-19T04:24:21.607131+0000","last_became_active":"2024-04-19T04:24:20.554960+0000","last_became_peered":"2024-04-19T04:24:20.554960+0000","last_unstale":"2024-04-19T04:24:21.607131+0000","last_undegraded":"2024-04-19T04:24:21.607131+0000","last_fullsized":"2024-04-19T04:24:21.607131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:27.393720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538917+0000","last_change":"2024-04-19T04:24:20.180873+0000","last_active":"2024-04-19T04:24:21.538917+0000","last_peered":"2024-04-19T04:24:21.538917+0000","last_clean":"2024-04-19T04:24:21.538917+0000","last_became_active":"2024-04-19T04:24:20.180584+0000","last_became_peered":"2024-04-19T04:24:20.180584+0000","last_unstale":"2024-04-19T04:24:21.538917+0000","last_undegraded":"2024-04-19T04:24:21.538917+0000","last_fullsized":"2024-04-19T04:24:21.538917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:43:03.367159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":253952,"data_stored":649246,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31296,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340544,"statfs":{"total":96636764160,"available":96604717056,"internally_reserved":0,"allocated":172032,"data_stored":57748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":649862,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:24:33.316 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-19T04:24:33.316 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-19T04:24:33.317 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-19T04:24:33.317 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-19T04:24:33.656 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:33.657 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-19T04:24:33.671 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-19T04:24:33.672 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T04:24:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:33.974 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":19,"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","created":"2024-04-19T04:23:58.837304+0000","modified":"2024-04-19T04:24:21.527750+0000","last_up_change":"2024-04-19T04:24:08.081123+0000","last_in_change":"2024-04-19T04:24:00.437672+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T04:24:08.928860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T04:24:14.725769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T04:24:19.096707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T04:24:19.528844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28ba89d9-eaaf-4fb5-86bc-783b607a4cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":18128},{"type":"v1","addr":"172.21.15.27:6801","nonce":18128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":18128},{"type":"v1","addr":"172.21.15.27:6803","nonce":18128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":18128},{"type":"v1","addr":"172.21.15.27:6807","nonce":18128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":18128},{"type":"v1","addr":"172.21.15.27:6805","nonce":18128}]},"public_addr":"172.21.15.27:6801/18128","cluster_addr":"172.21.15.27:6803/18128","heartbeat_back_addr":"172.21.15.27:6807/18128","heartbeat_front_addr":"172.21.15.27:6805/18128","state":["exists","up"]},{"osd":1,"uuid":"9d5408b5-b74c-4e5e-858c-e0c8b593204e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":18186},{"type":"v1","addr":"172.21.15.66:6801","nonce":18186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":18186},{"type":"v1","addr":"172.21.15.66:6803","nonce":18186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":18186},{"type":"v1","addr":"172.21.15.66:6807","nonce":18186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":18186},{"type":"v1","addr":"172.21.15.66:6805","nonce":18186}]},"public_addr":"172.21.15.66:6801/18186","cluster_addr":"172.21.15.66:6803/18186","heartbeat_back_addr":"172.21.15.66:6807/18186","heartbeat_front_addr":"172.21.15.66:6805/18186","state":["exists","up"]},{"osd":2,"uuid":"9b600dc4-4425-4873-82d8-5434ca838bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":18250},{"type":"v1","addr":"172.21.15.172:6801","nonce":18250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":18250},{"type":"v1","addr":"172.21.15.172:6803","nonce":18250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":18250},{"type":"v1","addr":"172.21.15.172:6807","nonce":18250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":18250},{"type":"v1","addr":"172.21.15.172:6805","nonce":18250}]},"public_addr":"172.21.15.172:6801/18250","cluster_addr":"172.21.15.172:6803/18250","heartbeat_back_addr":"172.21.15.172:6807/18250","heartbeat_front_addr":"172.21.15.172:6805/18250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.749539+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.573103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.812945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T04:24:33.990 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T04:24:08.928860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T04:24:14.725769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T04:24:19.096707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T04:24:19.528844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T04:24:33.991 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T04:24:34.289 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-19T04:24:34.304 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T04:24:34.614 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2024-04-19T04:24:34.629 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-19T04:24:34.938 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-19T04:24:34.952 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-19T04:24:35.258 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-19T04:24:35.272 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T04:24:35.610 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:35.610 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T04:24:20.525070+0000","modified":"2024-04-19T04:24:22.534106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6803/1858240019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1858240019},{"type":"v1","addr":"172.21.15.7:6803","nonce":1858240019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T04:24:35.613 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 5 2024-04-19T04:24:35.624 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T04:24:35.921 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:35.921 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":19,"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","created":"2024-04-19T04:23:58.837304+0000","modified":"2024-04-19T04:24:21.527750+0000","last_up_change":"2024-04-19T04:24:08.081123+0000","last_in_change":"2024-04-19T04:24:00.437672+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T04:24:08.928860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T04:24:14.725769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T04:24:19.096707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T04:24:19.528844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28ba89d9-eaaf-4fb5-86bc-783b607a4cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":18128},{"type":"v1","addr":"172.21.15.27:6801","nonce":18128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":18128},{"type":"v1","addr":"172.21.15.27:6803","nonce":18128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":18128},{"type":"v1","addr":"172.21.15.27:6807","nonce":18128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":18128},{"type":"v1","addr":"172.21.15.27:6805","nonce":18128}]},"public_addr":"172.21.15.27:6801/18128","cluster_addr":"172.21.15.27:6803/18128","heartbeat_back_addr":"172.21.15.27:6807/18128","heartbeat_front_addr":"172.21.15.27:6805/18128","state":["exists","up"]},{"osd":1,"uuid":"9d5408b5-b74c-4e5e-858c-e0c8b593204e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":18186},{"type":"v1","addr":"172.21.15.66:6801","nonce":18186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":18186},{"type":"v1","addr":"172.21.15.66:6803","nonce":18186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":18186},{"type":"v1","addr":"172.21.15.66:6807","nonce":18186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":18186},{"type":"v1","addr":"172.21.15.66:6805","nonce":18186}]},"public_addr":"172.21.15.66:6801/18186","cluster_addr":"172.21.15.66:6803/18186","heartbeat_back_addr":"172.21.15.66:6807/18186","heartbeat_front_addr":"172.21.15.66:6805/18186","state":["exists","up"]},{"osd":2,"uuid":"9b600dc4-4425-4873-82d8-5434ca838bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":18250},{"type":"v1","addr":"172.21.15.172:6801","nonce":18250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":18250},{"type":"v1","addr":"172.21.15.172:6803","nonce":18250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":18250},{"type":"v1","addr":"172.21.15.172:6807","nonce":18250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":18250},{"type":"v1","addr":"172.21.15.172:6805","nonce":18250}]},"public_addr":"172.21.15.172:6801/18250","cluster_addr":"172.21.15.172:6803/18250","heartbeat_back_addr":"172.21.15.172:6807/18250","heartbeat_front_addr":"172.21.15.172:6805/18250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.749539+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.573103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.812945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T04:24:35.937 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T04:24:08.928860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T04:24:14.725769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T04:24:19.096707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T04:24:19.528844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T04:24:35.937 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T04:24:36.243 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-19T04:24:36.257 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T04:24:36.559 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2024-04-19T04:24:36.577 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-19T04:24:36.888 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-19T04:24:36.903 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-19T04:24:37.207 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-19T04:24:37.228 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T04:24:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:37.555 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T04:24:20.525070+0000","modified":"2024-04-19T04:24:22.534106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6803/1858240019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1858240019},{"type":"v1","addr":"172.21.15.7:6803","nonce":1858240019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T04:24:37.558 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 5 2024-04-19T04:24:37.575 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T04:24:37.878 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:37.879 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":19,"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","created":"2024-04-19T04:23:58.837304+0000","modified":"2024-04-19T04:24:21.527750+0000","last_up_change":"2024-04-19T04:24:08.081123+0000","last_in_change":"2024-04-19T04:24:00.437672+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T04:24:08.928860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T04:24:14.725769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T04:24:19.096707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T04:24:19.528844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28ba89d9-eaaf-4fb5-86bc-783b607a4cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":18128},{"type":"v1","addr":"172.21.15.27:6801","nonce":18128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":18128},{"type":"v1","addr":"172.21.15.27:6803","nonce":18128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":18128},{"type":"v1","addr":"172.21.15.27:6807","nonce":18128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":18128},{"type":"v1","addr":"172.21.15.27:6805","nonce":18128}]},"public_addr":"172.21.15.27:6801/18128","cluster_addr":"172.21.15.27:6803/18128","heartbeat_back_addr":"172.21.15.27:6807/18128","heartbeat_front_addr":"172.21.15.27:6805/18128","state":["exists","up"]},{"osd":1,"uuid":"9d5408b5-b74c-4e5e-858c-e0c8b593204e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":18186},{"type":"v1","addr":"172.21.15.66:6801","nonce":18186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":18186},{"type":"v1","addr":"172.21.15.66:6803","nonce":18186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":18186},{"type":"v1","addr":"172.21.15.66:6807","nonce":18186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":18186},{"type":"v1","addr":"172.21.15.66:6805","nonce":18186}]},"public_addr":"172.21.15.66:6801/18186","cluster_addr":"172.21.15.66:6803/18186","heartbeat_back_addr":"172.21.15.66:6807/18186","heartbeat_front_addr":"172.21.15.66:6805/18186","state":["exists","up"]},{"osd":2,"uuid":"9b600dc4-4425-4873-82d8-5434ca838bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":18250},{"type":"v1","addr":"172.21.15.172:6801","nonce":18250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":18250},{"type":"v1","addr":"172.21.15.172:6803","nonce":18250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":18250},{"type":"v1","addr":"172.21.15.172:6807","nonce":18250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":18250},{"type":"v1","addr":"172.21.15.172:6805","nonce":18250}]},"public_addr":"172.21.15.172:6801/18250","cluster_addr":"172.21.15.172:6803/18250","heartbeat_back_addr":"172.21.15.172:6807/18250","heartbeat_front_addr":"172.21.15.172:6805/18250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.749539+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.573103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.812945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T04:24:37.894 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T04:24:38.223 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:38.223 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T04:24:20.525070+0000","modified":"2024-04-19T04:24:22.534106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6803/1858240019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1858240019},{"type":"v1","addr":"172.21.15.7:6803","nonce":1858240019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T04:24:38.227 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 5 2024-04-19T04:24:38.339 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-19T04:24:20.525070+0000', 'modified': '2024-04-19T04:24:22.534106+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4239}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4239': {'gid': 4239, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6803/1858240019', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6802', 'nonce': 1858240019}, {'type': 'v1', 'addr': '172.21.15.7:6803', 'nonce': 1858240019}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-19T04:24:38.339 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-19T04:24:38.339 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-19T04:24:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-19T04:24:38.478+0000 7f67c0ff9700 0 client.4516 ms_handle_reset on v2:172.21.15.7:6802/1858240019 2024-04-19T04:24:38.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-19T04:24:38.510+0000 7f67c0ff9700 0 client.4656 ms_handle_reset on v2:172.21.15.7:6802/1858240019 2024-04-19T04:24:38.514 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-19T04:24:38.514 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "7aba6173-85fe-4265-947d-27b4a313af4e", 2024-04-19T04:24:38.514 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-19T04:24:38.514 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4239, 2024-04-19T04:24:38.514 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-19T04:24:38.515 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-19T04:24:38.515 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-19T04:24:38.515 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 17.986005295999998, 2024-04-19T04:24:38.515 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 5, 2024-04-19T04:24:38.515 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 19, 2024-04-19T04:24:38.515 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 19, 2024-04-19T04:24:38.515 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 22.284059351 2024-04-19T04:24:38.515 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-19T04:24:38.533 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-19T04:24:38.544 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-19T04:24:38.544 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}} 2024-04-19T04:24:38.545 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-19T04:24:38.545 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-19T04:24:38.545 DEBUG:teuthology.orchestra.run.smithi007:> sync 2024-04-19T04:24:38.778 DEBUG:teuthology.orchestra.run.smithi027:> sync 2024-04-19T04:24:38.816 DEBUG:teuthology.orchestra.run.smithi066:> sync 2024-04-19T04:24:38.864 DEBUG:teuthology.orchestra.run.smithi172:> sync 2024-04-19T04:24:38.939 DEBUG:tasks.thrashosds:checking console status of smithi007 2024-04-19T04:24:38.940 DEBUG:teuthology.orchestra.console.smithi007:Waiting for login prompt 2024-04-19T04:24:38.940 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi007 2024-04-19T04:24:39.109 DEBUG:teuthology.orchestra.console.smithi007:expect before: [Enter `^Ec?' for help] 2024-04-19T04:24:39.109 DEBUG:teuthology.orchestra.console.smithi007:expect after: smithi007 login: 2024-04-19T04:24:39.163 DEBUG:teuthology.orchestra.console.smithi007:console disconnect output: [Enter `^Ec?' for help] smithi007 login: [disconnect] 2024-04-19T04:24:39.264 DEBUG:tasks.thrashosds:checking console status of smithi027 2024-04-19T04:24:39.264 DEBUG:teuthology.orchestra.console.smithi027:Waiting for login prompt 2024-04-19T04:24:39.264 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi027 2024-04-19T04:24:39.407 DEBUG:teuthology.orchestra.console.smithi027:expect before: [Enter `^Ec?' for help] 2024-04-19T04:24:39.407 DEBUG:teuthology.orchestra.console.smithi027:expect after: smithi027 login: 2024-04-19T04:24:39.459 DEBUG:teuthology.orchestra.console.smithi027:console disconnect output: [Enter `^Ec?' for help] smithi027 login: [disconnect] 2024-04-19T04:24:39.560 DEBUG:tasks.thrashosds:checking console status of smithi066 2024-04-19T04:24:39.561 DEBUG:teuthology.orchestra.console.smithi066:Waiting for login prompt 2024-04-19T04:24:39.561 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi066 2024-04-19T04:24:39.726 DEBUG:teuthology.orchestra.console.smithi066:expect before: [Enter `^Ec?' for help] 2024-04-19T04:24:39.726 DEBUG:teuthology.orchestra.console.smithi066:expect after: smithi066 login: 2024-04-19T04:24:39.778 DEBUG:teuthology.orchestra.console.smithi066:console disconnect output: [Enter `^Ec?' for help] smithi066 login: [disconnect] 2024-04-19T04:24:39.878 DEBUG:tasks.thrashosds:checking console status of smithi172 2024-04-19T04:24:39.879 DEBUG:teuthology.orchestra.console.smithi172:Waiting for login prompt 2024-04-19T04:24:39.879 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi172 2024-04-19T04:24:40.013 DEBUG:teuthology.orchestra.console.smithi172:expect before: [Enter `^Ec?' for help] 2024-04-19T04:24:40.014 DEBUG:teuthology.orchestra.console.smithi172:expect after: smithi172 login: 2024-04-19T04:24:40.066 DEBUG:teuthology.orchestra.console.smithi172:console disconnect output: [Enter `^Ec?' for help] smithi172 login: [disconnect] 2024-04-19T04:24:40.167 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-19T04:24:40.518 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-19T04:24:40.518 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-19T04:24:40.518 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:24:40.826 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:40.829 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:24:40.842 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-04-19T04:24:38.876669+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94032,"kb_used_data":672,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021488,"statfs":{"total":289910292480,"available":289814003712,"internally_reserved":0,"allocated":688128,"data_stored":1356856,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004415"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541340+0000","last_change":"2024-04-19T04:24:20.550082+0000","last_active":"2024-04-19T04:24:21.541340+0000","last_peered":"2024-04-19T04:24:21.541340+0000","last_clean":"2024-04-19T04:24:21.541340+0000","last_became_active":"2024-04-19T04:24:20.549529+0000","last_became_peered":"2024-04-19T04:24:20.549529+0000","last_unstale":"2024-04-19T04:24:21.541340+0000","last_undegraded":"2024-04-19T04:24:21.541340+0000","last_fullsized":"2024-04-19T04:24:21.541340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:27.393720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540906+0000","last_change":"2024-04-19T04:24:20.545709+0000","last_active":"2024-04-19T04:24:21.540906+0000","last_peered":"2024-04-19T04:24:21.540906+0000","last_clean":"2024-04-19T04:24:21.540906+0000","last_became_active":"2024-04-19T04:24:20.544962+0000","last_became_peered":"2024-04-19T04:24:20.544962+0000","last_unstale":"2024-04-19T04:24:21.540906+0000","last_undegraded":"2024-04-19T04:24:21.540906+0000","last_fullsized":"2024-04-19T04:24:21.540906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:06.452910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608479+0000","last_change":"2024-04-19T04:24:20.556199+0000","last_active":"2024-04-19T04:24:21.608479+0000","last_peered":"2024-04-19T04:24:21.608479+0000","last_clean":"2024-04-19T04:24:21.608479+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:24:21.608479+0000","last_undegraded":"2024-04-19T04:24:21.608479+0000","last_fullsized":"2024-04-19T04:24:21.608479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:14.348910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608071+0000","last_change":"2024-04-19T04:24:20.552787+0000","last_active":"2024-04-19T04:24:21.608071+0000","last_peered":"2024-04-19T04:24:21.608071+0000","last_clean":"2024-04-19T04:24:21.608071+0000","last_became_active":"2024-04-19T04:24:20.551784+0000","last_became_peered":"2024-04-19T04:24:20.551784+0000","last_unstale":"2024-04-19T04:24:21.608071+0000","last_undegraded":"2024-04-19T04:24:21.608071+0000","last_fullsized":"2024-04-19T04:24:21.608071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:21.734428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541302+0000","last_change":"2024-04-19T04:24:20.550112+0000","last_active":"2024-04-19T04:24:21.541302+0000","last_peered":"2024-04-19T04:24:21.541302+0000","last_clean":"2024-04-19T04:24:21.541302+0000","last_became_active":"2024-04-19T04:24:20.549620+0000","last_became_peered":"2024-04-19T04:24:20.549620+0000","last_unstale":"2024-04-19T04:24:21.541302+0000","last_undegraded":"2024-04-19T04:24:21.541302+0000","last_fullsized":"2024-04-19T04:24:21.541302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:03:50.416299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607265+0000","last_change":"2024-04-19T04:24:20.551576+0000","last_active":"2024-04-19T04:24:21.607265+0000","last_peered":"2024-04-19T04:24:21.607265+0000","last_clean":"2024-04-19T04:24:21.607265+0000","last_became_active":"2024-04-19T04:24:20.548600+0000","last_became_peered":"2024-04-19T04:24:20.548600+0000","last_unstale":"2024-04-19T04:24:21.607265+0000","last_undegraded":"2024-04-19T04:24:21.607265+0000","last_fullsized":"2024-04-19T04:24:21.607265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:39.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607230+0000","last_change":"2024-04-19T04:24:20.550337+0000","last_active":"2024-04-19T04:24:21.607230+0000","last_peered":"2024-04-19T04:24:21.607230+0000","last_clean":"2024-04-19T04:24:21.607230+0000","last_became_active":"2024-04-19T04:24:20.548514+0000","last_became_peered":"2024-04-19T04:24:20.548514+0000","last_unstale":"2024-04-19T04:24:21.607230+0000","last_undegraded":"2024-04-19T04:24:21.607230+0000","last_fullsized":"2024-04-19T04:24:21.607230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:14.194572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606529+0000","last_change":"2024-04-19T04:24:20.553787+0000","last_active":"2024-04-19T04:24:21.606529+0000","last_peered":"2024-04-19T04:24:21.606529+0000","last_clean":"2024-04-19T04:24:21.606529+0000","last_became_active":"2024-04-19T04:24:20.553410+0000","last_became_peered":"2024-04-19T04:24:20.553410+0000","last_unstale":"2024-04-19T04:24:21.606529+0000","last_undegraded":"2024-04-19T04:24:21.606529+0000","last_fullsized":"2024-04-19T04:24:21.606529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:00.475711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538444+0000","last_change":"2024-04-19T04:24:20.547585+0000","last_active":"2024-04-19T04:24:21.538444+0000","last_peered":"2024-04-19T04:24:21.538444+0000","last_clean":"2024-04-19T04:24:21.538444+0000","last_became_active":"2024-04-19T04:24:20.547395+0000","last_became_peered":"2024-04-19T04:24:20.547395+0000","last_unstale":"2024-04-19T04:24:21.538444+0000","last_undegraded":"2024-04-19T04:24:21.538444+0000","last_fullsized":"2024-04-19T04:24:21.538444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:15.398090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540977+0000","last_change":"2024-04-19T04:24:20.546893+0000","last_active":"2024-04-19T04:24:21.540977+0000","last_peered":"2024-04-19T04:24:21.540977+0000","last_clean":"2024-04-19T04:24:21.540977+0000","last_became_active":"2024-04-19T04:24:20.546257+0000","last_became_peered":"2024-04-19T04:24:20.546257+0000","last_unstale":"2024-04-19T04:24:21.540977+0000","last_undegraded":"2024-04-19T04:24:21.540977+0000","last_fullsized":"2024-04-19T04:24:21.540977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:47.327841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608401+0000","last_change":"2024-04-19T04:24:20.556382+0000","last_active":"2024-04-19T04:24:21.608401+0000","last_peered":"2024-04-19T04:24:21.608401+0000","last_clean":"2024-04-19T04:24:21.608401+0000","last_became_active":"2024-04-19T04:24:20.555246+0000","last_became_peered":"2024-04-19T04:24:20.555246+0000","last_unstale":"2024-04-19T04:24:21.608401+0000","last_undegraded":"2024-04-19T04:24:21.608401+0000","last_fullsized":"2024-04-19T04:24:21.608401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:37:15.332493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540961+0000","last_change":"2024-04-19T04:24:20.558886+0000","last_active":"2024-04-19T04:24:21.540961+0000","last_peered":"2024-04-19T04:24:21.540961+0000","last_clean":"2024-04-19T04:24:21.540961+0000","last_became_active":"2024-04-19T04:24:20.558293+0000","last_became_peered":"2024-04-19T04:24:20.558293+0000","last_unstale":"2024-04-19T04:24:21.540961+0000","last_undegraded":"2024-04-19T04:24:21.540961+0000","last_fullsized":"2024-04-19T04:24:21.540961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:37:15.332493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540418+0000","last_change":"2024-04-19T04:24:20.545891+0000","last_active":"2024-04-19T04:24:21.540418+0000","last_peered":"2024-04-19T04:24:21.540418+0000","last_clean":"2024-04-19T04:24:21.540418+0000","last_became_active":"2024-04-19T04:24:20.545422+0000","last_became_peered":"2024-04-19T04:24:20.545422+0000","last_unstale":"2024-04-19T04:24:21.540418+0000","last_undegraded":"2024-04-19T04:24:21.540418+0000","last_fullsized":"2024-04-19T04:24:21.540418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:31:52.562663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607344+0000","last_change":"2024-04-19T04:24:20.552690+0000","last_active":"2024-04-19T04:24:21.607344+0000","last_peered":"2024-04-19T04:24:21.607344+0000","last_clean":"2024-04-19T04:24:21.607344+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:24:21.607344+0000","last_undegraded":"2024-04-19T04:24:21.607344+0000","last_fullsized":"2024-04-19T04:24:21.607344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:53:16.890992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607404+0000","last_change":"2024-04-19T04:24:20.551809+0000","last_active":"2024-04-19T04:24:21.607404+0000","last_peered":"2024-04-19T04:24:21.607404+0000","last_clean":"2024-04-19T04:24:21.607404+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:24:21.607404+0000","last_undegraded":"2024-04-19T04:24:21.607404+0000","last_fullsized":"2024-04-19T04:24:21.607404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:43:31.281765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606723+0000","last_change":"2024-04-19T04:24:20.552758+0000","last_active":"2024-04-19T04:24:21.606723+0000","last_peered":"2024-04-19T04:24:21.606723+0000","last_clean":"2024-04-19T04:24:21.606723+0000","last_became_active":"2024-04-19T04:24:20.548882+0000","last_became_peered":"2024-04-19T04:24:20.548882+0000","last_unstale":"2024-04-19T04:24:21.606723+0000","last_undegraded":"2024-04-19T04:24:21.606723+0000","last_fullsized":"2024-04-19T04:24:21.606723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:56.738569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539114+0000","last_change":"2024-04-19T04:24:20.546173+0000","last_active":"2024-04-19T04:24:21.539114+0000","last_peered":"2024-04-19T04:24:21.539114+0000","last_clean":"2024-04-19T04:24:21.539114+0000","last_became_active":"2024-04-19T04:24:20.545582+0000","last_became_peered":"2024-04-19T04:24:20.545582+0000","last_unstale":"2024-04-19T04:24:21.539114+0000","last_undegraded":"2024-04-19T04:24:21.539114+0000","last_fullsized":"2024-04-19T04:24:21.539114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:55.955786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541323+0000","last_change":"2024-04-19T04:24:20.549835+0000","last_active":"2024-04-19T04:24:21.541323+0000","last_peered":"2024-04-19T04:24:21.541323+0000","last_clean":"2024-04-19T04:24:21.541323+0000","last_became_active":"2024-04-19T04:24:20.549411+0000","last_became_peered":"2024-04-19T04:24:20.549411+0000","last_unstale":"2024-04-19T04:24:21.541323+0000","last_undegraded":"2024-04-19T04:24:21.541323+0000","last_fullsized":"2024-04-19T04:24:21.541323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:31:11.088424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538186+0000","last_change":"2024-04-19T04:24:20.546517+0000","last_active":"2024-04-19T04:24:21.538186+0000","last_peered":"2024-04-19T04:24:21.538186+0000","last_clean":"2024-04-19T04:24:21.538186+0000","last_became_active":"2024-04-19T04:24:20.546116+0000","last_became_peered":"2024-04-19T04:24:20.546116+0000","last_unstale":"2024-04-19T04:24:21.538186+0000","last_undegraded":"2024-04-19T04:24:21.538186+0000","last_fullsized":"2024-04-19T04:24:21.538186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:28:06.813455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608191+0000","last_change":"2024-04-19T04:24:20.551326+0000","last_active":"2024-04-19T04:24:21.608191+0000","last_peered":"2024-04-19T04:24:21.608191+0000","last_clean":"2024-04-19T04:24:21.608191+0000","last_became_active":"2024-04-19T04:24:20.550246+0000","last_became_peered":"2024-04-19T04:24:20.550246+0000","last_unstale":"2024-04-19T04:24:21.608191+0000","last_undegraded":"2024-04-19T04:24:21.608191+0000","last_fullsized":"2024-04-19T04:24:21.608191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:12.211801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608194+0000","last_change":"2024-04-19T04:24:20.556352+0000","last_active":"2024-04-19T04:24:21.608194+0000","last_peered":"2024-04-19T04:24:21.608194+0000","last_clean":"2024-04-19T04:24:21.608194+0000","last_became_active":"2024-04-19T04:24:20.554294+0000","last_became_peered":"2024-04-19T04:24:20.554294+0000","last_unstale":"2024-04-19T04:24:21.608194+0000","last_undegraded":"2024-04-19T04:24:21.608194+0000","last_fullsized":"2024-04-19T04:24:21.608194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:06.452910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540048+0000","last_change":"2024-04-19T04:24:20.555257+0000","last_active":"2024-04-19T04:24:21.540048+0000","last_peered":"2024-04-19T04:24:21.540048+0000","last_clean":"2024-04-19T04:24:21.540048+0000","last_became_active":"2024-04-19T04:24:20.554895+0000","last_became_peered":"2024-04-19T04:24:20.554895+0000","last_unstale":"2024-04-19T04:24:21.540048+0000","last_undegraded":"2024-04-19T04:24:21.540048+0000","last_fullsized":"2024-04-19T04:24:21.540048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:39.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536664+0000","last_change":"2024-04-19T04:24:20.549936+0000","last_active":"2024-04-19T04:24:21.536664+0000","last_peered":"2024-04-19T04:24:21.536664+0000","last_clean":"2024-04-19T04:24:21.536664+0000","last_became_active":"2024-04-19T04:24:20.549428+0000","last_became_peered":"2024-04-19T04:24:20.549428+0000","last_unstale":"2024-04-19T04:24:21.536664+0000","last_undegraded":"2024-04-19T04:24:21.536664+0000","last_fullsized":"2024-04-19T04:24:21.536664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:44:47.158480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539602+0000","last_change":"2024-04-19T04:24:20.546315+0000","last_active":"2024-04-19T04:24:21.539602+0000","last_peered":"2024-04-19T04:24:21.539602+0000","last_clean":"2024-04-19T04:24:21.539602+0000","last_became_active":"2024-04-19T04:24:20.545851+0000","last_became_peered":"2024-04-19T04:24:20.545851+0000","last_unstale":"2024-04-19T04:24:21.539602+0000","last_undegraded":"2024-04-19T04:24:21.539602+0000","last_fullsized":"2024-04-19T04:24:21.539602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:07:48.905896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541518+0000","last_change":"2024-04-19T04:24:20.554855+0000","last_active":"2024-04-19T04:24:21.541518+0000","last_peered":"2024-04-19T04:24:21.541518+0000","last_clean":"2024-04-19T04:24:21.541518+0000","last_became_active":"2024-04-19T04:24:20.554383+0000","last_became_peered":"2024-04-19T04:24:20.554383+0000","last_unstale":"2024-04-19T04:24:21.541518+0000","last_undegraded":"2024-04-19T04:24:21.541518+0000","last_fullsized":"2024-04-19T04:24:21.541518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:18:50.807364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538534+0000","last_change":"2024-04-19T04:24:20.546410+0000","last_active":"2024-04-19T04:24:21.538534+0000","last_peered":"2024-04-19T04:24:21.538534+0000","last_clean":"2024-04-19T04:24:21.538534+0000","last_became_active":"2024-04-19T04:24:20.545607+0000","last_became_peered":"2024-04-19T04:24:20.545607+0000","last_unstale":"2024-04-19T04:24:21.538534+0000","last_undegraded":"2024-04-19T04:24:21.538534+0000","last_fullsized":"2024-04-19T04:24:21.538534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:03.482984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608645+0000","last_change":"2024-04-19T04:24:20.554885+0000","last_active":"2024-04-19T04:24:21.608645+0000","last_peered":"2024-04-19T04:24:21.608645+0000","last_clean":"2024-04-19T04:24:21.608645+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:24:21.608645+0000","last_undegraded":"2024-04-19T04:24:21.608645+0000","last_fullsized":"2024-04-19T04:24:21.608645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:44:08.285518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541646+0000","last_change":"2024-04-19T04:24:20.558702+0000","last_active":"2024-04-19T04:24:21.541646+0000","last_peered":"2024-04-19T04:24:21.541646+0000","last_clean":"2024-04-19T04:24:21.541646+0000","last_became_active":"2024-04-19T04:24:20.558202+0000","last_became_peered":"2024-04-19T04:24:20.558202+0000","last_unstale":"2024-04-19T04:24:21.541646+0000","last_undegraded":"2024-04-19T04:24:21.541646+0000","last_fullsized":"2024-04-19T04:24:21.541646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:56.738569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537991+0000","last_change":"2024-04-19T04:24:20.543906+0000","last_active":"2024-04-19T04:24:21.537991+0000","last_peered":"2024-04-19T04:24:21.537991+0000","last_clean":"2024-04-19T04:24:21.537991+0000","last_became_active":"2024-04-19T04:24:20.543531+0000","last_became_peered":"2024-04-19T04:24:20.543531+0000","last_unstale":"2024-04-19T04:24:21.537991+0000","last_undegraded":"2024-04-19T04:24:21.537991+0000","last_fullsized":"2024-04-19T04:24:21.537991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:28:04.850289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540345+0000","last_change":"2024-04-19T04:24:20.554847+0000","last_active":"2024-04-19T04:24:21.540345+0000","last_peered":"2024-04-19T04:24:21.540345+0000","last_clean":"2024-04-19T04:24:21.540345+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:24:21.540345+0000","last_undegraded":"2024-04-19T04:24:21.540345+0000","last_fullsized":"2024-04-19T04:24:21.540345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:00.475711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536735+0000","last_change":"2024-04-19T04:24:20.546826+0000","last_active":"2024-04-19T04:24:21.536735+0000","last_peered":"2024-04-19T04:24:21.536735+0000","last_clean":"2024-04-19T04:24:21.536735+0000","last_became_active":"2024-04-19T04:24:20.546065+0000","last_became_peered":"2024-04-19T04:24:20.546065+0000","last_unstale":"2024-04-19T04:24:21.536735+0000","last_undegraded":"2024-04-19T04:24:21.536735+0000","last_fullsized":"2024-04-19T04:24:21.536735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:47.956234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606802+0000","last_change":"2024-04-19T04:24:20.552289+0000","last_active":"2024-04-19T04:24:21.606802+0000","last_peered":"2024-04-19T04:24:21.606802+0000","last_clean":"2024-04-19T04:24:21.606802+0000","last_became_active":"2024-04-19T04:24:20.548755+0000","last_became_peered":"2024-04-19T04:24:20.548755+0000","last_unstale":"2024-04-19T04:24:21.606802+0000","last_undegraded":"2024-04-19T04:24:21.606802+0000","last_fullsized":"2024-04-19T04:24:21.606802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541554+0000","last_change":"2024-04-19T04:24:20.546223+0000","last_active":"2024-04-19T04:24:21.541554+0000","last_peered":"2024-04-19T04:24:21.541554+0000","last_clean":"2024-04-19T04:24:21.541554+0000","last_became_active":"2024-04-19T04:24:20.545807+0000","last_became_peered":"2024-04-19T04:24:20.545807+0000","last_unstale":"2024-04-19T04:24:21.541554+0000","last_undegraded":"2024-04-19T04:24:21.541554+0000","last_fullsized":"2024-04-19T04:24:21.541554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:19.894104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608609+0000","last_change":"2024-04-19T04:24:20.184870+0000","last_active":"2024-04-19T04:24:21.608609+0000","last_peered":"2024-04-19T04:24:21.608609+0000","last_clean":"2024-04-19T04:24:21.608609+0000","last_became_active":"2024-04-19T04:24:20.183615+0000","last_became_peered":"2024-04-19T04:24:20.183615+0000","last_unstale":"2024-04-19T04:24:21.608609+0000","last_undegraded":"2024-04-19T04:24:21.608609+0000","last_fullsized":"2024-04-19T04:24:21.608609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:52:38.272121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541893+0000","last_change":"2024-04-19T04:24:20.547475+0000","last_active":"2024-04-19T04:24:21.541893+0000","last_peered":"2024-04-19T04:24:21.541893+0000","last_clean":"2024-04-19T04:24:21.541893+0000","last_became_active":"2024-04-19T04:24:20.546615+0000","last_became_peered":"2024-04-19T04:24:20.546615+0000","last_unstale":"2024-04-19T04:24:21.541893+0000","last_undegraded":"2024-04-19T04:24:21.541893+0000","last_fullsized":"2024-04-19T04:24:21.541893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:24.049904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537755+0000","last_change":"2024-04-19T04:24:20.177739+0000","last_active":"2024-04-19T04:24:21.537755+0000","last_peered":"2024-04-19T04:24:21.537755+0000","last_clean":"2024-04-19T04:24:21.537755+0000","last_became_active":"2024-04-19T04:24:20.177328+0000","last_became_peered":"2024-04-19T04:24:20.177328+0000","last_unstale":"2024-04-19T04:24:21.537755+0000","last_undegraded":"2024-04-19T04:24:21.537755+0000","last_fullsized":"2024-04-19T04:24:21.537755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:27.902190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538848+0000","last_change":"2024-04-19T04:24:20.547144+0000","last_active":"2024-04-19T04:24:21.538848+0000","last_peered":"2024-04-19T04:24:21.538848+0000","last_clean":"2024-04-19T04:24:21.538848+0000","last_became_active":"2024-04-19T04:24:20.546814+0000","last_became_peered":"2024-04-19T04:24:20.546814+0000","last_unstale":"2024-04-19T04:24:21.538848+0000","last_undegraded":"2024-04-19T04:24:21.538848+0000","last_fullsized":"2024-04-19T04:24:21.538848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:04.710943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540345+0000","last_change":"2024-04-19T04:24:20.183855+0000","last_active":"2024-04-19T04:24:21.540345+0000","last_peered":"2024-04-19T04:24:21.540345+0000","last_clean":"2024-04-19T04:24:21.540345+0000","last_became_active":"2024-04-19T04:24:20.183272+0000","last_became_peered":"2024-04-19T04:24:20.183272+0000","last_unstale":"2024-04-19T04:24:21.540345+0000","last_undegraded":"2024-04-19T04:24:21.540345+0000","last_fullsized":"2024-04-19T04:24:21.540345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:54.737330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538578+0000","last_change":"2024-04-19T04:24:20.551347+0000","last_active":"2024-04-19T04:24:21.538578+0000","last_peered":"2024-04-19T04:24:21.538578+0000","last_clean":"2024-04-19T04:24:21.538578+0000","last_became_active":"2024-04-19T04:24:20.550917+0000","last_became_peered":"2024-04-19T04:24:20.550917+0000","last_unstale":"2024-04-19T04:24:21.538578+0000","last_undegraded":"2024-04-19T04:24:21.538578+0000","last_fullsized":"2024-04-19T04:24:21.538578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:47.732617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606983+0000","last_change":"2024-04-19T04:24:20.187299+0000","last_active":"2024-04-19T04:24:21.606983+0000","last_peered":"2024-04-19T04:24:21.606983+0000","last_clean":"2024-04-19T04:24:21.606983+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:24:21.606983+0000","last_undegraded":"2024-04-19T04:24:21.606983+0000","last_fullsized":"2024-04-19T04:24:21.606983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:49:37.812125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609542+0000","last_change":"2024-04-19T04:24:20.186029+0000","last_active":"2024-04-19T04:24:21.609542+0000","last_peered":"2024-04-19T04:24:21.609542+0000","last_clean":"2024-04-19T04:24:21.609542+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:24:21.609542+0000","last_undegraded":"2024-04-19T04:24:21.609542+0000","last_fullsized":"2024-04-19T04:24:21.609542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:49.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539569+0000","last_change":"2024-04-19T04:24:20.555751+0000","last_active":"2024-04-19T04:24:21.539569+0000","last_peered":"2024-04-19T04:24:21.539569+0000","last_clean":"2024-04-19T04:24:21.539569+0000","last_became_active":"2024-04-19T04:24:20.555501+0000","last_became_peered":"2024-04-19T04:24:20.555501+0000","last_unstale":"2024-04-19T04:24:21.539569+0000","last_undegraded":"2024-04-19T04:24:21.539569+0000","last_fullsized":"2024-04-19T04:24:21.539569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:57.839930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541919+0000","last_change":"2024-04-19T04:24:20.184142+0000","last_active":"2024-04-19T04:24:21.541919+0000","last_peered":"2024-04-19T04:24:21.541919+0000","last_clean":"2024-04-19T04:24:21.541919+0000","last_became_active":"2024-04-19T04:24:20.183546+0000","last_became_peered":"2024-04-19T04:24:20.183546+0000","last_unstale":"2024-04-19T04:24:21.541919+0000","last_undegraded":"2024-04-19T04:24:21.541919+0000","last_fullsized":"2024-04-19T04:24:21.541919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:17.280977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539845+0000","last_change":"2024-04-19T04:24:20.545490+0000","last_active":"2024-04-19T04:24:21.539845+0000","last_peered":"2024-04-19T04:24:21.539845+0000","last_clean":"2024-04-19T04:24:21.539845+0000","last_became_active":"2024-04-19T04:24:20.544898+0000","last_became_peered":"2024-04-19T04:24:20.544898+0000","last_unstale":"2024-04-19T04:24:21.539845+0000","last_undegraded":"2024-04-19T04:24:21.539845+0000","last_fullsized":"2024-04-19T04:24:21.539845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:40:02.138518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609093+0000","last_change":"2024-04-19T04:24:20.186044+0000","last_active":"2024-04-19T04:24:21.609093+0000","last_peered":"2024-04-19T04:24:21.609093+0000","last_clean":"2024-04-19T04:24:21.609093+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:24:21.609093+0000","last_undegraded":"2024-04-19T04:24:21.609093+0000","last_fullsized":"2024-04-19T04:24:21.609093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.432692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607445+0000","last_change":"2024-04-19T04:24:20.552828+0000","last_active":"2024-04-19T04:24:21.607445+0000","last_peered":"2024-04-19T04:24:21.607445+0000","last_clean":"2024-04-19T04:24:21.607445+0000","last_became_active":"2024-04-19T04:24:20.551927+0000","last_became_peered":"2024-04-19T04:24:20.551927+0000","last_unstale":"2024-04-19T04:24:21.607445+0000","last_undegraded":"2024-04-19T04:24:21.607445+0000","last_fullsized":"2024-04-19T04:24:21.607445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:41.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608700+0000","last_change":"2024-04-19T04:24:20.179238+0000","last_active":"2024-04-19T04:24:21.608700+0000","last_peered":"2024-04-19T04:24:21.608700+0000","last_clean":"2024-04-19T04:24:21.608700+0000","last_became_active":"2024-04-19T04:24:20.178758+0000","last_became_peered":"2024-04-19T04:24:20.178758+0000","last_unstale":"2024-04-19T04:24:21.608700+0000","last_undegraded":"2024-04-19T04:24:21.608700+0000","last_fullsized":"2024-04-19T04:24:21.608700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:18:24.789775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537600+0000","last_change":"2024-04-19T04:24:20.554969+0000","last_active":"2024-04-19T04:24:21.537600+0000","last_peered":"2024-04-19T04:24:21.537600+0000","last_clean":"2024-04-19T04:24:21.537600+0000","last_became_active":"2024-04-19T04:24:20.554604+0000","last_became_peered":"2024-04-19T04:24:20.554604+0000","last_unstale":"2024-04-19T04:24:21.537600+0000","last_undegraded":"2024-04-19T04:24:21.537600+0000","last_fullsized":"2024-04-19T04:24:21.537600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:58:47.703110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538228+0000","last_change":"2024-04-19T04:24:20.178602+0000","last_active":"2024-04-19T04:24:21.538228+0000","last_peered":"2024-04-19T04:24:21.538228+0000","last_clean":"2024-04-19T04:24:21.538228+0000","last_became_active":"2024-04-19T04:24:20.177976+0000","last_became_peered":"2024-04-19T04:24:20.177976+0000","last_unstale":"2024-04-19T04:24:21.538228+0000","last_undegraded":"2024-04-19T04:24:21.538228+0000","last_fullsized":"2024-04-19T04:24:21.538228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:15.883790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608409+0000","last_change":"2024-04-19T04:24:20.548296+0000","last_active":"2024-04-19T04:24:21.608409+0000","last_peered":"2024-04-19T04:24:21.608409+0000","last_clean":"2024-04-19T04:24:21.608409+0000","last_became_active":"2024-04-19T04:24:20.547457+0000","last_became_peered":"2024-04-19T04:24:20.547457+0000","last_unstale":"2024-04-19T04:24:21.608409+0000","last_undegraded":"2024-04-19T04:24:21.608409+0000","last_fullsized":"2024-04-19T04:24:21.608409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:57.839930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607638+0000","last_change":"2024-04-19T04:24:20.184338+0000","last_active":"2024-04-19T04:24:21.607638+0000","last_peered":"2024-04-19T04:24:21.607638+0000","last_clean":"2024-04-19T04:24:21.607638+0000","last_became_active":"2024-04-19T04:24:20.183511+0000","last_became_peered":"2024-04-19T04:24:20.183511+0000","last_unstale":"2024-04-19T04:24:21.607638+0000","last_undegraded":"2024-04-19T04:24:21.607638+0000","last_fullsized":"2024-04-19T04:24:21.607638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:14.235823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608849+0000","last_change":"2024-04-19T04:24:20.555922+0000","last_active":"2024-04-19T04:24:21.608849+0000","last_peered":"2024-04-19T04:24:21.608849+0000","last_clean":"2024-04-19T04:24:21.608849+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:24:21.608849+0000","last_undegraded":"2024-04-19T04:24:21.608849+0000","last_fullsized":"2024-04-19T04:24:21.608849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:06:53.595149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540165+0000","last_change":"2024-04-19T04:24:20.183944+0000","last_active":"2024-04-19T04:24:21.540165+0000","last_peered":"2024-04-19T04:24:21.540165+0000","last_clean":"2024-04-19T04:24:21.540165+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:24:21.540165+0000","last_undegraded":"2024-04-19T04:24:21.540165+0000","last_fullsized":"2024-04-19T04:24:21.540165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:42.018487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608707+0000","last_change":"2024-04-19T04:24:20.553085+0000","last_active":"2024-04-19T04:24:21.608707+0000","last_peered":"2024-04-19T04:24:21.608707+0000","last_clean":"2024-04-19T04:24:21.608707+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:24:21.608707+0000","last_undegraded":"2024-04-19T04:24:21.608707+0000","last_fullsized":"2024-04-19T04:24:21.608707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:07:21.467758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539831+0000","last_change":"2024-04-19T04:24:20.180834+0000","last_active":"2024-04-19T04:24:21.539831+0000","last_peered":"2024-04-19T04:24:21.539831+0000","last_clean":"2024-04-19T04:24:21.539831+0000","last_became_active":"2024-04-19T04:24:20.180522+0000","last_became_peered":"2024-04-19T04:24:20.180522+0000","last_unstale":"2024-04-19T04:24:21.539831+0000","last_undegraded":"2024-04-19T04:24:21.539831+0000","last_fullsized":"2024-04-19T04:24:21.539831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:38:28.208268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538763+0000","last_change":"2024-04-19T04:24:20.547313+0000","last_active":"2024-04-19T04:24:21.538763+0000","last_peered":"2024-04-19T04:24:21.538763+0000","last_clean":"2024-04-19T04:24:21.538763+0000","last_became_active":"2024-04-19T04:24:20.545692+0000","last_became_peered":"2024-04-19T04:24:20.545692+0000","last_unstale":"2024-04-19T04:24:21.538763+0000","last_undegraded":"2024-04-19T04:24:21.538763+0000","last_fullsized":"2024-04-19T04:24:21.538763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:24:42.844961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.547904+0000","last_change":"2024-04-19T04:24:10.106278+0000","last_active":"2024-04-19T04:24:20.547904+0000","last_peered":"2024-04-19T04:24:20.547904+0000","last_clean":"2024-04-19T04:24:20.547904+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:24:20.547904+0000","last_undegraded":"2024-04-19T04:24:20.547904+0000","last_fullsized":"2024-04-19T04:24:20.547904+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_clean_scrub_stamp":"2024-04-19T04:24:09.083488+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.549706+0000","last_change":"2024-04-19T04:24:16.144872+0000","last_active":"2024-04-19T04:24:20.549706+0000","last_peered":"2024-04-19T04:24:20.549706+0000","last_clean":"2024-04-19T04:24:20.549706+0000","last_became_active":"2024-04-19T04:24:16.143778+0000","last_became_peered":"2024-04-19T04:24:16.143778+0000","last_unstale":"2024-04-19T04:24:20.549706+0000","last_undegraded":"2024-04-19T04:24:20.549706+0000","last_fullsized":"2024-04-19T04:24:20.549706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:26:06.303713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538038+0000","last_change":"2024-04-19T04:24:20.174958+0000","last_active":"2024-04-19T04:24:21.538038+0000","last_peered":"2024-04-19T04:24:21.538038+0000","last_clean":"2024-04-19T04:24:21.538038+0000","last_became_active":"2024-04-19T04:24:20.174643+0000","last_became_peered":"2024-04-19T04:24:20.174643+0000","last_unstale":"2024-04-19T04:24:21.538038+0000","last_undegraded":"2024-04-19T04:24:21.538038+0000","last_fullsized":"2024-04-19T04:24:21.538038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:37.752236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608950+0000","last_change":"2024-04-19T04:24:20.553999+0000","last_active":"2024-04-19T04:24:21.608950+0000","last_peered":"2024-04-19T04:24:21.608950+0000","last_clean":"2024-04-19T04:24:21.608950+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:24:21.608950+0000","last_undegraded":"2024-04-19T04:24:21.608950+0000","last_fullsized":"2024-04-19T04:24:21.608950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:13:53.306369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.546806+0000","last_change":"2024-04-19T04:24:16.144482+0000","last_active":"2024-04-19T04:24:20.546806+0000","last_peered":"2024-04-19T04:24:20.546806+0000","last_clean":"2024-04-19T04:24:20.546806+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:24:20.546806+0000","last_undegraded":"2024-04-19T04:24:20.546806+0000","last_fullsized":"2024-04-19T04:24:20.546806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:15.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537224+0000","last_change":"2024-04-19T04:24:20.179129+0000","last_active":"2024-04-19T04:24:21.537224+0000","last_peered":"2024-04-19T04:24:21.537224+0000","last_clean":"2024-04-19T04:24:21.537224+0000","last_became_active":"2024-04-19T04:24:20.178247+0000","last_became_peered":"2024-04-19T04:24:20.178247+0000","last_unstale":"2024-04-19T04:24:21.537224+0000","last_undegraded":"2024-04-19T04:24:21.537224+0000","last_fullsized":"2024-04-19T04:24:21.537224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:51.616306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541152+0000","last_change":"2024-04-19T04:24:20.550166+0000","last_active":"2024-04-19T04:24:21.541152+0000","last_peered":"2024-04-19T04:24:21.541152+0000","last_clean":"2024-04-19T04:24:21.541152+0000","last_became_active":"2024-04-19T04:24:20.549606+0000","last_became_peered":"2024-04-19T04:24:20.549606+0000","last_unstale":"2024-04-19T04:24:21.541152+0000","last_undegraded":"2024-04-19T04:24:21.541152+0000","last_fullsized":"2024-04-19T04:24:21.541152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:41.685120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.533460+0000","last_change":"2024-04-19T04:24:16.135584+0000","last_active":"2024-04-19T04:24:20.533460+0000","last_peered":"2024-04-19T04:24:20.533460+0000","last_clean":"2024-04-19T04:24:20.533460+0000","last_became_active":"2024-04-19T04:24:16.134799+0000","last_became_peered":"2024-04-19T04:24:16.134799+0000","last_unstale":"2024-04-19T04:24:20.533460+0000","last_undegraded":"2024-04-19T04:24:20.533460+0000","last_fullsized":"2024-04-19T04:24:20.533460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:55:57.442649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539948+0000","last_change":"2024-04-19T04:24:20.183933+0000","last_active":"2024-04-19T04:24:21.539948+0000","last_peered":"2024-04-19T04:24:21.539948+0000","last_clean":"2024-04-19T04:24:21.539948+0000","last_became_active":"2024-04-19T04:24:20.183490+0000","last_became_peered":"2024-04-19T04:24:20.183490+0000","last_unstale":"2024-04-19T04:24:21.539948+0000","last_undegraded":"2024-04-19T04:24:21.539948+0000","last_fullsized":"2024-04-19T04:24:21.539948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:43.869727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538758+0000","last_change":"2024-04-19T04:24:20.544687+0000","last_active":"2024-04-19T04:24:21.538758+0000","last_peered":"2024-04-19T04:24:21.538758+0000","last_clean":"2024-04-19T04:24:21.538758+0000","last_became_active":"2024-04-19T04:24:20.544430+0000","last_became_peered":"2024-04-19T04:24:20.544430+0000","last_unstale":"2024-04-19T04:24:21.538758+0000","last_undegraded":"2024-04-19T04:24:21.538758+0000","last_fullsized":"2024-04-19T04:24:21.538758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:11:22.765812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.548059+0000","last_change":"2024-04-19T04:24:16.145124+0000","last_active":"2024-04-19T04:24:20.548059+0000","last_peered":"2024-04-19T04:24:20.548059+0000","last_clean":"2024-04-19T04:24:20.548059+0000","last_became_active":"2024-04-19T04:24:16.143949+0000","last_became_peered":"2024-04-19T04:24:16.143949+0000","last_unstale":"2024-04-19T04:24:20.548059+0000","last_undegraded":"2024-04-19T04:24:20.548059+0000","last_fullsized":"2024-04-19T04:24:20.548059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:18.901615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608836+0000","last_change":"2024-04-19T04:24:20.179004+0000","last_active":"2024-04-19T04:24:21.608836+0000","last_peered":"2024-04-19T04:24:21.608836+0000","last_clean":"2024-04-19T04:24:21.608836+0000","last_became_active":"2024-04-19T04:24:20.178123+0000","last_became_peered":"2024-04-19T04:24:20.178123+0000","last_unstale":"2024-04-19T04:24:21.608836+0000","last_undegraded":"2024-04-19T04:24:21.608836+0000","last_fullsized":"2024-04-19T04:24:21.608836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:35:25.084528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538611+0000","last_change":"2024-04-19T04:24:20.544312+0000","last_active":"2024-04-19T04:24:21.538611+0000","last_peered":"2024-04-19T04:24:21.538611+0000","last_clean":"2024-04-19T04:24:21.538611+0000","last_became_active":"2024-04-19T04:24:20.543738+0000","last_became_peered":"2024-04-19T04:24:20.543738+0000","last_unstale":"2024-04-19T04:24:21.538611+0000","last_undegraded":"2024-04-19T04:24:21.538611+0000","last_fullsized":"2024-04-19T04:24:21.538611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:23.486532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609184+0000","last_change":"2024-04-19T04:24:20.184349+0000","last_active":"2024-04-19T04:24:21.609184+0000","last_peered":"2024-04-19T04:24:21.609184+0000","last_clean":"2024-04-19T04:24:21.609184+0000","last_became_active":"2024-04-19T04:24:20.183495+0000","last_became_peered":"2024-04-19T04:24:20.183495+0000","last_unstale":"2024-04-19T04:24:21.609184+0000","last_undegraded":"2024-04-19T04:24:21.609184+0000","last_fullsized":"2024-04-19T04:24:21.609184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:16:09.571178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.531994+0000","last_change":"2024-04-19T04:24:16.136119+0000","last_active":"2024-04-19T04:24:20.531994+0000","last_peered":"2024-04-19T04:24:20.531994+0000","last_clean":"2024-04-19T04:24:20.531994+0000","last_became_active":"2024-04-19T04:24:16.135272+0000","last_became_peered":"2024-04-19T04:24:16.135272+0000","last_unstale":"2024-04-19T04:24:20.531994+0000","last_undegraded":"2024-04-19T04:24:20.531994+0000","last_fullsized":"2024-04-19T04:24:20.531994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:07:14.180095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540172+0000","last_change":"2024-04-19T04:24:20.555116+0000","last_active":"2024-04-19T04:24:21.540172+0000","last_peered":"2024-04-19T04:24:21.540172+0000","last_clean":"2024-04-19T04:24:21.540172+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:24:21.540172+0000","last_undegraded":"2024-04-19T04:24:21.540172+0000","last_fullsized":"2024-04-19T04:24:21.540172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:21.734428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538645+0000","last_change":"2024-04-19T04:24:20.174833+0000","last_active":"2024-04-19T04:24:21.538645+0000","last_peered":"2024-04-19T04:24:21.538645+0000","last_clean":"2024-04-19T04:24:21.538645+0000","last_became_active":"2024-04-19T04:24:20.174517+0000","last_became_peered":"2024-04-19T04:24:20.174517+0000","last_unstale":"2024-04-19T04:24:21.538645+0000","last_undegraded":"2024-04-19T04:24:21.538645+0000","last_fullsized":"2024-04-19T04:24:21.538645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:51.699530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.536090+0000","last_change":"2024-04-19T04:24:16.141899+0000","last_active":"2024-04-19T04:24:20.536090+0000","last_peered":"2024-04-19T04:24:20.536090+0000","last_clean":"2024-04-19T04:24:20.536090+0000","last_became_active":"2024-04-19T04:24:16.141508+0000","last_became_peered":"2024-04-19T04:24:16.141508+0000","last_unstale":"2024-04-19T04:24:20.536090+0000","last_undegraded":"2024-04-19T04:24:20.536090+0000","last_fullsized":"2024-04-19T04:24:20.536090+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:31.719446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540502+0000","last_change":"2024-04-19T04:24:20.558559+0000","last_active":"2024-04-19T04:24:21.540502+0000","last_peered":"2024-04-19T04:24:21.540502+0000","last_clean":"2024-04-19T04:24:21.540502+0000","last_became_active":"2024-04-19T04:24:20.558215+0000","last_became_peered":"2024-04-19T04:24:20.558215+0000","last_unstale":"2024-04-19T04:24:21.540502+0000","last_undegraded":"2024-04-19T04:24:21.540502+0000","last_fullsized":"2024-04-19T04:24:21.540502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:41.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539118+0000","last_change":"2024-04-19T04:24:20.175205+0000","last_active":"2024-04-19T04:24:21.539118+0000","last_peered":"2024-04-19T04:24:21.539118+0000","last_clean":"2024-04-19T04:24:21.539118+0000","last_became_active":"2024-04-19T04:24:20.174912+0000","last_became_peered":"2024-04-19T04:24:20.174912+0000","last_unstale":"2024-04-19T04:24:21.539118+0000","last_undegraded":"2024-04-19T04:24:21.539118+0000","last_fullsized":"2024-04-19T04:24:21.539118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:21:37.681287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.533233+0000","last_change":"2024-04-19T04:24:16.135892+0000","last_active":"2024-04-19T04:24:20.533233+0000","last_peered":"2024-04-19T04:24:20.533233+0000","last_clean":"2024-04-19T04:24:20.533233+0000","last_became_active":"2024-04-19T04:24:16.135385+0000","last_became_peered":"2024-04-19T04:24:16.135385+0000","last_unstale":"2024-04-19T04:24:20.533233+0000","last_undegraded":"2024-04-19T04:24:20.533233+0000","last_fullsized":"2024-04-19T04:24:20.533233+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:37.110319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536977+0000","last_change":"2024-04-19T04:24:20.553486+0000","last_active":"2024-04-19T04:24:21.536977+0000","last_peered":"2024-04-19T04:24:21.536977+0000","last_clean":"2024-04-19T04:24:21.536977+0000","last_became_active":"2024-04-19T04:24:20.553206+0000","last_became_peered":"2024-04-19T04:24:20.553206+0000","last_unstale":"2024-04-19T04:24:21.536977+0000","last_undegraded":"2024-04-19T04:24:21.536977+0000","last_fullsized":"2024-04-19T04:24:21.536977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:32.648637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:23.878567+0000","last_change":"2024-04-19T04:24:20.178880+0000","last_active":"2024-04-19T04:24:23.878567+0000","last_peered":"2024-04-19T04:24:23.878567+0000","last_clean":"2024-04-19T04:24:23.878567+0000","last_became_active":"2024-04-19T04:24:20.177593+0000","last_became_peered":"2024-04-19T04:24:20.177593+0000","last_unstale":"2024-04-19T04:24:23.878567+0000","last_undegraded":"2024-04-19T04:24:23.878567+0000","last_fullsized":"2024-04-19T04:24:23.878567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:58:32.732477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.549281+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:24:20.549281+0000","last_peered":"2024-04-19T04:24:20.549281+0000","last_clean":"2024-04-19T04:24:20.549281+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:24:20.549281+0000","last_undegraded":"2024-04-19T04:24:20.549281+0000","last_fullsized":"2024-04-19T04:24:20.549281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:45.574813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539891+0000","last_change":"2024-04-19T04:24:20.554721+0000","last_active":"2024-04-19T04:24:21.539891+0000","last_peered":"2024-04-19T04:24:21.539891+0000","last_clean":"2024-04-19T04:24:21.539891+0000","last_became_active":"2024-04-19T04:24:20.554286+0000","last_became_peered":"2024-04-19T04:24:20.554286+0000","last_unstale":"2024-04-19T04:24:21.539891+0000","last_undegraded":"2024-04-19T04:24:21.539891+0000","last_fullsized":"2024-04-19T04:24:21.539891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:14.194572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608106+0000","last_change":"2024-04-19T04:24:20.555406+0000","last_active":"2024-04-19T04:24:21.608106+0000","last_peered":"2024-04-19T04:24:21.608106+0000","last_clean":"2024-04-19T04:24:21.608106+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:24:21.608106+0000","last_undegraded":"2024-04-19T04:24:21.608106+0000","last_fullsized":"2024-04-19T04:24:21.608106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:10.453970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608703+0000","last_change":"2024-04-19T04:24:20.185978+0000","last_active":"2024-04-19T04:24:21.608703+0000","last_peered":"2024-04-19T04:24:21.608703+0000","last_clean":"2024-04-19T04:24:21.608703+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:24:21.608703+0000","last_undegraded":"2024-04-19T04:24:21.608703+0000","last_fullsized":"2024-04-19T04:24:21.608703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:48.158805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537416+0000","last_change":"2024-04-19T04:24:20.544323+0000","last_active":"2024-04-19T04:24:21.537416+0000","last_peered":"2024-04-19T04:24:21.537416+0000","last_clean":"2024-04-19T04:24:21.537416+0000","last_became_active":"2024-04-19T04:24:20.543893+0000","last_became_peered":"2024-04-19T04:24:20.543893+0000","last_unstale":"2024-04-19T04:24:21.537416+0000","last_undegraded":"2024-04-19T04:24:21.537416+0000","last_fullsized":"2024-04-19T04:24:21.537416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:01.587027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.542097+0000","last_change":"2024-04-19T04:24:20.184342+0000","last_active":"2024-04-19T04:24:21.542097+0000","last_peered":"2024-04-19T04:24:21.542097+0000","last_clean":"2024-04-19T04:24:21.542097+0000","last_became_active":"2024-04-19T04:24:20.183970+0000","last_became_peered":"2024-04-19T04:24:20.183970+0000","last_unstale":"2024-04-19T04:24:21.542097+0000","last_undegraded":"2024-04-19T04:24:21.542097+0000","last_fullsized":"2024-04-19T04:24:21.542097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:46.956957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609216+0000","last_change":"2024-04-19T04:24:20.184508+0000","last_active":"2024-04-19T04:24:21.609216+0000","last_peered":"2024-04-19T04:24:21.609216+0000","last_clean":"2024-04-19T04:24:21.609216+0000","last_became_active":"2024-04-19T04:24:20.184060+0000","last_became_peered":"2024-04-19T04:24:20.184060+0000","last_unstale":"2024-04-19T04:24:21.609216+0000","last_undegraded":"2024-04-19T04:24:21.609216+0000","last_fullsized":"2024-04-19T04:24:21.609216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:14:57.634877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537342+0000","last_change":"2024-04-19T04:24:20.546949+0000","last_active":"2024-04-19T04:24:21.537342+0000","last_peered":"2024-04-19T04:24:21.537342+0000","last_clean":"2024-04-19T04:24:21.537342+0000","last_became_active":"2024-04-19T04:24:20.546029+0000","last_became_peered":"2024-04-19T04:24:20.546029+0000","last_unstale":"2024-04-19T04:24:21.537342+0000","last_undegraded":"2024-04-19T04:24:21.537342+0000","last_fullsized":"2024-04-19T04:24:21.537342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:22:06.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539031+0000","last_change":"2024-04-19T04:24:20.178672+0000","last_active":"2024-04-19T04:24:21.539031+0000","last_peered":"2024-04-19T04:24:21.539031+0000","last_clean":"2024-04-19T04:24:21.539031+0000","last_became_active":"2024-04-19T04:24:20.177921+0000","last_became_peered":"2024-04-19T04:24:20.177921+0000","last_unstale":"2024-04-19T04:24:21.539031+0000","last_undegraded":"2024-04-19T04:24:21.539031+0000","last_fullsized":"2024-04-19T04:24:21.539031+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:21.042990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536875+0000","last_change":"2024-04-19T04:24:20.546616+0000","last_active":"2024-04-19T04:24:21.536875+0000","last_peered":"2024-04-19T04:24:21.536875+0000","last_clean":"2024-04-19T04:24:21.536875+0000","last_became_active":"2024-04-19T04:24:20.546032+0000","last_became_peered":"2024-04-19T04:24:20.546032+0000","last_unstale":"2024-04-19T04:24:21.536875+0000","last_undegraded":"2024-04-19T04:24:21.536875+0000","last_fullsized":"2024-04-19T04:24:21.536875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:02:20.398899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541610+0000","last_change":"2024-04-19T04:24:20.552644+0000","last_active":"2024-04-19T04:24:21.541610+0000","last_peered":"2024-04-19T04:24:21.541610+0000","last_clean":"2024-04-19T04:24:21.541610+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:24:21.541610+0000","last_undegraded":"2024-04-19T04:24:21.541610+0000","last_fullsized":"2024-04-19T04:24:21.541610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537050+0000","last_change":"2024-04-19T04:24:20.174912+0000","last_active":"2024-04-19T04:24:21.537050+0000","last_peered":"2024-04-19T04:24:21.537050+0000","last_clean":"2024-04-19T04:24:21.537050+0000","last_became_active":"2024-04-19T04:24:20.174629+0000","last_became_peered":"2024-04-19T04:24:20.174629+0000","last_unstale":"2024-04-19T04:24:21.537050+0000","last_undegraded":"2024-04-19T04:24:21.537050+0000","last_fullsized":"2024-04-19T04:24:21.537050+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:09:12.929115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538272+0000","last_change":"2024-04-19T04:24:20.549484+0000","last_active":"2024-04-19T04:24:21.538272+0000","last_peered":"2024-04-19T04:24:21.538272+0000","last_clean":"2024-04-19T04:24:21.538272+0000","last_became_active":"2024-04-19T04:24:20.549149+0000","last_became_peered":"2024-04-19T04:24:20.549149+0000","last_unstale":"2024-04-19T04:24:21.538272+0000","last_undegraded":"2024-04-19T04:24:21.538272+0000","last_fullsized":"2024-04-19T04:24:21.538272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:49.148982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537100+0000","last_change":"2024-04-19T04:24:20.178730+0000","last_active":"2024-04-19T04:24:21.537100+0000","last_peered":"2024-04-19T04:24:21.537100+0000","last_clean":"2024-04-19T04:24:21.537100+0000","last_became_active":"2024-04-19T04:24:20.177996+0000","last_became_peered":"2024-04-19T04:24:20.177996+0000","last_unstale":"2024-04-19T04:24:21.537100+0000","last_undegraded":"2024-04-19T04:24:21.537100+0000","last_fullsized":"2024-04-19T04:24:21.537100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:27:46.704368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541658+0000","last_change":"2024-04-19T04:24:20.556092+0000","last_active":"2024-04-19T04:24:21.541658+0000","last_peered":"2024-04-19T04:24:21.541658+0000","last_clean":"2024-04-19T04:24:21.541658+0000","last_became_active":"2024-04-19T04:24:20.555928+0000","last_became_peered":"2024-04-19T04:24:20.555928+0000","last_unstale":"2024-04-19T04:24:21.541658+0000","last_undegraded":"2024-04-19T04:24:21.541658+0000","last_fullsized":"2024-04-19T04:24:21.541658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:12.211801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540632+0000","last_change":"2024-04-19T04:24:20.179779+0000","last_active":"2024-04-19T04:24:21.540632+0000","last_peered":"2024-04-19T04:24:21.540632+0000","last_clean":"2024-04-19T04:24:21.540632+0000","last_became_active":"2024-04-19T04:24:20.179457+0000","last_became_peered":"2024-04-19T04:24:20.179457+0000","last_unstale":"2024-04-19T04:24:21.540632+0000","last_undegraded":"2024-04-19T04:24:21.540632+0000","last_fullsized":"2024-04-19T04:24:21.540632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:27:04.757759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541223+0000","last_change":"2024-04-19T04:24:20.546222+0000","last_active":"2024-04-19T04:24:21.541223+0000","last_peered":"2024-04-19T04:24:21.541223+0000","last_clean":"2024-04-19T04:24:21.541223+0000","last_became_active":"2024-04-19T04:24:20.545395+0000","last_became_peered":"2024-04-19T04:24:20.545395+0000","last_unstale":"2024-04-19T04:24:21.541223+0000","last_undegraded":"2024-04-19T04:24:21.541223+0000","last_fullsized":"2024-04-19T04:24:21.541223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:56.201003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540715+0000","last_change":"2024-04-19T04:24:20.184108+0000","last_active":"2024-04-19T04:24:21.540715+0000","last_peered":"2024-04-19T04:24:21.540715+0000","last_clean":"2024-04-19T04:24:21.540715+0000","last_became_active":"2024-04-19T04:24:20.183677+0000","last_became_peered":"2024-04-19T04:24:20.183677+0000","last_unstale":"2024-04-19T04:24:21.540715+0000","last_undegraded":"2024-04-19T04:24:21.540715+0000","last_fullsized":"2024-04-19T04:24:21.540715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:06.185573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607906+0000","last_change":"2024-04-19T04:24:20.556556+0000","last_active":"2024-04-19T04:24:21.607906+0000","last_peered":"2024-04-19T04:24:21.607906+0000","last_clean":"2024-04-19T04:24:21.607906+0000","last_became_active":"2024-04-19T04:24:20.555286+0000","last_became_peered":"2024-04-19T04:24:20.555286+0000","last_unstale":"2024-04-19T04:24:21.607906+0000","last_undegraded":"2024-04-19T04:24:21.607906+0000","last_fullsized":"2024-04-19T04:24:21.607906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:18:50.807364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608430+0000","last_change":"2024-04-19T04:24:20.184583+0000","last_active":"2024-04-19T04:24:21.608430+0000","last_peered":"2024-04-19T04:24:21.608430+0000","last_clean":"2024-04-19T04:24:21.608430+0000","last_became_active":"2024-04-19T04:24:20.183933+0000","last_became_peered":"2024-04-19T04:24:20.183933+0000","last_unstale":"2024-04-19T04:24:21.608430+0000","last_undegraded":"2024-04-19T04:24:21.608430+0000","last_fullsized":"2024-04-19T04:24:21.608430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:24.424300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607603+0000","last_change":"2024-04-19T04:24:20.550606+0000","last_active":"2024-04-19T04:24:21.607603+0000","last_peered":"2024-04-19T04:24:21.607603+0000","last_clean":"2024-04-19T04:24:21.607603+0000","last_became_active":"2024-04-19T04:24:20.548990+0000","last_became_peered":"2024-04-19T04:24:20.548990+0000","last_unstale":"2024-04-19T04:24:21.607603+0000","last_undegraded":"2024-04-19T04:24:21.607603+0000","last_fullsized":"2024-04-19T04:24:21.607603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:31:52.562663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541997+0000","last_change":"2024-04-19T04:24:20.184190+0000","last_active":"2024-04-19T04:24:21.541997+0000","last_peered":"2024-04-19T04:24:21.541997+0000","last_clean":"2024-04-19T04:24:21.541997+0000","last_became_active":"2024-04-19T04:24:20.183869+0000","last_became_peered":"2024-04-19T04:24:20.183869+0000","last_unstale":"2024-04-19T04:24:21.541997+0000","last_undegraded":"2024-04-19T04:24:21.541997+0000","last_fullsized":"2024-04-19T04:24:21.541997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:13:48.624837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540713+0000","last_change":"2024-04-19T04:24:20.546603+0000","last_active":"2024-04-19T04:24:21.540713+0000","last_peered":"2024-04-19T04:24:21.540713+0000","last_clean":"2024-04-19T04:24:21.540713+0000","last_became_active":"2024-04-19T04:24:20.546136+0000","last_became_peered":"2024-04-19T04:24:20.546136+0000","last_unstale":"2024-04-19T04:24:21.540713+0000","last_undegraded":"2024-04-19T04:24:21.540713+0000","last_fullsized":"2024-04-19T04:24:21.540713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:20.610726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538747+0000","last_change":"2024-04-19T04:24:20.178148+0000","last_active":"2024-04-19T04:24:21.538747+0000","last_peered":"2024-04-19T04:24:21.538747+0000","last_clean":"2024-04-19T04:24:21.538747+0000","last_became_active":"2024-04-19T04:24:20.177382+0000","last_became_peered":"2024-04-19T04:24:20.177382+0000","last_unstale":"2024-04-19T04:24:21.538747+0000","last_undegraded":"2024-04-19T04:24:21.538747+0000","last_fullsized":"2024-04-19T04:24:21.538747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:03.585052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607131+0000","last_change":"2024-04-19T04:24:20.556288+0000","last_active":"2024-04-19T04:24:21.607131+0000","last_peered":"2024-04-19T04:24:21.607131+0000","last_clean":"2024-04-19T04:24:21.607131+0000","last_became_active":"2024-04-19T04:24:20.554960+0000","last_became_peered":"2024-04-19T04:24:20.554960+0000","last_unstale":"2024-04-19T04:24:21.607131+0000","last_undegraded":"2024-04-19T04:24:21.607131+0000","last_fullsized":"2024-04-19T04:24:21.607131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:27.393720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538917+0000","last_change":"2024-04-19T04:24:20.180873+0000","last_active":"2024-04-19T04:24:21.538917+0000","last_peered":"2024-04-19T04:24:21.538917+0000","last_clean":"2024-04-19T04:24:21.538917+0000","last_became_active":"2024-04-19T04:24:20.180584+0000","last_became_peered":"2024-04-19T04:24:20.180584+0000","last_unstale":"2024-04-19T04:24:21.538917+0000","last_undegraded":"2024-04-19T04:24:21.538917+0000","last_fullsized":"2024-04-19T04:24:21.538917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:43:03.367159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705674,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":253952,"data_stored":649246,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31296,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340544,"statfs":{"total":96636764160,"available":96604717056,"internally_reserved":0,"allocated":172032,"data_stored":57748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":649862,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:24:40.847 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:24:41.171 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:24:41.173 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:24:41.187 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-04-19T04:24:40.877464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94032,"kb_used_data":672,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021488,"statfs":{"total":289910292480,"available":289814003712,"internally_reserved":0,"allocated":688128,"data_stored":1356856,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004702"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541340+0000","last_change":"2024-04-19T04:24:20.550082+0000","last_active":"2024-04-19T04:24:21.541340+0000","last_peered":"2024-04-19T04:24:21.541340+0000","last_clean":"2024-04-19T04:24:21.541340+0000","last_became_active":"2024-04-19T04:24:20.549529+0000","last_became_peered":"2024-04-19T04:24:20.549529+0000","last_unstale":"2024-04-19T04:24:21.541340+0000","last_undegraded":"2024-04-19T04:24:21.541340+0000","last_fullsized":"2024-04-19T04:24:21.541340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:27.393720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540906+0000","last_change":"2024-04-19T04:24:20.545709+0000","last_active":"2024-04-19T04:24:21.540906+0000","last_peered":"2024-04-19T04:24:21.540906+0000","last_clean":"2024-04-19T04:24:21.540906+0000","last_became_active":"2024-04-19T04:24:20.544962+0000","last_became_peered":"2024-04-19T04:24:20.544962+0000","last_unstale":"2024-04-19T04:24:21.540906+0000","last_undegraded":"2024-04-19T04:24:21.540906+0000","last_fullsized":"2024-04-19T04:24:21.540906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:06.452910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608479+0000","last_change":"2024-04-19T04:24:20.556199+0000","last_active":"2024-04-19T04:24:21.608479+0000","last_peered":"2024-04-19T04:24:21.608479+0000","last_clean":"2024-04-19T04:24:21.608479+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:24:21.608479+0000","last_undegraded":"2024-04-19T04:24:21.608479+0000","last_fullsized":"2024-04-19T04:24:21.608479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:14.348910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608071+0000","last_change":"2024-04-19T04:24:20.552787+0000","last_active":"2024-04-19T04:24:21.608071+0000","last_peered":"2024-04-19T04:24:21.608071+0000","last_clean":"2024-04-19T04:24:21.608071+0000","last_became_active":"2024-04-19T04:24:20.551784+0000","last_became_peered":"2024-04-19T04:24:20.551784+0000","last_unstale":"2024-04-19T04:24:21.608071+0000","last_undegraded":"2024-04-19T04:24:21.608071+0000","last_fullsized":"2024-04-19T04:24:21.608071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:21.734428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541302+0000","last_change":"2024-04-19T04:24:20.550112+0000","last_active":"2024-04-19T04:24:21.541302+0000","last_peered":"2024-04-19T04:24:21.541302+0000","last_clean":"2024-04-19T04:24:21.541302+0000","last_became_active":"2024-04-19T04:24:20.549620+0000","last_became_peered":"2024-04-19T04:24:20.549620+0000","last_unstale":"2024-04-19T04:24:21.541302+0000","last_undegraded":"2024-04-19T04:24:21.541302+0000","last_fullsized":"2024-04-19T04:24:21.541302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:03:50.416299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607265+0000","last_change":"2024-04-19T04:24:20.551576+0000","last_active":"2024-04-19T04:24:21.607265+0000","last_peered":"2024-04-19T04:24:21.607265+0000","last_clean":"2024-04-19T04:24:21.607265+0000","last_became_active":"2024-04-19T04:24:20.548600+0000","last_became_peered":"2024-04-19T04:24:20.548600+0000","last_unstale":"2024-04-19T04:24:21.607265+0000","last_undegraded":"2024-04-19T04:24:21.607265+0000","last_fullsized":"2024-04-19T04:24:21.607265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:39.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607230+0000","last_change":"2024-04-19T04:24:20.550337+0000","last_active":"2024-04-19T04:24:21.607230+0000","last_peered":"2024-04-19T04:24:21.607230+0000","last_clean":"2024-04-19T04:24:21.607230+0000","last_became_active":"2024-04-19T04:24:20.548514+0000","last_became_peered":"2024-04-19T04:24:20.548514+0000","last_unstale":"2024-04-19T04:24:21.607230+0000","last_undegraded":"2024-04-19T04:24:21.607230+0000","last_fullsized":"2024-04-19T04:24:21.607230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:14.194572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606529+0000","last_change":"2024-04-19T04:24:20.553787+0000","last_active":"2024-04-19T04:24:21.606529+0000","last_peered":"2024-04-19T04:24:21.606529+0000","last_clean":"2024-04-19T04:24:21.606529+0000","last_became_active":"2024-04-19T04:24:20.553410+0000","last_became_peered":"2024-04-19T04:24:20.553410+0000","last_unstale":"2024-04-19T04:24:21.606529+0000","last_undegraded":"2024-04-19T04:24:21.606529+0000","last_fullsized":"2024-04-19T04:24:21.606529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:00.475711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538444+0000","last_change":"2024-04-19T04:24:20.547585+0000","last_active":"2024-04-19T04:24:21.538444+0000","last_peered":"2024-04-19T04:24:21.538444+0000","last_clean":"2024-04-19T04:24:21.538444+0000","last_became_active":"2024-04-19T04:24:20.547395+0000","last_became_peered":"2024-04-19T04:24:20.547395+0000","last_unstale":"2024-04-19T04:24:21.538444+0000","last_undegraded":"2024-04-19T04:24:21.538444+0000","last_fullsized":"2024-04-19T04:24:21.538444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:15.398090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540977+0000","last_change":"2024-04-19T04:24:20.546893+0000","last_active":"2024-04-19T04:24:21.540977+0000","last_peered":"2024-04-19T04:24:21.540977+0000","last_clean":"2024-04-19T04:24:21.540977+0000","last_became_active":"2024-04-19T04:24:20.546257+0000","last_became_peered":"2024-04-19T04:24:20.546257+0000","last_unstale":"2024-04-19T04:24:21.540977+0000","last_undegraded":"2024-04-19T04:24:21.540977+0000","last_fullsized":"2024-04-19T04:24:21.540977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:47.327841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608401+0000","last_change":"2024-04-19T04:24:20.556382+0000","last_active":"2024-04-19T04:24:21.608401+0000","last_peered":"2024-04-19T04:24:21.608401+0000","last_clean":"2024-04-19T04:24:21.608401+0000","last_became_active":"2024-04-19T04:24:20.555246+0000","last_became_peered":"2024-04-19T04:24:20.555246+0000","last_unstale":"2024-04-19T04:24:21.608401+0000","last_undegraded":"2024-04-19T04:24:21.608401+0000","last_fullsized":"2024-04-19T04:24:21.608401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:37:15.332493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540961+0000","last_change":"2024-04-19T04:24:20.558886+0000","last_active":"2024-04-19T04:24:21.540961+0000","last_peered":"2024-04-19T04:24:21.540961+0000","last_clean":"2024-04-19T04:24:21.540961+0000","last_became_active":"2024-04-19T04:24:20.558293+0000","last_became_peered":"2024-04-19T04:24:20.558293+0000","last_unstale":"2024-04-19T04:24:21.540961+0000","last_undegraded":"2024-04-19T04:24:21.540961+0000","last_fullsized":"2024-04-19T04:24:21.540961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:37:15.332493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540418+0000","last_change":"2024-04-19T04:24:20.545891+0000","last_active":"2024-04-19T04:24:21.540418+0000","last_peered":"2024-04-19T04:24:21.540418+0000","last_clean":"2024-04-19T04:24:21.540418+0000","last_became_active":"2024-04-19T04:24:20.545422+0000","last_became_peered":"2024-04-19T04:24:20.545422+0000","last_unstale":"2024-04-19T04:24:21.540418+0000","last_undegraded":"2024-04-19T04:24:21.540418+0000","last_fullsized":"2024-04-19T04:24:21.540418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:31:52.562663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607344+0000","last_change":"2024-04-19T04:24:20.552690+0000","last_active":"2024-04-19T04:24:21.607344+0000","last_peered":"2024-04-19T04:24:21.607344+0000","last_clean":"2024-04-19T04:24:21.607344+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:24:21.607344+0000","last_undegraded":"2024-04-19T04:24:21.607344+0000","last_fullsized":"2024-04-19T04:24:21.607344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:53:16.890992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607404+0000","last_change":"2024-04-19T04:24:20.551809+0000","last_active":"2024-04-19T04:24:21.607404+0000","last_peered":"2024-04-19T04:24:21.607404+0000","last_clean":"2024-04-19T04:24:21.607404+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:24:21.607404+0000","last_undegraded":"2024-04-19T04:24:21.607404+0000","last_fullsized":"2024-04-19T04:24:21.607404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:43:31.281765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606723+0000","last_change":"2024-04-19T04:24:20.552758+0000","last_active":"2024-04-19T04:24:21.606723+0000","last_peered":"2024-04-19T04:24:21.606723+0000","last_clean":"2024-04-19T04:24:21.606723+0000","last_became_active":"2024-04-19T04:24:20.548882+0000","last_became_peered":"2024-04-19T04:24:20.548882+0000","last_unstale":"2024-04-19T04:24:21.606723+0000","last_undegraded":"2024-04-19T04:24:21.606723+0000","last_fullsized":"2024-04-19T04:24:21.606723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:56.738569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539114+0000","last_change":"2024-04-19T04:24:20.546173+0000","last_active":"2024-04-19T04:24:21.539114+0000","last_peered":"2024-04-19T04:24:21.539114+0000","last_clean":"2024-04-19T04:24:21.539114+0000","last_became_active":"2024-04-19T04:24:20.545582+0000","last_became_peered":"2024-04-19T04:24:20.545582+0000","last_unstale":"2024-04-19T04:24:21.539114+0000","last_undegraded":"2024-04-19T04:24:21.539114+0000","last_fullsized":"2024-04-19T04:24:21.539114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:55.955786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541323+0000","last_change":"2024-04-19T04:24:20.549835+0000","last_active":"2024-04-19T04:24:21.541323+0000","last_peered":"2024-04-19T04:24:21.541323+0000","last_clean":"2024-04-19T04:24:21.541323+0000","last_became_active":"2024-04-19T04:24:20.549411+0000","last_became_peered":"2024-04-19T04:24:20.549411+0000","last_unstale":"2024-04-19T04:24:21.541323+0000","last_undegraded":"2024-04-19T04:24:21.541323+0000","last_fullsized":"2024-04-19T04:24:21.541323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:31:11.088424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538186+0000","last_change":"2024-04-19T04:24:20.546517+0000","last_active":"2024-04-19T04:24:21.538186+0000","last_peered":"2024-04-19T04:24:21.538186+0000","last_clean":"2024-04-19T04:24:21.538186+0000","last_became_active":"2024-04-19T04:24:20.546116+0000","last_became_peered":"2024-04-19T04:24:20.546116+0000","last_unstale":"2024-04-19T04:24:21.538186+0000","last_undegraded":"2024-04-19T04:24:21.538186+0000","last_fullsized":"2024-04-19T04:24:21.538186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:28:06.813455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608191+0000","last_change":"2024-04-19T04:24:20.551326+0000","last_active":"2024-04-19T04:24:21.608191+0000","last_peered":"2024-04-19T04:24:21.608191+0000","last_clean":"2024-04-19T04:24:21.608191+0000","last_became_active":"2024-04-19T04:24:20.550246+0000","last_became_peered":"2024-04-19T04:24:20.550246+0000","last_unstale":"2024-04-19T04:24:21.608191+0000","last_undegraded":"2024-04-19T04:24:21.608191+0000","last_fullsized":"2024-04-19T04:24:21.608191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:12.211801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608194+0000","last_change":"2024-04-19T04:24:20.556352+0000","last_active":"2024-04-19T04:24:21.608194+0000","last_peered":"2024-04-19T04:24:21.608194+0000","last_clean":"2024-04-19T04:24:21.608194+0000","last_became_active":"2024-04-19T04:24:20.554294+0000","last_became_peered":"2024-04-19T04:24:20.554294+0000","last_unstale":"2024-04-19T04:24:21.608194+0000","last_undegraded":"2024-04-19T04:24:21.608194+0000","last_fullsized":"2024-04-19T04:24:21.608194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:06.452910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540048+0000","last_change":"2024-04-19T04:24:20.555257+0000","last_active":"2024-04-19T04:24:21.540048+0000","last_peered":"2024-04-19T04:24:21.540048+0000","last_clean":"2024-04-19T04:24:21.540048+0000","last_became_active":"2024-04-19T04:24:20.554895+0000","last_became_peered":"2024-04-19T04:24:20.554895+0000","last_unstale":"2024-04-19T04:24:21.540048+0000","last_undegraded":"2024-04-19T04:24:21.540048+0000","last_fullsized":"2024-04-19T04:24:21.540048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:39.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536664+0000","last_change":"2024-04-19T04:24:20.549936+0000","last_active":"2024-04-19T04:24:21.536664+0000","last_peered":"2024-04-19T04:24:21.536664+0000","last_clean":"2024-04-19T04:24:21.536664+0000","last_became_active":"2024-04-19T04:24:20.549428+0000","last_became_peered":"2024-04-19T04:24:20.549428+0000","last_unstale":"2024-04-19T04:24:21.536664+0000","last_undegraded":"2024-04-19T04:24:21.536664+0000","last_fullsized":"2024-04-19T04:24:21.536664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:44:47.158480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539602+0000","last_change":"2024-04-19T04:24:20.546315+0000","last_active":"2024-04-19T04:24:21.539602+0000","last_peered":"2024-04-19T04:24:21.539602+0000","last_clean":"2024-04-19T04:24:21.539602+0000","last_became_active":"2024-04-19T04:24:20.545851+0000","last_became_peered":"2024-04-19T04:24:20.545851+0000","last_unstale":"2024-04-19T04:24:21.539602+0000","last_undegraded":"2024-04-19T04:24:21.539602+0000","last_fullsized":"2024-04-19T04:24:21.539602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:07:48.905896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541518+0000","last_change":"2024-04-19T04:24:20.554855+0000","last_active":"2024-04-19T04:24:21.541518+0000","last_peered":"2024-04-19T04:24:21.541518+0000","last_clean":"2024-04-19T04:24:21.541518+0000","last_became_active":"2024-04-19T04:24:20.554383+0000","last_became_peered":"2024-04-19T04:24:20.554383+0000","last_unstale":"2024-04-19T04:24:21.541518+0000","last_undegraded":"2024-04-19T04:24:21.541518+0000","last_fullsized":"2024-04-19T04:24:21.541518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:18:50.807364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538534+0000","last_change":"2024-04-19T04:24:20.546410+0000","last_active":"2024-04-19T04:24:21.538534+0000","last_peered":"2024-04-19T04:24:21.538534+0000","last_clean":"2024-04-19T04:24:21.538534+0000","last_became_active":"2024-04-19T04:24:20.545607+0000","last_became_peered":"2024-04-19T04:24:20.545607+0000","last_unstale":"2024-04-19T04:24:21.538534+0000","last_undegraded":"2024-04-19T04:24:21.538534+0000","last_fullsized":"2024-04-19T04:24:21.538534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:03.482984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608645+0000","last_change":"2024-04-19T04:24:20.554885+0000","last_active":"2024-04-19T04:24:21.608645+0000","last_peered":"2024-04-19T04:24:21.608645+0000","last_clean":"2024-04-19T04:24:21.608645+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:24:21.608645+0000","last_undegraded":"2024-04-19T04:24:21.608645+0000","last_fullsized":"2024-04-19T04:24:21.608645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:44:08.285518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541646+0000","last_change":"2024-04-19T04:24:20.558702+0000","last_active":"2024-04-19T04:24:21.541646+0000","last_peered":"2024-04-19T04:24:21.541646+0000","last_clean":"2024-04-19T04:24:21.541646+0000","last_became_active":"2024-04-19T04:24:20.558202+0000","last_became_peered":"2024-04-19T04:24:20.558202+0000","last_unstale":"2024-04-19T04:24:21.541646+0000","last_undegraded":"2024-04-19T04:24:21.541646+0000","last_fullsized":"2024-04-19T04:24:21.541646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:56.738569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537991+0000","last_change":"2024-04-19T04:24:20.543906+0000","last_active":"2024-04-19T04:24:21.537991+0000","last_peered":"2024-04-19T04:24:21.537991+0000","last_clean":"2024-04-19T04:24:21.537991+0000","last_became_active":"2024-04-19T04:24:20.543531+0000","last_became_peered":"2024-04-19T04:24:20.543531+0000","last_unstale":"2024-04-19T04:24:21.537991+0000","last_undegraded":"2024-04-19T04:24:21.537991+0000","last_fullsized":"2024-04-19T04:24:21.537991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:28:04.850289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540345+0000","last_change":"2024-04-19T04:24:20.554847+0000","last_active":"2024-04-19T04:24:21.540345+0000","last_peered":"2024-04-19T04:24:21.540345+0000","last_clean":"2024-04-19T04:24:21.540345+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:24:21.540345+0000","last_undegraded":"2024-04-19T04:24:21.540345+0000","last_fullsized":"2024-04-19T04:24:21.540345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:00.475711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536735+0000","last_change":"2024-04-19T04:24:20.546826+0000","last_active":"2024-04-19T04:24:21.536735+0000","last_peered":"2024-04-19T04:24:21.536735+0000","last_clean":"2024-04-19T04:24:21.536735+0000","last_became_active":"2024-04-19T04:24:20.546065+0000","last_became_peered":"2024-04-19T04:24:20.546065+0000","last_unstale":"2024-04-19T04:24:21.536735+0000","last_undegraded":"2024-04-19T04:24:21.536735+0000","last_fullsized":"2024-04-19T04:24:21.536735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:47.956234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606802+0000","last_change":"2024-04-19T04:24:20.552289+0000","last_active":"2024-04-19T04:24:21.606802+0000","last_peered":"2024-04-19T04:24:21.606802+0000","last_clean":"2024-04-19T04:24:21.606802+0000","last_became_active":"2024-04-19T04:24:20.548755+0000","last_became_peered":"2024-04-19T04:24:20.548755+0000","last_unstale":"2024-04-19T04:24:21.606802+0000","last_undegraded":"2024-04-19T04:24:21.606802+0000","last_fullsized":"2024-04-19T04:24:21.606802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541554+0000","last_change":"2024-04-19T04:24:20.546223+0000","last_active":"2024-04-19T04:24:21.541554+0000","last_peered":"2024-04-19T04:24:21.541554+0000","last_clean":"2024-04-19T04:24:21.541554+0000","last_became_active":"2024-04-19T04:24:20.545807+0000","last_became_peered":"2024-04-19T04:24:20.545807+0000","last_unstale":"2024-04-19T04:24:21.541554+0000","last_undegraded":"2024-04-19T04:24:21.541554+0000","last_fullsized":"2024-04-19T04:24:21.541554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:19.894104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608609+0000","last_change":"2024-04-19T04:24:20.184870+0000","last_active":"2024-04-19T04:24:21.608609+0000","last_peered":"2024-04-19T04:24:21.608609+0000","last_clean":"2024-04-19T04:24:21.608609+0000","last_became_active":"2024-04-19T04:24:20.183615+0000","last_became_peered":"2024-04-19T04:24:20.183615+0000","last_unstale":"2024-04-19T04:24:21.608609+0000","last_undegraded":"2024-04-19T04:24:21.608609+0000","last_fullsized":"2024-04-19T04:24:21.608609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:52:38.272121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541893+0000","last_change":"2024-04-19T04:24:20.547475+0000","last_active":"2024-04-19T04:24:21.541893+0000","last_peered":"2024-04-19T04:24:21.541893+0000","last_clean":"2024-04-19T04:24:21.541893+0000","last_became_active":"2024-04-19T04:24:20.546615+0000","last_became_peered":"2024-04-19T04:24:20.546615+0000","last_unstale":"2024-04-19T04:24:21.541893+0000","last_undegraded":"2024-04-19T04:24:21.541893+0000","last_fullsized":"2024-04-19T04:24:21.541893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:24.049904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537755+0000","last_change":"2024-04-19T04:24:20.177739+0000","last_active":"2024-04-19T04:24:21.537755+0000","last_peered":"2024-04-19T04:24:21.537755+0000","last_clean":"2024-04-19T04:24:21.537755+0000","last_became_active":"2024-04-19T04:24:20.177328+0000","last_became_peered":"2024-04-19T04:24:20.177328+0000","last_unstale":"2024-04-19T04:24:21.537755+0000","last_undegraded":"2024-04-19T04:24:21.537755+0000","last_fullsized":"2024-04-19T04:24:21.537755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:27.902190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538848+0000","last_change":"2024-04-19T04:24:20.547144+0000","last_active":"2024-04-19T04:24:21.538848+0000","last_peered":"2024-04-19T04:24:21.538848+0000","last_clean":"2024-04-19T04:24:21.538848+0000","last_became_active":"2024-04-19T04:24:20.546814+0000","last_became_peered":"2024-04-19T04:24:20.546814+0000","last_unstale":"2024-04-19T04:24:21.538848+0000","last_undegraded":"2024-04-19T04:24:21.538848+0000","last_fullsized":"2024-04-19T04:24:21.538848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:04.710943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540345+0000","last_change":"2024-04-19T04:24:20.183855+0000","last_active":"2024-04-19T04:24:21.540345+0000","last_peered":"2024-04-19T04:24:21.540345+0000","last_clean":"2024-04-19T04:24:21.540345+0000","last_became_active":"2024-04-19T04:24:20.183272+0000","last_became_peered":"2024-04-19T04:24:20.183272+0000","last_unstale":"2024-04-19T04:24:21.540345+0000","last_undegraded":"2024-04-19T04:24:21.540345+0000","last_fullsized":"2024-04-19T04:24:21.540345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:54.737330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538578+0000","last_change":"2024-04-19T04:24:20.551347+0000","last_active":"2024-04-19T04:24:21.538578+0000","last_peered":"2024-04-19T04:24:21.538578+0000","last_clean":"2024-04-19T04:24:21.538578+0000","last_became_active":"2024-04-19T04:24:20.550917+0000","last_became_peered":"2024-04-19T04:24:20.550917+0000","last_unstale":"2024-04-19T04:24:21.538578+0000","last_undegraded":"2024-04-19T04:24:21.538578+0000","last_fullsized":"2024-04-19T04:24:21.538578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:47.732617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.606983+0000","last_change":"2024-04-19T04:24:20.187299+0000","last_active":"2024-04-19T04:24:21.606983+0000","last_peered":"2024-04-19T04:24:21.606983+0000","last_clean":"2024-04-19T04:24:21.606983+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:24:21.606983+0000","last_undegraded":"2024-04-19T04:24:21.606983+0000","last_fullsized":"2024-04-19T04:24:21.606983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:49:37.812125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609542+0000","last_change":"2024-04-19T04:24:20.186029+0000","last_active":"2024-04-19T04:24:21.609542+0000","last_peered":"2024-04-19T04:24:21.609542+0000","last_clean":"2024-04-19T04:24:21.609542+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:24:21.609542+0000","last_undegraded":"2024-04-19T04:24:21.609542+0000","last_fullsized":"2024-04-19T04:24:21.609542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:49.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539569+0000","last_change":"2024-04-19T04:24:20.555751+0000","last_active":"2024-04-19T04:24:21.539569+0000","last_peered":"2024-04-19T04:24:21.539569+0000","last_clean":"2024-04-19T04:24:21.539569+0000","last_became_active":"2024-04-19T04:24:20.555501+0000","last_became_peered":"2024-04-19T04:24:20.555501+0000","last_unstale":"2024-04-19T04:24:21.539569+0000","last_undegraded":"2024-04-19T04:24:21.539569+0000","last_fullsized":"2024-04-19T04:24:21.539569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:57.839930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541919+0000","last_change":"2024-04-19T04:24:20.184142+0000","last_active":"2024-04-19T04:24:21.541919+0000","last_peered":"2024-04-19T04:24:21.541919+0000","last_clean":"2024-04-19T04:24:21.541919+0000","last_became_active":"2024-04-19T04:24:20.183546+0000","last_became_peered":"2024-04-19T04:24:20.183546+0000","last_unstale":"2024-04-19T04:24:21.541919+0000","last_undegraded":"2024-04-19T04:24:21.541919+0000","last_fullsized":"2024-04-19T04:24:21.541919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:17.280977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539845+0000","last_change":"2024-04-19T04:24:20.545490+0000","last_active":"2024-04-19T04:24:21.539845+0000","last_peered":"2024-04-19T04:24:21.539845+0000","last_clean":"2024-04-19T04:24:21.539845+0000","last_became_active":"2024-04-19T04:24:20.544898+0000","last_became_peered":"2024-04-19T04:24:20.544898+0000","last_unstale":"2024-04-19T04:24:21.539845+0000","last_undegraded":"2024-04-19T04:24:21.539845+0000","last_fullsized":"2024-04-19T04:24:21.539845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:40:02.138518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609093+0000","last_change":"2024-04-19T04:24:20.186044+0000","last_active":"2024-04-19T04:24:21.609093+0000","last_peered":"2024-04-19T04:24:21.609093+0000","last_clean":"2024-04-19T04:24:21.609093+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:24:21.609093+0000","last_undegraded":"2024-04-19T04:24:21.609093+0000","last_fullsized":"2024-04-19T04:24:21.609093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.432692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607445+0000","last_change":"2024-04-19T04:24:20.552828+0000","last_active":"2024-04-19T04:24:21.607445+0000","last_peered":"2024-04-19T04:24:21.607445+0000","last_clean":"2024-04-19T04:24:21.607445+0000","last_became_active":"2024-04-19T04:24:20.551927+0000","last_became_peered":"2024-04-19T04:24:20.551927+0000","last_unstale":"2024-04-19T04:24:21.607445+0000","last_undegraded":"2024-04-19T04:24:21.607445+0000","last_fullsized":"2024-04-19T04:24:21.607445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:41.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608700+0000","last_change":"2024-04-19T04:24:20.179238+0000","last_active":"2024-04-19T04:24:21.608700+0000","last_peered":"2024-04-19T04:24:21.608700+0000","last_clean":"2024-04-19T04:24:21.608700+0000","last_became_active":"2024-04-19T04:24:20.178758+0000","last_became_peered":"2024-04-19T04:24:20.178758+0000","last_unstale":"2024-04-19T04:24:21.608700+0000","last_undegraded":"2024-04-19T04:24:21.608700+0000","last_fullsized":"2024-04-19T04:24:21.608700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:18:24.789775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537600+0000","last_change":"2024-04-19T04:24:20.554969+0000","last_active":"2024-04-19T04:24:21.537600+0000","last_peered":"2024-04-19T04:24:21.537600+0000","last_clean":"2024-04-19T04:24:21.537600+0000","last_became_active":"2024-04-19T04:24:20.554604+0000","last_became_peered":"2024-04-19T04:24:20.554604+0000","last_unstale":"2024-04-19T04:24:21.537600+0000","last_undegraded":"2024-04-19T04:24:21.537600+0000","last_fullsized":"2024-04-19T04:24:21.537600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:58:47.703110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538228+0000","last_change":"2024-04-19T04:24:20.178602+0000","last_active":"2024-04-19T04:24:21.538228+0000","last_peered":"2024-04-19T04:24:21.538228+0000","last_clean":"2024-04-19T04:24:21.538228+0000","last_became_active":"2024-04-19T04:24:20.177976+0000","last_became_peered":"2024-04-19T04:24:20.177976+0000","last_unstale":"2024-04-19T04:24:21.538228+0000","last_undegraded":"2024-04-19T04:24:21.538228+0000","last_fullsized":"2024-04-19T04:24:21.538228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:15.883790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608409+0000","last_change":"2024-04-19T04:24:20.548296+0000","last_active":"2024-04-19T04:24:21.608409+0000","last_peered":"2024-04-19T04:24:21.608409+0000","last_clean":"2024-04-19T04:24:21.608409+0000","last_became_active":"2024-04-19T04:24:20.547457+0000","last_became_peered":"2024-04-19T04:24:20.547457+0000","last_unstale":"2024-04-19T04:24:21.608409+0000","last_undegraded":"2024-04-19T04:24:21.608409+0000","last_fullsized":"2024-04-19T04:24:21.608409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:57.839930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607638+0000","last_change":"2024-04-19T04:24:20.184338+0000","last_active":"2024-04-19T04:24:21.607638+0000","last_peered":"2024-04-19T04:24:21.607638+0000","last_clean":"2024-04-19T04:24:21.607638+0000","last_became_active":"2024-04-19T04:24:20.183511+0000","last_became_peered":"2024-04-19T04:24:20.183511+0000","last_unstale":"2024-04-19T04:24:21.607638+0000","last_undegraded":"2024-04-19T04:24:21.607638+0000","last_fullsized":"2024-04-19T04:24:21.607638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:14.235823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608849+0000","last_change":"2024-04-19T04:24:20.555922+0000","last_active":"2024-04-19T04:24:21.608849+0000","last_peered":"2024-04-19T04:24:21.608849+0000","last_clean":"2024-04-19T04:24:21.608849+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:24:21.608849+0000","last_undegraded":"2024-04-19T04:24:21.608849+0000","last_fullsized":"2024-04-19T04:24:21.608849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:06:53.595149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540165+0000","last_change":"2024-04-19T04:24:20.183944+0000","last_active":"2024-04-19T04:24:21.540165+0000","last_peered":"2024-04-19T04:24:21.540165+0000","last_clean":"2024-04-19T04:24:21.540165+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:24:21.540165+0000","last_undegraded":"2024-04-19T04:24:21.540165+0000","last_fullsized":"2024-04-19T04:24:21.540165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:42.018487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608707+0000","last_change":"2024-04-19T04:24:20.553085+0000","last_active":"2024-04-19T04:24:21.608707+0000","last_peered":"2024-04-19T04:24:21.608707+0000","last_clean":"2024-04-19T04:24:21.608707+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:24:21.608707+0000","last_undegraded":"2024-04-19T04:24:21.608707+0000","last_fullsized":"2024-04-19T04:24:21.608707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:07:21.467758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539831+0000","last_change":"2024-04-19T04:24:20.180834+0000","last_active":"2024-04-19T04:24:21.539831+0000","last_peered":"2024-04-19T04:24:21.539831+0000","last_clean":"2024-04-19T04:24:21.539831+0000","last_became_active":"2024-04-19T04:24:20.180522+0000","last_became_peered":"2024-04-19T04:24:20.180522+0000","last_unstale":"2024-04-19T04:24:21.539831+0000","last_undegraded":"2024-04-19T04:24:21.539831+0000","last_fullsized":"2024-04-19T04:24:21.539831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:38:28.208268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538763+0000","last_change":"2024-04-19T04:24:20.547313+0000","last_active":"2024-04-19T04:24:21.538763+0000","last_peered":"2024-04-19T04:24:21.538763+0000","last_clean":"2024-04-19T04:24:21.538763+0000","last_became_active":"2024-04-19T04:24:20.545692+0000","last_became_peered":"2024-04-19T04:24:20.545692+0000","last_unstale":"2024-04-19T04:24:21.538763+0000","last_undegraded":"2024-04-19T04:24:21.538763+0000","last_fullsized":"2024-04-19T04:24:21.538763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:24:42.844961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.547904+0000","last_change":"2024-04-19T04:24:10.106278+0000","last_active":"2024-04-19T04:24:20.547904+0000","last_peered":"2024-04-19T04:24:20.547904+0000","last_clean":"2024-04-19T04:24:20.547904+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:24:20.547904+0000","last_undegraded":"2024-04-19T04:24:20.547904+0000","last_fullsized":"2024-04-19T04:24:20.547904+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_clean_scrub_stamp":"2024-04-19T04:24:09.083488+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.549706+0000","last_change":"2024-04-19T04:24:16.144872+0000","last_active":"2024-04-19T04:24:20.549706+0000","last_peered":"2024-04-19T04:24:20.549706+0000","last_clean":"2024-04-19T04:24:20.549706+0000","last_became_active":"2024-04-19T04:24:16.143778+0000","last_became_peered":"2024-04-19T04:24:16.143778+0000","last_unstale":"2024-04-19T04:24:20.549706+0000","last_undegraded":"2024-04-19T04:24:20.549706+0000","last_fullsized":"2024-04-19T04:24:20.549706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:26:06.303713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538038+0000","last_change":"2024-04-19T04:24:20.174958+0000","last_active":"2024-04-19T04:24:21.538038+0000","last_peered":"2024-04-19T04:24:21.538038+0000","last_clean":"2024-04-19T04:24:21.538038+0000","last_became_active":"2024-04-19T04:24:20.174643+0000","last_became_peered":"2024-04-19T04:24:20.174643+0000","last_unstale":"2024-04-19T04:24:21.538038+0000","last_undegraded":"2024-04-19T04:24:21.538038+0000","last_fullsized":"2024-04-19T04:24:21.538038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:37.752236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608950+0000","last_change":"2024-04-19T04:24:20.553999+0000","last_active":"2024-04-19T04:24:21.608950+0000","last_peered":"2024-04-19T04:24:21.608950+0000","last_clean":"2024-04-19T04:24:21.608950+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:24:21.608950+0000","last_undegraded":"2024-04-19T04:24:21.608950+0000","last_fullsized":"2024-04-19T04:24:21.608950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:13:53.306369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.546806+0000","last_change":"2024-04-19T04:24:16.144482+0000","last_active":"2024-04-19T04:24:20.546806+0000","last_peered":"2024-04-19T04:24:20.546806+0000","last_clean":"2024-04-19T04:24:20.546806+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:24:20.546806+0000","last_undegraded":"2024-04-19T04:24:20.546806+0000","last_fullsized":"2024-04-19T04:24:20.546806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:15.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537224+0000","last_change":"2024-04-19T04:24:20.179129+0000","last_active":"2024-04-19T04:24:21.537224+0000","last_peered":"2024-04-19T04:24:21.537224+0000","last_clean":"2024-04-19T04:24:21.537224+0000","last_became_active":"2024-04-19T04:24:20.178247+0000","last_became_peered":"2024-04-19T04:24:20.178247+0000","last_unstale":"2024-04-19T04:24:21.537224+0000","last_undegraded":"2024-04-19T04:24:21.537224+0000","last_fullsized":"2024-04-19T04:24:21.537224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:51.616306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541152+0000","last_change":"2024-04-19T04:24:20.550166+0000","last_active":"2024-04-19T04:24:21.541152+0000","last_peered":"2024-04-19T04:24:21.541152+0000","last_clean":"2024-04-19T04:24:21.541152+0000","last_became_active":"2024-04-19T04:24:20.549606+0000","last_became_peered":"2024-04-19T04:24:20.549606+0000","last_unstale":"2024-04-19T04:24:21.541152+0000","last_undegraded":"2024-04-19T04:24:21.541152+0000","last_fullsized":"2024-04-19T04:24:21.541152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:41.685120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.533460+0000","last_change":"2024-04-19T04:24:16.135584+0000","last_active":"2024-04-19T04:24:20.533460+0000","last_peered":"2024-04-19T04:24:20.533460+0000","last_clean":"2024-04-19T04:24:20.533460+0000","last_became_active":"2024-04-19T04:24:16.134799+0000","last_became_peered":"2024-04-19T04:24:16.134799+0000","last_unstale":"2024-04-19T04:24:20.533460+0000","last_undegraded":"2024-04-19T04:24:20.533460+0000","last_fullsized":"2024-04-19T04:24:20.533460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:55:57.442649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539948+0000","last_change":"2024-04-19T04:24:20.183933+0000","last_active":"2024-04-19T04:24:21.539948+0000","last_peered":"2024-04-19T04:24:21.539948+0000","last_clean":"2024-04-19T04:24:21.539948+0000","last_became_active":"2024-04-19T04:24:20.183490+0000","last_became_peered":"2024-04-19T04:24:20.183490+0000","last_unstale":"2024-04-19T04:24:21.539948+0000","last_undegraded":"2024-04-19T04:24:21.539948+0000","last_fullsized":"2024-04-19T04:24:21.539948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:43.869727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538758+0000","last_change":"2024-04-19T04:24:20.544687+0000","last_active":"2024-04-19T04:24:21.538758+0000","last_peered":"2024-04-19T04:24:21.538758+0000","last_clean":"2024-04-19T04:24:21.538758+0000","last_became_active":"2024-04-19T04:24:20.544430+0000","last_became_peered":"2024-04-19T04:24:20.544430+0000","last_unstale":"2024-04-19T04:24:21.538758+0000","last_undegraded":"2024-04-19T04:24:21.538758+0000","last_fullsized":"2024-04-19T04:24:21.538758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:11:22.765812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.548059+0000","last_change":"2024-04-19T04:24:16.145124+0000","last_active":"2024-04-19T04:24:20.548059+0000","last_peered":"2024-04-19T04:24:20.548059+0000","last_clean":"2024-04-19T04:24:20.548059+0000","last_became_active":"2024-04-19T04:24:16.143949+0000","last_became_peered":"2024-04-19T04:24:16.143949+0000","last_unstale":"2024-04-19T04:24:20.548059+0000","last_undegraded":"2024-04-19T04:24:20.548059+0000","last_fullsized":"2024-04-19T04:24:20.548059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:18.901615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608836+0000","last_change":"2024-04-19T04:24:20.179004+0000","last_active":"2024-04-19T04:24:21.608836+0000","last_peered":"2024-04-19T04:24:21.608836+0000","last_clean":"2024-04-19T04:24:21.608836+0000","last_became_active":"2024-04-19T04:24:20.178123+0000","last_became_peered":"2024-04-19T04:24:20.178123+0000","last_unstale":"2024-04-19T04:24:21.608836+0000","last_undegraded":"2024-04-19T04:24:21.608836+0000","last_fullsized":"2024-04-19T04:24:21.608836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:35:25.084528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538611+0000","last_change":"2024-04-19T04:24:20.544312+0000","last_active":"2024-04-19T04:24:21.538611+0000","last_peered":"2024-04-19T04:24:21.538611+0000","last_clean":"2024-04-19T04:24:21.538611+0000","last_became_active":"2024-04-19T04:24:20.543738+0000","last_became_peered":"2024-04-19T04:24:20.543738+0000","last_unstale":"2024-04-19T04:24:21.538611+0000","last_undegraded":"2024-04-19T04:24:21.538611+0000","last_fullsized":"2024-04-19T04:24:21.538611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:23.486532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609184+0000","last_change":"2024-04-19T04:24:20.184349+0000","last_active":"2024-04-19T04:24:21.609184+0000","last_peered":"2024-04-19T04:24:21.609184+0000","last_clean":"2024-04-19T04:24:21.609184+0000","last_became_active":"2024-04-19T04:24:20.183495+0000","last_became_peered":"2024-04-19T04:24:20.183495+0000","last_unstale":"2024-04-19T04:24:21.609184+0000","last_undegraded":"2024-04-19T04:24:21.609184+0000","last_fullsized":"2024-04-19T04:24:21.609184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:16:09.571178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.531994+0000","last_change":"2024-04-19T04:24:16.136119+0000","last_active":"2024-04-19T04:24:20.531994+0000","last_peered":"2024-04-19T04:24:20.531994+0000","last_clean":"2024-04-19T04:24:20.531994+0000","last_became_active":"2024-04-19T04:24:16.135272+0000","last_became_peered":"2024-04-19T04:24:16.135272+0000","last_unstale":"2024-04-19T04:24:20.531994+0000","last_undegraded":"2024-04-19T04:24:20.531994+0000","last_fullsized":"2024-04-19T04:24:20.531994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:07:14.180095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540172+0000","last_change":"2024-04-19T04:24:20.555116+0000","last_active":"2024-04-19T04:24:21.540172+0000","last_peered":"2024-04-19T04:24:21.540172+0000","last_clean":"2024-04-19T04:24:21.540172+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:24:21.540172+0000","last_undegraded":"2024-04-19T04:24:21.540172+0000","last_fullsized":"2024-04-19T04:24:21.540172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:21.734428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538645+0000","last_change":"2024-04-19T04:24:20.174833+0000","last_active":"2024-04-19T04:24:21.538645+0000","last_peered":"2024-04-19T04:24:21.538645+0000","last_clean":"2024-04-19T04:24:21.538645+0000","last_became_active":"2024-04-19T04:24:20.174517+0000","last_became_peered":"2024-04-19T04:24:20.174517+0000","last_unstale":"2024-04-19T04:24:21.538645+0000","last_undegraded":"2024-04-19T04:24:21.538645+0000","last_fullsized":"2024-04-19T04:24:21.538645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:51.699530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.536090+0000","last_change":"2024-04-19T04:24:16.141899+0000","last_active":"2024-04-19T04:24:20.536090+0000","last_peered":"2024-04-19T04:24:20.536090+0000","last_clean":"2024-04-19T04:24:20.536090+0000","last_became_active":"2024-04-19T04:24:16.141508+0000","last_became_peered":"2024-04-19T04:24:16.141508+0000","last_unstale":"2024-04-19T04:24:20.536090+0000","last_undegraded":"2024-04-19T04:24:20.536090+0000","last_fullsized":"2024-04-19T04:24:20.536090+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:31.719446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540502+0000","last_change":"2024-04-19T04:24:20.558559+0000","last_active":"2024-04-19T04:24:21.540502+0000","last_peered":"2024-04-19T04:24:21.540502+0000","last_clean":"2024-04-19T04:24:21.540502+0000","last_became_active":"2024-04-19T04:24:20.558215+0000","last_became_peered":"2024-04-19T04:24:20.558215+0000","last_unstale":"2024-04-19T04:24:21.540502+0000","last_undegraded":"2024-04-19T04:24:21.540502+0000","last_fullsized":"2024-04-19T04:24:21.540502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:41.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539118+0000","last_change":"2024-04-19T04:24:20.175205+0000","last_active":"2024-04-19T04:24:21.539118+0000","last_peered":"2024-04-19T04:24:21.539118+0000","last_clean":"2024-04-19T04:24:21.539118+0000","last_became_active":"2024-04-19T04:24:20.174912+0000","last_became_peered":"2024-04-19T04:24:20.174912+0000","last_unstale":"2024-04-19T04:24:21.539118+0000","last_undegraded":"2024-04-19T04:24:21.539118+0000","last_fullsized":"2024-04-19T04:24:21.539118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:21:37.681287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.533233+0000","last_change":"2024-04-19T04:24:16.135892+0000","last_active":"2024-04-19T04:24:20.533233+0000","last_peered":"2024-04-19T04:24:20.533233+0000","last_clean":"2024-04-19T04:24:20.533233+0000","last_became_active":"2024-04-19T04:24:16.135385+0000","last_became_peered":"2024-04-19T04:24:16.135385+0000","last_unstale":"2024-04-19T04:24:20.533233+0000","last_undegraded":"2024-04-19T04:24:20.533233+0000","last_fullsized":"2024-04-19T04:24:20.533233+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:37.110319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536977+0000","last_change":"2024-04-19T04:24:20.553486+0000","last_active":"2024-04-19T04:24:21.536977+0000","last_peered":"2024-04-19T04:24:21.536977+0000","last_clean":"2024-04-19T04:24:21.536977+0000","last_became_active":"2024-04-19T04:24:20.553206+0000","last_became_peered":"2024-04-19T04:24:20.553206+0000","last_unstale":"2024-04-19T04:24:21.536977+0000","last_undegraded":"2024-04-19T04:24:21.536977+0000","last_fullsized":"2024-04-19T04:24:21.536977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:32.648637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:23.878567+0000","last_change":"2024-04-19T04:24:20.178880+0000","last_active":"2024-04-19T04:24:23.878567+0000","last_peered":"2024-04-19T04:24:23.878567+0000","last_clean":"2024-04-19T04:24:23.878567+0000","last_became_active":"2024-04-19T04:24:20.177593+0000","last_became_peered":"2024-04-19T04:24:20.177593+0000","last_unstale":"2024-04-19T04:24:23.878567+0000","last_undegraded":"2024-04-19T04:24:23.878567+0000","last_fullsized":"2024-04-19T04:24:23.878567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:58:32.732477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T04:24:20.549281+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:24:20.549281+0000","last_peered":"2024-04-19T04:24:20.549281+0000","last_clean":"2024-04-19T04:24:20.549281+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:24:20.549281+0000","last_undegraded":"2024-04-19T04:24:20.549281+0000","last_fullsized":"2024-04-19T04:24:20.549281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:45.574813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539891+0000","last_change":"2024-04-19T04:24:20.554721+0000","last_active":"2024-04-19T04:24:21.539891+0000","last_peered":"2024-04-19T04:24:21.539891+0000","last_clean":"2024-04-19T04:24:21.539891+0000","last_became_active":"2024-04-19T04:24:20.554286+0000","last_became_peered":"2024-04-19T04:24:20.554286+0000","last_unstale":"2024-04-19T04:24:21.539891+0000","last_undegraded":"2024-04-19T04:24:21.539891+0000","last_fullsized":"2024-04-19T04:24:21.539891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:14.194572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608106+0000","last_change":"2024-04-19T04:24:20.555406+0000","last_active":"2024-04-19T04:24:21.608106+0000","last_peered":"2024-04-19T04:24:21.608106+0000","last_clean":"2024-04-19T04:24:21.608106+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:24:21.608106+0000","last_undegraded":"2024-04-19T04:24:21.608106+0000","last_fullsized":"2024-04-19T04:24:21.608106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:10.453970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608703+0000","last_change":"2024-04-19T04:24:20.185978+0000","last_active":"2024-04-19T04:24:21.608703+0000","last_peered":"2024-04-19T04:24:21.608703+0000","last_clean":"2024-04-19T04:24:21.608703+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:24:21.608703+0000","last_undegraded":"2024-04-19T04:24:21.608703+0000","last_fullsized":"2024-04-19T04:24:21.608703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:48.158805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537416+0000","last_change":"2024-04-19T04:24:20.544323+0000","last_active":"2024-04-19T04:24:21.537416+0000","last_peered":"2024-04-19T04:24:21.537416+0000","last_clean":"2024-04-19T04:24:21.537416+0000","last_became_active":"2024-04-19T04:24:20.543893+0000","last_became_peered":"2024-04-19T04:24:20.543893+0000","last_unstale":"2024-04-19T04:24:21.537416+0000","last_undegraded":"2024-04-19T04:24:21.537416+0000","last_fullsized":"2024-04-19T04:24:21.537416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:01.587027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.542097+0000","last_change":"2024-04-19T04:24:20.184342+0000","last_active":"2024-04-19T04:24:21.542097+0000","last_peered":"2024-04-19T04:24:21.542097+0000","last_clean":"2024-04-19T04:24:21.542097+0000","last_became_active":"2024-04-19T04:24:20.183970+0000","last_became_peered":"2024-04-19T04:24:20.183970+0000","last_unstale":"2024-04-19T04:24:21.542097+0000","last_undegraded":"2024-04-19T04:24:21.542097+0000","last_fullsized":"2024-04-19T04:24:21.542097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:46.956957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.609216+0000","last_change":"2024-04-19T04:24:20.184508+0000","last_active":"2024-04-19T04:24:21.609216+0000","last_peered":"2024-04-19T04:24:21.609216+0000","last_clean":"2024-04-19T04:24:21.609216+0000","last_became_active":"2024-04-19T04:24:20.184060+0000","last_became_peered":"2024-04-19T04:24:20.184060+0000","last_unstale":"2024-04-19T04:24:21.609216+0000","last_undegraded":"2024-04-19T04:24:21.609216+0000","last_fullsized":"2024-04-19T04:24:21.609216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:14:57.634877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537342+0000","last_change":"2024-04-19T04:24:20.546949+0000","last_active":"2024-04-19T04:24:21.537342+0000","last_peered":"2024-04-19T04:24:21.537342+0000","last_clean":"2024-04-19T04:24:21.537342+0000","last_became_active":"2024-04-19T04:24:20.546029+0000","last_became_peered":"2024-04-19T04:24:20.546029+0000","last_unstale":"2024-04-19T04:24:21.537342+0000","last_undegraded":"2024-04-19T04:24:21.537342+0000","last_fullsized":"2024-04-19T04:24:21.537342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:22:06.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.539031+0000","last_change":"2024-04-19T04:24:20.178672+0000","last_active":"2024-04-19T04:24:21.539031+0000","last_peered":"2024-04-19T04:24:21.539031+0000","last_clean":"2024-04-19T04:24:21.539031+0000","last_became_active":"2024-04-19T04:24:20.177921+0000","last_became_peered":"2024-04-19T04:24:20.177921+0000","last_unstale":"2024-04-19T04:24:21.539031+0000","last_undegraded":"2024-04-19T04:24:21.539031+0000","last_fullsized":"2024-04-19T04:24:21.539031+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:21.042990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.536875+0000","last_change":"2024-04-19T04:24:20.546616+0000","last_active":"2024-04-19T04:24:21.536875+0000","last_peered":"2024-04-19T04:24:21.536875+0000","last_clean":"2024-04-19T04:24:21.536875+0000","last_became_active":"2024-04-19T04:24:20.546032+0000","last_became_peered":"2024-04-19T04:24:20.546032+0000","last_unstale":"2024-04-19T04:24:21.536875+0000","last_undegraded":"2024-04-19T04:24:21.536875+0000","last_fullsized":"2024-04-19T04:24:21.536875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:02:20.398899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541610+0000","last_change":"2024-04-19T04:24:20.552644+0000","last_active":"2024-04-19T04:24:21.541610+0000","last_peered":"2024-04-19T04:24:21.541610+0000","last_clean":"2024-04-19T04:24:21.541610+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:24:21.541610+0000","last_undegraded":"2024-04-19T04:24:21.541610+0000","last_fullsized":"2024-04-19T04:24:21.541610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537050+0000","last_change":"2024-04-19T04:24:20.174912+0000","last_active":"2024-04-19T04:24:21.537050+0000","last_peered":"2024-04-19T04:24:21.537050+0000","last_clean":"2024-04-19T04:24:21.537050+0000","last_became_active":"2024-04-19T04:24:20.174629+0000","last_became_peered":"2024-04-19T04:24:20.174629+0000","last_unstale":"2024-04-19T04:24:21.537050+0000","last_undegraded":"2024-04-19T04:24:21.537050+0000","last_fullsized":"2024-04-19T04:24:21.537050+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:09:12.929115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538272+0000","last_change":"2024-04-19T04:24:20.549484+0000","last_active":"2024-04-19T04:24:21.538272+0000","last_peered":"2024-04-19T04:24:21.538272+0000","last_clean":"2024-04-19T04:24:21.538272+0000","last_became_active":"2024-04-19T04:24:20.549149+0000","last_became_peered":"2024-04-19T04:24:20.549149+0000","last_unstale":"2024-04-19T04:24:21.538272+0000","last_undegraded":"2024-04-19T04:24:21.538272+0000","last_fullsized":"2024-04-19T04:24:21.538272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:49.148982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.537100+0000","last_change":"2024-04-19T04:24:20.178730+0000","last_active":"2024-04-19T04:24:21.537100+0000","last_peered":"2024-04-19T04:24:21.537100+0000","last_clean":"2024-04-19T04:24:21.537100+0000","last_became_active":"2024-04-19T04:24:20.177996+0000","last_became_peered":"2024-04-19T04:24:20.177996+0000","last_unstale":"2024-04-19T04:24:21.537100+0000","last_undegraded":"2024-04-19T04:24:21.537100+0000","last_fullsized":"2024-04-19T04:24:21.537100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:27:46.704368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541658+0000","last_change":"2024-04-19T04:24:20.556092+0000","last_active":"2024-04-19T04:24:21.541658+0000","last_peered":"2024-04-19T04:24:21.541658+0000","last_clean":"2024-04-19T04:24:21.541658+0000","last_became_active":"2024-04-19T04:24:20.555928+0000","last_became_peered":"2024-04-19T04:24:20.555928+0000","last_unstale":"2024-04-19T04:24:21.541658+0000","last_undegraded":"2024-04-19T04:24:21.541658+0000","last_fullsized":"2024-04-19T04:24:21.541658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:12.211801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540632+0000","last_change":"2024-04-19T04:24:20.179779+0000","last_active":"2024-04-19T04:24:21.540632+0000","last_peered":"2024-04-19T04:24:21.540632+0000","last_clean":"2024-04-19T04:24:21.540632+0000","last_became_active":"2024-04-19T04:24:20.179457+0000","last_became_peered":"2024-04-19T04:24:20.179457+0000","last_unstale":"2024-04-19T04:24:21.540632+0000","last_undegraded":"2024-04-19T04:24:21.540632+0000","last_fullsized":"2024-04-19T04:24:21.540632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:27:04.757759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541223+0000","last_change":"2024-04-19T04:24:20.546222+0000","last_active":"2024-04-19T04:24:21.541223+0000","last_peered":"2024-04-19T04:24:21.541223+0000","last_clean":"2024-04-19T04:24:21.541223+0000","last_became_active":"2024-04-19T04:24:20.545395+0000","last_became_peered":"2024-04-19T04:24:20.545395+0000","last_unstale":"2024-04-19T04:24:21.541223+0000","last_undegraded":"2024-04-19T04:24:21.541223+0000","last_fullsized":"2024-04-19T04:24:21.541223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:56.201003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540715+0000","last_change":"2024-04-19T04:24:20.184108+0000","last_active":"2024-04-19T04:24:21.540715+0000","last_peered":"2024-04-19T04:24:21.540715+0000","last_clean":"2024-04-19T04:24:21.540715+0000","last_became_active":"2024-04-19T04:24:20.183677+0000","last_became_peered":"2024-04-19T04:24:20.183677+0000","last_unstale":"2024-04-19T04:24:21.540715+0000","last_undegraded":"2024-04-19T04:24:21.540715+0000","last_fullsized":"2024-04-19T04:24:21.540715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:06.185573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607906+0000","last_change":"2024-04-19T04:24:20.556556+0000","last_active":"2024-04-19T04:24:21.607906+0000","last_peered":"2024-04-19T04:24:21.607906+0000","last_clean":"2024-04-19T04:24:21.607906+0000","last_became_active":"2024-04-19T04:24:20.555286+0000","last_became_peered":"2024-04-19T04:24:20.555286+0000","last_unstale":"2024-04-19T04:24:21.607906+0000","last_undegraded":"2024-04-19T04:24:21.607906+0000","last_fullsized":"2024-04-19T04:24:21.607906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:18:50.807364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.608430+0000","last_change":"2024-04-19T04:24:20.184583+0000","last_active":"2024-04-19T04:24:21.608430+0000","last_peered":"2024-04-19T04:24:21.608430+0000","last_clean":"2024-04-19T04:24:21.608430+0000","last_became_active":"2024-04-19T04:24:20.183933+0000","last_became_peered":"2024-04-19T04:24:20.183933+0000","last_unstale":"2024-04-19T04:24:21.608430+0000","last_undegraded":"2024-04-19T04:24:21.608430+0000","last_fullsized":"2024-04-19T04:24:21.608430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:24.424300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607603+0000","last_change":"2024-04-19T04:24:20.550606+0000","last_active":"2024-04-19T04:24:21.607603+0000","last_peered":"2024-04-19T04:24:21.607603+0000","last_clean":"2024-04-19T04:24:21.607603+0000","last_became_active":"2024-04-19T04:24:20.548990+0000","last_became_peered":"2024-04-19T04:24:20.548990+0000","last_unstale":"2024-04-19T04:24:21.607603+0000","last_undegraded":"2024-04-19T04:24:21.607603+0000","last_fullsized":"2024-04-19T04:24:21.607603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:31:52.562663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.541997+0000","last_change":"2024-04-19T04:24:20.184190+0000","last_active":"2024-04-19T04:24:21.541997+0000","last_peered":"2024-04-19T04:24:21.541997+0000","last_clean":"2024-04-19T04:24:21.541997+0000","last_became_active":"2024-04-19T04:24:20.183869+0000","last_became_peered":"2024-04-19T04:24:20.183869+0000","last_unstale":"2024-04-19T04:24:21.541997+0000","last_undegraded":"2024-04-19T04:24:21.541997+0000","last_fullsized":"2024-04-19T04:24:21.541997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:13:48.624837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.540713+0000","last_change":"2024-04-19T04:24:20.546603+0000","last_active":"2024-04-19T04:24:21.540713+0000","last_peered":"2024-04-19T04:24:21.540713+0000","last_clean":"2024-04-19T04:24:21.540713+0000","last_became_active":"2024-04-19T04:24:20.546136+0000","last_became_peered":"2024-04-19T04:24:20.546136+0000","last_unstale":"2024-04-19T04:24:21.540713+0000","last_undegraded":"2024-04-19T04:24:21.540713+0000","last_fullsized":"2024-04-19T04:24:21.540713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:20.610726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538747+0000","last_change":"2024-04-19T04:24:20.178148+0000","last_active":"2024-04-19T04:24:21.538747+0000","last_peered":"2024-04-19T04:24:21.538747+0000","last_clean":"2024-04-19T04:24:21.538747+0000","last_became_active":"2024-04-19T04:24:20.177382+0000","last_became_peered":"2024-04-19T04:24:20.177382+0000","last_unstale":"2024-04-19T04:24:21.538747+0000","last_undegraded":"2024-04-19T04:24:21.538747+0000","last_fullsized":"2024-04-19T04:24:21.538747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:03.585052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.607131+0000","last_change":"2024-04-19T04:24:20.556288+0000","last_active":"2024-04-19T04:24:21.607131+0000","last_peered":"2024-04-19T04:24:21.607131+0000","last_clean":"2024-04-19T04:24:21.607131+0000","last_became_active":"2024-04-19T04:24:20.554960+0000","last_became_peered":"2024-04-19T04:24:20.554960+0000","last_unstale":"2024-04-19T04:24:21.607131+0000","last_undegraded":"2024-04-19T04:24:21.607131+0000","last_fullsized":"2024-04-19T04:24:21.607131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:27.393720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T04:24:21.538917+0000","last_change":"2024-04-19T04:24:20.180873+0000","last_active":"2024-04-19T04:24:21.538917+0000","last_peered":"2024-04-19T04:24:21.538917+0000","last_clean":"2024-04-19T04:24:21.538917+0000","last_became_active":"2024-04-19T04:24:20.180584+0000","last_became_peered":"2024-04-19T04:24:20.180584+0000","last_unstale":"2024-04-19T04:24:21.538917+0000","last_undegraded":"2024-04-19T04:24:21.538917+0000","last_fullsized":"2024-04-19T04:24:21.538917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:43:03.367159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705674,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":253952,"data_stored":649246,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705674,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31296,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340544,"statfs":{"total":96636764160,"available":96604717056,"internally_reserved":0,"allocated":172032,"data_stored":57748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":649862,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:24:41.191 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-19T04:24:41.191 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-19T04:24:41.501 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 19 2024-04-19T04:24:41.501 INFO:teuthology.orchestra.run.smithi007.stdout:fsid 7aba6173-85fe-4265-947d-27b4a313af4e 2024-04-19T04:24:41.501 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-04-19T04:23:58.837304+0000 2024-04-19T04:24:41.501 INFO:teuthology.orchestra.run.smithi007.stdout:modified 2024-04-19T04:24:21.527750+0000 2024-04-19T04:24:41.502 INFO:teuthology.orchestra.run.smithi007.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-19T04:24:41.502 INFO:teuthology.orchestra.run.smithi007.stdout:crush_version 5 2024-04-19T04:24:41.502 INFO:teuthology.orchestra.run.smithi007.stdout:full_ratio 0.95 2024-04-19T04:24:41.502 INFO:teuthology.orchestra.run.smithi007.stdout:backfillfull_ratio 0.9 2024-04-19T04:24:41.502 INFO:teuthology.orchestra.run.smithi007.stdout:nearfull_ratio 0.85 2024-04-19T04:24:41.502 INFO:teuthology.orchestra.run.smithi007.stdout:require_min_compat_client luminous 2024-04-19T04:24:41.502 INFO:teuthology.orchestra.run.smithi007.stdout:min_compat_client jewel 2024-04-19T04:24:41.502 INFO:teuthology.orchestra.run.smithi007.stdout:require_osd_release reef 2024-04-19T04:24:41.502 INFO:teuthology.orchestra.run.smithi007.stdout:stretch_mode_enabled false 2024-04-19T04:24:41.502 INFO:teuthology.orchestra.run.smithi007.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-19T04:24:41.502 INFO:teuthology.orchestra.run.smithi007.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-19T04:24:41.502 INFO:teuthology.orchestra.run.smithi007.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-19T04:24:41.502 INFO:teuthology.orchestra.run.smithi007.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-19T04:24:41.503 INFO:teuthology.orchestra.run.smithi007.stdout:max_osd 3 2024-04-19T04:24:41.503 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 up in weight 1 up_from 9 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.27:6800/18128,v1:172.21.15.27:6801/18128] [v2:172.21.15.27:6802/18128,v1:172.21.15.27:6803/18128] exists,up 28ba89d9-eaaf-4fb5-86bc-783b607a4cba 2024-04-19T04:24:41.503 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 up in weight 1 up_from 9 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6800/18186,v1:172.21.15.66:6801/18186] [v2:172.21.15.66:6802/18186,v1:172.21.15.66:6803/18186] exists,up 9d5408b5-b74c-4e5e-858c-e0c8b593204e 2024-04-19T04:24:41.503 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 up in weight 1 up_from 9 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/18250,v1:172.21.15.172:6801/18250] [v2:172.21.15.172:6802/18250,v1:172.21.15.172:6803/18250] exists,up 9b600dc4-4425-4873-82d8-5434ca838bc1 2024-04-19T04:24:41.516 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.27:6800/18128,v1:172.21.15.27:6801/18128] [v2:172.21.15.27:6802/18128,v1:172.21.15.27:6803/18128] exists,up 28ba89d9-eaaf-4fb5-86bc-783b607a4cba', 'osd.1 up in weight 1 up_from 9 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6800/18186,v1:172.21.15.66:6801/18186] [v2:172.21.15.66:6802/18186,v1:172.21.15.66:6803/18186] exists,up 9d5408b5-b74c-4e5e-858c-e0c8b593204e', 'osd.2 up in weight 1 up_from 9 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/18250,v1:172.21.15.172:6801/18250] [v2:172.21.15.172:6802/18250,v1:172.21.15.172:6803/18250] exists,up 9b600dc4-4425-4873-82d8-5434ca838bc1'] 2024-04-19T04:24:41.516 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-19T04:24:41.627 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-19T04:24:41.628 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mon.a", 2024-04-19T04:24:41.628 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster": "ceph", 2024-04-19T04:24:41.628 INFO:teuthology.orchestra.run.smithi007.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-19T04:24:41.628 INFO:teuthology.orchestra.run.smithi007.stdout: "admin_socket_mode": "", 2024-04-19T04:24:41.628 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-19T04:24:41.629 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_client_required": "cephx, none", 2024-04-19T04:24:41.629 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_cluster_required": "cephx", 2024-04-19T04:24:41.629 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_debug": "true", 2024-04-19T04:24:41.629 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-19T04:24:41.629 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-19T04:24:41.629 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_service_required": "cephx", 2024-04-19T04:24:41.629 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-19T04:24:41.630 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_supported": "cephx", 2024-04-19T04:24:41.630 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_aio": "true", 2024-04-19T04:24:41.630 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-19T04:24:41.630 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_aio_poll_ms": "250", 2024-04-19T04:24:41.630 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_aio_reap_max": "16", 2024-04-19T04:24:41.630 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_async_discard": "false", 2024-04-19T04:24:41.631 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_block_size": "4096", 2024-04-19T04:24:41.631 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_debug_aio": "false", 2024-04-19T04:24:41.631 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-19T04:24:41.631 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-19T04:24:41.631 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_debug_inflight_ios": "false", 2024-04-19T04:24:41.631 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_enable_discard": "false", 2024-04-19T04:24:41.631 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_flock_retry": "3", 2024-04-19T04:24:41.631 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-19T04:24:41.632 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_inject_crash": "0", 2024-04-19T04:24:41.632 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-19T04:24:41.632 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_ioring": "false", 2024-04-19T04:24:41.632 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_ioring_hipri": "false", 2024-04-19T04:24:41.632 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-19T04:24:41.632 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-19T04:24:41.632 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-19T04:24:41.632 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-19T04:24:41.633 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_type": "", 2024-04-19T04:24:41.633 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_alloc_size": "1048576", 2024-04-19T04:24:41.633 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_allocator": "hybrid", 2024-04-19T04:24:41.633 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_buffered_io": "true", 2024-04-19T04:24:41.633 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_check_for_zeros": "false", 2024-04-19T04:24:41.633 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-19T04:24:41.634 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-19T04:24:41.634 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_compact_log_sync": "false", 2024-04-19T04:24:41.634 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-19T04:24:41.634 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-19T04:24:41.634 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-19T04:24:41.634 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-19T04:24:41.634 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_max_log_runway": "4194304", 2024-04-19T04:24:41.635 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_max_prefetch": "1048576", 2024-04-19T04:24:41.635 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_min_flush_size": "524288", 2024-04-19T04:24:41.635 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_min_log_runway": "1048576", 2024-04-19T04:24:41.635 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_replay_recovery": "false", 2024-04-19T04:24:41.635 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-19T04:24:41.636 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-19T04:24:41.636 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_sync_write": "false", 2024-04-19T04:24:41.636 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-19T04:24:41.636 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-19T04:24:41.636 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-19T04:24:41.636 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_allocation_from_file": "true", 2024-04-19T04:24:41.636 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_allocator": "hybrid", 2024-04-19T04:24:41.636 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-19T04:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-19T04:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-19T04:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-19T04:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-19T04:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-19T04:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-19T04:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_create": "true", 2024-04-19T04:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_db_create": "false", 2024-04-19T04:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_db_path": "", 2024-04-19T04:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_db_size": "0", 2024-04-19T04:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_path": "", 2024-04-19T04:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_preallocate_file": "false", 2024-04-19T04:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_size": "107374182400", 2024-04-19T04:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_wal_create": "false", 2024-04-19T04:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_wal_path": "", 2024-04-19T04:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_wal_size": "100663296", 2024-04-19T04:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bluefs": "true", 2024-04-19T04:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-19T04:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-19T04:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-19T04:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-19T04:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-19T04:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-19T04:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-19T04:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-19T04:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_autotune": "true", 2024-04-19T04:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-19T04:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-19T04:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-19T04:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-19T04:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_size": "0", 2024-04-19T04:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-19T04:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-19T04:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-19T04:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-19T04:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_type": "2q", 2024-04-19T04:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-19T04:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_clone_cow": "true", 2024-04-19T04:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-19T04:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-19T04:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-19T04:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-19T04:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-19T04:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-19T04:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-19T04:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_mode": "none", 2024-04-19T04:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-19T04:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_csum_type": "crc32c", 2024-04-19T04:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-19T04:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_freelist": "false", 2024-04-19T04:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-19T04:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-19T04:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_inject_bug21040": "false", 2024-04-19T04:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-19T04:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-19T04:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-19T04:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-19T04:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-19T04:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-19T04:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-19T04:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-19T04:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-19T04:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-19T04:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-19T04:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_small_allocations": "0", 2024-04-19T04:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-19T04:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_default_buffered_read": "true", 2024-04-19T04:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_default_buffered_write": "false", 2024-04-19T04:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-19T04:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-19T04:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-19T04:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-19T04:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-19T04:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-19T04:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-19T04:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-19T04:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fail_eio": "false", 2024-04-19T04:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-19T04:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-19T04:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-19T04:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-19T04:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-19T04:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-19T04:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_mount": "false", 2024-04-19T04:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-19T04:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_umount": "false", 2024-04-19T04:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-19T04:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-19T04:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-19T04:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-19T04:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-19T04:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-19T04:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-19T04:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-19T04:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_ignore_data_csum": "false", 2024-04-19T04:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-19T04:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-19T04:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-19T04:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-19T04:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_log_op_age": "5.000000", 2024-04-19T04:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_alloc_size": "0", 2024-04-19T04:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_blob_size": "0", 2024-04-19T04:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-19T04:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-19T04:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-19T04:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_deferred_txc": "32", 2024-04-19T04:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_min_alloc_size": "0", 2024-04-19T04:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-19T04:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-19T04:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_nid_prealloc": "1024", 2024-04-19T04:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-19T04:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-19T04:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-19T04:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-19T04:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_retry_disk_reads": "3", 2024-04-19T04:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_rocksdb_cf": "true", 2024-04-19T04:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-19T04:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-19T04:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-19T04:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-19T04:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-19T04:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-19T04:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_spdk_mem": "512", 2024-04-19T04:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-19T04:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-19T04:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-19T04:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-19T04:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-19T04:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-19T04:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-19T04:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_tracing": "false", 2024-04-19T04:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-19T04:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-19T04:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-19T04:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-19T04:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-19T04:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-19T04:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-19T04:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-19T04:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-19T04:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_zero_block_detection": "false", 2024-04-19T04:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-19T04:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-19T04:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-19T04:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-19T04:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-19T04:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-19T04:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-19T04:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-19T04:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-19T04:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-19T04:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-19T04:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-19T04:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-19T04:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-19T04:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_cluster_require_signatures": "false", 2024-04-19T04:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_cluster_require_version": "2", 2024-04-19T04:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_require_signatures": "false", 2024-04-19T04:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_require_version": "2", 2024-04-19T04:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_service_require_signatures": "false", 2024-04-19T04:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_service_require_version": "2", 2024-04-19T04:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_sign_messages": "true", 2024-04-19T04:24:41.649 INFO:teuthology.orchestra.run.smithi007.stdout: "chdir": "", 2024-04-19T04:24:41.649 INFO:teuthology.orchestra.run.smithi007.stdout: "client_acl_type": "", 2024-04-19T04:24:41.649 INFO:teuthology.orchestra.run.smithi007.stdout: "client_asio_thread_count": "2", 2024-04-19T04:24:41.649 INFO:teuthology.orchestra.run.smithi007.stdout: "client_cache_mid": "0.750000", 2024-04-19T04:24:41.649 INFO:teuthology.orchestra.run.smithi007.stdout: "client_cache_size": "16384", 2024-04-19T04:24:41.649 INFO:teuthology.orchestra.run.smithi007.stdout: "client_caps_release_delay": "5", 2024-04-19T04:24:41.649 INFO:teuthology.orchestra.run.smithi007.stdout: "client_check_pool_perm": "true", 2024-04-19T04:24:41.649 INFO:teuthology.orchestra.run.smithi007.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-19T04:24:41.649 INFO:teuthology.orchestra.run.smithi007.stdout: "client_debug_force_sync_read": "false", 2024-04-19T04:24:41.649 INFO:teuthology.orchestra.run.smithi007.stdout: "client_debug_getattr_caps": "false", 2024-04-19T04:24:41.649 INFO:teuthology.orchestra.run.smithi007.stdout: "client_debug_inject_tick_delay": "0", 2024-04-19T04:24:41.649 INFO:teuthology.orchestra.run.smithi007.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-19T04:24:41.649 INFO:teuthology.orchestra.run.smithi007.stdout: "client_die_on_failed_remount": "false", 2024-04-19T04:24:41.649 INFO:teuthology.orchestra.run.smithi007.stdout: "client_dirsize_rbytes": "true", 2024-04-19T04:24:41.649 INFO:teuthology.orchestra.run.smithi007.stdout: "client_force_lazyio": "false", 2024-04-19T04:24:41.650 INFO:teuthology.orchestra.run.smithi007.stdout: "client_fs": "", 2024-04-19T04:24:41.650 INFO:teuthology.orchestra.run.smithi007.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-19T04:24:41.650 INFO:teuthology.orchestra.run.smithi007.stdout: "client_inject_release_failure": "false", 2024-04-19T04:24:41.650 INFO:teuthology.orchestra.run.smithi007.stdout: "client_max_inline_size": "4096", 2024-04-19T04:24:41.650 INFO:teuthology.orchestra.run.smithi007.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-19T04:24:41.650 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mds_namespace": "", 2024-04-19T04:24:41.650 INFO:teuthology.orchestra.run.smithi007.stdout: "client_metadata": "", 2024-04-19T04:24:41.650 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mount_gid": "-1", 2024-04-19T04:24:41.650 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mount_timeout": "300", 2024-04-19T04:24:41.650 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mount_uid": "-1", 2024-04-19T04:24:41.650 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mountpoint": "/", 2024-04-19T04:24:41.650 INFO:teuthology.orchestra.run.smithi007.stdout: "client_notify_timeout": "10", 2024-04-19T04:24:41.650 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc": "true", 2024-04-19T04:24:41.650 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_max_dirty": "104857600", 2024-04-19T04:24:41.651 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-19T04:24:41.651 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_max_objects": "1000", 2024-04-19T04:24:41.651 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_size": "209715200", 2024-04-19T04:24:41.651 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_target_dirty": "8388608", 2024-04-19T04:24:41.651 INFO:teuthology.orchestra.run.smithi007.stdout: "client_permissions": "true", 2024-04-19T04:24:41.651 INFO:teuthology.orchestra.run.smithi007.stdout: "client_quota": "true", 2024-04-19T04:24:41.651 INFO:teuthology.orchestra.run.smithi007.stdout: "client_quota_df": "true", 2024-04-19T04:24:41.651 INFO:teuthology.orchestra.run.smithi007.stdout: "client_readahead_max_bytes": "0", 2024-04-19T04:24:41.651 INFO:teuthology.orchestra.run.smithi007.stdout: "client_readahead_max_periods": "4", 2024-04-19T04:24:41.651 INFO:teuthology.orchestra.run.smithi007.stdout: "client_readahead_min": "131072", 2024-04-19T04:24:41.651 INFO:teuthology.orchestra.run.smithi007.stdout: "client_reconnect_stale": "false", 2024-04-19T04:24:41.651 INFO:teuthology.orchestra.run.smithi007.stdout: "client_shutdown_timeout": "30", 2024-04-19T04:24:41.651 INFO:teuthology.orchestra.run.smithi007.stdout: "client_snapdir": ".snap", 2024-04-19T04:24:41.651 INFO:teuthology.orchestra.run.smithi007.stdout: "client_tick_interval": "1", 2024-04-19T04:24:41.652 INFO:teuthology.orchestra.run.smithi007.stdout: "client_trace": "", 2024-04-19T04:24:41.652 INFO:teuthology.orchestra.run.smithi007.stdout: "client_try_dentry_invalidate": "false", 2024-04-19T04:24:41.652 INFO:teuthology.orchestra.run.smithi007.stdout: "client_use_faked_inos": "false", 2024-04-19T04:24:41.652 INFO:teuthology.orchestra.run.smithi007.stdout: "client_use_random_mds": "false", 2024-04-19T04:24:41.652 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_graylog": "false", 2024-04-19T04:24:41.652 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-19T04:24:41.652 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_graylog_port": "12201", 2024-04-19T04:24:41.652 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_monitors": "default=true", 2024-04-19T04:24:41.652 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_syslog": "false", 2024-04-19T04:24:41.652 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-19T04:24:41.652 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_syslog_level": "info", 2024-04-19T04:24:41.652 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "-", 2024-04-19T04:24:41.652 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_network": "", 2024-04-19T04:24:41.652 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_network_interface": "", 2024-04-19T04:24:41.652 INFO:teuthology.orchestra.run.smithi007.stdout: "compressor_zlib_isal": "false", 2024-04-19T04:24:41.653 INFO:teuthology.orchestra.run.smithi007.stdout: "compressor_zlib_level": "5", 2024-04-19T04:24:41.653 INFO:teuthology.orchestra.run.smithi007.stdout: "compressor_zlib_winsize": "-15", 2024-04-19T04:24:41.653 INFO:teuthology.orchestra.run.smithi007.stdout: "compressor_zstd_level": "1", 2024-04-19T04:24:41.653 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-19T04:24:41.653 INFO:teuthology.orchestra.run.smithi007.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-19T04:24:41.653 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_alien_op_num_threads": "6", 2024-04-19T04:24:41.653 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-19T04:24:41.653 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_osd_obc_lru_size": "10", 2024-04-19T04:24:41.653 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-19T04:24:41.653 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_seastar_smp": "1", 2024-04-19T04:24:41.653 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_location": "", 2024-04-19T04:24:41.653 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_location_hook": "", 2024-04-19T04:24:41.653 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_location_hook_timeout": "10", 2024-04-19T04:24:41.653 INFO:teuthology.orchestra.run.smithi007.stdout: "daemonize": "false", 2024-04-19T04:24:41.653 INFO:teuthology.orchestra.run.smithi007.stdout: "daos_pool": "tank", 2024-04-19T04:24:41.654 INFO:teuthology.orchestra.run.smithi007.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-19T04:24:41.654 INFO:teuthology.orchestra.run.smithi007.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-19T04:24:41.654 INFO:teuthology.orchestra.run.smithi007.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-19T04:24:41.654 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_alienstore": "0/5", 2024-04-19T04:24:41.654 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_allow_any_pool_priority": "false", 2024-04-19T04:24:41.654 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_asok": "1/5", 2024-04-19T04:24:41.654 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_asok_assert_abort": "false", 2024-04-19T04:24:41.654 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_asserts_on_shutdown": "true", 2024-04-19T04:24:41.654 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_auth": "20/20", 2024-04-19T04:24:41.654 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_bdev": "1/3", 2024-04-19T04:24:41.654 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_bluefs": "1/5", 2024-04-19T04:24:41.654 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_bluestore": "1/5", 2024-04-19T04:24:41.654 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_buffer": "0/1", 2024-04-19T04:24:41.655 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_ceph_exporter": "1/5", 2024-04-19T04:24:41.655 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_cephfs_mirror": "0/5", 2024-04-19T04:24:41.655 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_cephsqlite": "0/5", 2024-04-19T04:24:41.655 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_client": "0/5", 2024-04-19T04:24:41.655 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_compressor": "1/5", 2024-04-19T04:24:41.655 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_context": "0/1", 2024-04-19T04:24:41.655 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_crush": "1/1", 2024-04-19T04:24:41.655 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_crypto": "1/5", 2024-04-19T04:24:41.655 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_cyanstore": "0/5", 2024-04-19T04:24:41.655 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_deliberately_leak_memory": "false", 2024-04-19T04:24:41.655 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_disable_randomized_ping": "false", 2024-04-19T04:24:41.655 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_dpdk": "1/5", 2024-04-19T04:24:41.655 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_eventtrace": "1/5", 2024-04-19T04:24:41.655 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_filer": "0/1", 2024-04-19T04:24:41.655 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_filestore": "1/3", 2024-04-19T04:24:41.656 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_finisher": "1/1", 2024-04-19T04:24:41.656 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_fuse": "1/5", 2024-04-19T04:24:41.656 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_heartbeat_testing_span": "0", 2024-04-19T04:24:41.656 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_heartbeatmap": "1/5", 2024-04-19T04:24:41.656 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-19T04:24:41.656 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_javaclient": "1/5", 2024-04-19T04:24:41.656 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_journal": "1/3", 2024-04-19T04:24:41.656 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_journaler": "0/5", 2024-04-19T04:24:41.656 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_kstore": "1/5", 2024-04-19T04:24:41.656 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_leveldb": "4/5", 2024-04-19T04:24:41.656 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_lockdep": "0/1", 2024-04-19T04:24:41.656 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mclock": "1/5", 2024-04-19T04:24:41.656 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds": "1/5", 2024-04-19T04:24:41.656 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_balancer": "1/5", 2024-04-19T04:24:41.657 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_locker": "1/5", 2024-04-19T04:24:41.657 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_log": "1/5", 2024-04-19T04:24:41.657 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_log_expire": "1/5", 2024-04-19T04:24:41.657 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_migrator": "1/5", 2024-04-19T04:24:41.657 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_memstore": "1/5", 2024-04-19T04:24:41.657 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mgr": "2/5", 2024-04-19T04:24:41.657 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mgrc": "1/5", 2024-04-19T04:24:41.657 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mon": "20/20", 2024-04-19T04:24:41.657 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_monc": "0/10", 2024-04-19T04:24:41.657 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_ms": "1/1", 2024-04-19T04:24:41.657 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_none": "0/5", 2024-04-19T04:24:41.657 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_objclass": "0/5", 2024-04-19T04:24:41.657 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_objectcacher": "0/5", 2024-04-19T04:24:41.657 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_objecter": "0/1", 2024-04-19T04:24:41.658 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_optracker": "0/5", 2024-04-19T04:24:41.658 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_osd": "1/5", 2024-04-19T04:24:41.658 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_paxos": "20/20", 2024-04-19T04:24:41.658 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_perfcounter": "1/5", 2024-04-19T04:24:41.658 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_prioritycache": "1/5", 2024-04-19T04:24:41.658 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rados": "0/5", 2024-04-19T04:24:41.658 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rbd": "0/5", 2024-04-19T04:24:41.658 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rbd_mirror": "0/5", 2024-04-19T04:24:41.658 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rbd_pwl": "0/5", 2024-04-19T04:24:41.658 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rbd_replay": "0/5", 2024-04-19T04:24:41.658 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_refs": "0/0", 2024-04-19T04:24:41.658 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_reserver": "1/1", 2024-04-19T04:24:41.658 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw": "1/5", 2024-04-19T04:24:41.658 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw_access": "1/5", 2024-04-19T04:24:41.659 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw_datacache": "1/5", 2024-04-19T04:24:41.659 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw_dbstore": "1/5", 2024-04-19T04:24:41.659 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw_flight": "1/5", 2024-04-19T04:24:41.659 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw_sync": "1/5", 2024-04-19T04:24:41.659 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rocksdb": "4/5", 2024-04-19T04:24:41.659 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore": "0/5", 2024-04-19T04:24:41.659 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_backref": "0/5", 2024-04-19T04:24:41.659 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_cache": "0/5", 2024-04-19T04:24:41.659 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_cleaner": "0/5", 2024-04-19T04:24:41.659 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_device": "0/5", 2024-04-19T04:24:41.659 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_epm": "0/5", 2024-04-19T04:24:41.659 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-19T04:24:41.659 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_journal": "0/5", 2024-04-19T04:24:41.659 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_lba": "0/5", 2024-04-19T04:24:41.659 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_odata": "0/5", 2024-04-19T04:24:41.660 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_omap": "0/5", 2024-04-19T04:24:41.660 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_onode": "0/5", 2024-04-19T04:24:41.660 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_t": "0/5", 2024-04-19T04:24:41.660 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_tm": "0/5", 2024-04-19T04:24:41.660 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_striper": "0/1", 2024-04-19T04:24:41.660 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_test": "0/5", 2024-04-19T04:24:41.660 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_throttle": "1/1", 2024-04-19T04:24:41.660 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_timer": "0/1", 2024-04-19T04:24:41.660 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_tp": "0/5", 2024-04-19T04:24:41.660 INFO:teuthology.orchestra.run.smithi007.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-19T04:24:41.660 INFO:teuthology.orchestra.run.smithi007.stdout: "device_failure_prediction_mode": "none", 2024-04-19T04:24:41.660 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-19T04:24:41.660 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-19T04:24:41.660 INFO:teuthology.orchestra.run.smithi007.stdout: "err_to_graylog": "false", 2024-04-19T04:24:41.661 INFO:teuthology.orchestra.run.smithi007.stdout: "err_to_journald": "false", 2024-04-19T04:24:41.661 INFO:teuthology.orchestra.run.smithi007.stdout: "err_to_stderr": "true", 2024-04-19T04:24:41.661 INFO:teuthology.orchestra.run.smithi007.stdout: "err_to_syslog": "false", 2024-04-19T04:24:41.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event_tracing": "false", 2024-04-19T04:24:41.661 INFO:teuthology.orchestra.run.smithi007.stdout: "exporter_addr": "0.0.0.0", 2024-04-19T04:24:41.661 INFO:teuthology.orchestra.run.smithi007.stdout: "exporter_http_port": "9926", 2024-04-19T04:24:41.661 INFO:teuthology.orchestra.run.smithi007.stdout: "exporter_prio_limit": "5", 2024-04-19T04:24:41.661 INFO:teuthology.orchestra.run.smithi007.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-19T04:24:41.661 INFO:teuthology.orchestra.run.smithi007.stdout: "exporter_sort_metrics": "true", 2024-04-19T04:24:41.661 INFO:teuthology.orchestra.run.smithi007.stdout: "exporter_stats_period": "5", 2024-04-19T04:24:41.661 INFO:teuthology.orchestra.run.smithi007.stdout: "fake_statfs_for_testing": "0", 2024-04-19T04:24:41.661 INFO:teuthology.orchestra.run.smithi007.stdout: "fatal_signal_handlers": "true", 2024-04-19T04:24:41.661 INFO:teuthology.orchestra.run.smithi007.stdout: "filer_max_purge_ops": "10", 2024-04-19T04:24:41.661 INFO:teuthology.orchestra.run.smithi007.stdout: "filer_max_truncate_ops": "128", 2024-04-19T04:24:41.661 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_apply_finisher_threads": "1", 2024-04-19T04:24:41.662 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_blackhole": "false", 2024-04-19T04:24:41.662 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_btrfs_clone_range": "true", 2024-04-19T04:24:41.662 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_btrfs_snap": "true", 2024-04-19T04:24:41.662 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_caller_concurrency": "10", 2024-04-19T04:24:41.662 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_collect_device_partition_information": "true", 2024-04-19T04:24:41.662 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_commit_timeout": "600.000000", 2024-04-19T04:24:41.662 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_debug_inject_read_err": "false", 2024-04-19T04:24:41.662 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_debug_omap_check": "false", 2024-04-19T04:24:41.662 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-19T04:24:41.662 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_debug_verify_split": "false", 2024-04-19T04:24:41.662 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_dump_file": "", 2024-04-19T04:24:41.662 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-19T04:24:41.663 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-19T04:24:41.663 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fadvise": "true", 2024-04-19T04:24:41.663 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fail_eio": "true", 2024-04-19T04:24:41.663 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fd_cache_shards": "16", 2024-04-19T04:24:41.663 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fd_cache_size": "128", 2024-04-19T04:24:41.663 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fiemap": "false", 2024-04-19T04:24:41.663 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fiemap_threshold": "4096", 2024-04-19T04:24:41.663 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-19T04:24:41.663 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-19T04:24:41.663 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_inject_stall": "0", 2024-04-19T04:24:41.663 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_journal_parallel": "false", 2024-04-19T04:24:41.663 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_journal_trailing": "false", 2024-04-19T04:24:41.663 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_journal_writeahead": "false", 2024-04-19T04:24:41.663 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_kill_at": "0", 2024-04-19T04:24:41.664 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-19T04:24:41.664 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-19T04:24:41.664 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-19T04:24:41.664 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-19T04:24:41.664 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-19T04:24:41.664 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattrs": "0", 2024-04-19T04:24:41.664 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-19T04:24:41.664 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-19T04:24:41.664 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-19T04:24:41.664 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-19T04:24:41.664 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_xattr_value_size": "0", 2024-04-19T04:24:41.664 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-19T04:24:41.664 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-19T04:24:41.664 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-19T04:24:41.664 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_merge_threshold": "-10", 2024-04-19T04:24:41.665 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-19T04:24:41.665 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_odsync_write": "false", 2024-04-19T04:24:41.665 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_omap_backend": "rocksdb", 2024-04-19T04:24:41.665 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_omap_backend_path": "", 2024-04-19T04:24:41.665 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-19T04:24:41.665 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-19T04:24:41.665 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-19T04:24:41.665 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_op_thread_timeout": "60", 2024-04-19T04:24:41.665 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_op_threads": "2", 2024-04-19T04:24:41.665 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_punch_hole": "false", 2024-04-19T04:24:41.665 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-19T04:24:41.665 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-19T04:24:41.665 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-19T04:24:41.665 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-19T04:24:41.666 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-19T04:24:41.666 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-19T04:24:41.666 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-19T04:24:41.666 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-19T04:24:41.666 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-19T04:24:41.666 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_ops": "50", 2024-04-19T04:24:41.666 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-19T04:24:41.666 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_seek_data_hole": "false", 2024-04-19T04:24:41.666 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_sloppy_crc": "false", 2024-04-19T04:24:41.666 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-19T04:24:41.666 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_splice": "false", 2024-04-19T04:24:41.666 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_split_multiple": "2", 2024-04-19T04:24:41.666 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_split_rand_factor": "20", 2024-04-19T04:24:41.667 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_update_to": "1000", 2024-04-19T04:24:41.667 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-19T04:24:41.667 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-19T04:24:41.667 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-19T04:24:41.667 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-19T04:24:41.667 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-19T04:24:41.667 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-19T04:24:41.667 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_enable": "true", 2024-04-19T04:24:41.667 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-19T04:24:41.667 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-19T04:24:41.667 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-19T04:24:41.667 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-19T04:24:41.667 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-19T04:24:41.667 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-19T04:24:41.668 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_xfs_extsize": "false", 2024-04-19T04:24:41.668 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_zfs_snap": "false", 2024-04-19T04:24:41.668 INFO:teuthology.orchestra.run.smithi007.stdout: "fio_dir": "/tmp/fio", 2024-04-19T04:24:41.668 INFO:teuthology.orchestra.run.smithi007.stdout: "fsid": "7aba6173-85fe-4265-947d-27b4a313af4e", 2024-04-19T04:24:41.668 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_allow_other": "true", 2024-04-19T04:24:41.668 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_atomic_o_trunc": "true", 2024-04-19T04:24:41.668 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_big_writes": "true", 2024-04-19T04:24:41.668 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_debug": "false", 2024-04-19T04:24:41.668 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_default_permissions": "false", 2024-04-19T04:24:41.668 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_disable_pagecache": "false", 2024-04-19T04:24:41.668 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_max_write": "0", 2024-04-19T04:24:41.668 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_multithreaded": "true", 2024-04-19T04:24:41.668 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_require_active_mds": "true", 2024-04-19T04:24:41.668 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_set_user_groups": "true", 2024-04-19T04:24:41.668 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_splice_move": "true", 2024-04-19T04:24:41.669 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_splice_read": "true", 2024-04-19T04:24:41.669 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_splice_write": "true", 2024-04-19T04:24:41.669 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-19T04:24:41.669 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_use_invalidate_cb": "true", 2024-04-19T04:24:41.669 INFO:teuthology.orchestra.run.smithi007.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-19T04:24:41.669 INFO:teuthology.orchestra.run.smithi007.stdout: "gss_target_name": "ceph", 2024-04-19T04:24:41.669 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_file": "", 2024-04-19T04:24:41.669 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_inject_failure": "0", 2024-04-19T04:24:41.669 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_interval": "5", 2024-04-19T04:24:41.669 INFO:teuthology.orchestra.run.smithi007.stdout: "host": "smithi007", 2024-04-19T04:24:41.669 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-19T04:24:41.669 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-19T04:24:41.669 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-19T04:24:41.669 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-19T04:24:41.669 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-19T04:24:41.670 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-19T04:24:41.670 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-19T04:24:41.670 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-19T04:24:41.670 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-19T04:24:41.670 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-19T04:24:41.670 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-19T04:24:41.670 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-19T04:24:41.670 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-19T04:24:41.670 INFO:teuthology.orchestra.run.smithi007.stdout: "inject_early_sigterm": "false", 2024-04-19T04:24:41.670 INFO:teuthology.orchestra.run.smithi007.stdout: "jaeger_agent_port": "6799", 2024-04-19T04:24:41.670 INFO:teuthology.orchestra.run.smithi007.stdout: "jaeger_tracing_enable": "false", 2024-04-19T04:24:41.670 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_aio": "true", 2024-04-19T04:24:41.670 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_align_min_size": "65536", 2024-04-19T04:24:41.670 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_block_align": "true", 2024-04-19T04:24:41.671 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_block_size": "4096", 2024-04-19T04:24:41.671 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_dio": "true", 2024-04-19T04:24:41.671 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_discard": "false", 2024-04-19T04:24:41.671 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_force_aio": "false", 2024-04-19T04:24:41.671 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_ignore_corruption": "false", 2024-04-19T04:24:41.671 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_max_write_bytes": "10485760", 2024-04-19T04:24:41.671 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_max_write_entries": "100", 2024-04-19T04:24:41.671 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_replay_from": "0", 2024-04-19T04:24:41.671 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-19T04:24:41.671 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-19T04:24:41.671 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-19T04:24:41.671 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-19T04:24:41.671 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_write_header_frequency": "0", 2024-04-19T04:24:41.671 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_zero_on_create": "false", 2024-04-19T04:24:41.672 INFO:teuthology.orchestra.run.smithi007.stdout: "journaler_prefetch_periods": "10", 2024-04-19T04:24:41.672 INFO:teuthology.orchestra.run.smithi007.stdout: "journaler_prezero_periods": "5", 2024-04-19T04:24:41.672 INFO:teuthology.orchestra.run.smithi007.stdout: "journaler_write_head_interval": "15", 2024-04-19T04:24:41.672 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "", 2024-04-19T04:24:41.672 INFO:teuthology.orchestra.run.smithi007.stdout: "keyfile": "", 2024-04-19T04:24:41.672 INFO:teuthology.orchestra.run.smithi007.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-19T04:24:41.672 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_backend": "rocksdb", 2024-04-19T04:24:41.672 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_default_stripe_size": "65536", 2024-04-19T04:24:41.672 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_fsck_on_mount": "false", 2024-04-19T04:24:41.672 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-19T04:24:41.672 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_max_bytes": "67108864", 2024-04-19T04:24:41.672 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_max_ops": "512", 2024-04-19T04:24:41.672 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_nid_prealloc": "1024", 2024-04-19T04:24:41.672 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_onode_map_size": "1024", 2024-04-19T04:24:41.672 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-19T04:24:41.673 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_sync_submit_transaction": "false", 2024-04-19T04:24:41.673 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_sync_transaction": "false", 2024-04-19T04:24:41.673 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_block_size": "65536", 2024-04-19T04:24:41.673 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_bloom_size": "0", 2024-04-19T04:24:41.673 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_cache_size": "536870912", 2024-04-19T04:24:41.673 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_compact_on_mount": "false", 2024-04-19T04:24:41.673 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_compression": "false", 2024-04-19T04:24:41.673 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_log": "", 2024-04-19T04:24:41.673 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_log_to_ceph_log": "true", 2024-04-19T04:24:41.673 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_max_open_files": "0", 2024-04-19T04:24:41.673 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_paranoid": "false", 2024-04-19T04:24:41.673 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_write_buffer_size": "33554432", 2024-04-19T04:24:41.673 INFO:teuthology.orchestra.run.smithi007.stdout: "librados_thread_count": "2", 2024-04-19T04:24:41.673 INFO:teuthology.orchestra.run.smithi007.stdout: "lockdep": "false", 2024-04-19T04:24:41.673 INFO:teuthology.orchestra.run.smithi007.stdout: "lockdep_force_backtrace": "false", 2024-04-19T04:24:41.674 INFO:teuthology.orchestra.run.smithi007.stdout: "log_coarse_timestamps": "true", 2024-04-19T04:24:41.674 INFO:teuthology.orchestra.run.smithi007.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-19T04:24:41.674 INFO:teuthology.orchestra.run.smithi007.stdout: "log_flush_on_exit": "false", 2024-04-19T04:24:41.674 INFO:teuthology.orchestra.run.smithi007.stdout: "log_graylog_host": "127.0.0.1", 2024-04-19T04:24:41.674 INFO:teuthology.orchestra.run.smithi007.stdout: "log_graylog_port": "12201", 2024-04-19T04:24:41.674 INFO:teuthology.orchestra.run.smithi007.stdout: "log_max_new": "1000", 2024-04-19T04:24:41.674 INFO:teuthology.orchestra.run.smithi007.stdout: "log_max_recent": "10000", 2024-04-19T04:24:41.674 INFO:teuthology.orchestra.run.smithi007.stdout: "log_stderr_prefix": "", 2024-04-19T04:24:41.674 INFO:teuthology.orchestra.run.smithi007.stdout: "log_stop_at_utilization": "0.970000", 2024-04-19T04:24:41.674 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": "true", 2024-04-19T04:24:41.674 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_graylog": "false", 2024-04-19T04:24:41.674 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_journald": "false", 2024-04-19T04:24:41.674 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_stderr": "false", 2024-04-19T04:24:41.674 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_syslog": "false", 2024-04-19T04:24:41.675 INFO:teuthology.orchestra.run.smithi007.stdout: "max_rotating_auth_attempts": "10", 2024-04-19T04:24:41.675 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-19T04:24:41.675 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_action_on_write_error": "1", 2024-04-19T04:24:41.675 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_alternate_name_max": "8192", 2024-04-19T04:24:41.675 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_asio_thread_count": "2", 2024-04-19T04:24:41.675 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_export_pin": "true", 2024-04-19T04:24:41.675 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_fragment_dirs": "true", 2024-04-19T04:24:41.675 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-19T04:24:41.675 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_fragment_interval": "5", 2024-04-19T04:24:41.675 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-19T04:24:41.675 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-19T04:24:41.675 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_interval": "10", 2024-04-19T04:24:41.675 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_max": "-1", 2024-04-19T04:24:41.675 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_max_until": "-1", 2024-04-19T04:24:41.675 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_merge_size": "50", 2024-04-19T04:24:41.676 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_midchunk": "0.300000", 2024-04-19T04:24:41.676 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-19T04:24:41.676 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_min_start": "0.200000", 2024-04-19T04:24:41.676 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_minchunk": "0.001000", 2024-04-19T04:24:41.676 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_mode": "0", 2024-04-19T04:24:41.676 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_need_max": "1.200000", 2024-04-19T04:24:41.676 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_need_min": "0.800000", 2024-04-19T04:24:41.676 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-19T04:24:41.676 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-19T04:24:41.676 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_split_bits": "3", 2024-04-19T04:24:41.676 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-19T04:24:41.676 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_split_size": "10000", 2024-04-19T04:24:41.677 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-19T04:24:41.677 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_target_decay": "10.000000", 2024-04-19T04:24:41.677 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-19T04:24:41.677 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_beacon_grace": "15.000000", 2024-04-19T04:24:41.677 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_beacon_interval": "4.000000", 2024-04-19T04:24:41.677 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-19T04:24:41.677 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-19T04:24:41.677 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_mid": "0.700000", 2024-04-19T04:24:41.677 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_release_free_interval": "10", 2024-04-19T04:24:41.677 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_reservation": "0.050000", 2024-04-19T04:24:41.677 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-19T04:24:41.677 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_trim_interval": "1", 2024-04-19T04:24:41.677 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_trim_threshold": "262144", 2024-04-19T04:24:41.677 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-19T04:24:41.677 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-19T04:24:41.678 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-19T04:24:41.678 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_client_prealloc_inos": "1000", 2024-04-19T04:24:41.678 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-19T04:24:41.678 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_connect_bootstrapping": "false", 2024-04-19T04:24:41.678 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_damage_table_max_entries": "10000", 2024-04-19T04:24:41.678 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-19T04:24:41.678 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_debug_auth_pins": "false", 2024-04-19T04:24:41.678 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_debug_frag": "false", 2024-04-19T04:24:41.678 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_debug_scatterstat": "false", 2024-04-19T04:24:41.678 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_debug_subtrees": "false", 2024-04-19T04:24:41.678 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_decay_halflife": "5.000000", 2024-04-19T04:24:41.678 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_default_dir_hash": "2", 2024-04-19T04:24:41.678 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_defer_session_stale": "true", 2024-04-19T04:24:41.679 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_deny_all_reconnect": "false", 2024-04-19T04:24:41.679 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dir_keys_per_op": "16384", 2024-04-19T04:24:41.679 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dir_max_commit_size": "10", 2024-04-19T04:24:41.679 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dir_max_entries": "0", 2024-04-19T04:24:41.679 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dir_prefetch": "true", 2024-04-19T04:24:41.679 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-19T04:24:41.679 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-19T04:24:41.679 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dump_cache_on_map": "false", 2024-04-19T04:24:41.679 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-19T04:24:41.679 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-19T04:24:41.679 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_early_reply": "true", 2024-04-19T04:24:41.679 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_enable_op_tracker": "true", 2024-04-19T04:24:41.679 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_enforce_unique_name": "true", 2024-04-19T04:24:41.679 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-19T04:24:41.680 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-19T04:24:41.680 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_export_ephemeral_random": "true", 2024-04-19T04:24:41.680 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-19T04:24:41.680 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-19T04:24:41.680 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-19T04:24:41.680 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-19T04:24:41.680 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-19T04:24:41.680 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-19T04:24:41.680 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-19T04:24:41.680 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-19T04:24:41.680 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_health_summarize_threshold": "10", 2024-04-19T04:24:41.680 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-19T04:24:41.680 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-19T04:24:41.680 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_health_dummy": "false", 2024-04-19T04:24:41.680 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-19T04:24:41.681 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_migrator_session_race": "false", 2024-04-19T04:24:41.681 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-19T04:24:41.681 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-19T04:24:41.681 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-19T04:24:41.681 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_join_fs": "", 2024-04-19T04:24:41.681 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_journal_format": "1", 2024-04-19T04:24:41.681 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_create_at": "0", 2024-04-19T04:24:41.681 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_export_at": "0", 2024-04-19T04:24:41.681 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_import_at": "0", 2024-04-19T04:24:41.681 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_journal_at": "0", 2024-04-19T04:24:41.681 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_journal_expire_at": "0", 2024-04-19T04:24:41.681 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_journal_replay_at": "0", 2024-04-19T04:24:41.681 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_link_at": "0", 2024-04-19T04:24:41.681 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_mdstable_at": "0", 2024-04-19T04:24:41.682 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_openc_at": "0", 2024-04-19T04:24:41.682 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_rename_at": "0", 2024-04-19T04:24:41.682 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-19T04:24:41.682 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_events_per_segment": "1024", 2024-04-19T04:24:41.682 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_max_events": "-1", 2024-04-19T04:24:41.682 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_max_segments": "128", 2024-04-19T04:24:41.682 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_pause": "false", 2024-04-19T04:24:41.682 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_segment_size": "0", 2024-04-19T04:24:41.682 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-19T04:24:41.682 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_warn_factor": "2.000000", 2024-04-19T04:24:41.682 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_caps_per_client": "1048576", 2024-04-19T04:24:41.682 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_completed_flushes": "100000", 2024-04-19T04:24:41.682 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_completed_requests": "100000", 2024-04-19T04:24:41.682 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_export_size": "20971520", 2024-04-19T04:24:41.683 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_file_recover": "32", 2024-04-19T04:24:41.683 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_purge_files": "64", 2024-04-19T04:24:41.683 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_purge_ops": "8192", 2024-04-19T04:24:41.683 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-19T04:24:41.683 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-19T04:24:41.683 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_snaps_per_dir": "100", 2024-04-19T04:24:41.683 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_metrics_update_interval": "2", 2024-04-19T04:24:41.683 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_min_caps_per_client": "100", 2024-04-19T04:24:41.683 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_min_caps_working_set": "10000", 2024-04-19T04:24:41.683 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-19T04:24:41.683 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_numa_node": "-1", 2024-04-19T04:24:41.683 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-19T04:24:41.683 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_complaint_time": "30.000000", 2024-04-19T04:24:41.683 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_history_duration": "600", 2024-04-19T04:24:41.684 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_history_size": "20", 2024-04-19T04:24:41.684 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_history_slow_op_size": "20", 2024-04-19T04:24:41.684 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-19T04:24:41.684 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_log_threshold": "5", 2024-04-19T04:24:41.684 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_ping_grace": "15", 2024-04-19T04:24:41.684 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_ping_interval": "5", 2024-04-19T04:24:41.684 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-19T04:24:41.684 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-19T04:24:41.684 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_max_caps": "30000", 2024-04-19T04:24:41.684 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-19T04:24:41.684 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-19T04:24:41.684 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-19T04:24:41.684 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_warning_threshold": "262144", 2024-04-19T04:24:41.684 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-19T04:24:41.685 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_replay_interval": "1.000000", 2024-04-19T04:24:41.685 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-19T04:24:41.685 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-19T04:24:41.685 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_root_ino_gid": "0", 2024-04-19T04:24:41.685 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_root_ino_uid": "0", 2024-04-19T04:24:41.685 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-19T04:24:41.685 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-19T04:24:41.685 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-19T04:24:41.685 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-19T04:24:41.685 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-19T04:24:41.685 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-19T04:24:41.685 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-19T04:24:41.685 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-19T04:24:41.685 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-19T04:24:41.685 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-19T04:24:41.686 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_shutdown_check": "0", 2024-04-19T04:24:41.686 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_skip_ino": "0", 2024-04-19T04:24:41.686 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-19T04:24:41.686 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_snap_max_uid": "4294967294", 2024-04-19T04:24:41.686 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_snap_min_uid": "0", 2024-04-19T04:24:41.686 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_snap_rstat": "false", 2024-04-19T04:24:41.686 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_standby_replay_damaged": "false", 2024-04-19T04:24:41.686 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_symlink_recovery": "true", 2024-04-19T04:24:41.686 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-19T04:24:41.686 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_thrash_exports": "0", 2024-04-19T04:24:41.686 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_thrash_fragments": "0", 2024-04-19T04:24:41.686 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_tick_interval": "5.000000", 2024-04-19T04:24:41.686 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_valgrind_exit": "false", 2024-04-19T04:24:41.686 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_verify_backtrace": "1", 2024-04-19T04:24:41.687 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_verify_scatter": "false", 2024-04-19T04:24:41.687 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-19T04:24:41.687 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_wipe_sessions": "false", 2024-04-19T04:24:41.687 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool_debug": "false", 2024-04-19T04:24:41.687 INFO:teuthology.orchestra.run.smithi007.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-19T04:24:41.687 INFO:teuthology.orchestra.run.smithi007.stdout: "memstore_device_bytes": "1073741824", 2024-04-19T04:24:41.687 INFO:teuthology.orchestra.run.smithi007.stdout: "memstore_page_set": "false", 2024-04-19T04:24:41.687 INFO:teuthology.orchestra.run.smithi007.stdout: "memstore_page_size": "65536", 2024-04-19T04:24:41.687 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_client_bytes": "134217728", 2024-04-19T04:24:41.687 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_client_messages": "512", 2024-04-19T04:24:41.687 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-19T04:24:41.687 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-19T04:24:41.687 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-19T04:24:41.687 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-19T04:24:41.687 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_disabled_modules": "", 2024-04-19T04:24:41.688 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-19T04:24:41.688 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_max_pg_num_change": "128", 2024-04-19T04:24:41.688 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_mds_bytes": "134217728", 2024-04-19T04:24:41.688 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_mds_messages": "128", 2024-04-19T04:24:41.688 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-19T04:24:41.688 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_mon_bytes": "134217728", 2024-04-19T04:24:41.688 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_mon_messages": "128", 2024-04-19T04:24:41.688 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_osd_bytes": "536870912", 2024-04-19T04:24:41.688 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_osd_messages": "8192", 2024-04-19T04:24:41.688 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_pool": "true", 2024-04-19T04:24:41.688 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-19T04:24:41.688 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_standby_modules": "true", 2024-04-19T04:24:41.688 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_stats_period": "5", 2024-04-19T04:24:41.688 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_stats_threshold": "5", 2024-04-19T04:24:41.689 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_tick_period": "2", 2024-04-19T04:24:41.689 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-19T04:24:41.689 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-19T04:24:41.689 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_allow_pool_delete": "true", 2024-04-19T04:24:41.689 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_allow_pool_size_one": "true", 2024-04-19T04:24:41.689 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_auth_validate_all_caps": "true", 2024-04-19T04:24:41.689 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-19T04:24:41.689 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-19T04:24:41.689 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_bytes": "104857600", 2024-04-19T04:24:41.689 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_directed_command_retry": "2", 2024-04-19T04:24:41.689 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-19T04:24:41.689 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-19T04:24:41.689 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-19T04:24:41.689 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-19T04:24:41.689 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_parallel": "3", 2024-04-19T04:24:41.690 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_log_interval": "1.000000", 2024-04-19T04:24:41.690 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-19T04:24:41.690 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_ping_interval": "10.000000", 2024-04-19T04:24:41.690 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-19T04:24:41.690 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-19T04:24:41.690 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-19T04:24:41.690 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-19T04:24:41.690 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_file_level": "debug", 2024-04-19T04:24:41.690 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_file": "true", 2024-04-19T04:24:41.690 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-19T04:24:41.690 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-19T04:24:41.690 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-19T04:24:41.690 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_journald": "false", 2024-04-19T04:24:41.690 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-19T04:24:41.691 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-19T04:24:41.691 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-19T04:24:41.691 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-19T04:24:41.691 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_compact_on_bootstrap": "false", 2024-04-19T04:24:41.691 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_compact_on_start": "false", 2024-04-19T04:24:41.691 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_compact_on_trim": "true", 2024-04-19T04:24:41.691 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-19T04:24:41.691 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-19T04:24:41.691 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-19T04:24:41.691 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cpu_threads": "4", 2024-04-19T04:24:41.691 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_crush_min_required_version": "hammer", 2024-04-19T04:24:41.691 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_daemon_bytes": "419430400", 2024-04-19T04:24:41.691 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-19T04:24:41.691 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_data_avail_crit": "5", 2024-04-19T04:24:41.692 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_data_avail_warn": "5", 2024-04-19T04:24:41.692 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_data_size_warn": "16106127360", 2024-04-19T04:24:41.692 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-19T04:24:41.692 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-19T04:24:41.692 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_dump_json": "false", 2024-04-19T04:24:41.692 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-19T04:24:41.692 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_dump_transactions": "false", 2024-04-19T04:24:41.692 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_extra_checks": "false", 2024-04-19T04:24:41.692 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-19T04:24:41.692 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-19T04:24:41.692 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_no_require_quincy": "false", 2024-04-19T04:24:41.692 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_no_require_reef": "false", 2024-04-19T04:24:41.692 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-19T04:24:41.692 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-19T04:24:41.692 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-19T04:24:41.693 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_down_mkfs_grace": "120", 2024-04-19T04:24:41.693 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_election_default_strategy": "1", 2024-04-19T04:24:41.693 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_election_timeout": "5.000000", 2024-04-19T04:24:41.693 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-19T04:24:41.693 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_elector_ping_divisor": "2", 2024-04-19T04:24:41.693 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-19T04:24:41.693 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_enable_op_tracker": "true", 2024-04-19T04:24:41.693 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_fake_pool_delete": "false", 2024-04-19T04:24:41.693 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_force_quorum_join": "false", 2024-04-19T04:24:41.693 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_globalid_prealloc": "10000", 2024-04-19T04:24:41.693 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_detail_to_clog": "false", 2024-04-19T04:24:41.693 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_log_update_period": "5", 2024-04-19T04:24:41.693 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_max_detail": "50", 2024-04-19T04:24:41.693 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_to_clog": "true", 2024-04-19T04:24:41.694 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_to_clog_interval": "600", 2024-04-19T04:24:41.694 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-19T04:24:41.694 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_host": "172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],[v2:172.21.15.7:3302,v1:172.21.15.7:6791]", 2024-04-19T04:24:41.694 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_host_override": "", 2024-04-19T04:24:41.694 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_initial_members": "", 2024-04-19T04:24:41.694 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-19T04:24:41.694 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-19T04:24:41.694 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-19T04:24:41.694 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-19T04:24:41.694 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-19T04:24:41.694 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_lease": "5.000000", 2024-04-19T04:24:41.694 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-19T04:24:41.694 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-19T04:24:41.694 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_log_full_interval": "50", 2024-04-19T04:24:41.695 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_log_max": "10000", 2024-04-19T04:24:41.695 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_log_max_summary": "50", 2024-04-19T04:24:41.695 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-19T04:24:41.695 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_log_epochs": "500", 2024-04-19T04:24:41.695 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-19T04:24:41.695 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-19T04:24:41.695 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_osd": "10000", 2024-04-19T04:24:41.695 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_pg_per_osd": "10000", 2024-04-19T04:24:41.695 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_pool_pg_num": "65536", 2024-04-19T04:24:41.695 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-19T04:24:41.695 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-19T04:24:41.695 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mds_force_trim_to": "0", 2024-04-19T04:24:41.695 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mds_skip_sanity": "false", 2024-04-19T04:24:41.695 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_memory_autotune": "true", 2024-04-19T04:24:41.695 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_memory_target": "2147483648", 2024-04-19T04:24:41.696 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_beacon_grace": "30", 2024-04-19T04:24:41.696 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-19T04:24:41.696 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_digest_period": "5", 2024-04-19T04:24:41.696 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_inactive_grace": "60", 2024-04-19T04:24:41.696 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-19T04:24:41.696 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-19T04:24:41.696 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_min_osdmap_epochs": "500", 2024-04-19T04:24:41.696 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_complaint_time": "30", 2024-04-19T04:24:41.696 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_history_duration": "600", 2024-04-19T04:24:41.696 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_history_size": "20", 2024-04-19T04:24:41.696 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_history_slow_op_size": "20", 2024-04-19T04:24:41.696 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-19T04:24:41.696 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_log_threshold": "5", 2024-04-19T04:24:41.696 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-19T04:24:41.697 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-19T04:24:41.697 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-19T04:24:41.697 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_auto_mark_in": "false", 2024-04-19T04:24:41.697 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-19T04:24:41.697 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-19T04:24:41.697 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-19T04:24:41.697 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_cache_size": "500", 2024-04-19T04:24:41.697 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-19T04:24:41.697 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-19T04:24:41.697 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-19T04:24:41.697 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_down_out_interval": "600", 2024-04-19T04:24:41.697 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-19T04:24:41.697 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-19T04:24:41.697 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_force_trim_to": "0", 2024-04-19T04:24:41.697 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-19T04:24:41.698 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-19T04:24:41.698 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-19T04:24:41.698 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-19T04:24:41.698 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-19T04:24:41.698 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-19T04:24:41.698 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-19T04:24:41.698 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-19T04:24:41.698 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_min_down_reporters": "2", 2024-04-19T04:24:41.698 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-19T04:24:41.698 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-19T04:24:41.698 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-19T04:24:41.698 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-19T04:24:41.698 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-19T04:24:41.698 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-19T04:24:41.699 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_report_timeout": "900", 2024-04-19T04:24:41.699 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-19T04:24:41.699 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-19T04:24:41.699 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-19T04:24:41.699 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-19T04:24:41.699 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-19T04:24:41.699 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-19T04:24:41.699 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-19T04:24:41.699 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-19T04:24:41.699 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-19T04:24:41.699 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_stuck_threshold": "60", 2024-04-19T04:24:41.699 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-19T04:24:41.699 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-19T04:24:41.699 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-19T04:24:41.699 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-19T04:24:41.700 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-19T04:24:41.700 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-19T04:24:41.700 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_probe_timeout": "2.000000", 2024-04-19T04:24:41.700 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_reweight_max_change": "0.050000", 2024-04-19T04:24:41.700 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_reweight_max_osds": "4", 2024-04-19T04:24:41.700 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-19T04:24:41.700 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-19T04:24:41.700 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-19T04:24:41.700 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-19T04:24:41.700 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-19T04:24:41.700 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_interval": "86400", 2024-04-19T04:24:41.700 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_max_keys": "100", 2024-04-19T04:24:41.701 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_timeout": "300", 2024-04-19T04:24:41.701 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_session_timeout": "300", 2024-04-19T04:24:41.701 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_smart_report_timeout": "5", 2024-04-19T04:24:41.701 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stat_smooth_intervals": "6", 2024-04-19T04:24:41.701 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-19T04:24:41.701 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stretch_pool_min_size": "2", 2024-04-19T04:24:41.701 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stretch_pool_size": "4", 2024-04-19T04:24:41.701 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-19T04:24:41.701 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-19T04:24:41.701 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_debug": "false", 2024-04-19T04:24:41.701 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-19T04:24:41.701 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-19T04:24:41.702 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_provider_kill_at": "0", 2024-04-19T04:24:41.702 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_requester_kill_at": "0", 2024-04-19T04:24:41.702 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_timeout": "60.000000", 2024-04-19T04:24:41.702 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_target_pg_per_osd": "100", 2024-04-19T04:24:41.702 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_tick_interval": "5", 2024-04-19T04:24:41.702 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_timecheck_interval": "300.000000", 2024-04-19T04:24:41.702 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-19T04:24:41.702 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_use_min_delay_socket": "false", 2024-04-19T04:24:41.702 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_older_version_delay": "604800", 2024-04-19T04:24:41.702 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-19T04:24:41.702 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-19T04:24:41.702 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-19T04:24:41.702 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-19T04:24:41.703 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-19T04:24:41.703 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-19T04:24:41.703 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-19T04:24:41.703 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_misplaced": "false", 2024-04-19T04:24:41.703 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-19T04:24:41.703 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_older_version": "true", 2024-04-19T04:24:41.703 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-19T04:24:41.703 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-19T04:24:41.703 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-19T04:24:41.703 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-19T04:24:41.703 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-19T04:24:41.703 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-19T04:24:41.703 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-19T04:24:41.703 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-19T04:24:41.703 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-19T04:24:41.704 INFO:teuthology.orchestra.run.smithi007.stdout: "monmap": "", 2024-04-19T04:24:41.704 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-19T04:24:41.704 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-19T04:24:41.704 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-19T04:24:41.704 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-19T04:24:41.704 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-19T04:24:41.704 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-19T04:24:41.704 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_tracing_enabled": "false", 2024-04-19T04:24:41.704 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_op_threads": "3", 2024-04-19T04:24:41.704 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-19T04:24:41.704 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_cm": "false", 2024-04-19T04:24:41.704 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_device_name": "", 2024-04-19T04:24:41.704 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_dscp": "96", 2024-04-19T04:24:41.704 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-19T04:24:41.704 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-19T04:24:41.705 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_local_gid": "", 2024-04-19T04:24:41.705 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-19T04:24:41.705 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_port_num": "1", 2024-04-19T04:24:41.705 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-19T04:24:41.705 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-19T04:24:41.705 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-19T04:24:41.705 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-19T04:24:41.705 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_sl": "3", 2024-04-19T04:24:41.705 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_support_srq": "true", 2024-04-19T04:24:41.705 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_type": "ib", 2024-04-19T04:24:41.705 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_reap_threshold": "5", 2024-04-19T04:24:41.705 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_before_connect": "false", 2024-04-19T04:24:41.705 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_ipv4": "true", 2024-04-19T04:24:41.705 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_ipv6": "false", 2024-04-19T04:24:41.706 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_msgr1": "true", 2024-04-19T04:24:41.706 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_msgr2": "true", 2024-04-19T04:24:41.706 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_port_max": "7568", 2024-04-19T04:24:41.706 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_port_min": "6800", 2024-04-19T04:24:41.706 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-19T04:24:41.706 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_retry_count": "3", 2024-04-19T04:24:41.706 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_retry_delay": "5", 2024-04-19T04:24:41.706 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_client": "false", 2024-04-19T04:24:41.706 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_mds": "false", 2024-04-19T04:24:41.706 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_mgr": "false", 2024-04-19T04:24:41.706 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_mon": "false", 2024-04-19T04:24:41.706 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_osd": "false", 2024-04-19T04:24:41.706 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_client_mode": "crc secure", 2024-04-19T04:24:41.707 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_cluster_mode": "crc secure", 2024-04-19T04:24:41.707 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_cluster_type": "", 2024-04-19T04:24:41.707 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_compress_secure": "false", 2024-04-19T04:24:41.707 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_connection_idle_timeout": "900", 2024-04-19T04:24:41.707 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_connection_ready_timeout": "10", 2024-04-19T04:24:41.707 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_crc_data": "true", 2024-04-19T04:24:41.707 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_crc_header": "true", 2024-04-19T04:24:41.707 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_bad_msg": "false", 2024-04-19T04:24:41.707 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_bug": "true", 2024-04-19T04:24:41.707 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_old_message": "true", 2024-04-19T04:24:41.707 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_skipped_message": "false", 2024-04-19T04:24:41.707 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-19T04:24:41.707 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-19T04:24:41.707 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_coremask": "0xF", 2024-04-19T04:24:41.707 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-19T04:24:41.708 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-19T04:24:41.708 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_enable_tso": "true", 2024-04-19T04:24:41.708 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-19T04:24:41.708 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-19T04:24:41.708 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_hugepages": "", 2024-04-19T04:24:41.708 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-19T04:24:41.708 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-19T04:24:41.708 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_lro": "true", 2024-04-19T04:24:41.708 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_memory_channel": "4", 2024-04-19T04:24:41.708 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-19T04:24:41.708 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_pmd": "", 2024-04-19T04:24:41.708 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_port_id": "0", 2024-04-19T04:24:41.708 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-19T04:24:41.709 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-19T04:24:41.709 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dump_on_send": "false", 2024-04-19T04:24:41.709 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_initial_backoff": "0.200000", 2024-04-19T04:24:41.709 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_delay_max": "1.000000", 2024-04-19T04:24:41.709 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-19T04:24:41.709 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_delay_type": "", 2024-04-19T04:24:41.709 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-19T04:24:41.709 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_network_congestion": "0", 2024-04-19T04:24:41.709 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_socket_failures": "0", 2024-04-19T04:24:41.709 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_learn_addr_from_peer": "true", 2024-04-19T04:24:41.709 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_max_accept_failures": "4", 2024-04-19T04:24:41.709 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_max_backoff": "15.000000", 2024-04-19T04:24:41.709 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_mon_client_mode": "secure crc", 2024-04-19T04:24:41.709 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-19T04:24:41.710 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_mon_service_mode": "secure crc", 2024-04-19T04:24:41.710 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_osd_compress_min_size": "1024", 2024-04-19T04:24:41.710 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_osd_compress_mode": "none", 2024-04-19T04:24:41.710 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-19T04:24:41.710 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-19T04:24:41.710 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_pq_min_cost": "65536", 2024-04-19T04:24:41.710 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_public_type": "", 2024-04-19T04:24:41.711 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_service_mode": "crc secure", 2024-04-19T04:24:41.711 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_tcp_listen_backlog": "512", 2024-04-19T04:24:41.711 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_tcp_nodelay": "true", 2024-04-19T04:24:41.711 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-19T04:24:41.711 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_tcp_rcvbuf": "0", 2024-04-19T04:24:41.711 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_type": "async+posix", 2024-04-19T04:24:41.711 INFO:teuthology.orchestra.run.smithi007.stdout: "no_config_file": "false", 2024-04-19T04:24:41.711 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_completion_locks_per_session": "32", 2024-04-19T04:24:41.711 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-19T04:24:41.711 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-19T04:24:41.712 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_inflight_ops": "1024", 2024-04-19T04:24:41.712 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-19T04:24:41.712 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-19T04:24:41.712 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_tick_interval": "5.000000", 2024-04-19T04:24:41.712 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_timeout": "10.000000", 2024-04-19T04:24:41.712 INFO:teuthology.orchestra.run.smithi007.stdout: "objectstore_blackhole": "false", 2024-04-19T04:24:41.712 INFO:teuthology.orchestra.run.smithi007.stdout: "openssl_engine_opts": "", 2024-04-19T04:24:41.712 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_delay_time": "5.000000", 2024-04-19T04:24:41.712 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_hist_halflife": "1000", 2024-04-19T04:24:41.712 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_max_low_ops": "2", 2024-04-19T04:24:41.712 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_max_ops": "4", 2024-04-19T04:24:41.712 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-19T04:24:41.712 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-19T04:24:41.712 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_slop": "0.020000", 2024-04-19T04:24:41.712 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-19T04:24:41.713 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-19T04:24:41.713 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_asio_thread_count": "2", 2024-04-19T04:24:41.713 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_async_recovery_min_cost": "100", 2024-04-19T04:24:41.713 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-19T04:24:41.713 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-19T04:24:41.713 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backfill_scan_max": "512", 2024-04-19T04:24:41.713 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backfill_scan_min": "64", 2024-04-19T04:24:41.713 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backoff_on_degraded": "false", 2024-04-19T04:24:41.713 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backoff_on_peering": "false", 2024-04-19T04:24:41.713 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backoff_on_unfound": "true", 2024-04-19T04:24:41.713 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_beacon_report_interval": "300", 2024-04-19T04:24:41.713 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bench_duration": "30", 2024-04-19T04:24:41.713 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-19T04:24:41.713 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bench_max_block_size": "67108864", 2024-04-19T04:24:41.713 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-19T04:24:41.714 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_blkin_trace_all": "false", 2024-04-19T04:24:41.714 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-19T04:24:41.714 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-19T04:24:41.714 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-19T04:24:41.714 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-19T04:24:41.714 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_check_for_log_corruption": "false", 2024-04-19T04:24:41.714 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-19T04:24:41.714 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-19T04:24:41.714 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-19T04:24:41.714 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-19T04:24:41.714 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_class_update_on_start": "true", 2024-04-19T04:24:41.714 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_client_message_cap": "256", 2024-04-19T04:24:41.714 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_client_message_size_cap": "524288000", 2024-04-19T04:24:41.715 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_client_op_priority": "63", 2024-04-19T04:24:41.715 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_client_watch_timeout": "30", 2024-04-19T04:24:41.715 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_command_max_records": "256", 2024-04-19T04:24:41.715 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_compact_on_start": "false", 2024-04-19T04:24:41.715 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-19T04:24:41.715 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-19T04:24:41.715 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-19T04:24:41.715 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_crush_update_on_start": "true", 2024-04-19T04:24:41.715 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_crush_update_weight_set": "true", 2024-04-19T04:24:41.715 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-19T04:24:41.715 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-19T04:24:41.715 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-19T04:24:41.715 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-19T04:24:41.715 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-19T04:24:41.716 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_feed_pullee": "-1", 2024-04-19T04:24:41.716 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-19T04:24:41.716 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-19T04:24:41.716 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-19T04:24:41.716 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_misdirected_ops": "false", 2024-04-19T04:24:41.716 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_no_acting_change": "false", 2024-04-19T04:24:41.716 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_no_purge_strays": "false", 2024-04-19T04:24:41.716 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_op_order": "false", 2024-04-19T04:24:41.716 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-19T04:24:41.716 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-19T04:24:41.716 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-19T04:24:41.716 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-19T04:24:41.716 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_shutdown": "false", 2024-04-19T04:24:41.716 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-19T04:24:41.717 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-19T04:24:41.717 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-19T04:24:41.717 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-19T04:24:41.717 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_verify_snaps": "false", 2024-04-19T04:24:41.717 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-19T04:24:41.717 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-19T04:24:41.717 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_keys": "1024", 2024-04-19T04:24:41.717 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-19T04:24:41.717 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-19T04:24:41.717 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-19T04:24:41.717 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_stride": "524288", 2024-04-19T04:24:41.717 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-19T04:24:41.717 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-19T04:24:41.717 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_default_notify_timeout": "30", 2024-04-19T04:24:41.717 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_delete_sleep": "0.000000", 2024-04-19T04:24:41.718 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-19T04:24:41.718 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-19T04:24:41.718 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-19T04:24:41.718 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_discard_disconnected_ops": "true", 2024-04-19T04:24:41.718 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_enable_op_tracker": "true", 2024-04-19T04:24:41.718 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-19T04:24:41.718 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-19T04:24:41.718 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-19T04:24:41.718 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-19T04:24:41.718 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_info": "true", 2024-04-19T04:24:41.718 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_shutdown": "true", 2024-04-19T04:24:41.718 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-19T04:24:41.718 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-19T04:24:41.718 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-19T04:24:41.719 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-19T04:24:41.719 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-19T04:24:41.719 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_function_tracing": "false", 2024-04-19T04:24:41.719 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_grace": "20", 2024-04-19T04:24:41.719 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_interval": "6", 2024-04-19T04:24:41.719 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-19T04:24:41.719 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_min_peers": "10", 2024-04-19T04:24:41.719 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_min_size": "2000", 2024-04-19T04:24:41.719 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_stale": "600", 2024-04-19T04:24:41.719 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-19T04:24:41.719 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_hit_set_max_size": "100000", 2024-04-19T04:24:41.719 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_hit_set_min_size": "1000", 2024-04-19T04:24:41.719 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-19T04:24:41.719 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-19T04:24:41.720 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-19T04:24:41.720 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-19T04:24:41.720 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-19T04:24:41.720 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-19T04:24:41.720 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_journal_size": "5120", 2024-04-19T04:24:41.720 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_kill_backfill_at": "0", 2024-04-19T04:24:41.720 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-19T04:24:41.720 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_cache_size": "50", 2024-04-19T04:24:41.720 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_dedup": "true", 2024-04-19T04:24:41.720 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_message_max": "40", 2024-04-19T04:24:41.720 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-19T04:24:41.720 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_share_max_epochs": "40", 2024-04-19T04:24:41.720 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_attr_name_len": "100", 2024-04-19T04:24:41.720 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_attr_size": "0", 2024-04-19T04:24:41.720 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_backfills": "1", 2024-04-19T04:24:41.721 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_markdown_count": "5", 2024-04-19T04:24:41.721 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_markdown_period": "600", 2024-04-19T04:24:41.721 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_object_name_len": "2048", 2024-04-19T04:24:41.721 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_object_namespace_len": "256", 2024-04-19T04:24:41.721 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_object_size": "134217728", 2024-04-19T04:24:41.721 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-19T04:24:41.721 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-19T04:24:41.721 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_pg_blocked_by": "16", 2024-04-19T04:24:41.721 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_pg_log_entries": "10000", 2024-04-19T04:24:41.721 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-19T04:24:41.721 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_pgls": "1024", 2024-04-19T04:24:41.721 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_push_cost": "8388608", 2024-04-19T04:24:41.721 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_push_objects": "10", 2024-04-19T04:24:41.721 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_scrubs": "3", 2024-04-19T04:24:41.721 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-19T04:24:41.722 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_trimming_pgs": "2", 2024-04-19T04:24:41.722 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_write_op_reply_len": "64", 2024-04-19T04:24:41.722 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_write_size": "90", 2024-04-19T04:24:41.722 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-19T04:24:41.722 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-19T04:24:41.722 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-19T04:24:41.722 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-19T04:24:41.722 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-19T04:24:41.722 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-19T04:24:41.722 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-19T04:24:41.722 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-19T04:24:41.722 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_profile": "balanced", 2024-04-19T04:24:41.722 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-19T04:24:41.723 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-19T04:24:41.723 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-19T04:24:41.723 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-19T04:24:41.723 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-19T04:24:41.723 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-19T04:24:41.723 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-19T04:24:41.723 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-19T04:24:41.723 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-19T04:24:41.723 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-19T04:24:41.723 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-19T04:24:41.723 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_base": "805306368", 2024-04-19T04:24:41.723 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_cache_min": "134217728", 2024-04-19T04:24:41.723 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-19T04:24:41.723 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-19T04:24:41.723 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_target": "4294967296", 2024-04-19T04:24:41.724 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_target_autotune": "false", 2024-04-19T04:24:41.724 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-19T04:24:41.724 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_min_pg_log_entries": "250", 2024-04-19T04:24:41.724 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_min_recovery_priority": "0", 2024-04-19T04:24:41.724 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-19T04:24:41.724 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-19T04:24:41.724 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_report_interval": "5", 2024-04-19T04:24:41.724 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-19T04:24:41.724 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-19T04:24:41.724 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_num_cache_shards": "32", 2024-04-19T04:24:41.724 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_num_op_tracker_shard": "32", 2024-04-19T04:24:41.724 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_numa_auto_affinity": "true", 2024-04-19T04:24:41.724 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_numa_node": "-1", 2024-04-19T04:24:41.724 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_numa_prefer_iface": "true", 2024-04-19T04:24:41.725 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-19T04:24:41.725 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_objecter_finishers": "1", 2024-04-19T04:24:41.725 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_objectstore": "bluestore", 2024-04-19T04:24:41.725 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_objectstore_fuse": "false", 2024-04-19T04:24:41.725 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_objectstore_tracing": "false", 2024-04-19T04:24:41.725 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_complaint_time": "30.000000", 2024-04-19T04:24:41.725 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_history_duration": "600", 2024-04-19T04:24:41.725 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_history_size": "20", 2024-04-19T04:24:41.725 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_history_slow_op_size": "20", 2024-04-19T04:24:41.725 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-19T04:24:41.725 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_log_threshold": "5", 2024-04-19T04:24:41.725 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_shards": "0", 2024-04-19T04:24:41.725 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_shards_hdd": "5", 2024-04-19T04:24:41.725 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_shards_ssd": "8", 2024-04-19T04:24:41.726 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-19T04:24:41.726 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-19T04:24:41.726 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-19T04:24:41.726 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-19T04:24:41.726 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_pq_min_cost": "65536", 2024-04-19T04:24:41.726 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-19T04:24:41.726 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_queue_cut_off": "high", 2024-04-19T04:24:41.726 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-19T04:24:41.726 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_thread_timeout": "15", 2024-04-19T04:24:41.726 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_open_classes_on_start": "true", 2024-04-19T04:24:41.726 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_os_flags": "0", 2024-04-19T04:24:41.726 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_peering_op_priority": "255", 2024-04-19T04:24:41.726 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_delete_cost": "1048576", 2024-04-19T04:24:41.726 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_delete_priority": "5", 2024-04-19T04:24:41.727 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-19T04:24:41.727 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-19T04:24:41.727 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-19T04:24:41.727 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_log_trim_max": "10000", 2024-04-19T04:24:41.727 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_log_trim_min": "100", 2024-04-19T04:24:41.727 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-19T04:24:41.727 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-19T04:24:41.727 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_stat_report_interval_max": "500", 2024-04-19T04:24:41.727 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-19T04:24:41.727 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-19T04:24:41.727 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-19T04:24:41.727 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-19T04:24:41.727 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-19T04:24:41.727 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-19T04:24:41.728 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_crimson": "false", 2024-04-19T04:24:41.728 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-19T04:24:41.728 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-19T04:24:41.728 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-19T04:24:41.728 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-19T04:24:41.728 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-19T04:24:41.728 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-19T04:24:41.728 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-19T04:24:41.728 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-19T04:24:41.728 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flags": "0", 2024-04-19T04:24:41.728 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-19T04:24:41.728 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_min_size": "0", 2024-04-19T04:24:41.728 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-19T04:24:41.728 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_pg_num": "32", 2024-04-19T04:24:41.728 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_pgp_num": "0", 2024-04-19T04:24:41.729 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-19T04:24:41.729 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_size": "2", 2024-04-19T04:24:41.729 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_type": "replicated", 2024-04-19T04:24:41.729 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-19T04:24:41.729 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-19T04:24:41.729 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_push_per_object_cost": "1000", 2024-04-19T04:24:41.729 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-19T04:24:41.729 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recover_clone_overlap": "true", 2024-04-19T04:24:41.729 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-19T04:24:41.729 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_cost": "20971520", 2024-04-19T04:24:41.729 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-19T04:24:41.729 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_active": "0", 2024-04-19T04:24:41.729 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-19T04:24:41.729 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-19T04:24:41.729 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-19T04:24:41.730 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-19T04:24:41.730 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_single_start": "1", 2024-04-19T04:24:41.730 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_op_priority": "3", 2024-04-19T04:24:41.730 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-19T04:24:41.730 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_priority": "5", 2024-04-19T04:24:41.730 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-19T04:24:41.730 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_sleep": "0.000000", 2024-04-19T04:24:41.730 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-19T04:24:41.730 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-19T04:24:41.730 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-19T04:24:41.730 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_repair_during_recovery": "false", 2024-04-19T04:24:41.730 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_requested_scrub_priority": "120", 2024-04-19T04:24:41.730 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-19T04:24:41.731 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-19T04:24:41.731 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_auto_repair": "false", 2024-04-19T04:24:41.731 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-19T04:24:41.731 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-19T04:24:41.731 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_begin_hour": "0", 2024-04-19T04:24:41.731 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_begin_week_day": "0", 2024-04-19T04:24:41.731 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_chunk_max": "25", 2024-04-19T04:24:41.731 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_chunk_min": "5", 2024-04-19T04:24:41.731 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_cost": "52428800", 2024-04-19T04:24:41.731 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_during_recovery": "false", 2024-04-19T04:24:41.731 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_end_hour": "0", 2024-04-19T04:24:41.731 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_end_week_day": "0", 2024-04-19T04:24:41.731 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_event_cost": "4096", 2024-04-19T04:24:41.731 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-19T04:24:41.732 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-19T04:24:41.732 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_invalid_stats": "true", 2024-04-19T04:24:41.732 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-19T04:24:41.732 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-19T04:24:41.732 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_max_preemptions": "5", 2024-04-19T04:24:41.732 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-19T04:24:41.732 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_priority": "5", 2024-04-19T04:24:41.732 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_reservation_timeout": "5000", 2024-04-19T04:24:41.732 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_sleep": "0.000000", 2024-04-19T04:24:41.732 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-04-19T04:24:41.732 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-19T04:24:41.732 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-19T04:24:41.732 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-19T04:24:41.732 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_skip_data_digest": "false", 2024-04-19T04:24:41.733 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_smart_report_timeout": "5", 2024-04-19T04:24:41.733 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_cost": "1048576", 2024-04-19T04:24:41.733 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_priority": "5", 2024-04-19T04:24:41.733 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-19T04:24:41.733 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-19T04:24:41.733 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-19T04:24:41.733 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-19T04:24:41.733 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-19T04:24:41.733 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-19T04:24:41.733 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-19T04:24:41.733 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_target_transaction_size": "30", 2024-04-19T04:24:41.733 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-19T04:24:41.733 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-19T04:24:41.733 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-19T04:24:41.733 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-19T04:24:41.734 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-19T04:24:41.734 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-19T04:24:41.734 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-19T04:24:41.734 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-19T04:24:41.734 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-19T04:24:41.734 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-19T04:24:41.734 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tracing": "false", 2024-04-19T04:24:41.734 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_use_stale_snap": "false", 2024-04-19T04:24:41.734 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-19T04:24:41.734 INFO:teuthology.orchestra.run.smithi007.stdout: "osdc_blkin_trace_all": "false", 2024-04-19T04:24:41.734 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_kill_at": "0", 2024-04-19T04:24:41.734 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_max_join_drift": "10", 2024-04-19T04:24:41.734 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_min": "500", 2024-04-19T04:24:41.735 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_min_wait": "0.050000", 2024-04-19T04:24:41.735 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_propose_interval": "1.000000", 2024-04-19T04:24:41.735 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_service_trim_max": "500", 2024-04-19T04:24:41.735 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-19T04:24:41.735 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_service_trim_min": "250", 2024-04-19T04:24:41.735 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_stash_full_interval": "25", 2024-04-19T04:24:41.735 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_trim_max": "500", 2024-04-19T04:24:41.735 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_trim_min": "250", 2024-04-19T04:24:41.735 INFO:teuthology.orchestra.run.smithi007.stdout: "perf": "true", 2024-04-19T04:24:41.735 INFO:teuthology.orchestra.run.smithi007.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-19T04:24:41.735 INFO:teuthology.orchestra.run.smithi007.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-19T04:24:41.735 INFO:teuthology.orchestra.run.smithi007.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-19T04:24:41.735 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "-", 2024-04-19T04:24:41.735 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrv": "", 2024-04-19T04:24:41.736 INFO:teuthology.orchestra.run.smithi007.stdout: "public_bind_addr": "-", 2024-04-19T04:24:41.736 INFO:teuthology.orchestra.run.smithi007.stdout: "public_network": "", 2024-04-19T04:24:41.736 INFO:teuthology.orchestra.run.smithi007.stdout: "public_network_interface": "", 2024-04-19T04:24:41.736 INFO:teuthology.orchestra.run.smithi007.stdout: "qat_compressor_enabled": "false", 2024-04-19T04:24:41.736 INFO:teuthology.orchestra.run.smithi007.stdout: "qat_compressor_session_max_number": "256", 2024-04-19T04:24:41.736 INFO:teuthology.orchestra.run.smithi007.stdout: "rados_mon_op_timeout": "0", 2024-04-19T04:24:41.736 INFO:teuthology.orchestra.run.smithi007.stdout: "rados_osd_op_timeout": "0", 2024-04-19T04:24:41.736 INFO:teuthology.orchestra.run.smithi007.stdout: "rados_tracing": "false", 2024-04-19T04:24:41.736 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_atime_update_interval": "60", 2024-04-19T04:24:41.736 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-19T04:24:41.736 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_balance_parent_reads": "false", 2024-04-19T04:24:41.736 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_balance_snap_reads": "false", 2024-04-19T04:24:41.736 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_blkin_trace_all": "false", 2024-04-19T04:24:41.736 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-19T04:24:41.736 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-19T04:24:41.737 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache": "true", 2024-04-19T04:24:41.737 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-19T04:24:41.737 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-19T04:24:41.737 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-19T04:24:41.737 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-19T04:24:41.737 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_policy": "writearound", 2024-04-19T04:24:41.737 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_size": "33554432", 2024-04-19T04:24:41.737 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-19T04:24:41.737 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-19T04:24:41.737 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_clone_copy_on_read": "false", 2024-04-19T04:24:41.737 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_compression_hint": "none", 2024-04-19T04:24:41.737 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_concurrent_management_ops": "10", 2024-04-19T04:24:41.737 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-19T04:24:41.737 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_clone_format": "auto", 2024-04-19T04:24:41.738 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_data_pool": "", 2024-04-19T04:24:41.738 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_features": "61", 2024-04-19T04:24:41.738 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_format": "2", 2024-04-19T04:24:41.738 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_map_options": "", 2024-04-19T04:24:41.738 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_order": "22", 2024-04-19T04:24:41.738 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_pool": "rbd", 2024-04-19T04:24:41.738 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-19T04:24:41.738 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_stripe_count": "0", 2024-04-19T04:24:41.738 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_stripe_unit": "0", 2024-04-19T04:24:41.738 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-19T04:24:41.738 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-19T04:24:41.738 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-19T04:24:41.738 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_enable_alloc_hint": "true", 2024-04-19T04:24:41.739 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-19T04:24:41.739 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_io_scheduler": "simple", 2024-04-19T04:24:41.739 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-19T04:24:41.739 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-19T04:24:41.739 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-19T04:24:41.739 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-19T04:24:41.739 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-19T04:24:41.739 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-19T04:24:41.739 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-19T04:24:41.739 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-19T04:24:41.739 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-19T04:24:41.739 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_order": "24", 2024-04-19T04:24:41.739 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_pool": "", 2024-04-19T04:24:41.739 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_splay_width": "4", 2024-04-19T04:24:41.740 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_localize_parent_reads": "false", 2024-04-19T04:24:41.740 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_localize_snap_reads": "false", 2024-04-19T04:24:41.740 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-19T04:24:41.740 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-19T04:24:41.740 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-19T04:24:41.740 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-19T04:24:41.740 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-19T04:24:41.740 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-19T04:24:41.740 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-19T04:24:41.740 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-19T04:24:41.740 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-19T04:24:41.740 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-19T04:24:41.740 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-19T04:24:41.740 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-19T04:24:41.740 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-19T04:24:41.741 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-19T04:24:41.741 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-19T04:24:41.741 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-19T04:24:41.741 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-19T04:24:41.741 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-19T04:24:41.741 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-19T04:24:41.741 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-19T04:24:41.741 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-19T04:24:41.741 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-19T04:24:41.741 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-19T04:24:41.741 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-19T04:24:41.741 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-19T04:24:41.741 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-19T04:24:41.741 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-19T04:24:41.742 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-19T04:24:41.742 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-19T04:24:41.742 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-19T04:24:41.742 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-19T04:24:41.742 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mtime_update_interval": "60", 2024-04-19T04:24:41.742 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_non_blocking_aio": "true", 2024-04-19T04:24:41.742 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_op_thread_timeout": "60", 2024-04-19T04:24:41.742 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_op_threads": "1", 2024-04-19T04:24:41.742 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_parent_cache_enabled": "false", 2024-04-19T04:24:41.742 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-19T04:24:41.742 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-19T04:24:41.742 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-19T04:24:41.742 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_plugins": "", 2024-04-19T04:24:41.742 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_bps_burst": "0", 2024-04-19T04:24:41.743 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-19T04:24:41.743 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_bps_limit": "0", 2024-04-19T04:24:41.743 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_exclude_ops": "0", 2024-04-19T04:24:41.743 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_iops_burst": "0", 2024-04-19T04:24:41.743 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-19T04:24:41.743 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_iops_limit": "0", 2024-04-19T04:24:41.743 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-19T04:24:41.743 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-19T04:24:41.743 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-19T04:24:41.743 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-19T04:24:41.743 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-19T04:24:41.743 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-19T04:24:41.743 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-19T04:24:41.743 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-19T04:24:41.743 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-19T04:24:41.744 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-19T04:24:41.744 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-19T04:24:41.744 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-19T04:24:41.744 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-19T04:24:41.744 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-19T04:24:41.744 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_read_from_replica_policy": "default", 2024-04-19T04:24:41.744 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-19T04:24:41.744 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-19T04:24:41.744 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-19T04:24:41.744 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-19T04:24:41.744 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_skip_partial_discard": "true", 2024-04-19T04:24:41.744 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-19T04:24:41.744 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_tracing": "false", 2024-04-19T04:24:41.744 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_validate_names": "true", 2024-04-19T04:24:41.744 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_validate_pool": "true", 2024-04-19T04:24:41.745 INFO:teuthology.orchestra.run.smithi007.stdout: "restapi_base_url": "", 2024-04-19T04:24:41.745 INFO:teuthology.orchestra.run.smithi007.stdout: "restapi_log_level": "", 2024-04-19T04:24:41.745 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_acl_grants_max_num": "100", 2024-04-19T04:24:41.745 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_admin_entry": "admin", 2024-04-19T04:24:41.745 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-19T04:24:41.745 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_backend_store": "rados", 2024-04-19T04:24:41.745 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_barbican_url": "", 2024-04-19T04:24:41.745 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_beast_enable_async": "true", 2024-04-19T04:24:41.745 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-19T04:24:41.745 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-19T04:24:41.745 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-19T04:24:41.745 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-19T04:24:41.745 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-19T04:24:41.745 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-19T04:24:41.745 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-19T04:24:41.746 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cache_enabled": "true", 2024-04-19T04:24:41.746 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cache_expiry_interval": "900", 2024-04-19T04:24:41.746 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cache_lru_size": "10000", 2024-04-19T04:24:41.746 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_config_store": "rados", 2024-04-19T04:24:41.746 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_content_length_compat": "false", 2024-04-19T04:24:41.746 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_copy_obj_progress": "true", 2024-04-19T04:24:41.746 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-19T04:24:41.746 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cors_rules_max_num": "100", 2024-04-19T04:24:41.746 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cross_domain_policy": "", 2024-04-19T04:24:41.746 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-19T04:24:41.746 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_addr": "", 2024-04-19T04:24:41.746 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-19T04:24:41.746 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-19T04:24:41.747 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-19T04:24:41.747 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-19T04:24:41.747 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_password": "", 2024-04-19T04:24:41.747 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-19T04:24:41.747 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_username": "", 2024-04-19T04:24:41.747 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_require_ssl": "true", 2024-04-19T04:24:41.747 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-19T04:24:41.747 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-19T04:24:41.747 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-19T04:24:41.747 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-19T04:24:41.747 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-19T04:24:41.747 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-19T04:24:41.747 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-19T04:24:41.747 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-19T04:24:41.748 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-19T04:24:41.748 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-19T04:24:41.748 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-19T04:24:41.748 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-19T04:24:41.748 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-19T04:24:41.748 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-19T04:24:41.748 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-19T04:24:41.748 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_addr": "", 2024-04-19T04:24:41.748 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_auth": "token", 2024-04-19T04:24:41.748 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_namespace": "", 2024-04-19T04:24:41.748 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_prefix": "", 2024-04-19T04:24:41.748 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-19T04:24:41.748 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-19T04:24:41.748 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-19T04:24:41.749 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-19T04:24:41.749 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_token_file": "", 2024-04-19T04:24:41.749 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-19T04:24:41.749 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_buffersize": "524288", 2024-04-19T04:24:41.749 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-19T04:24:41.749 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_low_speed_time": "300", 2024-04-19T04:24:41.749 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-19T04:24:41.749 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-19T04:24:41.749 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-19T04:24:41.749 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-19T04:24:41.749 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-19T04:24:41.749 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-19T04:24:41.749 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-19T04:24:41.749 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-19T04:24:41.749 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-19T04:24:41.750 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-19T04:24:41.750 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-19T04:24:41.750 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_log_changes_size": "1000", 2024-04-19T04:24:41.750 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_log_num_shards": "128", 2024-04-19T04:24:41.750 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-19T04:24:41.750 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_log_window": "30", 2024-04-19T04:24:41.750 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-19T04:24:41.750 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-19T04:24:41.750 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-19T04:24:41.750 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-19T04:24:41.750 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-19T04:24:41.750 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-19T04:24:41.750 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-19T04:24:41.751 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-19T04:24:41.751 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-19T04:24:41.751 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-19T04:24:41.751 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-19T04:24:41.751 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-19T04:24:41.751 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-19T04:24:41.751 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-19T04:24:41.751 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-19T04:24:41.751 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-19T04:24:41.751 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-19T04:24:41.751 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-19T04:24:41.751 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-19T04:24:41.751 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-19T04:24:41.751 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-19T04:24:41.752 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-19T04:24:41.752 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-19T04:24:41.752 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-19T04:24:41.752 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dns_name": "", 2024-04-19T04:24:41.752 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dns_s3website_name": "", 2024-04-19T04:24:41.752 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dynamic_resharding": "true", 2024-04-19T04:24:41.752 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-19T04:24:41.752 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_gc_threads": "true", 2024-04-19T04:24:41.752 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_lc_threads": "true", 2024-04-19T04:24:41.752 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_ops_log": "false", 2024-04-19T04:24:41.752 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_quota_threads": "true", 2024-04-19T04:24:41.752 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_static_website": "false", 2024-04-19T04:24:41.752 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_usage_log": "false", 2024-04-19T04:24:41.752 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enforce_swift_acls": "true", 2024-04-19T04:24:41.752 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_exit_timeout_secs": "120", 2024-04-19T04:24:41.753 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_expose_bucket": "false", 2024-04-19T04:24:41.753 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_extended_http_attrs": "", 2024-04-19T04:24:41.753 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_filter": "none", 2024-04-19T04:24:41.753 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-19T04:24:41.753 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_frontends": "beast port=7480", 2024-04-19T04:24:41.753 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-19T04:24:41.753 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_deferred": "50", 2024-04-19T04:24:41.753 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-19T04:24:41.753 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_objs": "32", 2024-04-19T04:24:41.753 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-19T04:24:41.753 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-19T04:24:41.753 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-19T04:24:41.753 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-19T04:24:41.753 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_processor_period": "3600", 2024-04-19T04:24:41.753 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-19T04:24:41.754 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-19T04:24:41.754 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-19T04:24:41.754 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-19T04:24:41.754 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_init_timeout": "300", 2024-04-19T04:24:41.754 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-19T04:24:41.754 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-19T04:24:41.754 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-19T04:24:41.754 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-19T04:24:41.754 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_domain": "", 2024-04-19T04:24:41.754 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_password": "", 2024-04-19T04:24:41.754 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_password_path": "", 2024-04-19T04:24:41.754 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_project": "", 2024-04-19T04:24:41.754 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_tenant": "", 2024-04-19T04:24:41.754 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_token": "", 2024-04-19T04:24:41.755 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_token_path": "", 2024-04-19T04:24:41.755 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_user": "", 2024-04-19T04:24:41.755 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_api_version": "2", 2024-04-19T04:24:41.755 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_domain": "", 2024-04-19T04:24:41.755 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_password": "", 2024-04-19T04:24:41.755 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_project": "", 2024-04-19T04:24:41.755 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-19T04:24:41.755 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_user": "", 2024-04-19T04:24:41.755 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-19T04:24:41.755 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-19T04:24:41.755 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-19T04:24:41.755 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-19T04:24:41.755 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-19T04:24:41.755 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_url": "", 2024-04-19T04:24:41.756 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-19T04:24:41.756 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_debug_interval": "-1", 2024-04-19T04:24:41.756 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_lock_max_time": "90", 2024-04-19T04:24:41.756 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_max_objs": "32", 2024-04-19T04:24:41.756 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_max_rules": "1000", 2024-04-19T04:24:41.756 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_max_worker": "3", 2024-04-19T04:24:41.756 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-19T04:24:41.756 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_thread_delay": "0", 2024-04-19T04:24:41.756 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-19T04:24:41.756 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_dnattr": "uid", 2024-04-19T04:24:41.756 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-19T04:24:41.756 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_searchfilter": "", 2024-04-19T04:24:41.756 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-19T04:24:41.756 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-19T04:24:41.756 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-19T04:24:41.756 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-19T04:24:41.757 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-19T04:24:41.757 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_log_http_headers": "", 2024-04-19T04:24:41.757 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-19T04:24:41.757 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-19T04:24:41.757 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_log_object_name_utc": "false", 2024-04-19T04:24:41.757 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-04-19T04:24:41.757 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_attr_name_len": "0", 2024-04-19T04:24:41.757 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_attr_size": "0", 2024-04-19T04:24:41.757 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-19T04:24:41.757 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_chunk_size": "4194304", 2024-04-19T04:24:41.757 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-19T04:24:41.757 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-19T04:24:41.757 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-19T04:24:41.757 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_listing_results": "1000", 2024-04-19T04:24:41.758 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_notify_retries": "10", 2024-04-19T04:24:41.758 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-19T04:24:41.758 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_put_param_size": "1048576", 2024-04-19T04:24:41.758 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_put_size": "5368709120", 2024-04-19T04:24:41.758 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_slo_entries": "1000", 2024-04-19T04:24:41.758 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_md_log_max_shards": "64", 2024-04-19T04:24:41.758 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-19T04:24:41.758 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-19T04:24:41.758 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-19T04:24:41.758 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-19T04:24:41.758 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_mp_lock_max_time": "600", 2024-04-19T04:24:41.758 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-19T04:24:41.758 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-19T04:24:41.759 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-19T04:24:41.759 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-19T04:24:41.759 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-19T04:24:41.759 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-19T04:24:41.759 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-19T04:24:41.759 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-19T04:24:41.759 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_max_gc": "300", 2024-04-19T04:24:41.759 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-19T04:24:41.759 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-19T04:24:41.759 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-19T04:24:41.759 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-19T04:24:41.759 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-19T04:24:41.759 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-19T04:24:41.759 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-19T04:24:41.759 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_num_async_rados_threads": "32", 2024-04-19T04:24:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_num_control_oids": "8", 2024-04-19T04:24:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_numa_node": "-1", 2024-04-19T04:24:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-19T04:24:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-19T04:24:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_objexp_chunk_size": "100", 2024-04-19T04:24:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_objexp_gc_interval": "600", 2024-04-19T04:24:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-19T04:24:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-19T04:24:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-19T04:24:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_op_thread_timeout": "600", 2024-04-19T04:24:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_op_tracing": "false", 2024-04-19T04:24:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_opa_token": "", 2024-04-19T04:24:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_opa_url": "", 2024-04-19T04:24:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_opa_verify_ssl": "true", 2024-04-19T04:24:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-19T04:24:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-19T04:24:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ops_log_rados": "false", 2024-04-19T04:24:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ops_log_socket_path": "", 2024-04-19T04:24:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-19T04:24:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-19T04:24:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-19T04:24:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_period_push_interval": "2.000000", 2024-04-19T04:24:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-19T04:24:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-19T04:24:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-19T04:24:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_print_continue": "true", 2024-04-19T04:24:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-19T04:24:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-19T04:24:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-19T04:24:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-19T04:24:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-19T04:24:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_rados_tracing": "false", 2024-04-19T04:24:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_realm": "", 2024-04-19T04:24:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_realm_id": "", 2024-04-19T04:24:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-19T04:24:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_region": "", 2024-04-19T04:24:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-19T04:24:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-19T04:24:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-19T04:24:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-19T04:24:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_request_uri": "", 2024-04-19T04:24:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_batch_size": "64", 2024-04-19T04:24:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-19T04:24:41.763 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_max_aio": "128", 2024-04-19T04:24:41.763 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_num_logs": "16", 2024-04-19T04:24:41.763 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_thread_interval": "600", 2024-04-19T04:24:41.763 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_resolve_cname": "false", 2024-04-19T04:24:41.763 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-19T04:24:41.763 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_run_sync_thread": "true", 2024-04-19T04:24:41.763 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-19T04:24:41.764 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-19T04:24:41.764 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-19T04:24:41.764 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-19T04:24:41.764 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-19T04:24:41.764 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-19T04:24:41.764 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-19T04:24:41.765 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-19T04:24:41.765 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_scheduler_type": "throttler", 2024-04-19T04:24:41.765 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_script_uri": "", 2024-04-19T04:24:41.765 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_service_provider_name": "", 2024-04-19T04:24:41.765 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-19T04:24:41.765 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_client_id": "", 2024-04-19T04:24:41.765 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_client_secret": "", 2024-04-19T04:24:41.765 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_entry": "sts", 2024-04-19T04:24:41.765 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_key": "sts", 2024-04-19T04:24:41.765 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-19T04:24:41.765 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_min_session_duration": "900", 2024-04-19T04:24:41.765 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_token_introspection_url": "", 2024-04-19T04:24:41.765 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_account_in_url": "false", 2024-04-19T04:24:41.766 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_auth_entry": "auth", 2024-04-19T04:24:41.766 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_auth_url": "", 2024-04-19T04:24:41.766 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_custom_header": "", 2024-04-19T04:24:41.766 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-19T04:24:41.766 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_need_stats": "true", 2024-04-19T04:24:41.766 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_tenant_name": "", 2024-04-19T04:24:41.766 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_token_expiration": "86400", 2024-04-19T04:24:41.766 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_url": "", 2024-04-19T04:24:41.767 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_url_prefix": "swift", 2024-04-19T04:24:41.767 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-19T04:24:41.767 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-19T04:24:41.767 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-19T04:24:41.767 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_lease_period": "120", 2024-04-19T04:24:41.767 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-19T04:24:41.767 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-19T04:24:41.768 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-19T04:24:41.768 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-19T04:24:41.768 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-19T04:24:41.768 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-19T04:24:41.768 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-19T04:24:41.768 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-19T04:24:41.768 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-19T04:24:41.768 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_thread_pool_size": "512", 2024-04-19T04:24:41.769 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_comment": "", 2024-04-19T04:24:41.769 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_createby": "", 2024-04-19T04:24:41.769 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_encoding": "", 2024-04-19T04:24:41.769 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_flag": "false", 2024-04-19T04:24:41.769 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_origin": "", 2024-04-19T04:24:41.769 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-19T04:24:41.770 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_tracker": "", 2024-04-19T04:24:41.770 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_trust_forwarded_https": "false", 2024-04-19T04:24:41.770 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-19T04:24:41.770 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-19T04:24:41.770 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_usage_max_shards": "32", 2024-04-19T04:24:41.770 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_usage_max_user_shards": "1", 2024-04-19T04:24:41.770 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_use_opa_authz": "false", 2024-04-19T04:24:41.771 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-19T04:24:41.771 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-19T04:24:41.771 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_max_buckets": "1000", 2024-04-19T04:24:41.771 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_policies_max_num": "100", 2024-04-19T04:24:41.771 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-19T04:24:41.771 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-19T04:24:41.771 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-19T04:24:41.772 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-19T04:24:41.772 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_unique_email": "true", 2024-04-19T04:24:41.772 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_verify_ssl": "true", 2024-04-19T04:24:41.772 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-19T04:24:41.772 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zone": "", 2024-04-19T04:24:41.772 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zone_id": "", 2024-04-19T04:24:41.772 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-19T04:24:41.772 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zonegroup": "", 2024-04-19T04:24:41.773 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zonegroup_id": "", 2024-04-19T04:24:41.773 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-19T04:24:41.773 INFO:teuthology.orchestra.run.smithi007.stdout: "rgwlc_auto_session_clear": "true", 2024-04-19T04:24:41.773 INFO:teuthology.orchestra.run.smithi007.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-19T04:24:41.773 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_block_size": "4096", 2024-04-19T04:24:41.773 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-19T04:24:41.773 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-19T04:24:41.773 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-19T04:24:41.774 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-19T04:24:41.774 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-19T04:24:41.774 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_size": "536870912", 2024-04-19T04:24:41.774 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-19T04:24:41.774 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-19T04:24:41.774 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-19T04:24:41.775 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-19T04:24:41.775 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-19T04:24:41.775 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-19T04:24:41.775 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-19T04:24:41.775 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-19T04:24:41.775 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_index_type": "binary_search", 2024-04-19T04:24:41.775 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-19T04:24:41.776 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-19T04:24:41.776 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_partition_filters": "false", 2024-04-19T04:24:41.776 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_perf": "false", 2024-04-19T04:24:41.776 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-19T04:24:41.776 INFO:teuthology.orchestra.run.smithi007.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-19T04:24:41.776 INFO:teuthology.orchestra.run.smithi007.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-19T04:24:41.776 INFO:teuthology.orchestra.run.smithi007.stdout: "run_dir": "/var/run/ceph", 2024-04-19T04:24:41.777 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_block_create": "true", 2024-04-19T04:24:41.777 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_cache_lru_size": "67108864", 2024-04-19T04:24:41.777 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-19T04:24:41.777 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_default_max_object_size": "16777216", 2024-04-19T04:24:41.777 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-19T04:24:41.777 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_device_size": "53687091200", 2024-04-19T04:24:41.778 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_journal_batch_capacity": "16", 2024-04-19T04:24:41.778 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-19T04:24:41.778 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-19T04:24:41.778 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-19T04:24:41.778 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_main_device_type": "SSD", 2024-04-19T04:24:41.778 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-19T04:24:41.778 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-19T04:24:41.778 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-19T04:24:41.778 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-19T04:24:41.778 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-19T04:24:41.779 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_segment_size": "67108864", 2024-04-19T04:24:41.779 INFO:teuthology.orchestra.run.smithi007.stdout: "set_keepcaps": "false", 2024-04-19T04:24:41.779 INFO:teuthology.orchestra.run.smithi007.stdout: "setgroup": "", 2024-04-19T04:24:41.779 INFO:teuthology.orchestra.run.smithi007.stdout: "setuser": "", 2024-04-19T04:24:41.779 INFO:teuthology.orchestra.run.smithi007.stdout: "setuser_match_path": "", 2024-04-19T04:24:41.779 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-19T04:24:41.779 INFO:teuthology.orchestra.run.smithi007.stdout: "thp": "false", 2024-04-19T04:24:41.779 INFO:teuthology.orchestra.run.smithi007.stdout: "threadpool_default_timeout": "60", 2024-04-19T04:24:41.779 INFO:teuthology.orchestra.run.smithi007.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-19T04:24:41.779 INFO:teuthology.orchestra.run.smithi007.stdout: "throttler_perf_counter": "true" 2024-04-19T04:24:41.779 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-19T04:24:41.781 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-19T04:24:41.926 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a: {} 2024-04-19T04:24:41.938 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b: {} 2024-04-19T04:24:41.951 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c: {} 2024-04-19T04:24:41.953 INFO:teuthology.orchestra.run.smithi007.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T04:24:41.953 INFO:teuthology.orchestra.run.smithi007.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T04:24:41.954 INFO:teuthology.orchestra.run.smithi007.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T04:24:41.967 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-19T04:24:41.968 INFO:teuthology.run_tasks:Running task radosbench... 2024-04-19T04:24:41.982 INFO:tasks.radosbench:Beginning radosbench... 2024-04-19T04:24:41.982 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-04-19T04:24:41.983 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-04-19T04:24:41.983 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-19T04:24:41.983 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T04:24:41.983 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T04:24:41.983 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-19T04:24:41.984 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-19T04:24:41.984 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-19T04:24:41.984 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-19T04:24:41.984 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-19T04:24:41.985 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-19T04:24:41.985 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:24:41.985 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-19T04:24:41.985 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:24:41.986 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-19T04:24:41.986 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T04:24:41.988 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:41.983+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:42.086 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:42.083+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:42.103 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:24:42.103 INFO:teuthology.orchestra.run.smithi172.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-19T04:24:42.103 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:24:42.104 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:42.104 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:24:42.104 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 0 2024-04-19T04:24:42.104 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:42.114 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:24:42.127 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:24:42.149 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-04-19T04:24:42.171 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:24:42.172 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:24:42.173 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T04:24:42.173 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:24:42.187 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:42.183+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:42.227 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:42.227 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:42.236 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:24:42.289 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:42.283+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:42.346 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:42.346 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:42.358 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:24:42.389 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:42.387+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:42.474 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:42.475 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:42.485 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:24:42.490 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:42.491+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:42.591 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:42.587+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:42.592 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:42.592 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:42.602 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:24:42.640 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-04-19T04:24:42.642 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'unique_pool_0' created 2024-04-19T04:24:42.654 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-04-19T04:24:42.692 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:42.691+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:42.707 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:42.707 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:42.716 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:24:42.793 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:42.787+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:42.831 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:42.831 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:42.841 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:24:42.894 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:42.891+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:42.944 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:42.944 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:42.953 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:24:42.994 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:42.995+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:43.095 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:43.091+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:43.106 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:43.106 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:43.116 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:24:43.196 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:43.195+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:43.232 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:43.232 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:43.242 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:24:43.297 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:43.291+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:43.346 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:43.347 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:43.356 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:24:43.398 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:43.395+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:43.466 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:43.466 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:43.475 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:24:43.499 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:43.495+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:43.593 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:43.594 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:43.601 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:43.595+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:43.603 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:24:43.649 INFO:teuthology.orchestra.run.smithi007.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-04-19T04:24:43.701 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:43.695+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:43.715 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:43.715 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:43.725 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:24:43.802 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:43.803+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:43.828 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:43.828 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:43.838 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:24:43.903 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:43.899+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:43.951 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:43.952 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:43.962 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:24:44.004 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:43.999+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:44.066 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:44.066 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:44.076 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:24:44.105 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:44.103+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:44.175 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:44.175 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:44.184 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:24:44.186 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:24:44.207 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:44.203+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:44.302 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:44.302 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:44.307 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:44.303+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:44.312 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:24:44.345 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:24:44.370 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-04-19T04:24:44.393 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:24:44.395 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:24:44.395 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T04:24:44.395 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:24:44.413 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:44.407+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:44.417 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:44.417 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:24:44.417 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:24:44.417 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:24:44.417 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:44.427 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:24:44.513 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:44.511+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:44.543 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:44.543 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:24:44.543 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:24:44.543 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:24:44.543 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.543 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4159.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-04-19T04:24:44.543 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:11.119346+0000", 2024-04-19T04:24:44.543 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.420454128999999, 2024-04-19T04:24:44.543 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019667567, 2024-04-19T04:24:44.544 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.544 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.544 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:44.544 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4159", 2024-04-19T04:24:44.544 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/1235519030", 2024-04-19T04:24:44.544 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 189 2024-04-19T04:24:44.544 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.544 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.544 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.544 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.544 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119346+0000", 2024-04-19T04:24:44.544 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.544 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.544 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.545 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.545 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119346+0000", 2024-04-19T04:24:44.545 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.545 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.545 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.545 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.545 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119345+0000", 2024-04-19T04:24:44.545 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:44.545 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.545 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.545 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.545 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119353+0000", 2024-04-19T04:24:44.545 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.396e-06 2024-04-19T04:24:44.545 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.546 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.546 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.546 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119361+0000", 2024-04-19T04:24:44.546 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9130000000000003e-06 2024-04-19T04:24:44.546 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.546 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.546 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.546 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119367+0000", 2024-04-19T04:24:44.546 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4500000000000001e-06 2024-04-19T04:24:44.546 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.546 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.546 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.546 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.135564+0000", 2024-04-19T04:24:44.546 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016196894999999999 2024-04-19T04:24:44.547 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.547 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.547 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.547 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.135679+0000", 2024-04-19T04:24:44.547 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114722 2024-04-19T04:24:44.547 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.547 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.547 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:44.547 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.135816+0000", 2024-04-19T04:24:44.547 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000137637 2024-04-19T04:24:44.547 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.547 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.547 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.547 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.138143+0000", 2024-04-19T04:24:44.547 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023263279999999999 2024-04-19T04:24:44.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.548 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.548 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.548 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.138920+0000", 2024-04-19T04:24:44.548 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000777515 2024-04-19T04:24:44.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.548 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.548 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.548 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.138969+0000", 2024-04-19T04:24:44.548 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8634999999999998e-05 2024-04-19T04:24:44.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.548 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.548 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.548 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.139014+0000", 2024-04-19T04:24:44.549 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4722999999999999e-05 2024-04-19T04:24:44.549 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.549 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.549 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.549 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.549 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.549 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.549 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:44.549 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.006064577, 2024-04-19T04:24:44.549 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026801078999999998, 2024-04-19T04:24:44.549 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.549 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.549 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.549 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.549 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.550 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:44.550 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.550 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.550 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.550 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.550 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:44.550 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.550 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.550 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.550 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.550 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533733+0000", 2024-04-19T04:24:44.550 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999976 2024-04-19T04:24:44.550 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.551 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.551 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.551 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533746+0000", 2024-04-19T04:24:44.551 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2679e-05 2024-04-19T04:24:44.551 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.551 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.551 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.551 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533769+0000", 2024-04-19T04:24:44.551 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2832000000000001e-05 2024-04-19T04:24:44.551 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.551 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.551 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.551 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:24:44.551 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0599999999999999e-05 2024-04-19T04:24:44.551 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.552 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.552 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.552 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533907+0000", 2024-04-19T04:24:44.552 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000118076 2024-04-19T04:24:44.552 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.552 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.552 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:44.552 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533919+0000", 2024-04-19T04:24:44.552 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1644999999999999e-05 2024-04-19T04:24:44.552 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.552 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.552 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.552 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553399+0000", 2024-04-19T04:24:44.552 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019479987000000001 2024-04-19T04:24:44.553 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.553 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.553 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.553 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553535+0000", 2024-04-19T04:24:44.553 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553400000000001 2024-04-19T04:24:44.553 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.553 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.553 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:44.553 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553696+0000", 2024-04-19T04:24:44.553 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000161068 2024-04-19T04:24:44.553 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.553 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.553 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.553 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558096+0000", 2024-04-19T04:24:44.554 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0043998880000000002 2024-04-19T04:24:44.554 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.554 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.554 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.554 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560465+0000", 2024-04-19T04:24:44.554 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023695159999999999 2024-04-19T04:24:44.554 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.554 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.554 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.554 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560513+0000", 2024-04-19T04:24:44.554 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7899000000000003e-05 2024-04-19T04:24:44.554 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.554 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.554 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.554 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560537+0000", 2024-04-19T04:24:44.555 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3768e-05 2024-04-19T04:24:44.555 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.555 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.555 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.555 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.555 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.555 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.555 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:44.555 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.005987503, 2024-04-19T04:24:44.555 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026864505, 2024-04-19T04:24:44.555 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.555 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.555 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.555 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.556 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.556 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:44.556 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.556 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.556 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.556 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.556 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:44.556 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.556 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.556 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.556 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.556 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533812+0000", 2024-04-19T04:24:44.556 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:44.556 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.557 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.557 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.557 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533818+0000", 2024-04-19T04:24:44.557 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2369999999999997e-06 2024-04-19T04:24:44.557 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.557 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.557 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.557 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533863+0000", 2024-04-19T04:24:44.557 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4515000000000003e-05 2024-04-19T04:24:44.557 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.557 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.557 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.557 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533880+0000", 2024-04-19T04:24:44.557 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7119e-05 2024-04-19T04:24:44.557 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.558 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.558 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.558 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534029+0000", 2024-04-19T04:24:44.558 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014955099999999999 2024-04-19T04:24:44.558 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.558 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.558 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:44.558 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534034+0000", 2024-04-19T04:24:44.558 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1649999999999997e-06 2024-04-19T04:24:44.558 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.559 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.559 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.559 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554888+0000", 2024-04-19T04:24:44.559 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020854075 2024-04-19T04:24:44.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.559 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.559 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.559 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554967+0000", 2024-04-19T04:24:44.559 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8209999999999998e-05 2024-04-19T04:24:44.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.559 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.559 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:44.559 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555087+0000", 2024-04-19T04:24:44.559 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000120411 2024-04-19T04:24:44.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.560 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.560 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.560 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559328+0000", 2024-04-19T04:24:44.560 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042409800000000001 2024-04-19T04:24:44.560 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.560 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.560 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.560 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560587+0000", 2024-04-19T04:24:44.560 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012587119999999999 2024-04-19T04:24:44.560 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.560 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.560 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.560 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560620+0000", 2024-04-19T04:24:44.560 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2716999999999999e-05 2024-04-19T04:24:44.561 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.561 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.561 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.561 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560677+0000", 2024-04-19T04:24:44.561 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7726999999999998e-05 2024-04-19T04:24:44.561 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.561 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.561 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.561 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.561 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.561 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.561 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:44.561 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.00590511, 2024-04-19T04:24:44.561 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027363064999999999, 2024-04-19T04:24:44.561 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.562 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.562 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.562 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.562 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:44.562 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.562 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.562 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.562 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:44.562 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.562 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.562 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533894+0000", 2024-04-19T04:24:44.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:44.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533913+0000", 2024-04-19T04:24:44.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8896e-05 2024-04-19T04:24:44.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533933+0000", 2024-04-19T04:24:44.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9775e-05 2024-04-19T04:24:44.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.564 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.564 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533967+0000", 2024-04-19T04:24:44.564 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4536000000000003e-05 2024-04-19T04:24:44.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.564 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.564 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.564 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:44.564 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553600000000001 2024-04-19T04:24:44.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.564 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.564 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:44.564 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534107+0000", 2024-04-19T04:24:44.564 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1470000000000003e-06 2024-04-19T04:24:44.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.565 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.565 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556463+0000", 2024-04-19T04:24:44.565 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022356536999999999 2024-04-19T04:24:44.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.565 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.565 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556586+0000", 2024-04-19T04:24:44.565 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122967 2024-04-19T04:24:44.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.565 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:44.565 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556738+0000", 2024-04-19T04:24:44.565 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015182800000000001 2024-04-19T04:24:44.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.566 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.566 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.566 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561020+0000", 2024-04-19T04:24:44.566 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042818819999999999 2024-04-19T04:24:44.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.566 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.566 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.566 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561183+0000", 2024-04-19T04:24:44.566 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000162683 2024-04-19T04:24:44.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.566 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.566 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.566 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561226+0000", 2024-04-19T04:24:44.567 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3686000000000002e-05 2024-04-19T04:24:44.567 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.567 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.567 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.567 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561258+0000", 2024-04-19T04:24:44.567 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1814999999999999e-05 2024-04-19T04:24:44.567 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.567 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.567 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.567 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.567 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.567 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.567 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:44.567 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.005814597000001, 2024-04-19T04:24:44.567 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027417816000000001, 2024-04-19T04:24:44.568 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.568 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.568 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.568 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.568 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.568 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:44.568 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.568 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.568 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.568 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.568 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:44.568 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.568 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.568 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.569 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.569 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533984+0000", 2024-04-19T04:24:44.569 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:44.569 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.569 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.569 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.569 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:44.569 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3876000000000001e-05 2024-04-19T04:24:44.569 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.569 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.569 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.569 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534015+0000", 2024-04-19T04:24:44.569 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6818999999999999e-05 2024-04-19T04:24:44.569 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.569 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.570 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.570 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534030+0000", 2024-04-19T04:24:44.570 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.537e-05 2024-04-19T04:24:44.570 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.570 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.570 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.570 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534152+0000", 2024-04-19T04:24:44.570 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121685 2024-04-19T04:24:44.570 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.570 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.570 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:44.570 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534156+0000", 2024-04-19T04:24:44.570 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9029999999999997e-06 2024-04-19T04:24:44.570 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.571 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.571 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.571 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557520+0000", 2024-04-19T04:24:44.571 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023364125999999999 2024-04-19T04:24:44.571 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.571 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.571 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.571 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557585+0000", 2024-04-19T04:24:44.571 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5275000000000001e-05 2024-04-19T04:24:44.571 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.571 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.571 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:44.571 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557719+0000", 2024-04-19T04:24:44.571 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013396299999999999 2024-04-19T04:24:44.572 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.572 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.572 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.572 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561133+0000", 2024-04-19T04:24:44.572 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034140989999999999 2024-04-19T04:24:44.572 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.572 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.572 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.572 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561352+0000", 2024-04-19T04:24:44.572 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0002185 2024-04-19T04:24:44.572 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.572 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.572 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.572 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561380+0000", 2024-04-19T04:24:44.573 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8317999999999999e-05 2024-04-19T04:24:44.573 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.573 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.573 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.573 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561403+0000", 2024-04-19T04:24:44.573 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3264999999999998e-05 2024-04-19T04:24:44.573 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.573 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.573 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.573 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.573 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.573 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.573 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:44.573 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.005750952, 2024-04-19T04:24:44.573 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029897119999999999, 2024-04-19T04:24:44.574 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.574 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.574 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.574 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.574 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.574 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:44.574 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.574 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.574 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.574 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.574 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:44.574 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.574 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.574 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.575 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.575 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534048+0000", 2024-04-19T04:24:44.575 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:44.575 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.575 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.575 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.575 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534057+0000", 2024-04-19T04:24:44.575 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7930000000000003e-06 2024-04-19T04:24:44.575 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.575 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.575 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.575 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534075+0000", 2024-04-19T04:24:44.575 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7846000000000002e-05 2024-04-19T04:24:44.575 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.575 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.576 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.576 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534089+0000", 2024-04-19T04:24:44.576 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4463e-05 2024-04-19T04:24:44.576 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.576 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.576 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.576 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534198+0000", 2024-04-19T04:24:44.576 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109145 2024-04-19T04:24:44.576 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.576 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.576 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:44.576 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534202+0000", 2024-04-19T04:24:44.576 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.98e-06 2024-04-19T04:24:44.576 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.577 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.577 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.577 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558221+0000", 2024-04-19T04:24:44.577 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024018208999999999 2024-04-19T04:24:44.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.577 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.577 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.577 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558320+0000", 2024-04-19T04:24:44.577 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9642000000000006e-05 2024-04-19T04:24:44.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.577 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.577 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:44.577 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558401+0000", 2024-04-19T04:24:44.577 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1038000000000006e-05 2024-04-19T04:24:44.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.578 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.578 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.578 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561173+0000", 2024-04-19T04:24:44.578 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027714549999999999 2024-04-19T04:24:44.578 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.578 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.578 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.578 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563851+0000", 2024-04-19T04:24:44.578 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026786010000000001 2024-04-19T04:24:44.578 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.578 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.578 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.578 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563906+0000", 2024-04-19T04:24:44.578 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4895999999999998e-05 2024-04-19T04:24:44.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.579 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.579 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563946+0000", 2024-04-19T04:24:44.579 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0116e-05 2024-04-19T04:24:44.579 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.579 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.579 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.579 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.579 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:44.579 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.005697570999999, 2024-04-19T04:24:44.579 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029917846000000001, 2024-04-19T04:24:44.579 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.580 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.580 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.580 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.580 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.580 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:44.580 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.580 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.580 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.580 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.580 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:44.580 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.580 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.580 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.580 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.580 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534101+0000", 2024-04-19T04:24:44.581 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:44.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.581 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.581 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.581 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534111+0000", 2024-04-19T04:24:44.581 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5659999999999996e-06 2024-04-19T04:24:44.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.581 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.581 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.581 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534129+0000", 2024-04-19T04:24:44.581 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7632999999999999e-05 2024-04-19T04:24:44.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.581 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.581 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.581 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534143+0000", 2024-04-19T04:24:44.582 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4362000000000001e-05 2024-04-19T04:24:44.582 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.582 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.582 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.582 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534256+0000", 2024-04-19T04:24:44.582 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113267 2024-04-19T04:24:44.582 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.582 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.582 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:44.582 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534260+0000", 2024-04-19T04:24:44.582 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9949999999999999e-06 2024-04-19T04:24:44.582 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.582 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.582 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.583 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558653+0000", 2024-04-19T04:24:44.583 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024393182999999999 2024-04-19T04:24:44.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.583 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.583 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.583 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558704+0000", 2024-04-19T04:24:44.583 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0303999999999998e-05 2024-04-19T04:24:44.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.583 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.583 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:44.583 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558782+0000", 2024-04-19T04:24:44.583 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8079999999999998e-05 2024-04-19T04:24:44.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.583 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.583 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.584 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561309+0000", 2024-04-19T04:24:44.584 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002527708 2024-04-19T04:24:44.584 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.584 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.584 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.584 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563952+0000", 2024-04-19T04:24:44.584 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026425450000000001 2024-04-19T04:24:44.584 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.584 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.584 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.584 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563996+0000", 2024-04-19T04:24:44.584 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3606000000000002e-05 2024-04-19T04:24:44.584 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.584 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.585 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.585 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564021+0000", 2024-04-19T04:24:44.585 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.491e-05 2024-04-19T04:24:44.585 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.585 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.585 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.585 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.585 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.585 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.585 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:44.585 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.005645059999999, 2024-04-19T04:24:44.585 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:24:44.585 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.585 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.586 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.586 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.586 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:44.586 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.586 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.586 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:44.586 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.586 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.586 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:24:44.587 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:44.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.587 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.587 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.587 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:24:44.587 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:24:44.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.587 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.587 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.587 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:24:44.587 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:24:44.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.587 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.587 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:24:44.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:24:44.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:24:44.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:24:44.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:44.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:24:44.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:24:44.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.589 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:24:44.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:24:44.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.589 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.589 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:24:44.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:24:44.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.589 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:44.589 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:24:44.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:24:44.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.590 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.590 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:24:44.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:24:44.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.590 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.590 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.590 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:24:44.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:24:44.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.590 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.590 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.590 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:24:44.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:24:44.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.591 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:24:44.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:24:44.591 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.591 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.591 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.591 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.591 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:44.591 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.005590515000002, 2024-04-19T04:24:44.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:24:44.591 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.592 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.592 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:44.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:44.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:24:44.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:44.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.593 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:24:44.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:24:44.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.593 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:24:44.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:24:44.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.593 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.594 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:24:44.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:24:44.594 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.594 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.594 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.594 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:24:44.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:24:44.594 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.594 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.594 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:44.594 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:24:44.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:24:44.594 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.594 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.595 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.595 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:24:44.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:24:44.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.595 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.595 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:24:44.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:24:44.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.595 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:44.595 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:24:44.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:24:44.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:24:44.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:24:44.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:24:44.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:24:44.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:24:44.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:24:44.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:24:44.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:24:44.597 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.597 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.597 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.597 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.597 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534259+0000", 2024-04-19T04:24:44.597 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.005541106999999, 2024-04-19T04:24:44.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026049582000000002, 2024-04-19T04:24:44.597 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.598 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.598 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534259+0000", 2024-04-19T04:24:44.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534259+0000", 2024-04-19T04:24:44.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.599 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534258+0000", 2024-04-19T04:24:44.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:44.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.599 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.599 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534266+0000", 2024-04-19T04:24:44.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5870000000000004e-06 2024-04-19T04:24:44.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.599 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.599 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534281+0000", 2024-04-19T04:24:44.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5676e-05 2024-04-19T04:24:44.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.599 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534297+0000", 2024-04-19T04:24:44.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5458999999999999e-05 2024-04-19T04:24:44.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534379+0000", 2024-04-19T04:24:44.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2667e-05 2024-04-19T04:24:44.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:44.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534387+0000", 2024-04-19T04:24:44.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8900000000000007e-06 2024-04-19T04:24:44.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.552640+0000", 2024-04-19T04:24:44.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.018252344 2024-04-19T04:24:44.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.552944+0000", 2024-04-19T04:24:44.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00030430000000000002 2024-04-19T04:24:44.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:44.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553088+0000", 2024-04-19T04:24:44.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143793 2024-04-19T04:24:44.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557028+0000", 2024-04-19T04:24:44.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0039397770000000002 2024-04-19T04:24:44.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560246+0000", 2024-04-19T04:24:44.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032184990000000001 2024-04-19T04:24:44.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560282+0000", 2024-04-19T04:24:44.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6168999999999999e-05 2024-04-19T04:24:44.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560309+0000", 2024-04-19T04:24:44.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6508000000000001e-05 2024-04-19T04:24:44.603 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.603 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.603 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.603 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.603 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534327+0000", 2024-04-19T04:24:44.603 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.005472937, 2024-04-19T04:24:44.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022180505999999999, 2024-04-19T04:24:44.603 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.604 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.604 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534327+0000", 2024-04-19T04:24:44.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534327+0000", 2024-04-19T04:24:44.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534326+0000", 2024-04-19T04:24:44.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:44.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534335+0000", 2024-04-19T04:24:44.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2359999999999993e-06 2024-04-19T04:24:44.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534348+0000", 2024-04-19T04:24:44.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2680000000000001e-05 2024-04-19T04:24:44.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534364+0000", 2024-04-19T04:24:44.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6249e-05 2024-04-19T04:24:44.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534424+0000", 2024-04-19T04:24:44.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9494999999999999e-05 2024-04-19T04:24:44.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:44.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534429+0000", 2024-04-19T04:24:44.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.536e-06 2024-04-19T04:24:44.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.549957+0000", 2024-04-19T04:24:44.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015528121000000001 2024-04-19T04:24:44.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550172+0000", 2024-04-19T04:24:44.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00021493400000000001 2024-04-19T04:24:44.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:44.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550371+0000", 2024-04-19T04:24:44.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019863899999999999 2024-04-19T04:24:44.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556311+0000", 2024-04-19T04:24:44.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0059402639999999998 2024-04-19T04:24:44.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556351+0000", 2024-04-19T04:24:44.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9932000000000003e-05 2024-04-19T04:24:44.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556464+0000", 2024-04-19T04:24:44.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113089 2024-04-19T04:24:44.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556508+0000", 2024-04-19T04:24:44.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3537e-05 2024-04-19T04:24:44.609 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.609 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.609 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.609 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.609 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534402+0000", 2024-04-19T04:24:44.609 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.005398306, 2024-04-19T04:24:44.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026426121, 2024-04-19T04:24:44.610 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.610 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.610 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534402+0000", 2024-04-19T04:24:44.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534402+0000", 2024-04-19T04:24:44.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534401+0000", 2024-04-19T04:24:44.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:44.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534423+0000", 2024-04-19T04:24:44.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2589e-05 2024-04-19T04:24:44.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534440+0000", 2024-04-19T04:24:44.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6175999999999999e-05 2024-04-19T04:24:44.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.612 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.612 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534448+0000", 2024-04-19T04:24:44.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0970000000000006e-06 2024-04-19T04:24:44.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.612 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.612 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534563+0000", 2024-04-19T04:24:44.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011575500000000001 2024-04-19T04:24:44.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.612 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:44.612 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534575+0000", 2024-04-19T04:24:44.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1199999999999999e-05 2024-04-19T04:24:44.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553676+0000", 2024-04-19T04:24:44.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019101098 2024-04-19T04:24:44.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553803+0000", 2024-04-19T04:24:44.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012747499999999999 2024-04-19T04:24:44.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:44.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553942+0000", 2024-04-19T04:24:44.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000138863 2024-04-19T04:24:44.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557090+0000", 2024-04-19T04:24:44.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003148283 2024-04-19T04:24:44.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560726+0000", 2024-04-19T04:24:44.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0036352530000000002 2024-04-19T04:24:44.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560784+0000", 2024-04-19T04:24:44.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8034e-05 2024-04-19T04:24:44.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560828+0000", 2024-04-19T04:24:44.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4418000000000001e-05 2024-04-19T04:24:44.615 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.615 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.615 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.615 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.615 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534469+0000", 2024-04-19T04:24:44.616 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.005331232, 2024-04-19T04:24:44.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023528199, 2024-04-19T04:24:44.616 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.616 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.616 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.616 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534469+0000", 2024-04-19T04:24:44.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534469+0000", 2024-04-19T04:24:44.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534468+0000", 2024-04-19T04:24:44.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:44.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534476+0000", 2024-04-19T04:24:44.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2199999999999992e-06 2024-04-19T04:24:44.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534493+0000", 2024-04-19T04:24:44.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6708999999999999e-05 2024-04-19T04:24:44.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534518+0000", 2024-04-19T04:24:44.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4803e-05 2024-04-19T04:24:44.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534601+0000", 2024-04-19T04:24:44.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3498000000000006e-05 2024-04-19T04:24:44.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:44.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534606+0000", 2024-04-19T04:24:44.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9949999999999996e-06 2024-04-19T04:24:44.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.549312+0000", 2024-04-19T04:24:44.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.014705993000000001 2024-04-19T04:24:44.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550221+0000", 2024-04-19T04:24:44.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00090864099999999996 2024-04-19T04:24:44.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:44.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550417+0000", 2024-04-19T04:24:44.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000196551 2024-04-19T04:24:44.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555547+0000", 2024-04-19T04:24:44.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0051299830000000003 2024-04-19T04:24:44.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557916+0000", 2024-04-19T04:24:44.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023689380000000001 2024-04-19T04:24:44.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557951+0000", 2024-04-19T04:24:44.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4771000000000003e-05 2024-04-19T04:24:44.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557997+0000", 2024-04-19T04:24:44.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6167e-05 2024-04-19T04:24:44.624 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.624 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.624 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.624 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.624 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534568+0000", 2024-04-19T04:24:44.624 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.005231998999999, 2024-04-19T04:24:44.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026371452, 2024-04-19T04:24:44.624 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.625 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.625 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534568+0000", 2024-04-19T04:24:44.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534568+0000", 2024-04-19T04:24:44.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534567+0000", 2024-04-19T04:24:44.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:44.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534578+0000", 2024-04-19T04:24:44.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.08e-05 2024-04-19T04:24:44.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534597+0000", 2024-04-19T04:24:44.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9245999999999998e-05 2024-04-19T04:24:44.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534607+0000", 2024-04-19T04:24:44.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.039e-05 2024-04-19T04:24:44.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534685+0000", 2024-04-19T04:24:44.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7297000000000002e-05 2024-04-19T04:24:44.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:44.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534691+0000", 2024-04-19T04:24:44.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5690000000000001e-06 2024-04-19T04:24:44.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554391+0000", 2024-04-19T04:24:44.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019699926999999999 2024-04-19T04:24:44.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554645+0000", 2024-04-19T04:24:44.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00025359599999999998 2024-04-19T04:24:44.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:44.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554947+0000", 2024-04-19T04:24:44.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00030229200000000001 2024-04-19T04:24:44.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557380+0000", 2024-04-19T04:24:44.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024329680000000002 2024-04-19T04:24:44.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560869+0000", 2024-04-19T04:24:44.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034894230000000002 2024-04-19T04:24:44.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560902+0000", 2024-04-19T04:24:44.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2710999999999999e-05 2024-04-19T04:24:44.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560940+0000", 2024-04-19T04:24:44.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.756e-05 2024-04-19T04:24:44.630 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.630 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.630 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.630 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.630 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534626+0000", 2024-04-19T04:24:44.630 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.005174644, 2024-04-19T04:24:44.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022377527000000001, 2024-04-19T04:24:44.630 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.630 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.631 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534626+0000", 2024-04-19T04:24:44.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534626+0000", 2024-04-19T04:24:44.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534624+0000", 2024-04-19T04:24:44.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:44.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534633+0000", 2024-04-19T04:24:44.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7590000000000003e-06 2024-04-19T04:24:44.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534643+0000", 2024-04-19T04:24:44.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0396e-05 2024-04-19T04:24:44.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534691+0000", 2024-04-19T04:24:44.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7735000000000003e-05 2024-04-19T04:24:44.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534775+0000", 2024-04-19T04:24:44.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4556999999999997e-05 2024-04-19T04:24:44.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:44.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534783+0000", 2024-04-19T04:24:44.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9230000000000002e-06 2024-04-19T04:24:44.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.549925+0000", 2024-04-19T04:24:44.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015141419999999999 2024-04-19T04:24:44.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550367+0000", 2024-04-19T04:24:44.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00044214500000000002 2024-04-19T04:24:44.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:44.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550806+0000", 2024-04-19T04:24:44.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00043874799999999998 2024-04-19T04:24:44.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556642+0000", 2024-04-19T04:24:44.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0058363850000000004 2024-04-19T04:24:44.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556723+0000", 2024-04-19T04:24:44.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1383000000000003e-05 2024-04-19T04:24:44.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556775+0000", 2024-04-19T04:24:44.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1659999999999997e-05 2024-04-19T04:24:44.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557003+0000", 2024-04-19T04:24:44.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022796599999999999 2024-04-19T04:24:44.636 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.636 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.636 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.636 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.636 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534711+0000", 2024-04-19T04:24:44.636 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.005089537, 2024-04-19T04:24:44.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023431483999999999, 2024-04-19T04:24:44.636 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.636 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.637 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534711+0000", 2024-04-19T04:24:44.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534711+0000", 2024-04-19T04:24:44.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534710+0000", 2024-04-19T04:24:44.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:44.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534716+0000", 2024-04-19T04:24:44.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3430000000000001e-06 2024-04-19T04:24:44.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534728+0000", 2024-04-19T04:24:44.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1616e-05 2024-04-19T04:24:44.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534739+0000", 2024-04-19T04:24:44.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1416999999999999e-05 2024-04-19T04:24:44.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534812+0000", 2024-04-19T04:24:44.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.305e-05 2024-04-19T04:24:44.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:44.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534821+0000", 2024-04-19T04:24:44.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2329999999999995e-06 2024-04-19T04:24:44.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.548691+0000", 2024-04-19T04:24:44.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.013869375 2024-04-19T04:24:44.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.548892+0000", 2024-04-19T04:24:44.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00020125500000000001 2024-04-19T04:24:44.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:44.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.549719+0000", 2024-04-19T04:24:44.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000826935 2024-04-19T04:24:44.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555981+0000", 2024-04-19T04:24:44.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062615079999999998 2024-04-19T04:24:44.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557961+0000", 2024-04-19T04:24:44.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0019805339999999999 2024-04-19T04:24:44.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558028+0000", 2024-04-19T04:24:44.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6987000000000001e-05 2024-04-19T04:24:44.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.642 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.642 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558142+0000", 2024-04-19T04:24:44.642 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011410500000000001 2024-04-19T04:24:44.642 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.642 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.642 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.642 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.642 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534754+0000", 2024-04-19T04:24:44.642 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.005046473, 2024-04-19T04:24:44.642 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026409367, 2024-04-19T04:24:44.642 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.643 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:44.643 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.643 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.643 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.643 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534754+0000", 2024-04-19T04:24:44.643 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.643 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.643 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.643 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.643 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534754+0000", 2024-04-19T04:24:44.643 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.643 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.643 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.643 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.643 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534753+0000", 2024-04-19T04:24:44.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:44.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534757+0000", 2024-04-19T04:24:44.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0430000000000001e-06 2024-04-19T04:24:44.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534765+0000", 2024-04-19T04:24:44.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2430000000000005e-06 2024-04-19T04:24:44.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534772+0000", 2024-04-19T04:24:44.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.973e-06 2024-04-19T04:24:44.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534849+0000", 2024-04-19T04:24:44.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6724000000000006e-05 2024-04-19T04:24:44.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:44.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534853+0000", 2024-04-19T04:24:44.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.442e-06 2024-04-19T04:24:44.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555493+0000", 2024-04-19T04:24:44.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020639571999999998 2024-04-19T04:24:44.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555890+0000", 2024-04-19T04:24:44.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00039718000000000002 2024-04-19T04:24:44.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561163+0000", 2024-04-19T04:24:44.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0052728929999999999 2024-04-19T04:24:44.647 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.647 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.647 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.647 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.647 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534797+0000", 2024-04-19T04:24:44.647 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.005003678000001, 2024-04-19T04:24:44.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026586375999999998, 2024-04-19T04:24:44.647 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.647 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.647 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.648 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.648 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534797+0000", 2024-04-19T04:24:44.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.648 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.648 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.648 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534797+0000", 2024-04-19T04:24:44.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.648 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.648 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.648 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534796+0000", 2024-04-19T04:24:44.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:44.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.649 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.649 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534805+0000", 2024-04-19T04:24:44.649 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.3700000000000001e-06 2024-04-19T04:24:44.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.649 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.649 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534822+0000", 2024-04-19T04:24:44.649 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6878999999999999e-05 2024-04-19T04:24:44.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.649 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.649 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534832+0000", 2024-04-19T04:24:44.649 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:24:44.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534899+0000", 2024-04-19T04:24:44.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7280999999999995e-05 2024-04-19T04:24:44.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:44.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534905+0000", 2024-04-19T04:24:44.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8490000000000002e-06 2024-04-19T04:24:44.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556245+0000", 2024-04-19T04:24:44.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.021340136999999999 2024-04-19T04:24:44.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556327+0000", 2024-04-19T04:24:44.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2347000000000003e-05 2024-04-19T04:24:44.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:44.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556554+0000", 2024-04-19T04:24:44.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022676200000000001 2024-04-19T04:24:44.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561197+0000", 2024-04-19T04:24:44.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0046431019999999996 2024-04-19T04:24:44.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.652 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561303+0000", 2024-04-19T04:24:44.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000106043 2024-04-19T04:24:44.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.652 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561350+0000", 2024-04-19T04:24:44.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6711000000000001e-05 2024-04-19T04:24:44.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561383+0000", 2024-04-19T04:24:44.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2904999999999998e-05 2024-04-19T04:24:44.653 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.653 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.653 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.653 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.653 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534840+0000", 2024-04-19T04:24:44.653 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.004960519000001, 2024-04-19T04:24:44.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022162659000000001, 2024-04-19T04:24:44.653 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.653 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.654 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.654 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.654 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534840+0000", 2024-04-19T04:24:44.654 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.654 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.654 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534840+0000", 2024-04-19T04:24:44.654 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.654 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534839+0000", 2024-04-19T04:24:44.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:44.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534844+0000", 2024-04-19T04:24:44.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7859999999999996e-06 2024-04-19T04:24:44.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534856+0000", 2024-04-19T04:24:44.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2150000000000001e-05 2024-04-19T04:24:44.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534863+0000", 2024-04-19T04:24:44.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.883e-06 2024-04-19T04:24:44.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534915+0000", 2024-04-19T04:24:44.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1675999999999998e-05 2024-04-19T04:24:44.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:44.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534918+0000", 2024-04-19T04:24:44.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7850000000000002e-06 2024-04-19T04:24:44.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.551513+0000", 2024-04-19T04:24:44.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016594398 2024-04-19T04:24:44.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.551634+0000", 2024-04-19T04:24:44.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012141700000000001 2024-04-19T04:24:44.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:44.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.551867+0000", 2024-04-19T04:24:44.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00023267000000000001 2024-04-19T04:24:44.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556539+0000", 2024-04-19T04:24:44.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0046719910000000003 2024-04-19T04:24:44.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556594+0000", 2024-04-19T04:24:44.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4715e-05 2024-04-19T04:24:44.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556818+0000", 2024-04-19T04:24:44.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000224064 2024-04-19T04:24:44.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557002+0000", 2024-04-19T04:24:44.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00018477399999999999 2024-04-19T04:24:44.660 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.660 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.660 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.660 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:44.660 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534883+0000", 2024-04-19T04:24:44.660 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 24.004917114000001, 2024-04-19T04:24:44.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022503523000000001, 2024-04-19T04:24:44.661 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:44.661 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:44.661 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:44.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:44.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534883+0000", 2024-04-19T04:24:44.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:44.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534883+0000", 2024-04-19T04:24:44.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:44.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.662 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:44.662 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534882+0000", 2024-04-19T04:24:44.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:44.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.662 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:44.662 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534894+0000", 2024-04-19T04:24:44.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1579999999999999e-05 2024-04-19T04:24:44.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:44.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534903+0000", 2024-04-19T04:24:44.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0790000000000007e-06 2024-04-19T04:24:44.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534910+0000", 2024-04-19T04:24:44.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8329999999999996e-06 2024-04-19T04:24:44.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534960+0000", 2024-04-19T04:24:44.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0441e-05 2024-04-19T04:24:44.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:44.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534964+0000", 2024-04-19T04:24:44.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9169999999999999e-06 2024-04-19T04:24:44.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:44.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.552567+0000", 2024-04-19T04:24:44.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.017603088999999999 2024-04-19T04:24:44.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:44.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553342+0000", 2024-04-19T04:24:44.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00077492299999999995 2024-04-19T04:24:44.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:44.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553552+0000", 2024-04-19T04:24:44.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00020988300000000001 2024-04-19T04:24:44.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:44.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556683+0000", 2024-04-19T04:24:44.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031310830000000002 2024-04-19T04:24:44.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:44.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557301+0000", 2024-04-19T04:24:44.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000618051 2024-04-19T04:24:44.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:44.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557350+0000", 2024-04-19T04:24:44.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8976e-05 2024-04-19T04:24:44.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:44.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:44.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:44.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557387+0000", 2024-04-19T04:24:44.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6325000000000002e-05 2024-04-19T04:24:44.667 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.667 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.667 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.667 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:44.667 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:44.667 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:44.668 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T04:24:44.669 DEBUG:teuthology.orchestra.run.smithi007:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 60 write' 2024-04-19T04:24:44.670 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:44.663+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:44.671 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:24:44.672 INFO:teuthology.run_tasks:Running task admin_socket... 2024-04-19T04:24:44.684 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2024-04-19T04:24:44.684 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2024-04-19T04:24:44.749 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:hints = 1 2024-04-19T04:24:44.749 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 60 seconds or 0 objects 2024-04-19T04:24:44.749 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Object prefix: benchmark_data_smithi007_19526 2024-04-19T04:24:44.749 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-19T04:24:44.749 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 0 0 0 0 0 0 - 0 2024-04-19T04:24:44.770 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:44.767+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:44.819 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:24:44.819 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [ 2024-04-19T04:24:44.820 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.820 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:156 5.a 5:59bdafca:::benchmark_data_smithi007_19526_object155:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:44.820 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:44.812790+0000", 2024-04-19T04:24:44.820 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00080198200000000002, 2024-04-19T04:24:44.820 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00084384599999999998, 2024-04-19T04:24:44.820 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:44.820 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:44.820 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:44.820 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:44.820 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:44.820 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 156 2024-04-19T04:24:44.820 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.821 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:44.821 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.821 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:44.821 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812790+0000", 2024-04-19T04:24:44.821 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:44.821 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.821 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.821 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:44.821 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812790+0000", 2024-04-19T04:24:44.821 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:44.821 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.822 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.822 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:44.822 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812789+0000", 2024-04-19T04:24:44.822 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:44.822 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.822 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.822 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:44.822 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812825+0000", 2024-04-19T04:24:44.822 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6554999999999998e-05 2024-04-19T04:24:44.823 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.823 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.823 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:44.823 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812833+0000", 2024-04-19T04:24:44.823 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.0099999999999995e-06 2024-04-19T04:24:44.823 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.823 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.823 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.823 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812837+0000", 2024-04-19T04:24:44.823 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.0130000000000004e-06 2024-04-19T04:24:44.823 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.823 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.823 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:44.823 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812910+0000", 2024-04-19T04:24:44.823 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2671999999999998e-05 2024-04-19T04:24:44.824 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.824 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.824 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:44.824 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813106+0000", 2024-04-19T04:24:44.824 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00019571700000000001 2024-04-19T04:24:44.824 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.824 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.824 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:44.824 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813313+0000", 2024-04-19T04:24:44.824 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00020767999999999999 2024-04-19T04:24:44.824 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:44.824 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:44.824 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:44.825 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.825 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.825 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:153 5.8 e22/20 5:1f812e46:::benchmark_data_smithi007_19526_object152:head v 22'13, mlcod=22'11)", 2024-04-19T04:24:44.825 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:44.813053+0000", 2024-04-19T04:24:44.825 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00053876200000000003, 2024-04-19T04:24:44.825 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00074565600000000003, 2024-04-19T04:24:44.825 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:44.825 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:44.825 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:44.825 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.825 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:44.825 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813053+0000", 2024-04-19T04:24:44.825 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:44.826 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.826 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.826 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:44.826 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813053+0000", 2024-04-19T04:24:44.826 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:44.826 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.826 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.826 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:44.826 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813052+0000", 2024-04-19T04:24:44.826 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:44.826 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.826 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.826 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:44.826 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813122+0000", 2024-04-19T04:24:44.827 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.9728999999999996e-05 2024-04-19T04:24:44.827 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.827 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.827 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:44.827 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813137+0000", 2024-04-19T04:24:44.827 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.4620000000000001e-05 2024-04-19T04:24:44.827 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.827 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.827 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.827 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813150+0000", 2024-04-19T04:24:44.827 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3400999999999999e-05 2024-04-19T04:24:44.827 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.827 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.827 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:44.828 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813210+0000", 2024-04-19T04:24:44.828 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.0043000000000001e-05 2024-04-19T04:24:44.828 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.828 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.828 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:44.828 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813241+0000", 2024-04-19T04:24:44.828 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.0883000000000002e-05 2024-04-19T04:24:44.828 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:44.828 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:44.828 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:44.828 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.828 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.828 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:160 5.c 5:31ad7b65:::benchmark_data_smithi007_19526_object159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:44.828 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:44.813000+0000", 2024-04-19T04:24:44.829 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00059177800000000005, 2024-04-19T04:24:44.829 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00089451299999999999, 2024-04-19T04:24:44.829 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:44.829 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:44.829 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:44.829 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:44.829 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:44.829 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 160 2024-04-19T04:24:44.829 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.829 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:44.829 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.829 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:44.829 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813000+0000", 2024-04-19T04:24:44.829 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:44.829 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.829 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.830 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:44.830 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813000+0000", 2024-04-19T04:24:44.830 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:44.830 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.830 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.830 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:44.830 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812999+0000", 2024-04-19T04:24:44.830 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:44.830 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.830 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.830 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:44.830 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813137+0000", 2024-04-19T04:24:44.830 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000137565 2024-04-19T04:24:44.830 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.831 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.831 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:44.831 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813153+0000", 2024-04-19T04:24:44.831 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.6030000000000001e-05 2024-04-19T04:24:44.831 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.831 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.831 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.831 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813170+0000", 2024-04-19T04:24:44.831 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.6996000000000001e-05 2024-04-19T04:24:44.831 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.831 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.831 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:44.831 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813223+0000", 2024-04-19T04:24:44.831 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.3668999999999997e-05 2024-04-19T04:24:44.831 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.832 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.832 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:44.832 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813330+0000", 2024-04-19T04:24:44.832 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00010688000000000001 2024-04-19T04:24:44.832 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.832 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.832 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:44.832 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813437+0000", 2024-04-19T04:24:44.832 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00010656499999999999 2024-04-19T04:24:44.832 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:44.832 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:44.832 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:44.832 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.832 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.832 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:154 5.4 e22/20 5:2c5548bb:::benchmark_data_smithi007_19526_object153:head v 22'15, mlcod=22'13)", 2024-04-19T04:24:44.833 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:44.813502+0000", 2024-04-19T04:24:44.833 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 9.0184000000000003e-05, 2024-04-19T04:24:44.833 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00049755899999999996, 2024-04-19T04:24:44.833 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:44.833 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:44.833 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:44.833 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.833 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:44.833 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813502+0000", 2024-04-19T04:24:44.833 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:44.833 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.833 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.833 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:44.833 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813502+0000", 2024-04-19T04:24:44.834 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:44.834 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.834 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.834 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:44.834 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813501+0000", 2024-04-19T04:24:44.834 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:44.834 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.834 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.834 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:44.834 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813551+0000", 2024-04-19T04:24:44.834 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.0380000000000002e-05 2024-04-19T04:24:44.834 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.834 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.835 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:44.835 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813563+0000", 2024-04-19T04:24:44.835 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1433e-05 2024-04-19T04:24:44.835 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.835 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.835 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.835 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813569+0000", 2024-04-19T04:24:44.835 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.5579999999999997e-06 2024-04-19T04:24:44.835 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.835 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.835 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:44.835 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813596+0000", 2024-04-19T04:24:44.835 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.6356e-05 2024-04-19T04:24:44.835 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.835 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.836 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:44.836 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813607+0000", 2024-04-19T04:24:44.836 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1226000000000001e-05 2024-04-19T04:24:44.836 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:44.836 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:44.836 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:44.836 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.836 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.836 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:162 5.0 e22/20 5:0019d6b8:::benchmark_data_smithi007_19526_object161:head v 22'10, mlcod=22'8)", 2024-04-19T04:24:44.836 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:44.813687+0000", 2024-04-19T04:24:44.836 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4294967295.9999046, 2024-04-19T04:24:44.836 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00038696500000000002, 2024-04-19T04:24:44.836 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:44.836 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:44.836 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:44.837 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.837 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:44.837 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813687+0000", 2024-04-19T04:24:44.837 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:44.837 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.837 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.837 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:44.837 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813687+0000", 2024-04-19T04:24:44.837 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:44.837 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.837 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.837 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:44.837 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813686+0000", 2024-04-19T04:24:44.837 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:44.838 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.838 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.838 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:44.838 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813796+0000", 2024-04-19T04:24:44.838 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00010949499999999999 2024-04-19T04:24:44.838 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.838 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.838 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:44.838 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813807+0000", 2024-04-19T04:24:44.838 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1518000000000001e-05 2024-04-19T04:24:44.838 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.838 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.838 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.839 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813814+0000", 2024-04-19T04:24:44.839 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.1729999999999998e-06 2024-04-19T04:24:44.839 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.839 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.839 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:44.839 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813866+0000", 2024-04-19T04:24:44.839 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.1875000000000001e-05 2024-04-19T04:24:44.839 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.839 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.839 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:44.839 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813889+0000", 2024-04-19T04:24:44.839 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2390000000000001e-05 2024-04-19T04:24:44.839 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:44.839 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:44.839 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:44.840 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.840 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.840 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:152 5.a 5:5cc5931a:::benchmark_data_smithi007_19526_object151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:44.840 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:44.809943+0000", 2024-04-19T04:24:44.840 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0036488359999999999, 2024-04-19T04:24:44.840 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0042086509999999999, 2024-04-19T04:24:44.840 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:44.840 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:44.840 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:44.840 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:44.840 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:44.840 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 152 2024-04-19T04:24:44.840 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.840 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:44.841 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.841 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:44.841 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.809943+0000", 2024-04-19T04:24:44.841 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:44.841 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.841 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.841 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:44.841 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.809943+0000", 2024-04-19T04:24:44.841 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:44.841 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.841 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.841 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:44.841 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.809942+0000", 2024-04-19T04:24:44.841 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:44.842 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.842 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.842 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:44.842 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.810059+0000", 2024-04-19T04:24:44.842 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000117291 2024-04-19T04:24:44.842 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.842 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.842 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:44.842 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.810088+0000", 2024-04-19T04:24:44.842 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.8770999999999999e-05 2024-04-19T04:24:44.842 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.842 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.842 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.842 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.810110+0000", 2024-04-19T04:24:44.843 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2296000000000001e-05 2024-04-19T04:24:44.843 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.843 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.843 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:44.843 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.810418+0000", 2024-04-19T04:24:44.843 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000307693 2024-04-19T04:24:44.843 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.843 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.843 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:44.843 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.810578+0000", 2024-04-19T04:24:44.843 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015992600000000001 2024-04-19T04:24:44.843 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.843 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.843 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:44.843 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.810807+0000", 2024-04-19T04:24:44.844 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000229593 2024-04-19T04:24:44.844 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.844 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.844 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:44.844 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812583+0000", 2024-04-19T04:24:44.844 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0017761260000000001 2024-04-19T04:24:44.844 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:44.844 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:44.844 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:44.844 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.844 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.844 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:155 5.6 5:67b6a8ff:::benchmark_data_smithi007_19526_object154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:44.844 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:44.812655+0000", 2024-04-19T04:24:44.844 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00093646099999999998, 2024-04-19T04:24:44.844 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0015966019999999999, 2024-04-19T04:24:44.845 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:44.845 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:44.845 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:44.845 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:44.845 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:44.845 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 155 2024-04-19T04:24:44.845 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.845 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:44.845 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.845 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:44.845 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812655+0000", 2024-04-19T04:24:44.845 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:44.845 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.845 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.845 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:44.846 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812655+0000", 2024-04-19T04:24:44.846 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:44.846 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.846 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.846 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:44.846 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812654+0000", 2024-04-19T04:24:44.846 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:44.846 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.846 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.846 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:44.846 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812756+0000", 2024-04-19T04:24:44.846 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000101975 2024-04-19T04:24:44.846 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.846 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.847 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:44.847 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812768+0000", 2024-04-19T04:24:44.847 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1522000000000001e-05 2024-04-19T04:24:44.847 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.847 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.847 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:44.847 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812779+0000", 2024-04-19T04:24:44.847 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1807000000000001e-05 2024-04-19T04:24:44.847 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.847 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.847 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:44.847 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812830+0000", 2024-04-19T04:24:44.847 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.0899999999999997e-05 2024-04-19T04:24:44.847 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.847 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.848 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:44.848 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813125+0000", 2024-04-19T04:24:44.848 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000294889 2024-04-19T04:24:44.848 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:44.848 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:44.848 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:44.848 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.813304+0000", 2024-04-19T04:24:44.848 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017845099999999999 2024-04-19T04:24:44.848 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:44.848 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:44.848 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:44.848 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:44.848 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-04-19T04:24:44.848 INFO:teuthology.orchestra.run.smithi066.stdout: "num_ops": 7 2024-04-19T04:24:44.848 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:24:44.850 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:24:44.870 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:44.867+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:44.971 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:44.967+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:44.983 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:24:44.983 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [], 2024-04-19T04:24:44.983 INFO:teuthology.orchestra.run.smithi066.stdout: "complaint_time": 30, 2024-04-19T04:24:44.983 INFO:teuthology.orchestra.run.smithi066.stdout: "num_blocked_ops": 0 2024-04-19T04:24:44.983 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:24:44.998 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:24:45.073 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:45.067+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:45.135 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:24:45.136 INFO:teuthology.orchestra.run.smithi066.stdout: "size": 20, 2024-04-19T04:24:45.136 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 600, 2024-04-19T04:24:45.136 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [ 2024-04-19T04:24:45.136 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.136 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:45.136 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:24:45.137 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 24.598478062000002, 2024-04-19T04:24:45.137 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019436790999999998, 2024-04-19T04:24:45.137 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.137 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.137 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.137 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.137 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.137 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:24:45.137 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.138 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.138 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.138 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.138 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:24:45.138 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.138 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.138 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.138 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.138 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533562+0000", 2024-04-19T04:24:45.138 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999967 2024-04-19T04:24:45.138 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.138 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.138 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.138 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533588+0000", 2024-04-19T04:24:45.139 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.6128000000000001e-05 2024-04-19T04:24:45.139 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.139 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.139 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.139 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533617+0000", 2024-04-19T04:24:45.139 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.8685000000000001e-05 2024-04-19T04:24:45.139 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.139 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.139 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.139 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533649+0000", 2024-04-19T04:24:45.140 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.2532e-05 2024-04-19T04:24:45.140 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.140 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.140 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.140 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536605+0000", 2024-04-19T04:24:45.140 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0029553130000000002 2024-04-19T04:24:45.140 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.140 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.140 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.140 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536746+0000", 2024-04-19T04:24:45.140 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000141011 2024-04-19T04:24:45.140 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.140 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.140 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.141 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536889+0000", 2024-04-19T04:24:45.141 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000143437 2024-04-19T04:24:45.141 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.141 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.141 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:45.141 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542807+0000", 2024-04-19T04:24:45.141 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0059181210000000001 2024-04-19T04:24:45.141 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.141 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.141 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.141 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.552917+0000", 2024-04-19T04:24:45.141 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010110111 2024-04-19T04:24:45.141 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.142 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.142 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:45.142 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.552962+0000", 2024-04-19T04:24:45.142 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.4811999999999997e-05 2024-04-19T04:24:45.142 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.142 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.142 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.142 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553002+0000", 2024-04-19T04:24:45.142 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9957999999999999e-05 2024-04-19T04:24:45.142 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.142 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.142 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.142 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.143 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.143 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:45.143 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:24:45.143 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 24.598362118000001, 2024-04-19T04:24:45.143 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019464940999999999, 2024-04-19T04:24:45.143 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.143 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.143 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.143 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.143 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.143 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:24:45.143 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.143 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.143 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.144 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.144 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:24:45.144 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.144 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.144 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.144 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.144 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533680+0000", 2024-04-19T04:24:45.144 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:45.144 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.144 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.144 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.144 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533692+0000", 2024-04-19T04:24:45.144 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2235000000000001e-05 2024-04-19T04:24:45.145 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.145 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.145 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.145 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533770+0000", 2024-04-19T04:24:45.145 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.8248e-05 2024-04-19T04:24:45.145 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.145 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.145 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.145 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:24:45.145 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8671000000000001e-05 2024-04-19T04:24:45.145 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.145 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.145 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.145 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539610+0000", 2024-04-19T04:24:45.146 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0058206669999999999 2024-04-19T04:24:45.146 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.146 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.146 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.146 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539705+0000", 2024-04-19T04:24:45.146 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.5313e-05 2024-04-19T04:24:45.146 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.146 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.146 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.146 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539857+0000", 2024-04-19T04:24:45.146 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000151881 2024-04-19T04:24:45.146 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.147 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.147 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:45.147 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542812+0000", 2024-04-19T04:24:45.147 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.002954857 2024-04-19T04:24:45.147 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.147 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.147 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.147 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553058+0000", 2024-04-19T04:24:45.147 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010246570999999999 2024-04-19T04:24:45.147 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.147 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.147 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:45.148 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553104+0000", 2024-04-19T04:24:45.148 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.5235999999999999e-05 2024-04-19T04:24:45.148 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.148 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.148 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.148 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553146+0000", 2024-04-19T04:24:45.148 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2725999999999997e-05 2024-04-19T04:24:45.148 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.148 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.148 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.148 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.148 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.148 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:20 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:45.148 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533808+0000", 2024-04-19T04:24:45.149 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 24.598235559999999, 2024-04-19T04:24:45.149 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013169548999999999, 2024-04-19T04:24:45.149 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.149 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.149 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.149 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.149 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.149 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533808+0000", 2024-04-19T04:24:45.149 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.149 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.149 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.149 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.150 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533808+0000", 2024-04-19T04:24:45.150 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.150 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.150 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.150 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.150 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533807+0000", 2024-04-19T04:24:45.150 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:45.150 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.150 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.150 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.150 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533816+0000", 2024-04-19T04:24:45.150 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.7440000000000002e-06 2024-04-19T04:24:45.151 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.151 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.151 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.151 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533835+0000", 2024-04-19T04:24:45.151 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.9074000000000001e-05 2024-04-19T04:24:45.151 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.151 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.151 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.151 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533851+0000", 2024-04-19T04:24:45.151 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.5862000000000002e-05 2024-04-19T04:24:45.151 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.151 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.151 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.152 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.540449+0000", 2024-04-19T04:24:45.152 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0065977889999999997 2024-04-19T04:24:45.152 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.152 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.152 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.152 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.540629+0000", 2024-04-19T04:24:45.152 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00018008499999999999 2024-04-19T04:24:45.152 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.152 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.152 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:45.153 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.540786+0000", 2024-04-19T04:24:45.153 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015730799999999999 2024-04-19T04:24:45.153 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.154 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.154 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:45.154 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542894+0000", 2024-04-19T04:24:45.154 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0021071140000000002 2024-04-19T04:24:45.154 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.155 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.155 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.155 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.546830+0000", 2024-04-19T04:24:45.155 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0039364129999999997 2024-04-19T04:24:45.156 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.156 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.156 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:45.156 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.546925+0000", 2024-04-19T04:24:45.156 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.4747999999999995e-05 2024-04-19T04:24:45.156 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.157 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.157 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.157 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.546977+0000", 2024-04-19T04:24:45.157 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2791999999999999e-05 2024-04-19T04:24:45.157 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.157 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.158 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.158 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.158 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.158 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:45.158 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533866+0000", 2024-04-19T04:24:45.158 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 24.598177802999999, 2024-04-19T04:24:45.159 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013268970999999999, 2024-04-19T04:24:45.159 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.159 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.159 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.159 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.159 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.160 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533866+0000", 2024-04-19T04:24:45.160 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.160 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.160 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.160 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.160 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533866+0000", 2024-04-19T04:24:45.161 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.161 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.161 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.161 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.161 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533865+0000", 2024-04-19T04:24:45.161 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.162 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.162 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.162 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.162 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533879+0000", 2024-04-19T04:24:45.162 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3825000000000001e-05 2024-04-19T04:24:45.162 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.163 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.163 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.163 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:45.163 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.6816999999999998e-05 2024-04-19T04:24:45.163 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.163 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.164 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.164 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533926+0000", 2024-04-19T04:24:45.164 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.0309000000000001e-05 2024-04-19T04:24:45.164 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.164 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.164 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.164 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541173+0000", 2024-04-19T04:24:45.164 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0072477560000000002 2024-04-19T04:24:45.164 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.165 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.165 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.165 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541268+0000", 2024-04-19T04:24:45.165 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.4400000000000004e-05 2024-04-19T04:24:45.165 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.165 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.166 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:45.166 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541394+0000", 2024-04-19T04:24:45.166 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012616400000000001 2024-04-19T04:24:45.166 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.166 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.166 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:45.167 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.543380+0000", 2024-04-19T04:24:45.167 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0019861940000000002 2024-04-19T04:24:45.167 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.167 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.167 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.167 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.547049+0000", 2024-04-19T04:24:45.168 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00366855 2024-04-19T04:24:45.168 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.168 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.168 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:45.168 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.547098+0000", 2024-04-19T04:24:45.168 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.9716000000000003e-05 2024-04-19T04:24:45.169 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.169 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.169 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.169 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.547135+0000", 2024-04-19T04:24:45.169 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6217000000000002e-05 2024-04-19T04:24:45.170 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.170 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.170 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.170 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.170 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.170 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:21 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:45.171 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:24:45.171 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 24.598103018, 2024-04-19T04:24:45.171 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019340466000000001, 2024-04-19T04:24:45.171 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.171 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.172 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.172 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.172 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.172 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:24:45.172 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.172 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.173 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.173 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.173 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:24:45.173 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.173 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.173 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.174 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.174 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533939+0000", 2024-04-19T04:24:45.174 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.174 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.174 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.174 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.174 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533950+0000", 2024-04-19T04:24:45.175 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0533999999999999e-05 2024-04-19T04:24:45.175 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.175 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.175 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.175 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533973+0000", 2024-04-19T04:24:45.176 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2614000000000001e-05 2024-04-19T04:24:45.176 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.176 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.176 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.176 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:45.176 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3531e-05 2024-04-19T04:24:45.176 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.177 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.177 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.177 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541149+0000", 2024-04-19T04:24:45.177 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0071628780000000001 2024-04-19T04:24:45.177 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.177 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.177 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.178 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541279+0000", 2024-04-19T04:24:45.178 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013014999999999999 2024-04-19T04:24:45.178 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.178 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.178 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.178 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541430+0000", 2024-04-19T04:24:45.178 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015048399999999999 2024-04-19T04:24:45.179 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.179 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.179 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:45.179 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.543384+0000", 2024-04-19T04:24:45.179 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001954468 2024-04-19T04:24:45.179 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.179 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.179 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.180 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553193+0000", 2024-04-19T04:24:45.180 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0098089059999999992 2024-04-19T04:24:45.180 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.180 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.180 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:45.180 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553245+0000", 2024-04-19T04:24:45.180 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.1742e-05 2024-04-19T04:24:45.180 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.181 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.181 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.181 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553281+0000", 2024-04-19T04:24:45.181 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6272000000000001e-05 2024-04-19T04:24:45.181 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.181 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.181 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.182 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.182 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.182 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:45.182 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:45.182 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 24.598045766999999, 2024-04-19T04:24:45.182 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019497464999999999, 2024-04-19T04:24:45.182 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.182 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.182 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.182 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.182 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.182 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:45.183 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.183 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.183 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.183 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.183 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:45.183 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.183 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.183 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.183 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.183 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533997+0000", 2024-04-19T04:24:45.183 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.183 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.183 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.183 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.184 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534019+0000", 2024-04-19T04:24:45.184 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.1871000000000001e-05 2024-04-19T04:24:45.184 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.184 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.184 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.184 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534036+0000", 2024-04-19T04:24:45.184 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.7073999999999999e-05 2024-04-19T04:24:45.184 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.185 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.185 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.185 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:45.185 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3781000000000001e-05 2024-04-19T04:24:45.185 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.185 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.185 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.185 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534167+0000", 2024-04-19T04:24:45.185 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000117463 2024-04-19T04:24:45.185 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.185 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.186 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.186 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.535182+0000", 2024-04-19T04:24:45.186 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0010149340000000001 2024-04-19T04:24:45.186 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.186 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.186 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.186 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.535459+0000", 2024-04-19T04:24:45.186 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000277013 2024-04-19T04:24:45.186 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.186 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.186 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:45.186 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.540338+0000", 2024-04-19T04:24:45.186 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0048786109999999997 2024-04-19T04:24:45.186 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.187 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.187 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.187 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553416+0000", 2024-04-19T04:24:45.187 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013078251000000001 2024-04-19T04:24:45.187 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.187 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.187 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:45.187 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553456+0000", 2024-04-19T04:24:45.187 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.0516999999999998e-05 2024-04-19T04:24:45.187 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.187 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.187 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.187 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553495+0000", 2024-04-19T04:24:45.187 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8899999999999997e-05 2024-04-19T04:24:45.188 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.188 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.188 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.188 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.188 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.188 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:45.188 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:24:45.188 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 24.597947381000001, 2024-04-19T04:24:45.188 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019607754000000002, 2024-04-19T04:24:45.188 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.188 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:45.188 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.188 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.188 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.189 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:24:45.189 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.189 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.189 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.189 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.189 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:24:45.189 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.189 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.189 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.189 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.189 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534095+0000", 2024-04-19T04:24:45.189 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:45.189 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.190 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.190 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.190 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534104+0000", 2024-04-19T04:24:45.190 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.9779999999999994e-06 2024-04-19T04:24:45.190 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.190 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.190 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.190 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534122+0000", 2024-04-19T04:24:45.190 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8464000000000001e-05 2024-04-19T04:24:45.190 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.190 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.190 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.190 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534142+0000", 2024-04-19T04:24:45.190 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.9287999999999999e-05 2024-04-19T04:24:45.191 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.191 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.191 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.191 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.538550+0000", 2024-04-19T04:24:45.191 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0044085560000000001 2024-04-19T04:24:45.191 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.191 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.191 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.191 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.538726+0000", 2024-04-19T04:24:45.191 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017599299999999999 2024-04-19T04:24:45.191 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.191 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.191 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.191 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553704+0000", 2024-04-19T04:24:45.191 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.014977802 2024-04-19T04:24:45.192 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.192 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.192 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.192 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.192 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.192 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:45.192 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:24:45.192 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 24.597860491999999, 2024-04-19T04:24:45.192 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019220208999999999, 2024-04-19T04:24:45.192 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.192 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:45.192 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.192 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.192 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.193 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:24:45.193 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.193 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.193 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.193 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.193 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:24:45.193 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.193 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.193 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.193 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.193 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534182+0000", 2024-04-19T04:24:45.193 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.193 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.193 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.193 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.194 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534189+0000", 2024-04-19T04:24:45.194 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3710000000000002e-06 2024-04-19T04:24:45.194 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.194 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.194 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.194 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534810+0000", 2024-04-19T04:24:45.194 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00062098000000000003 2024-04-19T04:24:45.194 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.194 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.194 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.194 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534829+0000", 2024-04-19T04:24:45.194 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8207999999999999e-05 2024-04-19T04:24:45.194 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.194 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.195 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.195 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542089+0000", 2024-04-19T04:24:45.195 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0072601710000000002 2024-04-19T04:24:45.195 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.195 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.195 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.195 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542225+0000", 2024-04-19T04:24:45.195 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000135988 2024-04-19T04:24:45.195 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.195 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.195 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.195 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553403+0000", 2024-04-19T04:24:45.195 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011178478 2024-04-19T04:24:45.196 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.196 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.196 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.196 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.196 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.196 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:31 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:45.196 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.534846+0000", 2024-04-19T04:24:45.196 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 24.597197812000001, 2024-04-19T04:24:45.196 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.012197726000000001, 2024-04-19T04:24:45.196 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.196 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:45.196 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.196 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.196 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.197 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534846+0000", 2024-04-19T04:24:45.197 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.197 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.197 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.197 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.197 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534846+0000", 2024-04-19T04:24:45.197 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.197 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.197 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.197 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.197 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534845+0000", 2024-04-19T04:24:45.197 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.197 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.197 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534863+0000", 2024-04-19T04:24:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8525e-05 2024-04-19T04:24:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534882+0000", 2024-04-19T04:24:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.9341e-05 2024-04-19T04:24:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534896+0000", 2024-04-19T04:24:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3478e-05 2024-04-19T04:24:45.198 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.199 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.199 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.199 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.535147+0000", 2024-04-19T04:24:45.199 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00025112600000000001 2024-04-19T04:24:45.199 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.199 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.199 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.199 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.535348+0000", 2024-04-19T04:24:45.199 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00020112299999999999 2024-04-19T04:24:45.199 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.199 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.199 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.199 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.547043+0000", 2024-04-19T04:24:45.200 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011695196999999999 2024-04-19T04:24:45.200 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.200 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.200 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.200 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.200 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.200 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:125 5.6 5:667e42fb:::benchmark_data_smithi007_19526_object124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.200 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:44.800626+0000", 2024-04-19T04:24:45.200 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.331417664, 2024-04-19T04:24:45.200 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0085285259999999998, 2024-04-19T04:24:45.200 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.200 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.200 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:45.200 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:45.200 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.201 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 125 2024-04-19T04:24:45.201 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.201 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.201 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.201 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.201 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.800626+0000", 2024-04-19T04:24:45.201 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.201 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.201 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.201 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.201 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.800626+0000", 2024-04-19T04:24:45.201 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.201 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.201 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.202 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.202 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.800625+0000", 2024-04-19T04:24:45.202 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.202 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.202 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.202 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.202 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.800664+0000", 2024-04-19T04:24:45.202 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9159999999999998e-05 2024-04-19T04:24:45.202 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.202 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.202 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.202 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.800696+0000", 2024-04-19T04:24:45.202 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.2200999999999999e-05 2024-04-19T04:24:45.202 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.203 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.203 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.203 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.800731+0000", 2024-04-19T04:24:45.203 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.4638999999999998e-05 2024-04-19T04:24:45.203 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.203 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.203 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.203 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.800786+0000", 2024-04-19T04:24:45.203 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.5671999999999998e-05 2024-04-19T04:24:45.203 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.203 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.203 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.203 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.800866+0000", 2024-04-19T04:24:45.204 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.9616000000000005e-05 2024-04-19T04:24:45.204 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.204 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.204 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.204 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.800950+0000", 2024-04-19T04:24:45.204 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.4379e-05 2024-04-19T04:24:45.204 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.204 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.204 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:45.204 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.801737+0000", 2024-04-19T04:24:45.204 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00078611399999999998 2024-04-19T04:24:45.204 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.204 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.204 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.204 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.809036+0000", 2024-04-19T04:24:45.205 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0072995739999999996 2024-04-19T04:24:45.205 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.205 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.205 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:45.205 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.809074+0000", 2024-04-19T04:24:45.205 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.7626999999999997e-05 2024-04-19T04:24:45.205 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.205 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.205 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.205 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.809154+0000", 2024-04-19T04:24:45.205 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.0595999999999999e-05 2024-04-19T04:24:45.206 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.206 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.206 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.206 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.206 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.206 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:126 5.5 5:aca0fd5f:::benchmark_data_smithi007_19526_object125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.206 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:44.800767+0000", 2024-04-19T04:24:45.206 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.331276978, 2024-04-19T04:24:45.206 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0083477919999999997, 2024-04-19T04:24:45.206 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.206 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.206 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:45.206 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:45.207 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.207 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 126 2024-04-19T04:24:45.207 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.207 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.207 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.207 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.207 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.800767+0000", 2024-04-19T04:24:45.207 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.207 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.207 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.207 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.207 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.800767+0000", 2024-04-19T04:24:45.207 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.207 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.207 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.208 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.208 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.800766+0000", 2024-04-19T04:24:45.208 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.208 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.208 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.208 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.208 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.800794+0000", 2024-04-19T04:24:45.208 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.7806000000000001e-05 2024-04-19T04:24:45.208 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.208 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.208 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.208 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.800804+0000", 2024-04-19T04:24:45.208 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0043e-05 2024-04-19T04:24:45.208 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.208 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.209 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.209 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.800810+0000", 2024-04-19T04:24:45.209 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.6749999999999996e-06 2024-04-19T04:24:45.209 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.209 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.209 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.209 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.800856+0000", 2024-04-19T04:24:45.209 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.5581000000000003e-05 2024-04-19T04:24:45.209 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.209 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.209 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.209 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.800949+0000", 2024-04-19T04:24:45.209 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.3074999999999999e-05 2024-04-19T04:24:45.210 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.210 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.210 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.210 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.801060+0000", 2024-04-19T04:24:45.210 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000111488 2024-04-19T04:24:45.210 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.210 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.210 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:45.210 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.802224+0000", 2024-04-19T04:24:45.210 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0011638040000000001 2024-04-19T04:24:45.210 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.210 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.211 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.211 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.809012+0000", 2024-04-19T04:24:45.211 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0067880429999999997 2024-04-19T04:24:45.212 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.212 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.212 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:45.212 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.809059+0000", 2024-04-19T04:24:45.212 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7129999999999998e-05 2024-04-19T04:24:45.212 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.212 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.212 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.212 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.809114+0000", 2024-04-19T04:24:45.212 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4941999999999997e-05 2024-04-19T04:24:45.212 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.212 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.212 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.213 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.213 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.213 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:139 5.6 5:61b8e6e4:::benchmark_data_smithi007_19526_object138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.213 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:44.804455+0000", 2024-04-19T04:24:45.213 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.32758847499999999, 2024-04-19T04:24:45.213 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00829885, 2024-04-19T04:24:45.213 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.213 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.213 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:45.214 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:45.214 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.214 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 139 2024-04-19T04:24:45.214 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.214 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.214 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.214 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.214 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.804455+0000", 2024-04-19T04:24:45.214 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.214 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.214 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.214 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.214 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.804455+0000", 2024-04-19T04:24:45.215 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.215 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.215 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.215 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.215 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.804454+0000", 2024-04-19T04:24:45.215 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:45.215 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.215 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.215 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.215 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.804527+0000", 2024-04-19T04:24:45.215 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2912999999999998e-05 2024-04-19T04:24:45.215 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.215 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.215 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.216 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.804542+0000", 2024-04-19T04:24:45.216 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.5441999999999999e-05 2024-04-19T04:24:45.216 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.216 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.216 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.216 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.804552+0000", 2024-04-19T04:24:45.216 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.8630000000000003e-06 2024-04-19T04:24:45.216 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.216 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.216 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.216 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.804632+0000", 2024-04-19T04:24:45.216 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.0228999999999994e-05 2024-04-19T04:24:45.216 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.216 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.217 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.217 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.804789+0000", 2024-04-19T04:24:45.217 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015698099999999999 2024-04-19T04:24:45.217 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.217 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.217 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.217 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.804961+0000", 2024-04-19T04:24:45.217 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000171893 2024-04-19T04:24:45.217 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.217 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.217 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:45.217 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.809411+0000", 2024-04-19T04:24:45.217 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.004450351 2024-04-19T04:24:45.217 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.218 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.218 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.218 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812633+0000", 2024-04-19T04:24:45.218 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0032211750000000002 2024-04-19T04:24:45.218 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.218 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.218 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:45.218 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812687+0000", 2024-04-19T04:24:45.218 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4497999999999999e-05 2024-04-19T04:24:45.218 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.218 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.219 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.219 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.812754+0000", 2024-04-19T04:24:45.219 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.6836999999999997e-05 2024-04-19T04:24:45.219 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.219 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.219 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.219 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.219 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.219 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:395 5.3 5:c8059494:::benchmark_data_smithi007_19526_object394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.219 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:44.881157+0000", 2024-04-19T04:24:45.219 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.25088637800000002, 2024-04-19T04:24:45.219 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0084175550000000002, 2024-04-19T04:24:45.219 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.219 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.220 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:45.220 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:45.220 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.220 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 395 2024-04-19T04:24:45.220 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.220 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.220 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.220 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.220 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.881157+0000", 2024-04-19T04:24:45.220 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.220 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.220 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.220 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.220 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.881157+0000", 2024-04-19T04:24:45.221 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.221 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.221 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.221 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.221 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.881156+0000", 2024-04-19T04:24:45.221 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.221 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.221 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.221 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.221 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.881226+0000", 2024-04-19T04:24:45.221 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.9969999999999996e-05 2024-04-19T04:24:45.221 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.221 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.221 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.222 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.881239+0000", 2024-04-19T04:24:45.222 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.288e-05 2024-04-19T04:24:45.222 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.222 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.222 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.222 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.881245+0000", 2024-04-19T04:24:45.222 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.7370000000000003e-06 2024-04-19T04:24:45.222 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.222 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.222 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.222 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.881294+0000", 2024-04-19T04:24:45.222 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.9466999999999999e-05 2024-04-19T04:24:45.222 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.223 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.223 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.223 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.881436+0000", 2024-04-19T04:24:45.223 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000141748 2024-04-19T04:24:45.223 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.223 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.223 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.223 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.881547+0000", 2024-04-19T04:24:45.223 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000111585 2024-04-19T04:24:45.223 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.223 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.223 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:45.223 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.883187+0000", 2024-04-19T04:24:45.223 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0016401160000000001 2024-04-19T04:24:45.223 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.224 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.224 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.224 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.889491+0000", 2024-04-19T04:24:45.224 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0063039209999999997 2024-04-19T04:24:45.224 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.224 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.224 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:45.224 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.889539+0000", 2024-04-19T04:24:45.224 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.8041999999999998e-05 2024-04-19T04:24:45.224 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.224 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.224 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.224 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.889575+0000", 2024-04-19T04:24:45.224 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.5247000000000003e-05 2024-04-19T04:24:45.224 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.225 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.225 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.225 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.225 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.225 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:710 5.a 5:5b1ffcae:::benchmark_data_smithi007_19526_object709:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.225 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:44.987092+0000", 2024-04-19T04:24:45.225 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.14495143899999999, 2024-04-19T04:24:45.225 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0086748959999999996, 2024-04-19T04:24:45.225 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.225 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.225 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:45.225 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:45.225 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.225 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 710 2024-04-19T04:24:45.226 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.226 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.226 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.226 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.226 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.987092+0000", 2024-04-19T04:24:45.226 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.226 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.226 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.226 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.226 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.987092+0000", 2024-04-19T04:24:45.226 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.226 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.226 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.227 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.227 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.987091+0000", 2024-04-19T04:24:45.227 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.227 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.227 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.227 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.227 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.987167+0000", 2024-04-19T04:24:45.227 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.6244999999999999e-05 2024-04-19T04:24:45.227 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.227 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.227 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.227 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.987178+0000", 2024-04-19T04:24:45.227 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0523000000000001e-05 2024-04-19T04:24:45.227 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.227 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.228 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.228 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.987183+0000", 2024-04-19T04:24:45.228 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.3279999999999996e-06 2024-04-19T04:24:45.228 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.228 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.228 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.228 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.987227+0000", 2024-04-19T04:24:45.228 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.4237999999999999e-05 2024-04-19T04:24:45.228 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.228 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.228 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.228 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.987328+0000", 2024-04-19T04:24:45.228 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000100598 2024-04-19T04:24:45.228 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.228 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.229 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:45.229 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.987452+0000", 2024-04-19T04:24:45.229 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012405599999999999 2024-04-19T04:24:45.229 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.229 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.229 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.229 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.989715+0000", 2024-04-19T04:24:45.229 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0022629830000000001 2024-04-19T04:24:45.229 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.229 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.229 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:45.229 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.995596+0000", 2024-04-19T04:24:45.229 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0058808389999999997 2024-04-19T04:24:45.229 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.230 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.230 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:45.230 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.995694+0000", 2024-04-19T04:24:45.230 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.8465e-05 2024-04-19T04:24:45.230 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.230 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.230 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.230 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.995767+0000", 2024-04-19T04:24:45.230 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2626999999999994e-05 2024-04-19T04:24:45.231 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.231 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.231 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.231 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.231 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.231 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:711 5.5 5:aae33591:::benchmark_data_smithi007_19526_object710:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.231 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:44.987194+0000", 2024-04-19T04:24:45.231 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.14484913799999999, 2024-04-19T04:24:45.232 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0085712740000000003, 2024-04-19T04:24:45.232 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.232 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.232 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:45.232 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:45.232 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.232 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 711 2024-04-19T04:24:45.233 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.233 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.233 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.233 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.233 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.987194+0000", 2024-04-19T04:24:45.233 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.234 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.234 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.234 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.234 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.987194+0000", 2024-04-19T04:24:45.234 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.234 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.234 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.234 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.234 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.987194+0000", 2024-04-19T04:24:45.235 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:45.235 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.235 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.235 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.235 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.987338+0000", 2024-04-19T04:24:45.235 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014405200000000001 2024-04-19T04:24:45.235 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.235 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.235 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.235 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.987344+0000", 2024-04-19T04:24:45.235 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:24:45.235 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.235 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.235 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.236 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.987348+0000", 2024-04-19T04:24:45.236 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.5540000000000002e-06 2024-04-19T04:24:45.236 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.236 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.236 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.236 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.987386+0000", 2024-04-19T04:24:45.236 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8476000000000002e-05 2024-04-19T04:24:45.236 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.236 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.236 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.236 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.987479+0000", 2024-04-19T04:24:45.236 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.2921e-05 2024-04-19T04:24:45.236 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.236 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.237 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.237 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.987628+0000", 2024-04-19T04:24:45.237 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014887799999999999 2024-04-19T04:24:45.237 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.237 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.237 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.237 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.992571+0000", 2024-04-19T04:24:45.237 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0049432790000000001 2024-04-19T04:24:45.237 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.237 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.237 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:45.237 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.995605+0000", 2024-04-19T04:24:45.237 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0030335850000000001 2024-04-19T04:24:45.237 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.237 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.238 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:45.238 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.995689+0000", 2024-04-19T04:24:45.238 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.4079999999999995e-05 2024-04-19T04:24:45.238 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.238 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.238 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.238 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.995766+0000", 2024-04-19T04:24:45.238 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.6803000000000003e-05 2024-04-19T04:24:45.238 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.238 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.238 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.238 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.238 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.238 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:720 5.c 5:38b90c9f:::benchmark_data_smithi007_19526_object719:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.239 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:44.990406+0000", 2024-04-19T04:24:45.239 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.14163773499999999, 2024-04-19T04:24:45.239 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0087731500000000004, 2024-04-19T04:24:45.239 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.239 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.239 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:45.239 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:45.239 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.239 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 720 2024-04-19T04:24:45.239 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.239 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.239 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.239 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.239 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.990406+0000", 2024-04-19T04:24:45.240 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.240 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.240 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.240 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.240 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.990406+0000", 2024-04-19T04:24:45.240 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.240 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.240 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.240 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.240 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.990405+0000", 2024-04-19T04:24:45.240 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.240 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.240 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.240 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.241 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.990455+0000", 2024-04-19T04:24:45.241 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.0661999999999997e-05 2024-04-19T04:24:45.241 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.241 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.241 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.241 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.990469+0000", 2024-04-19T04:24:45.241 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3271999999999999e-05 2024-04-19T04:24:45.241 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.241 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.241 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.241 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.990475+0000", 2024-04-19T04:24:45.241 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7569999999999998e-06 2024-04-19T04:24:45.241 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.241 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.242 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.242 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.990523+0000", 2024-04-19T04:24:45.242 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7982000000000002e-05 2024-04-19T04:24:45.242 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.242 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.242 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.242 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.990640+0000", 2024-04-19T04:24:45.242 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000116248 2024-04-19T04:24:45.242 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.242 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.242 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.242 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.990740+0000", 2024-04-19T04:24:45.242 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000100691 2024-04-19T04:24:45.242 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.243 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.243 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.243 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.998123+0000", 2024-04-19T04:24:45.243 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0073829229999999996 2024-04-19T04:24:45.243 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.243 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.243 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:45.243 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.999108+0000", 2024-04-19T04:24:45.243 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00098437299999999998 2024-04-19T04:24:45.243 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.243 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.243 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:45.243 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.999151+0000", 2024-04-19T04:24:45.243 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.3013999999999998e-05 2024-04-19T04:24:45.244 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.244 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.244 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.244 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.999179+0000", 2024-04-19T04:24:45.244 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.8242000000000002e-05 2024-04-19T04:24:45.244 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.244 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.244 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.244 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.244 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.244 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:721 5.3 5:c291622e:::benchmark_data_smithi007_19526_object720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.244 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:44.990488+0000", 2024-04-19T04:24:45.244 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.14155558900000001, 2024-04-19T04:24:45.244 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0096074669999999997, 2024-04-19T04:24:45.245 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.245 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.245 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:45.245 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:45.245 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.245 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 721 2024-04-19T04:24:45.245 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.245 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.245 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.245 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.245 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.990488+0000", 2024-04-19T04:24:45.245 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.245 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.245 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.245 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.246 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.990488+0000", 2024-04-19T04:24:45.246 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.246 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.246 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.246 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.246 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.990487+0000", 2024-04-19T04:24:45.246 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:45.246 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.246 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.246 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.246 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.990548+0000", 2024-04-19T04:24:45.246 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.0446999999999999e-05 2024-04-19T04:24:45.246 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.247 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.247 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.247 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.990557+0000", 2024-04-19T04:24:45.247 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.3440000000000007e-06 2024-04-19T04:24:45.247 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.247 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.247 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.247 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.990564+0000", 2024-04-19T04:24:45.247 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2799999999999998e-06 2024-04-19T04:24:45.247 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.247 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.247 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.247 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.990599+0000", 2024-04-19T04:24:45.247 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.4629999999999999e-05 2024-04-19T04:24:45.248 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.248 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.248 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.248 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.990680+0000", 2024-04-19T04:24:45.248 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.0673999999999994e-05 2024-04-19T04:24:45.248 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.248 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.248 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.248 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.990754+0000", 2024-04-19T04:24:45.248 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.4405000000000003e-05 2024-04-19T04:24:45.248 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.248 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.248 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.249 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.997887+0000", 2024-04-19T04:24:45.249 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0071326109999999996 2024-04-19T04:24:45.249 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.249 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.249 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:45.249 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.999954+0000", 2024-04-19T04:24:45.249 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0020672619999999998 2024-04-19T04:24:45.249 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.249 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.249 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:45.250 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.000043+0000", 2024-04-19T04:24:45.250 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.9375000000000004e-05 2024-04-19T04:24:45.250 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.250 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.250 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.250 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.000095+0000", 2024-04-19T04:24:45.250 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2028999999999999e-05 2024-04-19T04:24:45.250 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.250 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.250 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.250 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.250 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.250 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:722 5.4 e22/20 5:2b205001:::benchmark_data_smithi007_19526_object721:head v 22'49, mlcod=22'46)", 2024-04-19T04:24:45.250 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:44.991112+0000", 2024-04-19T04:24:45.251 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.14093167000000001, 2024-04-19T04:24:45.251 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0080987109999999998, 2024-04-19T04:24:45.251 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.251 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.251 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.251 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.251 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.251 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.991112+0000", 2024-04-19T04:24:45.251 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.252 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.252 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.252 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.252 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.991112+0000", 2024-04-19T04:24:45.252 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.252 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.252 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.252 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.252 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.991111+0000", 2024-04-19T04:24:45.252 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:45.252 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.252 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.252 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.252 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.991158+0000", 2024-04-19T04:24:45.253 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7589999999999997e-05 2024-04-19T04:24:45.253 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.253 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.253 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.253 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.991208+0000", 2024-04-19T04:24:45.253 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.9852000000000003e-05 2024-04-19T04:24:45.253 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.253 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.253 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.253 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.991219+0000", 2024-04-19T04:24:45.253 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0892e-05 2024-04-19T04:24:45.253 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.253 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.253 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.253 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.991245+0000", 2024-04-19T04:24:45.254 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.5996999999999999e-05 2024-04-19T04:24:45.254 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.254 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.254 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.254 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.991263+0000", 2024-04-19T04:24:45.254 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8598e-05 2024-04-19T04:24:45.254 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.254 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.254 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:45.254 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.999183+0000", 2024-04-19T04:24:45.254 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0079190389999999992 2024-04-19T04:24:45.254 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.254 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.255 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.255 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.999211+0000", 2024-04-19T04:24:45.255 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.8027000000000001e-05 2024-04-19T04:24:45.255 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.255 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.255 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.255 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.255 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.255 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:726 5.a 5:5dd825a8:::benchmark_data_smithi007_19526_object725:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.255 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:44.996209+0000", 2024-04-19T04:24:45.255 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.13583494600000001, 2024-04-19T04:24:45.255 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0083045259999999996, 2024-04-19T04:24:45.255 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.256 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.256 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:45.256 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:45.256 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.256 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 726 2024-04-19T04:24:45.256 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.256 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.256 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.256 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.256 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.996209+0000", 2024-04-19T04:24:45.256 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.256 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.256 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.256 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.256 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.996209+0000", 2024-04-19T04:24:45.257 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.257 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.257 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.257 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.257 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.996207+0000", 2024-04-19T04:24:45.257 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999981 2024-04-19T04:24:45.257 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.257 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.257 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.257 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.996299+0000", 2024-04-19T04:24:45.257 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.2627999999999995e-05 2024-04-19T04:24:45.257 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.257 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.257 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.258 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.996315+0000", 2024-04-19T04:24:45.258 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.5896000000000002e-05 2024-04-19T04:24:45.258 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.258 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.258 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.258 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.996324+0000", 2024-04-19T04:24:45.258 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.2469999999999997e-06 2024-04-19T04:24:45.258 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.258 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.258 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.258 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.996398+0000", 2024-04-19T04:24:45.258 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3170999999999995e-05 2024-04-19T04:24:45.258 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.259 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.259 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.259 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.996589+0000", 2024-04-19T04:24:45.259 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00019130500000000001 2024-04-19T04:24:45.259 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.259 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.259 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:45.259 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.996729+0000", 2024-04-19T04:24:45.259 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013970899999999999 2024-04-19T04:24:45.259 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.259 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.259 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:45.259 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.000356+0000", 2024-04-19T04:24:45.259 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.003627094 2024-04-19T04:24:45.259 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.260 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.260 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.260 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.004372+0000", 2024-04-19T04:24:45.260 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0040166790000000004 2024-04-19T04:24:45.260 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.260 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.260 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:45.260 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.004451+0000", 2024-04-19T04:24:45.260 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.8508000000000001e-05 2024-04-19T04:24:45.260 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.260 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.260 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.260 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.004513+0000", 2024-04-19T04:24:45.260 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.2119000000000006e-05 2024-04-19T04:24:45.261 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.261 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.261 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.261 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.261 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.261 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:738 5.a 5:576874ac:::benchmark_data_smithi007_19526_object737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.261 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:44.999631+0000", 2024-04-19T04:24:45.261 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.13241245200000001, 2024-04-19T04:24:45.261 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0084090480000000006, 2024-04-19T04:24:45.262 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:45.262 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.262 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:45.262 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:45.262 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.262 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 738 2024-04-19T04:24:45.262 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.263 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:45.263 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.263 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:45.263 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.999631+0000", 2024-04-19T04:24:45.263 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.263 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.263 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.263 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:45.263 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.999631+0000", 2024-04-19T04:24:45.263 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:45.263 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.263 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.263 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:45.263 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.999630+0000", 2024-04-19T04:24:45.264 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.264 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.264 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.264 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:45.264 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.999682+0000", 2024-04-19T04:24:45.264 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2320000000000001e-05 2024-04-19T04:24:45.264 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.264 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.264 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:45.264 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.999693+0000", 2024-04-19T04:24:45.264 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0285999999999999e-05 2024-04-19T04:24:45.264 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.264 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.264 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.264 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.999705+0000", 2024-04-19T04:24:45.265 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2303000000000001e-05 2024-04-19T04:24:45.265 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.265 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.265 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:45.265 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.999743+0000", 2024-04-19T04:24:45.265 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.7800999999999999e-05 2024-04-19T04:24:45.265 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.265 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.265 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:45.265 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.999847+0000", 2024-04-19T04:24:45.265 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000104524 2024-04-19T04:24:45.265 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.265 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.265 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:45.266 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:44.999922+0000", 2024-04-19T04:24:45.266 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.4536999999999995e-05 2024-04-19T04:24:45.266 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.266 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.266 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:45.266 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.005773+0000", 2024-04-19T04:24:45.266 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0058511049999999997 2024-04-19T04:24:45.266 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.266 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.266 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.266 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.007940+0000", 2024-04-19T04:24:45.266 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0021668049999999999 2024-04-19T04:24:45.266 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.266 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.267 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:45.267 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.007997+0000", 2024-04-19T04:24:45.267 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.7457000000000002e-05 2024-04-19T04:24:45.267 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:45.267 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:45.267 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:45.267 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.008040+0000", 2024-04-19T04:24:45.267 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2916e-05 2024-04-19T04:24:45.267 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.267 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.267 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.267 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:45.267 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:45.267 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:24:45.269 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:24:45.269 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:45.267+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:45.369 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:45.363+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:45.402 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:24:45.402 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:24:45.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.402 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:1943 5.4 5:21c0900c:::benchmark_data_smithi007_19526_object1942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.402 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:45.393882+0000", 2024-04-19T04:24:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0080828159999999996, 2024-04-19T04:24:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081165749999999991, 2024-04-19T04:24:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1943 2024-04-19T04:24:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.393882+0000", 2024-04-19T04:24:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.393882+0000", 2024-04-19T04:24:45.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.393882+0000", 2024-04-19T04:24:45.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:45.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.393925+0000", 2024-04-19T04:24:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3053999999999998e-05 2024-04-19T04:24:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.393931+0000", 2024-04-19T04:24:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3300000000000004e-06 2024-04-19T04:24:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.393936+0000", 2024-04-19T04:24:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5020000000000003e-06 2024-04-19T04:24:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394407+0000", 2024-04-19T04:24:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00047180799999999999 2024-04-19T04:24:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394486+0000", 2024-04-19T04:24:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8270999999999997e-05 2024-04-19T04:24:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394574+0000", 2024-04-19T04:24:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8143e-05 2024-04-19T04:24:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.396245+0000", 2024-04-19T04:24:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016715090000000001 2024-04-19T04:24:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.401928+0000", 2024-04-19T04:24:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056831090000000004 2024-04-19T04:24:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.401994+0000", 2024-04-19T04:24:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5795000000000003e-05 2024-04-19T04:24:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:1944 5.4 5:2bc2ed3e:::benchmark_data_smithi007_19526_object1943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:45.393946+0000", 2024-04-19T04:24:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0080190060000000004, 2024-04-19T04:24:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081859040000000008, 2024-04-19T04:24:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1944 2024-04-19T04:24:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.393946+0000", 2024-04-19T04:24:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.393946+0000", 2024-04-19T04:24:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.393945+0000", 2024-04-19T04:24:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394084+0000", 2024-04-19T04:24:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013872999999999999 2024-04-19T04:24:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394101+0000", 2024-04-19T04:24:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6741000000000001e-05 2024-04-19T04:24:45.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394106+0000", 2024-04-19T04:24:45.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3850000000000001e-06 2024-04-19T04:24:45.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.395153+0000", 2024-04-19T04:24:45.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010471720000000001 2024-04-19T04:24:45.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.395327+0000", 2024-04-19T04:24:45.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000173764 2024-04-19T04:24:45.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:45.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.395456+0000", 2024-04-19T04:24:45.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128532 2024-04-19T04:24:45.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.396767+0000", 2024-04-19T04:24:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001311272 2024-04-19T04:24:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:1945 5.d 5:b5feb13e:::benchmark_data_smithi007_19526_object1944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:45.394122+0000", 2024-04-19T04:24:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0078433129999999993, 2024-04-19T04:24:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080835400000000002, 2024-04-19T04:24:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1945 2024-04-19T04:24:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394122+0000", 2024-04-19T04:24:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394122+0000", 2024-04-19T04:24:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394121+0000", 2024-04-19T04:24:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394157+0000", 2024-04-19T04:24:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5837999999999998e-05 2024-04-19T04:24:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394164+0000", 2024-04-19T04:24:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4030000000000004e-06 2024-04-19T04:24:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394168+0000", 2024-04-19T04:24:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4050000000000002e-06 2024-04-19T04:24:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394207+0000", 2024-04-19T04:24:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8504999999999998e-05 2024-04-19T04:24:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394316+0000", 2024-04-19T04:24:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010923499999999999 2024-04-19T04:24:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394482+0000", 2024-04-19T04:24:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000166076 2024-04-19T04:24:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.396748+0000", 2024-04-19T04:24:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022658579999999999 2024-04-19T04:24:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:1951 5.d 5:b875426d:::benchmark_data_smithi007_19526_object1950:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:45.394290+0000", 2024-04-19T04:24:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0076747209999999998, 2024-04-19T04:24:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080012499999999997, 2024-04-19T04:24:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1951 2024-04-19T04:24:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394290+0000", 2024-04-19T04:24:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394290+0000", 2024-04-19T04:24:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394290+0000", 2024-04-19T04:24:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394394+0000", 2024-04-19T04:24:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000104431 2024-04-19T04:24:45.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394409+0000", 2024-04-19T04:24:45.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4997999999999999e-05 2024-04-19T04:24:45.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394417+0000", 2024-04-19T04:24:45.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2479999999999996e-06 2024-04-19T04:24:45.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.395054+0000", 2024-04-19T04:24:45.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00063674599999999999 2024-04-19T04:24:45.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.395199+0000", 2024-04-19T04:24:45.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145325 2024-04-19T04:24:45.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.395354+0000", 2024-04-19T04:24:45.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154473 2024-04-19T04:24:45.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.396760+0000", 2024-04-19T04:24:45.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001405688 2024-04-19T04:24:45.422 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.422 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.422 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.422 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:1952 5.d 5:b681dd43:::benchmark_data_smithi007_19526_object1951:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.422 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:45.394432+0000", 2024-04-19T04:24:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0075328180000000002, 2024-04-19T04:24:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079652899999999999, 2024-04-19T04:24:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1952 2024-04-19T04:24:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394432+0000", 2024-04-19T04:24:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394432+0000", 2024-04-19T04:24:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394431+0000", 2024-04-19T04:24:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394479+0000", 2024-04-19T04:24:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7672e-05 2024-04-19T04:24:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394490+0000", 2024-04-19T04:24:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0664e-05 2024-04-19T04:24:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394497+0000", 2024-04-19T04:24:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4370000000000001e-06 2024-04-19T04:24:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.395978+0000", 2024-04-19T04:24:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001480273 2024-04-19T04:24:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.396149+0000", 2024-04-19T04:24:45.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000171943 2024-04-19T04:24:45.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.396267+0000", 2024-04-19T04:24:45.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117395 2024-04-19T04:24:45.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.397451+0000", 2024-04-19T04:24:45.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0011845219999999999 2024-04-19T04:24:45.427 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.427 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.427 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.427 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:1953 5.d 5:b2a37543:::benchmark_data_smithi007_19526_object1952:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.427 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:45.394505+0000", 2024-04-19T04:24:45.427 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0074600339999999999, 2024-04-19T04:24:45.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080274860000000003, 2024-04-19T04:24:45.427 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.427 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:45.427 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1953 2024-04-19T04:24:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394505+0000", 2024-04-19T04:24:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394505+0000", 2024-04-19T04:24:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394504+0000", 2024-04-19T04:24:45.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394539+0000", 2024-04-19T04:24:45.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4288000000000001e-05 2024-04-19T04:24:45.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394550+0000", 2024-04-19T04:24:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0985000000000001e-05 2024-04-19T04:24:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394557+0000", 2024-04-19T04:24:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3579999999999997e-06 2024-04-19T04:24:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.396779+0000", 2024-04-19T04:24:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002222496 2024-04-19T04:24:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.396899+0000", 2024-04-19T04:24:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119935 2024-04-19T04:24:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.396991+0000", 2024-04-19T04:24:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1280999999999996e-05 2024-04-19T04:24:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.397795+0000", 2024-04-19T04:24:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00080405899999999998 2024-04-19T04:24:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:1957 5.d 5:b67a31a2:::benchmark_data_smithi007_19526_object1956:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:45.399432+0000", 2024-04-19T04:24:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002533038, 2024-04-19T04:24:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031795510000000001, 2024-04-19T04:24:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1957 2024-04-19T04:24:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.399432+0000", 2024-04-19T04:24:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.399432+0000", 2024-04-19T04:24:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.399431+0000", 2024-04-19T04:24:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.399546+0000", 2024-04-19T04:24:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000115721 2024-04-19T04:24:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.399559+0000", 2024-04-19T04:24:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3023000000000001e-05 2024-04-19T04:24:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.399566+0000", 2024-04-19T04:24:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5409999999999997e-06 2024-04-19T04:24:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.399646+0000", 2024-04-19T04:24:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9870999999999995e-05 2024-04-19T04:24:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.399771+0000", 2024-04-19T04:24:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124666 2024-04-19T04:24:45.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.399858+0000", 2024-04-19T04:24:45.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7529999999999997e-05 2024-04-19T04:24:45.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.400861+0000", 2024-04-19T04:24:45.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010034079999999999 2024-04-19T04:24:45.436 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.436 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.436 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.437 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.437 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:24:45.437 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 7 2024-04-19T04:24:45.437 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:24:45.438 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:24:45.470 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:45.467+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:45.562 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:24:45.562 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:24:45.562 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:24:45.562 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:24:45.562 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:24:45.571 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:45.566+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:45.573 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:24:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2024-04-19T04:24:45.673 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:45.667+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:45.694 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'reef'} 2024-04-19T04:24:45.694 DEBUG:teuthology.orchestra.run.smithi007:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=reef' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-04-19T04:24:45.704 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:24:45.704 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:24:45.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:24:45.704 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:24:45.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.705 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:45.705 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539530+0000", 2024-04-19T04:24:45.705 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.162980499, 2024-04-19T04:24:45.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015136197000000001, 2024-04-19T04:24:45.705 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.705 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.705 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539530+0000", 2024-04-19T04:24:45.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539530+0000", 2024-04-19T04:24:45.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539527+0000", 2024-04-19T04:24:45.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999971 2024-04-19T04:24:45.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539544+0000", 2024-04-19T04:24:45.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7082999999999999e-05 2024-04-19T04:24:45.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539567+0000", 2024-04-19T04:24:45.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3569000000000001e-05 2024-04-19T04:24:45.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539589+0000", 2024-04-19T04:24:45.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1486999999999999e-05 2024-04-19T04:24:45.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539691+0000", 2024-04-19T04:24:45.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010262 2024-04-19T04:24:45.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539876+0000", 2024-04-19T04:24:45.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000184172 2024-04-19T04:24:45.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541233+0000", 2024-04-19T04:24:45.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013569719999999999 2024-04-19T04:24:45.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547291+0000", 2024-04-19T04:24:45.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060583080000000001 2024-04-19T04:24:45.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554597+0000", 2024-04-19T04:24:45.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0073062800000000001 2024-04-19T04:24:45.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554640+0000", 2024-04-19T04:24:45.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3115999999999999e-05 2024-04-19T04:24:45.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554666+0000", 2024-04-19T04:24:45.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5400000000000001e-05 2024-04-19T04:24:45.710 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.710 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.710 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.710 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:45.710 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539646+0000", 2024-04-19T04:24:45.710 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.162863672, 2024-04-19T04:24:45.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015767644000000001, 2024-04-19T04:24:45.711 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.711 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.711 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539646+0000", 2024-04-19T04:24:45.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539646+0000", 2024-04-19T04:24:45.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539645+0000", 2024-04-19T04:24:45.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:45.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539672+0000", 2024-04-19T04:24:45.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7036999999999999e-05 2024-04-19T04:24:45.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539691+0000", 2024-04-19T04:24:45.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8929000000000001e-05 2024-04-19T04:24:45.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539707+0000", 2024-04-19T04:24:45.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5979999999999999e-05 2024-04-19T04:24:45.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542292+0000", 2024-04-19T04:24:45.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025857020000000001 2024-04-19T04:24:45.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542472+0000", 2024-04-19T04:24:45.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018001599999999999 2024-04-19T04:24:45.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543505+0000", 2024-04-19T04:24:45.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010326739999999999 2024-04-19T04:24:45.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547314+0000", 2024-04-19T04:24:45.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038089349999999998 2024-04-19T04:24:45.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555323+0000", 2024-04-19T04:24:45.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080089979999999998 2024-04-19T04:24:45.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555378+0000", 2024-04-19T04:24:45.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4951999999999998e-05 2024-04-19T04:24:45.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555414+0000", 2024-04-19T04:24:45.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5998000000000003e-05 2024-04-19T04:24:45.716 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.716 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.716 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.716 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:45.716 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539729+0000", 2024-04-19T04:24:45.716 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.162780576999999, 2024-04-19T04:24:45.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015615043, 2024-04-19T04:24:45.716 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.716 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.716 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539729+0000", 2024-04-19T04:24:45.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539729+0000", 2024-04-19T04:24:45.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539728+0000", 2024-04-19T04:24:45.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:45.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539737+0000", 2024-04-19T04:24:45.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5799999999999992e-06 2024-04-19T04:24:45.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539753+0000", 2024-04-19T04:24:45.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6373000000000001e-05 2024-04-19T04:24:45.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539770+0000", 2024-04-19T04:24:45.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7516e-05 2024-04-19T04:24:45.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542136+0000", 2024-04-19T04:24:45.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023653440000000001 2024-04-19T04:24:45.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543783+0000", 2024-04-19T04:24:45.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016468209999999999 2024-04-19T04:24:45.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543971+0000", 2024-04-19T04:24:45.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018871200000000001 2024-04-19T04:24:45.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547318+0000", 2024-04-19T04:24:45.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033471199999999999 2024-04-19T04:24:45.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555276+0000", 2024-04-19T04:24:45.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079574280000000008 2024-04-19T04:24:45.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555320+0000", 2024-04-19T04:24:45.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3664000000000001e-05 2024-04-19T04:24:45.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555344+0000", 2024-04-19T04:24:45.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4905e-05 2024-04-19T04:24:45.721 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.721 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.721 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.721 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:45.721 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539783+0000", 2024-04-19T04:24:45.721 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.162727272000001, 2024-04-19T04:24:45.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014773131, 2024-04-19T04:24:45.722 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.722 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.722 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539783+0000", 2024-04-19T04:24:45.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539783+0000", 2024-04-19T04:24:45.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539782+0000", 2024-04-19T04:24:45.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539790+0000", 2024-04-19T04:24:45.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9440000000000005e-06 2024-04-19T04:24:45.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539807+0000", 2024-04-19T04:24:45.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7036000000000001e-05 2024-04-19T04:24:45.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539822+0000", 2024-04-19T04:24:45.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4939e-05 2024-04-19T04:24:45.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539914+0000", 2024-04-19T04:24:45.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2435000000000005e-05 2024-04-19T04:24:45.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541221+0000", 2024-04-19T04:24:45.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001307358 2024-04-19T04:24:45.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541403+0000", 2024-04-19T04:24:45.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018113299999999999 2024-04-19T04:24:45.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.545434+0000", 2024-04-19T04:24:45.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040314260000000003 2024-04-19T04:24:45.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554049+0000", 2024-04-19T04:24:45.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0086145500000000003 2024-04-19T04:24:45.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554515+0000", 2024-04-19T04:24:45.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00046650899999999999 2024-04-19T04:24:45.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554556+0000", 2024-04-19T04:24:45.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0850999999999999e-05 2024-04-19T04:24:45.726 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.726 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.726 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.727 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:45.727 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:24:45.727 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.162667013, 2024-04-19T04:24:45.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018096054, 2024-04-19T04:24:45.727 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.727 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.727 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:24:45.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:24:45.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539842+0000", 2024-04-19T04:24:45.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:45.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539848+0000", 2024-04-19T04:24:45.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-19T04:24:45.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539859+0000", 2024-04-19T04:24:45.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0783e-05 2024-04-19T04:24:45.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539866+0000", 2024-04-19T04:24:45.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9439999999999999e-06 2024-04-19T04:24:45.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547400+0000", 2024-04-19T04:24:45.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075343729999999996 2024-04-19T04:24:45.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547480+0000", 2024-04-19T04:24:45.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9793e-05 2024-04-19T04:24:45.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547587+0000", 2024-04-19T04:24:45.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107333 2024-04-19T04:24:45.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.548935+0000", 2024-04-19T04:24:45.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013480639999999999 2024-04-19T04:24:45.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557892+0000", 2024-04-19T04:24:45.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089563939999999995 2024-04-19T04:24:45.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557920+0000", 2024-04-19T04:24:45.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8342000000000001e-05 2024-04-19T04:24:45.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557939+0000", 2024-04-19T04:24:45.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9142000000000001e-05 2024-04-19T04:24:45.732 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.732 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.732 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.732 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:45.732 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539872+0000", 2024-04-19T04:24:45.732 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.162637604, 2024-04-19T04:24:45.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015022429, 2024-04-19T04:24:45.732 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.732 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.732 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539872+0000", 2024-04-19T04:24:45.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539872+0000", 2024-04-19T04:24:45.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539872+0000", 2024-04-19T04:24:45.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:45.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539876+0000", 2024-04-19T04:24:45.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1999999999999996e-06 2024-04-19T04:24:45.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539886+0000", 2024-04-19T04:24:45.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9469999999999998e-06 2024-04-19T04:24:45.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539906+0000", 2024-04-19T04:24:45.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0542000000000001e-05 2024-04-19T04:24:45.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542491+0000", 2024-04-19T04:24:45.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025843530000000002 2024-04-19T04:24:45.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543411+0000", 2024-04-19T04:24:45.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00091973700000000001 2024-04-19T04:24:45.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543523+0000", 2024-04-19T04:24:45.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112323 2024-04-19T04:24:45.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.546595+0000", 2024-04-19T04:24:45.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003071631 2024-04-19T04:24:45.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554744+0000", 2024-04-19T04:24:45.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081498850000000008 2024-04-19T04:24:45.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554799+0000", 2024-04-19T04:24:45.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5067e-05 2024-04-19T04:24:45.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554895+0000", 2024-04-19T04:24:45.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5364000000000004e-05 2024-04-19T04:24:45.737 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.737 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.737 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.737 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:45.737 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:24:45.737 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.162590765000001, 2024-04-19T04:24:45.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018086631999999998, 2024-04-19T04:24:45.737 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.738 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.738 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:24:45.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:24:45.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539918+0000", 2024-04-19T04:24:45.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539931+0000", 2024-04-19T04:24:45.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2566e-05 2024-04-19T04:24:45.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539958+0000", 2024-04-19T04:24:45.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6582999999999999e-05 2024-04-19T04:24:45.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539972+0000", 2024-04-19T04:24:45.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4789e-05 2024-04-19T04:24:45.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547577+0000", 2024-04-19T04:24:45.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0076045979999999997 2024-04-19T04:24:45.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547769+0000", 2024-04-19T04:24:45.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000192034 2024-04-19T04:24:45.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547929+0000", 2024-04-19T04:24:45.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000159679 2024-04-19T04:24:45.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.548942+0000", 2024-04-19T04:24:45.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010138720000000001 2024-04-19T04:24:45.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557962+0000", 2024-04-19T04:24:45.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090199970000000001 2024-04-19T04:24:45.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557985+0000", 2024-04-19T04:24:45.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2623e-05 2024-04-19T04:24:45.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.558006+0000", 2024-04-19T04:24:45.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0764e-05 2024-04-19T04:24:45.742 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.742 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.742 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.742 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:27 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:45.742 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:24:45.742 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.162524777000002, 2024-04-19T04:24:45.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018047384, 2024-04-19T04:24:45.743 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.743 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:24:45.743 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:24:45.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:24:45.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539984+0000", 2024-04-19T04:24:45.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:45.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539991+0000", 2024-04-19T04:24:45.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7769999999999997e-06 2024-04-19T04:24:45.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540010+0000", 2024-04-19T04:24:45.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9573e-05 2024-04-19T04:24:45.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540025+0000", 2024-04-19T04:24:45.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4796e-05 2024-04-19T04:24:45.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541220+0000", 2024-04-19T04:24:45.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001195172 2024-04-19T04:24:45.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541569+0000", 2024-04-19T04:24:45.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00034836600000000002 2024-04-19T04:24:45.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.558033+0000", 2024-04-19T04:24:45.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.016464092999999999 2024-04-19T04:24:45.746 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.746 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.746 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.746 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:30 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:45.746 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.540051+0000", 2024-04-19T04:24:45.746 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.162459434999999, 2024-04-19T04:24:45.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010846148, 2024-04-19T04:24:45.746 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.747 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:24:45.747 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540051+0000", 2024-04-19T04:24:45.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540051+0000", 2024-04-19T04:24:45.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540050+0000", 2024-04-19T04:24:45.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540065+0000", 2024-04-19T04:24:45.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5392000000000001e-05 2024-04-19T04:24:45.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540083+0000", 2024-04-19T04:24:45.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7603000000000001e-05 2024-04-19T04:24:45.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540096+0000", 2024-04-19T04:24:45.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.345e-05 2024-04-19T04:24:45.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541222+0000", 2024-04-19T04:24:45.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0011259760000000001 2024-04-19T04:24:45.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541377+0000", 2024-04-19T04:24:45.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015506600000000001 2024-04-19T04:24:45.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.550897+0000", 2024-04-19T04:24:45.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0095197200000000006 2024-04-19T04:24:45.750 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.750 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.750 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.750 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:717 5.d 5:b894f9c2:::benchmark_data_smithi007_19526_object716:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.750 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:44.990030+0000", 2024-04-19T04:24:45.750 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.71248028799999996, 2024-04-19T04:24:45.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096446320000000002, 2024-04-19T04:24:45.750 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.750 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.750 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:45.751 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:45.751 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.751 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 717 2024-04-19T04:24:45.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.751 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:44.990030+0000", 2024-04-19T04:24:45.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:44.990030+0000", 2024-04-19T04:24:45.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:44.990028+0000", 2024-04-19T04:24:45.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:45.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:44.990075+0000", 2024-04-19T04:24:45.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6690999999999997e-05 2024-04-19T04:24:45.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:44.990087+0000", 2024-04-19T04:24:45.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2046e-05 2024-04-19T04:24:45.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:44.990097+0000", 2024-04-19T04:24:45.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5249999999999994e-06 2024-04-19T04:24:45.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:44.990189+0000", 2024-04-19T04:24:45.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2051000000000003e-05 2024-04-19T04:24:45.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:44.990410+0000", 2024-04-19T04:24:45.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000221876 2024-04-19T04:24:45.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:44.990601+0000", 2024-04-19T04:24:45.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019076799999999999 2024-04-19T04:24:45.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:44.994555+0000", 2024-04-19T04:24:45.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039537599999999997 2024-04-19T04:24:45.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:44.999589+0000", 2024-04-19T04:24:45.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050345260000000001 2024-04-19T04:24:45.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:44.999647+0000", 2024-04-19T04:24:45.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7525999999999998e-05 2024-04-19T04:24:45.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:44.999674+0000", 2024-04-19T04:24:45.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7341000000000001e-05 2024-04-19T04:24:45.756 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.756 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.756 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.756 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:735 5.4 5:284cabc7:::benchmark_data_smithi007_19526_object734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.756 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:44.999875+0000", 2024-04-19T04:24:45.756 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.70263545299999997, 2024-04-19T04:24:45.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010034405, 2024-04-19T04:24:45.756 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.756 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.756 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:45.756 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:45.756 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.756 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 735 2024-04-19T04:24:45.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.757 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:44.999875+0000", 2024-04-19T04:24:45.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:44.999875+0000", 2024-04-19T04:24:45.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:44.999873+0000", 2024-04-19T04:24:45.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:45.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.758 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.758 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.000003+0000", 2024-04-19T04:24:45.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012988 2024-04-19T04:24:45.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.758 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.758 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.000016+0000", 2024-04-19T04:24:45.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2561000000000001e-05 2024-04-19T04:24:45.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.758 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.000025+0000", 2024-04-19T04:24:45.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2750000000000001e-06 2024-04-19T04:24:45.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.000086+0000", 2024-04-19T04:24:45.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1223000000000007e-05 2024-04-19T04:24:45.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.000202+0000", 2024-04-19T04:24:45.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000115998 2024-04-19T04:24:45.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:45.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.000309+0000", 2024-04-19T04:24:45.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106901 2024-04-19T04:24:45.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.005610+0000", 2024-04-19T04:24:45.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053009770000000001 2024-04-19T04:24:45.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.009725+0000", 2024-04-19T04:24:45.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0041152269999999999 2024-04-19T04:24:45.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.009831+0000", 2024-04-19T04:24:45.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010535 2024-04-19T04:24:45.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.009909+0000", 2024-04-19T04:24:45.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8312000000000005e-05 2024-04-19T04:24:45.761 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.761 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.761 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.762 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:740 5.0 5:012cc313:::benchmark_data_smithi007_19526_object739:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.762 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:45.001625+0000", 2024-04-19T04:24:45.762 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.70088518899999996, 2024-04-19T04:24:45.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010103608, 2024-04-19T04:24:45.762 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.762 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.762 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:45.762 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:45.762 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.762 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 740 2024-04-19T04:24:45.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.762 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.001625+0000", 2024-04-19T04:24:45.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.001625+0000", 2024-04-19T04:24:45.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.001623+0000", 2024-04-19T04:24:45.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:45.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.001670+0000", 2024-04-19T04:24:45.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6128000000000003e-05 2024-04-19T04:24:45.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.001684+0000", 2024-04-19T04:24:45.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4228e-05 2024-04-19T04:24:45.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.001691+0000", 2024-04-19T04:24:45.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.204e-06 2024-04-19T04:24:45.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.001734+0000", 2024-04-19T04:24:45.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2957999999999998e-05 2024-04-19T04:24:45.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.001831+0000", 2024-04-19T04:24:45.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7219999999999994e-05 2024-04-19T04:24:45.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:45.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.001913+0000", 2024-04-19T04:24:45.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1988000000000002e-05 2024-04-19T04:24:45.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.766 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.010117+0000", 2024-04-19T04:24:45.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082036790000000002 2024-04-19T04:24:45.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.766 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.011610+0000", 2024-04-19T04:24:45.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0014930570000000001 2024-04-19T04:24:45.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.011661+0000", 2024-04-19T04:24:45.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0847000000000003e-05 2024-04-19T04:24:45.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.011728+0000", 2024-04-19T04:24:45.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7636000000000001e-05 2024-04-19T04:24:45.767 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.767 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.767 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.767 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:1172 5.b 5:d1acad34:::benchmark_data_smithi007_19526_object1171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.767 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:45.135280+0000", 2024-04-19T04:24:45.768 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.56722991700000003, 2024-04-19T04:24:45.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010018679000000001, 2024-04-19T04:24:45.768 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.768 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.769 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:45.769 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:45.769 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.769 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1172 2024-04-19T04:24:45.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.769 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.135280+0000", 2024-04-19T04:24:45.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.135280+0000", 2024-04-19T04:24:45.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.135279+0000", 2024-04-19T04:24:45.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:45.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.135417+0000", 2024-04-19T04:24:45.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013843199999999999 2024-04-19T04:24:45.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.771 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.135425+0000", 2024-04-19T04:24:45.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5329999999999997e-06 2024-04-19T04:24:45.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.771 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.771 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.135429+0000", 2024-04-19T04:24:45.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5770000000000004e-06 2024-04-19T04:24:45.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.771 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.771 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.135486+0000", 2024-04-19T04:24:45.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6990000000000002e-05 2024-04-19T04:24:45.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.135738+0000", 2024-04-19T04:24:45.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025205300000000002 2024-04-19T04:24:45.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:45.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.135937+0000", 2024-04-19T04:24:45.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000198844 2024-04-19T04:24:45.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.141990+0000", 2024-04-19T04:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060525459999999998 2024-04-19T04:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.145209+0000", 2024-04-19T04:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032188130000000001 2024-04-19T04:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.145263+0000", 2024-04-19T04:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4242e-05 2024-04-19T04:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.145299+0000", 2024-04-19T04:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5918999999999999e-05 2024-04-19T04:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:1173 5.b 5:d2806b34:::benchmark_data_smithi007_19526_object1172:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:45.135439+0000", 2024-04-19T04:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.567070882, 2024-04-19T04:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0099988779999999992, 2024-04-19T04:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1173 2024-04-19T04:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.135439+0000", 2024-04-19T04:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.135439+0000", 2024-04-19T04:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.135439+0000", 2024-04-19T04:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:45.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.777 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.777 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.135472+0000", 2024-04-19T04:24:45.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3524e-05 2024-04-19T04:24:45.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.777 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.777 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.135479+0000", 2024-04-19T04:24:45.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.934e-06 2024-04-19T04:24:45.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.777 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.777 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.135483+0000", 2024-04-19T04:24:45.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9389999999999999e-06 2024-04-19T04:24:45.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.778 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.136576+0000", 2024-04-19T04:24:45.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010933500000000001 2024-04-19T04:24:45.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.778 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.136712+0000", 2024-04-19T04:24:45.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013562599999999999 2024-04-19T04:24:45.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:45.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.136827+0000", 2024-04-19T04:24:45.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000115151 2024-04-19T04:24:45.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.142045+0000", 2024-04-19T04:24:45.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052180610000000004 2024-04-19T04:24:45.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.145340+0000", 2024-04-19T04:24:45.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032943769999999998 2024-04-19T04:24:45.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.145400+0000", 2024-04-19T04:24:45.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0441e-05 2024-04-19T04:24:45.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.145438+0000", 2024-04-19T04:24:45.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7987000000000001e-05 2024-04-19T04:24:45.780 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.780 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.780 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.780 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:1486 5.8 5:177beae8:::benchmark_data_smithi007_19526_object1485:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.781 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:45.236851+0000", 2024-04-19T04:24:45.781 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.46565931199999999, 2024-04-19T04:24:45.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011532138000000001, 2024-04-19T04:24:45.781 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.781 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.781 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:45.781 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:45.781 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.781 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1486 2024-04-19T04:24:45.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.782 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.782 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.236851+0000", 2024-04-19T04:24:45.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.782 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.236851+0000", 2024-04-19T04:24:45.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.236850+0000", 2024-04-19T04:24:45.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.236934+0000", 2024-04-19T04:24:45.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4574999999999996e-05 2024-04-19T04:24:45.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.236944+0000", 2024-04-19T04:24:45.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9000000000000001e-06 2024-04-19T04:24:45.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.236952+0000", 2024-04-19T04:24:45.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5800000000000003e-06 2024-04-19T04:24:45.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237775+0000", 2024-04-19T04:24:45.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00082350700000000002 2024-04-19T04:24:45.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237933+0000", 2024-04-19T04:24:45.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015765000000000001 2024-04-19T04:24:45.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:45.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.238212+0000", 2024-04-19T04:24:45.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027868599999999999 2024-04-19T04:24:45.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.241800+0000", 2024-04-19T04:24:45.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035879900000000001 2024-04-19T04:24:45.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.248203+0000", 2024-04-19T04:24:45.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0064031840000000001 2024-04-19T04:24:45.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.248302+0000", 2024-04-19T04:24:45.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9427999999999997e-05 2024-04-19T04:24:45.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.248383+0000", 2024-04-19T04:24:45.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0538999999999996e-05 2024-04-19T04:24:45.787 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.787 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.787 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.787 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:1489 5.8 5:1c1d000a:::benchmark_data_smithi007_19526_object1488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.787 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:45.237312+0000", 2024-04-19T04:24:45.787 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.46519837800000002, 2024-04-19T04:24:45.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012162592999999999, 2024-04-19T04:24:45.787 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.787 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.788 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:45.788 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:45.788 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.788 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1489 2024-04-19T04:24:45.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.788 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237312+0000", 2024-04-19T04:24:45.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237312+0000", 2024-04-19T04:24:45.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237311+0000", 2024-04-19T04:24:45.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237379+0000", 2024-04-19T04:24:45.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7903000000000004e-05 2024-04-19T04:24:45.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.790 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237388+0000", 2024-04-19T04:24:45.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7110000000000007e-06 2024-04-19T04:24:45.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.790 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237398+0000", 2024-04-19T04:24:45.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4029999999999996e-06 2024-04-19T04:24:45.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.238849+0000", 2024-04-19T04:24:45.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001451461 2024-04-19T04:24:45.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.238942+0000", 2024-04-19T04:24:45.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3009000000000003e-05 2024-04-19T04:24:45.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:45.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.239037+0000", 2024-04-19T04:24:45.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4748999999999997e-05 2024-04-19T04:24:45.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.242004+0000", 2024-04-19T04:24:45.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029668810000000002 2024-04-19T04:24:45.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.249368+0000", 2024-04-19T04:24:45.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0073641419999999997 2024-04-19T04:24:45.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.249427+0000", 2024-04-19T04:24:45.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8761000000000002e-05 2024-04-19T04:24:45.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.249474+0000", 2024-04-19T04:24:45.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7602000000000003e-05 2024-04-19T04:24:45.794 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.794 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.794 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.794 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:1490 5.0 5:0c323df6:::benchmark_data_smithi007_19526_object1489:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.794 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:45.237409+0000", 2024-04-19T04:24:45.794 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.465100662, 2024-04-19T04:24:45.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012295823000000001, 2024-04-19T04:24:45.794 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.794 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.794 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:45.794 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:45.795 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.795 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1490 2024-04-19T04:24:45.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.795 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237409+0000", 2024-04-19T04:24:45.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237409+0000", 2024-04-19T04:24:45.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237408+0000", 2024-04-19T04:24:45.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237453+0000", 2024-04-19T04:24:45.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4221000000000002e-05 2024-04-19T04:24:45.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237462+0000", 2024-04-19T04:24:45.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5149999999999995e-06 2024-04-19T04:24:45.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237469+0000", 2024-04-19T04:24:45.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9770000000000003e-06 2024-04-19T04:24:45.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.238922+0000", 2024-04-19T04:24:45.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001452535 2024-04-19T04:24:45.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.239029+0000", 2024-04-19T04:24:45.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107217 2024-04-19T04:24:45.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:45.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.239158+0000", 2024-04-19T04:24:45.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012859699999999999 2024-04-19T04:24:45.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.241822+0000", 2024-04-19T04:24:45.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026646299999999999 2024-04-19T04:24:45.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.249609+0000", 2024-04-19T04:24:45.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077870609999999996 2024-04-19T04:24:45.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.249663+0000", 2024-04-19T04:24:45.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3794e-05 2024-04-19T04:24:45.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.249705+0000", 2024-04-19T04:24:45.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2125000000000001e-05 2024-04-19T04:24:45.800 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.800 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.800 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.800 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:1953 5.d 5:b2a37543:::benchmark_data_smithi007_19526_object1952:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.800 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:45.394505+0000", 2024-04-19T04:24:45.800 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.30800492400000001, 2024-04-19T04:24:45.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010189393, 2024-04-19T04:24:45.800 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.800 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:45.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:45.801 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.801 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1953 2024-04-19T04:24:45.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.801 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394505+0000", 2024-04-19T04:24:45.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394505+0000", 2024-04-19T04:24:45.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394504+0000", 2024-04-19T04:24:45.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394539+0000", 2024-04-19T04:24:45.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4288000000000001e-05 2024-04-19T04:24:45.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394550+0000", 2024-04-19T04:24:45.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0985000000000001e-05 2024-04-19T04:24:45.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.394557+0000", 2024-04-19T04:24:45.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3579999999999997e-06 2024-04-19T04:24:45.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.396779+0000", 2024-04-19T04:24:45.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002222496 2024-04-19T04:24:45.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.396899+0000", 2024-04-19T04:24:45.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119935 2024-04-19T04:24:45.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:45.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.396991+0000", 2024-04-19T04:24:45.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1280999999999996e-05 2024-04-19T04:24:45.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.397795+0000", 2024-04-19T04:24:45.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00080405899999999998 2024-04-19T04:24:45.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.404574+0000", 2024-04-19T04:24:45.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0067792570000000003 2024-04-19T04:24:45.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.404641+0000", 2024-04-19T04:24:45.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6512000000000003e-05 2024-04-19T04:24:45.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.404694+0000", 2024-04-19T04:24:45.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3946000000000002e-05 2024-04-19T04:24:45.806 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.806 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.806 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.806 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:2314 5.8 5:1d03d455:::benchmark_data_smithi007_19526_object2313:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.806 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:45.518929+0000", 2024-04-19T04:24:45.806 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.183580943, 2024-04-19T04:24:45.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0097618600000000007, 2024-04-19T04:24:45.806 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.807 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.807 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:45.807 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:45.807 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.807 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 2314 2024-04-19T04:24:45.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.807 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.518929+0000", 2024-04-19T04:24:45.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.518929+0000", 2024-04-19T04:24:45.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.518928+0000", 2024-04-19T04:24:45.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.519010+0000", 2024-04-19T04:24:45.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1951000000000002e-05 2024-04-19T04:24:45.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.519030+0000", 2024-04-19T04:24:45.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9470000000000002e-05 2024-04-19T04:24:45.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.519036+0000", 2024-04-19T04:24:45.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.348e-06 2024-04-19T04:24:45.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.519073+0000", 2024-04-19T04:24:45.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6964e-05 2024-04-19T04:24:45.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.519178+0000", 2024-04-19T04:24:45.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010537800000000001 2024-04-19T04:24:45.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:45.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.519289+0000", 2024-04-19T04:24:45.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110554 2024-04-19T04:24:45.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.520503+0000", 2024-04-19T04:24:45.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001214695 2024-04-19T04:24:45.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.528536+0000", 2024-04-19T04:24:45.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080324799999999998 2024-04-19T04:24:45.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.528657+0000", 2024-04-19T04:24:45.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121494 2024-04-19T04:24:45.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.528691+0000", 2024-04-19T04:24:45.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3500000000000001e-05 2024-04-19T04:24:45.812 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.812 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.812 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.813 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:2325 5.0 5:0ce891be:::benchmark_data_smithi007_19526_object2324:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:45.813 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:45.522062+0000", 2024-04-19T04:24:45.813 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.18044771100000001, 2024-04-19T04:24:45.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0099735959999999995, 2024-04-19T04:24:45.813 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:45.813 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:45.813 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:45.813 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:45.813 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.813 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 2325 2024-04-19T04:24:45.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.813 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:45.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:45.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.522062+0000", 2024-04-19T04:24:45.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:45.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.522062+0000", 2024-04-19T04:24:45.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:45.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:45.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.522061+0000", 2024-04-19T04:24:45.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:45.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:45.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.522123+0000", 2024-04-19T04:24:45.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2068000000000003e-05 2024-04-19T04:24:45.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:45.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.522137+0000", 2024-04-19T04:24:45.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.384e-05 2024-04-19T04:24:45.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.522147+0000", 2024-04-19T04:24:45.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0327e-05 2024-04-19T04:24:45.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:45.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.522201+0000", 2024-04-19T04:24:45.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3536999999999999e-05 2024-04-19T04:24:45.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:45.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.522358+0000", 2024-04-19T04:24:45.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015680499999999999 2024-04-19T04:24:45.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:45.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.522530+0000", 2024-04-19T04:24:45.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017210700000000001 2024-04-19T04:24:45.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:45.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.524498+0000", 2024-04-19T04:24:45.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019683130000000002 2024-04-19T04:24:45.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.531963+0000", 2024-04-19T04:24:45.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074647170000000001 2024-04-19T04:24:45.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:45.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.532006+0000", 2024-04-19T04:24:45.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2979000000000003e-05 2024-04-19T04:24:45.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:45.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:45.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:45.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.532036+0000", 2024-04-19T04:24:45.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0176e-05 2024-04-19T04:24:45.819 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.819 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.819 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.819 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:45.819 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:45.819 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:24:45.820 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 1 16 3014 2998 187.361 187.375 0.00260291 0.00531123 2024-04-19T04:24:45.821 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:45.815+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:45.821 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:24:45.921 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:45.919+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:45.955 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:45.955 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:24:45.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.955 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:3625 5.1 5:888a16b3:::benchmark_data_smithi007_19526_object3624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T04:24:45.955 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:45.951983+0000", 2024-04-19T04:24:45.955 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0028943979999999998, 2024-04-19T04:24:45.955 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0029421489999999998, 2024-04-19T04:24:45.955 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:45.956 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:45.956 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:45.956 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:45.956 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.956 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 3625 2024-04-19T04:24:45.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.956 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:45.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:45.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.951983+0000", 2024-04-19T04:24:45.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:45.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.951983+0000", 2024-04-19T04:24:45.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:45.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.951983+0000", 2024-04-19T04:24:45.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:45.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:45.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952026+0000", 2024-04-19T04:24:45.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2926999999999997e-05 2024-04-19T04:24:45.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:45.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952033+0000", 2024-04-19T04:24:45.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4490000000000002e-06 2024-04-19T04:24:45.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952038+0000", 2024-04-19T04:24:45.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6500000000000004e-06 2024-04-19T04:24:45.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:45.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953046+0000", 2024-04-19T04:24:45.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001007836 2024-04-19T04:24:45.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.959 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:45.959 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953255+0000", 2024-04-19T04:24:45.959 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00020917599999999999 2024-04-19T04:24:45.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.959 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.959 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:45.959 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953468+0000", 2024-04-19T04:24:45.959 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000213074 2024-04-19T04:24:45.959 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.959 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:45.959 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.959 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.959 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:3621 5.5 e23/20 5:ab2e3b65:::benchmark_data_smithi007_19526_object3620:head v 23'209, mlcod=23'207)", 2024-04-19T04:24:45.960 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:45.952280+0000", 2024-04-19T04:24:45.960 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00259786, 2024-04-19T04:24:45.960 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027216110000000001, 2024-04-19T04:24:45.960 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:45.960 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:45.960 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:45.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.960 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:45.960 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952280+0000", 2024-04-19T04:24:45.960 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.960 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:45.960 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952280+0000", 2024-04-19T04:24:45.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:45.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952279+0000", 2024-04-19T04:24:45.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:45.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952332+0000", 2024-04-19T04:24:45.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2754999999999999e-05 2024-04-19T04:24:45.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:45.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952341+0000", 2024-04-19T04:24:45.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1719999999999996e-06 2024-04-19T04:24:45.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952346+0000", 2024-04-19T04:24:45.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1939999999999997e-06 2024-04-19T04:24:45.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:45.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952400+0000", 2024-04-19T04:24:45.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3905e-05 2024-04-19T04:24:45.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:45.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952414+0000", 2024-04-19T04:24:45.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3579e-05 2024-04-19T04:24:45.963 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.963 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:45.963 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.963 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:3628 5.9 5:9915f0eb:::benchmark_data_smithi007_19526_object3627:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T04:24:45.963 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:45.952230+0000", 2024-04-19T04:24:45.963 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0026473159999999998, 2024-04-19T04:24:45.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028268220000000001, 2024-04-19T04:24:45.963 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:45.963 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:45.963 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:45.964 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:45.964 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.964 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 3628 2024-04-19T04:24:45.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.964 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:45.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:45.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952230+0000", 2024-04-19T04:24:45.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:45.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952230+0000", 2024-04-19T04:24:45.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.965 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:45.965 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952229+0000", 2024-04-19T04:24:45.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.965 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:45.965 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952379+0000", 2024-04-19T04:24:45.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014954599999999999 2024-04-19T04:24:45.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.965 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:45.965 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952392+0000", 2024-04-19T04:24:45.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2872e-05 2024-04-19T04:24:45.966 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.966 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.966 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952400+0000", 2024-04-19T04:24:45.966 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.8829999999999995e-06 2024-04-19T04:24:45.966 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.966 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:45.966 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952895+0000", 2024-04-19T04:24:45.966 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00049411500000000005 2024-04-19T04:24:45.966 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.966 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:45.966 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953025+0000", 2024-04-19T04:24:45.966 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013040799999999999 2024-04-19T04:24:45.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:45.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953199+0000", 2024-04-19T04:24:45.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017406600000000001 2024-04-19T04:24:45.967 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.967 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:45.967 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.967 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:3620 5.c e23/20 5:3ce9ee40:::benchmark_data_smithi007_19526_object3619:head v 23'220, mlcod=23'218)", 2024-04-19T04:24:45.967 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:45.952379+0000", 2024-04-19T04:24:45.967 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0024982519999999999, 2024-04-19T04:24:45.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027333779999999998, 2024-04-19T04:24:45.967 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:45.968 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:45.968 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:45.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:45.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952379+0000", 2024-04-19T04:24:45.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:45.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952379+0000", 2024-04-19T04:24:45.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:45.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952379+0000", 2024-04-19T04:24:45.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:45.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:45.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952515+0000", 2024-04-19T04:24:45.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013558900000000001 2024-04-19T04:24:45.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:45.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952524+0000", 2024-04-19T04:24:45.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9189999999999994e-06 2024-04-19T04:24:45.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952530+0000", 2024-04-19T04:24:45.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2270000000000001e-06 2024-04-19T04:24:45.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:45.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952583+0000", 2024-04-19T04:24:45.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3173000000000001e-05 2024-04-19T04:24:45.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.971 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:45.971 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952620+0000", 2024-04-19T04:24:45.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6702999999999997e-05 2024-04-19T04:24:45.971 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.971 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:45.971 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.971 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:3624 5.d e23/20 5:b4a25dfb:::benchmark_data_smithi007_19526_object3623:head v 23'212, mlcod=23'210)", 2024-04-19T04:24:45.971 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:45.952892+0000", 2024-04-19T04:24:45.971 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0019857, 2024-04-19T04:24:45.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002267505, 2024-04-19T04:24:45.971 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:45.972 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:45.972 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:45.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:45.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952892+0000", 2024-04-19T04:24:45.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:45.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952892+0000", 2024-04-19T04:24:45.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:45.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952891+0000", 2024-04-19T04:24:45.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:45.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952946+0000", 2024-04-19T04:24:45.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5339e-05 2024-04-19T04:24:45.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:45.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952961+0000", 2024-04-19T04:24:45.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4531e-05 2024-04-19T04:24:45.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.974 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952969+0000", 2024-04-19T04:24:45.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1340000000000004e-06 2024-04-19T04:24:45.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.974 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:45.974 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953023+0000", 2024-04-19T04:24:45.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3950999999999999e-05 2024-04-19T04:24:45.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.974 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:45.974 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953077+0000", 2024-04-19T04:24:45.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4138000000000002e-05 2024-04-19T04:24:45.974 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.974 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:45.974 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.975 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:3627 5.6 e23/20 5:63ed250a:::benchmark_data_smithi007_19526_object3626:head v 23'228, mlcod=23'226)", 2024-04-19T04:24:45.975 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:45.952939+0000", 2024-04-19T04:24:45.975 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0019382010000000001, 2024-04-19T04:24:45.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0022647959999999999, 2024-04-19T04:24:45.975 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:45.975 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:45.975 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:45.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.975 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:45.975 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952939+0000", 2024-04-19T04:24:45.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:45.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952939+0000", 2024-04-19T04:24:45.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:45.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952938+0000", 2024-04-19T04:24:45.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:45.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953036+0000", 2024-04-19T04:24:45.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7416000000000004e-05 2024-04-19T04:24:45.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:45.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953069+0000", 2024-04-19T04:24:45.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.3247999999999997e-05 2024-04-19T04:24:45.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953079+0000", 2024-04-19T04:24:45.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8800000000000003e-06 2024-04-19T04:24:45.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:45.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953126+0000", 2024-04-19T04:24:45.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7376000000000002e-05 2024-04-19T04:24:45.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.978 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.978 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:45.978 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953140+0000", 2024-04-19T04:24:45.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4171e-05 2024-04-19T04:24:45.978 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.978 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:45.978 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.978 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.978 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:3622 5.c e23/20 5:385a5f95:::benchmark_data_smithi007_19526_object3621:head v 23'221, mlcod=23'218)", 2024-04-19T04:24:45.978 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:45.953586+0000", 2024-04-19T04:24:45.978 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001291476, 2024-04-19T04:24:45.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001662918, 2024-04-19T04:24:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953586+0000", 2024-04-19T04:24:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953586+0000", 2024-04-19T04:24:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953585+0000", 2024-04-19T04:24:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953644+0000", 2024-04-19T04:24:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8697999999999999e-05 2024-04-19T04:24:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953655+0000", 2024-04-19T04:24:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1357e-05 2024-04-19T04:24:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953662+0000", 2024-04-19T04:24:45.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.002e-06 2024-04-19T04:24:45.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.981 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:45.981 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953747+0000", 2024-04-19T04:24:45.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4684000000000004e-05 2024-04-19T04:24:45.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.981 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:45.981 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.953779+0000", 2024-04-19T04:24:45.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2055999999999999e-05 2024-04-19T04:24:45.981 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.981 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:45.981 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.982 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:3630 5.1 5:8a89afbd:::benchmark_data_smithi007_19526_object3629:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T04:24:45.982 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:45.954693+0000", 2024-04-19T04:24:45.982 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00018464999999999999, 2024-04-19T04:24:45.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00062657000000000001, 2024-04-19T04:24:45.982 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:45.982 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:45.982 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:45.982 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:45.982 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.982 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 3630 2024-04-19T04:24:45.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.982 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:45.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:45.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.954693+0000", 2024-04-19T04:24:45.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:45.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.954693+0000", 2024-04-19T04:24:45.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:45.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.954692+0000", 2024-04-19T04:24:45.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:45.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:45.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.954770+0000", 2024-04-19T04:24:45.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8274000000000003e-05 2024-04-19T04:24:45.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:45.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.954787+0000", 2024-04-19T04:24:45.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6714e-05 2024-04-19T04:24:45.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.954795+0000", 2024-04-19T04:24:45.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.875e-06 2024-04-19T04:24:45.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:45.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.954838+0000", 2024-04-19T04:24:45.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3643000000000002e-05 2024-04-19T04:24:45.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:45.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.954917+0000", 2024-04-19T04:24:45.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8582000000000001e-05 2024-04-19T04:24:45.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:45.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.954991+0000", 2024-04-19T04:24:45.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4517999999999994e-05 2024-04-19T04:24:45.986 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.986 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:45.986 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.986 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:3628 5.9 e23/20)", 2024-04-19T04:24:45.986 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:45.955292+0000", 2024-04-19T04:24:45.986 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9995861, 2024-04-19T04:24:45.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5636999999999993e-05, 2024-04-19T04:24:45.986 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:45.986 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:45.986 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:45.987 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.987 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:45.987 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.955292+0000", 2024-04-19T04:24:45.987 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.987 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.987 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:45.987 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.955292+0000", 2024-04-19T04:24:45.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:45.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.955291+0000", 2024-04-19T04:24:45.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:45.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.955296+0000", 2024-04-19T04:24:45.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8389999999999997e-06 2024-04-19T04:24:45.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:45.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.955304+0000", 2024-04-19T04:24:45.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7959999999999996e-06 2024-04-19T04:24:45.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.989 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.989 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.955309+0000", 2024-04-19T04:24:45.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1390000000000003e-06 2024-04-19T04:24:45.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.989 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:45.989 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.955364+0000", 2024-04-19T04:24:45.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4777000000000001e-05 2024-04-19T04:24:45.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.989 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:45.989 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.955377+0000", 2024-04-19T04:24:45.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.306e-05 2024-04-19T04:24:45.990 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.990 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:45.990 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.990 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.990 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:3616 5.f 5:f15b760d:::benchmark_data_smithi007_19526_object3615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T04:24:45.990 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:45.951369+0000", 2024-04-19T04:24:45.990 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.003508597, 2024-04-19T04:24:45.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040612290000000004, 2024-04-19T04:24:45.990 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:45.990 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:45.990 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:45.990 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:45.991 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.991 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 3616 2024-04-19T04:24:45.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.991 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:45.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:45.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.951369+0000", 2024-04-19T04:24:45.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:45.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.951369+0000", 2024-04-19T04:24:45.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:45.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.951368+0000", 2024-04-19T04:24:45.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:45.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:45.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.951405+0000", 2024-04-19T04:24:45.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6511999999999999e-05 2024-04-19T04:24:45.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:45.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.951414+0000", 2024-04-19T04:24:45.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.132e-06 2024-04-19T04:24:45.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.951425+0000", 2024-04-19T04:24:45.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0971999999999999e-05 2024-04-19T04:24:45.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:45.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952211+0000", 2024-04-19T04:24:45.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00078619099999999999 2024-04-19T04:24:45.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:45.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952643+0000", 2024-04-19T04:24:45.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00043211500000000001 2024-04-19T04:24:45.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:45.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952739+0000", 2024-04-19T04:24:45.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.645e-05 2024-04-19T04:24:45.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:45.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.954913+0000", 2024-04-19T04:24:45.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0021734800000000002 2024-04-19T04:24:45.994 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.994 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:45.994 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.994 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:3623 5.1 5:857196a3:::benchmark_data_smithi007_19526_object3622:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T04:24:45.995 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:45.951861+0000", 2024-04-19T04:24:45.995 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0030164889999999998, 2024-04-19T04:24:45.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00363256, 2024-04-19T04:24:45.995 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:45.995 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:45.995 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:45.995 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:45.995 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:45.995 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 3623 2024-04-19T04:24:45.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.995 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:45.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.995 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:45.995 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.951861+0000", 2024-04-19T04:24:45.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:45.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.951861+0000", 2024-04-19T04:24:45.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:45.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:45.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.951860+0000", 2024-04-19T04:24:45.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:45.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:45.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.951937+0000", 2024-04-19T04:24:45.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6817999999999995e-05 2024-04-19T04:24:45.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:45.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.951948+0000", 2024-04-19T04:24:45.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1676e-05 2024-04-19T04:24:45.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:45.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.951957+0000", 2024-04-19T04:24:45.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5099999999999998e-06 2024-04-19T04:24:45.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:45.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952016+0000", 2024-04-19T04:24:45.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8879999999999999e-05 2024-04-19T04:24:45.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:45.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952142+0000", 2024-04-19T04:24:45.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126057 2024-04-19T04:24:45.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:45.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:45.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:45.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:45.952407+0000", 2024-04-19T04:24:45.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026557799999999998 2024-04-19T04:24:45.998 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.998 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:45.998 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.998 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:45.999 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:24:45.999 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 11 2024-04-19T04:24:45.999 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:46.000 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:24:46.023 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:46.019+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:46.123 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:46.119+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:46.129 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:46.129 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:24:46.129 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:24:46.129 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:24:46.129 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:46.142 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:24:46.197 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2024-04-19T04:24:46.225 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:46.222+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:46.277 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:46.277 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:24:46.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:24:46.277 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:24:46.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.277 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4159.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-04-19T04:24:46.277 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:11.119346+0000", 2024-04-19T04:24:46.277 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.155853583000003, 2024-04-19T04:24:46.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019667567, 2024-04-19T04:24:46.277 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.277 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.278 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:46.278 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4159", 2024-04-19T04:24:46.278 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/1235519030", 2024-04-19T04:24:46.278 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 189 2024-04-19T04:24:46.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.278 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119346+0000", 2024-04-19T04:24:46.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119346+0000", 2024-04-19T04:24:46.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.279 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.279 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119345+0000", 2024-04-19T04:24:46.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:46.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.279 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.279 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119353+0000", 2024-04-19T04:24:46.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.396e-06 2024-04-19T04:24:46.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.279 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.279 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119361+0000", 2024-04-19T04:24:46.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9130000000000003e-06 2024-04-19T04:24:46.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119367+0000", 2024-04-19T04:24:46.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4500000000000001e-06 2024-04-19T04:24:46.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.135564+0000", 2024-04-19T04:24:46.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016196894999999999 2024-04-19T04:24:46.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.135679+0000", 2024-04-19T04:24:46.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114722 2024-04-19T04:24:46.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:46.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.135816+0000", 2024-04-19T04:24:46.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000137637 2024-04-19T04:24:46.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.138143+0000", 2024-04-19T04:24:46.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023263279999999999 2024-04-19T04:24:46.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.138920+0000", 2024-04-19T04:24:46.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000777515 2024-04-19T04:24:46.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.283 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.283 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.138969+0000", 2024-04-19T04:24:46.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8634999999999998e-05 2024-04-19T04:24:46.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.283 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.283 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.139014+0000", 2024-04-19T04:24:46.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4722999999999999e-05 2024-04-19T04:24:46.283 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.283 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.283 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.284 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.284 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:46.284 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.741464031, 2024-04-19T04:24:46.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026801078999999998, 2024-04-19T04:24:46.284 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.284 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.284 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:46.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.285 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.285 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:46.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.285 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.285 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533733+0000", 2024-04-19T04:24:46.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999976 2024-04-19T04:24:46.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.285 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.285 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533746+0000", 2024-04-19T04:24:46.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2679e-05 2024-04-19T04:24:46.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533769+0000", 2024-04-19T04:24:46.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2832000000000001e-05 2024-04-19T04:24:46.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:24:46.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0599999999999999e-05 2024-04-19T04:24:46.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533907+0000", 2024-04-19T04:24:46.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000118076 2024-04-19T04:24:46.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:46.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533919+0000", 2024-04-19T04:24:46.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1644999999999999e-05 2024-04-19T04:24:46.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553399+0000", 2024-04-19T04:24:46.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019479987000000001 2024-04-19T04:24:46.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553535+0000", 2024-04-19T04:24:46.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553400000000001 2024-04-19T04:24:46.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:46.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553696+0000", 2024-04-19T04:24:46.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000161068 2024-04-19T04:24:46.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558096+0000", 2024-04-19T04:24:46.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0043998880000000002 2024-04-19T04:24:46.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560465+0000", 2024-04-19T04:24:46.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023695159999999999 2024-04-19T04:24:46.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560513+0000", 2024-04-19T04:24:46.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7899000000000003e-05 2024-04-19T04:24:46.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560537+0000", 2024-04-19T04:24:46.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3768e-05 2024-04-19T04:24:46.289 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.290 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.290 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.290 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.290 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:46.290 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.741386957, 2024-04-19T04:24:46.290 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026864505, 2024-04-19T04:24:46.290 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.291 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.291 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:46.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:46.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.293 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.293 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533812+0000", 2024-04-19T04:24:46.293 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:46.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.293 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.293 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533818+0000", 2024-04-19T04:24:46.293 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2369999999999997e-06 2024-04-19T04:24:46.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.294 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.294 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533863+0000", 2024-04-19T04:24:46.294 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4515000000000003e-05 2024-04-19T04:24:46.294 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.294 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.294 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.294 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533880+0000", 2024-04-19T04:24:46.294 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7119e-05 2024-04-19T04:24:46.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.295 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.295 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534029+0000", 2024-04-19T04:24:46.295 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014955099999999999 2024-04-19T04:24:46.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.295 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:46.295 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534034+0000", 2024-04-19T04:24:46.295 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1649999999999997e-06 2024-04-19T04:24:46.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554888+0000", 2024-04-19T04:24:46.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020854075 2024-04-19T04:24:46.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554967+0000", 2024-04-19T04:24:46.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8209999999999998e-05 2024-04-19T04:24:46.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:46.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555087+0000", 2024-04-19T04:24:46.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000120411 2024-04-19T04:24:46.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.297 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.297 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559328+0000", 2024-04-19T04:24:46.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042409800000000001 2024-04-19T04:24:46.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.297 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.297 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560587+0000", 2024-04-19T04:24:46.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012587119999999999 2024-04-19T04:24:46.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.298 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560620+0000", 2024-04-19T04:24:46.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2716999999999999e-05 2024-04-19T04:24:46.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.298 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560677+0000", 2024-04-19T04:24:46.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7726999999999998e-05 2024-04-19T04:24:46.298 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.298 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.298 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.299 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.299 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:46.299 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.741304564, 2024-04-19T04:24:46.299 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027363064999999999, 2024-04-19T04:24:46.299 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.299 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.299 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.299 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.299 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:46.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:46.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533894+0000", 2024-04-19T04:24:46.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:46.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533913+0000", 2024-04-19T04:24:46.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8896e-05 2024-04-19T04:24:46.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533933+0000", 2024-04-19T04:24:46.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9775e-05 2024-04-19T04:24:46.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533967+0000", 2024-04-19T04:24:46.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4536000000000003e-05 2024-04-19T04:24:46.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:46.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553600000000001 2024-04-19T04:24:46.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:46.302 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534107+0000", 2024-04-19T04:24:46.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1470000000000003e-06 2024-04-19T04:24:46.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.302 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556463+0000", 2024-04-19T04:24:46.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022356536999999999 2024-04-19T04:24:46.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556586+0000", 2024-04-19T04:24:46.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122967 2024-04-19T04:24:46.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:46.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556738+0000", 2024-04-19T04:24:46.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015182800000000001 2024-04-19T04:24:46.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561020+0000", 2024-04-19T04:24:46.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042818819999999999 2024-04-19T04:24:46.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561183+0000", 2024-04-19T04:24:46.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000162683 2024-04-19T04:24:46.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.304 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.304 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561226+0000", 2024-04-19T04:24:46.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3686000000000002e-05 2024-04-19T04:24:46.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.304 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.304 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561258+0000", 2024-04-19T04:24:46.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1814999999999999e-05 2024-04-19T04:24:46.304 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.304 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.304 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.305 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.305 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:46.305 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.741214051, 2024-04-19T04:24:46.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027417816000000001, 2024-04-19T04:24:46.305 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.305 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.305 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:46.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:46.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533984+0000", 2024-04-19T04:24:46.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:46.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:46.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3876000000000001e-05 2024-04-19T04:24:46.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534015+0000", 2024-04-19T04:24:46.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6818999999999999e-05 2024-04-19T04:24:46.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534030+0000", 2024-04-19T04:24:46.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.537e-05 2024-04-19T04:24:46.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534152+0000", 2024-04-19T04:24:46.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121685 2024-04-19T04:24:46.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.309 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:46.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534156+0000", 2024-04-19T04:24:46.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9029999999999997e-06 2024-04-19T04:24:46.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557520+0000", 2024-04-19T04:24:46.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023364125999999999 2024-04-19T04:24:46.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557585+0000", 2024-04-19T04:24:46.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5275000000000001e-05 2024-04-19T04:24:46.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:46.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557719+0000", 2024-04-19T04:24:46.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013396299999999999 2024-04-19T04:24:46.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561133+0000", 2024-04-19T04:24:46.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034140989999999999 2024-04-19T04:24:46.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561352+0000", 2024-04-19T04:24:46.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0002185 2024-04-19T04:24:46.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561380+0000", 2024-04-19T04:24:46.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8317999999999999e-05 2024-04-19T04:24:46.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561403+0000", 2024-04-19T04:24:46.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3264999999999998e-05 2024-04-19T04:24:46.312 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.312 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.312 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.313 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.313 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:46.313 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.741150405999999, 2024-04-19T04:24:46.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029897119999999999, 2024-04-19T04:24:46.313 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.313 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.313 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:46.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:46.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534048+0000", 2024-04-19T04:24:46.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:46.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534057+0000", 2024-04-19T04:24:46.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7930000000000003e-06 2024-04-19T04:24:46.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534075+0000", 2024-04-19T04:24:46.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7846000000000002e-05 2024-04-19T04:24:46.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534089+0000", 2024-04-19T04:24:46.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4463e-05 2024-04-19T04:24:46.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534198+0000", 2024-04-19T04:24:46.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109145 2024-04-19T04:24:46.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.316 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:46.316 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534202+0000", 2024-04-19T04:24:46.316 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.98e-06 2024-04-19T04:24:46.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.316 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.316 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558221+0000", 2024-04-19T04:24:46.316 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024018208999999999 2024-04-19T04:24:46.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.316 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.317 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558320+0000", 2024-04-19T04:24:46.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9642000000000006e-05 2024-04-19T04:24:46.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.317 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:46.317 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558401+0000", 2024-04-19T04:24:46.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1038000000000006e-05 2024-04-19T04:24:46.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.317 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.317 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561173+0000", 2024-04-19T04:24:46.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027714549999999999 2024-04-19T04:24:46.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563851+0000", 2024-04-19T04:24:46.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026786010000000001 2024-04-19T04:24:46.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563906+0000", 2024-04-19T04:24:46.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4895999999999998e-05 2024-04-19T04:24:46.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563946+0000", 2024-04-19T04:24:46.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0116e-05 2024-04-19T04:24:46.319 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.319 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.319 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.319 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.319 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.319 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.319 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:46.320 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.741097024999998, 2024-04-19T04:24:46.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029917846000000001, 2024-04-19T04:24:46.320 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.320 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.320 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.320 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.320 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.320 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:46.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.320 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.320 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.320 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.320 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:46.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.321 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.321 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.321 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.321 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534101+0000", 2024-04-19T04:24:46.321 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:46.321 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.321 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.321 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.321 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534111+0000", 2024-04-19T04:24:46.321 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5659999999999996e-06 2024-04-19T04:24:46.321 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.321 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.321 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.321 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534129+0000", 2024-04-19T04:24:46.322 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7632999999999999e-05 2024-04-19T04:24:46.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.322 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.322 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.322 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534143+0000", 2024-04-19T04:24:46.322 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4362000000000001e-05 2024-04-19T04:24:46.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.322 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.322 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.322 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534256+0000", 2024-04-19T04:24:46.322 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113267 2024-04-19T04:24:46.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.322 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.323 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:46.323 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534260+0000", 2024-04-19T04:24:46.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9949999999999999e-06 2024-04-19T04:24:46.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.323 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.323 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.323 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558653+0000", 2024-04-19T04:24:46.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024393182999999999 2024-04-19T04:24:46.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.323 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.323 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.323 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558704+0000", 2024-04-19T04:24:46.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0303999999999998e-05 2024-04-19T04:24:46.324 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.324 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.324 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:46.324 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558782+0000", 2024-04-19T04:24:46.324 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8079999999999998e-05 2024-04-19T04:24:46.324 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.324 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.324 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.324 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561309+0000", 2024-04-19T04:24:46.324 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002527708 2024-04-19T04:24:46.324 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.324 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.324 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.324 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563952+0000", 2024-04-19T04:24:46.325 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026425450000000001 2024-04-19T04:24:46.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.325 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.325 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563996+0000", 2024-04-19T04:24:46.325 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3606000000000002e-05 2024-04-19T04:24:46.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.325 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.325 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564021+0000", 2024-04-19T04:24:46.325 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.491e-05 2024-04-19T04:24:46.325 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.325 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.325 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.326 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.326 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.326 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.326 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:46.326 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.741044513999999, 2024-04-19T04:24:46.326 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:24:46.326 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.326 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.326 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.326 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.326 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.326 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:46.326 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.326 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.327 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.327 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:46.327 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.327 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.327 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:24:46.327 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:46.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.327 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.327 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:24:46.327 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:24:46.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:24:46.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:24:46.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:24:46.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:24:46.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.329 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.329 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:24:46.329 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:24:46.329 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.329 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:46.329 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:24:46.329 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:24:46.329 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.329 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.329 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:24:46.329 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:24:46.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.330 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:24:46.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:24:46.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.330 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:46.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:24:46.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:24:46.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:24:46.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:24:46.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:24:46.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:24:46.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:24:46.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:24:46.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.332 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.332 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:24:46.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:24:46.332 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.332 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.332 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.332 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.332 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:46.332 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.740989969000001, 2024-04-19T04:24:46.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:24:46.332 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.333 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.333 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.333 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:46.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.333 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:46.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:24:46.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:46.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:24:46.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:24:46.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:24:46.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:24:46.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:24:46.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:24:46.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:24:46.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:24:46.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:46.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:24:46.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:24:46.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:24:46.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:24:46.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:24:46.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:24:46.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:46.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:24:46.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:24:46.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.337 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.337 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:24:46.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:24:46.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.337 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.337 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:24:46.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:24:46.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.337 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.337 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:24:46.338 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:24:46.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.338 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.338 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:24:46.338 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:24:46.338 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.338 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.338 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.338 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.338 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534259+0000", 2024-04-19T04:24:46.339 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.740940560999999, 2024-04-19T04:24:46.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026049582000000002, 2024-04-19T04:24:46.339 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.339 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.339 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534259+0000", 2024-04-19T04:24:46.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534259+0000", 2024-04-19T04:24:46.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534258+0000", 2024-04-19T04:24:46.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:46.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534266+0000", 2024-04-19T04:24:46.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5870000000000004e-06 2024-04-19T04:24:46.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534281+0000", 2024-04-19T04:24:46.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5676e-05 2024-04-19T04:24:46.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534297+0000", 2024-04-19T04:24:46.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5458999999999999e-05 2024-04-19T04:24:46.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534379+0000", 2024-04-19T04:24:46.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2667e-05 2024-04-19T04:24:46.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:46.342 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534387+0000", 2024-04-19T04:24:46.342 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8900000000000007e-06 2024-04-19T04:24:46.342 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.342 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.342 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.342 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.552640+0000", 2024-04-19T04:24:46.342 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.018252344 2024-04-19T04:24:46.342 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.342 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.342 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.342 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.552944+0000", 2024-04-19T04:24:46.342 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00030430000000000002 2024-04-19T04:24:46.342 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.342 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.343 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:46.343 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553088+0000", 2024-04-19T04:24:46.343 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143793 2024-04-19T04:24:46.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.343 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.343 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557028+0000", 2024-04-19T04:24:46.343 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0039397770000000002 2024-04-19T04:24:46.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.343 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.343 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560246+0000", 2024-04-19T04:24:46.343 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032184990000000001 2024-04-19T04:24:46.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.344 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.344 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560282+0000", 2024-04-19T04:24:46.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6168999999999999e-05 2024-04-19T04:24:46.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.344 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.344 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560309+0000", 2024-04-19T04:24:46.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6508000000000001e-05 2024-04-19T04:24:46.344 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.344 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.344 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.344 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.345 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534327+0000", 2024-04-19T04:24:46.345 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.740872391, 2024-04-19T04:24:46.345 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022180505999999999, 2024-04-19T04:24:46.345 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.345 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.345 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.345 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.345 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534327+0000", 2024-04-19T04:24:46.345 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.345 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.345 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.345 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534327+0000", 2024-04-19T04:24:46.346 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.346 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.346 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534326+0000", 2024-04-19T04:24:46.346 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:46.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.346 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.346 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534335+0000", 2024-04-19T04:24:46.346 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2359999999999993e-06 2024-04-19T04:24:46.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.346 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534348+0000", 2024-04-19T04:24:46.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2680000000000001e-05 2024-04-19T04:24:46.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534364+0000", 2024-04-19T04:24:46.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6249e-05 2024-04-19T04:24:46.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534424+0000", 2024-04-19T04:24:46.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9494999999999999e-05 2024-04-19T04:24:46.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:46.348 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534429+0000", 2024-04-19T04:24:46.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.536e-06 2024-04-19T04:24:46.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.348 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.348 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.348 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.549957+0000", 2024-04-19T04:24:46.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015528121000000001 2024-04-19T04:24:46.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.348 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.348 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.348 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550172+0000", 2024-04-19T04:24:46.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00021493400000000001 2024-04-19T04:24:46.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.349 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:46.349 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550371+0000", 2024-04-19T04:24:46.349 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019863899999999999 2024-04-19T04:24:46.349 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.349 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.349 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556311+0000", 2024-04-19T04:24:46.349 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0059402639999999998 2024-04-19T04:24:46.349 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.349 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.349 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556351+0000", 2024-04-19T04:24:46.349 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9932000000000003e-05 2024-04-19T04:24:46.350 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.350 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.350 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.350 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556464+0000", 2024-04-19T04:24:46.350 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113089 2024-04-19T04:24:46.350 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.350 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.350 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.350 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556508+0000", 2024-04-19T04:24:46.350 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3537e-05 2024-04-19T04:24:46.350 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.350 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.350 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.350 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.351 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.351 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.351 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534402+0000", 2024-04-19T04:24:46.351 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.74079776, 2024-04-19T04:24:46.351 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026426121, 2024-04-19T04:24:46.351 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.351 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.351 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.351 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.351 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.351 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534402+0000", 2024-04-19T04:24:46.351 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.351 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.351 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.352 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.352 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534402+0000", 2024-04-19T04:24:46.352 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.352 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.352 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.352 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.352 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534401+0000", 2024-04-19T04:24:46.352 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:46.352 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.352 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.352 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.352 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534423+0000", 2024-04-19T04:24:46.352 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2589e-05 2024-04-19T04:24:46.352 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.353 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.353 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534440+0000", 2024-04-19T04:24:46.353 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6175999999999999e-05 2024-04-19T04:24:46.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.353 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.353 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534448+0000", 2024-04-19T04:24:46.353 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0970000000000006e-06 2024-04-19T04:24:46.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.353 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.353 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534563+0000", 2024-04-19T04:24:46.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011575500000000001 2024-04-19T04:24:46.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.354 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:46.354 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534575+0000", 2024-04-19T04:24:46.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1199999999999999e-05 2024-04-19T04:24:46.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.354 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.354 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553676+0000", 2024-04-19T04:24:46.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019101098 2024-04-19T04:24:46.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553803+0000", 2024-04-19T04:24:46.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012747499999999999 2024-04-19T04:24:46.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:46.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553942+0000", 2024-04-19T04:24:46.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000138863 2024-04-19T04:24:46.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557090+0000", 2024-04-19T04:24:46.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003148283 2024-04-19T04:24:46.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.356 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560726+0000", 2024-04-19T04:24:46.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0036352530000000002 2024-04-19T04:24:46.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.356 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560784+0000", 2024-04-19T04:24:46.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8034e-05 2024-04-19T04:24:46.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.356 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560828+0000", 2024-04-19T04:24:46.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4418000000000001e-05 2024-04-19T04:24:46.357 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.357 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.357 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.357 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.357 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534469+0000", 2024-04-19T04:24:46.357 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.740730685999999, 2024-04-19T04:24:46.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023528199, 2024-04-19T04:24:46.357 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.357 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.357 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.357 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534469+0000", 2024-04-19T04:24:46.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534469+0000", 2024-04-19T04:24:46.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534468+0000", 2024-04-19T04:24:46.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:46.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.359 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.359 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534476+0000", 2024-04-19T04:24:46.359 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2199999999999992e-06 2024-04-19T04:24:46.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.359 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.359 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.359 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534493+0000", 2024-04-19T04:24:46.359 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6708999999999999e-05 2024-04-19T04:24:46.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.359 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.359 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.359 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534518+0000", 2024-04-19T04:24:46.359 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4803e-05 2024-04-19T04:24:46.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.360 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534601+0000", 2024-04-19T04:24:46.360 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3498000000000006e-05 2024-04-19T04:24:46.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:46.360 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534606+0000", 2024-04-19T04:24:46.360 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9949999999999996e-06 2024-04-19T04:24:46.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.360 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.549312+0000", 2024-04-19T04:24:46.360 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.014705993000000001 2024-04-19T04:24:46.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550221+0000", 2024-04-19T04:24:46.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00090864099999999996 2024-04-19T04:24:46.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:46.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550417+0000", 2024-04-19T04:24:46.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000196551 2024-04-19T04:24:46.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.362 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555547+0000", 2024-04-19T04:24:46.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0051299830000000003 2024-04-19T04:24:46.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.362 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557916+0000", 2024-04-19T04:24:46.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023689380000000001 2024-04-19T04:24:46.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.362 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557951+0000", 2024-04-19T04:24:46.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4771000000000003e-05 2024-04-19T04:24:46.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.363 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.363 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.363 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557997+0000", 2024-04-19T04:24:46.363 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6167e-05 2024-04-19T04:24:46.363 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.363 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.363 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.363 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.363 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.363 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.363 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534568+0000", 2024-04-19T04:24:46.363 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.740631452999999, 2024-04-19T04:24:46.364 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026371452, 2024-04-19T04:24:46.364 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.364 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.364 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.364 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.364 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.364 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534568+0000", 2024-04-19T04:24:46.364 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.364 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.364 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.364 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534568+0000", 2024-04-19T04:24:46.364 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534567+0000", 2024-04-19T04:24:46.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:46.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534578+0000", 2024-04-19T04:24:46.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.08e-05 2024-04-19T04:24:46.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534597+0000", 2024-04-19T04:24:46.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9245999999999998e-05 2024-04-19T04:24:46.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534607+0000", 2024-04-19T04:24:46.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.039e-05 2024-04-19T04:24:46.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534685+0000", 2024-04-19T04:24:46.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7297000000000002e-05 2024-04-19T04:24:46.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:46.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534691+0000", 2024-04-19T04:24:46.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5690000000000001e-06 2024-04-19T04:24:46.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.367 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554391+0000", 2024-04-19T04:24:46.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019699926999999999 2024-04-19T04:24:46.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.367 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554645+0000", 2024-04-19T04:24:46.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00025359599999999998 2024-04-19T04:24:46.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:46.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554947+0000", 2024-04-19T04:24:46.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00030229200000000001 2024-04-19T04:24:46.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557380+0000", 2024-04-19T04:24:46.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024329680000000002 2024-04-19T04:24:46.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560869+0000", 2024-04-19T04:24:46.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034894230000000002 2024-04-19T04:24:46.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560902+0000", 2024-04-19T04:24:46.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2710999999999999e-05 2024-04-19T04:24:46.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560940+0000", 2024-04-19T04:24:46.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.756e-05 2024-04-19T04:24:46.369 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.369 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.369 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.369 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.370 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534626+0000", 2024-04-19T04:24:46.370 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.740574098, 2024-04-19T04:24:46.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022377527000000001, 2024-04-19T04:24:46.370 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.370 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.370 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534626+0000", 2024-04-19T04:24:46.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534626+0000", 2024-04-19T04:24:46.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534624+0000", 2024-04-19T04:24:46.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:46.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534633+0000", 2024-04-19T04:24:46.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7590000000000003e-06 2024-04-19T04:24:46.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534643+0000", 2024-04-19T04:24:46.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0396e-05 2024-04-19T04:24:46.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534691+0000", 2024-04-19T04:24:46.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7735000000000003e-05 2024-04-19T04:24:46.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534775+0000", 2024-04-19T04:24:46.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4556999999999997e-05 2024-04-19T04:24:46.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:46.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534783+0000", 2024-04-19T04:24:46.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9230000000000002e-06 2024-04-19T04:24:46.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.549925+0000", 2024-04-19T04:24:46.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015141419999999999 2024-04-19T04:24:46.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550367+0000", 2024-04-19T04:24:46.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00044214500000000002 2024-04-19T04:24:46.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:46.374 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550806+0000", 2024-04-19T04:24:46.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00043874799999999998 2024-04-19T04:24:46.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.374 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556642+0000", 2024-04-19T04:24:46.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0058363850000000004 2024-04-19T04:24:46.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.374 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556723+0000", 2024-04-19T04:24:46.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1383000000000003e-05 2024-04-19T04:24:46.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556775+0000", 2024-04-19T04:24:46.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1659999999999997e-05 2024-04-19T04:24:46.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557003+0000", 2024-04-19T04:24:46.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022796599999999999 2024-04-19T04:24:46.375 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.375 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.375 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.376 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.376 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534711+0000", 2024-04-19T04:24:46.376 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.740488990999999, 2024-04-19T04:24:46.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023431483999999999, 2024-04-19T04:24:46.376 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.376 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.376 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.376 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.376 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534711+0000", 2024-04-19T04:24:46.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.376 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534711+0000", 2024-04-19T04:24:46.377 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534710+0000", 2024-04-19T04:24:46.377 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:46.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534716+0000", 2024-04-19T04:24:46.377 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3430000000000001e-06 2024-04-19T04:24:46.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.378 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.378 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534728+0000", 2024-04-19T04:24:46.378 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1616e-05 2024-04-19T04:24:46.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.378 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.378 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534739+0000", 2024-04-19T04:24:46.378 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1416999999999999e-05 2024-04-19T04:24:46.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.378 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.378 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534812+0000", 2024-04-19T04:24:46.379 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.305e-05 2024-04-19T04:24:46.379 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.379 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.379 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:46.379 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534821+0000", 2024-04-19T04:24:46.379 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2329999999999995e-06 2024-04-19T04:24:46.379 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.379 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.379 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.379 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.548691+0000", 2024-04-19T04:24:46.379 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.013869375 2024-04-19T04:24:46.379 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.379 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.380 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.380 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.548892+0000", 2024-04-19T04:24:46.380 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00020125500000000001 2024-04-19T04:24:46.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.380 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.380 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:46.380 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.549719+0000", 2024-04-19T04:24:46.380 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000826935 2024-04-19T04:24:46.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.380 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.380 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.380 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555981+0000", 2024-04-19T04:24:46.380 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062615079999999998 2024-04-19T04:24:46.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.380 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.381 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557961+0000", 2024-04-19T04:24:46.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0019805339999999999 2024-04-19T04:24:46.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.381 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558028+0000", 2024-04-19T04:24:46.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6987000000000001e-05 2024-04-19T04:24:46.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.381 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558142+0000", 2024-04-19T04:24:46.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011410500000000001 2024-04-19T04:24:46.381 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.382 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.382 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.382 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.382 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.382 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.382 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534754+0000", 2024-04-19T04:24:46.382 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.740445927, 2024-04-19T04:24:46.382 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026409367, 2024-04-19T04:24:46.382 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.382 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:46.382 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.382 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.382 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534754+0000", 2024-04-19T04:24:46.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534754+0000", 2024-04-19T04:24:46.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534753+0000", 2024-04-19T04:24:46.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:46.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.384 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.384 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534757+0000", 2024-04-19T04:24:46.384 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0430000000000001e-06 2024-04-19T04:24:46.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.384 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.384 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.384 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534765+0000", 2024-04-19T04:24:46.384 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2430000000000005e-06 2024-04-19T04:24:46.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.384 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.384 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.384 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534772+0000", 2024-04-19T04:24:46.384 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.973e-06 2024-04-19T04:24:46.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.384 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.385 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.385 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534849+0000", 2024-04-19T04:24:46.385 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6724000000000006e-05 2024-04-19T04:24:46.385 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.385 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.385 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:46.385 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534853+0000", 2024-04-19T04:24:46.385 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.442e-06 2024-04-19T04:24:46.385 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.385 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.385 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.385 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555493+0000", 2024-04-19T04:24:46.385 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020639571999999998 2024-04-19T04:24:46.385 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.386 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.386 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.386 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555890+0000", 2024-04-19T04:24:46.386 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00039718000000000002 2024-04-19T04:24:46.386 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.386 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.386 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.386 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561163+0000", 2024-04-19T04:24:46.386 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0052728929999999999 2024-04-19T04:24:46.386 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.386 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.386 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.387 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.387 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.387 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534797+0000", 2024-04-19T04:24:46.387 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.740403132000001, 2024-04-19T04:24:46.387 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026586375999999998, 2024-04-19T04:24:46.387 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.387 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.387 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.387 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.387 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534797+0000", 2024-04-19T04:24:46.387 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.387 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534797+0000", 2024-04-19T04:24:46.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534796+0000", 2024-04-19T04:24:46.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:46.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534805+0000", 2024-04-19T04:24:46.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.3700000000000001e-06 2024-04-19T04:24:46.389 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.389 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.389 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.389 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534822+0000", 2024-04-19T04:24:46.389 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6878999999999999e-05 2024-04-19T04:24:46.389 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.389 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.389 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.389 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534832+0000", 2024-04-19T04:24:46.389 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:24:46.389 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.389 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.389 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.389 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534899+0000", 2024-04-19T04:24:46.390 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7280999999999995e-05 2024-04-19T04:24:46.390 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.390 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.390 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:46.390 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534905+0000", 2024-04-19T04:24:46.390 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8490000000000002e-06 2024-04-19T04:24:46.390 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.390 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.390 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.390 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556245+0000", 2024-04-19T04:24:46.390 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.021340136999999999 2024-04-19T04:24:46.390 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.390 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.391 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.391 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556327+0000", 2024-04-19T04:24:46.391 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2347000000000003e-05 2024-04-19T04:24:46.391 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.391 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.391 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:46.391 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556554+0000", 2024-04-19T04:24:46.391 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022676200000000001 2024-04-19T04:24:46.391 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.391 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.391 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.391 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561197+0000", 2024-04-19T04:24:46.391 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0046431019999999996 2024-04-19T04:24:46.391 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.392 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.392 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.392 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561303+0000", 2024-04-19T04:24:46.392 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000106043 2024-04-19T04:24:46.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.392 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.392 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.392 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561350+0000", 2024-04-19T04:24:46.392 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6711000000000001e-05 2024-04-19T04:24:46.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.392 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.392 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.392 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561383+0000", 2024-04-19T04:24:46.393 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2904999999999998e-05 2024-04-19T04:24:46.393 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.393 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.393 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.393 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.393 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.393 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.393 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534840+0000", 2024-04-19T04:24:46.393 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.740359973, 2024-04-19T04:24:46.393 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022162659000000001, 2024-04-19T04:24:46.393 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.393 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.393 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.394 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.394 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.394 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534840+0000", 2024-04-19T04:24:46.394 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.394 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.394 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.394 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.394 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534840+0000", 2024-04-19T04:24:46.394 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.394 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.394 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.394 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.394 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534839+0000", 2024-04-19T04:24:46.394 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:46.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.395 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.395 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.395 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534844+0000", 2024-04-19T04:24:46.395 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7859999999999996e-06 2024-04-19T04:24:46.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.395 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.395 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.395 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534856+0000", 2024-04-19T04:24:46.395 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2150000000000001e-05 2024-04-19T04:24:46.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.395 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.395 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.395 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534863+0000", 2024-04-19T04:24:46.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.883e-06 2024-04-19T04:24:46.396 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534915+0000", 2024-04-19T04:24:46.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1675999999999998e-05 2024-04-19T04:24:46.396 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:46.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534918+0000", 2024-04-19T04:24:46.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7850000000000002e-06 2024-04-19T04:24:46.396 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.551513+0000", 2024-04-19T04:24:46.397 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016594398 2024-04-19T04:24:46.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.397 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.397 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.551634+0000", 2024-04-19T04:24:46.397 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012141700000000001 2024-04-19T04:24:46.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.397 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:46.397 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.551867+0000", 2024-04-19T04:24:46.397 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00023267000000000001 2024-04-19T04:24:46.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.397 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.398 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556539+0000", 2024-04-19T04:24:46.398 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0046719910000000003 2024-04-19T04:24:46.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.398 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.398 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.398 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556594+0000", 2024-04-19T04:24:46.398 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4715e-05 2024-04-19T04:24:46.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.398 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.398 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.398 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556818+0000", 2024-04-19T04:24:46.398 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000224064 2024-04-19T04:24:46.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.399 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.399 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.399 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557002+0000", 2024-04-19T04:24:46.399 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00018477399999999999 2024-04-19T04:24:46.399 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.399 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.399 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.399 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.399 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.399 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:46.399 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534883+0000", 2024-04-19T04:24:46.399 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 25.740316568000001, 2024-04-19T04:24:46.399 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022503523000000001, 2024-04-19T04:24:46.400 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:46.400 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:46.400 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:46.400 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.400 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:46.400 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534883+0000", 2024-04-19T04:24:46.400 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.400 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.400 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.400 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:46.400 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534883+0000", 2024-04-19T04:24:46.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:46.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.401 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:46.401 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534882+0000", 2024-04-19T04:24:46.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:46.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.401 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:46.401 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534894+0000", 2024-04-19T04:24:46.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1579999999999999e-05 2024-04-19T04:24:46.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.401 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:46.402 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534903+0000", 2024-04-19T04:24:46.402 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0790000000000007e-06 2024-04-19T04:24:46.402 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.402 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.402 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.402 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534910+0000", 2024-04-19T04:24:46.402 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8329999999999996e-06 2024-04-19T04:24:46.402 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.402 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.402 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.402 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534960+0000", 2024-04-19T04:24:46.402 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0441e-05 2024-04-19T04:24:46.402 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.403 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:46.403 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534964+0000", 2024-04-19T04:24:46.403 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9169999999999999e-06 2024-04-19T04:24:46.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.403 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:46.403 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.552567+0000", 2024-04-19T04:24:46.403 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.017603088999999999 2024-04-19T04:24:46.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.403 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:46.403 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553342+0000", 2024-04-19T04:24:46.403 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00077492299999999995 2024-04-19T04:24:46.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.404 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:46.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553552+0000", 2024-04-19T04:24:46.404 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00020988300000000001 2024-04-19T04:24:46.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.404 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:46.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556683+0000", 2024-04-19T04:24:46.404 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031310830000000002 2024-04-19T04:24:46.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.404 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:46.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557301+0000", 2024-04-19T04:24:46.404 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000618051 2024-04-19T04:24:46.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.405 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.405 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:46.405 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557350+0000", 2024-04-19T04:24:46.405 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8976e-05 2024-04-19T04:24:46.405 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:46.405 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:46.405 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:46.405 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557387+0000", 2024-04-19T04:24:46.405 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6325000000000002e-05 2024-04-19T04:24:46.405 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.405 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.405 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.405 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:46.405 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:46.405 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:46.408 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-19T04:24:46.408 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-04-19T04:24:46.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-19T04:24:46.408 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 4713, 2024-04-19T04:24:46.408 INFO:teuthology.orchestra.run.smithi007.stdout: "pg": "5.ec2ada92", 2024-04-19T04:24:46.408 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2024-04-19T04:24:46.408 INFO:teuthology.orchestra.run.smithi007.stdout: "object_id": "benchmark_data_smithi007_19526_object4712", 2024-04-19T04:24:46.408 INFO:teuthology.orchestra.run.smithi007.stdout: "object_locator": "@5", 2024-04-19T04:24:46.408 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_id": "benchmark_data_smithi007_19526_object4712", 2024-04-19T04:24:46.408 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_locator": "@5", 2024-04-19T04:24:46.408 INFO:teuthology.orchestra.run.smithi007.stdout: "paused": 0, 2024-04-19T04:24:46.409 INFO:teuthology.orchestra.run.smithi007.stdout: "used_replica": 0, 2024-04-19T04:24:46.409 INFO:teuthology.orchestra.run.smithi007.stdout: "precalc_pgid": 0, 2024-04-19T04:24:46.409 INFO:teuthology.orchestra.run.smithi007.stdout: "last_sent": "718.374632s", 2024-04-19T04:24:46.409 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0039999099999999998, 2024-04-19T04:24:46.409 INFO:teuthology.orchestra.run.smithi007.stdout: "attempts": 1, 2024-04-19T04:24:46.409 INFO:teuthology.orchestra.run.smithi007.stdout: "snapid": "head", 2024-04-19T04:24:46.409 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_context": "0=[]", 2024-04-19T04:24:46.409 INFO:teuthology.orchestra.run.smithi007.stdout: "mtime": "2024-04-19T04:24:46.305213+0000", 2024-04-19T04:24:46.409 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ops": [ 2024-04-19T04:24:46.409 INFO:teuthology.orchestra.run.smithi007.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T04:24:46.409 INFO:teuthology.orchestra.run.smithi007.stdout: "write 0~65536 in=65536b" 2024-04-19T04:24:46.409 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-19T04:24:46.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-19T04:24:46.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-19T04:24:46.410 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 4714, 2024-04-19T04:24:46.410 INFO:teuthology.orchestra.run.smithi007.stdout: "pg": "5.f1c8abc7", 2024-04-19T04:24:46.410 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2024-04-19T04:24:46.410 INFO:teuthology.orchestra.run.smithi007.stdout: "object_id": "benchmark_data_smithi007_19526_object4713", 2024-04-19T04:24:46.410 INFO:teuthology.orchestra.run.smithi007.stdout: "object_locator": "@5", 2024-04-19T04:24:46.410 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_id": "benchmark_data_smithi007_19526_object4713", 2024-04-19T04:24:46.410 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_locator": "@5", 2024-04-19T04:24:46.410 INFO:teuthology.orchestra.run.smithi007.stdout: "paused": 0, 2024-04-19T04:24:46.410 INFO:teuthology.orchestra.run.smithi007.stdout: "used_replica": 0, 2024-04-19T04:24:46.410 INFO:teuthology.orchestra.run.smithi007.stdout: "precalc_pgid": 0, 2024-04-19T04:24:46.410 INFO:teuthology.orchestra.run.smithi007.stdout: "last_sent": "718.374632s", 2024-04-19T04:24:46.410 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0039999099999999998, 2024-04-19T04:24:46.411 INFO:teuthology.orchestra.run.smithi007.stdout: "attempts": 1, 2024-04-19T04:24:46.411 INFO:teuthology.orchestra.run.smithi007.stdout: "snapid": "head", 2024-04-19T04:24:46.411 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_context": "0=[]", 2024-04-19T04:24:46.411 INFO:teuthology.orchestra.run.smithi007.stdout: "mtime": "2024-04-19T04:24:46.305597+0000", 2024-04-19T04:24:46.411 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ops": [ 2024-04-19T04:24:46.411 INFO:teuthology.orchestra.run.smithi007.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T04:24:46.411 INFO:teuthology.orchestra.run.smithi007.stdout: "write 0~65536 in=65536b" 2024-04-19T04:24:46.411 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-19T04:24:46.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-19T04:24:46.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-19T04:24:46.411 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 4716, 2024-04-19T04:24:46.411 INFO:teuthology.orchestra.run.smithi007.stdout: "pg": "5.3ddf2791", 2024-04-19T04:24:46.411 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2024-04-19T04:24:46.411 INFO:teuthology.orchestra.run.smithi007.stdout: "object_id": "benchmark_data_smithi007_19526_object4715", 2024-04-19T04:24:46.412 INFO:teuthology.orchestra.run.smithi007.stdout: "object_locator": "@5", 2024-04-19T04:24:46.412 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_id": "benchmark_data_smithi007_19526_object4715", 2024-04-19T04:24:46.412 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_locator": "@5", 2024-04-19T04:24:46.412 INFO:teuthology.orchestra.run.smithi007.stdout: "paused": 0, 2024-04-19T04:24:46.412 INFO:teuthology.orchestra.run.smithi007.stdout: "used_replica": 0, 2024-04-19T04:24:46.412 INFO:teuthology.orchestra.run.smithi007.stdout: "precalc_pgid": 0, 2024-04-19T04:24:46.412 INFO:teuthology.orchestra.run.smithi007.stdout: "last_sent": "718.378632s", 2024-04-19T04:24:46.412 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0, 2024-04-19T04:24:46.412 INFO:teuthology.orchestra.run.smithi007.stdout: "attempts": 1, 2024-04-19T04:24:46.412 INFO:teuthology.orchestra.run.smithi007.stdout: "snapid": "head", 2024-04-19T04:24:46.412 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_context": "0=[]", 2024-04-19T04:24:46.412 INFO:teuthology.orchestra.run.smithi007.stdout: "mtime": "2024-04-19T04:24:46.307743+0000", 2024-04-19T04:24:46.412 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ops": [ 2024-04-19T04:24:46.412 INFO:teuthology.orchestra.run.smithi007.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T04:24:46.413 INFO:teuthology.orchestra.run.smithi007.stdout: "write 0~65536 in=65536b" 2024-04-19T04:24:46.413 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-19T04:24:46.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-19T04:24:46.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-19T04:24:46.413 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 4704, 2024-04-19T04:24:46.413 INFO:teuthology.orchestra.run.smithi007.stdout: "pg": "5.5cee1a0a", 2024-04-19T04:24:46.413 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2024-04-19T04:24:46.413 INFO:teuthology.orchestra.run.smithi007.stdout: "object_id": "benchmark_data_smithi007_19526_object4703", 2024-04-19T04:24:46.413 INFO:teuthology.orchestra.run.smithi007.stdout: "object_locator": "@5", 2024-04-19T04:24:46.413 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_id": "benchmark_data_smithi007_19526_object4703", 2024-04-19T04:24:46.413 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_locator": "@5", 2024-04-19T04:24:46.413 INFO:teuthology.orchestra.run.smithi007.stdout: "paused": 0, 2024-04-19T04:24:46.413 INFO:teuthology.orchestra.run.smithi007.stdout: "used_replica": 0, 2024-04-19T04:24:46.413 INFO:teuthology.orchestra.run.smithi007.stdout: "precalc_pgid": 0, 2024-04-19T04:24:46.414 INFO:teuthology.orchestra.run.smithi007.stdout: "last_sent": "718.370632s", 2024-04-19T04:24:46.414 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0079998199999999995, 2024-04-19T04:24:46.414 INFO:teuthology.orchestra.run.smithi007.stdout: "attempts": 1, 2024-04-19T04:24:46.414 INFO:teuthology.orchestra.run.smithi007.stdout: "snapid": "head", 2024-04-19T04:24:46.414 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_context": "0=[]", 2024-04-19T04:24:46.414 INFO:teuthology.orchestra.run.smithi007.stdout: "mtime": "2024-04-19T04:24:46.303513+0000", 2024-04-19T04:24:46.414 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ops": [ 2024-04-19T04:24:46.414 INFO:teuthology.orchestra.run.smithi007.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T04:24:46.414 INFO:teuthology.orchestra.run.smithi007.stdout: "write 0~65536 in=65536b" 2024-04-19T04:24:46.414 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-19T04:24:46.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-19T04:24:46.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-19T04:24:46.414 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 4706, 2024-04-19T04:24:46.415 INFO:teuthology.orchestra.run.smithi007.stdout: "pg": "5.6cf2b603", 2024-04-19T04:24:46.415 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2024-04-19T04:24:46.415 INFO:teuthology.orchestra.run.smithi007.stdout: "object_id": "benchmark_data_smithi007_19526_object4705", 2024-04-19T04:24:46.415 INFO:teuthology.orchestra.run.smithi007.stdout: "object_locator": "@5", 2024-04-19T04:24:46.415 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_id": "benchmark_data_smithi007_19526_object4705", 2024-04-19T04:24:46.415 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_locator": "@5", 2024-04-19T04:24:46.415 INFO:teuthology.orchestra.run.smithi007.stdout: "paused": 0, 2024-04-19T04:24:46.415 INFO:teuthology.orchestra.run.smithi007.stdout: "used_replica": 0, 2024-04-19T04:24:46.415 INFO:teuthology.orchestra.run.smithi007.stdout: "precalc_pgid": 0, 2024-04-19T04:24:46.415 INFO:teuthology.orchestra.run.smithi007.stdout: "last_sent": "718.374632s", 2024-04-19T04:24:46.415 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0039999099999999998, 2024-04-19T04:24:46.415 INFO:teuthology.orchestra.run.smithi007.stdout: "attempts": 1, 2024-04-19T04:24:46.415 INFO:teuthology.orchestra.run.smithi007.stdout: "snapid": "head", 2024-04-19T04:24:46.415 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_context": "0=[]", 2024-04-19T04:24:46.416 INFO:teuthology.orchestra.run.smithi007.stdout: "mtime": "2024-04-19T04:24:46.303847+0000", 2024-04-19T04:24:46.416 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ops": [ 2024-04-19T04:24:46.416 INFO:teuthology.orchestra.run.smithi007.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T04:24:46.416 INFO:teuthology.orchestra.run.smithi007.stdout: "write 0~65536 in=65536b" 2024-04-19T04:24:46.416 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-19T04:24:46.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-19T04:24:46.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-19T04:24:46.416 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 4711, 2024-04-19T04:24:46.416 INFO:teuthology.orchestra.run.smithi007.stdout: "pg": "5.d856e8e3", 2024-04-19T04:24:46.416 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2024-04-19T04:24:46.416 INFO:teuthology.orchestra.run.smithi007.stdout: "object_id": "benchmark_data_smithi007_19526_object4710", 2024-04-19T04:24:46.416 INFO:teuthology.orchestra.run.smithi007.stdout: "object_locator": "@5", 2024-04-19T04:24:46.416 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_id": "benchmark_data_smithi007_19526_object4710", 2024-04-19T04:24:46.416 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_locator": "@5", 2024-04-19T04:24:46.417 INFO:teuthology.orchestra.run.smithi007.stdout: "paused": 0, 2024-04-19T04:24:46.417 INFO:teuthology.orchestra.run.smithi007.stdout: "used_replica": 0, 2024-04-19T04:24:46.417 INFO:teuthology.orchestra.run.smithi007.stdout: "precalc_pgid": 0, 2024-04-19T04:24:46.417 INFO:teuthology.orchestra.run.smithi007.stdout: "last_sent": "718.374632s", 2024-04-19T04:24:46.417 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0039999099999999998, 2024-04-19T04:24:46.417 INFO:teuthology.orchestra.run.smithi007.stdout: "attempts": 1, 2024-04-19T04:24:46.417 INFO:teuthology.orchestra.run.smithi007.stdout: "snapid": "head", 2024-04-19T04:24:46.417 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_context": "0=[]", 2024-04-19T04:24:46.417 INFO:teuthology.orchestra.run.smithi007.stdout: "mtime": "2024-04-19T04:24:46.304146+0000", 2024-04-19T04:24:46.417 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ops": [ 2024-04-19T04:24:46.417 INFO:teuthology.orchestra.run.smithi007.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T04:24:46.417 INFO:teuthology.orchestra.run.smithi007.stdout: "write 0~65536 in=65536b" 2024-04-19T04:24:46.417 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-19T04:24:46.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-19T04:24:46.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-19T04:24:46.418 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 4715, 2024-04-19T04:24:46.418 INFO:teuthology.orchestra.run.smithi007.stdout: "pg": "5.ae5ea15a", 2024-04-19T04:24:46.418 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2024-04-19T04:24:46.418 INFO:teuthology.orchestra.run.smithi007.stdout: "object_id": "benchmark_data_smithi007_19526_object4714", 2024-04-19T04:24:46.418 INFO:teuthology.orchestra.run.smithi007.stdout: "object_locator": "@5", 2024-04-19T04:24:46.418 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_id": "benchmark_data_smithi007_19526_object4714", 2024-04-19T04:24:46.418 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_locator": "@5", 2024-04-19T04:24:46.418 INFO:teuthology.orchestra.run.smithi007.stdout: "paused": 0, 2024-04-19T04:24:46.418 INFO:teuthology.orchestra.run.smithi007.stdout: "used_replica": 0, 2024-04-19T04:24:46.418 INFO:teuthology.orchestra.run.smithi007.stdout: "precalc_pgid": 0, 2024-04-19T04:24:46.418 INFO:teuthology.orchestra.run.smithi007.stdout: "last_sent": "718.374632s", 2024-04-19T04:24:46.418 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0039999099999999998, 2024-04-19T04:24:46.418 INFO:teuthology.orchestra.run.smithi007.stdout: "attempts": 1, 2024-04-19T04:24:46.418 INFO:teuthology.orchestra.run.smithi007.stdout: "snapid": "head", 2024-04-19T04:24:46.419 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_context": "0=[]", 2024-04-19T04:24:46.419 INFO:teuthology.orchestra.run.smithi007.stdout: "mtime": "2024-04-19T04:24:46.305644+0000", 2024-04-19T04:24:46.419 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ops": [ 2024-04-19T04:24:46.419 INFO:teuthology.orchestra.run.smithi007.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T04:24:46.419 INFO:teuthology.orchestra.run.smithi007.stdout: "write 0~65536 in=65536b" 2024-04-19T04:24:46.419 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-19T04:24:46.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-19T04:24:46.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-19T04:24:46.419 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 4719, 2024-04-19T04:24:46.419 INFO:teuthology.orchestra.run.smithi007.stdout: "pg": "5.93445045", 2024-04-19T04:24:46.419 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2024-04-19T04:24:46.419 INFO:teuthology.orchestra.run.smithi007.stdout: "object_id": "benchmark_data_smithi007_19526_object4718", 2024-04-19T04:24:46.419 INFO:teuthology.orchestra.run.smithi007.stdout: "object_locator": "@5", 2024-04-19T04:24:46.420 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_id": "benchmark_data_smithi007_19526_object4718", 2024-04-19T04:24:46.420 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_locator": "@5", 2024-04-19T04:24:46.420 INFO:teuthology.orchestra.run.smithi007.stdout: "paused": 0, 2024-04-19T04:24:46.420 INFO:teuthology.orchestra.run.smithi007.stdout: "used_replica": 0, 2024-04-19T04:24:46.420 INFO:teuthology.orchestra.run.smithi007.stdout: "precalc_pgid": 0, 2024-04-19T04:24:46.420 INFO:teuthology.orchestra.run.smithi007.stdout: "last_sent": "718.378632s", 2024-04-19T04:24:46.420 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0, 2024-04-19T04:24:46.420 INFO:teuthology.orchestra.run.smithi007.stdout: "attempts": 1, 2024-04-19T04:24:46.420 INFO:teuthology.orchestra.run.smithi007.stdout: "snapid": "head", 2024-04-19T04:24:46.420 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_context": "0=[]", 2024-04-19T04:24:46.420 INFO:teuthology.orchestra.run.smithi007.stdout: "mtime": "2024-04-19T04:24:46.308573+0000", 2024-04-19T04:24:46.420 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ops": [ 2024-04-19T04:24:46.420 INFO:teuthology.orchestra.run.smithi007.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T04:24:46.420 INFO:teuthology.orchestra.run.smithi007.stdout: "write 0~65536 in=65536b" 2024-04-19T04:24:46.420 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-19T04:24:46.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-19T04:24:46.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-19T04:24:46.421 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 4721, 2024-04-19T04:24:46.421 INFO:teuthology.orchestra.run.smithi007.stdout: "pg": "5.f4080946", 2024-04-19T04:24:46.421 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2024-04-19T04:24:46.421 INFO:teuthology.orchestra.run.smithi007.stdout: "object_id": "benchmark_data_smithi007_19526_object4720", 2024-04-19T04:24:46.421 INFO:teuthology.orchestra.run.smithi007.stdout: "object_locator": "@5", 2024-04-19T04:24:46.421 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_id": "benchmark_data_smithi007_19526_object4720", 2024-04-19T04:24:46.421 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_locator": "@5", 2024-04-19T04:24:46.421 INFO:teuthology.orchestra.run.smithi007.stdout: "paused": 0, 2024-04-19T04:24:46.421 INFO:teuthology.orchestra.run.smithi007.stdout: "used_replica": 0, 2024-04-19T04:24:46.421 INFO:teuthology.orchestra.run.smithi007.stdout: "precalc_pgid": 0, 2024-04-19T04:24:46.421 INFO:teuthology.orchestra.run.smithi007.stdout: "last_sent": "718.378632s", 2024-04-19T04:24:46.421 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0, 2024-04-19T04:24:46.422 INFO:teuthology.orchestra.run.smithi007.stdout: "attempts": 1, 2024-04-19T04:24:46.422 INFO:teuthology.orchestra.run.smithi007.stdout: "snapid": "head", 2024-04-19T04:24:46.422 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_context": "0=[]", 2024-04-19T04:24:46.422 INFO:teuthology.orchestra.run.smithi007.stdout: "mtime": "2024-04-19T04:24:46.308773+0000", 2024-04-19T04:24:46.422 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ops": [ 2024-04-19T04:24:46.422 INFO:teuthology.orchestra.run.smithi007.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T04:24:46.422 INFO:teuthology.orchestra.run.smithi007.stdout: "write 0~65536 in=65536b" 2024-04-19T04:24:46.422 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-19T04:24:46.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-19T04:24:46.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-19T04:24:46.422 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 4707, 2024-04-19T04:24:46.423 INFO:teuthology.orchestra.run.smithi007.stdout: "pg": "5.9352544b", 2024-04-19T04:24:46.423 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2024-04-19T04:24:46.423 INFO:teuthology.orchestra.run.smithi007.stdout: "object_id": "benchmark_data_smithi007_19526_object4706", 2024-04-19T04:24:46.423 INFO:teuthology.orchestra.run.smithi007.stdout: "object_locator": "@5", 2024-04-19T04:24:46.423 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_id": "benchmark_data_smithi007_19526_object4706", 2024-04-19T04:24:46.423 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_locator": "@5", 2024-04-19T04:24:46.423 INFO:teuthology.orchestra.run.smithi007.stdout: "paused": 0, 2024-04-19T04:24:46.423 INFO:teuthology.orchestra.run.smithi007.stdout: "used_replica": 0, 2024-04-19T04:24:46.423 INFO:teuthology.orchestra.run.smithi007.stdout: "precalc_pgid": 0, 2024-04-19T04:24:46.423 INFO:teuthology.orchestra.run.smithi007.stdout: "last_sent": "718.374632s", 2024-04-19T04:24:46.423 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0039999099999999998, 2024-04-19T04:24:46.423 INFO:teuthology.orchestra.run.smithi007.stdout: "attempts": 1, 2024-04-19T04:24:46.423 INFO:teuthology.orchestra.run.smithi007.stdout: "snapid": "head", 2024-04-19T04:24:46.423 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_context": "0=[]", 2024-04-19T04:24:46.423 INFO:teuthology.orchestra.run.smithi007.stdout: "mtime": "2024-04-19T04:24:46.304031+0000", 2024-04-19T04:24:46.424 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ops": [ 2024-04-19T04:24:46.424 INFO:teuthology.orchestra.run.smithi007.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T04:24:46.424 INFO:teuthology.orchestra.run.smithi007.stdout: "write 0~65536 in=65536b" 2024-04-19T04:24:46.424 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-19T04:24:46.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-19T04:24:46.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-19T04:24:46.424 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 4708, 2024-04-19T04:24:46.424 INFO:teuthology.orchestra.run.smithi007.stdout: "pg": "5.dfef4bab", 2024-04-19T04:24:46.424 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2024-04-19T04:24:46.424 INFO:teuthology.orchestra.run.smithi007.stdout: "object_id": "benchmark_data_smithi007_19526_object4707", 2024-04-19T04:24:46.424 INFO:teuthology.orchestra.run.smithi007.stdout: "object_locator": "@5", 2024-04-19T04:24:46.424 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_id": "benchmark_data_smithi007_19526_object4707", 2024-04-19T04:24:46.424 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_locator": "@5", 2024-04-19T04:24:46.424 INFO:teuthology.orchestra.run.smithi007.stdout: "paused": 0, 2024-04-19T04:24:46.424 INFO:teuthology.orchestra.run.smithi007.stdout: "used_replica": 0, 2024-04-19T04:24:46.425 INFO:teuthology.orchestra.run.smithi007.stdout: "precalc_pgid": 0, 2024-04-19T04:24:46.425 INFO:teuthology.orchestra.run.smithi007.stdout: "last_sent": "718.374632s", 2024-04-19T04:24:46.425 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0039999099999999998, 2024-04-19T04:24:46.425 INFO:teuthology.orchestra.run.smithi007.stdout: "attempts": 1, 2024-04-19T04:24:46.425 INFO:teuthology.orchestra.run.smithi007.stdout: "snapid": "head", 2024-04-19T04:24:46.425 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_context": "0=[]", 2024-04-19T04:24:46.425 INFO:teuthology.orchestra.run.smithi007.stdout: "mtime": "2024-04-19T04:24:46.304052+0000", 2024-04-19T04:24:46.425 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ops": [ 2024-04-19T04:24:46.425 INFO:teuthology.orchestra.run.smithi007.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T04:24:46.425 INFO:teuthology.orchestra.run.smithi007.stdout: "write 0~65536 in=65536b" 2024-04-19T04:24:46.425 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-19T04:24:46.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-19T04:24:46.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-19T04:24:46.425 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 4710, 2024-04-19T04:24:46.426 INFO:teuthology.orchestra.run.smithi007.stdout: "pg": "5.5d1a2694", 2024-04-19T04:24:46.426 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2024-04-19T04:24:46.426 INFO:teuthology.orchestra.run.smithi007.stdout: "object_id": "benchmark_data_smithi007_19526_object4709", 2024-04-19T04:24:46.426 INFO:teuthology.orchestra.run.smithi007.stdout: "object_locator": "@5", 2024-04-19T04:24:46.426 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_id": "benchmark_data_smithi007_19526_object4709", 2024-04-19T04:24:46.426 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_locator": "@5", 2024-04-19T04:24:46.426 INFO:teuthology.orchestra.run.smithi007.stdout: "paused": 0, 2024-04-19T04:24:46.426 INFO:teuthology.orchestra.run.smithi007.stdout: "used_replica": 0, 2024-04-19T04:24:46.426 INFO:teuthology.orchestra.run.smithi007.stdout: "precalc_pgid": 0, 2024-04-19T04:24:46.426 INFO:teuthology.orchestra.run.smithi007.stdout: "last_sent": "718.374632s", 2024-04-19T04:24:46.426 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0039999099999999998, 2024-04-19T04:24:46.426 INFO:teuthology.orchestra.run.smithi007.stdout: "attempts": 1, 2024-04-19T04:24:46.426 INFO:teuthology.orchestra.run.smithi007.stdout: "snapid": "head", 2024-04-19T04:24:46.426 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_context": "0=[]", 2024-04-19T04:24:46.427 INFO:teuthology.orchestra.run.smithi007.stdout: "mtime": "2024-04-19T04:24:46.304138+0000", 2024-04-19T04:24:46.427 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ops": [ 2024-04-19T04:24:46.427 INFO:teuthology.orchestra.run.smithi007.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T04:24:46.427 INFO:teuthology.orchestra.run.smithi007.stdout: "write 0~65536 in=65536b" 2024-04-19T04:24:46.427 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-19T04:24:46.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-19T04:24:46.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-19T04:24:46.427 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 4712, 2024-04-19T04:24:46.427 INFO:teuthology.orchestra.run.smithi007.stdout: "pg": "5.9094b56b", 2024-04-19T04:24:46.427 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2024-04-19T04:24:46.427 INFO:teuthology.orchestra.run.smithi007.stdout: "object_id": "benchmark_data_smithi007_19526_object4711", 2024-04-19T04:24:46.427 INFO:teuthology.orchestra.run.smithi007.stdout: "object_locator": "@5", 2024-04-19T04:24:46.427 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_id": "benchmark_data_smithi007_19526_object4711", 2024-04-19T04:24:46.427 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_locator": "@5", 2024-04-19T04:24:46.428 INFO:teuthology.orchestra.run.smithi007.stdout: "paused": 0, 2024-04-19T04:24:46.428 INFO:teuthology.orchestra.run.smithi007.stdout: "used_replica": 0, 2024-04-19T04:24:46.428 INFO:teuthology.orchestra.run.smithi007.stdout: "precalc_pgid": 0, 2024-04-19T04:24:46.428 INFO:teuthology.orchestra.run.smithi007.stdout: "last_sent": "718.374632s", 2024-04-19T04:24:46.428 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0039999099999999998, 2024-04-19T04:24:46.428 INFO:teuthology.orchestra.run.smithi007.stdout: "attempts": 1, 2024-04-19T04:24:46.428 INFO:teuthology.orchestra.run.smithi007.stdout: "snapid": "head", 2024-04-19T04:24:46.428 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_context": "0=[]", 2024-04-19T04:24:46.428 INFO:teuthology.orchestra.run.smithi007.stdout: "mtime": "2024-04-19T04:24:46.304467+0000", 2024-04-19T04:24:46.428 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ops": [ 2024-04-19T04:24:46.428 INFO:teuthology.orchestra.run.smithi007.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T04:24:46.428 INFO:teuthology.orchestra.run.smithi007.stdout: "write 0~65536 in=65536b" 2024-04-19T04:24:46.428 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-19T04:24:46.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-19T04:24:46.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-19T04:24:46.429 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 4717, 2024-04-19T04:24:46.429 INFO:teuthology.orchestra.run.smithi007.stdout: "pg": "5.da420edd", 2024-04-19T04:24:46.429 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2024-04-19T04:24:46.429 INFO:teuthology.orchestra.run.smithi007.stdout: "object_id": "benchmark_data_smithi007_19526_object4716", 2024-04-19T04:24:46.429 INFO:teuthology.orchestra.run.smithi007.stdout: "object_locator": "@5", 2024-04-19T04:24:46.429 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_id": "benchmark_data_smithi007_19526_object4716", 2024-04-19T04:24:46.429 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_locator": "@5", 2024-04-19T04:24:46.429 INFO:teuthology.orchestra.run.smithi007.stdout: "paused": 0, 2024-04-19T04:24:46.429 INFO:teuthology.orchestra.run.smithi007.stdout: "used_replica": 0, 2024-04-19T04:24:46.429 INFO:teuthology.orchestra.run.smithi007.stdout: "precalc_pgid": 0, 2024-04-19T04:24:46.429 INFO:teuthology.orchestra.run.smithi007.stdout: "last_sent": "718.378632s", 2024-04-19T04:24:46.429 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0, 2024-04-19T04:24:46.429 INFO:teuthology.orchestra.run.smithi007.stdout: "attempts": 1, 2024-04-19T04:24:46.429 INFO:teuthology.orchestra.run.smithi007.stdout: "snapid": "head", 2024-04-19T04:24:46.430 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_context": "0=[]", 2024-04-19T04:24:46.430 INFO:teuthology.orchestra.run.smithi007.stdout: "mtime": "2024-04-19T04:24:46.308400+0000", 2024-04-19T04:24:46.430 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ops": [ 2024-04-19T04:24:46.430 INFO:teuthology.orchestra.run.smithi007.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T04:24:46.430 INFO:teuthology.orchestra.run.smithi007.stdout: "write 0~65536 in=65536b" 2024-04-19T04:24:46.430 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-19T04:24:46.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-19T04:24:46.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-19T04:24:46.430 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 4718, 2024-04-19T04:24:46.430 INFO:teuthology.orchestra.run.smithi007.stdout: "pg": "5.67aa48ce", 2024-04-19T04:24:46.430 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2024-04-19T04:24:46.430 INFO:teuthology.orchestra.run.smithi007.stdout: "object_id": "benchmark_data_smithi007_19526_object4717", 2024-04-19T04:24:46.430 INFO:teuthology.orchestra.run.smithi007.stdout: "object_locator": "@5", 2024-04-19T04:24:46.430 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_id": "benchmark_data_smithi007_19526_object4717", 2024-04-19T04:24:46.431 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_locator": "@5", 2024-04-19T04:24:46.431 INFO:teuthology.orchestra.run.smithi007.stdout: "paused": 0, 2024-04-19T04:24:46.431 INFO:teuthology.orchestra.run.smithi007.stdout: "used_replica": 0, 2024-04-19T04:24:46.431 INFO:teuthology.orchestra.run.smithi007.stdout: "precalc_pgid": 0, 2024-04-19T04:24:46.431 INFO:teuthology.orchestra.run.smithi007.stdout: "last_sent": "718.378632s", 2024-04-19T04:24:46.431 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0, 2024-04-19T04:24:46.431 INFO:teuthology.orchestra.run.smithi007.stdout: "attempts": 1, 2024-04-19T04:24:46.431 INFO:teuthology.orchestra.run.smithi007.stdout: "snapid": "head", 2024-04-19T04:24:46.431 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_context": "0=[]", 2024-04-19T04:24:46.431 INFO:teuthology.orchestra.run.smithi007.stdout: "mtime": "2024-04-19T04:24:46.308441+0000", 2024-04-19T04:24:46.431 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ops": [ 2024-04-19T04:24:46.431 INFO:teuthology.orchestra.run.smithi007.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T04:24:46.431 INFO:teuthology.orchestra.run.smithi007.stdout: "write 0~65536 in=65536b" 2024-04-19T04:24:46.431 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-19T04:24:46.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-19T04:24:46.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-19T04:24:46.432 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 4720, 2024-04-19T04:24:46.432 INFO:teuthology.orchestra.run.smithi007.stdout: "pg": "5.254f6beb", 2024-04-19T04:24:46.432 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2024-04-19T04:24:46.432 INFO:teuthology.orchestra.run.smithi007.stdout: "object_id": "benchmark_data_smithi007_19526_object4719", 2024-04-19T04:24:46.432 INFO:teuthology.orchestra.run.smithi007.stdout: "object_locator": "@5", 2024-04-19T04:24:46.432 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_id": "benchmark_data_smithi007_19526_object4719", 2024-04-19T04:24:46.432 INFO:teuthology.orchestra.run.smithi007.stdout: "target_object_locator": "@5", 2024-04-19T04:24:46.432 INFO:teuthology.orchestra.run.smithi007.stdout: "paused": 0, 2024-04-19T04:24:46.432 INFO:teuthology.orchestra.run.smithi007.stdout: "used_replica": 0, 2024-04-19T04:24:46.432 INFO:teuthology.orchestra.run.smithi007.stdout: "precalc_pgid": 0, 2024-04-19T04:24:46.432 INFO:teuthology.orchestra.run.smithi007.stdout: "last_sent": "718.378632s", 2024-04-19T04:24:46.432 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0, 2024-04-19T04:24:46.432 INFO:teuthology.orchestra.run.smithi007.stdout: "attempts": 1, 2024-04-19T04:24:46.433 INFO:teuthology.orchestra.run.smithi007.stdout: "snapid": "head", 2024-04-19T04:24:46.433 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_context": "0=[]", 2024-04-19T04:24:46.433 INFO:teuthology.orchestra.run.smithi007.stdout: "mtime": "2024-04-19T04:24:46.308640+0000", 2024-04-19T04:24:46.433 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ops": [ 2024-04-19T04:24:46.433 INFO:teuthology.orchestra.run.smithi007.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T04:24:46.433 INFO:teuthology.orchestra.run.smithi007.stdout: "write 0~65536 in=65536b" 2024-04-19T04:24:46.433 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-19T04:24:46.433 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-19T04:24:46.433 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-19T04:24:46.433 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_ops": [], 2024-04-19T04:24:46.433 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ops": [], 2024-04-19T04:24:46.433 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_stat_ops": [], 2024-04-19T04:24:46.433 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_ops": [], 2024-04-19T04:24:46.433 INFO:teuthology.orchestra.run.smithi007.stdout: "command_ops": [] 2024-04-19T04:24:46.434 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-19T04:24:46.434 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:24:46.434 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:46.402+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:46.435 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 4713, "pg": "5.ec2ada92", "osd": 0, "object_id": "benchmark_data_smithi007_19526_object4712", "object_locator": "@5", "target_object_id": "benchmark_data_smithi007_19526_object4712", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "718.374632s", "age": 0.0039999099999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T04:24:46.305213+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4714, "pg": "5.f1c8abc7", "osd": 0, "object_id": "benchmark_data_smithi007_19526_object4713", "object_locator": "@5", "target_object_id": "benchmark_data_smithi007_19526_object4713", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "718.374632s", "age": 0.0039999099999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T04:24:46.305597+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4716, "pg": "5.3ddf2791", "osd": 0, "object_id": "benchmark_data_smithi007_19526_object4715", "object_locator": "@5", "target_object_id": "benchmark_data_smithi007_19526_object4715", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "718.378632s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T04:24:46.307743+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4704, "pg": "5.5cee1a0a", "osd": 1, "object_id": "benchmark_data_smithi007_19526_object4703", "object_locator": "@5", "target_object_id": "benchmark_data_smithi007_19526_object4703", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "718.370632s", "age": 0.0079998199999999995, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T04:24:46.303513+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4706, "pg": "5.6cf2b603", "osd": 1, "object_id": "benchmark_data_smithi007_19526_object4705", "object_locator": "@5", "target_object_id": "benchmark_data_smithi007_19526_object4705", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "718.374632s", "age": 0.0039999099999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T04:24:46.303847+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4711, "pg": "5.d856e8e3", "osd": 1, "object_id": "benchmark_data_smithi007_19526_object4710", "object_locator": "@5", "target_object_id": "benchmark_data_smithi007_19526_object4710", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "718.374632s", "age": 0.0039999099999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T04:24:46.304146+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4715, "pg": "5.ae5ea15a", "osd": 1, "object_id": "benchmark_data_smithi007_19526_object4714", "object_locator": "@5", "target_object_id": "benchmark_data_smithi007_19526_object4714", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "718.374632s", "age": 0.0039999099999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T04:24:46.305644+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4719, "pg": "5.93445045", "osd": 1, "object_id": "benchmark_data_smithi007_19526_object4718", "object_locator": "@5", "target_object_id": "benchmark_data_smithi007_19526_object4718", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "718.378632s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T04:24:46.308573+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4721, "pg": "5.f4080946", "osd": 1, "object_id": "benchmark_data_smithi007_19526_object4720", "object_locator": "@5", "target_object_id": "benchmark_data_smithi007_19526_object4720", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "718.378632s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T04:24:46.308773+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4707, "pg": "5.9352544b", "osd": 2, "object_id": "benchmark_data_smithi007_19526_object4706", "object_locator": "@5", "target_object_id": "benchmark_data_smithi007_19526_object4706", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "718.374632s", "age": 0.0039999099999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T04:24:46.304031+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4708, "pg": "5.dfef4bab", "osd": 2, "object_id": "benchmark_data_smithi007_19526_object4707", "object_locator": "@5", "target_object_id": "benchmark_data_smithi007_19526_object4707", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "718.374632s", "age": 0.0039999099999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T04:24:46.304052+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4710, "pg": "5.5d1a2694", "osd": 2, "object_id": "benchmark_data_smithi007_19526_object4709", "object_locator": "@5", "target_object_id": "benchmark_data_smithi007_19526_object4709", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "718.374632s", "age": 0.0039999099999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T04:24:46.304138+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4712, "pg": "5.9094b56b", "osd": 2, "object_id": "benchmark_data_smithi007_19526_object4711", "object_locator": "@5", "target_object_id": "benchmark_data_smithi007_19526_object4711", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "718.374632s", "age": 0.0039999099999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T04:24:46.304467+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4717, "pg": "5.da420edd", "osd": 2, "object_id": "benchmark_data_smithi007_19526_object4716", "object_locator": "@5", "target_object_id": "benchmark_data_smithi007_19526_object4716", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "718.378632s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T04:24:46.308400+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4718, "pg": "5.67aa48ce", "osd": 2, "object_id": "benchmark_data_smithi007_19526_object4717", "object_locator": "@5", "target_object_id": "benchmark_data_smithi007_19526_object4717", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "718.378632s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T04:24:46.308441+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4720, "pg": "5.254f6beb", "osd": 2, "object_id": "benchmark_data_smithi007_19526_object4719", "object_locator": "@5", "target_object_id": "benchmark_data_smithi007_19526_object4719", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "718.378632s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T04:24:46.308640+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2024-04-19T04:24:46.435 DEBUG:teuthology.orchestra.run.smithi007:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-04-19T04:24:46.436 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:24:46.481 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2024-04-19T04:24:46.487 DEBUG:teuthology.parallel:result is None 2024-04-19T04:24:46.488 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2024-04-19T04:24:46.497 INFO:tasks.radosbench:joining radosbench (timing out after 2100s) 2024-04-19T04:24:46.497 INFO:teuthology.orchestra.run:waiting for 2100 2024-04-19T04:24:46.507 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:46.503+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:46.578 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:24:46.579 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [ 2024-04-19T04:24:46.579 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.579 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:5567 5.3 5:c5fc647e:::benchmark_data_smithi007_19526_object5566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T04:24:46.579 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:46.573677+0000", 2024-04-19T04:24:46.579 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00306712, 2024-04-19T04:24:46.579 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.003098735, 2024-04-19T04:24:46.579 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:46.579 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:46.579 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:46.579 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:46.579 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:46.579 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 5567 2024-04-19T04:24:46.579 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.579 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:46.580 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.580 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:46.580 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573677+0000", 2024-04-19T04:24:46.580 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.580 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.580 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.580 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:46.580 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573677+0000", 2024-04-19T04:24:46.580 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.580 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.580 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.580 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:46.580 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573676+0000", 2024-04-19T04:24:46.580 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:46.580 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.580 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.581 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:46.581 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573729+0000", 2024-04-19T04:24:46.581 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2581999999999999e-05 2024-04-19T04:24:46.581 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.581 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.581 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:46.581 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573749+0000", 2024-04-19T04:24:46.581 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.0834000000000001e-05 2024-04-19T04:24:46.581 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.581 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.581 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.581 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573759+0000", 2024-04-19T04:24:46.581 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.5040000000000008e-06 2024-04-19T04:24:46.581 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.581 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.582 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:46.582 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573797+0000", 2024-04-19T04:24:46.582 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8206e-05 2024-04-19T04:24:46.582 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.583 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.583 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:46.583 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573897+0000", 2024-04-19T04:24:46.583 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.9643999999999997e-05 2024-04-19T04:24:46.583 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.583 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.583 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:46.583 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574060+0000", 2024-04-19T04:24:46.583 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00016290799999999999 2024-04-19T04:24:46.583 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.583 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.583 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:46.583 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.575899+0000", 2024-04-19T04:24:46.583 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001839118 2024-04-19T04:24:46.584 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.584 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:46.584 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.584 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.584 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.584 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:5568 5.6 5:6bf443d6:::benchmark_data_smithi007_19526_object5567:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T04:24:46.584 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:46.573812+0000", 2024-04-19T04:24:46.584 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0029319530000000002, 2024-04-19T04:24:46.584 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0030660890000000001, 2024-04-19T04:24:46.584 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:46.584 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:46.584 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:46.584 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:46.584 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:46.584 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 5568 2024-04-19T04:24:46.585 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.585 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:46.585 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.585 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:46.585 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573812+0000", 2024-04-19T04:24:46.585 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.585 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.585 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.585 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:46.586 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573812+0000", 2024-04-19T04:24:46.586 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.586 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.586 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.586 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:46.586 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573811+0000", 2024-04-19T04:24:46.586 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:46.586 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.586 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.586 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:46.586 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573858+0000", 2024-04-19T04:24:46.586 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.6715999999999998e-05 2024-04-19T04:24:46.586 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.586 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.587 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:46.587 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573868+0000", 2024-04-19T04:24:46.587 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.8889999999999997e-06 2024-04-19T04:24:46.587 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.587 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.587 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.587 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573875+0000", 2024-04-19T04:24:46.587 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.742e-06 2024-04-19T04:24:46.588 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.588 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.588 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:46.588 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573912+0000", 2024-04-19T04:24:46.588 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.7052999999999999e-05 2024-04-19T04:24:46.588 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.588 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.588 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:46.588 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574045+0000", 2024-04-19T04:24:46.588 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013367899999999999 2024-04-19T04:24:46.588 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.588 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.588 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:46.588 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574184+0000", 2024-04-19T04:24:46.588 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000138286 2024-04-19T04:24:46.589 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.589 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:46.589 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.589 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.589 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.589 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:5569 5.6 5:6e3c1f5e:::benchmark_data_smithi007_19526_object5568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T04:24:46.589 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:46.573926+0000", 2024-04-19T04:24:46.589 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0028186249999999999, 2024-04-19T04:24:46.589 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0030539009999999999, 2024-04-19T04:24:46.589 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:46.589 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:46.589 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:46.589 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:46.589 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:46.589 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 5569 2024-04-19T04:24:46.589 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.590 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:46.590 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.590 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:46.590 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573926+0000", 2024-04-19T04:24:46.590 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.590 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.590 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.590 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:46.590 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573926+0000", 2024-04-19T04:24:46.590 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.590 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.590 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.590 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:46.590 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573925+0000", 2024-04-19T04:24:46.591 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:46.591 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.591 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.591 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:46.591 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573971+0000", 2024-04-19T04:24:46.591 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.6795999999999997e-05 2024-04-19T04:24:46.591 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.591 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.591 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:46.591 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573982+0000", 2024-04-19T04:24:46.591 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.04e-05 2024-04-19T04:24:46.591 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.591 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.591 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.592 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.573989+0000", 2024-04-19T04:24:46.592 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.5889999999999997e-06 2024-04-19T04:24:46.592 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.592 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.592 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:46.592 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574894+0000", 2024-04-19T04:24:46.592 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00090497199999999998 2024-04-19T04:24:46.592 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.592 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.592 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:46.592 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574971+0000", 2024-04-19T04:24:46.592 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.6423999999999999e-05 2024-04-19T04:24:46.592 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.592 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.592 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:46.592 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.575063+0000", 2024-04-19T04:24:46.593 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.1775999999999997e-05 2024-04-19T04:24:46.593 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.593 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:46.593 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.593 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.593 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.593 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:5571 5.3 5:cd1aac89:::benchmark_data_smithi007_19526_object5570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T04:24:46.593 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:46.574020+0000", 2024-04-19T04:24:46.593 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0027238169999999999, 2024-04-19T04:24:46.593 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.003049225, 2024-04-19T04:24:46.593 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:46.593 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:46.593 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:46.593 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:46.594 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:46.594 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 5571 2024-04-19T04:24:46.594 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.594 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:46.594 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.594 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:46.594 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574020+0000", 2024-04-19T04:24:46.594 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.594 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.594 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.594 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:46.594 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574020+0000", 2024-04-19T04:24:46.594 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.594 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.595 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.595 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:46.595 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574020+0000", 2024-04-19T04:24:46.595 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:46.595 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.595 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.595 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:46.595 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574101+0000", 2024-04-19T04:24:46.595 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.1620999999999997e-05 2024-04-19T04:24:46.595 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.596 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.596 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:46.596 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574110+0000", 2024-04-19T04:24:46.596 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.1009999999999998e-06 2024-04-19T04:24:46.596 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.596 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.596 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.596 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574117+0000", 2024-04-19T04:24:46.596 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.9179999999999997e-06 2024-04-19T04:24:46.596 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.596 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.596 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:46.596 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574881+0000", 2024-04-19T04:24:46.596 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00076406599999999999 2024-04-19T04:24:46.596 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.597 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.597 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:46.597 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.575008+0000", 2024-04-19T04:24:46.597 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012635599999999999 2024-04-19T04:24:46.597 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.597 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.597 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:46.597 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.575149+0000", 2024-04-19T04:24:46.597 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014140499999999999 2024-04-19T04:24:46.597 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.597 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:46.597 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.597 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.597 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.598 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:5570 5.1 e23/20 5:8231aac5:::benchmark_data_smithi007_19526_object5569:head v 23'356, mlcod=23'354)", 2024-04-19T04:24:46.598 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:46.574618+0000", 2024-04-19T04:24:46.598 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0021256909999999999, 2024-04-19T04:24:46.598 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0025072990000000002, 2024-04-19T04:24:46.598 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:46.598 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:46.598 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:46.598 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.598 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:46.598 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574618+0000", 2024-04-19T04:24:46.598 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.598 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.598 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.598 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:46.598 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574618+0000", 2024-04-19T04:24:46.599 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.599 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.599 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.599 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:46.599 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574618+0000", 2024-04-19T04:24:46.599 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:46.599 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.599 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.599 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:46.599 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574687+0000", 2024-04-19T04:24:46.599 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.9593999999999998e-05 2024-04-19T04:24:46.599 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.599 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.599 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:46.599 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574697+0000", 2024-04-19T04:24:46.600 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.4159999999999993e-06 2024-04-19T04:24:46.600 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.600 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.600 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.600 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574705+0000", 2024-04-19T04:24:46.600 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.0390000000000005e-06 2024-04-19T04:24:46.600 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.600 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.600 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:46.600 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574754+0000", 2024-04-19T04:24:46.600 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.9583999999999998e-05 2024-04-19T04:24:46.600 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.600 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.600 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:46.600 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.574782+0000", 2024-04-19T04:24:46.601 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.8030000000000001e-05 2024-04-19T04:24:46.601 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.601 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:46.601 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.601 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.601 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.601 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:5572 5.e e23/20 5:70159fcd:::benchmark_data_smithi007_19526_object5571:head v 23'352, mlcod=23'350)", 2024-04-19T04:24:46.601 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:46.575054+0000", 2024-04-19T04:24:46.601 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.001690343, 2024-04-19T04:24:46.601 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0021082449999999999, 2024-04-19T04:24:46.601 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:46.601 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:46.601 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:46.601 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.601 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:46.602 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.575054+0000", 2024-04-19T04:24:46.602 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.602 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.602 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.602 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:46.602 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.575054+0000", 2024-04-19T04:24:46.602 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.602 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.602 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.602 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:46.602 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.575053+0000", 2024-04-19T04:24:46.602 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:46.602 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.602 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.603 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:46.603 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.575100+0000", 2024-04-19T04:24:46.603 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7290000000000003e-05 2024-04-19T04:24:46.603 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.603 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.603 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:46.603 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.575163+0000", 2024-04-19T04:24:46.603 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.2644000000000005e-05 2024-04-19T04:24:46.603 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.603 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.603 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.603 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.575172+0000", 2024-04-19T04:24:46.603 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.6710000000000005e-06 2024-04-19T04:24:46.603 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.603 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.604 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:46.604 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.575240+0000", 2024-04-19T04:24:46.604 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.8689999999999995e-05 2024-04-19T04:24:46.604 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.604 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.604 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:46.604 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.575259+0000", 2024-04-19T04:24:46.604 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8831999999999999e-05 2024-04-19T04:24:46.604 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.604 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:46.604 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.604 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.604 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.604 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:5575 5.5 5:af2651ef:::benchmark_data_smithi007_19526_object5574:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T04:24:46.604 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:46.576175+0000", 2024-04-19T04:24:46.604 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00056952599999999999, 2024-04-19T04:24:46.605 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0010692550000000001, 2024-04-19T04:24:46.605 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:46.605 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:46.605 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:46.605 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:46.605 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:46.605 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 5575 2024-04-19T04:24:46.605 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.605 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:46.605 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.605 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:46.605 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576175+0000", 2024-04-19T04:24:46.605 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.605 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.605 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.606 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:46.606 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576175+0000", 2024-04-19T04:24:46.606 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.606 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.606 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.606 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:46.606 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576174+0000", 2024-04-19T04:24:46.606 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:46.606 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.606 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.606 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:46.606 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576241+0000", 2024-04-19T04:24:46.606 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7020000000000005e-05 2024-04-19T04:24:46.606 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.607 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.607 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:46.607 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576253+0000", 2024-04-19T04:24:46.607 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2836e-05 2024-04-19T04:24:46.607 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.607 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.607 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.607 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576260+0000", 2024-04-19T04:24:46.607 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.4710000000000004e-06 2024-04-19T04:24:46.607 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.607 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.607 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:46.607 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576311+0000", 2024-04-19T04:24:46.607 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.1405e-05 2024-04-19T04:24:46.607 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.607 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.608 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:46.608 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576438+0000", 2024-04-19T04:24:46.608 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012692399999999999 2024-04-19T04:24:46.608 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.608 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.608 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:46.608 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576522+0000", 2024-04-19T04:24:46.608 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.3319999999999995e-05 2024-04-19T04:24:46.608 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.608 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:46.608 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.608 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.608 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.608 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:5576 5.c 5:3f0a6666:::benchmark_data_smithi007_19526_object5575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T04:24:46.609 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:46.576270+0000", 2024-04-19T04:24:46.609 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00047397800000000001, 2024-04-19T04:24:46.609 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0010613230000000001, 2024-04-19T04:24:46.609 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:46.609 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:46.609 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:46.609 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:46.609 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:46.609 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 5576 2024-04-19T04:24:46.609 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.609 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:46.609 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.609 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:46.609 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576270+0000", 2024-04-19T04:24:46.609 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.610 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.610 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.610 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:46.610 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576270+0000", 2024-04-19T04:24:46.610 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.610 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.610 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.610 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:46.610 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576269+0000", 2024-04-19T04:24:46.610 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:46.610 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.610 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.610 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:46.610 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576318+0000", 2024-04-19T04:24:46.610 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.8816999999999997e-05 2024-04-19T04:24:46.611 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.611 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.611 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:46.611 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576327+0000", 2024-04-19T04:24:46.611 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.7320000000000004e-06 2024-04-19T04:24:46.611 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.611 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.611 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.611 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576340+0000", 2024-04-19T04:24:46.611 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3183000000000001e-05 2024-04-19T04:24:46.611 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.611 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.611 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:46.611 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576382+0000", 2024-04-19T04:24:46.611 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2163999999999998e-05 2024-04-19T04:24:46.612 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.612 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.612 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:46.612 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576485+0000", 2024-04-19T04:24:46.612 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000102365 2024-04-19T04:24:46.612 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.612 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.612 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:46.612 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576577+0000", 2024-04-19T04:24:46.612 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.2157999999999994e-05 2024-04-19T04:24:46.612 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.612 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:46.612 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.612 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.612 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.613 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:5574 5.1 e23/20 5:825db300:::benchmark_data_smithi007_19526_object5573:head v 23'357, mlcod=23'354)", 2024-04-19T04:24:46.613 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:46.576599+0000", 2024-04-19T04:24:46.613 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.000145501, 2024-04-19T04:24:46.613 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00079417500000000005, 2024-04-19T04:24:46.613 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:46.613 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:46.613 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:46.613 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.613 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:46.613 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576599+0000", 2024-04-19T04:24:46.613 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.613 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.613 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.613 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:46.613 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576599+0000", 2024-04-19T04:24:46.614 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.614 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.614 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.614 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:46.614 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576598+0000", 2024-04-19T04:24:46.614 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:46.614 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.614 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.614 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:46.614 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576695+0000", 2024-04-19T04:24:46.614 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.7087000000000001e-05 2024-04-19T04:24:46.614 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.614 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.614 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:46.614 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576704+0000", 2024-04-19T04:24:46.615 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.2420000000000006e-06 2024-04-19T04:24:46.615 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.615 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.615 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.615 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576710+0000", 2024-04-19T04:24:46.615 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.0079999999999999e-06 2024-04-19T04:24:46.615 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.615 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.615 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:46.615 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576766+0000", 2024-04-19T04:24:46.615 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.5247000000000001e-05 2024-04-19T04:24:46.615 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.615 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.615 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:46.615 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576780+0000", 2024-04-19T04:24:46.616 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.4316e-05 2024-04-19T04:24:46.616 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.616 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:46.616 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.616 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.616 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.616 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:5577 5.8 e23/20 5:151e05eb:::benchmark_data_smithi007_19526_object5576:head v 23'372, mlcod=23'369)", 2024-04-19T04:24:46.616 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:46.576960+0000", 2024-04-19T04:24:46.616 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4294967295.9997845, 2024-04-19T04:24:46.616 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000468011, 2024-04-19T04:24:46.616 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:46.616 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:46.616 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:46.616 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.616 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:46.617 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576960+0000", 2024-04-19T04:24:46.617 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.617 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.617 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.617 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:46.617 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576960+0000", 2024-04-19T04:24:46.617 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:46.617 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.617 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.617 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:46.617 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576959+0000", 2024-04-19T04:24:46.617 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:46.617 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.617 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.617 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:46.618 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.576993+0000", 2024-04-19T04:24:46.618 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.3942999999999997e-05 2024-04-19T04:24:46.618 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.618 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.618 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:46.618 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.577014+0000", 2024-04-19T04:24:46.618 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.1648999999999999e-05 2024-04-19T04:24:46.618 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.618 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.618 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:46.618 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.577023+0000", 2024-04-19T04:24:46.618 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.3280000000000006e-06 2024-04-19T04:24:46.618 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.618 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.618 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:46.619 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.577074+0000", 2024-04-19T04:24:46.619 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.1604999999999998e-05 2024-04-19T04:24:46.619 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:46.619 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:46.619 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:46.619 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:46.577089+0000", 2024-04-19T04:24:46.619 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.4918e-05 2024-04-19T04:24:46.619 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.619 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:46.619 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.619 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:46.619 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-04-19T04:24:46.619 INFO:teuthology.orchestra.run.smithi066.stdout: "num_ops": 10 2024-04-19T04:24:46.619 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:24:46.621 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:24:46.621 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-04-19T04:24:46.622 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:24:46.622 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:46.615+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:46.630 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:24:46.633 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:24:46.633 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T04:24:46.633 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:24:46.721 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:46.715+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:46.750 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 2 16 6100 6084 190.108 192.875 0.00680532 0.00524593 2024-04-19T04:24:46.764 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:46.764 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:46.777 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:24:46.822 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:46.815+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:46.908 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:46.909 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:46.922 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:24:46.923 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:46.919+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:47.024 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:47.018+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:47.048 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:47.049 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:47.060 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:24:47.113 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T04:24:47.114 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T04:24:47.114 INFO:tasks.thrashosds.thrasher:Setting full ratio to .001 2024-04-19T04:24:47.114 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .001 2024-04-19T04:24:47.124 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:47.119+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:47.176 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:47.176 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:47.190 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:24:47.225 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:47.219+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:47.322 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:47.322 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:47.326 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:47.319+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:47.334 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:24:47.427 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:47.423+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:47.466 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:47.466 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:47.478 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:24:47.528 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:47.523+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:47.613 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:47.613 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:47.626 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:24:47.629 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:47.623+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:47.653 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-04-19T04:24:47.650+0000 7f2f67176700 -1 log_channel(cluster) log [ERR] : Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2024-04-19T04:24:47.669 INFO:teuthology.orchestra.run.smithi007.stderr:osd set-full-ratio 0.001 2024-04-19T04:24:47.675 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T04:24:47.730 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:47.723+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:47.750 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 3 15 9067 9052 188.562 185.5 0.00415434 0.00529448 2024-04-19T04:24:47.754 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:47.754 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:47.767 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:24:47.830 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:47.823+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:47.910 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:47.910 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:47.924 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:24:47.931 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:47.926+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:48.032 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:48.027+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:48.060 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:48.061 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:48.074 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:24:48.133 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:48.130+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:48.210 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:48.210 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:48.223 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:24:48.233 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:48.230+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:48.335 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:48.331+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:48.345 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:48.345 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:48.357 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:24:48.436 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:48.430+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:48.475 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:48.475 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:48.486 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:24:48.536 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:48.531+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:48.610 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:48.610 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:48.622 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:24:48.638 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:48.635+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:48.645 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:24:48.675 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-04-19T04:24:48.684 INFO:tasks.thrashosds.thrasher:Setting full ratio back to .95 2024-04-19T04:24:48.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .95 2024-04-19T04:24:48.739 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:48.734+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:48.750 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 4 16 11909 11893 185.807 177.562 0.00779517 0.00537346 2024-04-19T04:24:48.758 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:48.758 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:48.770 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:24:48.804 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:24:48.830 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-04-19T04:24:48.839 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:48.835+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:48.853 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:24:48.854 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:24:48.855 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T04:24:48.855 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:24:48.891 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:48.892 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:24:48.892 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:24:48.892 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:24:48.892 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:48.907 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:24:48.957 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:48.954+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:49.034 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:49.035 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:24:49.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:24:49.035 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:24:49.035 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.035 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4159.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-04-19T04:24:49.035 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:11.119346+0000", 2024-04-19T04:24:49.035 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 37.914099473999997, 2024-04-19T04:24:49.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019667567, 2024-04-19T04:24:49.035 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.035 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.035 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:49.035 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4159", 2024-04-19T04:24:49.035 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/1235519030", 2024-04-19T04:24:49.036 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 189 2024-04-19T04:24:49.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.036 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.036 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.036 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.036 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119346+0000", 2024-04-19T04:24:49.036 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.036 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.036 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.036 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119346+0000", 2024-04-19T04:24:49.036 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.036 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.037 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.037 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119345+0000", 2024-04-19T04:24:49.037 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:49.037 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.037 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.037 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.037 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119353+0000", 2024-04-19T04:24:49.037 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.396e-06 2024-04-19T04:24:49.037 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.037 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.037 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.037 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119361+0000", 2024-04-19T04:24:49.037 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9130000000000003e-06 2024-04-19T04:24:49.037 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.038 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.038 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.038 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119367+0000", 2024-04-19T04:24:49.038 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4500000000000001e-06 2024-04-19T04:24:49.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.038 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.038 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.038 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.135564+0000", 2024-04-19T04:24:49.038 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016196894999999999 2024-04-19T04:24:49.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.038 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.038 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.038 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.135679+0000", 2024-04-19T04:24:49.038 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114722 2024-04-19T04:24:49.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.039 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.039 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:49.039 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.135816+0000", 2024-04-19T04:24:49.039 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000137637 2024-04-19T04:24:49.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.039 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.039 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.039 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.138143+0000", 2024-04-19T04:24:49.039 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023263279999999999 2024-04-19T04:24:49.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.039 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.039 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.039 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.138920+0000", 2024-04-19T04:24:49.040 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000777515 2024-04-19T04:24:49.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.040 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.040 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.040 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.138969+0000", 2024-04-19T04:24:49.040 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8634999999999998e-05 2024-04-19T04:24:49.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.040 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.040 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.040 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.139014+0000", 2024-04-19T04:24:49.040 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4722999999999999e-05 2024-04-19T04:24:49.040 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.040 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.040 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.041 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.041 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:49.041 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.499709922000001, 2024-04-19T04:24:49.041 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026801078999999998, 2024-04-19T04:24:49.041 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.041 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.041 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.041 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.041 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:49.041 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.041 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.042 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.042 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:49.042 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.042 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.042 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.042 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.042 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533733+0000", 2024-04-19T04:24:49.042 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999976 2024-04-19T04:24:49.042 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.042 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.042 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.042 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533746+0000", 2024-04-19T04:24:49.042 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2679e-05 2024-04-19T04:24:49.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.043 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.043 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.043 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533769+0000", 2024-04-19T04:24:49.043 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2832000000000001e-05 2024-04-19T04:24:49.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.043 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.043 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.043 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:24:49.043 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0599999999999999e-05 2024-04-19T04:24:49.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.043 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.043 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.043 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533907+0000", 2024-04-19T04:24:49.043 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000118076 2024-04-19T04:24:49.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.044 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.044 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:49.044 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533919+0000", 2024-04-19T04:24:49.044 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1644999999999999e-05 2024-04-19T04:24:49.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.044 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.044 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.044 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553399+0000", 2024-04-19T04:24:49.044 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019479987000000001 2024-04-19T04:24:49.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.044 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.044 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.044 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553535+0000", 2024-04-19T04:24:49.044 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553400000000001 2024-04-19T04:24:49.045 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.045 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.045 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:49.045 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553696+0000", 2024-04-19T04:24:49.045 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000161068 2024-04-19T04:24:49.045 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.045 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.045 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.045 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558096+0000", 2024-04-19T04:24:49.045 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0043998880000000002 2024-04-19T04:24:49.045 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.045 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.045 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.045 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560465+0000", 2024-04-19T04:24:49.046 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023695159999999999 2024-04-19T04:24:49.046 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.046 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.046 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.046 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560513+0000", 2024-04-19T04:24:49.046 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7899000000000003e-05 2024-04-19T04:24:49.046 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.046 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.046 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.046 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560537+0000", 2024-04-19T04:24:49.046 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3768e-05 2024-04-19T04:24:49.046 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.046 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.046 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.046 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.047 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.047 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.047 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:49.047 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.499632848000001, 2024-04-19T04:24:49.047 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026864505, 2024-04-19T04:24:49.047 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.047 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.047 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.047 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.047 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.047 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:49.047 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.047 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.047 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.047 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.048 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:49.048 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.048 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.048 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.048 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.048 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533812+0000", 2024-04-19T04:24:49.048 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.048 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.048 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.048 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.048 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533818+0000", 2024-04-19T04:24:49.048 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2369999999999997e-06 2024-04-19T04:24:49.048 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.048 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.049 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.049 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533863+0000", 2024-04-19T04:24:49.049 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4515000000000003e-05 2024-04-19T04:24:49.049 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.049 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.049 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.049 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533880+0000", 2024-04-19T04:24:49.049 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7119e-05 2024-04-19T04:24:49.049 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.049 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.049 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.049 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534029+0000", 2024-04-19T04:24:49.049 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014955099999999999 2024-04-19T04:24:49.049 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.049 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.050 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:49.050 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534034+0000", 2024-04-19T04:24:49.050 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1649999999999997e-06 2024-04-19T04:24:49.050 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.050 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.050 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.050 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554888+0000", 2024-04-19T04:24:49.050 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020854075 2024-04-19T04:24:49.050 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.050 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.050 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.050 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554967+0000", 2024-04-19T04:24:49.050 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8209999999999998e-05 2024-04-19T04:24:49.050 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.051 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.051 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:49.051 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555087+0000", 2024-04-19T04:24:49.051 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000120411 2024-04-19T04:24:49.051 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.051 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.051 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.051 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559328+0000", 2024-04-19T04:24:49.051 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042409800000000001 2024-04-19T04:24:49.051 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.051 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.051 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.051 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560587+0000", 2024-04-19T04:24:49.051 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012587119999999999 2024-04-19T04:24:49.052 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.052 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.052 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.052 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560620+0000", 2024-04-19T04:24:49.052 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2716999999999999e-05 2024-04-19T04:24:49.052 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.052 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.052 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.052 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560677+0000", 2024-04-19T04:24:49.052 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7726999999999998e-05 2024-04-19T04:24:49.052 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.052 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.052 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.052 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.053 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.053 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.053 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:49.053 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.499550455000001, 2024-04-19T04:24:49.053 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027363064999999999, 2024-04-19T04:24:49.053 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.053 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.053 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.053 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.053 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.053 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:49.053 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.053 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.053 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.053 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:49.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.054 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.054 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533894+0000", 2024-04-19T04:24:49.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:49.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.054 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.054 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533913+0000", 2024-04-19T04:24:49.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8896e-05 2024-04-19T04:24:49.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.055 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.055 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533933+0000", 2024-04-19T04:24:49.055 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9775e-05 2024-04-19T04:24:49.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.055 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.055 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533967+0000", 2024-04-19T04:24:49.055 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4536000000000003e-05 2024-04-19T04:24:49.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.055 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.055 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:49.055 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553600000000001 2024-04-19T04:24:49.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.056 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:49.056 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534107+0000", 2024-04-19T04:24:49.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1470000000000003e-06 2024-04-19T04:24:49.056 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.056 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.056 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556463+0000", 2024-04-19T04:24:49.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022356536999999999 2024-04-19T04:24:49.056 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.056 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.056 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556586+0000", 2024-04-19T04:24:49.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122967 2024-04-19T04:24:49.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.057 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:49.057 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556738+0000", 2024-04-19T04:24:49.057 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015182800000000001 2024-04-19T04:24:49.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.057 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.057 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561020+0000", 2024-04-19T04:24:49.057 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042818819999999999 2024-04-19T04:24:49.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.057 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.057 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561183+0000", 2024-04-19T04:24:49.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000162683 2024-04-19T04:24:49.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.058 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.058 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561226+0000", 2024-04-19T04:24:49.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3686000000000002e-05 2024-04-19T04:24:49.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.058 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.058 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561258+0000", 2024-04-19T04:24:49.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1814999999999999e-05 2024-04-19T04:24:49.058 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.058 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.058 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.059 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.059 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.059 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:49.059 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.499459942000001, 2024-04-19T04:24:49.059 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027417816000000001, 2024-04-19T04:24:49.059 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.059 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.059 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.059 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.059 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.059 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:49.059 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.059 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.059 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.059 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.060 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:49.060 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.060 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.060 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.060 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.060 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533984+0000", 2024-04-19T04:24:49.060 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:49.060 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.060 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.060 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.060 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:49.060 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3876000000000001e-05 2024-04-19T04:24:49.060 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.060 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.060 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.061 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534015+0000", 2024-04-19T04:24:49.061 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6818999999999999e-05 2024-04-19T04:24:49.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.061 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534030+0000", 2024-04-19T04:24:49.061 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.537e-05 2024-04-19T04:24:49.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.061 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534152+0000", 2024-04-19T04:24:49.061 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121685 2024-04-19T04:24:49.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:49.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534156+0000", 2024-04-19T04:24:49.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9029999999999997e-06 2024-04-19T04:24:49.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557520+0000", 2024-04-19T04:24:49.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023364125999999999 2024-04-19T04:24:49.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557585+0000", 2024-04-19T04:24:49.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5275000000000001e-05 2024-04-19T04:24:49.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:49.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557719+0000", 2024-04-19T04:24:49.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013396299999999999 2024-04-19T04:24:49.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561133+0000", 2024-04-19T04:24:49.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034140989999999999 2024-04-19T04:24:49.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561352+0000", 2024-04-19T04:24:49.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0002185 2024-04-19T04:24:49.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.064 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.064 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.064 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561380+0000", 2024-04-19T04:24:49.064 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8317999999999999e-05 2024-04-19T04:24:49.064 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.064 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.064 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.064 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561403+0000", 2024-04-19T04:24:49.064 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3264999999999998e-05 2024-04-19T04:24:49.064 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.064 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.064 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.064 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.064 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.064 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.065 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:49.065 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.499396297000001, 2024-04-19T04:24:49.065 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029897119999999999, 2024-04-19T04:24:49.065 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.065 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.065 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.065 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.065 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.065 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:49.065 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.065 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.065 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.065 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.065 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:49.066 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.066 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.066 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534048+0000", 2024-04-19T04:24:49.066 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.066 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.066 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534057+0000", 2024-04-19T04:24:49.066 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7930000000000003e-06 2024-04-19T04:24:49.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.066 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534075+0000", 2024-04-19T04:24:49.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7846000000000002e-05 2024-04-19T04:24:49.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534089+0000", 2024-04-19T04:24:49.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4463e-05 2024-04-19T04:24:49.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534198+0000", 2024-04-19T04:24:49.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109145 2024-04-19T04:24:49.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:49.068 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534202+0000", 2024-04-19T04:24:49.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.98e-06 2024-04-19T04:24:49.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.068 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.068 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558221+0000", 2024-04-19T04:24:49.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024018208999999999 2024-04-19T04:24:49.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.068 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.068 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558320+0000", 2024-04-19T04:24:49.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9642000000000006e-05 2024-04-19T04:24:49.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.068 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:49.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558401+0000", 2024-04-19T04:24:49.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1038000000000006e-05 2024-04-19T04:24:49.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561173+0000", 2024-04-19T04:24:49.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027714549999999999 2024-04-19T04:24:49.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563851+0000", 2024-04-19T04:24:49.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026786010000000001 2024-04-19T04:24:49.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.070 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563906+0000", 2024-04-19T04:24:49.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4895999999999998e-05 2024-04-19T04:24:49.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.070 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.070 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563946+0000", 2024-04-19T04:24:49.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0116e-05 2024-04-19T04:24:49.070 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.070 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.070 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.070 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.070 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:49.071 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.499342916, 2024-04-19T04:24:49.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029917846000000001, 2024-04-19T04:24:49.071 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.071 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.071 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:49.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:49.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534101+0000", 2024-04-19T04:24:49.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:49.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534111+0000", 2024-04-19T04:24:49.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5659999999999996e-06 2024-04-19T04:24:49.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534129+0000", 2024-04-19T04:24:49.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7632999999999999e-05 2024-04-19T04:24:49.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534143+0000", 2024-04-19T04:24:49.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4362000000000001e-05 2024-04-19T04:24:49.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534256+0000", 2024-04-19T04:24:49.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113267 2024-04-19T04:24:49.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:49.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534260+0000", 2024-04-19T04:24:49.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9949999999999999e-06 2024-04-19T04:24:49.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558653+0000", 2024-04-19T04:24:49.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024393182999999999 2024-04-19T04:24:49.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558704+0000", 2024-04-19T04:24:49.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0303999999999998e-05 2024-04-19T04:24:49.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:49.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558782+0000", 2024-04-19T04:24:49.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8079999999999998e-05 2024-04-19T04:24:49.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561309+0000", 2024-04-19T04:24:49.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002527708 2024-04-19T04:24:49.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563952+0000", 2024-04-19T04:24:49.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026425450000000001 2024-04-19T04:24:49.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563996+0000", 2024-04-19T04:24:49.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3606000000000002e-05 2024-04-19T04:24:49.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.076 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.076 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564021+0000", 2024-04-19T04:24:49.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.491e-05 2024-04-19T04:24:49.076 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.076 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.076 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.076 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.076 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:49.076 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.499290405, 2024-04-19T04:24:49.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:24:49.077 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.077 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.077 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:49.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:49.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:24:49.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:24:49.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:24:49.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:24:49.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:24:49.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:24:49.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:24:49.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:24:49.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:24:49.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:49.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:24:49.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:24:49.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.081 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.081 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.081 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:24:49.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:24:49.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.081 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.081 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.081 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:24:49.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:24:49.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.081 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.081 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:49.081 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:24:49.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:24:49.082 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.082 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.082 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.082 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:24:49.082 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:24:49.082 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.082 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.082 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.082 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:24:49.082 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:24:49.082 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.082 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.082 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.082 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:24:49.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:24:49.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:24:49.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:24:49.083 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.083 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.083 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.083 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.083 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:49.083 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.499235859999999, 2024-04-19T04:24:49.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:24:49.084 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.084 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.084 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:49.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:49.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:24:49.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:24:49.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:24:49.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:24:49.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:24:49.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.086 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.086 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:24:49.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:24:49.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.086 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.086 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:24:49.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:24:49.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.086 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:49.086 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:24:49.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:24:49.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.087 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:24:49.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:24:49.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.087 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:24:49.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:24:49.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:49.087 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:24:49.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:24:49.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:24:49.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:24:49.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:24:49.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:24:49.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:24:49.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:24:49.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:24:49.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:24:49.089 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.089 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.089 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.089 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.089 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534259+0000", 2024-04-19T04:24:49.089 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.499186452, 2024-04-19T04:24:49.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026049582000000002, 2024-04-19T04:24:49.089 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.090 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.090 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.090 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534259+0000", 2024-04-19T04:24:49.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.090 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534259+0000", 2024-04-19T04:24:49.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.090 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.091 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534258+0000", 2024-04-19T04:24:49.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.091 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534266+0000", 2024-04-19T04:24:49.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5870000000000004e-06 2024-04-19T04:24:49.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.091 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534281+0000", 2024-04-19T04:24:49.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5676e-05 2024-04-19T04:24:49.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.092 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534297+0000", 2024-04-19T04:24:49.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5458999999999999e-05 2024-04-19T04:24:49.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.092 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.092 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534379+0000", 2024-04-19T04:24:49.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2667e-05 2024-04-19T04:24:49.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.092 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:49.092 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534387+0000", 2024-04-19T04:24:49.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8900000000000007e-06 2024-04-19T04:24:49.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.092 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.552640+0000", 2024-04-19T04:24:49.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.018252344 2024-04-19T04:24:49.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.552944+0000", 2024-04-19T04:24:49.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00030430000000000002 2024-04-19T04:24:49.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:49.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553088+0000", 2024-04-19T04:24:49.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143793 2024-04-19T04:24:49.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557028+0000", 2024-04-19T04:24:49.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0039397770000000002 2024-04-19T04:24:49.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560246+0000", 2024-04-19T04:24:49.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032184990000000001 2024-04-19T04:24:49.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560282+0000", 2024-04-19T04:24:49.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6168999999999999e-05 2024-04-19T04:24:49.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560309+0000", 2024-04-19T04:24:49.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6508000000000001e-05 2024-04-19T04:24:49.095 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.095 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.095 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.095 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.095 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534327+0000", 2024-04-19T04:24:49.095 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.499118282000001, 2024-04-19T04:24:49.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022180505999999999, 2024-04-19T04:24:49.095 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.095 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.096 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534327+0000", 2024-04-19T04:24:49.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534327+0000", 2024-04-19T04:24:49.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534326+0000", 2024-04-19T04:24:49.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:49.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534335+0000", 2024-04-19T04:24:49.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2359999999999993e-06 2024-04-19T04:24:49.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534348+0000", 2024-04-19T04:24:49.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2680000000000001e-05 2024-04-19T04:24:49.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534364+0000", 2024-04-19T04:24:49.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6249e-05 2024-04-19T04:24:49.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534424+0000", 2024-04-19T04:24:49.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9494999999999999e-05 2024-04-19T04:24:49.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:49.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534429+0000", 2024-04-19T04:24:49.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.536e-06 2024-04-19T04:24:49.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.549957+0000", 2024-04-19T04:24:49.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015528121000000001 2024-04-19T04:24:49.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550172+0000", 2024-04-19T04:24:49.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00021493400000000001 2024-04-19T04:24:49.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:49.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550371+0000", 2024-04-19T04:24:49.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019863899999999999 2024-04-19T04:24:49.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556311+0000", 2024-04-19T04:24:49.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0059402639999999998 2024-04-19T04:24:49.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556351+0000", 2024-04-19T04:24:49.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9932000000000003e-05 2024-04-19T04:24:49.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556464+0000", 2024-04-19T04:24:49.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113089 2024-04-19T04:24:49.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556508+0000", 2024-04-19T04:24:49.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3537e-05 2024-04-19T04:24:49.101 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.101 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.101 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.101 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.101 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534402+0000", 2024-04-19T04:24:49.101 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.499043651000001, 2024-04-19T04:24:49.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026426121, 2024-04-19T04:24:49.101 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.101 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.101 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534402+0000", 2024-04-19T04:24:49.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534402+0000", 2024-04-19T04:24:49.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534401+0000", 2024-04-19T04:24:49.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534423+0000", 2024-04-19T04:24:49.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2589e-05 2024-04-19T04:24:49.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534440+0000", 2024-04-19T04:24:49.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6175999999999999e-05 2024-04-19T04:24:49.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534448+0000", 2024-04-19T04:24:49.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0970000000000006e-06 2024-04-19T04:24:49.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534563+0000", 2024-04-19T04:24:49.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011575500000000001 2024-04-19T04:24:49.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:49.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534575+0000", 2024-04-19T04:24:49.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1199999999999999e-05 2024-04-19T04:24:49.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553676+0000", 2024-04-19T04:24:49.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019101098 2024-04-19T04:24:49.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553803+0000", 2024-04-19T04:24:49.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012747499999999999 2024-04-19T04:24:49.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:49.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553942+0000", 2024-04-19T04:24:49.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000138863 2024-04-19T04:24:49.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557090+0000", 2024-04-19T04:24:49.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003148283 2024-04-19T04:24:49.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560726+0000", 2024-04-19T04:24:49.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0036352530000000002 2024-04-19T04:24:49.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560784+0000", 2024-04-19T04:24:49.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8034e-05 2024-04-19T04:24:49.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560828+0000", 2024-04-19T04:24:49.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4418000000000001e-05 2024-04-19T04:24:49.106 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.107 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.107 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.107 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.107 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534469+0000", 2024-04-19T04:24:49.107 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.498976577000001, 2024-04-19T04:24:49.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023528199, 2024-04-19T04:24:49.107 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.107 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.107 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.107 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.107 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534469+0000", 2024-04-19T04:24:49.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534469+0000", 2024-04-19T04:24:49.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534468+0000", 2024-04-19T04:24:49.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534476+0000", 2024-04-19T04:24:49.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2199999999999992e-06 2024-04-19T04:24:49.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534493+0000", 2024-04-19T04:24:49.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6708999999999999e-05 2024-04-19T04:24:49.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534518+0000", 2024-04-19T04:24:49.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4803e-05 2024-04-19T04:24:49.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534601+0000", 2024-04-19T04:24:49.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3498000000000006e-05 2024-04-19T04:24:49.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:49.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534606+0000", 2024-04-19T04:24:49.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9949999999999996e-06 2024-04-19T04:24:49.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.549312+0000", 2024-04-19T04:24:49.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.014705993000000001 2024-04-19T04:24:49.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550221+0000", 2024-04-19T04:24:49.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00090864099999999996 2024-04-19T04:24:49.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:49.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550417+0000", 2024-04-19T04:24:49.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000196551 2024-04-19T04:24:49.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555547+0000", 2024-04-19T04:24:49.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0051299830000000003 2024-04-19T04:24:49.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557916+0000", 2024-04-19T04:24:49.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023689380000000001 2024-04-19T04:24:49.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.112 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.112 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557951+0000", 2024-04-19T04:24:49.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4771000000000003e-05 2024-04-19T04:24:49.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.112 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.112 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557997+0000", 2024-04-19T04:24:49.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6167e-05 2024-04-19T04:24:49.112 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.114 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.114 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.115 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.115 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534568+0000", 2024-04-19T04:24:49.115 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.498877344, 2024-04-19T04:24:49.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026371452, 2024-04-19T04:24:49.115 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.115 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.115 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534568+0000", 2024-04-19T04:24:49.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534568+0000", 2024-04-19T04:24:49.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.116 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534567+0000", 2024-04-19T04:24:49.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:49.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.116 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534578+0000", 2024-04-19T04:24:49.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.08e-05 2024-04-19T04:24:49.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.117 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534597+0000", 2024-04-19T04:24:49.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9245999999999998e-05 2024-04-19T04:24:49.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.117 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534607+0000", 2024-04-19T04:24:49.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.039e-05 2024-04-19T04:24:49.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.117 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534685+0000", 2024-04-19T04:24:49.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7297000000000002e-05 2024-04-19T04:24:49.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:49.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534691+0000", 2024-04-19T04:24:49.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5690000000000001e-06 2024-04-19T04:24:49.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554391+0000", 2024-04-19T04:24:49.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019699926999999999 2024-04-19T04:24:49.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554645+0000", 2024-04-19T04:24:49.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00025359599999999998 2024-04-19T04:24:49.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:49.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554947+0000", 2024-04-19T04:24:49.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00030229200000000001 2024-04-19T04:24:49.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557380+0000", 2024-04-19T04:24:49.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024329680000000002 2024-04-19T04:24:49.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560869+0000", 2024-04-19T04:24:49.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034894230000000002 2024-04-19T04:24:49.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.120 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560902+0000", 2024-04-19T04:24:49.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2710999999999999e-05 2024-04-19T04:24:49.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.120 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560940+0000", 2024-04-19T04:24:49.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.756e-05 2024-04-19T04:24:49.120 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.120 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.120 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.120 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.120 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534626+0000", 2024-04-19T04:24:49.121 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.498819989000001, 2024-04-19T04:24:49.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022377527000000001, 2024-04-19T04:24:49.121 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.121 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.121 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534626+0000", 2024-04-19T04:24:49.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534626+0000", 2024-04-19T04:24:49.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534624+0000", 2024-04-19T04:24:49.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:49.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534633+0000", 2024-04-19T04:24:49.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7590000000000003e-06 2024-04-19T04:24:49.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534643+0000", 2024-04-19T04:24:49.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0396e-05 2024-04-19T04:24:49.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534691+0000", 2024-04-19T04:24:49.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7735000000000003e-05 2024-04-19T04:24:49.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534775+0000", 2024-04-19T04:24:49.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4556999999999997e-05 2024-04-19T04:24:49.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:49.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534783+0000", 2024-04-19T04:24:49.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9230000000000002e-06 2024-04-19T04:24:49.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.549925+0000", 2024-04-19T04:24:49.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015141419999999999 2024-04-19T04:24:49.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550367+0000", 2024-04-19T04:24:49.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00044214500000000002 2024-04-19T04:24:49.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:49.125 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550806+0000", 2024-04-19T04:24:49.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00043874799999999998 2024-04-19T04:24:49.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.125 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.125 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556642+0000", 2024-04-19T04:24:49.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0058363850000000004 2024-04-19T04:24:49.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.125 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.125 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556723+0000", 2024-04-19T04:24:49.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1383000000000003e-05 2024-04-19T04:24:49.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.125 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556775+0000", 2024-04-19T04:24:49.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1659999999999997e-05 2024-04-19T04:24:49.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557003+0000", 2024-04-19T04:24:49.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022796599999999999 2024-04-19T04:24:49.126 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.126 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.126 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.126 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.126 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534711+0000", 2024-04-19T04:24:49.126 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.498734882000001, 2024-04-19T04:24:49.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023431483999999999, 2024-04-19T04:24:49.127 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.127 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.127 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534711+0000", 2024-04-19T04:24:49.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534711+0000", 2024-04-19T04:24:49.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534710+0000", 2024-04-19T04:24:49.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534716+0000", 2024-04-19T04:24:49.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3430000000000001e-06 2024-04-19T04:24:49.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534728+0000", 2024-04-19T04:24:49.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1616e-05 2024-04-19T04:24:49.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.129 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534739+0000", 2024-04-19T04:24:49.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1416999999999999e-05 2024-04-19T04:24:49.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.129 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534812+0000", 2024-04-19T04:24:49.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.305e-05 2024-04-19T04:24:49.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:49.129 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534821+0000", 2024-04-19T04:24:49.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2329999999999995e-06 2024-04-19T04:24:49.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.548691+0000", 2024-04-19T04:24:49.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.013869375 2024-04-19T04:24:49.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.548892+0000", 2024-04-19T04:24:49.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00020125500000000001 2024-04-19T04:24:49.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:49.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.549719+0000", 2024-04-19T04:24:49.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000826935 2024-04-19T04:24:49.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555981+0000", 2024-04-19T04:24:49.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062615079999999998 2024-04-19T04:24:49.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557961+0000", 2024-04-19T04:24:49.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0019805339999999999 2024-04-19T04:24:49.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558028+0000", 2024-04-19T04:24:49.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6987000000000001e-05 2024-04-19T04:24:49.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558142+0000", 2024-04-19T04:24:49.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011410500000000001 2024-04-19T04:24:49.132 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.132 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.132 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.132 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.132 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534754+0000", 2024-04-19T04:24:49.132 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.498691818000001, 2024-04-19T04:24:49.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026409367, 2024-04-19T04:24:49.132 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.132 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:49.133 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534754+0000", 2024-04-19T04:24:49.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534754+0000", 2024-04-19T04:24:49.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534753+0000", 2024-04-19T04:24:49.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:49.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534757+0000", 2024-04-19T04:24:49.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0430000000000001e-06 2024-04-19T04:24:49.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534765+0000", 2024-04-19T04:24:49.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2430000000000005e-06 2024-04-19T04:24:49.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534772+0000", 2024-04-19T04:24:49.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.973e-06 2024-04-19T04:24:49.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534849+0000", 2024-04-19T04:24:49.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6724000000000006e-05 2024-04-19T04:24:49.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:49.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534853+0000", 2024-04-19T04:24:49.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.442e-06 2024-04-19T04:24:49.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555493+0000", 2024-04-19T04:24:49.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020639571999999998 2024-04-19T04:24:49.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555890+0000", 2024-04-19T04:24:49.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00039718000000000002 2024-04-19T04:24:49.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561163+0000", 2024-04-19T04:24:49.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0052728929999999999 2024-04-19T04:24:49.136 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.136 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.136 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.137 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.137 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534797+0000", 2024-04-19T04:24:49.137 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.498649022999999, 2024-04-19T04:24:49.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026586375999999998, 2024-04-19T04:24:49.137 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.137 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.137 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.137 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534797+0000", 2024-04-19T04:24:49.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.138 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534797+0000", 2024-04-19T04:24:49.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.138 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534796+0000", 2024-04-19T04:24:49.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.138 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534805+0000", 2024-04-19T04:24:49.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.3700000000000001e-06 2024-04-19T04:24:49.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.139 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534822+0000", 2024-04-19T04:24:49.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6878999999999999e-05 2024-04-19T04:24:49.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.139 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534832+0000", 2024-04-19T04:24:49.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:24:49.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.139 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534899+0000", 2024-04-19T04:24:49.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7280999999999995e-05 2024-04-19T04:24:49.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.139 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:49.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534905+0000", 2024-04-19T04:24:49.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8490000000000002e-06 2024-04-19T04:24:49.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556245+0000", 2024-04-19T04:24:49.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.021340136999999999 2024-04-19T04:24:49.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556327+0000", 2024-04-19T04:24:49.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2347000000000003e-05 2024-04-19T04:24:49.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:49.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556554+0000", 2024-04-19T04:24:49.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022676200000000001 2024-04-19T04:24:49.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561197+0000", 2024-04-19T04:24:49.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0046431019999999996 2024-04-19T04:24:49.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561303+0000", 2024-04-19T04:24:49.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000106043 2024-04-19T04:24:49.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.142 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561350+0000", 2024-04-19T04:24:49.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6711000000000001e-05 2024-04-19T04:24:49.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.142 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.142 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561383+0000", 2024-04-19T04:24:49.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2904999999999998e-05 2024-04-19T04:24:49.142 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.142 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.142 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.142 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.142 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534840+0000", 2024-04-19T04:24:49.143 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.498605864000002, 2024-04-19T04:24:49.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022162659000000001, 2024-04-19T04:24:49.143 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.143 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.143 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.143 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.143 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534840+0000", 2024-04-19T04:24:49.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.143 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.143 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534840+0000", 2024-04-19T04:24:49.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534839+0000", 2024-04-19T04:24:49.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:49.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534844+0000", 2024-04-19T04:24:49.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7859999999999996e-06 2024-04-19T04:24:49.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534856+0000", 2024-04-19T04:24:49.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2150000000000001e-05 2024-04-19T04:24:49.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534863+0000", 2024-04-19T04:24:49.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.883e-06 2024-04-19T04:24:49.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534915+0000", 2024-04-19T04:24:49.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1675999999999998e-05 2024-04-19T04:24:49.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:49.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534918+0000", 2024-04-19T04:24:49.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7850000000000002e-06 2024-04-19T04:24:49.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.551513+0000", 2024-04-19T04:24:49.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016594398 2024-04-19T04:24:49.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.551634+0000", 2024-04-19T04:24:49.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012141700000000001 2024-04-19T04:24:49.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:49.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.551867+0000", 2024-04-19T04:24:49.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00023267000000000001 2024-04-19T04:24:49.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.147 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.147 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556539+0000", 2024-04-19T04:24:49.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0046719910000000003 2024-04-19T04:24:49.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.147 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.147 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556594+0000", 2024-04-19T04:24:49.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4715e-05 2024-04-19T04:24:49.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.147 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.147 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556818+0000", 2024-04-19T04:24:49.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000224064 2024-04-19T04:24:49.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.148 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557002+0000", 2024-04-19T04:24:49.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00018477399999999999 2024-04-19T04:24:49.148 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.148 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.148 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.148 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.148 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534883+0000", 2024-04-19T04:24:49.148 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.498562458999999, 2024-04-19T04:24:49.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022503523000000001, 2024-04-19T04:24:49.149 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:49.149 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.149 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:49.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:49.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534883+0000", 2024-04-19T04:24:49.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:49.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534883+0000", 2024-04-19T04:24:49.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:49.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:49.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534882+0000", 2024-04-19T04:24:49.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:49.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:49.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534894+0000", 2024-04-19T04:24:49.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1579999999999999e-05 2024-04-19T04:24:49.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:49.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534903+0000", 2024-04-19T04:24:49.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0790000000000007e-06 2024-04-19T04:24:49.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.151 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534910+0000", 2024-04-19T04:24:49.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8329999999999996e-06 2024-04-19T04:24:49.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.151 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.151 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.151 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534960+0000", 2024-04-19T04:24:49.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0441e-05 2024-04-19T04:24:49.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.151 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.151 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:49.151 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534964+0000", 2024-04-19T04:24:49.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9169999999999999e-06 2024-04-19T04:24:49.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.151 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.151 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:49.152 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.552567+0000", 2024-04-19T04:24:49.152 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.017603088999999999 2024-04-19T04:24:49.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.152 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:49.152 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553342+0000", 2024-04-19T04:24:49.152 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00077492299999999995 2024-04-19T04:24:49.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.152 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:49.152 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553552+0000", 2024-04-19T04:24:49.152 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00020988300000000001 2024-04-19T04:24:49.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.152 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:49.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556683+0000", 2024-04-19T04:24:49.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031310830000000002 2024-04-19T04:24:49.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557301+0000", 2024-04-19T04:24:49.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000618051 2024-04-19T04:24:49.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:49.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557350+0000", 2024-04-19T04:24:49.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8976e-05 2024-04-19T04:24:49.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:49.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:49.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:49.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557387+0000", 2024-04-19T04:24:49.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6325000000000002e-05 2024-04-19T04:24:49.154 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.154 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.154 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.154 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:49.154 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:49.154 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:49.155 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:24:49.156 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:49.151+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:49.256 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:49.251+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:49.588 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:24:49.588 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [ 2024-04-19T04:24:49.588 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.589 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:13352 5.2 e25/20 5:4e14f2af:::benchmark_data_smithi007_19526_object13351:head v 25'875, mlcod=25'872)", 2024-04-19T04:24:49.589 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:49.290062+0000", 2024-04-19T04:24:49.589 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.001328774, 2024-04-19T04:24:49.589 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0013470450000000001, 2024-04-19T04:24:49.589 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.589 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:49.589 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.589 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.589 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.589 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290062+0000", 2024-04-19T04:24:49.589 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.589 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.589 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.589 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.590 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290062+0000", 2024-04-19T04:24:49.590 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.590 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.590 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.590 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.590 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290061+0000", 2024-04-19T04:24:49.590 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.590 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.590 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.590 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.590 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290119+0000", 2024-04-19T04:24:49.591 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.8091999999999999e-05 2024-04-19T04:24:49.591 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.591 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.591 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.591 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290171+0000", 2024-04-19T04:24:49.591 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.1473e-05 2024-04-19T04:24:49.591 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.591 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.591 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.591 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290178+0000", 2024-04-19T04:24:49.591 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.5719999999999997e-06 2024-04-19T04:24:49.591 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.591 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.592 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.592 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290241+0000", 2024-04-19T04:24:49.592 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.2475000000000001e-05 2024-04-19T04:24:49.592 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.592 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.592 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.592 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290254+0000", 2024-04-19T04:24:49.592 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3322000000000001e-05 2024-04-19T04:24:49.592 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.592 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.592 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.592 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.592 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.592 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:13354 5.6 5:628a0049:::benchmark_data_smithi007_19526_object13353:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T04:24:49.592 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:49.290113+0000", 2024-04-19T04:24:49.593 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.001278001, 2024-04-19T04:24:49.593 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0013365530000000001, 2024-04-19T04:24:49.593 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.593 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:49.593 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:49.593 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:49.593 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:49.593 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 13354 2024-04-19T04:24:49.593 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.593 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.593 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.593 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.593 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290113+0000", 2024-04-19T04:24:49.593 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.593 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.594 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.594 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.594 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290113+0000", 2024-04-19T04:24:49.594 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.594 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.594 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.594 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.594 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290112+0000", 2024-04-19T04:24:49.594 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:49.594 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.594 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.594 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.594 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290252+0000", 2024-04-19T04:24:49.594 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014055299999999999 2024-04-19T04:24:49.595 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.595 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.595 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.595 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290272+0000", 2024-04-19T04:24:49.595 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.9587999999999999e-05 2024-04-19T04:24:49.595 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.595 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.595 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.595 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290283+0000", 2024-04-19T04:24:49.595 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1698999999999999e-05 2024-04-19T04:24:49.595 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.595 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.595 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.595 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290335+0000", 2024-04-19T04:24:49.596 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.1993999999999997e-05 2024-04-19T04:24:49.596 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.596 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.596 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.596 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290484+0000", 2024-04-19T04:24:49.596 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000148374 2024-04-19T04:24:49.596 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.596 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.596 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:49.596 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290663+0000", 2024-04-19T04:24:49.596 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017876 2024-04-19T04:24:49.596 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.596 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.596 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.596 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.597 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.597 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:13351 5.b e25/20 5:dd238b24:::benchmark_data_smithi007_19526_object13350:head v 25'803, mlcod=25'799)", 2024-04-19T04:24:49.597 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:49.290155+0000", 2024-04-19T04:24:49.597 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0012357830000000001, 2024-04-19T04:24:49.597 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001336664, 2024-04-19T04:24:49.597 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.597 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:49.597 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.597 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.597 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.597 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290155+0000", 2024-04-19T04:24:49.597 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.597 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.597 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.598 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.598 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290155+0000", 2024-04-19T04:24:49.598 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.598 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.598 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.598 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.598 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290154+0000", 2024-04-19T04:24:49.598 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.598 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.598 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.598 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.598 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290278+0000", 2024-04-19T04:24:49.598 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012381499999999999 2024-04-19T04:24:49.598 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.599 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.599 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.599 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290290+0000", 2024-04-19T04:24:49.599 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1983e-05 2024-04-19T04:24:49.599 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.599 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.599 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.599 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290298+0000", 2024-04-19T04:24:49.599 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.2330000000000006e-06 2024-04-19T04:24:49.599 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.599 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.599 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.599 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290344+0000", 2024-04-19T04:24:49.599 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.6e-05 2024-04-19T04:24:49.599 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.600 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.600 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.600 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290367+0000", 2024-04-19T04:24:49.600 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2892999999999999e-05 2024-04-19T04:24:49.600 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.600 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.600 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.600 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.600 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.600 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:13353 5.7 e25/20 5:e04779ff:::benchmark_data_smithi007_19526_object13352:head v 25'873, mlcod=25'871)", 2024-04-19T04:24:49.600 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:49.290243+0000", 2024-04-19T04:24:49.600 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.001147967, 2024-04-19T04:24:49.600 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0012791129999999999, 2024-04-19T04:24:49.600 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.600 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:49.601 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.601 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.601 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.601 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290243+0000", 2024-04-19T04:24:49.601 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.601 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.601 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.601 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.601 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290243+0000", 2024-04-19T04:24:49.601 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.601 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.601 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.601 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.601 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290242+0000", 2024-04-19T04:24:49.602 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:49.602 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.602 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.602 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.602 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290285+0000", 2024-04-19T04:24:49.602 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2172999999999998e-05 2024-04-19T04:24:49.602 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.602 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.602 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.602 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290296+0000", 2024-04-19T04:24:49.602 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1734e-05 2024-04-19T04:24:49.602 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.602 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.603 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.603 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290302+0000", 2024-04-19T04:24:49.603 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.7579999999999998e-06 2024-04-19T04:24:49.603 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.603 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.603 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.603 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290357+0000", 2024-04-19T04:24:49.603 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.5424999999999999e-05 2024-04-19T04:24:49.603 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.603 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.603 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.603 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.290376+0000", 2024-04-19T04:24:49.603 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8876999999999999e-05 2024-04-19T04:24:49.603 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.603 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.604 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.604 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.604 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.604 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:13342 5.6 5:6bda752c:::benchmark_data_smithi007_19526_object13341:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T04:24:49.604 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:49.284253+0000", 2024-04-19T04:24:49.604 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0071376800000000004, 2024-04-19T04:24:49.604 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0073028629999999997, 2024-04-19T04:24:49.604 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.604 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:49.604 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:49.604 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:49.604 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:49.604 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 13342 2024-04-19T04:24:49.604 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.605 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.605 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.605 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.605 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.284253+0000", 2024-04-19T04:24:49.605 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.605 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.605 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.605 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.605 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.284253+0000", 2024-04-19T04:24:49.605 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.605 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.605 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.605 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.605 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.284253+0000", 2024-04-19T04:24:49.606 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:49.606 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.606 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.606 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.606 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.284361+0000", 2024-04-19T04:24:49.606 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000108149 2024-04-19T04:24:49.606 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.606 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.606 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.606 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.284370+0000", 2024-04-19T04:24:49.606 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.5310000000000001e-06 2024-04-19T04:24:49.606 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.606 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.606 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.607 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.284373+0000", 2024-04-19T04:24:49.607 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9469999999999996e-06 2024-04-19T04:24:49.607 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.607 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.607 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.607 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.284449+0000", 2024-04-19T04:24:49.607 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.5607999999999998e-05 2024-04-19T04:24:49.607 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.607 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.607 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.607 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.284622+0000", 2024-04-19T04:24:49.607 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000172981 2024-04-19T04:24:49.607 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.607 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.607 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:49.608 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.284825+0000", 2024-04-19T04:24:49.608 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000202578 2024-04-19T04:24:49.608 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.608 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.608 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.608 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.289081+0000", 2024-04-19T04:24:49.608 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0042559629999999998 2024-04-19T04:24:49.608 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.608 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.608 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:49.608 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.291494+0000", 2024-04-19T04:24:49.608 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.002412984 2024-04-19T04:24:49.608 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.608 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.609 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.609 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.609 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.609 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:13347 5.e e25/20 5:7507bf2d:::benchmark_data_smithi007_19526_object13346:head v 25'839, mlcod=25'836)", 2024-04-19T04:24:49.609 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:49.285971+0000", 2024-04-19T04:24:49.609 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0054199210000000003, 2024-04-19T04:24:49.609 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0056342939999999998, 2024-04-19T04:24:49.609 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.609 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:49.609 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.609 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.609 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.609 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.285971+0000", 2024-04-19T04:24:49.609 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.609 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.610 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.610 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.610 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.285971+0000", 2024-04-19T04:24:49.610 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.610 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.610 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.610 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.610 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.285970+0000", 2024-04-19T04:24:49.610 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:49.610 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.610 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.610 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.610 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.286121+0000", 2024-04-19T04:24:49.610 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015030999999999999 2024-04-19T04:24:49.611 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.611 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.611 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.611 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.286147+0000", 2024-04-19T04:24:49.611 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.6767e-05 2024-04-19T04:24:49.611 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.611 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.611 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.611 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.286156+0000", 2024-04-19T04:24:49.611 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.5720000000000003e-06 2024-04-19T04:24:49.611 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.611 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.611 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.611 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.286203+0000", 2024-04-19T04:24:49.611 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7522999999999999e-05 2024-04-19T04:24:49.612 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.612 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.612 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.612 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.286222+0000", 2024-04-19T04:24:49.612 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8847000000000001e-05 2024-04-19T04:24:49.612 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.612 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.612 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.612 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.612 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.612 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:13349 5.6 5:6dc30bcc:::benchmark_data_smithi007_19526_object13348:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T04:24:49.612 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:49.286654+0000", 2024-04-19T04:24:49.612 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0047372780000000001, 2024-04-19T04:24:49.612 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0049845339999999997, 2024-04-19T04:24:49.612 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.613 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:49.613 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:49.613 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:49.613 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:49.613 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 13349 2024-04-19T04:24:49.613 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.613 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.613 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.613 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.613 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.286654+0000", 2024-04-19T04:24:49.613 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.613 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.613 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.613 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.613 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.286654+0000", 2024-04-19T04:24:49.614 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.614 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.614 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.614 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.614 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.286652+0000", 2024-04-19T04:24:49.614 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:49.614 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.614 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.614 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.614 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.286713+0000", 2024-04-19T04:24:49.614 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.0538999999999998e-05 2024-04-19T04:24:49.614 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.614 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.614 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.615 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.286727+0000", 2024-04-19T04:24:49.615 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.4255e-05 2024-04-19T04:24:49.615 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.615 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.615 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.615 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.286737+0000", 2024-04-19T04:24:49.615 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.8460000000000003e-06 2024-04-19T04:24:49.615 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.615 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.615 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.615 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.286911+0000", 2024-04-19T04:24:49.615 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017361500000000001 2024-04-19T04:24:49.615 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.615 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.615 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.616 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.287121+0000", 2024-04-19T04:24:49.616 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000210137 2024-04-19T04:24:49.616 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.616 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.616 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:49.616 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.287299+0000", 2024-04-19T04:24:49.616 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000178223 2024-04-19T04:24:49.616 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.616 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.616 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.616 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.289735+0000", 2024-04-19T04:24:49.616 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0024359669999999998 2024-04-19T04:24:49.616 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.616 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.616 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.617 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.617 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.617 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:13350 5.e e25/20 5:79909574:::benchmark_data_smithi007_19526_object13349:head v 25'840, mlcod=25'837)", 2024-04-19T04:24:49.617 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:49.289464+0000", 2024-04-19T04:24:49.617 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0019264110000000001, 2024-04-19T04:24:49.617 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0022179420000000001, 2024-04-19T04:24:49.617 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.617 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:49.617 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.617 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.617 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.617 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.289464+0000", 2024-04-19T04:24:49.617 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.617 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.617 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.618 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.618 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.289464+0000", 2024-04-19T04:24:49.618 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.618 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.618 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.618 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.618 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.289464+0000", 2024-04-19T04:24:49.618 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.618 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.618 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.618 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.618 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.289520+0000", 2024-04-19T04:24:49.618 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.6582000000000001e-05 2024-04-19T04:24:49.618 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.619 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.619 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.619 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.289534+0000", 2024-04-19T04:24:49.619 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3651e-05 2024-04-19T04:24:49.619 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.619 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.619 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.619 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.289543+0000", 2024-04-19T04:24:49.619 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8850000000000005e-06 2024-04-19T04:24:49.619 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.619 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.619 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.619 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.289584+0000", 2024-04-19T04:24:49.619 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1637000000000001e-05 2024-04-19T04:24:49.619 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.620 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.620 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.620 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.289598+0000", 2024-04-19T04:24:49.620 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3322999999999999e-05 2024-04-19T04:24:49.620 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.620 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.620 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.620 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.620 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-04-19T04:24:49.620 INFO:teuthology.orchestra.run.smithi066.stdout: "num_ops": 8 2024-04-19T04:24:49.620 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:24:49.621 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:24:49.621 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:49.583+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:49.678 INFO:teuthology.orchestra.run.smithi007.stderr:osd set-full-ratio 0.95 2024-04-19T04:24:49.689 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:49.687+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:49.750 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 5 16 14586 14570 182.104 167.312 0.00496736 0.00548256 2024-04-19T04:24:49.754 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:24:49.754 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [], 2024-04-19T04:24:49.754 INFO:teuthology.orchestra.run.smithi066.stdout: "complaint_time": 30, 2024-04-19T04:24:49.755 INFO:teuthology.orchestra.run.smithi066.stdout: "num_blocked_ops": 0 2024-04-19T04:24:49.755 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:24:49.768 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:24:49.790 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:49.783+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:49.890 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:49.891+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:49.908 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:24:49.908 INFO:teuthology.orchestra.run.smithi066.stdout: "size": 20, 2024-04-19T04:24:49.908 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 600, 2024-04-19T04:24:49.908 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [ 2024-04-19T04:24:49.908 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.908 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.909 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:24:49.909 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 29.372234868, 2024-04-19T04:24:49.909 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019436790999999998, 2024-04-19T04:24:49.909 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.909 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.909 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.909 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.909 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.909 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:24:49.909 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.909 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.909 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.909 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.909 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:24:49.909 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.910 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.910 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.910 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.910 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533562+0000", 2024-04-19T04:24:49.910 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999967 2024-04-19T04:24:49.910 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.910 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.910 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.910 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533588+0000", 2024-04-19T04:24:49.911 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.6128000000000001e-05 2024-04-19T04:24:49.911 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.911 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.911 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.911 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533617+0000", 2024-04-19T04:24:49.911 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.8685000000000001e-05 2024-04-19T04:24:49.911 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.911 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.911 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.911 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533649+0000", 2024-04-19T04:24:49.912 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.2532e-05 2024-04-19T04:24:49.912 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.912 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.912 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.912 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536605+0000", 2024-04-19T04:24:49.912 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0029553130000000002 2024-04-19T04:24:49.912 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.912 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.912 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.912 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536746+0000", 2024-04-19T04:24:49.912 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000141011 2024-04-19T04:24:49.912 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.912 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.912 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:49.912 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536889+0000", 2024-04-19T04:24:49.913 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000143437 2024-04-19T04:24:49.913 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.913 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.913 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:49.913 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542807+0000", 2024-04-19T04:24:49.913 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0059181210000000001 2024-04-19T04:24:49.913 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.913 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.913 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.913 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.552917+0000", 2024-04-19T04:24:49.913 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010110111 2024-04-19T04:24:49.913 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.913 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.913 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:49.913 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.552962+0000", 2024-04-19T04:24:49.914 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.4811999999999997e-05 2024-04-19T04:24:49.914 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.914 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.914 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:49.914 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553002+0000", 2024-04-19T04:24:49.914 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9957999999999999e-05 2024-04-19T04:24:49.914 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.914 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.914 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.914 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.914 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.914 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.914 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:24:49.914 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 29.372118923999999, 2024-04-19T04:24:49.915 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019464940999999999, 2024-04-19T04:24:49.915 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.915 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.915 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.915 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.915 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.915 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:24:49.915 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.916 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.916 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.916 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.916 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:24:49.916 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.916 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.916 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.916 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.916 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533680+0000", 2024-04-19T04:24:49.916 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:49.916 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.916 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.916 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.916 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533692+0000", 2024-04-19T04:24:49.917 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2235000000000001e-05 2024-04-19T04:24:49.917 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.917 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.917 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.917 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533770+0000", 2024-04-19T04:24:49.917 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.8248e-05 2024-04-19T04:24:49.917 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.917 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.917 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.917 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:24:49.917 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8671000000000001e-05 2024-04-19T04:24:49.917 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.918 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.918 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.918 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539610+0000", 2024-04-19T04:24:49.918 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0058206669999999999 2024-04-19T04:24:49.918 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.918 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.918 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.918 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539705+0000", 2024-04-19T04:24:49.918 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.5313e-05 2024-04-19T04:24:49.918 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.918 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.918 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:49.918 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539857+0000", 2024-04-19T04:24:49.918 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000151881 2024-04-19T04:24:49.919 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.919 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.919 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:49.919 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542812+0000", 2024-04-19T04:24:49.919 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.002954857 2024-04-19T04:24:49.919 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.919 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.919 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.919 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553058+0000", 2024-04-19T04:24:49.919 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010246570999999999 2024-04-19T04:24:49.919 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.919 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.919 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:49.919 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553104+0000", 2024-04-19T04:24:49.919 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.5235999999999999e-05 2024-04-19T04:24:49.920 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.920 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.920 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:49.920 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553146+0000", 2024-04-19T04:24:49.920 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2725999999999997e-05 2024-04-19T04:24:49.920 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.920 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.920 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.920 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.920 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.920 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:20 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.920 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533808+0000", 2024-04-19T04:24:49.920 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 29.371992366000001, 2024-04-19T04:24:49.920 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013169548999999999, 2024-04-19T04:24:49.920 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533808+0000", 2024-04-19T04:24:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533808+0000", 2024-04-19T04:24:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533807+0000", 2024-04-19T04:24:49.922 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:49.922 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.922 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.922 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.922 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533816+0000", 2024-04-19T04:24:49.922 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.7440000000000002e-06 2024-04-19T04:24:49.922 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.922 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.922 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.922 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533835+0000", 2024-04-19T04:24:49.922 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.9074000000000001e-05 2024-04-19T04:24:49.922 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.922 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.922 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.923 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533851+0000", 2024-04-19T04:24:49.923 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.5862000000000002e-05 2024-04-19T04:24:49.923 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.923 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.923 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.923 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.540449+0000", 2024-04-19T04:24:49.923 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0065977889999999997 2024-04-19T04:24:49.923 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.923 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.923 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.923 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.540629+0000", 2024-04-19T04:24:49.923 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00018008499999999999 2024-04-19T04:24:49.923 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.923 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.923 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:49.924 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.540786+0000", 2024-04-19T04:24:49.924 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015730799999999999 2024-04-19T04:24:49.924 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.924 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.924 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:49.924 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542894+0000", 2024-04-19T04:24:49.924 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0021071140000000002 2024-04-19T04:24:49.924 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.924 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.924 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.924 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.546830+0000", 2024-04-19T04:24:49.924 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0039364129999999997 2024-04-19T04:24:49.924 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.924 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.925 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:49.925 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.546925+0000", 2024-04-19T04:24:49.925 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.4747999999999995e-05 2024-04-19T04:24:49.925 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.925 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.925 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:49.925 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.546977+0000", 2024-04-19T04:24:49.925 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2791999999999999e-05 2024-04-19T04:24:49.925 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.926 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.926 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.926 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.926 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.926 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.926 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533866+0000", 2024-04-19T04:24:49.926 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 29.371934609, 2024-04-19T04:24:49.926 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013268970999999999, 2024-04-19T04:24:49.926 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.926 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.926 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.926 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.926 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.927 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533866+0000", 2024-04-19T04:24:49.927 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.927 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.930 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.930 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.930 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533866+0000", 2024-04-19T04:24:49.931 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.931 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.931 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.931 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.931 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533865+0000", 2024-04-19T04:24:49.931 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.931 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.931 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.931 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.931 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533879+0000", 2024-04-19T04:24:49.931 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3825000000000001e-05 2024-04-19T04:24:49.931 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.931 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.931 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.932 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:49.932 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.6816999999999998e-05 2024-04-19T04:24:49.932 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.932 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.932 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.932 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533926+0000", 2024-04-19T04:24:49.932 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.0309000000000001e-05 2024-04-19T04:24:49.932 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.932 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.932 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.932 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541173+0000", 2024-04-19T04:24:49.932 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0072477560000000002 2024-04-19T04:24:49.932 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.932 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.933 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.933 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541268+0000", 2024-04-19T04:24:49.933 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.4400000000000004e-05 2024-04-19T04:24:49.933 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.933 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.933 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:49.933 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541394+0000", 2024-04-19T04:24:49.933 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012616400000000001 2024-04-19T04:24:49.933 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.933 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.933 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:49.933 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.543380+0000", 2024-04-19T04:24:49.933 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0019861940000000002 2024-04-19T04:24:49.933 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.933 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.934 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.934 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.547049+0000", 2024-04-19T04:24:49.934 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00366855 2024-04-19T04:24:49.934 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.934 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.934 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:49.934 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.547098+0000", 2024-04-19T04:24:49.934 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.9716000000000003e-05 2024-04-19T04:24:49.934 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.934 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.934 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:49.934 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.547135+0000", 2024-04-19T04:24:49.934 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6217000000000002e-05 2024-04-19T04:24:49.934 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.935 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.935 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.935 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.935 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.935 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:21 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.935 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:24:49.935 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 29.371859824000001, 2024-04-19T04:24:49.935 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019340466000000001, 2024-04-19T04:24:49.935 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.935 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.935 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.935 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.935 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.935 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:24:49.935 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.936 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.936 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.936 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.936 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:24:49.936 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.936 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.936 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.936 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.936 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533939+0000", 2024-04-19T04:24:49.936 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.936 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.936 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.936 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.936 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533950+0000", 2024-04-19T04:24:49.936 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0533999999999999e-05 2024-04-19T04:24:49.937 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.937 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.937 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.937 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533973+0000", 2024-04-19T04:24:49.937 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2614000000000001e-05 2024-04-19T04:24:49.937 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.937 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.937 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.937 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:49.937 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3531e-05 2024-04-19T04:24:49.937 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.937 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.937 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.937 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541149+0000", 2024-04-19T04:24:49.937 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0071628780000000001 2024-04-19T04:24:49.938 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.938 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.938 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.938 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541279+0000", 2024-04-19T04:24:49.938 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013014999999999999 2024-04-19T04:24:49.938 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.938 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.938 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:49.938 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541430+0000", 2024-04-19T04:24:49.938 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015048399999999999 2024-04-19T04:24:49.938 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.938 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.938 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:49.938 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.543384+0000", 2024-04-19T04:24:49.938 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001954468 2024-04-19T04:24:49.939 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.939 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.939 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.939 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553193+0000", 2024-04-19T04:24:49.939 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0098089059999999992 2024-04-19T04:24:49.939 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.939 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.939 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:49.939 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553245+0000", 2024-04-19T04:24:49.939 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.1742e-05 2024-04-19T04:24:49.939 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.939 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.939 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:49.939 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553281+0000", 2024-04-19T04:24:49.940 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6272000000000001e-05 2024-04-19T04:24:49.940 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.940 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.940 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.940 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.940 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.940 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.940 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:49.940 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 29.371802573, 2024-04-19T04:24:49.940 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019497464999999999, 2024-04-19T04:24:49.940 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.940 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.940 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.940 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.941 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.941 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:49.941 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.941 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.941 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.941 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.941 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:49.941 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.942 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.942 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.942 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.942 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533997+0000", 2024-04-19T04:24:49.942 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.942 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.942 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.942 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.942 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534019+0000", 2024-04-19T04:24:49.942 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.1871000000000001e-05 2024-04-19T04:24:49.942 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.942 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.942 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.942 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534036+0000", 2024-04-19T04:24:49.943 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.7073999999999999e-05 2024-04-19T04:24:49.943 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.943 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.943 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.943 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:49.943 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3781000000000001e-05 2024-04-19T04:24:49.943 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.943 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.943 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.943 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534167+0000", 2024-04-19T04:24:49.943 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000117463 2024-04-19T04:24:49.943 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.943 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.943 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.943 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.535182+0000", 2024-04-19T04:24:49.944 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0010149340000000001 2024-04-19T04:24:49.944 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.944 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.944 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:49.944 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.535459+0000", 2024-04-19T04:24:49.944 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000277013 2024-04-19T04:24:49.944 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.944 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.944 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:49.944 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.540338+0000", 2024-04-19T04:24:49.944 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0048786109999999997 2024-04-19T04:24:49.944 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.944 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.944 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.944 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553416+0000", 2024-04-19T04:24:49.945 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013078251000000001 2024-04-19T04:24:49.945 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.945 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.945 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:49.945 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553456+0000", 2024-04-19T04:24:49.945 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.0516999999999998e-05 2024-04-19T04:24:49.945 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.945 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.945 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:49.945 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553495+0000", 2024-04-19T04:24:49.945 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8899999999999997e-05 2024-04-19T04:24:49.945 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.945 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.945 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.945 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.946 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.946 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.946 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:24:49.946 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 29.371704186999999, 2024-04-19T04:24:49.946 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019607754000000002, 2024-04-19T04:24:49.946 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.946 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:49.946 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.946 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.946 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.946 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:24:49.946 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.946 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.946 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534095+0000", 2024-04-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534104+0000", 2024-04-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.9779999999999994e-06 2024-04-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.948 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.948 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.948 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534122+0000", 2024-04-19T04:24:49.948 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8464000000000001e-05 2024-04-19T04:24:49.948 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.948 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.948 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.948 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534142+0000", 2024-04-19T04:24:49.948 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.9287999999999999e-05 2024-04-19T04:24:49.948 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.948 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.948 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.948 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.538550+0000", 2024-04-19T04:24:49.948 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0044085560000000001 2024-04-19T04:24:49.948 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.949 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.949 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.949 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.538726+0000", 2024-04-19T04:24:49.949 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017599299999999999 2024-04-19T04:24:49.949 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.949 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.949 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:49.949 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553704+0000", 2024-04-19T04:24:49.949 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.014977802 2024-04-19T04:24:49.949 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.949 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.949 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.949 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.949 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.949 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.950 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:24:49.950 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 29.371617298, 2024-04-19T04:24:49.950 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019220208999999999, 2024-04-19T04:24:49.950 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.950 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:49.950 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.950 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.950 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.950 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:24:49.950 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.950 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.950 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.950 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.950 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:24:49.950 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.951 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.951 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.951 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.951 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534182+0000", 2024-04-19T04:24:49.951 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.951 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.951 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.951 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.951 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534189+0000", 2024-04-19T04:24:49.951 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3710000000000002e-06 2024-04-19T04:24:49.951 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.951 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.951 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.951 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534810+0000", 2024-04-19T04:24:49.952 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00062098000000000003 2024-04-19T04:24:49.952 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.952 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.952 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.952 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534829+0000", 2024-04-19T04:24:49.952 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8207999999999999e-05 2024-04-19T04:24:49.952 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.952 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.952 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.952 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542089+0000", 2024-04-19T04:24:49.952 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0072601710000000002 2024-04-19T04:24:49.952 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.952 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.952 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.952 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542225+0000", 2024-04-19T04:24:49.953 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000135988 2024-04-19T04:24:49.953 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.953 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.953 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:49.953 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553403+0000", 2024-04-19T04:24:49.953 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011178478 2024-04-19T04:24:49.953 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.953 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.953 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.953 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.953 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.953 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:31 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:49.953 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.534846+0000", 2024-04-19T04:24:49.953 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 29.370954617999999, 2024-04-19T04:24:49.953 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.012197726000000001, 2024-04-19T04:24:49.954 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.954 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:49.954 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.954 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.954 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.954 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534846+0000", 2024-04-19T04:24:49.954 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.954 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.954 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.954 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.954 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534846+0000", 2024-04-19T04:24:49.954 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.954 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.954 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.955 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.955 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534845+0000", 2024-04-19T04:24:49.955 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.955 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.955 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.955 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.955 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534863+0000", 2024-04-19T04:24:49.955 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8525e-05 2024-04-19T04:24:49.955 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.955 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.955 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.955 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534882+0000", 2024-04-19T04:24:49.955 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.9341e-05 2024-04-19T04:24:49.955 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.955 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.956 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.956 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534896+0000", 2024-04-19T04:24:49.956 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3478e-05 2024-04-19T04:24:49.956 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.956 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.956 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.956 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.535147+0000", 2024-04-19T04:24:49.956 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00025112600000000001 2024-04-19T04:24:49.956 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.956 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.956 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.956 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.535348+0000", 2024-04-19T04:24:49.956 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00020112299999999999 2024-04-19T04:24:49.957 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.957 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.957 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:49.958 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.547043+0000", 2024-04-19T04:24:49.958 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011695196999999999 2024-04-19T04:24:49.958 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.958 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.958 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.958 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.958 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.958 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:1630 5.6 5:6e4f4195:::benchmark_data_smithi007_19526_object1629:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:49.958 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:45.288558+0000", 2024-04-19T04:24:49.959 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.6172421940000001, 2024-04-19T04:24:49.959 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010839563999999999, 2024-04-19T04:24:49.959 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.959 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.959 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:49.960 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:49.960 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:49.960 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 1630 2024-04-19T04:24:49.960 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.960 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.960 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.960 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.960 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.288558+0000", 2024-04-19T04:24:49.960 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.960 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.960 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.960 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.960 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.288558+0000", 2024-04-19T04:24:49.960 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.960 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.961 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.961 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.961 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.288557+0000", 2024-04-19T04:24:49.961 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:49.961 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.961 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.961 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.961 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.288663+0000", 2024-04-19T04:24:49.961 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000105114 2024-04-19T04:24:49.961 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.961 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.961 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.961 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.288692+0000", 2024-04-19T04:24:49.961 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.9505e-05 2024-04-19T04:24:49.961 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.962 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.962 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.962 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.288699+0000", 2024-04-19T04:24:49.962 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7680000000000003e-06 2024-04-19T04:24:49.962 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.962 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.962 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.962 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.290961+0000", 2024-04-19T04:24:49.962 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0022620980000000001 2024-04-19T04:24:49.962 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.962 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.962 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.962 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.291108+0000", 2024-04-19T04:24:49.962 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000147097 2024-04-19T04:24:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.291307+0000", 2024-04-19T04:24:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00019852199999999999 2024-04-19T04:24:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.298417+0000", 2024-04-19T04:24:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0071099630000000004 2024-04-19T04:24:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.299276+0000", 2024-04-19T04:24:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00085986299999999999 2024-04-19T04:24:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.299343+0000", 2024-04-19T04:24:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.6789e-05 2024-04-19T04:24:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.299398+0000", 2024-04-19T04:24:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4508000000000001e-05 2024-04-19T04:24:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.965 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:1634 5.6 5:6959a88a:::benchmark_data_smithi007_19526_object1633:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:49.965 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:45.290080+0000", 2024-04-19T04:24:49.965 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.6157200280000001, 2024-04-19T04:24:49.965 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.012560969999999999, 2024-04-19T04:24:49.965 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.965 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.965 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:49.965 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:49.965 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:49.965 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 1634 2024-04-19T04:24:49.965 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.965 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.965 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.965 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.966 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.290080+0000", 2024-04-19T04:24:49.966 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.966 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.966 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.966 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.966 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.290080+0000", 2024-04-19T04:24:49.966 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.966 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.966 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.966 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.966 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.290079+0000", 2024-04-19T04:24:49.966 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:49.966 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.966 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.966 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.967 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.290146+0000", 2024-04-19T04:24:49.967 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7626000000000006e-05 2024-04-19T04:24:49.967 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.967 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.967 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.967 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.290164+0000", 2024-04-19T04:24:49.967 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8232000000000001e-05 2024-04-19T04:24:49.967 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.967 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.967 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.967 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.290176+0000", 2024-04-19T04:24:49.968 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1841999999999999e-05 2024-04-19T04:24:49.968 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.968 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.969 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.969 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.294440+0000", 2024-04-19T04:24:49.969 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0042635870000000001 2024-04-19T04:24:49.969 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.969 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.969 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.969 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.294549+0000", 2024-04-19T04:24:49.969 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000109344 2024-04-19T04:24:49.969 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.969 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.969 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:49.969 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.294667+0000", 2024-04-19T04:24:49.969 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000117525 2024-04-19T04:24:49.970 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.970 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.970 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:49.970 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.299430+0000", 2024-04-19T04:24:49.970 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0047633019999999996 2024-04-19T04:24:49.970 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.970 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.970 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.970 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.302522+0000", 2024-04-19T04:24:49.970 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0030919530000000001 2024-04-19T04:24:49.970 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.970 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.970 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:49.970 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.302594+0000", 2024-04-19T04:24:49.971 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.1594000000000006e-05 2024-04-19T04:24:49.971 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.971 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.971 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:49.971 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.302641+0000", 2024-04-19T04:24:49.971 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7602000000000003e-05 2024-04-19T04:24:49.971 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.971 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.971 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.971 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.971 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.971 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:1643 5.6 5:63f88d20:::benchmark_data_smithi007_19526_object1642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:49.971 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:45.294696+0000", 2024-04-19T04:24:49.972 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.611104611, 2024-04-19T04:24:49.972 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010966848, 2024-04-19T04:24:49.972 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.972 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.972 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:49.972 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:49.972 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:49.973 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 1643 2024-04-19T04:24:49.973 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.973 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.973 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.973 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.973 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.294696+0000", 2024-04-19T04:24:49.973 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.973 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.973 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.973 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.973 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.294696+0000", 2024-04-19T04:24:49.973 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.973 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.973 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.974 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.974 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.294695+0000", 2024-04-19T04:24:49.974 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.974 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.974 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.974 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.974 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.294767+0000", 2024-04-19T04:24:49.974 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2539000000000005e-05 2024-04-19T04:24:49.974 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.974 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.974 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.974 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.294777+0000", 2024-04-19T04:24:49.974 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.2660000000000007e-06 2024-04-19T04:24:49.975 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.975 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.975 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.975 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.294783+0000", 2024-04-19T04:24:49.975 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.9800000000000003e-06 2024-04-19T04:24:49.975 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.975 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.975 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.975 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.298448+0000", 2024-04-19T04:24:49.975 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0036654970000000002 2024-04-19T04:24:49.975 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.975 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.975 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.975 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.298598+0000", 2024-04-19T04:24:49.975 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000149691 2024-04-19T04:24:49.976 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.976 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.976 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:49.976 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.298777+0000", 2024-04-19T04:24:49.976 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017899100000000001 2024-04-19T04:24:49.976 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.976 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.976 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:49.976 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.303087+0000", 2024-04-19T04:24:49.976 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0043099740000000003 2024-04-19T04:24:49.976 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.976 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.976 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.976 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.305543+0000", 2024-04-19T04:24:49.977 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0024566340000000001 2024-04-19T04:24:49.977 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.977 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.977 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:49.977 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.305610+0000", 2024-04-19T04:24:49.977 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.6470999999999994e-05 2024-04-19T04:24:49.977 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.977 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.977 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:49.977 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.305663+0000", 2024-04-19T04:24:49.977 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2633999999999998e-05 2024-04-19T04:24:49.977 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.977 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.977 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.978 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.978 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.978 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:12221 5.a 5:554b89f1:::benchmark_data_smithi007_19526_object12220:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T04:24:49.978 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:48.869516+0000", 2024-04-19T04:24:49.978 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 1.036283818, 2024-04-19T04:24:49.978 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.012486575999999999, 2024-04-19T04:24:49.978 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.978 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.978 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:49.978 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:49.978 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:49.978 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 12221 2024-04-19T04:24:49.978 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.978 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.979 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.979 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.979 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.869516+0000", 2024-04-19T04:24:49.979 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.979 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.979 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.979 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.979 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.869516+0000", 2024-04-19T04:24:49.979 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.979 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.980 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.980 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.980 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.869515+0000", 2024-04-19T04:24:49.980 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.980 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.980 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.980 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.980 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.869634+0000", 2024-04-19T04:24:49.980 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000118356 2024-04-19T04:24:49.980 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.980 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.980 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.980 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.869645+0000", 2024-04-19T04:24:49.980 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0915e-05 2024-04-19T04:24:49.980 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.981 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.981 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.981 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.869656+0000", 2024-04-19T04:24:49.981 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1695000000000001e-05 2024-04-19T04:24:49.981 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.981 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.981 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.981 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.869705+0000", 2024-04-19T04:24:49.981 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.8783999999999999e-05 2024-04-19T04:24:49.981 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.981 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.981 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.981 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.869845+0000", 2024-04-19T04:24:49.981 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000139326 2024-04-19T04:24:49.982 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.982 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.982 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:49.982 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.870033+0000", 2024-04-19T04:24:49.982 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00018805100000000001 2024-04-19T04:24:49.982 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.982 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.982 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:49.982 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.874423+0000", 2024-04-19T04:24:49.983 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0043904319999999997 2024-04-19T04:24:49.983 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.983 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.983 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:49.983 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.881875+0000", 2024-04-19T04:24:49.983 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0074519219999999997 2024-04-19T04:24:49.983 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.983 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.983 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:49.984 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.881977+0000", 2024-04-19T04:24:49.984 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000102391 2024-04-19T04:24:49.984 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.984 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.984 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:49.984 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.882003+0000", 2024-04-19T04:24:49.984 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.5689000000000001e-05 2024-04-19T04:24:49.984 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.984 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.985 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.985 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.985 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.985 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:12216 5.e e25/20 5:776534c9:::benchmark_data_smithi007_19526_object12215:head v 25'773, mlcod=25'770)", 2024-04-19T04:24:49.985 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:48.870195+0000", 2024-04-19T04:24:49.985 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 1.035605653, 2024-04-19T04:24:49.986 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011776264999999999, 2024-04-19T04:24:49.986 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.986 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.986 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.986 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.986 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.987 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.870195+0000", 2024-04-19T04:24:49.987 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.987 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.987 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.987 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.987 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.870195+0000", 2024-04-19T04:24:49.988 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.988 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.988 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.988 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.989 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.870194+0000", 2024-04-19T04:24:49.989 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:49.989 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.989 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.990 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.990 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.870289+0000", 2024-04-19T04:24:49.990 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.4726000000000001e-05 2024-04-19T04:24:49.990 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.991 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.991 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.991 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.870295+0000", 2024-04-19T04:24:49.991 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.3389999999999998e-06 2024-04-19T04:24:49.991 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.991 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.992 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.992 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.870299+0000", 2024-04-19T04:24:49.992 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.7440000000000001e-06 2024-04-19T04:24:49.992 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.992 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.992 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:49.993 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.872199+0000", 2024-04-19T04:24:49.993 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0019004200000000001 2024-04-19T04:24:49.993 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.993 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.993 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:49.993 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.872222+0000", 2024-04-19T04:24:49.993 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.268e-05 2024-04-19T04:24:49.994 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.994 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.994 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:49.994 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.881942+0000", 2024-04-19T04:24:49.994 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0097201430000000005 2024-04-19T04:24:49.994 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.994 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.994 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:49.995 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.881971+0000", 2024-04-19T04:24:49.995 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.8751999999999998e-05 2024-04-19T04:24:49.995 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.995 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:49.995 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:49.995 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.995 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.995 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:12334 5.c 5:3f543e11:::benchmark_data_smithi007_19526_object12333:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T04:24:49.995 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:48.913693+0000", 2024-04-19T04:24:49.995 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.99210715500000002, 2024-04-19T04:24:49.995 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010728168999999999, 2024-04-19T04:24:49.995 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:49.995 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:49.996 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:49.996 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:49.996 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:49.996 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 12334 2024-04-19T04:24:49.996 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.996 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:49.996 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.996 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:49.996 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.913693+0000", 2024-04-19T04:24:49.996 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.996 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.996 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.996 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:49.996 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.913693+0000", 2024-04-19T04:24:49.997 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:49.997 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.997 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.997 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:49.997 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.913692+0000", 2024-04-19T04:24:49.997 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:49.998 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.998 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.998 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:49.998 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.913757+0000", 2024-04-19T04:24:49.998 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.5364000000000006e-05 2024-04-19T04:24:49.998 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.999 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.999 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:49.999 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.913770+0000", 2024-04-19T04:24:49.999 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2264e-05 2024-04-19T04:24:49.999 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:49.999 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:49.999 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:49.999 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.913779+0000", 2024-04-19T04:24:49.999 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.4560000000000006e-06 2024-04-19T04:24:50.000 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.000 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.000 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:50.000 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.913847+0000", 2024-04-19T04:24:50.000 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7947000000000005e-05 2024-04-19T04:24:50.000 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.000 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.000 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:50.000 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.913982+0000", 2024-04-19T04:24:50.000 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000134924 2024-04-19T04:24:50.000 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.000 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.000 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:50.000 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.914097+0000", 2024-04-19T04:24:50.000 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000115431 2024-04-19T04:24:50.001 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.001 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.001 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:50.001 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.917360+0000", 2024-04-19T04:24:50.001 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0032626909999999999 2024-04-19T04:24:50.001 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.001 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.001 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.001 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.924368+0000", 2024-04-19T04:24:50.001 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0070073399999999999 2024-04-19T04:24:50.002 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.002 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.002 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:50.002 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.924398+0000", 2024-04-19T04:24:50.002 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.0017000000000001e-05 2024-04-19T04:24:50.002 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.002 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.002 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:50.002 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.924421+0000", 2024-04-19T04:24:50.002 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.3776000000000001e-05 2024-04-19T04:24:50.002 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:50.002 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:50.002 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:50.003 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.003 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.003 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:12336 5.c 5:3da08d20:::benchmark_data_smithi007_19526_object12335:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T04:24:50.003 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:48.914551+0000", 2024-04-19T04:24:50.003 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.99124933999999998, 2024-04-19T04:24:50.003 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010916904999999999, 2024-04-19T04:24:50.003 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:50.004 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.004 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:50.004 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:50.004 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.004 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 12336 2024-04-19T04:24:50.004 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.004 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:50.004 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.004 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:50.004 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.914551+0000", 2024-04-19T04:24:50.004 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:50.004 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.004 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.004 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:50.005 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.914551+0000", 2024-04-19T04:24:50.005 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:50.005 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.005 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.005 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:50.005 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.914550+0000", 2024-04-19T04:24:50.005 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.005 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.006 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.006 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:50.006 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.914591+0000", 2024-04-19T04:24:50.006 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1112999999999998e-05 2024-04-19T04:24:50.006 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.006 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.006 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:50.006 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.914606+0000", 2024-04-19T04:24:50.006 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.4999e-05 2024-04-19T04:24:50.006 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.007 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.007 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.007 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.914614+0000", 2024-04-19T04:24:50.007 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.3159999999999997e-06 2024-04-19T04:24:50.007 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.007 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.007 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:50.007 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.914917+0000", 2024-04-19T04:24:50.007 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00030318499999999998 2024-04-19T04:24:50.007 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.007 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.007 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:50.008 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.915098+0000", 2024-04-19T04:24:50.008 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00018033400000000001 2024-04-19T04:24:50.008 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.008 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.008 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:50.008 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.915254+0000", 2024-04-19T04:24:50.008 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015634500000000001 2024-04-19T04:24:50.008 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.008 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.008 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:50.008 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.918754+0000", 2024-04-19T04:24:50.009 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0034995809999999999 2024-04-19T04:24:50.009 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.009 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.009 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.009 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.925391+0000", 2024-04-19T04:24:50.009 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0066368850000000004 2024-04-19T04:24:50.009 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.009 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.009 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:50.009 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.925434+0000", 2024-04-19T04:24:50.009 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.3237e-05 2024-04-19T04:24:50.009 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.009 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.009 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:50.010 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.925468+0000", 2024-04-19T04:24:50.010 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.4090000000000001e-05 2024-04-19T04:24:50.010 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:50.010 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:50.010 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:50.010 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.010 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.010 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:12716 5.5 5:a958af77:::benchmark_data_smithi007_19526_object12715:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T04:24:50.010 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:49.055245+0000", 2024-04-19T04:24:50.010 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.85055507399999997, 2024-04-19T04:24:50.010 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011132469000000001, 2024-04-19T04:24:50.010 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:50.010 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.011 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:50.011 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:50.011 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.011 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 12716 2024-04-19T04:24:50.011 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.011 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:50.011 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.011 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:50.011 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.055245+0000", 2024-04-19T04:24:50.011 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:50.011 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.011 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.011 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:50.011 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.055245+0000", 2024-04-19T04:24:50.012 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:50.012 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.012 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.012 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:50.012 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.055244+0000", 2024-04-19T04:24:50.012 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.012 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.012 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.012 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:50.012 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.055297+0000", 2024-04-19T04:24:50.012 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2252e-05 2024-04-19T04:24:50.012 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.012 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.013 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:50.013 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.055310+0000", 2024-04-19T04:24:50.013 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3053e-05 2024-04-19T04:24:50.013 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.013 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.013 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.013 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.055318+0000", 2024-04-19T04:24:50.014 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.6740000000000003e-06 2024-04-19T04:24:50.014 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.014 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.014 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:50.014 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.056935+0000", 2024-04-19T04:24:50.014 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001617219 2024-04-19T04:24:50.014 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.014 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.014 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:50.014 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.057046+0000", 2024-04-19T04:24:50.015 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000110036 2024-04-19T04:24:50.015 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.015 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.015 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:50.015 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.057188+0000", 2024-04-19T04:24:50.015 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014265299999999999 2024-04-19T04:24:50.015 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.015 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.015 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:50.015 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.060167+0000", 2024-04-19T04:24:50.016 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0029792460000000001 2024-04-19T04:24:50.016 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.016 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.016 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.016 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.066284+0000", 2024-04-19T04:24:50.016 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0061168159999999997 2024-04-19T04:24:50.017 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.017 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.017 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:50.017 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.066335+0000", 2024-04-19T04:24:50.017 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.0770999999999999e-05 2024-04-19T04:24:50.017 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.018 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.018 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:50.018 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.066378+0000", 2024-04-19T04:24:50.018 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2667999999999999e-05 2024-04-19T04:24:50.018 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:50.019 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:50.019 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:50.019 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.019 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.019 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:14096 5.c 5:3f637f8d:::benchmark_data_smithi007_19526_object14095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T04:24:50.019 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:49.557772+0000", 2024-04-19T04:24:50.020 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.348028157, 2024-04-19T04:24:50.020 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010581584999999999, 2024-04-19T04:24:50.020 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:50.020 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.020 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:50.020 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:50.021 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.021 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 14096 2024-04-19T04:24:50.021 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.021 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:50.021 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.022 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:50.022 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.557772+0000", 2024-04-19T04:24:50.022 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:50.022 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.022 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.022 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:50.023 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.557772+0000", 2024-04-19T04:24:50.023 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:50.023 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.023 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.023 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:50.024 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.557772+0000", 2024-04-19T04:24:50.024 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:50.024 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.024 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.024 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:50.024 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.557826+0000", 2024-04-19T04:24:50.025 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4660000000000002e-05 2024-04-19T04:24:50.025 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.025 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.025 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:50.025 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.557838+0000", 2024-04-19T04:24:50.025 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1632e-05 2024-04-19T04:24:50.026 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.026 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.026 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.026 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.557845+0000", 2024-04-19T04:24:50.026 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.0849999999999999e-06 2024-04-19T04:24:50.026 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.027 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.027 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:50.027 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.562132+0000", 2024-04-19T04:24:50.027 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0042870950000000003 2024-04-19T04:24:50.027 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.027 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.028 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:50.028 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.562293+0000", 2024-04-19T04:24:50.028 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00016091 2024-04-19T04:24:50.029 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.029 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.029 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:50.029 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.562447+0000", 2024-04-19T04:24:50.029 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015425200000000001 2024-04-19T04:24:50.029 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.029 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.029 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:50.029 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.566150+0000", 2024-04-19T04:24:50.029 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0037032160000000001 2024-04-19T04:24:50.029 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.030 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.030 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.030 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.568276+0000", 2024-04-19T04:24:50.030 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0021259650000000001 2024-04-19T04:24:50.030 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.030 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.030 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:50.030 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.568314+0000", 2024-04-19T04:24:50.030 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.7409e-05 2024-04-19T04:24:50.030 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.030 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.031 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:50.031 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.568354+0000", 2024-04-19T04:24:50.031 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9919000000000002e-05 2024-04-19T04:24:50.031 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:50.031 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:50.031 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:50.031 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.031 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.031 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:14281 5.c 5:324bb768:::benchmark_data_smithi007_19526_object14280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T04:24:50.032 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:49.624149+0000", 2024-04-19T04:24:50.032 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.28165138200000001, 2024-04-19T04:24:50.032 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.01328056, 2024-04-19T04:24:50.032 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:50.032 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.032 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:50.032 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:50.032 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.032 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 14281 2024-04-19T04:24:50.032 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.032 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:50.032 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.032 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:50.033 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.624149+0000", 2024-04-19T04:24:50.033 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:50.033 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.033 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.033 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:50.033 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.624149+0000", 2024-04-19T04:24:50.033 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:50.033 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.033 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.033 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:50.033 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.624148+0000", 2024-04-19T04:24:50.033 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.033 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.034 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.034 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:50.034 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.624196+0000", 2024-04-19T04:24:50.034 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.8176000000000001e-05 2024-04-19T04:24:50.034 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.034 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.034 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:50.034 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.624218+0000", 2024-04-19T04:24:50.034 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2493e-05 2024-04-19T04:24:50.034 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.034 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.034 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.034 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.624229+0000", 2024-04-19T04:24:50.035 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0210999999999999e-05 2024-04-19T04:24:50.035 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.035 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.035 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:50.035 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.625136+0000", 2024-04-19T04:24:50.035 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00090728800000000002 2024-04-19T04:24:50.035 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.035 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.035 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:50.035 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.625286+0000", 2024-04-19T04:24:50.035 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014975700000000001 2024-04-19T04:24:50.035 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.035 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.036 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:50.036 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.625431+0000", 2024-04-19T04:24:50.036 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014548799999999999 2024-04-19T04:24:50.036 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.036 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.036 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.036 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.627337+0000", 2024-04-19T04:24:50.036 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0019056120000000001 2024-04-19T04:24:50.036 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.036 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.037 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:50.037 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.637374+0000", 2024-04-19T04:24:50.037 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010037315 2024-04-19T04:24:50.037 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.037 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.037 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:50.037 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.637407+0000", 2024-04-19T04:24:50.037 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.2675000000000001e-05 2024-04-19T04:24:50.037 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.037 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.037 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:50.037 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.637429+0000", 2024-04-19T04:24:50.037 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2722999999999999e-05 2024-04-19T04:24:50.038 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:50.038 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:50.038 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:50.038 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.038 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.038 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:14284 5.c 5:36bd4431:::benchmark_data_smithi007_19526_object14283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T04:24:50.038 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:49.625049+0000", 2024-04-19T04:24:50.038 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.280751627, 2024-04-19T04:24:50.038 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.012418848, 2024-04-19T04:24:50.038 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:50.039 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.039 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:50.039 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:50.039 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.039 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 14284 2024-04-19T04:24:50.039 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.039 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:50.039 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.039 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:50.039 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.625049+0000", 2024-04-19T04:24:50.040 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:50.040 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.040 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.040 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:50.040 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.625049+0000", 2024-04-19T04:24:50.040 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:50.040 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.040 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.040 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:50.040 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.625048+0000", 2024-04-19T04:24:50.040 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.040 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.040 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.041 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:50.041 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.625098+0000", 2024-04-19T04:24:50.041 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.0661999999999997e-05 2024-04-19T04:24:50.041 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.041 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.041 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:50.041 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.625109+0000", 2024-04-19T04:24:50.041 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0847e-05 2024-04-19T04:24:50.041 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.041 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.042 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.042 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.625117+0000", 2024-04-19T04:24:50.042 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.0430000000000008e-06 2024-04-19T04:24:50.042 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.042 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.042 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:50.043 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.626265+0000", 2024-04-19T04:24:50.043 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0011483260000000001 2024-04-19T04:24:50.043 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.043 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.043 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:50.043 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.626348+0000", 2024-04-19T04:24:50.043 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.3053000000000006e-05 2024-04-19T04:24:50.043 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.043 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.043 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:50.043 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.626460+0000", 2024-04-19T04:24:50.043 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00011181200000000001 2024-04-19T04:24:50.043 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.044 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.044 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.044 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.628701+0000", 2024-04-19T04:24:50.044 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0022406840000000002 2024-04-19T04:24:50.044 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.044 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.044 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:50.044 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.637434+0000", 2024-04-19T04:24:50.044 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0087331409999999998 2024-04-19T04:24:50.044 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.044 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.044 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:50.044 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.637453+0000", 2024-04-19T04:24:50.045 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8425999999999999e-05 2024-04-19T04:24:50.045 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:50.045 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:50.045 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:50.045 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.637468+0000", 2024-04-19T04:24:50.045 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.4975e-05 2024-04-19T04:24:50.045 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:50.045 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:50.045 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:50.045 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:50.045 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:50.045 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:24:50.047 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:50.042+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:50.048 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:24:50.147 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:50.143+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:50.176 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:24:50.176 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:24:50.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.176 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:15711 5.d 5:b0e0fceb:::benchmark_data_smithi007_19526_object15710:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:50.176 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:50.171326+0000", 2024-04-19T04:24:50.176 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0049364099999999996, 2024-04-19T04:24:50.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049603199999999998, 2024-04-19T04:24:50.176 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.176 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:50.176 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:50.176 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:50.177 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.177 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 15711 2024-04-19T04:24:50.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.177 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171326+0000", 2024-04-19T04:24:50.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171326+0000", 2024-04-19T04:24:50.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171325+0000", 2024-04-19T04:24:50.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171363+0000", 2024-04-19T04:24:50.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7787000000000003e-05 2024-04-19T04:24:50.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171376+0000", 2024-04-19T04:24:50.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2611e-05 2024-04-19T04:24:50.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171381+0000", 2024-04-19T04:24:50.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5899999999999998e-06 2024-04-19T04:24:50.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171422+0000", 2024-04-19T04:24:50.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0867e-05 2024-04-19T04:24:50.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171561+0000", 2024-04-19T04:24:50.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000138646 2024-04-19T04:24:50.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:50.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171713+0000", 2024-04-19T04:24:50.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015189199999999999 2024-04-19T04:24:50.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.174571+0000", 2024-04-19T04:24:50.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028582 2024-04-19T04:24:50.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.176257+0000", 2024-04-19T04:24:50.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016859970000000001 2024-04-19T04:24:50.182 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.182 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.182 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.183 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:15713 5.b 5:df059d12:::benchmark_data_smithi007_19526_object15712:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:50.183 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:50.171391+0000", 2024-04-19T04:24:50.183 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0048717229999999997, 2024-04-19T04:24:50.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049890200000000003, 2024-04-19T04:24:50.183 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.183 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.183 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:50.183 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:50.183 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.183 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 15713 2024-04-19T04:24:50.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.184 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171391+0000", 2024-04-19T04:24:50.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171391+0000", 2024-04-19T04:24:50.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171390+0000", 2024-04-19T04:24:50.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:50.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171415+0000", 2024-04-19T04:24:50.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5134e-05 2024-04-19T04:24:50.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171421+0000", 2024-04-19T04:24:50.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3140000000000003e-06 2024-04-19T04:24:50.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171424+0000", 2024-04-19T04:24:50.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8580000000000002e-06 2024-04-19T04:24:50.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171468+0000", 2024-04-19T04:24:50.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3167999999999997e-05 2024-04-19T04:24:50.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171607+0000", 2024-04-19T04:24:50.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013961099999999999 2024-04-19T04:24:50.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:50.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171750+0000", 2024-04-19T04:24:50.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014324199999999999 2024-04-19T04:24:50.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.173656+0000", 2024-04-19T04:24:50.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00190551 2024-04-19T04:24:50.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.176333+0000", 2024-04-19T04:24:50.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026774989999999999 2024-04-19T04:24:50.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.176379+0000", 2024-04-19T04:24:50.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5578000000000003e-05 2024-04-19T04:24:50.188 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.188 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.188 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.188 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:15716 5.d 5:b844f532:::benchmark_data_smithi007_19526_object15715:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:50.188 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:50.171684+0000", 2024-04-19T04:24:50.188 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0045784049999999998, 2024-04-19T04:24:50.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047956509999999997, 2024-04-19T04:24:50.188 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.188 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:50.188 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:50.189 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:50.189 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.189 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 15716 2024-04-19T04:24:50.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.189 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171684+0000", 2024-04-19T04:24:50.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171684+0000", 2024-04-19T04:24:50.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171683+0000", 2024-04-19T04:24:50.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171767+0000", 2024-04-19T04:24:50.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4324000000000001e-05 2024-04-19T04:24:50.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171774+0000", 2024-04-19T04:24:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0550000000000002e-06 2024-04-19T04:24:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.171779+0000", 2024-04-19T04:24:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5229999999999997e-06 2024-04-19T04:24:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.172649+0000", 2024-04-19T04:24:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00087019799999999998 2024-04-19T04:24:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.172786+0000", 2024-04-19T04:24:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013692199999999999 2024-04-19T04:24:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.172895+0000", 2024-04-19T04:24:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010962400000000001 2024-04-19T04:24:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.174920+0000", 2024-04-19T04:24:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002024564 2024-04-19T04:24:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:15718 5.f e26/20 5:ff780764:::benchmark_data_smithi007_19526_object15717:head v 26'940, mlcod=26'938)", 2024-04-19T04:24:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:50.174754+0000", 2024-04-19T04:24:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0015082030000000001, 2024-04-19T04:24:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0017844390000000001, 2024-04-19T04:24:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:24:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.174754+0000", 2024-04-19T04:24:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.174754+0000", 2024-04-19T04:24:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.174754+0000", 2024-04-19T04:24:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.174838+0000", 2024-04-19T04:24:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3916000000000001e-05 2024-04-19T04:24:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.174846+0000", 2024-04-19T04:24:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7639999999999994e-06 2024-04-19T04:24:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.174851+0000", 2024-04-19T04:24:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4190000000000004e-06 2024-04-19T04:24:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.174884+0000", 2024-04-19T04:24:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3445000000000003e-05 2024-04-19T04:24:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.174904+0000", 2024-04-19T04:24:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9673999999999998e-05 2024-04-19T04:24:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:15724 5.9 e26/20 5:92d5000d:::benchmark_data_smithi007_19526_object15723:head v 26'1021, mlcod=26'1018)", 2024-04-19T04:24:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:50.175441+0000", 2024-04-19T04:24:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00082092299999999999, 2024-04-19T04:24:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0011395610000000001, 2024-04-19T04:24:50.197 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.197 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:24:50.197 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.175441+0000", 2024-04-19T04:24:50.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.175441+0000", 2024-04-19T04:24:50.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.175441+0000", 2024-04-19T04:24:50.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.175502+0000", 2024-04-19T04:24:50.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1662999999999996e-05 2024-04-19T04:24:50.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.175512+0000", 2024-04-19T04:24:50.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9299999999999998e-06 2024-04-19T04:24:50.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.175519+0000", 2024-04-19T04:24:50.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5699999999999998e-06 2024-04-19T04:24:50.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.175573+0000", 2024-04-19T04:24:50.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3724000000000003e-05 2024-04-19T04:24:50.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.175587+0000", 2024-04-19T04:24:50.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4552999999999999e-05 2024-04-19T04:24:50.199 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.200 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.200 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.200 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:15727 5.e 5:7fa721e4:::benchmark_data_smithi007_19526_object15726:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:50.200 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:50.175784+0000", 2024-04-19T04:24:50.200 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.000478581, 2024-04-19T04:24:50.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00084256200000000004, 2024-04-19T04:24:50.200 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.200 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:50.200 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:50.200 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:50.200 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.200 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 15727 2024-04-19T04:24:50.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.201 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.175784+0000", 2024-04-19T04:24:50.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.175784+0000", 2024-04-19T04:24:50.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.175783+0000", 2024-04-19T04:24:50.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.175863+0000", 2024-04-19T04:24:50.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0636000000000005e-05 2024-04-19T04:24:50.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.175876+0000", 2024-04-19T04:24:50.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2944e-05 2024-04-19T04:24:50.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.175883+0000", 2024-04-19T04:24:50.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8680000000000001e-06 2024-04-19T04:24:50.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.175930+0000", 2024-04-19T04:24:50.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6798000000000002e-05 2024-04-19T04:24:50.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.176123+0000", 2024-04-19T04:24:50.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019254999999999999 2024-04-19T04:24:50.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:50.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:50.176235+0000", 2024-04-19T04:24:50.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011268 2024-04-19T04:24:50.205 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.205 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.205 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.205 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.206 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:24:50.206 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 6 2024-04-19T04:24:50.206 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:24:50.207 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:24:50.248 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:50.247+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:50.331 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:24:50.331 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:24:50.331 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:24:50.331 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:24:50.331 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:24:50.342 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:24:50.350 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:50.343+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:50.450 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:50.443+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:50.468 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:24:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:24:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:24:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:24:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539530+0000", 2024-04-19T04:24:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.928040476, 2024-04-19T04:24:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015136197000000001, 2024-04-19T04:24:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539530+0000", 2024-04-19T04:24:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539530+0000", 2024-04-19T04:24:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539527+0000", 2024-04-19T04:24:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999971 2024-04-19T04:24:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539544+0000", 2024-04-19T04:24:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7082999999999999e-05 2024-04-19T04:24:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539567+0000", 2024-04-19T04:24:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3569000000000001e-05 2024-04-19T04:24:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539589+0000", 2024-04-19T04:24:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1486999999999999e-05 2024-04-19T04:24:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539691+0000", 2024-04-19T04:24:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010262 2024-04-19T04:24:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539876+0000", 2024-04-19T04:24:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000184172 2024-04-19T04:24:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541233+0000", 2024-04-19T04:24:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013569719999999999 2024-04-19T04:24:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547291+0000", 2024-04-19T04:24:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060583080000000001 2024-04-19T04:24:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554597+0000", 2024-04-19T04:24:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0073062800000000001 2024-04-19T04:24:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554640+0000", 2024-04-19T04:24:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3115999999999999e-05 2024-04-19T04:24:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554666+0000", 2024-04-19T04:24:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5400000000000001e-05 2024-04-19T04:24:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539646+0000", 2024-04-19T04:24:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.927923649, 2024-04-19T04:24:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015767644000000001, 2024-04-19T04:24:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539646+0000", 2024-04-19T04:24:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539646+0000", 2024-04-19T04:24:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539645+0000", 2024-04-19T04:24:50.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:50.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539672+0000", 2024-04-19T04:24:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7036999999999999e-05 2024-04-19T04:24:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539691+0000", 2024-04-19T04:24:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8929000000000001e-05 2024-04-19T04:24:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539707+0000", 2024-04-19T04:24:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5979999999999999e-05 2024-04-19T04:24:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542292+0000", 2024-04-19T04:24:50.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025857020000000001 2024-04-19T04:24:50.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542472+0000", 2024-04-19T04:24:50.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018001599999999999 2024-04-19T04:24:50.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:50.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543505+0000", 2024-04-19T04:24:50.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010326739999999999 2024-04-19T04:24:50.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547314+0000", 2024-04-19T04:24:50.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038089349999999998 2024-04-19T04:24:50.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555323+0000", 2024-04-19T04:24:50.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080089979999999998 2024-04-19T04:24:50.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555378+0000", 2024-04-19T04:24:50.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4951999999999998e-05 2024-04-19T04:24:50.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555414+0000", 2024-04-19T04:24:50.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5998000000000003e-05 2024-04-19T04:24:50.480 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.480 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.480 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.480 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:50.480 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539729+0000", 2024-04-19T04:24:50.480 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.927840553999999, 2024-04-19T04:24:50.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015615043, 2024-04-19T04:24:50.480 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.480 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.480 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539729+0000", 2024-04-19T04:24:50.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539729+0000", 2024-04-19T04:24:50.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539728+0000", 2024-04-19T04:24:50.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:50.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539737+0000", 2024-04-19T04:24:50.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5799999999999992e-06 2024-04-19T04:24:50.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539753+0000", 2024-04-19T04:24:50.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6373000000000001e-05 2024-04-19T04:24:50.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539770+0000", 2024-04-19T04:24:50.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7516e-05 2024-04-19T04:24:50.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542136+0000", 2024-04-19T04:24:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023653440000000001 2024-04-19T04:24:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543783+0000", 2024-04-19T04:24:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016468209999999999 2024-04-19T04:24:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543971+0000", 2024-04-19T04:24:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018871200000000001 2024-04-19T04:24:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547318+0000", 2024-04-19T04:24:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033471199999999999 2024-04-19T04:24:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555276+0000", 2024-04-19T04:24:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079574280000000008 2024-04-19T04:24:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555320+0000", 2024-04-19T04:24:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3664000000000001e-05 2024-04-19T04:24:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555344+0000", 2024-04-19T04:24:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4905e-05 2024-04-19T04:24:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539783+0000", 2024-04-19T04:24:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.927787249000001, 2024-04-19T04:24:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014773131, 2024-04-19T04:24:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539783+0000", 2024-04-19T04:24:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539783+0000", 2024-04-19T04:24:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539782+0000", 2024-04-19T04:24:50.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539790+0000", 2024-04-19T04:24:50.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9440000000000005e-06 2024-04-19T04:24:50.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539807+0000", 2024-04-19T04:24:50.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7036000000000001e-05 2024-04-19T04:24:50.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539822+0000", 2024-04-19T04:24:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4939e-05 2024-04-19T04:24:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539914+0000", 2024-04-19T04:24:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2435000000000005e-05 2024-04-19T04:24:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541221+0000", 2024-04-19T04:24:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001307358 2024-04-19T04:24:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541403+0000", 2024-04-19T04:24:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018113299999999999 2024-04-19T04:24:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.545434+0000", 2024-04-19T04:24:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040314260000000003 2024-04-19T04:24:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554049+0000", 2024-04-19T04:24:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0086145500000000003 2024-04-19T04:24:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554515+0000", 2024-04-19T04:24:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00046650899999999999 2024-04-19T04:24:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554556+0000", 2024-04-19T04:24:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0850999999999999e-05 2024-04-19T04:24:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:24:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.92772699, 2024-04-19T04:24:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018096054, 2024-04-19T04:24:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:24:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:24:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539842+0000", 2024-04-19T04:24:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539848+0000", 2024-04-19T04:24:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-19T04:24:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539859+0000", 2024-04-19T04:24:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0783e-05 2024-04-19T04:24:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539866+0000", 2024-04-19T04:24:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9439999999999999e-06 2024-04-19T04:24:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547400+0000", 2024-04-19T04:24:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075343729999999996 2024-04-19T04:24:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547480+0000", 2024-04-19T04:24:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9793e-05 2024-04-19T04:24:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547587+0000", 2024-04-19T04:24:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107333 2024-04-19T04:24:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.548935+0000", 2024-04-19T04:24:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013480639999999999 2024-04-19T04:24:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557892+0000", 2024-04-19T04:24:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089563939999999995 2024-04-19T04:24:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557920+0000", 2024-04-19T04:24:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8342000000000001e-05 2024-04-19T04:24:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557939+0000", 2024-04-19T04:24:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9142000000000001e-05 2024-04-19T04:24:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539872+0000", 2024-04-19T04:24:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.927697581, 2024-04-19T04:24:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015022429, 2024-04-19T04:24:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539872+0000", 2024-04-19T04:24:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539872+0000", 2024-04-19T04:24:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539872+0000", 2024-04-19T04:24:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539876+0000", 2024-04-19T04:24:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1999999999999996e-06 2024-04-19T04:24:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539886+0000", 2024-04-19T04:24:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9469999999999998e-06 2024-04-19T04:24:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539906+0000", 2024-04-19T04:24:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0542000000000001e-05 2024-04-19T04:24:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542491+0000", 2024-04-19T04:24:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025843530000000002 2024-04-19T04:24:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543411+0000", 2024-04-19T04:24:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00091973700000000001 2024-04-19T04:24:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543523+0000", 2024-04-19T04:24:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112323 2024-04-19T04:24:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.546595+0000", 2024-04-19T04:24:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003071631 2024-04-19T04:24:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554744+0000", 2024-04-19T04:24:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081498850000000008 2024-04-19T04:24:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554799+0000", 2024-04-19T04:24:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5067e-05 2024-04-19T04:24:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554895+0000", 2024-04-19T04:24:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5364000000000004e-05 2024-04-19T04:24:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:24:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.927650742000001, 2024-04-19T04:24:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018086631999999998, 2024-04-19T04:24:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:24:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:24:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539918+0000", 2024-04-19T04:24:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539931+0000", 2024-04-19T04:24:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2566e-05 2024-04-19T04:24:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539958+0000", 2024-04-19T04:24:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6582999999999999e-05 2024-04-19T04:24:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539972+0000", 2024-04-19T04:24:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4789e-05 2024-04-19T04:24:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547577+0000", 2024-04-19T04:24:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0076045979999999997 2024-04-19T04:24:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547769+0000", 2024-04-19T04:24:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000192034 2024-04-19T04:24:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547929+0000", 2024-04-19T04:24:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000159679 2024-04-19T04:24:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.548942+0000", 2024-04-19T04:24:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010138720000000001 2024-04-19T04:24:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557962+0000", 2024-04-19T04:24:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090199970000000001 2024-04-19T04:24:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557985+0000", 2024-04-19T04:24:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2623e-05 2024-04-19T04:24:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.558006+0000", 2024-04-19T04:24:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0764e-05 2024-04-19T04:24:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:27 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:24:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.927584754000002, 2024-04-19T04:24:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018047384, 2024-04-19T04:24:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:24:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:24:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:24:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539984+0000", 2024-04-19T04:24:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539991+0000", 2024-04-19T04:24:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7769999999999997e-06 2024-04-19T04:24:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540010+0000", 2024-04-19T04:24:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9573e-05 2024-04-19T04:24:50.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540025+0000", 2024-04-19T04:24:50.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4796e-05 2024-04-19T04:24:50.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541220+0000", 2024-04-19T04:24:50.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001195172 2024-04-19T04:24:50.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541569+0000", 2024-04-19T04:24:50.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00034836600000000002 2024-04-19T04:24:50.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.558033+0000", 2024-04-19T04:24:50.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.016464092999999999 2024-04-19T04:24:50.511 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.511 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.511 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.511 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:1489 5.8 5:1c1d000a:::benchmark_data_smithi007_19526_object1488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:50.511 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:45.237312+0000", 2024-04-19T04:24:50.511 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.2302583550000001, 2024-04-19T04:24:50.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012162592999999999, 2024-04-19T04:24:50.512 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.512 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.512 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:50.512 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:50.512 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.512 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1489 2024-04-19T04:24:50.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.512 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237312+0000", 2024-04-19T04:24:50.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237312+0000", 2024-04-19T04:24:50.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237311+0000", 2024-04-19T04:24:50.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237379+0000", 2024-04-19T04:24:50.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7903000000000004e-05 2024-04-19T04:24:50.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237388+0000", 2024-04-19T04:24:50.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7110000000000007e-06 2024-04-19T04:24:50.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237398+0000", 2024-04-19T04:24:50.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4029999999999996e-06 2024-04-19T04:24:50.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.238849+0000", 2024-04-19T04:24:50.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001451461 2024-04-19T04:24:50.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.238942+0000", 2024-04-19T04:24:50.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3009000000000003e-05 2024-04-19T04:24:50.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:50.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.239037+0000", 2024-04-19T04:24:50.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4748999999999997e-05 2024-04-19T04:24:50.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.242004+0000", 2024-04-19T04:24:50.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029668810000000002 2024-04-19T04:24:50.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.249368+0000", 2024-04-19T04:24:50.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0073641419999999997 2024-04-19T04:24:50.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.249427+0000", 2024-04-19T04:24:50.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8761000000000002e-05 2024-04-19T04:24:50.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.249474+0000", 2024-04-19T04:24:50.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7602000000000003e-05 2024-04-19T04:24:50.517 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.517 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.517 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.517 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:1490 5.0 5:0c323df6:::benchmark_data_smithi007_19526_object1489:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:50.517 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:45.237409+0000", 2024-04-19T04:24:50.517 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.2301606390000002, 2024-04-19T04:24:50.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012295823000000001, 2024-04-19T04:24:50.517 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.517 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.517 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:50.517 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:50.517 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.518 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1490 2024-04-19T04:24:50.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.518 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237409+0000", 2024-04-19T04:24:50.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237409+0000", 2024-04-19T04:24:50.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237408+0000", 2024-04-19T04:24:50.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237453+0000", 2024-04-19T04:24:50.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4221000000000002e-05 2024-04-19T04:24:50.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237462+0000", 2024-04-19T04:24:50.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5149999999999995e-06 2024-04-19T04:24:50.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.237469+0000", 2024-04-19T04:24:50.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9770000000000003e-06 2024-04-19T04:24:50.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.238922+0000", 2024-04-19T04:24:50.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001452535 2024-04-19T04:24:50.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.239029+0000", 2024-04-19T04:24:50.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107217 2024-04-19T04:24:50.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:50.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.239158+0000", 2024-04-19T04:24:50.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012859699999999999 2024-04-19T04:24:50.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.241822+0000", 2024-04-19T04:24:50.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026646299999999999 2024-04-19T04:24:50.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.249609+0000", 2024-04-19T04:24:50.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077870609999999996 2024-04-19T04:24:50.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.249663+0000", 2024-04-19T04:24:50.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3794e-05 2024-04-19T04:24:50.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:45.249705+0000", 2024-04-19T04:24:50.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2125000000000001e-05 2024-04-19T04:24:50.522 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.522 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.522 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.523 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:4356 5.b 5:d88c0595:::benchmark_data_smithi007_19526_object4355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T04:24:50.523 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:46.193136+0000", 2024-04-19T04:24:50.523 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.2744338940000004, 2024-04-19T04:24:50.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011924094999999999, 2024-04-19T04:24:50.523 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.523 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.523 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:50.523 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:50.523 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.523 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 4356 2024-04-19T04:24:50.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.524 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.193136+0000", 2024-04-19T04:24:50.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.193136+0000", 2024-04-19T04:24:50.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.193135+0000", 2024-04-19T04:24:50.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.193180+0000", 2024-04-19T04:24:50.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.494e-05 2024-04-19T04:24:50.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.193189+0000", 2024-04-19T04:24:50.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0739999999999999e-06 2024-04-19T04:24:50.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.193195+0000", 2024-04-19T04:24:50.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2789999999999998e-06 2024-04-19T04:24:50.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.194474+0000", 2024-04-19T04:24:50.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012792070000000001 2024-04-19T04:24:50.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.194683+0000", 2024-04-19T04:24:50.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020884399999999999 2024-04-19T04:24:50.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:50.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.194910+0000", 2024-04-19T04:24:50.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000227168 2024-04-19T04:24:50.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.196858+0000", 2024-04-19T04:24:50.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001948471 2024-04-19T04:24:50.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.204972+0000", 2024-04-19T04:24:50.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081136509999999995 2024-04-19T04:24:50.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.205025+0000", 2024-04-19T04:24:50.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2908000000000002e-05 2024-04-19T04:24:50.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.205060+0000", 2024-04-19T04:24:50.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5280000000000001e-05 2024-04-19T04:24:50.529 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.529 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.529 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.529 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:4358 5.4 5:2ee1b5c1:::benchmark_data_smithi007_19526_object4357:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T04:24:50.529 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:46.193382+0000", 2024-04-19T04:24:50.529 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.2741878670000002, 2024-04-19T04:24:50.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011747881999999999, 2024-04-19T04:24:50.529 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.529 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.529 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:50.529 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:50.529 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.530 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 4358 2024-04-19T04:24:50.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.530 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.193382+0000", 2024-04-19T04:24:50.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.193382+0000", 2024-04-19T04:24:50.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.193381+0000", 2024-04-19T04:24:50.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:50.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.193415+0000", 2024-04-19T04:24:50.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3308e-05 2024-04-19T04:24:50.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.193421+0000", 2024-04-19T04:24:50.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3230000000000003e-06 2024-04-19T04:24:50.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.193425+0000", 2024-04-19T04:24:50.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3370000000000001e-06 2024-04-19T04:24:50.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.194211+0000", 2024-04-19T04:24:50.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00078546699999999998 2024-04-19T04:24:50.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.194387+0000", 2024-04-19T04:24:50.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017622100000000001 2024-04-19T04:24:50.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:50.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.194625+0000", 2024-04-19T04:24:50.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023786400000000001 2024-04-19T04:24:50.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.196500+0000", 2024-04-19T04:24:50.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0018745260000000001 2024-04-19T04:24:50.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.205041+0000", 2024-04-19T04:24:50.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085412890000000005 2024-04-19T04:24:50.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.205098+0000", 2024-04-19T04:24:50.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7649999999999999e-05 2024-04-19T04:24:50.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.205130+0000", 2024-04-19T04:24:50.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1526999999999998e-05 2024-04-19T04:24:50.535 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.535 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.535 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.535 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:4824 5.d 5:b439db4e:::benchmark_data_smithi007_19526_object4823:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T04:24:50.535 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:46.349526+0000", 2024-04-19T04:24:50.535 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.1180443059999998, 2024-04-19T04:24:50.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.01220977, 2024-04-19T04:24:50.535 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.535 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.535 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:50.535 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:50.535 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.536 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 4824 2024-04-19T04:24:50.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.536 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.349526+0000", 2024-04-19T04:24:50.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.349526+0000", 2024-04-19T04:24:50.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.349525+0000", 2024-04-19T04:24:50.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.349574+0000", 2024-04-19T04:24:50.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9289000000000002e-05 2024-04-19T04:24:50.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.349581+0000", 2024-04-19T04:24:50.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7660000000000001e-06 2024-04-19T04:24:50.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.349586+0000", 2024-04-19T04:24:50.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5920000000000002e-06 2024-04-19T04:24:50.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.350502+0000", 2024-04-19T04:24:50.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000915984 2024-04-19T04:24:50.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.350673+0000", 2024-04-19T04:24:50.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000171781 2024-04-19T04:24:50.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:50.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.350865+0000", 2024-04-19T04:24:50.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019156699999999999 2024-04-19T04:24:50.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.353443+0000", 2024-04-19T04:24:50.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025783630000000002 2024-04-19T04:24:50.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.361621+0000", 2024-04-19T04:24:50.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081780240000000008 2024-04-19T04:24:50.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.361690+0000", 2024-04-19T04:24:50.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9219000000000003e-05 2024-04-19T04:24:50.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:46.361735+0000", 2024-04-19T04:24:50.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4960999999999999e-05 2024-04-19T04:24:50.544 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.544 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.544 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.544 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:12216 5.e 5:776534c9:::benchmark_data_smithi007_19526_object12215:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T04:24:50.545 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:48.870864+0000", 2024-04-19T04:24:50.545 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.5967055879999998, 2024-04-19T04:24:50.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013154275, 2024-04-19T04:24:50.545 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.545 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:50.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:50.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.545 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 12216 2024-04-19T04:24:50.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.545 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:48.870864+0000", 2024-04-19T04:24:50.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:48.870864+0000", 2024-04-19T04:24:50.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:48.870863+0000", 2024-04-19T04:24:50.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:50.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:48.870909+0000", 2024-04-19T04:24:50.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6001000000000002e-05 2024-04-19T04:24:50.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:48.870917+0000", 2024-04-19T04:24:50.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.695e-06 2024-04-19T04:24:50.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:48.870926+0000", 2024-04-19T04:24:50.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2820000000000002e-06 2024-04-19T04:24:50.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:48.871647+0000", 2024-04-19T04:24:50.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00072052599999999998 2024-04-19T04:24:50.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:48.871738+0000", 2024-04-19T04:24:50.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1121999999999999e-05 2024-04-19T04:24:50.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:50.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:48.871835+0000", 2024-04-19T04:24:50.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6717000000000003e-05 2024-04-19T04:24:50.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:48.876027+0000", 2024-04-19T04:24:50.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0041927789999999998 2024-04-19T04:24:50.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:48.883910+0000", 2024-04-19T04:24:50.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0078829269999999996 2024-04-19T04:24:50.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:48.883976+0000", 2024-04-19T04:24:50.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5290999999999995e-05 2024-04-19T04:24:50.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:48.884019+0000", 2024-04-19T04:24:50.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3136000000000002e-05 2024-04-19T04:24:50.550 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.550 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.550 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.550 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:14351 5.0 5:06924ab4:::benchmark_data_smithi007_19526_object14350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T04:24:50.550 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:49.655245+0000", 2024-04-19T04:24:50.551 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.81232497100000001, 2024-04-19T04:24:50.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012947623, 2024-04-19T04:24:50.551 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.551 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.551 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:50.551 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:50.551 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.551 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 14351 2024-04-19T04:24:50.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.551 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.655245+0000", 2024-04-19T04:24:50.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.655245+0000", 2024-04-19T04:24:50.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.655244+0000", 2024-04-19T04:24:50.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.655328+0000", 2024-04-19T04:24:50.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4011000000000006e-05 2024-04-19T04:24:50.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.655362+0000", 2024-04-19T04:24:50.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3405999999999998e-05 2024-04-19T04:24:50.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.655369+0000", 2024-04-19T04:24:50.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5530000000000004e-06 2024-04-19T04:24:50.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.657008+0000", 2024-04-19T04:24:50.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016386129999999999 2024-04-19T04:24:50.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.657124+0000", 2024-04-19T04:24:50.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011663399999999999 2024-04-19T04:24:50.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:50.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.657254+0000", 2024-04-19T04:24:50.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129417 2024-04-19T04:24:50.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.663442+0000", 2024-04-19T04:24:50.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0061885760000000003 2024-04-19T04:24:50.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.668066+0000", 2024-04-19T04:24:50.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046238379999999999 2024-04-19T04:24:50.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.668142+0000", 2024-04-19T04:24:50.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6001999999999995e-05 2024-04-19T04:24:50.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.668193+0000", 2024-04-19T04:24:50.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0494999999999997e-05 2024-04-19T04:24:50.556 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.556 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.556 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.556 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:14826 5.0 5:08a02cda:::benchmark_data_smithi007_19526_object14825:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:50.556 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:49.834444+0000", 2024-04-19T04:24:50.556 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.63312550700000003, 2024-04-19T04:24:50.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011927343999999999, 2024-04-19T04:24:50.556 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.557 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.557 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:50.557 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:50.557 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.557 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 14826 2024-04-19T04:24:50.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.557 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.834444+0000", 2024-04-19T04:24:50.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.834444+0000", 2024-04-19T04:24:50.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.834443+0000", 2024-04-19T04:24:50.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:50.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.834548+0000", 2024-04-19T04:24:50.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105386 2024-04-19T04:24:50.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.834562+0000", 2024-04-19T04:24:50.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3854e-05 2024-04-19T04:24:50.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.834573+0000", 2024-04-19T04:24:50.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0498e-05 2024-04-19T04:24:50.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836754+0000", 2024-04-19T04:24:50.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021810639999999999 2024-04-19T04:24:50.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836932+0000", 2024-04-19T04:24:50.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017768300000000001 2024-04-19T04:24:50.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:50.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.837120+0000", 2024-04-19T04:24:50.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000188512 2024-04-19T04:24:50.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.841869+0000", 2024-04-19T04:24:50.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047484939999999998 2024-04-19T04:24:50.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.846144+0000", 2024-04-19T04:24:50.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0042750740000000002 2024-04-19T04:24:50.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.846304+0000", 2024-04-19T04:24:50.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000159922 2024-04-19T04:24:50.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.846372+0000", 2024-04-19T04:24:50.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8273000000000002e-05 2024-04-19T04:24:50.562 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.562 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.562 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.562 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:14827 5.8 5:17a0805e:::benchmark_data_smithi007_19526_object14826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:50.562 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:49.835039+0000", 2024-04-19T04:24:50.562 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.63253074399999998, 2024-04-19T04:24:50.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015368504, 2024-04-19T04:24:50.562 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.562 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.562 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:50.563 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:50.563 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.563 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 14827 2024-04-19T04:24:50.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.563 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835039+0000", 2024-04-19T04:24:50.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835039+0000", 2024-04-19T04:24:50.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835038+0000", 2024-04-19T04:24:50.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835118+0000", 2024-04-19T04:24:50.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0253000000000006e-05 2024-04-19T04:24:50.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835134+0000", 2024-04-19T04:24:50.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5565000000000001e-05 2024-04-19T04:24:50.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835145+0000", 2024-04-19T04:24:50.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1066e-05 2024-04-19T04:24:50.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.839716+0000", 2024-04-19T04:24:50.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045706610000000002 2024-04-19T04:24:50.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.839880+0000", 2024-04-19T04:24:50.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164272 2024-04-19T04:24:50.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:50.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.840064+0000", 2024-04-19T04:24:50.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018395999999999999 2024-04-19T04:24:50.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.842870+0000", 2024-04-19T04:24:50.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028064790000000002 2024-04-19T04:24:50.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.850315+0000", 2024-04-19T04:24:50.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074444639999999996 2024-04-19T04:24:50.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.850376+0000", 2024-04-19T04:24:50.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.088e-05 2024-04-19T04:24:50.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.850408+0000", 2024-04-19T04:24:50.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2013e-05 2024-04-19T04:24:50.567 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.567 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.568 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.568 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:14832 5.e 5:700017a8:::benchmark_data_smithi007_19526_object14831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:50.568 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:49.836412+0000", 2024-04-19T04:24:50.568 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.63115768299999997, 2024-04-19T04:24:50.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014543795, 2024-04-19T04:24:50.568 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.568 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.568 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:50.568 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:50.568 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.568 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 14832 2024-04-19T04:24:50.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.569 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836412+0000", 2024-04-19T04:24:50.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836412+0000", 2024-04-19T04:24:50.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836412+0000", 2024-04-19T04:24:50.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836460+0000", 2024-04-19T04:24:50.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8315000000000001e-05 2024-04-19T04:24:50.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836469+0000", 2024-04-19T04:24:50.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4520000000000003e-06 2024-04-19T04:24:50.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836477+0000", 2024-04-19T04:24:50.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.542e-06 2024-04-19T04:24:50.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836536+0000", 2024-04-19T04:24:50.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9579e-05 2024-04-19T04:24:50.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836737+0000", 2024-04-19T04:24:50.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000200776 2024-04-19T04:24:50.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:50.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836928+0000", 2024-04-19T04:24:50.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019054099999999999 2024-04-19T04:24:50.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.841782+0000", 2024-04-19T04:24:50.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048537820000000001 2024-04-19T04:24:50.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.850861+0000", 2024-04-19T04:24:50.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090793780000000008 2024-04-19T04:24:50.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.850901+0000", 2024-04-19T04:24:50.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9953000000000002e-05 2024-04-19T04:24:50.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.850956+0000", 2024-04-19T04:24:50.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5195999999999998e-05 2024-04-19T04:24:50.573 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.573 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.573 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.573 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:14913 5.d 5:be9d6cf9:::benchmark_data_smithi007_19526_object14912:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:50.574 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:49.872917+0000", 2024-04-19T04:24:50.574 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.594652501, 2024-04-19T04:24:50.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011960317, 2024-04-19T04:24:50.574 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.574 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.574 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:50.574 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:50.574 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.574 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 14913 2024-04-19T04:24:50.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.574 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.872917+0000", 2024-04-19T04:24:50.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.872917+0000", 2024-04-19T04:24:50.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.872916+0000", 2024-04-19T04:24:50.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:50.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.872974+0000", 2024-04-19T04:24:50.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8118999999999997e-05 2024-04-19T04:24:50.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.872992+0000", 2024-04-19T04:24:50.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7884e-05 2024-04-19T04:24:50.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.873002+0000", 2024-04-19T04:24:50.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7680000000000003e-06 2024-04-19T04:24:50.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.873621+0000", 2024-04-19T04:24:50.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00061912399999999998 2024-04-19T04:24:50.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.873752+0000", 2024-04-19T04:24:50.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000130786 2024-04-19T04:24:50.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:50.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.873866+0000", 2024-04-19T04:24:50.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000113949 2024-04-19T04:24:50.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.875721+0000", 2024-04-19T04:24:50.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0018550089999999999 2024-04-19T04:24:50.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.884808+0000", 2024-04-19T04:24:50.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090871240000000002 2024-04-19T04:24:50.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.884841+0000", 2024-04-19T04:24:50.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3253000000000002e-05 2024-04-19T04:24:50.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.884878+0000", 2024-04-19T04:24:50.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6740999999999999e-05 2024-04-19T04:24:50.579 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.579 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.579 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.579 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:14970 5.8 5:1cd5ae5d:::benchmark_data_smithi007_19526_object14969:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:50.579 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:49.896839+0000", 2024-04-19T04:24:50.579 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.57073140600000005, 2024-04-19T04:24:50.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012193315999999999, 2024-04-19T04:24:50.579 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:50.579 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:50.579 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:50.579 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:50.580 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.580 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 14970 2024-04-19T04:24:50.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.580 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:50.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:50.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.896839+0000", 2024-04-19T04:24:50.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:50.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.896839+0000", 2024-04-19T04:24:50.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:50.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:50.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.896838+0000", 2024-04-19T04:24:50.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:50.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:50.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.896989+0000", 2024-04-19T04:24:50.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000151209 2024-04-19T04:24:50.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:50.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.897002+0000", 2024-04-19T04:24:50.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2991e-05 2024-04-19T04:24:50.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.897010+0000", 2024-04-19T04:24:50.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2689999999999999e-06 2024-04-19T04:24:50.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:50.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.897065+0000", 2024-04-19T04:24:50.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4419999999999997e-05 2024-04-19T04:24:50.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:50.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.897179+0000", 2024-04-19T04:24:50.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114261 2024-04-19T04:24:50.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:50.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.897331+0000", 2024-04-19T04:24:50.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015142899999999999 2024-04-19T04:24:50.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:50.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.902168+0000", 2024-04-19T04:24:50.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048375249999999996 2024-04-19T04:24:50.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:50.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.908919+0000", 2024-04-19T04:24:50.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0067506290000000002 2024-04-19T04:24:50.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:50.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.908983+0000", 2024-04-19T04:24:50.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4282000000000006e-05 2024-04-19T04:24:50.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:50.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:50.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:50.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.909032+0000", 2024-04-19T04:24:50.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8882999999999999e-05 2024-04-19T04:24:50.585 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.585 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.585 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.585 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:50.585 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:50.585 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:24:50.587 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:24:50.587 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:50.582+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:50.687 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:50.682+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:50.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T04:24:50.715 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:50.715 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:24:50.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.715 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:17107 5.7 5:e59cb6b2:::benchmark_data_smithi007_19526_object17106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:50.715 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:50.713168+0000", 2024-04-19T04:24:50.715 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.002323182, 2024-04-19T04:24:50.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023458110000000002, 2024-04-19T04:24:50.715 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:50.715 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:50.715 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:50.716 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:50.716 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.716 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 17107 2024-04-19T04:24:50.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.716 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:50.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:50.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713168+0000", 2024-04-19T04:24:50.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:50.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:50.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713168+0000", 2024-04-19T04:24:50.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:50.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:50.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713166+0000", 2024-04-19T04:24:50.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:50.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:50.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713275+0000", 2024-04-19T04:24:50.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010901800000000001 2024-04-19T04:24:50.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:50.718 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713292+0000", 2024-04-19T04:24:50.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6396999999999999e-05 2024-04-19T04:24:50.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.718 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.718 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713301+0000", 2024-04-19T04:24:50.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.4939999999999992e-06 2024-04-19T04:24:50.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.718 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:50.718 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713365+0000", 2024-04-19T04:24:50.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:24:50.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.719 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:50.719 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713537+0000", 2024-04-19T04:24:50.719 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000172184 2024-04-19T04:24:50.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.719 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:50.719 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713688+0000", 2024-04-19T04:24:50.719 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0001515 2024-04-19T04:24:50.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.719 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:50.719 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.715126+0000", 2024-04-19T04:24:50.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001438188 2024-04-19T04:24:50.720 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:50.720 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:50.720 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:50.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.720 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:17108 5.2 5:4757cb85:::benchmark_data_smithi007_19526_object17107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:50.720 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:50.713321+0000", 2024-04-19T04:24:50.720 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0021695519999999999, 2024-04-19T04:24:50.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0022947879999999999, 2024-04-19T04:24:50.720 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:50.720 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:50.720 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:50.720 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:50.721 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.721 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 17108 2024-04-19T04:24:50.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.721 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:50.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:50.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713321+0000", 2024-04-19T04:24:50.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:50.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:50.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713321+0000", 2024-04-19T04:24:50.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:50.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.722 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:50.722 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713321+0000", 2024-04-19T04:24:50.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.722 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:50.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713376+0000", 2024-04-19T04:24:50.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5384999999999999e-05 2024-04-19T04:24:50.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:50.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713392+0000", 2024-04-19T04:24:50.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6098000000000001e-05 2024-04-19T04:24:50.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713397+0000", 2024-04-19T04:24:50.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.028e-06 2024-04-19T04:24:50.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:50.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713448+0000", 2024-04-19T04:24:50.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0680999999999998e-05 2024-04-19T04:24:50.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:50.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713590+0000", 2024-04-19T04:24:50.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000142335 2024-04-19T04:24:50.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:50.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713724+0000", 2024-04-19T04:24:50.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013406 2024-04-19T04:24:50.725 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:50.725 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:50.726 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:50.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.726 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:17111 5.9 5:92097772:::benchmark_data_smithi007_19526_object17110:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:50.726 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:50.713448+0000", 2024-04-19T04:24:50.726 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0020429139999999998, 2024-04-19T04:24:50.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0022324649999999999, 2024-04-19T04:24:50.726 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:50.726 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:50.726 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:50.726 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:50.726 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.726 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 17111 2024-04-19T04:24:50.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.727 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:50.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:50.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713448+0000", 2024-04-19T04:24:50.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:50.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:50.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713448+0000", 2024-04-19T04:24:50.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:50.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:50.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713447+0000", 2024-04-19T04:24:50.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:50.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:50.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713548+0000", 2024-04-19T04:24:50.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000100393 2024-04-19T04:24:50.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:50.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713555+0000", 2024-04-19T04:24:50.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5660000000000001e-06 2024-04-19T04:24:50.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713560+0000", 2024-04-19T04:24:50.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.651e-06 2024-04-19T04:24:50.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:50.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713604+0000", 2024-04-19T04:24:50.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3776000000000002e-05 2024-04-19T04:24:50.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:50.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713699+0000", 2024-04-19T04:24:50.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.4779999999999997e-05 2024-04-19T04:24:50.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.730 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:50.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.713799+0000", 2024-04-19T04:24:50.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000100216 2024-04-19T04:24:50.730 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:50.730 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:50.730 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:50.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.730 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:17112 5.9 5:9f8a5de6:::benchmark_data_smithi007_19526_object17111:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:50.730 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:50.715341+0000", 2024-04-19T04:24:50.731 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.000149782, 2024-04-19T04:24:50.731 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00038477699999999999, 2024-04-19T04:24:50.731 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:50.731 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:50.731 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:50.731 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:50.731 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:50.731 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 17112 2024-04-19T04:24:50.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.731 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:50.731 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.731 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:50.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.715341+0000", 2024-04-19T04:24:50.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:50.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:50.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.715341+0000", 2024-04-19T04:24:50.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:50.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:50.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.715340+0000", 2024-04-19T04:24:50.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:50.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:50.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.715432+0000", 2024-04-19T04:24:50.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1909000000000004e-05 2024-04-19T04:24:50.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:50.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.715450+0000", 2024-04-19T04:24:50.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8308000000000002e-05 2024-04-19T04:24:50.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:50.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.715458+0000", 2024-04-19T04:24:50.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8900000000000007e-06 2024-04-19T04:24:50.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:50.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.715517+0000", 2024-04-19T04:24:50.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8709000000000003e-05 2024-04-19T04:24:50.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:50.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:50.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:50.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:50.715669+0000", 2024-04-19T04:24:50.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152385 2024-04-19T04:24:50.735 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:50.735 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:50.735 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:50.735 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:50.735 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:24:50.735 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 4 2024-04-19T04:24:50.736 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:50.737 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:24:50.750 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 6 16 17226 17210 179.251 165 0.00514781 0.00557073 2024-04-19T04:24:50.787 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:50.787+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:50.867 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:24:50.867 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:50.868 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:24:50.868 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:24:50.868 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:24:50.868 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:50.880 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:24:50.888 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:50.887+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:50.990 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:50.983+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:51.009 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:24:51.014 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:51.015 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:51.028 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:24:51.031 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-04-19T04:24:51.051 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:24:51.053 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:24:51.054 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T04:24:51.054 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:24:51.091 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:51.087+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:51.165 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:51.165 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:51.179 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:24:51.192 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:51.191+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:51.293 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:51.290+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:51.312 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:51.312 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:51.324 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:24:51.395 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:51.395+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:51.458 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:51.458 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:51.470 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:24:51.496 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:51.494+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:51.598 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:51.594+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:51.599 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:51.600 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:51.613 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:24:51.692 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-04-19T04:24:51.698 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:51.699+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:51.727 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:51.727 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:51.738 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:24:51.750 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 7 16 19909 19893 177.596 167.688 0.00389162 0.00562342 2024-04-19T04:24:51.799 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:51.799+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:51.859 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:51.859 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:51.871 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:24:51.917 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:51.914+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:52.001 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:51.999+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:52.011 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:52.011 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:52.024 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:24:52.103 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:52.103+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:52.159 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:52.159 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:52.170 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:24:52.204 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:52.203+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:52.302 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:52.303 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:52.305 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:52.302+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:52.315 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:24:52.406 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:52.407+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:52.451 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:52.451 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:52.466 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:24:52.506 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:52.502+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:52.595 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:52.595 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:52.607 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:24:52.608 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:52.602+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:52.708 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:52.702+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:52.739 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:52.740 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:52.750 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 8 15 22475 22460 175.448 160.438 0.00819586 0.00569168 2024-04-19T04:24:52.752 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:24:52.808 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:52.807+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:52.881 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:52.882 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:52.893 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:24:52.909 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:52.903+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:53.010 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:53.003+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:53.017 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:53.017 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:53.029 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:24:53.065 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:24:53.111 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:53.111+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:53.150 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:53.151 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:53.163 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:24:53.213 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:53.211+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:53.226 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:24:53.250 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-04-19T04:24:53.271 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:24:53.273 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:24:53.274 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T04:24:53.274 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:24:53.293 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:53.294 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:24:53.294 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.294 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:23843 5.2 5:4593486a:::benchmark_data_smithi007_19526_object23842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:53.294 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:53.287460+0000", 2024-04-19T04:24:53.294 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0054336599999999999, 2024-04-19T04:24:53.294 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0054546339999999999, 2024-04-19T04:24:53.294 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.294 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:53.295 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:53.295 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:53.295 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:53.295 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 23843 2024-04-19T04:24:53.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.295 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.295 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.295 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.287460+0000", 2024-04-19T04:24:53.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.287460+0000", 2024-04-19T04:24:53.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.297 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.287458+0000", 2024-04-19T04:24:53.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:53.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.297 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.297 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.287518+0000", 2024-04-19T04:24:53.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9083000000000003e-05 2024-04-19T04:24:53.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.298 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.287530+0000", 2024-04-19T04:24:53.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2816000000000001e-05 2024-04-19T04:24:53.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.298 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.287539+0000", 2024-04-19T04:24:53.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2470000000000008e-06 2024-04-19T04:24:53.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.299 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.299 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.287589+0000", 2024-04-19T04:24:53.299 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9925000000000001e-05 2024-04-19T04:24:53.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.299 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.299 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.287724+0000", 2024-04-19T04:24:53.299 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013589099999999999 2024-04-19T04:24:53.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:53.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.287890+0000", 2024-04-19T04:24:53.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016557 2024-04-19T04:24:53.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.291909+0000", 2024-04-19T04:24:53.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040191430000000002 2024-04-19T04:24:53.301 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.301 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.301 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.301 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:23849 5.1 5:846f26e9:::benchmark_data_smithi007_19526_object23848:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:53.301 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:53.288572+0000", 2024-04-19T04:24:53.301 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0043210239999999997, 2024-04-19T04:24:53.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.004403957, 2024-04-19T04:24:53.301 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.302 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:53.302 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:53.302 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:53.302 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:53.302 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 23849 2024-04-19T04:24:53.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.302 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.288572+0000", 2024-04-19T04:24:53.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.288572+0000", 2024-04-19T04:24:53.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.304 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.288572+0000", 2024-04-19T04:24:53.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.304 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.304 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.288631+0000", 2024-04-19T04:24:53.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9713000000000002e-05 2024-04-19T04:24:53.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.288643+0000", 2024-04-19T04:24:53.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1738e-05 2024-04-19T04:24:53.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.288648+0000", 2024-04-19T04:24:53.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9389999999999996e-06 2024-04-19T04:24:53.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.288724+0000", 2024-04-19T04:24:53.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5950000000000003e-05 2024-04-19T04:24:53.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.288870+0000", 2024-04-19T04:24:53.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145816 2024-04-19T04:24:53.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:53.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.288983+0000", 2024-04-19T04:24:53.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113737 2024-04-19T04:24:53.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.291280+0000", 2024-04-19T04:24:53.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0022962109999999998 2024-04-19T04:24:53.307 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.307 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.307 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.307 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:23850 5.7 5:e2dc7854:::benchmark_data_smithi007_19526_object23849:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:53.307 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:53.290323+0000", 2024-04-19T04:24:53.307 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0025702440000000002, 2024-04-19T04:24:53.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027398309999999999, 2024-04-19T04:24:53.308 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.308 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:53.308 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:53.308 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:53.308 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:53.308 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 23850 2024-04-19T04:24:53.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.308 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290323+0000", 2024-04-19T04:24:53.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.309 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290323+0000", 2024-04-19T04:24:53.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.309 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290322+0000", 2024-04-19T04:24:53.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.309 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290402+0000", 2024-04-19T04:24:53.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.941e-05 2024-04-19T04:24:53.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290425+0000", 2024-04-19T04:24:53.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3195000000000001e-05 2024-04-19T04:24:53.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290433+0000", 2024-04-19T04:24:53.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1580000000000005e-06 2024-04-19T04:24:53.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290492+0000", 2024-04-19T04:24:53.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9376999999999997e-05 2024-04-19T04:24:53.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290671+0000", 2024-04-19T04:24:53.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000178643 2024-04-19T04:24:53.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:53.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290829+0000", 2024-04-19T04:24:53.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015790499999999999 2024-04-19T04:24:53.312 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.312 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.312 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.312 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:23851 5.2 5:4c8346c9:::benchmark_data_smithi007_19526_object23850:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:53.312 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:53.290490+0000", 2024-04-19T04:24:53.312 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0024035269999999999, 2024-04-19T04:24:53.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026631900000000002, 2024-04-19T04:24:53.312 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.312 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:53.312 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:53.313 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:53.313 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:53.313 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 23851 2024-04-19T04:24:53.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.313 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290490+0000", 2024-04-19T04:24:53.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290490+0000", 2024-04-19T04:24:53.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290489+0000", 2024-04-19T04:24:53.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:53.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290574+0000", 2024-04-19T04:24:53.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4660999999999995e-05 2024-04-19T04:24:53.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290581+0000", 2024-04-19T04:24:53.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.686e-06 2024-04-19T04:24:53.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290585+0000", 2024-04-19T04:24:53.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.391e-06 2024-04-19T04:24:53.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290629+0000", 2024-04-19T04:24:53.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.384e-05 2024-04-19T04:24:53.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.316 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290771+0000", 2024-04-19T04:24:53.316 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014255100000000001 2024-04-19T04:24:53.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.316 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:53.316 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290904+0000", 2024-04-19T04:24:53.316 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013228599999999999 2024-04-19T04:24:53.316 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.316 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.316 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.316 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:23853 5.9 5:9b03a23a:::benchmark_data_smithi007_19526_object23852:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:53.316 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:53.290931+0000", 2024-04-19T04:24:53.317 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0019625889999999998, 2024-04-19T04:24:53.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023075539999999999, 2024-04-19T04:24:53.317 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.317 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:53.317 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:53.317 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:53.317 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:53.317 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 23853 2024-04-19T04:24:53.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.317 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.317 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.317 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290931+0000", 2024-04-19T04:24:53.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290931+0000", 2024-04-19T04:24:53.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290928+0000", 2024-04-19T04:24:53.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999971 2024-04-19T04:24:53.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.319 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290983+0000", 2024-04-19T04:24:53.319 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5285999999999999e-05 2024-04-19T04:24:53.319 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.319 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.319 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.319 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.290997+0000", 2024-04-19T04:24:53.319 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3794e-05 2024-04-19T04:24:53.319 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.319 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.319 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.319 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.291003+0000", 2024-04-19T04:24:53.319 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:24:53.319 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.319 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.320 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.320 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.291073+0000", 2024-04-19T04:24:53.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9227999999999995e-05 2024-04-19T04:24:53.320 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.320 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.320 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.320 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.291320+0000", 2024-04-19T04:24:53.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00024775099999999999 2024-04-19T04:24:53.320 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.320 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.320 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:53.320 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.291545+0000", 2024-04-19T04:24:53.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000224432 2024-04-19T04:24:53.320 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.321 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.321 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.321 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.321 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.321 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:23860 5.1 5:81d47799:::benchmark_data_smithi007_19526_object23859:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:53.321 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:53.292776+0000", 2024-04-19T04:24:53.321 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.000117224, 2024-04-19T04:24:53.321 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00056181500000000001, 2024-04-19T04:24:53.321 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.321 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:53.321 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:53.321 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:53.321 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:53.321 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 23860 2024-04-19T04:24:53.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.322 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.322 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.322 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.322 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.292776+0000", 2024-04-19T04:24:53.322 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.322 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.322 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.322 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.292776+0000", 2024-04-19T04:24:53.322 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.322 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.322 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.323 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.292775+0000", 2024-04-19T04:24:53.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.323 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.323 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.323 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.292892+0000", 2024-04-19T04:24:53.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011636199999999999 2024-04-19T04:24:53.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.323 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.323 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.323 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.292917+0000", 2024-04-19T04:24:53.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4854999999999998e-05 2024-04-19T04:24:53.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.324 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.324 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.324 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.292929+0000", 2024-04-19T04:24:53.324 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2716e-05 2024-04-19T04:24:53.324 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.325 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.325 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.292976+0000", 2024-04-19T04:24:53.325 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6795000000000002e-05 2024-04-19T04:24:53.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.325 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.325 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293127+0000", 2024-04-19T04:24:53.325 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150903 2024-04-19T04:24:53.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.325 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:53.325 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293248+0000", 2024-04-19T04:24:53.325 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012098400000000001 2024-04-19T04:24:53.326 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.326 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.326 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.326 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.326 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.326 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:23849 5.1 e27/20)", 2024-04-19T04:24:53.326 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:53.292983+0000", 2024-04-19T04:24:53.326 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9999099, 2024-04-19T04:24:53.326 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00044363699999999998, 2024-04-19T04:24:53.326 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.326 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:24:53.326 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.326 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.327 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.327 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.292983+0000", 2024-04-19T04:24:53.327 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.327 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.327 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.292983+0000", 2024-04-19T04:24:53.327 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.327 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.327 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.292983+0000", 2024-04-19T04:24:53.327 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:53.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.292988+0000", 2024-04-19T04:24:53.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6389999999999997e-06 2024-04-19T04:24:53.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293036+0000", 2024-04-19T04:24:53.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7187000000000001e-05 2024-04-19T04:24:53.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293043+0000", 2024-04-19T04:24:53.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4240000000000004e-06 2024-04-19T04:24:53.329 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.329 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.329 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.329 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.329 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:23856 5.c e27/20 5:3062bb10:::benchmark_data_smithi007_19526_object23855:head v 27'1419, mlcod=27'1417)", 2024-04-19T04:24:53.329 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:53.293077+0000", 2024-04-19T04:24:53.329 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9998169, 2024-04-19T04:24:53.329 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00045265300000000002, 2024-04-19T04:24:53.329 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.329 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:53.329 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.329 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293077+0000", 2024-04-19T04:24:53.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.330 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293077+0000", 2024-04-19T04:24:53.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.330 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293076+0000", 2024-04-19T04:24:53.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:53.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293121+0000", 2024-04-19T04:24:53.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4956999999999997e-05 2024-04-19T04:24:53.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293130+0000", 2024-04-19T04:24:53.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1349999999999998e-06 2024-04-19T04:24:53.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293136+0000", 2024-04-19T04:24:53.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4929999999999998e-06 2024-04-19T04:24:53.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.332 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.332 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293179+0000", 2024-04-19T04:24:53.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3475e-05 2024-04-19T04:24:53.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.332 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.332 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293199+0000", 2024-04-19T04:24:53.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9613e-05 2024-04-19T04:24:53.332 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.332 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.332 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.333 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:23857 5.6 e27/20 5:65e08cba:::benchmark_data_smithi007_19526_object23856:head v 27'1513, mlcod=27'1511)", 2024-04-19T04:24:53.333 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:53.293150+0000", 2024-04-19T04:24:53.333 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9997435, 2024-04-19T04:24:53.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00044014299999999999, 2024-04-19T04:24:53.333 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.333 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:53.333 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.333 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293150+0000", 2024-04-19T04:24:53.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293150+0000", 2024-04-19T04:24:53.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293150+0000", 2024-04-19T04:24:53.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:53.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293180+0000", 2024-04-19T04:24:53.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.0505e-05 2024-04-19T04:24:53.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293189+0000", 2024-04-19T04:24:53.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2380000000000003e-06 2024-04-19T04:24:53.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293195+0000", 2024-04-19T04:24:53.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3519999999999997e-06 2024-04-19T04:24:53.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293250+0000", 2024-04-19T04:24:53.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5310999999999999e-05 2024-04-19T04:24:53.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293283+0000", 2024-04-19T04:24:53.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2678999999999997e-05 2024-04-19T04:24:53.336 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.336 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.336 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.336 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:23859 5.5 e27/20 5:afb4deab:::benchmark_data_smithi007_19526_object23858:head v 27'1498, mlcod=27'1496)", 2024-04-19T04:24:53.336 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:53.293229+0000", 2024-04-19T04:24:53.336 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9996643, 2024-04-19T04:24:53.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00043621300000000002, 2024-04-19T04:24:53.337 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.337 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:53.337 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.337 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.337 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293229+0000", 2024-04-19T04:24:53.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.337 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.337 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293229+0000", 2024-04-19T04:24:53.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.338 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.338 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293229+0000", 2024-04-19T04:24:53.338 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:53.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.338 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.338 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293299+0000", 2024-04-19T04:24:53.338 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0555000000000005e-05 2024-04-19T04:24:53.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.338 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.338 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293308+0000", 2024-04-19T04:24:53.338 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6969999999999999e-06 2024-04-19T04:24:53.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293315+0000", 2024-04-19T04:24:53.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8759999999999999e-06 2024-04-19T04:24:53.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293437+0000", 2024-04-19T04:24:53.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012256600000000001 2024-04-19T04:24:53.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:53.293457+0000", 2024-04-19T04:24:53.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9871e-05 2024-04-19T04:24:53.339 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.340 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.340 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.340 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.340 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:24:53.340 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 10 2024-04-19T04:24:53.340 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:53.341 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:53.339+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:53.342 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:24:53.443 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:53.439+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:53.467 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:53.468 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:24:53.468 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:24:53.468 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:24:53.468 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:53.479 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:24:53.544 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:53.539+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:53.618 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:53.618 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:24:53.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:24:53.618 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:24:53.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.618 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4159.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-04-19T04:24:53.618 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:11.119346+0000", 2024-04-19T04:24:53.618 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 42.496723068000001, 2024-04-19T04:24:53.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019667567, 2024-04-19T04:24:53.619 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.619 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.619 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:53.619 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4159", 2024-04-19T04:24:53.619 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/1235519030", 2024-04-19T04:24:53.619 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 189 2024-04-19T04:24:53.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.619 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119346+0000", 2024-04-19T04:24:53.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119346+0000", 2024-04-19T04:24:53.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119345+0000", 2024-04-19T04:24:53.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:53.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119353+0000", 2024-04-19T04:24:53.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.396e-06 2024-04-19T04:24:53.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119361+0000", 2024-04-19T04:24:53.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9130000000000003e-06 2024-04-19T04:24:53.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.119367+0000", 2024-04-19T04:24:53.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4500000000000001e-06 2024-04-19T04:24:53.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.135564+0000", 2024-04-19T04:24:53.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016196894999999999 2024-04-19T04:24:53.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.135679+0000", 2024-04-19T04:24:53.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114722 2024-04-19T04:24:53.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:53.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.135816+0000", 2024-04-19T04:24:53.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000137637 2024-04-19T04:24:53.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.138143+0000", 2024-04-19T04:24:53.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023263279999999999 2024-04-19T04:24:53.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.138920+0000", 2024-04-19T04:24:53.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000777515 2024-04-19T04:24:53.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.138969+0000", 2024-04-19T04:24:53.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8634999999999998e-05 2024-04-19T04:24:53.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:11.139014+0000", 2024-04-19T04:24:53.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4722999999999999e-05 2024-04-19T04:24:53.624 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.624 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.624 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.624 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.624 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:53.624 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.082333515999998, 2024-04-19T04:24:53.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026801078999999998, 2024-04-19T04:24:53.624 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.624 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.624 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:53.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:53.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533733+0000", 2024-04-19T04:24:53.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999976 2024-04-19T04:24:53.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533746+0000", 2024-04-19T04:24:53.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2679e-05 2024-04-19T04:24:53.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533769+0000", 2024-04-19T04:24:53.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2832000000000001e-05 2024-04-19T04:24:53.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:24:53.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0599999999999999e-05 2024-04-19T04:24:53.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533907+0000", 2024-04-19T04:24:53.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000118076 2024-04-19T04:24:53.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:53.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533919+0000", 2024-04-19T04:24:53.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1644999999999999e-05 2024-04-19T04:24:53.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553399+0000", 2024-04-19T04:24:53.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019479987000000001 2024-04-19T04:24:53.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553535+0000", 2024-04-19T04:24:53.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553400000000001 2024-04-19T04:24:53.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:53.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553696+0000", 2024-04-19T04:24:53.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000161068 2024-04-19T04:24:53.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558096+0000", 2024-04-19T04:24:53.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0043998880000000002 2024-04-19T04:24:53.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560465+0000", 2024-04-19T04:24:53.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023695159999999999 2024-04-19T04:24:53.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560513+0000", 2024-04-19T04:24:53.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7899000000000003e-05 2024-04-19T04:24:53.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560537+0000", 2024-04-19T04:24:53.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3768e-05 2024-04-19T04:24:53.630 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.630 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.630 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.630 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.630 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:53.630 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.082256442000002, 2024-04-19T04:24:53.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026864505, 2024-04-19T04:24:53.631 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.631 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.631 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:53.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:53.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533812+0000", 2024-04-19T04:24:53.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533818+0000", 2024-04-19T04:24:53.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2369999999999997e-06 2024-04-19T04:24:53.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533863+0000", 2024-04-19T04:24:53.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4515000000000003e-05 2024-04-19T04:24:53.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533880+0000", 2024-04-19T04:24:53.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7119e-05 2024-04-19T04:24:53.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534029+0000", 2024-04-19T04:24:53.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014955099999999999 2024-04-19T04:24:53.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:53.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534034+0000", 2024-04-19T04:24:53.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1649999999999997e-06 2024-04-19T04:24:53.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554888+0000", 2024-04-19T04:24:53.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020854075 2024-04-19T04:24:53.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554967+0000", 2024-04-19T04:24:53.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8209999999999998e-05 2024-04-19T04:24:53.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:53.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555087+0000", 2024-04-19T04:24:53.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000120411 2024-04-19T04:24:53.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559328+0000", 2024-04-19T04:24:53.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042409800000000001 2024-04-19T04:24:53.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560587+0000", 2024-04-19T04:24:53.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012587119999999999 2024-04-19T04:24:53.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560620+0000", 2024-04-19T04:24:53.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2716999999999999e-05 2024-04-19T04:24:53.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560677+0000", 2024-04-19T04:24:53.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7726999999999998e-05 2024-04-19T04:24:53.636 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.636 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.636 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.636 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.636 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:53.636 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.082174049000002, 2024-04-19T04:24:53.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027363064999999999, 2024-04-19T04:24:53.637 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.637 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.637 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:53.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:53.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533894+0000", 2024-04-19T04:24:53.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:53.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533913+0000", 2024-04-19T04:24:53.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8896e-05 2024-04-19T04:24:53.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533933+0000", 2024-04-19T04:24:53.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9775e-05 2024-04-19T04:24:53.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533967+0000", 2024-04-19T04:24:53.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4536000000000003e-05 2024-04-19T04:24:53.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:53.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553600000000001 2024-04-19T04:24:53.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:53.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534107+0000", 2024-04-19T04:24:53.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1470000000000003e-06 2024-04-19T04:24:53.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556463+0000", 2024-04-19T04:24:53.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022356536999999999 2024-04-19T04:24:53.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556586+0000", 2024-04-19T04:24:53.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122967 2024-04-19T04:24:53.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:53.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556738+0000", 2024-04-19T04:24:53.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015182800000000001 2024-04-19T04:24:53.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561020+0000", 2024-04-19T04:24:53.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042818819999999999 2024-04-19T04:24:53.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561183+0000", 2024-04-19T04:24:53.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000162683 2024-04-19T04:24:53.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.642 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.642 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561226+0000", 2024-04-19T04:24:53.642 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3686000000000002e-05 2024-04-19T04:24:53.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.642 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.642 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561258+0000", 2024-04-19T04:24:53.642 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1814999999999999e-05 2024-04-19T04:24:53.642 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.642 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.642 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.643 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.643 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.643 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.643 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:53.643 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.082083535999999, 2024-04-19T04:24:53.643 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027417816000000001, 2024-04-19T04:24:53.643 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.643 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.643 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.643 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.643 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.643 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:53.643 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.643 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:53.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533984+0000", 2024-04-19T04:24:53.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:53.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:53.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3876000000000001e-05 2024-04-19T04:24:53.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534015+0000", 2024-04-19T04:24:53.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6818999999999999e-05 2024-04-19T04:24:53.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534030+0000", 2024-04-19T04:24:53.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.537e-05 2024-04-19T04:24:53.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534152+0000", 2024-04-19T04:24:53.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121685 2024-04-19T04:24:53.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:53.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534156+0000", 2024-04-19T04:24:53.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9029999999999997e-06 2024-04-19T04:24:53.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557520+0000", 2024-04-19T04:24:53.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023364125999999999 2024-04-19T04:24:53.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.647 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.647 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557585+0000", 2024-04-19T04:24:53.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5275000000000001e-05 2024-04-19T04:24:53.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.647 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:53.647 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557719+0000", 2024-04-19T04:24:53.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013396299999999999 2024-04-19T04:24:53.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.648 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.648 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.648 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561133+0000", 2024-04-19T04:24:53.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034140989999999999 2024-04-19T04:24:53.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.648 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.648 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.648 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561352+0000", 2024-04-19T04:24:53.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0002185 2024-04-19T04:24:53.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.648 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.648 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.648 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561380+0000", 2024-04-19T04:24:53.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8317999999999999e-05 2024-04-19T04:24:53.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.649 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.649 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561403+0000", 2024-04-19T04:24:53.649 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3264999999999998e-05 2024-04-19T04:24:53.649 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.649 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.649 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.649 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.649 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:53.649 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.082019891000002, 2024-04-19T04:24:53.649 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029897119999999999, 2024-04-19T04:24:53.649 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.649 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.650 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:53.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:53.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534048+0000", 2024-04-19T04:24:53.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534057+0000", 2024-04-19T04:24:53.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7930000000000003e-06 2024-04-19T04:24:53.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.652 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534075+0000", 2024-04-19T04:24:53.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7846000000000002e-05 2024-04-19T04:24:53.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.652 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534089+0000", 2024-04-19T04:24:53.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4463e-05 2024-04-19T04:24:53.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534198+0000", 2024-04-19T04:24:53.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109145 2024-04-19T04:24:53.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:53.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534202+0000", 2024-04-19T04:24:53.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.98e-06 2024-04-19T04:24:53.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558221+0000", 2024-04-19T04:24:53.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024018208999999999 2024-04-19T04:24:53.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.654 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.654 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558320+0000", 2024-04-19T04:24:53.654 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9642000000000006e-05 2024-04-19T04:24:53.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.654 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:53.654 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558401+0000", 2024-04-19T04:24:53.654 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1038000000000006e-05 2024-04-19T04:24:53.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.654 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.654 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561173+0000", 2024-04-19T04:24:53.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027714549999999999 2024-04-19T04:24:53.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563851+0000", 2024-04-19T04:24:53.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026786010000000001 2024-04-19T04:24:53.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563906+0000", 2024-04-19T04:24:53.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4895999999999998e-05 2024-04-19T04:24:53.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563946+0000", 2024-04-19T04:24:53.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0116e-05 2024-04-19T04:24:53.656 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.656 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.656 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.656 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.656 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:53.656 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.081966510000001, 2024-04-19T04:24:53.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029917846000000001, 2024-04-19T04:24:53.656 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.656 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.656 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:53.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:53.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534101+0000", 2024-04-19T04:24:53.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:53.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534111+0000", 2024-04-19T04:24:53.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5659999999999996e-06 2024-04-19T04:24:53.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534129+0000", 2024-04-19T04:24:53.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7632999999999999e-05 2024-04-19T04:24:53.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534143+0000", 2024-04-19T04:24:53.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4362000000000001e-05 2024-04-19T04:24:53.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534256+0000", 2024-04-19T04:24:53.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113267 2024-04-19T04:24:53.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:53.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534260+0000", 2024-04-19T04:24:53.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9949999999999999e-06 2024-04-19T04:24:53.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558653+0000", 2024-04-19T04:24:53.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024393182999999999 2024-04-19T04:24:53.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558704+0000", 2024-04-19T04:24:53.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0303999999999998e-05 2024-04-19T04:24:53.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:53.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558782+0000", 2024-04-19T04:24:53.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8079999999999998e-05 2024-04-19T04:24:53.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561309+0000", 2024-04-19T04:24:53.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002527708 2024-04-19T04:24:53.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563952+0000", 2024-04-19T04:24:53.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026425450000000001 2024-04-19T04:24:53.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563996+0000", 2024-04-19T04:24:53.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3606000000000002e-05 2024-04-19T04:24:53.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.662 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.662 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564021+0000", 2024-04-19T04:24:53.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.491e-05 2024-04-19T04:24:53.662 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.662 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.662 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.662 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.662 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:53.662 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.081913999000001, 2024-04-19T04:24:53.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:24:53.662 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.663 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.663 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:53.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:53.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:24:53.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:24:53.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:24:53.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:24:53.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:24:53.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:24:53.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:24:53.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:24:53.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:24:53.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:53.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:24:53.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:24:53.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:24:53.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:24:53.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:24:53.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:24:53.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:53.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:24:53.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:24:53.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:24:53.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:24:53.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:24:53.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:24:53.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:24:53.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:24:53.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:24:53.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:24:53.668 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.668 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.668 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.668 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.669 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:53.669 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.081859454000003, 2024-04-19T04:24:53.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:24:53.669 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.669 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.669 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:53.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:53.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:24:53.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:24:53.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:24:53.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:24:53.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:24:53.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:24:53.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:24:53.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:24:53.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:24:53.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:53.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:24:53.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:24:53.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:24:53.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:24:53.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:24:53.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:24:53.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:53.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:24:53.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:24:53.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:24:53.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:24:53.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:24:53.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:24:53.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.674 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:24:53.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:24:53.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.674 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.674 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:24:53.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:24:53.674 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.674 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.674 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.675 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.675 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534259+0000", 2024-04-19T04:24:53.675 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.081810046000001, 2024-04-19T04:24:53.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026049582000000002, 2024-04-19T04:24:53.675 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.675 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.675 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534259+0000", 2024-04-19T04:24:53.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534259+0000", 2024-04-19T04:24:53.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534258+0000", 2024-04-19T04:24:53.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534266+0000", 2024-04-19T04:24:53.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5870000000000004e-06 2024-04-19T04:24:53.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534281+0000", 2024-04-19T04:24:53.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5676e-05 2024-04-19T04:24:53.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534297+0000", 2024-04-19T04:24:53.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5458999999999999e-05 2024-04-19T04:24:53.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534379+0000", 2024-04-19T04:24:53.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2667e-05 2024-04-19T04:24:53.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:53.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534387+0000", 2024-04-19T04:24:53.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8900000000000007e-06 2024-04-19T04:24:53.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.552640+0000", 2024-04-19T04:24:53.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.018252344 2024-04-19T04:24:53.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.552944+0000", 2024-04-19T04:24:53.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00030430000000000002 2024-04-19T04:24:53.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:53.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553088+0000", 2024-04-19T04:24:53.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143793 2024-04-19T04:24:53.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557028+0000", 2024-04-19T04:24:53.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0039397770000000002 2024-04-19T04:24:53.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560246+0000", 2024-04-19T04:24:53.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032184990000000001 2024-04-19T04:24:53.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560282+0000", 2024-04-19T04:24:53.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6168999999999999e-05 2024-04-19T04:24:53.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560309+0000", 2024-04-19T04:24:53.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6508000000000001e-05 2024-04-19T04:24:53.680 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.680 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.681 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.681 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.681 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534327+0000", 2024-04-19T04:24:53.681 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.081741876000002, 2024-04-19T04:24:53.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022180505999999999, 2024-04-19T04:24:53.681 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.681 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.681 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534327+0000", 2024-04-19T04:24:53.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534327+0000", 2024-04-19T04:24:53.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.683 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534326+0000", 2024-04-19T04:24:53.683 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:53.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.683 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534335+0000", 2024-04-19T04:24:53.683 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2359999999999993e-06 2024-04-19T04:24:53.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.683 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534348+0000", 2024-04-19T04:24:53.683 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2680000000000001e-05 2024-04-19T04:24:53.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.684 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.684 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534364+0000", 2024-04-19T04:24:53.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6249e-05 2024-04-19T04:24:53.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.684 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.684 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534424+0000", 2024-04-19T04:24:53.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9494999999999999e-05 2024-04-19T04:24:53.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.684 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:53.684 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534429+0000", 2024-04-19T04:24:53.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.536e-06 2024-04-19T04:24:53.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.549957+0000", 2024-04-19T04:24:53.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015528121000000001 2024-04-19T04:24:53.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550172+0000", 2024-04-19T04:24:53.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00021493400000000001 2024-04-19T04:24:53.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:53.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550371+0000", 2024-04-19T04:24:53.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019863899999999999 2024-04-19T04:24:53.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556311+0000", 2024-04-19T04:24:53.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0059402639999999998 2024-04-19T04:24:53.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.686 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556351+0000", 2024-04-19T04:24:53.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9932000000000003e-05 2024-04-19T04:24:53.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.686 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556464+0000", 2024-04-19T04:24:53.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113089 2024-04-19T04:24:53.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.687 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.687 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556508+0000", 2024-04-19T04:24:53.687 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3537e-05 2024-04-19T04:24:53.687 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.687 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.687 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.687 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.687 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.687 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.687 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534402+0000", 2024-04-19T04:24:53.687 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.081667244999998, 2024-04-19T04:24:53.687 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026426121, 2024-04-19T04:24:53.687 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.687 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.688 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534402+0000", 2024-04-19T04:24:53.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534402+0000", 2024-04-19T04:24:53.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534401+0000", 2024-04-19T04:24:53.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534423+0000", 2024-04-19T04:24:53.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2589e-05 2024-04-19T04:24:53.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534440+0000", 2024-04-19T04:24:53.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6175999999999999e-05 2024-04-19T04:24:53.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.690 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534448+0000", 2024-04-19T04:24:53.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0970000000000006e-06 2024-04-19T04:24:53.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.690 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534563+0000", 2024-04-19T04:24:53.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011575500000000001 2024-04-19T04:24:53.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.690 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:53.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534575+0000", 2024-04-19T04:24:53.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1199999999999999e-05 2024-04-19T04:24:53.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.691 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.691 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.691 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553676+0000", 2024-04-19T04:24:53.691 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019101098 2024-04-19T04:24:53.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.691 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.691 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.691 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553803+0000", 2024-04-19T04:24:53.691 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012747499999999999 2024-04-19T04:24:53.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.691 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.691 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:53.691 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553942+0000", 2024-04-19T04:24:53.691 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000138863 2024-04-19T04:24:53.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.692 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.692 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.692 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557090+0000", 2024-04-19T04:24:53.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003148283 2024-04-19T04:24:53.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.692 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.692 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.692 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560726+0000", 2024-04-19T04:24:53.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0036352530000000002 2024-04-19T04:24:53.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.692 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.692 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.692 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560784+0000", 2024-04-19T04:24:53.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8034e-05 2024-04-19T04:24:53.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.693 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.693 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560828+0000", 2024-04-19T04:24:53.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4418000000000001e-05 2024-04-19T04:24:53.693 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.693 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.693 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.693 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.694 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534469+0000", 2024-04-19T04:24:53.694 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.081600170999998, 2024-04-19T04:24:53.694 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023528199, 2024-04-19T04:24:53.694 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.694 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.694 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.694 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.694 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.694 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534469+0000", 2024-04-19T04:24:53.694 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.694 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.694 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.695 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.695 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534469+0000", 2024-04-19T04:24:53.695 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.695 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.695 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534468+0000", 2024-04-19T04:24:53.695 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.695 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.695 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534476+0000", 2024-04-19T04:24:53.695 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2199999999999992e-06 2024-04-19T04:24:53.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534493+0000", 2024-04-19T04:24:53.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6708999999999999e-05 2024-04-19T04:24:53.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534518+0000", 2024-04-19T04:24:53.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4803e-05 2024-04-19T04:24:53.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534601+0000", 2024-04-19T04:24:53.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3498000000000006e-05 2024-04-19T04:24:53.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:53.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534606+0000", 2024-04-19T04:24:53.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9949999999999996e-06 2024-04-19T04:24:53.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.549312+0000", 2024-04-19T04:24:53.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.014705993000000001 2024-04-19T04:24:53.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.698 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.698 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550221+0000", 2024-04-19T04:24:53.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00090864099999999996 2024-04-19T04:24:53.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.698 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.698 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:53.698 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550417+0000", 2024-04-19T04:24:53.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000196551 2024-04-19T04:24:53.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.698 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.698 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.698 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555547+0000", 2024-04-19T04:24:53.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0051299830000000003 2024-04-19T04:24:53.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.699 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.699 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557916+0000", 2024-04-19T04:24:53.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023689380000000001 2024-04-19T04:24:53.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.699 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.699 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557951+0000", 2024-04-19T04:24:53.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4771000000000003e-05 2024-04-19T04:24:53.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.700 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.700 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557997+0000", 2024-04-19T04:24:53.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6167e-05 2024-04-19T04:24:53.700 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.700 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.700 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.700 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.700 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534568+0000", 2024-04-19T04:24:53.700 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.081500937999998, 2024-04-19T04:24:53.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026371452, 2024-04-19T04:24:53.701 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.701 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.701 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534568+0000", 2024-04-19T04:24:53.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534568+0000", 2024-04-19T04:24:53.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534567+0000", 2024-04-19T04:24:53.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:53.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534578+0000", 2024-04-19T04:24:53.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.08e-05 2024-04-19T04:24:53.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534597+0000", 2024-04-19T04:24:53.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9245999999999998e-05 2024-04-19T04:24:53.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534607+0000", 2024-04-19T04:24:53.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.039e-05 2024-04-19T04:24:53.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534685+0000", 2024-04-19T04:24:53.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7297000000000002e-05 2024-04-19T04:24:53.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:53.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534691+0000", 2024-04-19T04:24:53.704 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5690000000000001e-06 2024-04-19T04:24:53.704 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.704 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.704 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.704 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554391+0000", 2024-04-19T04:24:53.704 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019699926999999999 2024-04-19T04:24:53.704 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.704 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.704 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.704 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554645+0000", 2024-04-19T04:24:53.705 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00025359599999999998 2024-04-19T04:24:53.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.705 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:53.705 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554947+0000", 2024-04-19T04:24:53.705 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00030229200000000001 2024-04-19T04:24:53.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.705 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.705 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557380+0000", 2024-04-19T04:24:53.705 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024329680000000002 2024-04-19T04:24:53.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.705 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560869+0000", 2024-04-19T04:24:53.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034894230000000002 2024-04-19T04:24:53.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560902+0000", 2024-04-19T04:24:53.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2710999999999999e-05 2024-04-19T04:24:53.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560940+0000", 2024-04-19T04:24:53.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.756e-05 2024-04-19T04:24:53.707 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.707 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.707 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.707 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.707 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534626+0000", 2024-04-19T04:24:53.707 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.081443583000002, 2024-04-19T04:24:53.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022377527000000001, 2024-04-19T04:24:53.707 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.707 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.707 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.708 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.708 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534626+0000", 2024-04-19T04:24:53.708 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.708 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.708 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.708 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534626+0000", 2024-04-19T04:24:53.708 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.708 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.708 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.708 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534624+0000", 2024-04-19T04:24:53.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:53.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.709 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.709 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.709 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534633+0000", 2024-04-19T04:24:53.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7590000000000003e-06 2024-04-19T04:24:53.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.709 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.709 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.709 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534643+0000", 2024-04-19T04:24:53.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0396e-05 2024-04-19T04:24:53.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.709 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.709 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534691+0000", 2024-04-19T04:24:53.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7735000000000003e-05 2024-04-19T04:24:53.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.710 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.710 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534775+0000", 2024-04-19T04:24:53.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4556999999999997e-05 2024-04-19T04:24:53.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.710 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.710 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:53.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534783+0000", 2024-04-19T04:24:53.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9230000000000002e-06 2024-04-19T04:24:53.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.549925+0000", 2024-04-19T04:24:53.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015141419999999999 2024-04-19T04:24:53.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550367+0000", 2024-04-19T04:24:53.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00044214500000000002 2024-04-19T04:24:53.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:53.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.550806+0000", 2024-04-19T04:24:53.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00043874799999999998 2024-04-19T04:24:53.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.712 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556642+0000", 2024-04-19T04:24:53.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0058363850000000004 2024-04-19T04:24:53.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.712 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556723+0000", 2024-04-19T04:24:53.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1383000000000003e-05 2024-04-19T04:24:53.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.712 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556775+0000", 2024-04-19T04:24:53.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1659999999999997e-05 2024-04-19T04:24:53.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.713 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.713 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.713 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557003+0000", 2024-04-19T04:24:53.713 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022796599999999999 2024-04-19T04:24:53.713 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.713 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.713 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.713 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.713 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.713 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534711+0000", 2024-04-19T04:24:53.714 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.081358475999998, 2024-04-19T04:24:53.714 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023431483999999999, 2024-04-19T04:24:53.714 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.714 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.714 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.714 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.714 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.714 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534711+0000", 2024-04-19T04:24:53.714 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.714 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534711+0000", 2024-04-19T04:24:53.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534710+0000", 2024-04-19T04:24:53.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534716+0000", 2024-04-19T04:24:53.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3430000000000001e-06 2024-04-19T04:24:53.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534728+0000", 2024-04-19T04:24:53.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1616e-05 2024-04-19T04:24:53.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534739+0000", 2024-04-19T04:24:53.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1416999999999999e-05 2024-04-19T04:24:53.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534812+0000", 2024-04-19T04:24:53.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.305e-05 2024-04-19T04:24:53.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:53.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534821+0000", 2024-04-19T04:24:53.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2329999999999995e-06 2024-04-19T04:24:53.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.548691+0000", 2024-04-19T04:24:53.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.013869375 2024-04-19T04:24:53.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.718 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.718 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.548892+0000", 2024-04-19T04:24:53.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00020125500000000001 2024-04-19T04:24:53.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.718 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:53.718 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.549719+0000", 2024-04-19T04:24:53.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000826935 2024-04-19T04:24:53.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.718 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.718 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555981+0000", 2024-04-19T04:24:53.719 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062615079999999998 2024-04-19T04:24:53.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.719 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.719 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557961+0000", 2024-04-19T04:24:53.719 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0019805339999999999 2024-04-19T04:24:53.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.719 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.719 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558028+0000", 2024-04-19T04:24:53.719 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6987000000000001e-05 2024-04-19T04:24:53.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558142+0000", 2024-04-19T04:24:53.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011410500000000001 2024-04-19T04:24:53.720 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.720 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.720 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.720 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.720 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534754+0000", 2024-04-19T04:24:53.720 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.081315412000002, 2024-04-19T04:24:53.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026409367, 2024-04-19T04:24:53.720 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.720 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:53.721 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534754+0000", 2024-04-19T04:24:53.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534754+0000", 2024-04-19T04:24:53.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534753+0000", 2024-04-19T04:24:53.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:53.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.722 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.722 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534757+0000", 2024-04-19T04:24:53.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0430000000000001e-06 2024-04-19T04:24:53.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.722 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.722 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534765+0000", 2024-04-19T04:24:53.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2430000000000005e-06 2024-04-19T04:24:53.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534772+0000", 2024-04-19T04:24:53.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.973e-06 2024-04-19T04:24:53.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534849+0000", 2024-04-19T04:24:53.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6724000000000006e-05 2024-04-19T04:24:53.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:53.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534853+0000", 2024-04-19T04:24:53.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.442e-06 2024-04-19T04:24:53.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555493+0000", 2024-04-19T04:24:53.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020639571999999998 2024-04-19T04:24:53.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555890+0000", 2024-04-19T04:24:53.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00039718000000000002 2024-04-19T04:24:53.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561163+0000", 2024-04-19T04:24:53.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0052728929999999999 2024-04-19T04:24:53.725 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.725 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.725 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.725 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.725 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534797+0000", 2024-04-19T04:24:53.725 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.081272617000003, 2024-04-19T04:24:53.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026586375999999998, 2024-04-19T04:24:53.725 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.725 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.725 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534797+0000", 2024-04-19T04:24:53.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.726 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534797+0000", 2024-04-19T04:24:53.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.726 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534796+0000", 2024-04-19T04:24:53.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534805+0000", 2024-04-19T04:24:53.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.3700000000000001e-06 2024-04-19T04:24:53.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534822+0000", 2024-04-19T04:24:53.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6878999999999999e-05 2024-04-19T04:24:53.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534832+0000", 2024-04-19T04:24:53.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:24:53.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534899+0000", 2024-04-19T04:24:53.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7280999999999995e-05 2024-04-19T04:24:53.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:53.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534905+0000", 2024-04-19T04:24:53.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8490000000000002e-06 2024-04-19T04:24:53.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556245+0000", 2024-04-19T04:24:53.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.021340136999999999 2024-04-19T04:24:53.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556327+0000", 2024-04-19T04:24:53.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2347000000000003e-05 2024-04-19T04:24:53.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:53.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556554+0000", 2024-04-19T04:24:53.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022676200000000001 2024-04-19T04:24:53.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561197+0000", 2024-04-19T04:24:53.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0046431019999999996 2024-04-19T04:24:53.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.730 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561303+0000", 2024-04-19T04:24:53.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000106043 2024-04-19T04:24:53.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.730 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561350+0000", 2024-04-19T04:24:53.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6711000000000001e-05 2024-04-19T04:24:53.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.730 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.731 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561383+0000", 2024-04-19T04:24:53.731 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2904999999999998e-05 2024-04-19T04:24:53.731 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.731 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.731 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.731 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.731 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.731 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534840+0000", 2024-04-19T04:24:53.731 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.081229458000003, 2024-04-19T04:24:53.731 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022162659000000001, 2024-04-19T04:24:53.731 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.731 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.731 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534840+0000", 2024-04-19T04:24:53.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534840+0000", 2024-04-19T04:24:53.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534839+0000", 2024-04-19T04:24:53.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:53.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534844+0000", 2024-04-19T04:24:53.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7859999999999996e-06 2024-04-19T04:24:53.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534856+0000", 2024-04-19T04:24:53.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2150000000000001e-05 2024-04-19T04:24:53.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534863+0000", 2024-04-19T04:24:53.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.883e-06 2024-04-19T04:24:53.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534915+0000", 2024-04-19T04:24:53.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1675999999999998e-05 2024-04-19T04:24:53.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:53.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534918+0000", 2024-04-19T04:24:53.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7850000000000002e-06 2024-04-19T04:24:53.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.551513+0000", 2024-04-19T04:24:53.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016594398 2024-04-19T04:24:53.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.551634+0000", 2024-04-19T04:24:53.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012141700000000001 2024-04-19T04:24:53.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:53.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.551867+0000", 2024-04-19T04:24:53.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00023267000000000001 2024-04-19T04:24:53.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556539+0000", 2024-04-19T04:24:53.736 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0046719910000000003 2024-04-19T04:24:53.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556594+0000", 2024-04-19T04:24:53.736 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4715e-05 2024-04-19T04:24:53.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556818+0000", 2024-04-19T04:24:53.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000224064 2024-04-19T04:24:53.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.737 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557002+0000", 2024-04-19T04:24:53.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00018477399999999999 2024-04-19T04:24:53.737 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.737 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.737 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.737 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:53.737 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534883+0000", 2024-04-19T04:24:53.738 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 33.081186053000003, 2024-04-19T04:24:53.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022503523000000001, 2024-04-19T04:24:53.738 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:53.738 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:53.738 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:53.738 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.738 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:53.738 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534883+0000", 2024-04-19T04:24:53.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.738 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.738 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:53.738 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534883+0000", 2024-04-19T04:24:53.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:53.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.739 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:53.739 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534882+0000", 2024-04-19T04:24:53.739 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:53.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.739 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:53.739 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534894+0000", 2024-04-19T04:24:53.739 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1579999999999999e-05 2024-04-19T04:24:53.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.739 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:53.740 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534903+0000", 2024-04-19T04:24:53.740 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0790000000000007e-06 2024-04-19T04:24:53.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.740 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.740 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.740 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534910+0000", 2024-04-19T04:24:53.740 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8329999999999996e-06 2024-04-19T04:24:53.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.740 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.740 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.740 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534960+0000", 2024-04-19T04:24:53.740 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0441e-05 2024-04-19T04:24:53.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.740 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:53.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534964+0000", 2024-04-19T04:24:53.741 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9169999999999999e-06 2024-04-19T04:24:53.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:53.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.552567+0000", 2024-04-19T04:24:53.741 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.017603088999999999 2024-04-19T04:24:53.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:53.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553342+0000", 2024-04-19T04:24:53.741 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00077492299999999995 2024-04-19T04:24:53.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:53.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553552+0000", 2024-04-19T04:24:53.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00020988300000000001 2024-04-19T04:24:53.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:53.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556683+0000", 2024-04-19T04:24:53.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031310830000000002 2024-04-19T04:24:53.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557301+0000", 2024-04-19T04:24:53.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000618051 2024-04-19T04:24:53.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.743 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:53.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557350+0000", 2024-04-19T04:24:53.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8976e-05 2024-04-19T04:24:53.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:53.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:53.743 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:53.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557387+0000", 2024-04-19T04:24:53.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6325000000000002e-05 2024-04-19T04:24:53.743 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.743 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.743 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.743 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:53.744 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:53.744 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:53.744 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T04:24:53.746 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:53.743+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:53.746 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:24:53.750 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 9 16 25014 24998 173.577 158.625 0.00682977 0.00575431 2024-04-19T04:24:53.847 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:53.843+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:53.886 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:24:53.887 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [ 2024-04-19T04:24:53.887 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.887 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:25349 5.2 e27/20 5:4b05eb6c:::benchmark_data_smithi007_19526_object25348:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:24:53.887 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:53.883502+0000", 2024-04-19T04:24:53.887 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00086722999999999998, 2024-04-19T04:24:53.887 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00088887899999999997, 2024-04-19T04:24:53.887 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:53.887 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:53.887 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:53.887 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.887 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:53.887 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883502+0000", 2024-04-19T04:24:53.888 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.888 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.888 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.888 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:53.888 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883502+0000", 2024-04-19T04:24:53.888 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.888 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.888 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.888 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:53.888 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883502+0000", 2024-04-19T04:24:53.888 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:53.888 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.888 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.888 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:53.889 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883551+0000", 2024-04-19T04:24:53.889 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.9734000000000002e-05 2024-04-19T04:24:53.889 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.889 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.889 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:53.889 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883562+0000", 2024-04-19T04:24:53.889 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0521e-05 2024-04-19T04:24:53.889 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.889 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.889 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.889 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883568+0000", 2024-04-19T04:24:53.889 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7139999999999996e-06 2024-04-19T04:24:53.890 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.890 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.890 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:53.890 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883622+0000", 2024-04-19T04:24:53.890 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.3439000000000001e-05 2024-04-19T04:24:53.890 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.890 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.890 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:53.890 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883640+0000", 2024-04-19T04:24:53.890 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8410000000000002e-05 2024-04-19T04:24:53.890 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.890 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:53.890 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.890 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.891 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.891 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25353 5.3 5:c4bcf237:::benchmark_data_smithi007_19526_object25352:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:53.891 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:53.883805+0000", 2024-04-19T04:24:53.891 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00056420400000000001, 2024-04-19T04:24:53.891 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00064962799999999997, 2024-04-19T04:24:53.891 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:53.891 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:53.891 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:53.891 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:53.891 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:53.891 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25353 2024-04-19T04:24:53.891 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.891 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:53.891 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.891 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:53.892 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883805+0000", 2024-04-19T04:24:53.892 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.892 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.892 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.892 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:53.892 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883805+0000", 2024-04-19T04:24:53.892 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.892 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.892 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.892 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:53.892 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883804+0000", 2024-04-19T04:24:53.892 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.892 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.892 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.893 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:53.893 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883857+0000", 2024-04-19T04:24:53.893 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2491000000000003e-05 2024-04-19T04:24:53.893 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.893 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.893 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:53.893 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883869+0000", 2024-04-19T04:24:53.893 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.171e-05 2024-04-19T04:24:53.893 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.893 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.893 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.893 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883874+0000", 2024-04-19T04:24:53.893 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.3329999999999996e-06 2024-04-19T04:24:53.893 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.893 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.894 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:53.894 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883923+0000", 2024-04-19T04:24:53.894 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.9500999999999999e-05 2024-04-19T04:24:53.894 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.894 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.894 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:53.894 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.884068+0000", 2024-04-19T04:24:53.894 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014493399999999999 2024-04-19T04:24:53.894 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.894 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.894 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:53.894 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.884210+0000", 2024-04-19T04:24:53.894 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014189699999999999 2024-04-19T04:24:53.894 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.895 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:53.895 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.895 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.895 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.895 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25339 5.3 5:c8b58bdb:::benchmark_data_smithi007_19526_object25338:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:53.895 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:53.877932+0000", 2024-04-19T04:24:53.895 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0064372559999999997, 2024-04-19T04:24:53.895 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0065938539999999997, 2024-04-19T04:24:53.895 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:53.895 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:53.895 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:53.895 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:53.895 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:53.895 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25339 2024-04-19T04:24:53.895 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.896 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:53.896 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.896 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:53.896 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.877932+0000", 2024-04-19T04:24:53.896 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.896 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.896 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.896 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:53.896 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.877932+0000", 2024-04-19T04:24:53.896 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.896 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.896 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.896 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:53.896 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.877932+0000", 2024-04-19T04:24:53.896 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:53.897 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.897 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.897 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:53.897 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.877980+0000", 2024-04-19T04:24:53.897 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.8362000000000002e-05 2024-04-19T04:24:53.897 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.897 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.897 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:53.897 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.877988+0000", 2024-04-19T04:24:53.897 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.8860000000000004e-06 2024-04-19T04:24:53.897 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.897 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.897 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.897 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.877994+0000", 2024-04-19T04:24:53.897 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.772e-06 2024-04-19T04:24:53.898 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.898 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.898 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:53.898 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.878046+0000", 2024-04-19T04:24:53.898 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2431e-05 2024-04-19T04:24:53.898 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.898 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.898 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:53.898 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.878173+0000", 2024-04-19T04:24:53.898 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012716100000000001 2024-04-19T04:24:53.898 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.898 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.898 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:53.898 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.878263+0000", 2024-04-19T04:24:53.899 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.9351000000000006e-05 2024-04-19T04:24:53.899 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.899 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.899 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:53.899 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.881020+0000", 2024-04-19T04:24:53.899 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00275772 2024-04-19T04:24:53.899 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.899 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:53.899 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.899 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.899 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.899 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25340 5.3 5:c301d74f:::benchmark_data_smithi007_19526_object25339:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:53.899 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:53.878010+0000", 2024-04-19T04:24:53.899 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.006359099, 2024-04-19T04:24:53.899 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0065891730000000003, 2024-04-19T04:24:53.900 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:53.900 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:53.900 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:53.900 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:53.900 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:53.900 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25340 2024-04-19T04:24:53.900 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.900 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:53.900 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.900 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:53.900 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.878010+0000", 2024-04-19T04:24:53.900 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.900 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.900 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.900 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:53.901 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.878010+0000", 2024-04-19T04:24:53.901 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.901 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.901 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.901 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:53.901 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.878010+0000", 2024-04-19T04:24:53.901 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:53.901 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.901 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.901 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:53.901 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.878036+0000", 2024-04-19T04:24:53.901 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.6316e-05 2024-04-19T04:24:53.901 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.901 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.902 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:53.902 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.878044+0000", 2024-04-19T04:24:53.902 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.3380000000000005e-06 2024-04-19T04:24:53.902 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.902 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.902 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.902 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.878049+0000", 2024-04-19T04:24:53.902 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.972e-06 2024-04-19T04:24:53.902 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.902 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.902 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:53.902 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.879593+0000", 2024-04-19T04:24:53.902 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0015433199999999999 2024-04-19T04:24:53.902 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.902 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.903 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:53.903 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.879756+0000", 2024-04-19T04:24:53.903 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000163163 2024-04-19T04:24:53.903 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.903 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.903 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:53.903 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.879950+0000", 2024-04-19T04:24:53.903 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000193876 2024-04-19T04:24:53.903 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.903 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.903 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:53.903 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.882873+0000", 2024-04-19T04:24:53.903 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0029227189999999998 2024-04-19T04:24:53.903 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.904 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:53.904 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.904 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.904 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.904 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25341 5.5 5:a0dafb9f:::benchmark_data_smithi007_19526_object25340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:53.904 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:53.879877+0000", 2024-04-19T04:24:53.904 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0044925369999999996, 2024-04-19T04:24:53.904 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0047973909999999998, 2024-04-19T04:24:53.904 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:53.904 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:53.905 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:53.905 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:53.905 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:53.905 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25341 2024-04-19T04:24:53.905 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.905 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:53.905 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.905 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:53.905 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.879877+0000", 2024-04-19T04:24:53.905 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.905 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.905 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.906 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:53.906 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.879877+0000", 2024-04-19T04:24:53.906 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.906 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.906 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.906 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:53.906 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.879876+0000", 2024-04-19T04:24:53.906 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.906 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.906 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.906 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:53.906 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.879941+0000", 2024-04-19T04:24:53.906 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.5063999999999999e-05 2024-04-19T04:24:53.906 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.907 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.907 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:53.907 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.879953+0000", 2024-04-19T04:24:53.907 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2388999999999999e-05 2024-04-19T04:24:53.907 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.907 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.907 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.907 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.879962+0000", 2024-04-19T04:24:53.907 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.5920000000000001e-06 2024-04-19T04:24:53.907 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.907 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.907 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:53.907 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880076+0000", 2024-04-19T04:24:53.907 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000114345 2024-04-19T04:24:53.908 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.908 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.908 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:53.908 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880240+0000", 2024-04-19T04:24:53.908 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000163375 2024-04-19T04:24:53.908 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.908 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.908 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:53.908 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880377+0000", 2024-04-19T04:24:53.908 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000137343 2024-04-19T04:24:53.908 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.908 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:53.908 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.908 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.908 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.908 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25343 5.6 5:695e6f61:::benchmark_data_smithi007_19526_object25342:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:53.909 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:53.879976+0000", 2024-04-19T04:24:53.909 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0043934009999999999, 2024-04-19T04:24:53.909 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0047682929999999998, 2024-04-19T04:24:53.909 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:53.909 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:53.909 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:53.909 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:53.909 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:53.909 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25343 2024-04-19T04:24:53.909 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.909 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:53.909 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.909 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:53.909 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.879976+0000", 2024-04-19T04:24:53.910 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.910 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.910 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.910 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:53.910 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.879976+0000", 2024-04-19T04:24:53.910 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.910 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.910 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.910 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:53.910 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.879975+0000", 2024-04-19T04:24:53.910 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.910 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.910 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.910 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:53.911 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880017+0000", 2024-04-19T04:24:53.911 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1525e-05 2024-04-19T04:24:53.911 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.911 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.911 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:53.911 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880026+0000", 2024-04-19T04:24:53.911 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.0580000000000004e-06 2024-04-19T04:24:53.911 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.911 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.911 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.911 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880033+0000", 2024-04-19T04:24:53.911 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.9589999999999998e-06 2024-04-19T04:24:53.911 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.911 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.911 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:53.912 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.881341+0000", 2024-04-19T04:24:53.912 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0013081760000000001 2024-04-19T04:24:53.912 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.912 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.912 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:53.912 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.881608+0000", 2024-04-19T04:24:53.912 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00026750100000000001 2024-04-19T04:24:53.912 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.912 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.912 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:53.912 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.881740+0000", 2024-04-19T04:24:53.912 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013164599999999999 2024-04-19T04:24:53.912 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.912 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:53.912 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.913 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.913 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.913 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25344 5.5 5:a2a8e60b:::benchmark_data_smithi007_19526_object25343:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:53.913 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:53.880143+0000", 2024-04-19T04:24:53.913 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0042261379999999999, 2024-04-19T04:24:53.913 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0046707099999999998, 2024-04-19T04:24:53.913 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:53.913 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:53.913 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:53.913 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:53.913 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:53.913 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25344 2024-04-19T04:24:53.913 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.913 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:53.914 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.914 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:53.914 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880143+0000", 2024-04-19T04:24:53.914 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.914 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.914 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.914 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:53.914 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880143+0000", 2024-04-19T04:24:53.914 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.914 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.914 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.914 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:53.914 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880142+0000", 2024-04-19T04:24:53.914 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.915 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.915 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.915 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:53.915 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880248+0000", 2024-04-19T04:24:53.915 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000105692 2024-04-19T04:24:53.915 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.915 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.915 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:53.915 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880256+0000", 2024-04-19T04:24:53.915 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.9279999999999993e-06 2024-04-19T04:24:53.915 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.915 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.915 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.915 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880261+0000", 2024-04-19T04:24:53.915 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.0440000000000003e-06 2024-04-19T04:24:53.916 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.916 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.916 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:53.916 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.881654+0000", 2024-04-19T04:24:53.916 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001393069 2024-04-19T04:24:53.916 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.916 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.916 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:53.916 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.881738+0000", 2024-04-19T04:24:53.917 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.3997000000000002e-05 2024-04-19T04:24:53.917 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.917 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.917 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:53.917 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.881888+0000", 2024-04-19T04:24:53.917 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014945400000000001 2024-04-19T04:24:53.917 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.917 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:53.917 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.917 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.917 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.917 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:25342 5.4 e27/20 5:2483d433:::benchmark_data_smithi007_19526_object25341:head v 27'1540, mlcod=27'1538)", 2024-04-19T04:24:53.918 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:53.880316+0000", 2024-04-19T04:24:53.918 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.004053793, 2024-04-19T04:24:53.918 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.004566957, 2024-04-19T04:24:53.918 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:53.918 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:53.918 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:53.918 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.918 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:53.918 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880316+0000", 2024-04-19T04:24:53.918 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.918 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.918 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.918 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:53.918 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880316+0000", 2024-04-19T04:24:53.919 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.919 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.919 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.919 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:53.919 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880315+0000", 2024-04-19T04:24:53.919 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:53.919 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.919 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.919 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:53.919 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880365+0000", 2024-04-19T04:24:53.919 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.9877999999999999e-05 2024-04-19T04:24:53.919 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.919 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.919 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:53.919 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880375+0000", 2024-04-19T04:24:53.920 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0213e-05 2024-04-19T04:24:53.920 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.920 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.920 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.920 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880379+0000", 2024-04-19T04:24:53.920 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2980000000000002e-06 2024-04-19T04:24:53.920 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.920 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.920 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:53.920 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880421+0000", 2024-04-19T04:24:53.920 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1357999999999999e-05 2024-04-19T04:24:53.920 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.920 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.920 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:53.920 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880452+0000", 2024-04-19T04:24:53.921 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.1613999999999999e-05 2024-04-19T04:24:53.921 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.921 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:53.921 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.921 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.921 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.921 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25347 5.a 5:50d65666:::benchmark_data_smithi007_19526_object25346:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:53.921 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:53.880435+0000", 2024-04-19T04:24:53.921 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.003934758, 2024-04-19T04:24:53.921 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0045047419999999999, 2024-04-19T04:24:53.921 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:53.921 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:53.921 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:53.921 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:53.922 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:53.922 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25347 2024-04-19T04:24:53.922 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.922 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:53.922 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.922 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:53.922 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880435+0000", 2024-04-19T04:24:53.922 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.922 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.922 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.923 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:53.923 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880435+0000", 2024-04-19T04:24:53.923 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.923 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.923 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.923 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:53.923 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880434+0000", 2024-04-19T04:24:53.923 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.923 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.923 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.923 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:53.924 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880483+0000", 2024-04-19T04:24:53.924 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.8832000000000003e-05 2024-04-19T04:24:53.924 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.924 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.924 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:53.924 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880493+0000", 2024-04-19T04:24:53.924 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0396e-05 2024-04-19T04:24:53.924 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.924 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.924 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.924 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880501+0000", 2024-04-19T04:24:53.924 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.7570000000000004e-06 2024-04-19T04:24:53.924 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.925 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.925 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:53.925 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880551+0000", 2024-04-19T04:24:53.925 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.9898000000000002e-05 2024-04-19T04:24:53.925 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.925 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.925 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:53.925 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880652+0000", 2024-04-19T04:24:53.925 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000101419 2024-04-19T04:24:53.925 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.925 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.925 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:53.925 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880726+0000", 2024-04-19T04:24:53.925 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.4000999999999998e-05 2024-04-19T04:24:53.925 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.926 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.926 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:53.926 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.884076+0000", 2024-04-19T04:24:53.926 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0033498960000000002 2024-04-19T04:24:53.926 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.926 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:53.926 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.926 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.926 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.926 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:25345 5.8 e27/20 5:1e69fdf2:::benchmark_data_smithi007_19526_object25344:head v 27'1588, mlcod=27'1585)", 2024-04-19T04:24:53.926 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:53.880737+0000", 2024-04-19T04:24:53.926 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0036321550000000002, 2024-04-19T04:24:53.926 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0042699349999999999, 2024-04-19T04:24:53.926 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:53.927 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:53.927 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:53.927 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.927 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:53.927 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880737+0000", 2024-04-19T04:24:53.927 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.927 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.927 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.927 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:53.927 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880737+0000", 2024-04-19T04:24:53.927 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.927 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.927 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.927 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:53.927 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880737+0000", 2024-04-19T04:24:53.928 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:53.928 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.928 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.928 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:53.928 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880787+0000", 2024-04-19T04:24:53.928 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.0374000000000003e-05 2024-04-19T04:24:53.928 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.928 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.928 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:53.928 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880797+0000", 2024-04-19T04:24:53.928 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0339e-05 2024-04-19T04:24:53.928 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.928 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.928 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.929 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880804+0000", 2024-04-19T04:24:53.929 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.4330000000000001e-06 2024-04-19T04:24:53.929 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.929 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.929 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:53.929 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880854+0000", 2024-04-19T04:24:53.929 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.0232999999999998e-05 2024-04-19T04:24:53.929 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.929 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.929 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:53.929 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.880873+0000", 2024-04-19T04:24:53.929 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8825999999999999e-05 2024-04-19T04:24:53.929 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.929 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:53.929 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.930 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.930 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.930 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:25346 5.4 e27/20 5:2d959022:::benchmark_data_smithi007_19526_object25345:head v 27'1541, mlcod=27'1538)", 2024-04-19T04:24:53.930 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:53.881832+0000", 2024-04-19T04:24:53.930 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.002537409, 2024-04-19T04:24:53.931 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0032273459999999999, 2024-04-19T04:24:53.931 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:53.931 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:53.931 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:53.931 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.931 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:53.931 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.881832+0000", 2024-04-19T04:24:53.931 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.931 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.931 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.931 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:53.932 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.881832+0000", 2024-04-19T04:24:53.932 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.932 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.932 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.932 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:53.932 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.881831+0000", 2024-04-19T04:24:53.932 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:53.932 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.932 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.932 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:53.932 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.881927+0000", 2024-04-19T04:24:53.932 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.5393e-05 2024-04-19T04:24:53.932 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.932 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.932 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:53.933 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.881946+0000", 2024-04-19T04:24:53.933 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.9317000000000002e-05 2024-04-19T04:24:53.933 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.933 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.933 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.933 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.881954+0000", 2024-04-19T04:24:53.933 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.6990000000000003e-06 2024-04-19T04:24:53.933 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.933 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.933 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:53.933 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.882003+0000", 2024-04-19T04:24:53.933 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.9023000000000001e-05 2024-04-19T04:24:53.933 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.933 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.934 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:53.934 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.882016+0000", 2024-04-19T04:24:53.934 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2899e-05 2024-04-19T04:24:53.934 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.934 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:53.934 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.934 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.934 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.934 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25348 5.5 5:a9a56491:::benchmark_data_smithi007_19526_object25347:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:53.934 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:53.882711+0000", 2024-04-19T04:24:53.934 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0016583570000000001, 2024-04-19T04:24:53.934 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.002404041, 2024-04-19T04:24:53.934 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:53.934 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:53.935 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:53.935 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:53.935 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:53.935 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25348 2024-04-19T04:24:53.935 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.935 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:53.935 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.935 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:53.935 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.882711+0000", 2024-04-19T04:24:53.935 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.935 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.935 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.935 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:53.935 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.882711+0000", 2024-04-19T04:24:53.936 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.936 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.936 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.936 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:53.936 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.882710+0000", 2024-04-19T04:24:53.936 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:53.936 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.936 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.936 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:53.936 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.882812+0000", 2024-04-19T04:24:53.936 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000102107 2024-04-19T04:24:53.936 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.936 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.936 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:53.936 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.882826+0000", 2024-04-19T04:24:53.937 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.4246999999999999e-05 2024-04-19T04:24:53.937 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.937 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.937 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.937 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.882835+0000", 2024-04-19T04:24:53.937 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.1349999999999998e-06 2024-04-19T04:24:53.937 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.937 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.937 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:53.937 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883088+0000", 2024-04-19T04:24:53.937 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000252978 2024-04-19T04:24:53.937 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.937 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.937 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:53.937 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883269+0000", 2024-04-19T04:24:53.938 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00018087299999999999 2024-04-19T04:24:53.938 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.938 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.938 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:53.938 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883404+0000", 2024-04-19T04:24:53.938 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013485099999999999 2024-04-19T04:24:53.938 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.938 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:53.938 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.938 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.938 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.938 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25350 5.c 5:3760397a:::benchmark_data_smithi007_19526_object25349:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:53.938 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:53.882929+0000", 2024-04-19T04:24:53.938 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0014401520000000001, 2024-04-19T04:24:53.938 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0022606670000000001, 2024-04-19T04:24:53.939 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:53.939 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:53.939 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:53.939 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:53.939 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:53.939 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25350 2024-04-19T04:24:53.939 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.939 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:53.939 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.939 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:53.939 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.882929+0000", 2024-04-19T04:24:53.939 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.939 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.939 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.939 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:53.940 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.882929+0000", 2024-04-19T04:24:53.940 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.940 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.940 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.940 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:53.940 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.882928+0000", 2024-04-19T04:24:53.940 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.940 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.940 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.940 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:53.940 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883031+0000", 2024-04-19T04:24:53.940 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000102602 2024-04-19T04:24:53.940 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.940 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.940 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:53.941 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883044+0000", 2024-04-19T04:24:53.941 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2859e-05 2024-04-19T04:24:53.941 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.941 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.941 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.941 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883052+0000", 2024-04-19T04:24:53.941 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.2120000000000003e-06 2024-04-19T04:24:53.941 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.941 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.942 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:53.942 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883084+0000", 2024-04-19T04:24:53.942 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.1829000000000003e-05 2024-04-19T04:24:53.942 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.942 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.942 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:53.942 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883195+0000", 2024-04-19T04:24:53.942 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00011155299999999999 2024-04-19T04:24:53.942 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.942 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.942 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:53.942 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883290+0000", 2024-04-19T04:24:53.942 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.4882000000000004e-05 2024-04-19T04:24:53.942 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.943 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:53.943 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.943 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.943 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.943 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25351 5.5 5:aaab0cab:::benchmark_data_smithi007_19526_object25350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:53.943 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:53.883076+0000", 2024-04-19T04:24:53.943 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.001293113, 2024-04-19T04:24:53.943 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.002190984, 2024-04-19T04:24:53.943 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:53.943 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:53.943 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:53.943 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:53.943 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:53.944 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25351 2024-04-19T04:24:53.944 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.944 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:53.944 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.944 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:53.944 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883076+0000", 2024-04-19T04:24:53.944 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.944 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.944 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.944 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:53.944 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883076+0000", 2024-04-19T04:24:53.944 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.944 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.944 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.944 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:53.945 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883075+0000", 2024-04-19T04:24:53.945 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:53.945 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.945 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.945 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:53.945 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883198+0000", 2024-04-19T04:24:53.945 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012311900000000001 2024-04-19T04:24:53.945 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.945 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.945 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:53.945 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883209+0000", 2024-04-19T04:24:53.945 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.027e-05 2024-04-19T04:24:53.945 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.945 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.945 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.946 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883217+0000", 2024-04-19T04:24:53.946 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.9570000000000002e-06 2024-04-19T04:24:53.946 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.946 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.946 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:53.946 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.884494+0000", 2024-04-19T04:24:53.946 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001277008 2024-04-19T04:24:53.946 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.946 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.946 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:53.946 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.884634+0000", 2024-04-19T04:24:53.946 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014062600000000001 2024-04-19T04:24:53.946 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.946 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.947 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:53.947 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.884782+0000", 2024-04-19T04:24:53.947 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000147527 2024-04-19T04:24:53.947 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.947 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:53.947 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.947 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.947 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.947 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25352 5.c 5:357e87a1:::benchmark_data_smithi007_19526_object25351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:53.947 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:53.883240+0000", 2024-04-19T04:24:53.947 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0011297029999999999, 2024-04-19T04:24:53.947 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.002099605, 2024-04-19T04:24:53.947 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:53.947 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:53.947 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:53.948 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:53.948 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:53.948 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25352 2024-04-19T04:24:53.948 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.948 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:53.948 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.948 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:53.948 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883240+0000", 2024-04-19T04:24:53.948 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.948 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.948 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.948 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:53.948 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883240+0000", 2024-04-19T04:24:53.948 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:53.948 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.949 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.949 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:53.949 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883239+0000", 2024-04-19T04:24:53.949 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:53.949 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.949 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.949 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:53.949 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883363+0000", 2024-04-19T04:24:53.949 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000124053 2024-04-19T04:24:53.949 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.949 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.949 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:53.949 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883373+0000", 2024-04-19T04:24:53.949 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.4569999999999994e-06 2024-04-19T04:24:53.949 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.950 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.950 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:53.950 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.883380+0000", 2024-04-19T04:24:53.950 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.0169999999999999e-06 2024-04-19T04:24:53.950 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.950 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.950 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:53.950 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.884466+0000", 2024-04-19T04:24:53.950 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0010864640000000001 2024-04-19T04:24:53.950 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.950 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.950 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:53.950 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.884576+0000", 2024-04-19T04:24:53.950 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000109793 2024-04-19T04:24:53.950 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:53.951 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:53.951 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:53.951 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.884667+0000", 2024-04-19T04:24:53.951 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.1370000000000001e-05 2024-04-19T04:24:53.951 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.951 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:53.951 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.951 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:53.951 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-04-19T04:24:53.951 INFO:teuthology.orchestra.run.smithi066.stdout: "num_ops": 15 2024-04-19T04:24:53.951 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:24:53.953 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:24:53.953 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:53.947+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:54.053 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:54.050+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:54.097 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:24:54.097 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [], 2024-04-19T04:24:54.097 INFO:teuthology.orchestra.run.smithi066.stdout: "complaint_time": 30, 2024-04-19T04:24:54.097 INFO:teuthology.orchestra.run.smithi066.stdout: "num_blocked_ops": 0 2024-04-19T04:24:54.097 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:24:54.110 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:24:54.155 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:54.151+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:54.244 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:24:54.244 INFO:teuthology.orchestra.run.smithi066.stdout: "size": 20, 2024-04-19T04:24:54.244 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 600, 2024-04-19T04:24:54.244 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [ 2024-04-19T04:24:54.245 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.245 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:54.245 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:24:54.245 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 33.707902685999997, 2024-04-19T04:24:54.245 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019436790999999998, 2024-04-19T04:24:54.245 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.245 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.245 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.245 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.246 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.246 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:24:54.246 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.246 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.246 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.246 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.246 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:24:54.246 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.246 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.246 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.247 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.247 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533562+0000", 2024-04-19T04:24:54.247 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999967 2024-04-19T04:24:54.247 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.247 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.247 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.247 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533588+0000", 2024-04-19T04:24:54.247 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.6128000000000001e-05 2024-04-19T04:24:54.247 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.247 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.247 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.247 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533617+0000", 2024-04-19T04:24:54.247 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.8685000000000001e-05 2024-04-19T04:24:54.247 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.248 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.248 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.248 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533649+0000", 2024-04-19T04:24:54.248 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.2532e-05 2024-04-19T04:24:54.248 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.248 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.248 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.248 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536605+0000", 2024-04-19T04:24:54.248 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0029553130000000002 2024-04-19T04:24:54.248 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.249 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.249 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.249 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536746+0000", 2024-04-19T04:24:54.249 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000141011 2024-04-19T04:24:54.249 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.249 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.249 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.249 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536889+0000", 2024-04-19T04:24:54.249 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000143437 2024-04-19T04:24:54.249 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.249 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.250 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:54.250 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542807+0000", 2024-04-19T04:24:54.250 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0059181210000000001 2024-04-19T04:24:54.250 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.250 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.250 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.250 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.552917+0000", 2024-04-19T04:24:54.250 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010110111 2024-04-19T04:24:54.250 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.250 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.250 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:54.250 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.552962+0000", 2024-04-19T04:24:54.251 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.4811999999999997e-05 2024-04-19T04:24:54.251 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.251 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.251 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.251 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553002+0000", 2024-04-19T04:24:54.251 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9957999999999999e-05 2024-04-19T04:24:54.251 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.251 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.251 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.251 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.251 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.251 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:54.251 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:24:54.252 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 33.707786742000003, 2024-04-19T04:24:54.252 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019464940999999999, 2024-04-19T04:24:54.252 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.252 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.252 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.252 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.252 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.252 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:24:54.252 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.252 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.252 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.252 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.252 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:24:54.253 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.253 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.253 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.253 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.253 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533680+0000", 2024-04-19T04:24:54.253 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:54.253 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.253 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.253 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.253 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533692+0000", 2024-04-19T04:24:54.253 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2235000000000001e-05 2024-04-19T04:24:54.253 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.254 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.254 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.254 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533770+0000", 2024-04-19T04:24:54.254 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.8248e-05 2024-04-19T04:24:54.254 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.254 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.254 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.254 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:24:54.254 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8671000000000001e-05 2024-04-19T04:24:54.254 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.254 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.254 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.255 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539610+0000", 2024-04-19T04:24:54.255 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0058206669999999999 2024-04-19T04:24:54.255 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.255 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.255 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.255 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539705+0000", 2024-04-19T04:24:54.255 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.5313e-05 2024-04-19T04:24:54.255 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.255 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.255 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.255 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539857+0000", 2024-04-19T04:24:54.255 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000151881 2024-04-19T04:24:54.255 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.255 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.256 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:54.256 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542812+0000", 2024-04-19T04:24:54.256 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.002954857 2024-04-19T04:24:54.256 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.256 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.256 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.256 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553058+0000", 2024-04-19T04:24:54.256 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010246570999999999 2024-04-19T04:24:54.256 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.256 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.256 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:54.257 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553104+0000", 2024-04-19T04:24:54.257 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.5235999999999999e-05 2024-04-19T04:24:54.257 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.257 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.257 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.257 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553146+0000", 2024-04-19T04:24:54.257 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2725999999999997e-05 2024-04-19T04:24:54.257 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.257 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.257 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.257 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.257 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.257 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:20 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:54.257 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533808+0000", 2024-04-19T04:24:54.258 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 33.707660183999998, 2024-04-19T04:24:54.258 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013169548999999999, 2024-04-19T04:24:54.258 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.258 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.258 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.258 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.258 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.258 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533808+0000", 2024-04-19T04:24:54.258 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.258 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.258 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.258 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.258 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533808+0000", 2024-04-19T04:24:54.258 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.259 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.259 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.259 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.259 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533807+0000", 2024-04-19T04:24:54.259 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:54.259 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.259 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.259 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.259 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533816+0000", 2024-04-19T04:24:54.259 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.7440000000000002e-06 2024-04-19T04:24:54.259 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.259 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.259 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.259 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533835+0000", 2024-04-19T04:24:54.259 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.9074000000000001e-05 2024-04-19T04:24:54.260 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.260 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.260 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.260 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533851+0000", 2024-04-19T04:24:54.260 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.5862000000000002e-05 2024-04-19T04:24:54.260 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.260 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.260 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.260 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.540449+0000", 2024-04-19T04:24:54.260 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0065977889999999997 2024-04-19T04:24:54.261 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.261 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.261 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.261 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.540629+0000", 2024-04-19T04:24:54.261 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00018008499999999999 2024-04-19T04:24:54.261 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.261 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.261 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:54.261 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.540786+0000", 2024-04-19T04:24:54.261 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015730799999999999 2024-04-19T04:24:54.261 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.261 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.261 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:54.262 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542894+0000", 2024-04-19T04:24:54.262 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0021071140000000002 2024-04-19T04:24:54.263 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.263 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.264 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.264 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.546830+0000", 2024-04-19T04:24:54.264 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0039364129999999997 2024-04-19T04:24:54.264 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.264 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.264 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:54.264 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.546925+0000", 2024-04-19T04:24:54.264 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.4747999999999995e-05 2024-04-19T04:24:54.264 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.264 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.264 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.264 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.546977+0000", 2024-04-19T04:24:54.264 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2791999999999999e-05 2024-04-19T04:24:54.264 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.265 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.265 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.265 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.265 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.265 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:54.265 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533866+0000", 2024-04-19T04:24:54.265 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 33.707602426999998, 2024-04-19T04:24:54.265 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013268970999999999, 2024-04-19T04:24:54.265 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.265 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.265 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.265 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.265 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.265 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533866+0000", 2024-04-19T04:24:54.266 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.266 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.266 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.266 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.266 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533866+0000", 2024-04-19T04:24:54.266 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.266 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.266 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.266 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.266 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533865+0000", 2024-04-19T04:24:54.266 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.266 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.266 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.266 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.267 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533879+0000", 2024-04-19T04:24:54.267 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3825000000000001e-05 2024-04-19T04:24:54.267 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.267 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.267 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.267 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:54.267 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.6816999999999998e-05 2024-04-19T04:24:54.267 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.267 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.267 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.267 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533926+0000", 2024-04-19T04:24:54.267 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.0309000000000001e-05 2024-04-19T04:24:54.267 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.267 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.267 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.268 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541173+0000", 2024-04-19T04:24:54.268 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0072477560000000002 2024-04-19T04:24:54.268 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.268 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.268 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.268 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541268+0000", 2024-04-19T04:24:54.268 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.4400000000000004e-05 2024-04-19T04:24:54.268 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.268 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.268 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:54.268 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541394+0000", 2024-04-19T04:24:54.269 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012616400000000001 2024-04-19T04:24:54.269 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.269 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.269 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:54.269 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.543380+0000", 2024-04-19T04:24:54.269 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0019861940000000002 2024-04-19T04:24:54.269 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.269 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.269 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.269 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.547049+0000", 2024-04-19T04:24:54.269 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00366855 2024-04-19T04:24:54.269 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.269 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.270 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:54.270 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.547098+0000", 2024-04-19T04:24:54.270 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.9716000000000003e-05 2024-04-19T04:24:54.270 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.270 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.270 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.270 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.547135+0000", 2024-04-19T04:24:54.270 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6217000000000002e-05 2024-04-19T04:24:54.270 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.270 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.270 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.270 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.270 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.270 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:21 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:54.271 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:24:54.271 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 33.707527642000002, 2024-04-19T04:24:54.271 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019340466000000001, 2024-04-19T04:24:54.271 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.271 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.271 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.271 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.271 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.271 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:24:54.272 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.272 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.272 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.272 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.272 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:24:54.272 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.272 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.272 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.272 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.273 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533939+0000", 2024-04-19T04:24:54.273 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.273 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.273 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.273 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.273 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533950+0000", 2024-04-19T04:24:54.273 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0533999999999999e-05 2024-04-19T04:24:54.273 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.273 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.273 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.273 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533973+0000", 2024-04-19T04:24:54.273 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2614000000000001e-05 2024-04-19T04:24:54.273 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.273 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.273 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.274 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:54.274 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3531e-05 2024-04-19T04:24:54.274 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.274 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.274 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.274 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541149+0000", 2024-04-19T04:24:54.274 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0071628780000000001 2024-04-19T04:24:54.274 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.274 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.274 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.274 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541279+0000", 2024-04-19T04:24:54.274 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013014999999999999 2024-04-19T04:24:54.274 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.275 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.275 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.275 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541430+0000", 2024-04-19T04:24:54.275 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015048399999999999 2024-04-19T04:24:54.275 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.275 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.275 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:54.275 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.543384+0000", 2024-04-19T04:24:54.275 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001954468 2024-04-19T04:24:54.275 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.275 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.275 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.275 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553193+0000", 2024-04-19T04:24:54.275 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0098089059999999992 2024-04-19T04:24:54.276 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.276 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.276 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:54.276 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553245+0000", 2024-04-19T04:24:54.276 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.1742e-05 2024-04-19T04:24:54.276 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.276 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.276 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.276 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553281+0000", 2024-04-19T04:24:54.276 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6272000000000001e-05 2024-04-19T04:24:54.276 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.276 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.277 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.277 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.277 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.277 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:54.277 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:54.277 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 33.707470391000001, 2024-04-19T04:24:54.277 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019497464999999999, 2024-04-19T04:24:54.277 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.277 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.277 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.277 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.277 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.277 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:54.277 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.277 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.278 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.278 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.278 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:54.278 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.278 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.278 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.278 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.278 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533997+0000", 2024-04-19T04:24:54.278 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.278 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.278 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.278 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.278 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534019+0000", 2024-04-19T04:24:54.278 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.1871000000000001e-05 2024-04-19T04:24:54.279 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.279 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.279 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.279 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534036+0000", 2024-04-19T04:24:54.279 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.7073999999999999e-05 2024-04-19T04:24:54.279 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.279 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.279 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.279 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:54.279 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3781000000000001e-05 2024-04-19T04:24:54.279 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.279 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.279 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.279 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534167+0000", 2024-04-19T04:24:54.280 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000117463 2024-04-19T04:24:54.280 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.280 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.280 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.280 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.535182+0000", 2024-04-19T04:24:54.280 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0010149340000000001 2024-04-19T04:24:54.280 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.280 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.280 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.280 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.535459+0000", 2024-04-19T04:24:54.280 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000277013 2024-04-19T04:24:54.280 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.280 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.280 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:54.280 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.540338+0000", 2024-04-19T04:24:54.281 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0048786109999999997 2024-04-19T04:24:54.281 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.281 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.281 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.281 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553416+0000", 2024-04-19T04:24:54.281 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013078251000000001 2024-04-19T04:24:54.281 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.281 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.281 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:54.281 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553456+0000", 2024-04-19T04:24:54.281 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.0516999999999998e-05 2024-04-19T04:24:54.281 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.281 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.282 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.282 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553495+0000", 2024-04-19T04:24:54.282 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8899999999999997e-05 2024-04-19T04:24:54.282 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.282 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.282 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.282 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.282 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.282 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:54.282 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:24:54.282 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 33.707372005000003, 2024-04-19T04:24:54.282 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019607754000000002, 2024-04-19T04:24:54.282 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.283 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:54.283 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.283 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.283 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.283 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:24:54.283 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.283 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.283 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.283 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.283 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:24:54.283 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.283 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.283 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.283 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.283 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534095+0000", 2024-04-19T04:24:54.284 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:54.284 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.284 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.284 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.284 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534104+0000", 2024-04-19T04:24:54.284 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.9779999999999994e-06 2024-04-19T04:24:54.284 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.284 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.284 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.284 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534122+0000", 2024-04-19T04:24:54.284 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8464000000000001e-05 2024-04-19T04:24:54.284 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.284 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.284 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.284 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534142+0000", 2024-04-19T04:24:54.285 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.9287999999999999e-05 2024-04-19T04:24:54.285 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.285 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.285 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.285 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.538550+0000", 2024-04-19T04:24:54.285 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0044085560000000001 2024-04-19T04:24:54.285 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.285 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.285 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.285 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.538726+0000", 2024-04-19T04:24:54.285 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017599299999999999 2024-04-19T04:24:54.285 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.285 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.285 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.285 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553704+0000", 2024-04-19T04:24:54.286 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.014977802 2024-04-19T04:24:54.286 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.286 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.286 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.286 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.286 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.286 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:54.286 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:24:54.286 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 33.707285116000001, 2024-04-19T04:24:54.286 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019220208999999999, 2024-04-19T04:24:54.286 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.286 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:54.286 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.286 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.287 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.287 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:24:54.287 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.287 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.287 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.287 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.287 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:24:54.287 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.287 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.288 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.288 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.288 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534182+0000", 2024-04-19T04:24:54.288 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.288 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.288 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.288 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.288 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534189+0000", 2024-04-19T04:24:54.288 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3710000000000002e-06 2024-04-19T04:24:54.288 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.288 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.288 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.288 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534810+0000", 2024-04-19T04:24:54.288 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00062098000000000003 2024-04-19T04:24:54.288 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.289 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.289 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.289 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534829+0000", 2024-04-19T04:24:54.289 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8207999999999999e-05 2024-04-19T04:24:54.289 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.289 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.289 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.289 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542089+0000", 2024-04-19T04:24:54.289 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0072601710000000002 2024-04-19T04:24:54.289 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.289 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.289 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.289 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542225+0000", 2024-04-19T04:24:54.289 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000135988 2024-04-19T04:24:54.289 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.290 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.290 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.290 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553403+0000", 2024-04-19T04:24:54.290 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011178478 2024-04-19T04:24:54.290 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.290 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.290 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.290 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.290 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.290 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:1634 5.6 5:6959a88a:::benchmark_data_smithi007_19526_object1633:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T04:24:54.290 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:45.290080+0000", 2024-04-19T04:24:54.291 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 8.9513878459999994, 2024-04-19T04:24:54.291 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.012560969999999999, 2024-04-19T04:24:54.291 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.291 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.291 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:54.291 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:54.291 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.291 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 1634 2024-04-19T04:24:54.291 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.291 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.291 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.292 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.292 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.290080+0000", 2024-04-19T04:24:54.292 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.292 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.292 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.292 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.292 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.290080+0000", 2024-04-19T04:24:54.292 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.292 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.292 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.292 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.292 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.290079+0000", 2024-04-19T04:24:54.293 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:54.293 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.293 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.293 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.293 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.290146+0000", 2024-04-19T04:24:54.293 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7626000000000006e-05 2024-04-19T04:24:54.293 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.293 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.293 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.293 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.290164+0000", 2024-04-19T04:24:54.293 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8232000000000001e-05 2024-04-19T04:24:54.293 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.293 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.293 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.293 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.290176+0000", 2024-04-19T04:24:54.294 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1841999999999999e-05 2024-04-19T04:24:54.294 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.294 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.294 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.294 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.294440+0000", 2024-04-19T04:24:54.294 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0042635870000000001 2024-04-19T04:24:54.294 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.294 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.294 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.294 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.294549+0000", 2024-04-19T04:24:54.294 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000109344 2024-04-19T04:24:54.294 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.294 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.294 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.295 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.294667+0000", 2024-04-19T04:24:54.295 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000117525 2024-04-19T04:24:54.295 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.295 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.295 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:54.295 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.299430+0000", 2024-04-19T04:24:54.295 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0047633019999999996 2024-04-19T04:24:54.295 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.295 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.295 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.295 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.302522+0000", 2024-04-19T04:24:54.295 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0030919530000000001 2024-04-19T04:24:54.295 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.295 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.296 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:54.296 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.302594+0000", 2024-04-19T04:24:54.296 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.1594000000000006e-05 2024-04-19T04:24:54.296 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.296 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.296 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.296 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:45.302641+0000", 2024-04-19T04:24:54.296 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7602000000000003e-05 2024-04-19T04:24:54.296 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.296 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.296 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.296 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.296 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.296 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:12221 5.a 5:554b89f1:::benchmark_data_smithi007_19526_object12220:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T04:24:54.296 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:48.869516+0000", 2024-04-19T04:24:54.297 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 5.3719516360000004, 2024-04-19T04:24:54.297 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.012486575999999999, 2024-04-19T04:24:54.297 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.297 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.297 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:54.297 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:54.297 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.297 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 12221 2024-04-19T04:24:54.297 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.297 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.297 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.297 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.297 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.869516+0000", 2024-04-19T04:24:54.297 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.297 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.298 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.298 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.298 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.869516+0000", 2024-04-19T04:24:54.298 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.298 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.298 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.298 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.298 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.869515+0000", 2024-04-19T04:24:54.298 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.298 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.298 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.298 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.298 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.869634+0000", 2024-04-19T04:24:54.298 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000118356 2024-04-19T04:24:54.299 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.299 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.299 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.299 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.869645+0000", 2024-04-19T04:24:54.299 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0915e-05 2024-04-19T04:24:54.299 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.299 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.299 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.299 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.869656+0000", 2024-04-19T04:24:54.299 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1695000000000001e-05 2024-04-19T04:24:54.299 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.299 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.299 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.299 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.869705+0000", 2024-04-19T04:24:54.300 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.8783999999999999e-05 2024-04-19T04:24:54.300 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.300 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.300 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.300 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.869845+0000", 2024-04-19T04:24:54.300 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000139326 2024-04-19T04:24:54.300 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.300 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.300 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:54.300 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.870033+0000", 2024-04-19T04:24:54.300 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00018805100000000001 2024-04-19T04:24:54.300 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.300 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.300 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.301 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.874423+0000", 2024-04-19T04:24:54.301 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0043904319999999997 2024-04-19T04:24:54.301 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.301 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.301 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:54.301 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.881875+0000", 2024-04-19T04:24:54.301 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0074519219999999997 2024-04-19T04:24:54.301 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.301 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.301 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:54.301 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.881977+0000", 2024-04-19T04:24:54.301 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000102391 2024-04-19T04:24:54.301 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.301 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.301 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.302 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:48.882003+0000", 2024-04-19T04:24:54.302 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.5689000000000001e-05 2024-04-19T04:24:54.302 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.302 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.302 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.302 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.302 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.302 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:14281 5.c 5:324bb768:::benchmark_data_smithi007_19526_object14280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T04:24:54.303 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:49.624149+0000", 2024-04-19T04:24:54.303 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.6173191999999998, 2024-04-19T04:24:54.303 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.01328056, 2024-04-19T04:24:54.303 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.303 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.303 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:54.303 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:54.303 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.303 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 14281 2024-04-19T04:24:54.303 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.303 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.303 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.303 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.303 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.624149+0000", 2024-04-19T04:24:54.303 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.303 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.304 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.304 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.304 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.624149+0000", 2024-04-19T04:24:54.304 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.304 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.304 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.304 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.304 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.624148+0000", 2024-04-19T04:24:54.304 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.304 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.304 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.304 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.304 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.624196+0000", 2024-04-19T04:24:54.304 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.8176000000000001e-05 2024-04-19T04:24:54.305 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.305 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.305 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.305 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.624218+0000", 2024-04-19T04:24:54.305 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2493e-05 2024-04-19T04:24:54.305 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.305 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.305 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.305 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.624229+0000", 2024-04-19T04:24:54.305 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0210999999999999e-05 2024-04-19T04:24:54.305 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.305 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.305 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.305 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.625136+0000", 2024-04-19T04:24:54.305 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00090728800000000002 2024-04-19T04:24:54.306 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.306 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.306 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.306 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.625286+0000", 2024-04-19T04:24:54.306 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014975700000000001 2024-04-19T04:24:54.306 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.306 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.306 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.306 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.625431+0000", 2024-04-19T04:24:54.306 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014548799999999999 2024-04-19T04:24:54.306 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.306 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.306 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.307 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.627337+0000", 2024-04-19T04:24:54.307 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0019056120000000001 2024-04-19T04:24:54.307 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.307 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.307 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:54.307 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.637374+0000", 2024-04-19T04:24:54.307 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010037315 2024-04-19T04:24:54.307 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.307 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.307 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:54.307 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.637407+0000", 2024-04-19T04:24:54.307 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.2675000000000001e-05 2024-04-19T04:24:54.307 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.307 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.307 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.308 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.637429+0000", 2024-04-19T04:24:54.308 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2722999999999999e-05 2024-04-19T04:24:54.308 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.308 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.308 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.308 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.308 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.308 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:14284 5.c 5:36bd4431:::benchmark_data_smithi007_19526_object14283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T04:24:54.308 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:49.625049+0000", 2024-04-19T04:24:54.308 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.616419445, 2024-04-19T04:24:54.308 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.012418848, 2024-04-19T04:24:54.308 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.308 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.308 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:54.309 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:54.309 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.309 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 14284 2024-04-19T04:24:54.309 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.309 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.309 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.309 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.309 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.625049+0000", 2024-04-19T04:24:54.309 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.309 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.309 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.309 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.309 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.625049+0000", 2024-04-19T04:24:54.309 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.309 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.310 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.310 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.310 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.625048+0000", 2024-04-19T04:24:54.310 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.310 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.310 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.310 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.310 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.625098+0000", 2024-04-19T04:24:54.310 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.0661999999999997e-05 2024-04-19T04:24:54.310 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.310 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.310 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.310 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.625109+0000", 2024-04-19T04:24:54.310 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0847e-05 2024-04-19T04:24:54.311 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.311 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.311 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.311 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.625117+0000", 2024-04-19T04:24:54.311 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.0430000000000008e-06 2024-04-19T04:24:54.311 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.311 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.311 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.311 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.626265+0000", 2024-04-19T04:24:54.311 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0011483260000000001 2024-04-19T04:24:54.311 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.311 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.311 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.311 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.626348+0000", 2024-04-19T04:24:54.311 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.3053000000000006e-05 2024-04-19T04:24:54.312 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.312 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.312 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.312 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.626460+0000", 2024-04-19T04:24:54.312 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00011181200000000001 2024-04-19T04:24:54.312 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.312 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.312 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.312 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.628701+0000", 2024-04-19T04:24:54.312 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0022406840000000002 2024-04-19T04:24:54.312 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.312 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.312 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:54.312 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.637434+0000", 2024-04-19T04:24:54.313 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0087331409999999998 2024-04-19T04:24:54.313 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.313 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.313 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:54.313 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.637453+0000", 2024-04-19T04:24:54.313 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8425999999999999e-05 2024-04-19T04:24:54.313 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.313 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.313 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.313 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.637468+0000", 2024-04-19T04:24:54.313 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.4975e-05 2024-04-19T04:24:54.313 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.313 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.313 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.313 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.313 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.314 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:15009 5.6 5:62234a36:::benchmark_data_smithi007_19526_object15008:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:54.314 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:49.911756+0000", 2024-04-19T04:24:54.314 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.3297116530000004, 2024-04-19T04:24:54.314 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013813215, 2024-04-19T04:24:54.314 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.314 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.314 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:54.314 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:54.314 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.314 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 15009 2024-04-19T04:24:54.314 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.314 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.314 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.314 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.315 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.911756+0000", 2024-04-19T04:24:54.315 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.315 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.315 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.315 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.315 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.911756+0000", 2024-04-19T04:24:54.315 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.315 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.315 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.315 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.315 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.911756+0000", 2024-04-19T04:24:54.315 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.315 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.315 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.315 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.316 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.911841+0000", 2024-04-19T04:24:54.316 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.5323999999999998e-05 2024-04-19T04:24:54.316 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.316 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.316 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.316 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.911863+0000", 2024-04-19T04:24:54.316 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2050999999999999e-05 2024-04-19T04:24:54.316 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.316 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.316 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.316 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.911870+0000", 2024-04-19T04:24:54.317 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.1119999999999998e-06 2024-04-19T04:24:54.317 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.317 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.317 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.317 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.912143+0000", 2024-04-19T04:24:54.317 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00027322799999999998 2024-04-19T04:24:54.317 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.317 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.317 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.317 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.912241+0000", 2024-04-19T04:24:54.317 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.7298000000000003e-05 2024-04-19T04:24:54.317 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.317 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.317 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.318 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.912331+0000", 2024-04-19T04:24:54.318 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.0629000000000003e-05 2024-04-19T04:24:54.318 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.318 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.318 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:54.318 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.914184+0000", 2024-04-19T04:24:54.318 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0018523389999999999 2024-04-19T04:24:54.318 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.318 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.318 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.318 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.925442+0000", 2024-04-19T04:24:54.318 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011258696 2024-04-19T04:24:54.318 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.318 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.319 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:54.319 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.925505+0000", 2024-04-19T04:24:54.319 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.3097999999999998e-05 2024-04-19T04:24:54.319 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.319 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.319 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.319 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.925570+0000", 2024-04-19T04:24:54.319 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.4238000000000004e-05 2024-04-19T04:24:54.319 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.319 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.319 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.319 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.319 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.319 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:15010 5.6 5:68f27626:::benchmark_data_smithi007_19526_object15009:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:54.320 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:49.913107+0000", 2024-04-19T04:24:54.320 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.3283607029999995, 2024-04-19T04:24:54.320 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.012619233000000001, 2024-04-19T04:24:54.320 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.320 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.320 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:54.320 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:54.320 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.320 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 15010 2024-04-19T04:24:54.320 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.320 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.320 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.320 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.320 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.913107+0000", 2024-04-19T04:24:54.321 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.321 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.321 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.321 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.321 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.913107+0000", 2024-04-19T04:24:54.321 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.321 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.321 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.321 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.321 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.913106+0000", 2024-04-19T04:24:54.321 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.321 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.321 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.321 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.321 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.913187+0000", 2024-04-19T04:24:54.322 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.0285999999999997e-05 2024-04-19T04:24:54.322 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.322 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.322 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.322 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.913198+0000", 2024-04-19T04:24:54.322 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1141000000000001e-05 2024-04-19T04:24:54.322 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.322 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.322 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.322 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.913207+0000", 2024-04-19T04:24:54.322 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.0529999999999996e-06 2024-04-19T04:24:54.322 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.322 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.322 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.323 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.913245+0000", 2024-04-19T04:24:54.323 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8485000000000002e-05 2024-04-19T04:24:54.323 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.323 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.323 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.323 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.913346+0000", 2024-04-19T04:24:54.323 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000100944 2024-04-19T04:24:54.323 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.323 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.323 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.323 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.913482+0000", 2024-04-19T04:24:54.323 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013567399999999999 2024-04-19T04:24:54.323 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.323 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.324 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:54.324 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.915754+0000", 2024-04-19T04:24:54.324 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.002272077 2024-04-19T04:24:54.324 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.324 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.324 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.324 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.925638+0000", 2024-04-19T04:24:54.324 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0098837549999999993 2024-04-19T04:24:54.324 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.324 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.324 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:54.324 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.925690+0000", 2024-04-19T04:24:54.324 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2272999999999999e-05 2024-04-19T04:24:54.324 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.324 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.325 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.325 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.925727+0000", 2024-04-19T04:24:54.325 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6656999999999998e-05 2024-04-19T04:24:54.325 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.325 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.325 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.325 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.325 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.325 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:15017 5.6 5:6a6a1ad0:::benchmark_data_smithi007_19526_object15016:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:54.325 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:49.915839+0000", 2024-04-19T04:24:54.325 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.3256293030000004, 2024-04-19T04:24:54.325 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.012371363, 2024-04-19T04:24:54.325 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.325 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.325 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:54.326 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:54.326 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.326 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 15017 2024-04-19T04:24:54.326 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.326 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.326 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.326 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.326 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.915839+0000", 2024-04-19T04:24:54.326 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.326 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.326 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.326 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.326 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.915839+0000", 2024-04-19T04:24:54.326 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.326 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.327 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.327 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.327 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.915838+0000", 2024-04-19T04:24:54.327 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.327 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.327 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.327 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.327 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.915892+0000", 2024-04-19T04:24:54.327 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4444999999999998e-05 2024-04-19T04:24:54.327 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.327 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.327 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.327 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.915901+0000", 2024-04-19T04:24:54.327 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.1999999999999994e-06 2024-04-19T04:24:54.327 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.328 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.328 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.328 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.915905+0000", 2024-04-19T04:24:54.328 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.3309999999999997e-06 2024-04-19T04:24:54.328 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.328 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.328 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.328 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.917258+0000", 2024-04-19T04:24:54.328 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0013527260000000001 2024-04-19T04:24:54.328 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.328 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.328 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.328 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.917390+0000", 2024-04-19T04:24:54.328 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000132018 2024-04-19T04:24:54.328 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.329 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.329 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.329 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.917560+0000", 2024-04-19T04:24:54.329 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017013999999999999 2024-04-19T04:24:54.329 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.329 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.329 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:54.329 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.923835+0000", 2024-04-19T04:24:54.329 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.006274829 2024-04-19T04:24:54.329 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.329 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.329 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.329 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.928121+0000", 2024-04-19T04:24:54.329 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0042868369999999999 2024-04-19T04:24:54.329 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.330 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.330 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:54.330 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.928173+0000", 2024-04-19T04:24:54.330 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.1978999999999998e-05 2024-04-19T04:24:54.330 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.330 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.330 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.330 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.928210+0000", 2024-04-19T04:24:54.330 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6724999999999998e-05 2024-04-19T04:24:54.330 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.330 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.330 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.330 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.330 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.331 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:24310 5.0 e27/20 5:07098fc4:::benchmark_data_smithi007_19526_object24309:head v 27'1477, mlcod=27'1475)", 2024-04-19T04:24:54.331 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:53.474912+0000", 2024-04-19T04:24:54.331 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.76655615700000002, 2024-04-19T04:24:54.331 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.012761052, 2024-04-19T04:24:54.331 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.331 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.331 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.331 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.331 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.331 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.474912+0000", 2024-04-19T04:24:54.331 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.331 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.331 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.331 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.331 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.474912+0000", 2024-04-19T04:24:54.332 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.332 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.332 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.332 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.332 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.474911+0000", 2024-04-19T04:24:54.332 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:54.332 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.332 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.332 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.332 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.474955+0000", 2024-04-19T04:24:54.332 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.3228e-05 2024-04-19T04:24:54.332 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.332 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.332 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.333 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.474968+0000", 2024-04-19T04:24:54.333 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3431999999999999e-05 2024-04-19T04:24:54.333 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.333 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.333 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.333 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.474976+0000", 2024-04-19T04:24:54.333 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.7209999999999994e-06 2024-04-19T04:24:54.333 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.333 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.333 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.333 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.475053+0000", 2024-04-19T04:24:54.333 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.7348999999999994e-05 2024-04-19T04:24:54.333 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.333 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.333 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.334 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.475080+0000", 2024-04-19T04:24:54.334 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.6276999999999999e-05 2024-04-19T04:24:54.334 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.334 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.334 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:54.334 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.486567+0000", 2024-04-19T04:24:54.334 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011487600000000001 2024-04-19T04:24:54.334 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.334 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.334 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.334 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.487673+0000", 2024-04-19T04:24:54.334 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001105902 2024-04-19T04:24:54.334 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.334 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.335 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.335 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.335 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.335 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25423 5.6 5:6f4ec70e:::benchmark_data_smithi007_19526_object25422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.335 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:53.911006+0000", 2024-04-19T04:24:54.335 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.33046192200000002, 2024-04-19T04:24:54.335 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.014609970999999999, 2024-04-19T04:24:54.335 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.335 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.335 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:54.335 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:54.335 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.335 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25423 2024-04-19T04:24:54.335 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.335 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.336 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.336 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.336 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.911006+0000", 2024-04-19T04:24:54.336 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.336 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.336 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.336 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.336 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.911006+0000", 2024-04-19T04:24:54.336 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.336 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.336 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.336 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.336 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.911005+0000", 2024-04-19T04:24:54.336 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.336 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.911068+0000", 2024-04-19T04:24:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.3034000000000007e-05 2024-04-19T04:24:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.911077+0000", 2024-04-19T04:24:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.1810000000000007e-06 2024-04-19T04:24:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.911083+0000", 2024-04-19T04:24:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.84e-06 2024-04-19T04:24:54.337 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.338 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.338 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.338 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.913975+0000", 2024-04-19T04:24:54.338 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0028923379999999999 2024-04-19T04:24:54.338 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.338 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.338 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.338 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.914167+0000", 2024-04-19T04:24:54.338 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00019184900000000001 2024-04-19T04:24:54.338 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.338 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.338 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.338 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.914336+0000", 2024-04-19T04:24:54.338 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000168245 2024-04-19T04:24:54.338 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.339 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.339 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:54.339 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.916211+0000", 2024-04-19T04:24:54.339 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0018751639999999999 2024-04-19T04:24:54.339 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.339 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.339 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.339 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.925521+0000", 2024-04-19T04:24:54.339 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.009309922 2024-04-19T04:24:54.339 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.339 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.339 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:54.339 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.925574+0000", 2024-04-19T04:24:54.339 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.3077e-05 2024-04-19T04:24:54.339 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.340 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.340 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.340 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.925616+0000", 2024-04-19T04:24:54.340 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2475000000000002e-05 2024-04-19T04:24:54.340 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.340 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.340 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.340 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.340 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.340 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25792 5.6 5:6ead9788:::benchmark_data_smithi007_19526_object25791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.340 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.070174+0000", 2024-04-19T04:24:54.340 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.17129376399999999, 2024-04-19T04:24:54.340 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.018078227999999998, 2024-04-19T04:24:54.340 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.340 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.341 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:54.341 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:54.341 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.341 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25792 2024-04-19T04:24:54.341 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.341 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.341 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.341 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.341 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070174+0000", 2024-04-19T04:24:54.341 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.341 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.341 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.341 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.341 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070174+0000", 2024-04-19T04:24:54.341 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.342 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.342 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.342 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.342 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070173+0000", 2024-04-19T04:24:54.342 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.342 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.342 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.342 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.342 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070241+0000", 2024-04-19T04:24:54.342 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7801999999999999e-05 2024-04-19T04:24:54.342 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.342 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.342 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.342 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070252+0000", 2024-04-19T04:24:54.342 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1405e-05 2024-04-19T04:24:54.343 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.343 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.343 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.343 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070258+0000", 2024-04-19T04:24:54.343 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4949999999999999e-06 2024-04-19T04:24:54.343 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.343 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.343 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.343 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070298+0000", 2024-04-19T04:24:54.343 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9932999999999999e-05 2024-04-19T04:24:54.343 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.343 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.343 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.343 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070386+0000", 2024-04-19T04:24:54.344 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8382999999999997e-05 2024-04-19T04:24:54.344 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.344 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.344 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.344 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070472+0000", 2024-04-19T04:24:54.344 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.5364999999999993e-05 2024-04-19T04:24:54.344 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.344 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.344 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.344 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.076618+0000", 2024-04-19T04:24:54.344 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.006146037 2024-04-19T04:24:54.344 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.344 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.344 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:54.344 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088147+0000", 2024-04-19T04:24:54.345 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011529634 2024-04-19T04:24:54.345 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.345 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.345 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:54.345 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088209+0000", 2024-04-19T04:24:54.345 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.1760999999999994e-05 2024-04-19T04:24:54.345 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.345 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.345 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.345 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088253+0000", 2024-04-19T04:24:54.345 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.3547000000000002e-05 2024-04-19T04:24:54.345 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.345 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.345 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.345 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.346 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.346 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:25794 5.e e27/20 5:77ddc1c5:::benchmark_data_smithi007_19526_object25793:head v 27'1671, mlcod=27'1669)", 2024-04-19T04:24:54.346 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.072074+0000", 2024-04-19T04:24:54.346 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.16939406200000001, 2024-04-19T04:24:54.346 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.016881862000000001, 2024-04-19T04:24:54.346 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.346 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.346 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.346 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.346 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.346 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072074+0000", 2024-04-19T04:24:54.346 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.346 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.346 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.347 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.347 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072074+0000", 2024-04-19T04:24:54.347 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.347 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.347 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.347 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.347 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072073+0000", 2024-04-19T04:24:54.347 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.347 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.347 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.347 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.347 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072119+0000", 2024-04-19T04:24:54.347 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.6301999999999998e-05 2024-04-19T04:24:54.347 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.347 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.348 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.348 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072130+0000", 2024-04-19T04:24:54.348 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1018e-05 2024-04-19T04:24:54.348 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.348 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.348 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.348 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072138+0000", 2024-04-19T04:24:54.348 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.131e-06 2024-04-19T04:24:54.348 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.348 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.348 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.348 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072176+0000", 2024-04-19T04:24:54.348 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8674000000000003e-05 2024-04-19T04:24:54.348 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.348 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.349 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.349 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072191+0000", 2024-04-19T04:24:54.349 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.5245000000000001e-05 2024-04-19T04:24:54.349 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.349 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.349 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:54.349 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088908+0000", 2024-04-19T04:24:54.349 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.016716742 2024-04-19T04:24:54.349 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.349 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.349 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.349 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088956+0000", 2024-04-19T04:24:54.349 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7675e-05 2024-04-19T04:24:54.349 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.350 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.350 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.350 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.350 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.350 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25802 5.6 5:6a01b8d5:::benchmark_data_smithi007_19526_object25801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.350 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.074125+0000", 2024-04-19T04:24:54.350 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.16734312400000001, 2024-04-19T04:24:54.350 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.014988691, 2024-04-19T04:24:54.350 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:54.350 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.351 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:54.351 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:54.351 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.351 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25802 2024-04-19T04:24:54.351 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.351 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:54.351 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.351 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:54.351 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.074125+0000", 2024-04-19T04:24:54.351 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.351 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.351 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.351 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:54.351 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.074125+0000", 2024-04-19T04:24:54.351 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:54.352 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.352 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.352 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:54.352 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.074124+0000", 2024-04-19T04:24:54.352 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.352 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.352 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.352 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:54.352 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.074172+0000", 2024-04-19T04:24:54.352 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7700000000000001e-05 2024-04-19T04:24:54.352 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.352 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.352 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:54.352 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.074180+0000", 2024-04-19T04:24:54.352 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8140000000000007e-06 2024-04-19T04:24:54.352 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.353 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.353 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.353 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.074186+0000", 2024-04-19T04:24:54.353 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.6860000000000003e-06 2024-04-19T04:24:54.353 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.353 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.353 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:54.353 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.074227+0000", 2024-04-19T04:24:54.353 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1323999999999999e-05 2024-04-19T04:24:54.353 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.353 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.353 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:54.353 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.074350+0000", 2024-04-19T04:24:54.353 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000122664 2024-04-19T04:24:54.354 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.354 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.354 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.354 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.074496+0000", 2024-04-19T04:24:54.354 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014595799999999999 2024-04-19T04:24:54.354 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.354 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.354 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.354 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.077162+0000", 2024-04-19T04:24:54.354 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0026657989999999999 2024-04-19T04:24:54.354 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.354 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.354 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:54.354 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088969+0000", 2024-04-19T04:24:54.354 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011807412999999999 2024-04-19T04:24:54.355 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.355 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.355 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:54.355 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.089072+0000", 2024-04-19T04:24:54.355 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000102915 2024-04-19T04:24:54.355 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:54.355 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:54.355 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:54.355 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.089114+0000", 2024-04-19T04:24:54.355 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1505999999999999e-05 2024-04-19T04:24:54.355 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.355 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.355 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.355 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:54.355 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:54.356 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:24:54.357 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:24:54.358 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:54.351+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:54.459 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:54.458+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:54.488 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:24:54.488 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:24:54.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.488 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26664 5.8 5:10120ecf:::benchmark_data_smithi007_19526_object26663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.488 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.482606+0000", 2024-04-19T04:24:54.488 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0055637409999999997, 2024-04-19T04:24:54.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055824890000000004, 2024-04-19T04:24:54.488 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.488 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:54.489 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.489 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.489 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.489 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26664 2024-04-19T04:24:54.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.489 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482606+0000", 2024-04-19T04:24:54.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482606+0000", 2024-04-19T04:24:54.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482605+0000", 2024-04-19T04:24:54.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482718+0000", 2024-04-19T04:24:54.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112761 2024-04-19T04:24:54.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482729+0000", 2024-04-19T04:24:54.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0761000000000001e-05 2024-04-19T04:24:54.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482736+0000", 2024-04-19T04:24:54.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3030000000000002e-06 2024-04-19T04:24:54.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482797+0000", 2024-04-19T04:24:54.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0469e-05 2024-04-19T04:24:54.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482949+0000", 2024-04-19T04:24:54.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000152657 2024-04-19T04:24:54.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:54.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.483084+0000", 2024-04-19T04:24:54.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000134886 2024-04-19T04:24:54.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.486522+0000", 2024-04-19T04:24:54.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003437655 2024-04-19T04:24:54.492 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.492 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.493 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.493 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26666 5.e 5:7a7e5472:::benchmark_data_smithi007_19526_object26665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.493 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.482752+0000", 2024-04-19T04:24:54.493 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0054183160000000003, 2024-04-19T04:24:54.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005498111, 2024-04-19T04:24:54.493 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.493 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:54.493 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.493 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.493 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.493 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26666 2024-04-19T04:24:54.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.493 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482752+0000", 2024-04-19T04:24:54.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482752+0000", 2024-04-19T04:24:54.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482751+0000", 2024-04-19T04:24:54.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:54.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482793+0000", 2024-04-19T04:24:54.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1841000000000001e-05 2024-04-19T04:24:54.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482799+0000", 2024-04-19T04:24:54.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.003e-06 2024-04-19T04:24:54.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482807+0000", 2024-04-19T04:24:54.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6839999999999996e-06 2024-04-19T04:24:54.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482866+0000", 2024-04-19T04:24:54.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8894999999999998e-05 2024-04-19T04:24:54.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482997+0000", 2024-04-19T04:24:54.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013142500000000001 2024-04-19T04:24:54.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:54.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.483129+0000", 2024-04-19T04:24:54.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013235300000000001 2024-04-19T04:24:54.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.485735+0000", 2024-04-19T04:24:54.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026059880000000001 2024-04-19T04:24:54.497 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.497 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.497 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.497 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26667 5.4 5:23abfacc:::benchmark_data_smithi007_19526_object26666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.497 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.482830+0000", 2024-04-19T04:24:54.497 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0053396989999999998, 2024-04-19T04:24:54.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054632960000000003, 2024-04-19T04:24:54.497 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.497 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:54.498 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.498 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.498 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.498 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26667 2024-04-19T04:24:54.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.498 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482830+0000", 2024-04-19T04:24:54.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482830+0000", 2024-04-19T04:24:54.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482830+0000", 2024-04-19T04:24:54.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:54.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482874+0000", 2024-04-19T04:24:54.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4223e-05 2024-04-19T04:24:54.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482882+0000", 2024-04-19T04:24:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.994e-06 2024-04-19T04:24:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482889+0000", 2024-04-19T04:24:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.759e-06 2024-04-19T04:24:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482924+0000", 2024-04-19T04:24:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5005000000000001e-05 2024-04-19T04:24:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.483064+0000", 2024-04-19T04:24:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014007599999999999 2024-04-19T04:24:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.483213+0000", 2024-04-19T04:24:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014940400000000001 2024-04-19T04:24:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.486481+0000", 2024-04-19T04:24:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032673960000000001 2024-04-19T04:24:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26668 5.b 5:d598aaab:::benchmark_data_smithi007_19526_object26667:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.482900+0000", 2024-04-19T04:24:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0052706810000000002, 2024-04-19T04:24:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054482239999999998, 2024-04-19T04:24:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26668 2024-04-19T04:24:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482900+0000", 2024-04-19T04:24:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482900+0000", 2024-04-19T04:24:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482899+0000", 2024-04-19T04:24:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482934+0000", 2024-04-19T04:24:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5404000000000002e-05 2024-04-19T04:24:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482942+0000", 2024-04-19T04:24:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4529999999999996e-06 2024-04-19T04:24:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482948+0000", 2024-04-19T04:24:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9159999999999998e-06 2024-04-19T04:24:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.482993+0000", 2024-04-19T04:24:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4910000000000002e-05 2024-04-19T04:24:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.483120+0000", 2024-04-19T04:24:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012787700000000001 2024-04-19T04:24:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.483245+0000", 2024-04-19T04:24:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012411099999999999 2024-04-19T04:24:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.486348+0000", 2024-04-19T04:24:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031036430000000001 2024-04-19T04:24:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26671 5.8 5:176afbfc:::benchmark_data_smithi007_19526_object26670:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.485146+0000", 2024-04-19T04:24:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.003024087, 2024-04-19T04:24:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003263981, 2024-04-19T04:24:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26671 2024-04-19T04:24:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.485146+0000", 2024-04-19T04:24:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.485146+0000", 2024-04-19T04:24:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.485145+0000", 2024-04-19T04:24:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.485248+0000", 2024-04-19T04:24:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102565 2024-04-19T04:24:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.485255+0000", 2024-04-19T04:24:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7190000000000001e-06 2024-04-19T04:24:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.485261+0000", 2024-04-19T04:24:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3170000000000001e-06 2024-04-19T04:24:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.485304+0000", 2024-04-19T04:24:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3309000000000002e-05 2024-04-19T04:24:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.485467+0000", 2024-04-19T04:24:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016326399999999999 2024-04-19T04:24:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.485599+0000", 2024-04-19T04:24:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013206900000000001 2024-04-19T04:24:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487990+0000", 2024-04-19T04:24:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023910810000000002 2024-04-19T04:24:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26675 5.8 5:1da84317:::benchmark_data_smithi007_19526_object26674:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.486905+0000", 2024-04-19T04:24:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001264879, 2024-04-19T04:24:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015650270000000001, 2024-04-19T04:24:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26675 2024-04-19T04:24:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.486905+0000", 2024-04-19T04:24:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.486905+0000", 2024-04-19T04:24:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.486904+0000", 2024-04-19T04:24:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487047+0000", 2024-04-19T04:24:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014293300000000001 2024-04-19T04:24:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487060+0000", 2024-04-19T04:24:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2486e-05 2024-04-19T04:24:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487068+0000", 2024-04-19T04:24:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5990000000000002e-06 2024-04-19T04:24:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487125+0000", 2024-04-19T04:24:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7170999999999999e-05 2024-04-19T04:24:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487229+0000", 2024-04-19T04:24:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103965 2024-04-19T04:24:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487337+0000", 2024-04-19T04:24:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010754700000000001 2024-04-19T04:24:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26676 5.8 5:17b295eb:::benchmark_data_smithi007_19526_object26675:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.487134+0000", 2024-04-19T04:24:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0010360429999999999, 2024-04-19T04:24:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013845299999999999, 2024-04-19T04:24:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26676 2024-04-19T04:24:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487134+0000", 2024-04-19T04:24:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487134+0000", 2024-04-19T04:24:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487133+0000", 2024-04-19T04:24:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487264+0000", 2024-04-19T04:24:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013014400000000001 2024-04-19T04:24:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487280+0000", 2024-04-19T04:24:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6589999999999999e-05 2024-04-19T04:24:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487287+0000", 2024-04-19T04:24:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0940000000000002e-06 2024-04-19T04:24:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.488019+0000", 2024-04-19T04:24:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00073202100000000002 2024-04-19T04:24:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.488152+0000", 2024-04-19T04:24:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013267699999999999 2024-04-19T04:24:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.488339+0000", 2024-04-19T04:24:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018715600000000001 2024-04-19T04:24:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:26673 5.a e27/20 5:5f88dfe4:::benchmark_data_smithi007_19526_object26672:head v 27'1674, mlcod=27'1669)", 2024-04-19T04:24:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.487319+0000", 2024-04-19T04:24:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00085110100000000005, 2024-04-19T04:24:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012401059999999999, 2024-04-19T04:24:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:24:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487319+0000", 2024-04-19T04:24:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487319+0000", 2024-04-19T04:24:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487319+0000", 2024-04-19T04:24:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487452+0000", 2024-04-19T04:24:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000133232 2024-04-19T04:24:54.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487465+0000", 2024-04-19T04:24:54.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2775999999999999e-05 2024-04-19T04:24:54.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487471+0000", 2024-04-19T04:24:54.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6869999999999997e-06 2024-04-19T04:24:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487509+0000", 2024-04-19T04:24:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8127000000000003e-05 2024-04-19T04:24:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487529+0000", 2024-04-19T04:24:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9423e-05 2024-04-19T04:24:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26677 5.4 5:21e247a4:::benchmark_data_smithi007_19526_object26676:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.487603+0000", 2024-04-19T04:24:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00056678700000000002, 2024-04-19T04:24:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00098941799999999994, 2024-04-19T04:24:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26677 2024-04-19T04:24:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487603+0000", 2024-04-19T04:24:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487603+0000", 2024-04-19T04:24:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487602+0000", 2024-04-19T04:24:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487730+0000", 2024-04-19T04:24:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000127644 2024-04-19T04:24:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487747+0000", 2024-04-19T04:24:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.696e-05 2024-04-19T04:24:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487772+0000", 2024-04-19T04:24:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4975999999999999e-05 2024-04-19T04:24:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487841+0000", 2024-04-19T04:24:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9188000000000002e-05 2024-04-19T04:24:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.487999+0000", 2024-04-19T04:24:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015781399999999999 2024-04-19T04:24:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.488134+0000", 2024-04-19T04:24:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013501100000000001 2024-04-19T04:24:54.528 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.528 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.528 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.528 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.528 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:24:54.528 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 9 2024-04-19T04:24:54.528 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:24:54.529 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:24:54.558 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:54.551+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:54.660 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:24:54.660 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:24:54.660 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:24:54.660 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:24:54.660 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:24:54.661 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:54.654+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:54.670 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:24:54.691 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T04:24:54.691 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T04:24:54.692 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-19T04:24:54.693 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.318936 2024-04-19T04:24:54.693 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.31893638816315284 2024-04-19T04:24:54.718 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-04-19T04:24:54.751 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 10 16 27319 27303 170.624 144.062 0.00635672 0.00585318 2024-04-19T04:24:54.760 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:54.754+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:54.799 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:24:54.799 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:24:54.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:24:54.800 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:24:54.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.800 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:54.800 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539530+0000", 2024-04-19T04:24:54.800 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 34.258241996999999, 2024-04-19T04:24:54.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015136197000000001, 2024-04-19T04:24:54.800 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.800 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.800 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539530+0000", 2024-04-19T04:24:54.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539530+0000", 2024-04-19T04:24:54.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539527+0000", 2024-04-19T04:24:54.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999971 2024-04-19T04:24:54.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539544+0000", 2024-04-19T04:24:54.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7082999999999999e-05 2024-04-19T04:24:54.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539567+0000", 2024-04-19T04:24:54.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3569000000000001e-05 2024-04-19T04:24:54.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539589+0000", 2024-04-19T04:24:54.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1486999999999999e-05 2024-04-19T04:24:54.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539691+0000", 2024-04-19T04:24:54.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010262 2024-04-19T04:24:54.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539876+0000", 2024-04-19T04:24:54.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000184172 2024-04-19T04:24:54.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541233+0000", 2024-04-19T04:24:54.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013569719999999999 2024-04-19T04:24:54.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547291+0000", 2024-04-19T04:24:54.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060583080000000001 2024-04-19T04:24:54.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554597+0000", 2024-04-19T04:24:54.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0073062800000000001 2024-04-19T04:24:54.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554640+0000", 2024-04-19T04:24:54.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3115999999999999e-05 2024-04-19T04:24:54.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554666+0000", 2024-04-19T04:24:54.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5400000000000001e-05 2024-04-19T04:24:54.805 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.805 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.805 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.805 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:54.805 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539646+0000", 2024-04-19T04:24:54.806 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 34.25812517, 2024-04-19T04:24:54.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015767644000000001, 2024-04-19T04:24:54.806 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.806 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.806 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539646+0000", 2024-04-19T04:24:54.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539646+0000", 2024-04-19T04:24:54.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539645+0000", 2024-04-19T04:24:54.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:54.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539672+0000", 2024-04-19T04:24:54.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7036999999999999e-05 2024-04-19T04:24:54.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539691+0000", 2024-04-19T04:24:54.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8929000000000001e-05 2024-04-19T04:24:54.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539707+0000", 2024-04-19T04:24:54.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5979999999999999e-05 2024-04-19T04:24:54.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542292+0000", 2024-04-19T04:24:54.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025857020000000001 2024-04-19T04:24:54.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542472+0000", 2024-04-19T04:24:54.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018001599999999999 2024-04-19T04:24:54.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543505+0000", 2024-04-19T04:24:54.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010326739999999999 2024-04-19T04:24:54.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547314+0000", 2024-04-19T04:24:54.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038089349999999998 2024-04-19T04:24:54.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555323+0000", 2024-04-19T04:24:54.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080089979999999998 2024-04-19T04:24:54.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555378+0000", 2024-04-19T04:24:54.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4951999999999998e-05 2024-04-19T04:24:54.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555414+0000", 2024-04-19T04:24:54.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5998000000000003e-05 2024-04-19T04:24:54.811 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.811 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.811 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.811 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:54.811 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539729+0000", 2024-04-19T04:24:54.811 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 34.258042074999999, 2024-04-19T04:24:54.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015615043, 2024-04-19T04:24:54.811 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.811 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.812 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539729+0000", 2024-04-19T04:24:54.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539729+0000", 2024-04-19T04:24:54.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539728+0000", 2024-04-19T04:24:54.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:54.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539737+0000", 2024-04-19T04:24:54.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5799999999999992e-06 2024-04-19T04:24:54.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539753+0000", 2024-04-19T04:24:54.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6373000000000001e-05 2024-04-19T04:24:54.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539770+0000", 2024-04-19T04:24:54.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7516e-05 2024-04-19T04:24:54.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542136+0000", 2024-04-19T04:24:54.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023653440000000001 2024-04-19T04:24:54.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543783+0000", 2024-04-19T04:24:54.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016468209999999999 2024-04-19T04:24:54.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543971+0000", 2024-04-19T04:24:54.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018871200000000001 2024-04-19T04:24:54.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547318+0000", 2024-04-19T04:24:54.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033471199999999999 2024-04-19T04:24:54.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555276+0000", 2024-04-19T04:24:54.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079574280000000008 2024-04-19T04:24:54.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555320+0000", 2024-04-19T04:24:54.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3664000000000001e-05 2024-04-19T04:24:54.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555344+0000", 2024-04-19T04:24:54.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4905e-05 2024-04-19T04:24:54.816 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.816 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.816 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.816 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:54.816 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539783+0000", 2024-04-19T04:24:54.816 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 34.257988769999997, 2024-04-19T04:24:54.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014773131, 2024-04-19T04:24:54.817 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.817 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.817 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539783+0000", 2024-04-19T04:24:54.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539783+0000", 2024-04-19T04:24:54.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539782+0000", 2024-04-19T04:24:54.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539790+0000", 2024-04-19T04:24:54.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9440000000000005e-06 2024-04-19T04:24:54.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539807+0000", 2024-04-19T04:24:54.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7036000000000001e-05 2024-04-19T04:24:54.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539822+0000", 2024-04-19T04:24:54.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4939e-05 2024-04-19T04:24:54.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539914+0000", 2024-04-19T04:24:54.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2435000000000005e-05 2024-04-19T04:24:54.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541221+0000", 2024-04-19T04:24:54.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001307358 2024-04-19T04:24:54.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541403+0000", 2024-04-19T04:24:54.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018113299999999999 2024-04-19T04:24:54.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.545434+0000", 2024-04-19T04:24:54.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040314260000000003 2024-04-19T04:24:54.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554049+0000", 2024-04-19T04:24:54.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0086145500000000003 2024-04-19T04:24:54.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554515+0000", 2024-04-19T04:24:54.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00046650899999999999 2024-04-19T04:24:54.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554556+0000", 2024-04-19T04:24:54.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0850999999999999e-05 2024-04-19T04:24:54.821 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.821 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.821 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.822 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:54.822 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:24:54.822 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 34.257928511000003, 2024-04-19T04:24:54.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018096054, 2024-04-19T04:24:54.822 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.822 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.822 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:24:54.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:24:54.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539842+0000", 2024-04-19T04:24:54.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:54.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539848+0000", 2024-04-19T04:24:54.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-19T04:24:54.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539859+0000", 2024-04-19T04:24:54.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0783e-05 2024-04-19T04:24:54.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539866+0000", 2024-04-19T04:24:54.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9439999999999999e-06 2024-04-19T04:24:54.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547400+0000", 2024-04-19T04:24:54.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075343729999999996 2024-04-19T04:24:54.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547480+0000", 2024-04-19T04:24:54.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9793e-05 2024-04-19T04:24:54.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547587+0000", 2024-04-19T04:24:54.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107333 2024-04-19T04:24:54.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.548935+0000", 2024-04-19T04:24:54.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013480639999999999 2024-04-19T04:24:54.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557892+0000", 2024-04-19T04:24:54.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089563939999999995 2024-04-19T04:24:54.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557920+0000", 2024-04-19T04:24:54.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8342000000000001e-05 2024-04-19T04:24:54.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.827 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557939+0000", 2024-04-19T04:24:54.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9142000000000001e-05 2024-04-19T04:24:54.827 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.827 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.827 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.827 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:54.827 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539872+0000", 2024-04-19T04:24:54.827 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 34.257899102000003, 2024-04-19T04:24:54.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015022429, 2024-04-19T04:24:54.827 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.827 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.828 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539872+0000", 2024-04-19T04:24:54.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539872+0000", 2024-04-19T04:24:54.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539872+0000", 2024-04-19T04:24:54.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:54.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539876+0000", 2024-04-19T04:24:54.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1999999999999996e-06 2024-04-19T04:24:54.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539886+0000", 2024-04-19T04:24:54.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9469999999999998e-06 2024-04-19T04:24:54.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539906+0000", 2024-04-19T04:24:54.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0542000000000001e-05 2024-04-19T04:24:54.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542491+0000", 2024-04-19T04:24:54.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025843530000000002 2024-04-19T04:24:54.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543411+0000", 2024-04-19T04:24:54.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00091973700000000001 2024-04-19T04:24:54.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.831 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543523+0000", 2024-04-19T04:24:54.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112323 2024-04-19T04:24:54.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.831 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.546595+0000", 2024-04-19T04:24:54.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003071631 2024-04-19T04:24:54.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.831 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554744+0000", 2024-04-19T04:24:54.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081498850000000008 2024-04-19T04:24:54.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554799+0000", 2024-04-19T04:24:54.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5067e-05 2024-04-19T04:24:54.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554895+0000", 2024-04-19T04:24:54.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5364000000000004e-05 2024-04-19T04:24:54.832 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.832 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.832 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.832 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:54.832 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:24:54.833 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 34.257852262999997, 2024-04-19T04:24:54.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018086631999999998, 2024-04-19T04:24:54.833 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.833 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.833 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:24:54.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:24:54.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539918+0000", 2024-04-19T04:24:54.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539931+0000", 2024-04-19T04:24:54.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2566e-05 2024-04-19T04:24:54.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539958+0000", 2024-04-19T04:24:54.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6582999999999999e-05 2024-04-19T04:24:54.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.835 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.835 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539972+0000", 2024-04-19T04:24:54.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4789e-05 2024-04-19T04:24:54.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.835 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.835 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547577+0000", 2024-04-19T04:24:54.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0076045979999999997 2024-04-19T04:24:54.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.835 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.836 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547769+0000", 2024-04-19T04:24:54.836 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000192034 2024-04-19T04:24:54.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.836 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.836 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.836 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547929+0000", 2024-04-19T04:24:54.836 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000159679 2024-04-19T04:24:54.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.836 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.836 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.836 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.548942+0000", 2024-04-19T04:24:54.836 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010138720000000001 2024-04-19T04:24:54.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557962+0000", 2024-04-19T04:24:54.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090199970000000001 2024-04-19T04:24:54.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557985+0000", 2024-04-19T04:24:54.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2623e-05 2024-04-19T04:24:54.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.558006+0000", 2024-04-19T04:24:54.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0764e-05 2024-04-19T04:24:54.838 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.838 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.838 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.838 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:27 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:54.838 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:24:54.838 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 34.257786275000001, 2024-04-19T04:24:54.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018047384, 2024-04-19T04:24:54.838 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.838 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:24:54.838 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.839 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:24:54.839 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.839 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.839 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.839 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:24:54.841 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.841 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.842 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.842 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.842 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539984+0000", 2024-04-19T04:24:54.842 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:54.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.842 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.842 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.842 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539991+0000", 2024-04-19T04:24:54.842 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7769999999999997e-06 2024-04-19T04:24:54.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.842 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.842 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.842 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540010+0000", 2024-04-19T04:24:54.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9573e-05 2024-04-19T04:24:54.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.843 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540025+0000", 2024-04-19T04:24:54.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4796e-05 2024-04-19T04:24:54.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.843 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541220+0000", 2024-04-19T04:24:54.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001195172 2024-04-19T04:24:54.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541569+0000", 2024-04-19T04:24:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00034836600000000002 2024-04-19T04:24:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.558033+0000", 2024-04-19T04:24:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.016464092999999999 2024-04-19T04:24:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:14827 5.8 5:17a0805e:::benchmark_data_smithi007_19526_object14826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:49.835039+0000", 2024-04-19T04:24:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.9627322649999996, 2024-04-19T04:24:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015368504, 2024-04-19T04:24:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 14827 2024-04-19T04:24:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835039+0000", 2024-04-19T04:24:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835039+0000", 2024-04-19T04:24:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835038+0000", 2024-04-19T04:24:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835118+0000", 2024-04-19T04:24:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0253000000000006e-05 2024-04-19T04:24:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835134+0000", 2024-04-19T04:24:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5565000000000001e-05 2024-04-19T04:24:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835145+0000", 2024-04-19T04:24:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1066e-05 2024-04-19T04:24:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.839716+0000", 2024-04-19T04:24:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045706610000000002 2024-04-19T04:24:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.839880+0000", 2024-04-19T04:24:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164272 2024-04-19T04:24:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.840064+0000", 2024-04-19T04:24:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018395999999999999 2024-04-19T04:24:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.842870+0000", 2024-04-19T04:24:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028064790000000002 2024-04-19T04:24:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.850315+0000", 2024-04-19T04:24:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074444639999999996 2024-04-19T04:24:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.850376+0000", 2024-04-19T04:24:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.088e-05 2024-04-19T04:24:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.850408+0000", 2024-04-19T04:24:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2013e-05 2024-04-19T04:24:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:14832 5.e 5:700017a8:::benchmark_data_smithi007_19526_object14831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:49.836412+0000", 2024-04-19T04:24:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.9613592039999999, 2024-04-19T04:24:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014543795, 2024-04-19T04:24:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 14832 2024-04-19T04:24:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836412+0000", 2024-04-19T04:24:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836412+0000", 2024-04-19T04:24:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.852 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836412+0000", 2024-04-19T04:24:54.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.852 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836460+0000", 2024-04-19T04:24:54.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8315000000000001e-05 2024-04-19T04:24:54.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836469+0000", 2024-04-19T04:24:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4520000000000003e-06 2024-04-19T04:24:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836477+0000", 2024-04-19T04:24:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.542e-06 2024-04-19T04:24:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836536+0000", 2024-04-19T04:24:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9579e-05 2024-04-19T04:24:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836737+0000", 2024-04-19T04:24:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000200776 2024-04-19T04:24:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.836928+0000", 2024-04-19T04:24:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019054099999999999 2024-04-19T04:24:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.841782+0000", 2024-04-19T04:24:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048537820000000001 2024-04-19T04:24:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.850861+0000", 2024-04-19T04:24:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090793780000000008 2024-04-19T04:24:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.850901+0000", 2024-04-19T04:24:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9953000000000002e-05 2024-04-19T04:24:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.850956+0000", 2024-04-19T04:24:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5195999999999998e-05 2024-04-19T04:24:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24310 5.0 5:07098fc4:::benchmark_data_smithi007_19526_object24309:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.471082+0000", 2024-04-19T04:24:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3266894499999999, 2024-04-19T04:24:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018533300999999999, 2024-04-19T04:24:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24310 2024-04-19T04:24:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.471082+0000", 2024-04-19T04:24:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.471082+0000", 2024-04-19T04:24:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.471081+0000", 2024-04-19T04:24:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472015+0000", 2024-04-19T04:24:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00093410800000000001 2024-04-19T04:24:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472027+0000", 2024-04-19T04:24:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1491000000000001e-05 2024-04-19T04:24:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472033+0000", 2024-04-19T04:24:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9499999999999998e-06 2024-04-19T04:24:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472087+0000", 2024-04-19T04:24:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4595999999999997e-05 2024-04-19T04:24:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472208+0000", 2024-04-19T04:24:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012105299999999999 2024-04-19T04:24:54.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:54.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.475540+0000", 2024-04-19T04:24:54.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033319310000000002 2024-04-19T04:24:54.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481479+0000", 2024-04-19T04:24:54.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059387440000000001 2024-04-19T04:24:54.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489528+0000", 2024-04-19T04:24:54.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080487739999999999 2024-04-19T04:24:54.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489578+0000", 2024-04-19T04:24:54.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0321999999999997e-05 2024-04-19T04:24:54.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489615+0000", 2024-04-19T04:24:54.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7425000000000002e-05 2024-04-19T04:24:54.861 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.861 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.861 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.862 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24318 5.0 5:09636443:::benchmark_data_smithi007_19526_object24317:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.862 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.472336+0000", 2024-04-19T04:24:54.862 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3254354209999999, 2024-04-19T04:24:54.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017477310999999999, 2024-04-19T04:24:54.862 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.862 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.862 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.862 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.862 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.862 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24318 2024-04-19T04:24:54.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.862 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472336+0000", 2024-04-19T04:24:54.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472336+0000", 2024-04-19T04:24:54.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472335+0000", 2024-04-19T04:24:54.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472373+0000", 2024-04-19T04:24:54.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7876999999999997e-05 2024-04-19T04:24:54.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472384+0000", 2024-04-19T04:24:54.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0513000000000001e-05 2024-04-19T04:24:54.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472391+0000", 2024-04-19T04:24:54.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6680000000000001e-06 2024-04-19T04:24:54.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.476649+0000", 2024-04-19T04:24:54.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004257172 2024-04-19T04:24:54.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.476767+0000", 2024-04-19T04:24:54.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118584 2024-04-19T04:24:54.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:54.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.476868+0000", 2024-04-19T04:24:54.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100912 2024-04-19T04:24:54.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481491+0000", 2024-04-19T04:24:54.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046224990000000004 2024-04-19T04:24:54.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489691+0000", 2024-04-19T04:24:54.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082007529999999999 2024-04-19T04:24:54.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489777+0000", 2024-04-19T04:24:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6174000000000005e-05 2024-04-19T04:24:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489813+0000", 2024-04-19T04:24:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.591e-05 2024-04-19T04:24:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24322 5.0 5:08733fec:::benchmark_data_smithi007_19526_object24321:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.474319+0000", 2024-04-19T04:24:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3234528810000001, 2024-04-19T04:24:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015646382, 2024-04-19T04:24:54.868 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.868 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.868 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.868 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.868 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.868 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24322 2024-04-19T04:24:54.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.868 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474319+0000", 2024-04-19T04:24:54.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474319+0000", 2024-04-19T04:24:54.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474318+0000", 2024-04-19T04:24:54.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474385+0000", 2024-04-19T04:24:54.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6892999999999998e-05 2024-04-19T04:24:54.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474405+0000", 2024-04-19T04:24:54.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9819000000000001e-05 2024-04-19T04:24:54.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474410+0000", 2024-04-19T04:24:54.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4990000000000002e-06 2024-04-19T04:24:54.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477692+0000", 2024-04-19T04:24:54.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032817570000000002 2024-04-19T04:24:54.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477802+0000", 2024-04-19T04:24:54.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0001102 2024-04-19T04:24:54.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:54.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477921+0000", 2024-04-19T04:24:54.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119159 2024-04-19T04:24:54.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481501+0000", 2024-04-19T04:24:54.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003579558 2024-04-19T04:24:54.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489889+0000", 2024-04-19T04:24:54.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083880570000000008 2024-04-19T04:24:54.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489937+0000", 2024-04-19T04:24:54.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8124000000000002e-05 2024-04-19T04:24:54.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489965+0000", 2024-04-19T04:24:54.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8085e-05 2024-04-19T04:24:54.873 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.873 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.873 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.873 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24324 5.0 5:08824c49:::benchmark_data_smithi007_19526_object24323:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.873 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.475064+0000", 2024-04-19T04:24:54.873 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3227077620000001, 2024-04-19T04:24:54.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014990401, 2024-04-19T04:24:54.873 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.873 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.873 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.873 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.873 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.874 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24324 2024-04-19T04:24:54.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.874 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.475064+0000", 2024-04-19T04:24:54.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.475064+0000", 2024-04-19T04:24:54.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.475063+0000", 2024-04-19T04:24:54.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.475214+0000", 2024-04-19T04:24:54.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015162800000000001 2024-04-19T04:24:54.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.475229+0000", 2024-04-19T04:24:54.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4887e-05 2024-04-19T04:24:54.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.475235+0000", 2024-04-19T04:24:54.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8080000000000001e-06 2024-04-19T04:24:54.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.478738+0000", 2024-04-19T04:24:54.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003503 2024-04-19T04:24:54.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.478891+0000", 2024-04-19T04:24:54.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015284399999999999 2024-04-19T04:24:54.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:54.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.479027+0000", 2024-04-19T04:24:54.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013615099999999999 2024-04-19T04:24:54.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481511+0000", 2024-04-19T04:24:54.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024843819999999998 2024-04-19T04:24:54.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489990+0000", 2024-04-19T04:24:54.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084784960000000003 2024-04-19T04:24:54.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.490030+0000", 2024-04-19T04:24:54.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0470999999999999e-05 2024-04-19T04:24:54.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.490054+0000", 2024-04-19T04:24:54.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3705000000000001e-05 2024-04-19T04:24:54.878 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.878 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.878 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.879 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24332 5.0 5:0c25ea80:::benchmark_data_smithi007_19526_object24331:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.879 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.477492+0000", 2024-04-19T04:24:54.879 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3202791620000001, 2024-04-19T04:24:54.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015281972, 2024-04-19T04:24:54.879 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.879 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.879 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.879 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.879 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.879 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24332 2024-04-19T04:24:54.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.879 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477492+0000", 2024-04-19T04:24:54.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477492+0000", 2024-04-19T04:24:54.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477491+0000", 2024-04-19T04:24:54.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477537+0000", 2024-04-19T04:24:54.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5785999999999998e-05 2024-04-19T04:24:54.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477554+0000", 2024-04-19T04:24:54.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6906e-05 2024-04-19T04:24:54.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477563+0000", 2024-04-19T04:24:54.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4730000000000006e-06 2024-04-19T04:24:54.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.480049+0000", 2024-04-19T04:24:54.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024853319999999998 2024-04-19T04:24:54.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.480228+0000", 2024-04-19T04:24:54.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000179502 2024-04-19T04:24:54.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:54.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.480409+0000", 2024-04-19T04:24:54.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000181168 2024-04-19T04:24:54.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481997+0000", 2024-04-19T04:24:54.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015875349999999999 2024-04-19T04:24:54.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.492645+0000", 2024-04-19T04:24:54.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010647647 2024-04-19T04:24:54.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.492715+0000", 2024-04-19T04:24:54.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0537999999999994e-05 2024-04-19T04:24:54.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.492774+0000", 2024-04-19T04:24:54.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9132999999999998e-05 2024-04-19T04:24:54.884 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.884 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.884 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.884 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:25794 5.e 5:77ddc1c5:::benchmark_data_smithi007_19526_object25793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.884 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.073091+0000", 2024-04-19T04:24:54.884 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.72468085000000004, 2024-04-19T04:24:54.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017751818999999999, 2024-04-19T04:24:54.885 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.885 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.885 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.885 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.885 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.885 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 25794 2024-04-19T04:24:54.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.885 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073091+0000", 2024-04-19T04:24:54.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073091+0000", 2024-04-19T04:24:54.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073089+0000", 2024-04-19T04:24:54.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073146+0000", 2024-04-19T04:24:54.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6011000000000003e-05 2024-04-19T04:24:54.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073162+0000", 2024-04-19T04:24:54.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6949e-05 2024-04-19T04:24:54.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073174+0000", 2024-04-19T04:24:54.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1538e-05 2024-04-19T04:24:54.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073244+0000", 2024-04-19T04:24:54.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9715000000000006e-05 2024-04-19T04:24:54.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073463+0000", 2024-04-19T04:24:54.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021919999999999999 2024-04-19T04:24:54.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:54.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073580+0000", 2024-04-19T04:24:54.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000116727 2024-04-19T04:24:54.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.075752+0000", 2024-04-19T04:24:54.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021724819999999999 2024-04-19T04:24:54.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.090747+0000", 2024-04-19T04:24:54.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014995059 2024-04-19T04:24:54.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.090790+0000", 2024-04-19T04:24:54.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3244999999999997e-05 2024-04-19T04:24:54.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.090842+0000", 2024-04-19T04:24:54.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2052000000000002e-05 2024-04-19T04:24:54.890 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.890 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.890 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.890 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.890 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:24:54.890 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.56224077800000005, 2024-04-19T04:24:54.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:24:54.890 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.890 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.890 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.890 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.890 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.891 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:24:54.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.891 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:24:54.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:24:54.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:24:54.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:54.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:24:54.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:24:54.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:24:54.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:24:54.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:24:54.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:24:54.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:24:54.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:24:54.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:24:54.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:24:54.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:24:54.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:24:54.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:24:54.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:24:54.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:24:54.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:24:54.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:24:54.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:24:54.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:24:54.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:24:54.895 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.896 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.896 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.896 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.896 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:24:54.896 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.55779186199999997, 2024-04-19T04:24:54.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:24:54.896 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.896 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.896 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.896 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.896 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.896 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:24:54.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.897 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:24:54.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:24:54.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:24:54.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:54.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:24:54.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:24:54.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:24:54.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:24:54.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:24:54.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:24:54.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:24:54.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:24:54.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:24:54.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:24:54.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:54.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:24:54.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:24:54.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:24:54.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:24:54.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:24:54.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:24:54.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:24:54.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:24:54.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:24:54.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:24:54.901 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.901 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.901 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.902 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26218 5.e 5:71096b4b:::benchmark_data_smithi007_19526_object26217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.902 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.299744+0000", 2024-04-19T04:24:54.902 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.49802763500000002, 2024-04-19T04:24:54.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015765136999999999, 2024-04-19T04:24:54.902 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.902 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.902 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.902 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.902 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.902 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26218 2024-04-19T04:24:54.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.902 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299744+0000", 2024-04-19T04:24:54.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299744+0000", 2024-04-19T04:24:54.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299743+0000", 2024-04-19T04:24:54.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:54.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299818+0000", 2024-04-19T04:24:54.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5840000000000006e-05 2024-04-19T04:24:54.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299827+0000", 2024-04-19T04:24:54.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5499999999999995e-06 2024-04-19T04:24:54.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299832+0000", 2024-04-19T04:24:54.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3569999999999997e-06 2024-04-19T04:24:54.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.301136+0000", 2024-04-19T04:24:54.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013039900000000001 2024-04-19T04:24:54.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.301220+0000", 2024-04-19T04:24:54.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3220999999999995e-05 2024-04-19T04:24:54.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:54.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.301339+0000", 2024-04-19T04:24:54.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119358 2024-04-19T04:24:54.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.302912+0000", 2024-04-19T04:24:54.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015726659999999999 2024-04-19T04:24:54.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.315424+0000", 2024-04-19T04:24:54.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012512452 2024-04-19T04:24:54.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.315479+0000", 2024-04-19T04:24:54.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4732999999999999e-05 2024-04-19T04:24:54.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.315509+0000", 2024-04-19T04:24:54.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0260000000000002e-05 2024-04-19T04:24:54.907 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.907 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.907 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.907 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26608 5.4 5:213b8aa4:::benchmark_data_smithi007_19526_object26607:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:54.907 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.459072+0000", 2024-04-19T04:24:54.907 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.33869911000000003, 2024-04-19T04:24:54.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013878537, 2024-04-19T04:24:54.907 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:54.908 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:54.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:54.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:54.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:54.908 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26608 2024-04-19T04:24:54.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.908 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:54.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:54.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.459072+0000", 2024-04-19T04:24:54.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:54.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.459072+0000", 2024-04-19T04:24:54.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:54.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:54.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.459072+0000", 2024-04-19T04:24:54.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:54.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:54.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.459192+0000", 2024-04-19T04:24:54.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012080500000000001 2024-04-19T04:24:54.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:54.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.459216+0000", 2024-04-19T04:24:54.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4019000000000002e-05 2024-04-19T04:24:54.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:54.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.459224+0000", 2024-04-19T04:24:54.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3900000000000004e-06 2024-04-19T04:24:54.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:54.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.459294+0000", 2024-04-19T04:24:54.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0611999999999994e-05 2024-04-19T04:24:54.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:54.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.459405+0000", 2024-04-19T04:24:54.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011042799999999999 2024-04-19T04:24:54.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:54.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.459495+0000", 2024-04-19T04:24:54.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9981999999999993e-05 2024-04-19T04:24:54.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:54.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.462320+0000", 2024-04-19T04:24:54.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028256800000000001 2024-04-19T04:24:54.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:54.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.472873+0000", 2024-04-19T04:24:54.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010552305 2024-04-19T04:24:54.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:54.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.472909+0000", 2024-04-19T04:24:54.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6677000000000001e-05 2024-04-19T04:24:54.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:54.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:54.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:54.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.472951+0000", 2024-04-19T04:24:54.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1464999999999997e-05 2024-04-19T04:24:54.913 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.913 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.913 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.913 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:54.913 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:54.913 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:24:54.914 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:54.910+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:54.915 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:24:55.015 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:55.011+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:55.048 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:55.048 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:24:55.048 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.049 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:28059 5.2 5:419f849f:::benchmark_data_smithi007_19526_object28058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T04:24:55.049 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:55.046094+0000", 2024-04-19T04:24:55.049 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0024147069999999999, 2024-04-19T04:24:55.049 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002433981, 2024-04-19T04:24:55.049 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.049 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:55.049 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:55.049 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:55.049 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:55.049 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 28059 2024-04-19T04:24:55.049 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.050 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.050 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.050 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.050 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046094+0000", 2024-04-19T04:24:55.050 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.050 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.050 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.050 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.050 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046094+0000", 2024-04-19T04:24:55.050 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.051 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.051 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.051 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.051 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046093+0000", 2024-04-19T04:24:55.051 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:55.051 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.051 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.051 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.051 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046122+0000", 2024-04-19T04:24:55.051 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9040999999999999e-05 2024-04-19T04:24:55.051 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.052 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.052 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.052 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046128+0000", 2024-04-19T04:24:55.052 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.789e-06 2024-04-19T04:24:55.052 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.052 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.052 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.052 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046134+0000", 2024-04-19T04:24:55.052 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4790000000000004e-06 2024-04-19T04:24:55.052 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.052 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.052 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.053 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046183+0000", 2024-04-19T04:24:55.053 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8900000000000003e-05 2024-04-19T04:24:55.053 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.053 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.053 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.053 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046362+0000", 2024-04-19T04:24:55.053 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017904800000000001 2024-04-19T04:24:55.053 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.053 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.053 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:55.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046517+0000", 2024-04-19T04:24:55.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000155449 2024-04-19T04:24:55.054 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.054 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.054 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.055 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:28060 5.f 5:fa87268d:::benchmark_data_smithi007_19526_object28059:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T04:24:55.055 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:55.046259+0000", 2024-04-19T04:24:55.055 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0022493270000000002, 2024-04-19T04:24:55.055 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002323019, 2024-04-19T04:24:55.055 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.055 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:55.055 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:55.055 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:55.055 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:55.055 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 28060 2024-04-19T04:24:55.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.055 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.056 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.056 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046259+0000", 2024-04-19T04:24:55.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.056 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.056 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.056 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046259+0000", 2024-04-19T04:24:55.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.056 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.056 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.056 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046258+0000", 2024-04-19T04:24:55.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:55.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.057 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.057 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046347+0000", 2024-04-19T04:24:55.057 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.8948000000000003e-05 2024-04-19T04:24:55.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.057 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.057 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046353+0000", 2024-04-19T04:24:55.057 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.66e-06 2024-04-19T04:24:55.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.057 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.057 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046357+0000", 2024-04-19T04:24:55.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9260000000000002e-06 2024-04-19T04:24:55.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.058 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.058 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046398+0000", 2024-04-19T04:24:55.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0994000000000001e-05 2024-04-19T04:24:55.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.058 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.058 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046524+0000", 2024-04-19T04:24:55.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012615599999999999 2024-04-19T04:24:55.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.058 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:55.059 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046659+0000", 2024-04-19T04:24:55.059 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013526200000000001 2024-04-19T04:24:55.059 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.059 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.059 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:55.059 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.048075+0000", 2024-04-19T04:24:55.059 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014158420000000001 2024-04-19T04:24:55.059 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.059 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.059 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.059 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.059 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.059 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:28065 5.2 5:406d0ba4:::benchmark_data_smithi007_19526_object28064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T04:24:55.059 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:55.048003+0000", 2024-04-19T04:24:55.059 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00050580600000000003, 2024-04-19T04:24:55.060 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00062304999999999999, 2024-04-19T04:24:55.060 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.060 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:55.060 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:55.060 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:55.060 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:55.060 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 28065 2024-04-19T04:24:55.060 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.060 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.060 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.060 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.060 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.048003+0000", 2024-04-19T04:24:55.060 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.060 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.060 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.061 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.048003+0000", 2024-04-19T04:24:55.061 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.061 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.048002+0000", 2024-04-19T04:24:55.061 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:55.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.061 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.048111+0000", 2024-04-19T04:24:55.061 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010950000000000001 2024-04-19T04:24:55.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.048127+0000", 2024-04-19T04:24:55.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6001000000000001e-05 2024-04-19T04:24:55.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.048134+0000", 2024-04-19T04:24:55.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3029999999999996e-06 2024-04-19T04:24:55.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.048171+0000", 2024-04-19T04:24:55.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7531999999999999e-05 2024-04-19T04:24:55.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.048298+0000", 2024-04-19T04:24:55.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012686699999999999 2024-04-19T04:24:55.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:55.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.048390+0000", 2024-04-19T04:24:55.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1669000000000006e-05 2024-04-19T04:24:55.063 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.063 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.063 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.063 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:28047 5.9 5:9637903e:::benchmark_data_smithi007_19526_object28046:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T04:24:55.064 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:55.041174+0000", 2024-04-19T04:24:55.064 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0073339850000000003, 2024-04-19T04:24:55.064 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0074911439999999999, 2024-04-19T04:24:55.064 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.064 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:55.064 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:55.064 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:55.064 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:55.064 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 28047 2024-04-19T04:24:55.064 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.064 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.064 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.064 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.064 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.041174+0000", 2024-04-19T04:24:55.064 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.065 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.065 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.065 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.065 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.041174+0000", 2024-04-19T04:24:55.065 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.065 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.065 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.065 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.065 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.041173+0000", 2024-04-19T04:24:55.065 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:55.065 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.065 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.065 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.065 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.041266+0000", 2024-04-19T04:24:55.066 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2455999999999997e-05 2024-04-19T04:24:55.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.066 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.066 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.041276+0000", 2024-04-19T04:24:55.066 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0182e-05 2024-04-19T04:24:55.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.066 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.066 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.041282+0000", 2024-04-19T04:24:55.066 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9660000000000001e-06 2024-04-19T04:24:55.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.066 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.042850+0000", 2024-04-19T04:24:55.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001567883 2024-04-19T04:24:55.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.043031+0000", 2024-04-19T04:24:55.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00018149999999999999 2024-04-19T04:24:55.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:55.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.043189+0000", 2024-04-19T04:24:55.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015752999999999999 2024-04-19T04:24:55.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:55.068 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.047153+0000", 2024-04-19T04:24:55.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0039638959999999997 2024-04-19T04:24:55.068 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.068 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.068 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.068 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:28049 5.f 5:f243f2a7:::benchmark_data_smithi007_19526_object28048:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T04:24:55.068 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:55.043374+0000", 2024-04-19T04:24:55.068 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0051348019999999999, 2024-04-19T04:24:55.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005333132, 2024-04-19T04:24:55.068 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.068 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:55.068 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:55.069 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:55.069 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:55.069 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 28049 2024-04-19T04:24:55.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.069 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.043374+0000", 2024-04-19T04:24:55.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.043374+0000", 2024-04-19T04:24:55.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.070 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.070 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.043373+0000", 2024-04-19T04:24:55.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:55.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.070 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.070 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.043438+0000", 2024-04-19T04:24:55.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5438999999999995e-05 2024-04-19T04:24:55.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.070 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.070 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.043453+0000", 2024-04-19T04:24:55.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5218000000000001e-05 2024-04-19T04:24:55.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.043461+0000", 2024-04-19T04:24:55.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0560000000000005e-06 2024-04-19T04:24:55.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.043509+0000", 2024-04-19T04:24:55.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7475000000000002e-05 2024-04-19T04:24:55.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.043623+0000", 2024-04-19T04:24:55.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114613 2024-04-19T04:24:55.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:55.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.043699+0000", 2024-04-19T04:24:55.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5153000000000004e-05 2024-04-19T04:24:55.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:55.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.045931+0000", 2024-04-19T04:24:55.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0022328600000000001 2024-04-19T04:24:55.072 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.072 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.072 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.073 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:28054 5.f 5:fe7bb5dd:::benchmark_data_smithi007_19526_object28053:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T04:24:55.073 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:55.044354+0000", 2024-04-19T04:24:55.073 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0041543379999999996, 2024-04-19T04:24:55.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0043954160000000001, 2024-04-19T04:24:55.073 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.073 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:55.073 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:55.073 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:55.073 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:55.073 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 28054 2024-04-19T04:24:55.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.073 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.044354+0000", 2024-04-19T04:24:55.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.044354+0000", 2024-04-19T04:24:55.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.044353+0000", 2024-04-19T04:24:55.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:55.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.044554+0000", 2024-04-19T04:24:55.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00020073700000000001 2024-04-19T04:24:55.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.044563+0000", 2024-04-19T04:24:55.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.3330000000000003e-06 2024-04-19T04:24:55.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.044570+0000", 2024-04-19T04:24:55.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4160000000000001e-06 2024-04-19T04:24:55.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.076 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.076 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.044624+0000", 2024-04-19T04:24:55.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4771999999999997e-05 2024-04-19T04:24:55.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.076 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.076 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.044703+0000", 2024-04-19T04:24:55.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8300000000000006e-05 2024-04-19T04:24:55.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.076 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:55.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.044783+0000", 2024-04-19T04:24:55.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0580000000000004e-05 2024-04-19T04:24:55.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:55.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.047948+0000", 2024-04-19T04:24:55.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031646230000000001 2024-04-19T04:24:55.077 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.077 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.077 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.077 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:28058 5.7 5:e74e46d9:::benchmark_data_smithi007_19526_object28057:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T04:24:55.077 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:55.046038+0000", 2024-04-19T04:24:55.077 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0024708600000000001, 2024-04-19T04:24:55.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027548070000000002, 2024-04-19T04:24:55.078 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.078 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:55.078 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:55.078 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:55.078 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:55.078 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 28058 2024-04-19T04:24:55.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.078 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046038+0000", 2024-04-19T04:24:55.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046038+0000", 2024-04-19T04:24:55.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046036+0000", 2024-04-19T04:24:55.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:55.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046064+0000", 2024-04-19T04:24:55.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.7302999999999999e-05 2024-04-19T04:24:55.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046078+0000", 2024-04-19T04:24:55.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3804e-05 2024-04-19T04:24:55.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046084+0000", 2024-04-19T04:24:55.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.088e-06 2024-04-19T04:24:55.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046130+0000", 2024-04-19T04:24:55.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6606000000000001e-05 2024-04-19T04:24:55.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.081 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046297+0000", 2024-04-19T04:24:55.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016647799999999999 2024-04-19T04:24:55.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.081 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.081 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:55.081 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.046467+0000", 2024-04-19T04:24:55.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017072699999999999 2024-04-19T04:24:55.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.081 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.081 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:55.081 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:55.048465+0000", 2024-04-19T04:24:55.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0019975129999999998 2024-04-19T04:24:55.081 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.081 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.081 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.082 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.082 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:24:55.082 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 7 2024-04-19T04:24:55.082 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:55.083 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:24:55.116 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:55.114+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:55.208 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:55.208 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:24:55.208 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:24:55.208 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:24:55.208 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:55.217 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:55.211+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:55.220 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:24:55.292 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:24:55.317 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:55.311+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:55.354 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:55.354 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:24:55.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:24:55.354 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:24:55.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.355 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:55.355 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:55.355 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.818164645000003, 2024-04-19T04:24:55.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026801078999999998, 2024-04-19T04:24:55.355 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.355 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:55.355 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:55.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.356 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:55.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.356 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533733+0000", 2024-04-19T04:24:55.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999976 2024-04-19T04:24:55.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.356 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533746+0000", 2024-04-19T04:24:55.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2679e-05 2024-04-19T04:24:55.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533769+0000", 2024-04-19T04:24:55.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2832000000000001e-05 2024-04-19T04:24:55.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.357 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:24:55.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0599999999999999e-05 2024-04-19T04:24:55.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.357 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533907+0000", 2024-04-19T04:24:55.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000118076 2024-04-19T04:24:55.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.357 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:55.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533919+0000", 2024-04-19T04:24:55.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1644999999999999e-05 2024-04-19T04:24:55.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553399+0000", 2024-04-19T04:24:55.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019479987000000001 2024-04-19T04:24:55.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553535+0000", 2024-04-19T04:24:55.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553400000000001 2024-04-19T04:24:55.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.359 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:55.359 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553696+0000", 2024-04-19T04:24:55.359 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000161068 2024-04-19T04:24:55.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.359 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.359 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:55.359 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558096+0000", 2024-04-19T04:24:55.359 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0043998880000000002 2024-04-19T04:24:55.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.359 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.359 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:55.359 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560465+0000", 2024-04-19T04:24:55.360 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023695159999999999 2024-04-19T04:24:55.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:55.360 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560513+0000", 2024-04-19T04:24:55.360 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7899000000000003e-05 2024-04-19T04:24:55.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.360 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560537+0000", 2024-04-19T04:24:55.360 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3768e-05 2024-04-19T04:24:55.360 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.360 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.361 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.361 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:55.361 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:55.361 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.818087571, 2024-04-19T04:24:55.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026864505, 2024-04-19T04:24:55.361 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.361 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:55.361 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:55.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.362 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:55.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.362 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533812+0000", 2024-04-19T04:24:55.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:55.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.363 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.363 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533818+0000", 2024-04-19T04:24:55.363 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2369999999999997e-06 2024-04-19T04:24:55.363 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.363 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.363 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.363 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533863+0000", 2024-04-19T04:24:55.363 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4515000000000003e-05 2024-04-19T04:24:55.363 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.363 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.363 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.363 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533880+0000", 2024-04-19T04:24:55.363 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7119e-05 2024-04-19T04:24:55.363 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.363 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.363 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.364 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534029+0000", 2024-04-19T04:24:55.364 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014955099999999999 2024-04-19T04:24:55.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.364 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.364 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:55.364 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534034+0000", 2024-04-19T04:24:55.364 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1649999999999997e-06 2024-04-19T04:24:55.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.364 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.364 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.364 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554888+0000", 2024-04-19T04:24:55.364 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020854075 2024-04-19T04:24:55.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.364 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.364 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554967+0000", 2024-04-19T04:24:55.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8209999999999998e-05 2024-04-19T04:24:55.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:55.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555087+0000", 2024-04-19T04:24:55.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000120411 2024-04-19T04:24:55.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:55.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559328+0000", 2024-04-19T04:24:55.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042409800000000001 2024-04-19T04:24:55.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:55.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560587+0000", 2024-04-19T04:24:55.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012587119999999999 2024-04-19T04:24:55.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:55.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560620+0000", 2024-04-19T04:24:55.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2716999999999999e-05 2024-04-19T04:24:55.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560677+0000", 2024-04-19T04:24:55.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7726999999999998e-05 2024-04-19T04:24:55.366 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.366 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.366 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.367 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:55.367 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:55.367 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.818005178, 2024-04-19T04:24:55.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027363064999999999, 2024-04-19T04:24:55.367 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.367 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:55.367 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.367 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:55.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:55.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533894+0000", 2024-04-19T04:24:55.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:55.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533913+0000", 2024-04-19T04:24:55.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8896e-05 2024-04-19T04:24:55.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533933+0000", 2024-04-19T04:24:55.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9775e-05 2024-04-19T04:24:55.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533967+0000", 2024-04-19T04:24:55.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4536000000000003e-05 2024-04-19T04:24:55.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:55.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553600000000001 2024-04-19T04:24:55.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:55.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534107+0000", 2024-04-19T04:24:55.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1470000000000003e-06 2024-04-19T04:24:55.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556463+0000", 2024-04-19T04:24:55.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022356536999999999 2024-04-19T04:24:55.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556586+0000", 2024-04-19T04:24:55.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122967 2024-04-19T04:24:55.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:55.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556738+0000", 2024-04-19T04:24:55.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015182800000000001 2024-04-19T04:24:55.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:55.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561020+0000", 2024-04-19T04:24:55.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042818819999999999 2024-04-19T04:24:55.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:55.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561183+0000", 2024-04-19T04:24:55.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000162683 2024-04-19T04:24:55.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:55.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561226+0000", 2024-04-19T04:24:55.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3686000000000002e-05 2024-04-19T04:24:55.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561258+0000", 2024-04-19T04:24:55.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1814999999999999e-05 2024-04-19T04:24:55.373 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.373 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.373 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.373 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:55.373 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:55.373 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.817914665000004, 2024-04-19T04:24:55.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027417816000000001, 2024-04-19T04:24:55.373 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.373 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:55.374 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.374 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:55.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.374 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:55.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.374 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533984+0000", 2024-04-19T04:24:55.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:55.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:55.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3876000000000001e-05 2024-04-19T04:24:55.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534015+0000", 2024-04-19T04:24:55.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6818999999999999e-05 2024-04-19T04:24:55.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534030+0000", 2024-04-19T04:24:55.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.537e-05 2024-04-19T04:24:55.376 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.376 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.376 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534152+0000", 2024-04-19T04:24:55.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121685 2024-04-19T04:24:55.376 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.376 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:55.376 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534156+0000", 2024-04-19T04:24:55.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9029999999999997e-06 2024-04-19T04:24:55.376 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.376 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.376 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557520+0000", 2024-04-19T04:24:55.377 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023364125999999999 2024-04-19T04:24:55.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557585+0000", 2024-04-19T04:24:55.377 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5275000000000001e-05 2024-04-19T04:24:55.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:55.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557719+0000", 2024-04-19T04:24:55.377 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013396299999999999 2024-04-19T04:24:55.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:55.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561133+0000", 2024-04-19T04:24:55.378 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034140989999999999 2024-04-19T04:24:55.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.378 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:55.378 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561352+0000", 2024-04-19T04:24:55.378 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0002185 2024-04-19T04:24:55.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.378 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:55.378 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561380+0000", 2024-04-19T04:24:55.378 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8317999999999999e-05 2024-04-19T04:24:55.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.378 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.379 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561403+0000", 2024-04-19T04:24:55.379 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3264999999999998e-05 2024-04-19T04:24:55.379 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.379 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.379 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.379 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.379 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.379 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:55.379 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:55.379 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.817851019999999, 2024-04-19T04:24:55.379 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029897119999999999, 2024-04-19T04:24:55.379 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.379 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:55.379 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.379 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.380 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.380 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:55.380 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.380 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.380 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.380 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:55.380 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.380 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.380 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534048+0000", 2024-04-19T04:24:55.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:55.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.381 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534057+0000", 2024-04-19T04:24:55.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7930000000000003e-06 2024-04-19T04:24:55.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.381 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534075+0000", 2024-04-19T04:24:55.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7846000000000002e-05 2024-04-19T04:24:55.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.382 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.382 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.382 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534089+0000", 2024-04-19T04:24:55.382 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4463e-05 2024-04-19T04:24:55.382 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.382 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.382 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.382 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534198+0000", 2024-04-19T04:24:55.382 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109145 2024-04-19T04:24:55.382 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.382 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:55.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534202+0000", 2024-04-19T04:24:55.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.98e-06 2024-04-19T04:24:55.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558221+0000", 2024-04-19T04:24:55.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024018208999999999 2024-04-19T04:24:55.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558320+0000", 2024-04-19T04:24:55.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9642000000000006e-05 2024-04-19T04:24:55.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.384 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.384 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:55.384 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558401+0000", 2024-04-19T04:24:55.384 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1038000000000006e-05 2024-04-19T04:24:55.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.384 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.384 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:55.384 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561173+0000", 2024-04-19T04:24:55.384 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027714549999999999 2024-04-19T04:24:55.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.385 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.385 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:55.385 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563851+0000", 2024-04-19T04:24:55.385 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026786010000000001 2024-04-19T04:24:55.385 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.385 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.385 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:55.385 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563906+0000", 2024-04-19T04:24:55.385 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4895999999999998e-05 2024-04-19T04:24:55.385 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.385 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.385 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.386 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563946+0000", 2024-04-19T04:24:55.386 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0116e-05 2024-04-19T04:24:55.386 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.386 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.386 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.386 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.386 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.386 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:55.386 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:55.386 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.817797638999998, 2024-04-19T04:24:55.386 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029917846000000001, 2024-04-19T04:24:55.386 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.386 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:55.387 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.387 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.387 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:55.387 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.387 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.387 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.387 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:55.387 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.387 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.387 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534101+0000", 2024-04-19T04:24:55.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:55.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534111+0000", 2024-04-19T04:24:55.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5659999999999996e-06 2024-04-19T04:24:55.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534129+0000", 2024-04-19T04:24:55.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7632999999999999e-05 2024-04-19T04:24:55.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.389 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.389 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534143+0000", 2024-04-19T04:24:55.389 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4362000000000001e-05 2024-04-19T04:24:55.389 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.389 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.389 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.389 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534256+0000", 2024-04-19T04:24:55.389 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113267 2024-04-19T04:24:55.389 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.389 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.389 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:55.389 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534260+0000", 2024-04-19T04:24:55.389 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9949999999999999e-06 2024-04-19T04:24:55.389 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.389 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.390 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.390 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558653+0000", 2024-04-19T04:24:55.390 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024393182999999999 2024-04-19T04:24:55.390 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.390 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.390 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.390 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558704+0000", 2024-04-19T04:24:55.390 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0303999999999998e-05 2024-04-19T04:24:55.390 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.390 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.390 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:55.390 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558782+0000", 2024-04-19T04:24:55.391 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8079999999999998e-05 2024-04-19T04:24:55.391 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.391 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.391 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:55.391 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561309+0000", 2024-04-19T04:24:55.391 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002527708 2024-04-19T04:24:55.391 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.391 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.391 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:55.391 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563952+0000", 2024-04-19T04:24:55.391 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026425450000000001 2024-04-19T04:24:55.391 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.392 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.392 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:55.392 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563996+0000", 2024-04-19T04:24:55.392 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3606000000000002e-05 2024-04-19T04:24:55.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.392 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.392 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.392 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564021+0000", 2024-04-19T04:24:55.392 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.491e-05 2024-04-19T04:24:55.392 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.392 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.392 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.393 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.393 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:55.393 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:55.393 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.817745127999999, 2024-04-19T04:24:55.393 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:24:55.393 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.393 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:55.393 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.393 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.393 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.393 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:55.393 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.393 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.393 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.394 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.394 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:55.394 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.394 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.394 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.394 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.394 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:24:55.394 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:55.394 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.394 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.394 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.394 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:24:55.394 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:24:55.394 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.394 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.395 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.395 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:24:55.395 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:24:55.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.395 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.395 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.395 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:24:55.395 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:24:55.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.395 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.395 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.395 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:24:55.395 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:24:55.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.395 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:55.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:24:55.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:24:55.396 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:24:55.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:24:55.396 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:24:55.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:24:55.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.397 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:55.397 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:24:55.397 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:24:55.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.397 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:55.397 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:24:55.397 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:24:55.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.397 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:55.397 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:24:55.398 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:24:55.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.398 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.398 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:55.398 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:24:55.398 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:24:55.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.398 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.398 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.398 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:24:55.398 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:24:55.398 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.398 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.398 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.399 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.399 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.399 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:55.399 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:55.399 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.817690583000001, 2024-04-19T04:24:55.399 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:24:55.399 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.399 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:55.399 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.399 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.399 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.399 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:55.399 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.399 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.400 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.400 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.400 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:55.400 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.400 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.400 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.400 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.400 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:24:55.400 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:55.400 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.400 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.400 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.401 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:24:55.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:24:55.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.401 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.401 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:24:55.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:24:55.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.401 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.401 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:24:55.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:24:55.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.402 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.402 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:24:55.402 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:24:55.402 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.402 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.402 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:55.402 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:24:55.402 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:24:55.402 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.402 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.402 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.402 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:24:55.402 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:24:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:24:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:24:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:24:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:24:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:55.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:24:55.404 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:24:55.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.404 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:55.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:24:55.404 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:24:55.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.404 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:55.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:24:55.404 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:24:55.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.405 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.405 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.405 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:24:55.405 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:24:55.405 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.405 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.405 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.405 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.405 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.405 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:55.405 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:24:55.405 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.120375997, 2024-04-19T04:24:55.405 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:24:55.405 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.405 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:55.406 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:55.406 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:55.406 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:55.406 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:24:55.406 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.406 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.406 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.406 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.406 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:24:55.406 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.406 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.406 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.406 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.406 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:24:55.407 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.407 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.407 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.407 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.407 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:24:55.407 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:55.407 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.407 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.407 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.407 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:24:55.407 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:24:55.407 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.407 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.407 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.408 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:24:55.408 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:24:55.408 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.408 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.408 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.408 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:24:55.408 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:24:55.408 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.408 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.408 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.408 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:24:55.408 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:24:55.408 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.408 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.408 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.409 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:24:55.409 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:24:55.409 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.409 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.409 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:55.409 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:24:55.409 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:24:55.409 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.409 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.409 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:55.409 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:24:55.409 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:24:55.409 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.409 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.410 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:55.410 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:24:55.410 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:24:55.410 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.410 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.410 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:55.410 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:24:55.410 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:24:55.410 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.410 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.410 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.411 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:24:55.411 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:24:55.411 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.411 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.411 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.411 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.411 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.411 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:55.411 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:24:55.411 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.1171948409999999, 2024-04-19T04:24:55.411 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:24:55.412 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.412 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:55.412 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:55.412 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:55.412 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:55.412 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:24:55.412 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.412 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.412 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.412 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.412 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:24:55.412 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.412 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.413 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.413 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.413 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:24:55.413 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.413 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.413 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.413 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.413 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:24:55.413 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:55.413 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.413 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.413 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.413 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:24:55.413 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:24:55.414 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.414 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.414 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.414 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:24:55.414 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:24:55.414 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.414 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.414 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.414 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:24:55.414 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:24:55.414 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.414 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.414 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.414 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:24:55.415 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:24:55.415 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.415 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.415 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.415 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:24:55.415 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:24:55.415 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.415 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.415 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:55.415 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:24:55.415 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:24:55.415 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.415 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.415 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:55.416 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:24:55.416 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:24:55.416 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.416 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.416 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:55.416 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:24:55.416 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:24:55.416 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.416 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.416 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:55.416 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:24:55.416 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:24:55.416 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.417 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.417 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.417 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:24:55.417 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:24:55.417 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.417 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.417 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.417 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.417 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.417 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:24:55.417 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:24:55.417 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.116626737, 2024-04-19T04:24:55.417 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:24:55.417 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.418 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:55.418 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.418 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.418 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.418 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:24:55.418 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.418 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.418 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.418 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.418 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:24:55.418 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.418 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.418 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.418 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.419 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:24:55.419 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:55.419 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.419 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.419 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.419 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:24:55.419 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:24:55.419 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.419 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.419 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.419 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:24:55.419 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:24:55.420 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.420 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.420 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.420 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:24:55.420 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:24:55.420 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.420 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.420 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.420 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:24:55.420 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:24:55.420 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.420 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.420 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.421 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:24:55.421 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:24:55.421 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.421 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.421 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:55.421 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:24:55.421 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:24:55.421 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.421 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.421 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.421 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:24:55.421 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:24:55.421 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.422 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.422 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.422 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.422 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.422 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:55.422 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:24:55.422 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.1162810759999999, 2024-04-19T04:24:55.422 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:24:55.422 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.422 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:55.422 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:55.422 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:55.422 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:55.422 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:24:55.423 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.423 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.423 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.423 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.423 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:24:55.423 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.423 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.423 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.423 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.423 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:24:55.423 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.423 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.423 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.423 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.424 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:24:55.424 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:55.424 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.424 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.424 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.424 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:24:55.424 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:24:55.424 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.424 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.424 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.424 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:24:55.424 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:24:55.424 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.424 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.425 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.425 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:24:55.425 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:24:55.425 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.425 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.425 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.425 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:24:55.425 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:24:55.425 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.425 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.425 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.425 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:24:55.425 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:24:55.425 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.426 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.426 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:55.426 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:24:55.426 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:24:55.426 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.426 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.426 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:55.426 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:24:55.426 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:24:55.427 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.427 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.427 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:55.427 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:24:55.427 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:24:55.427 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.427 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.427 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:55.427 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:24:55.427 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:24:55.427 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.427 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.427 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.427 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:24:55.427 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:24:55.428 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.428 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.428 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.428 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.428 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.428 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:24:55.428 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:24:55.428 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.1155566379999999, 2024-04-19T04:24:55.428 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:24:55.428 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.428 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:55.428 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.428 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.428 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.428 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:24:55.429 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.429 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.429 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.429 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.429 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:24:55.429 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.429 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.429 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.429 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.429 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:24:55.429 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:55.429 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.429 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.429 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.430 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:24:55.430 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:24:55.430 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.430 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.430 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.430 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:24:55.430 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:24:55.430 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.430 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.430 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.430 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:24:55.430 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:24:55.430 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.430 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.431 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.431 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:24:55.431 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:24:55.431 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.431 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.431 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.431 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:24:55.431 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:24:55.432 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.432 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.432 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:55.432 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:24:55.432 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:24:55.432 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.432 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.432 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.432 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:24:55.432 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:24:55.432 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.432 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.432 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.432 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.432 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.433 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:24:55.433 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:24:55.433 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.115549243, 2024-04-19T04:24:55.433 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:24:55.433 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.433 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:55.433 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.433 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.433 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.433 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:24:55.433 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.433 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.433 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.433 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.433 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:24:55.434 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.434 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.434 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.434 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.434 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:24:55.434 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:55.434 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.434 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.434 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.434 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:24:55.434 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:24:55.434 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.434 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.434 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.435 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:24:55.435 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:24:55.435 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.435 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.435 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.435 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:24:55.435 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:24:55.435 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.435 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.435 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.435 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:24:55.435 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:24:55.435 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.435 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.435 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.436 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:24:55.436 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:24:55.436 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.436 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.436 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:55.436 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:24:55.436 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:24:55.436 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.436 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.436 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.436 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:24:55.436 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:24:55.436 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.436 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.437 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.437 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.437 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.437 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:55.437 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:24:55.437 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.1137240959999999, 2024-04-19T04:24:55.437 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:24:55.437 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.437 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:55.437 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:55.437 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:55.437 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:55.437 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:24:55.437 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.437 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.437 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.438 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.438 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:24:55.438 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.438 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.438 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.438 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.438 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:24:55.438 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.438 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.438 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.438 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.438 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:24:55.438 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:55.438 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.439 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.439 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.439 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:24:55.439 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:24:55.439 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.439 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.439 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.439 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:24:55.439 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:24:55.439 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.439 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.439 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.439 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:24:55.439 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:24:55.440 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.440 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.440 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.440 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:24:55.440 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:24:55.440 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.440 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.440 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.440 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:24:55.440 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:24:55.440 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.440 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.440 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:55.440 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:24:55.441 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:24:55.441 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.441 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.441 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:55.441 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:24:55.441 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:24:55.441 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.441 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.441 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:55.441 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:24:55.441 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:24:55.441 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.441 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.441 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:55.441 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:24:55.442 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:24:55.442 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.442 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.442 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.442 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:24:55.442 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:24:55.442 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.442 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.442 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.442 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.442 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.442 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26148 5.9 e27/20 ondisk, result = 0)", 2024-04-19T04:24:55.442 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:24:55.442 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.1136237710000001, 2024-04-19T04:24:55.443 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.042005175999999998, 2024-04-19T04:24:55.443 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.443 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:55.443 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.443 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.443 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.443 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:24:55.443 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.444 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.444 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.444 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.444 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:24:55.444 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.444 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.444 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.444 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.444 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238276+0000", 2024-04-19T04:24:55.444 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:55.445 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.445 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.445 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.445 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238280+0000", 2024-04-19T04:24:55.445 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6399999999999999e-06 2024-04-19T04:24:55.445 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.445 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.445 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.445 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238286+0000", 2024-04-19T04:24:55.445 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2099999999999998e-06 2024-04-19T04:24:55.445 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.445 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.445 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.445 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238290+0000", 2024-04-19T04:24:55.445 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2470000000000002e-06 2024-04-19T04:24:55.446 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.446 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.446 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.446 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239526+0000", 2024-04-19T04:24:55.446 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012362619999999999 2024-04-19T04:24:55.446 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.446 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.446 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.446 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239538+0000", 2024-04-19T04:24:55.446 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1620999999999999e-05 2024-04-19T04:24:55.446 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.446 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.446 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.446 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280282+0000", 2024-04-19T04:24:55.447 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040743691999999998 2024-04-19T04:24:55.447 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.447 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.447 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.447 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.447 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.447 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:55.447 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:24:55.447 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.112989891, 2024-04-19T04:24:55.447 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:24:55.447 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.447 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:55.447 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:55.447 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:55.447 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:55.448 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:24:55.448 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.448 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.448 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.448 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.448 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:24:55.448 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.448 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.448 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.448 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.448 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:24:55.448 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.448 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.448 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.448 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.449 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:24:55.449 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:55.449 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.449 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.449 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.449 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:24:55.449 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:24:55.449 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.449 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.449 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.449 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:24:55.449 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:24:55.449 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.449 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.449 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.449 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:24:55.450 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:24:55.450 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.450 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.450 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.450 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:24:55.450 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:24:55.450 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.450 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.450 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.450 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:24:55.450 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:24:55.450 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.450 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.450 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:55.450 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:24:55.451 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:24:55.451 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.451 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.451 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:55.451 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:24:55.451 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:24:55.451 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.451 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.451 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:55.451 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:24:55.451 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:24:55.451 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.451 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.451 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:55.451 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:24:55.452 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:24:55.452 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.452 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.452 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.452 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:24:55.452 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:24:55.452 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.452 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.452 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.452 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.452 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.452 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:24:55.452 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:24:55.452 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.112455615, 2024-04-19T04:24:55.452 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:24:55.453 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.453 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:55.453 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.453 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.453 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.453 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:24:55.453 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.453 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.453 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.453 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.453 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:24:55.453 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.453 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.453 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.453 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.454 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:24:55.454 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:55.454 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.454 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.454 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.454 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:24:55.454 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:24:55.454 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.454 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.454 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.454 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:24:55.454 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:24:55.454 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.454 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.454 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.455 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:24:55.455 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:24:55.455 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.455 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.455 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.455 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:24:55.455 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:24:55.455 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.457 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.457 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.457 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:24:55.458 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:24:55.458 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.458 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.458 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:55.458 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:24:55.458 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:24:55.458 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.458 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.458 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.458 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:24:55.458 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:24:55.458 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.458 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.458 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.459 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.459 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26160 5.f e27/20 ondisk, result = 0)", 2024-04-19T04:24:55.459 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:24:55.459 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.1113402400000001, 2024-04-19T04:24:55.459 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039752357000000002, 2024-04-19T04:24:55.459 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.459 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:55.459 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.459 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.459 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.459 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:24:55.459 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.460 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.460 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:24:55.460 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.460 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.460 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240559+0000", 2024-04-19T04:24:55.460 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:55.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.460 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.460 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240569+0000", 2024-04-19T04:24:55.460 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7720000000000006e-06 2024-04-19T04:24:55.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.461 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.461 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.461 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280164+0000", 2024-04-19T04:24:55.461 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039595324000000001 2024-04-19T04:24:55.461 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.461 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.461 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.461 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280190+0000", 2024-04-19T04:24:55.461 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5692000000000001e-05 2024-04-19T04:24:55.461 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.461 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.461 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.461 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280287+0000", 2024-04-19T04:24:55.461 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7536999999999998e-05 2024-04-19T04:24:55.461 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.462 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.462 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.462 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280299+0000", 2024-04-19T04:24:55.462 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2057e-05 2024-04-19T04:24:55.462 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.462 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.462 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.462 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:24:55.462 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3244999999999999e-05 2024-04-19T04:24:55.462 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.462 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.462 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.462 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.462 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.462 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26179 5.3 e27/20 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head v 27'1624, mlcod=27'1621)", 2024-04-19T04:24:55.463 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:24:55.463 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.1081864880000001, 2024-04-19T04:24:55.463 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039964081999999998, 2024-04-19T04:24:55.463 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:55.463 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:55.463 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:55.463 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.463 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:55.463 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:24:55.463 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.463 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.463 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.463 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:55.463 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:24:55.463 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:55.464 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.464 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.464 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:55.464 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243713+0000", 2024-04-19T04:24:55.464 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:55.464 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.464 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.464 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:55.464 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243750+0000", 2024-04-19T04:24:55.464 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6704e-05 2024-04-19T04:24:55.464 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.464 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.464 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:55.464 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280162+0000", 2024-04-19T04:24:55.464 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036412117000000001 2024-04-19T04:24:55.465 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.465 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.465 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:55.465 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280186+0000", 2024-04-19T04:24:55.465 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4825999999999999e-05 2024-04-19T04:24:55.465 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.465 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.465 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:55.465 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:24:55.465 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012540000000000001 2024-04-19T04:24:55.465 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.465 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.465 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:55.465 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280347+0000", 2024-04-19T04:24:55.465 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4894000000000002e-05 2024-04-19T04:24:55.465 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.466 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.466 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:55.466 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283654+0000", 2024-04-19T04:24:55.466 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00330716 2024-04-19T04:24:55.466 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:55.466 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:55.466 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:55.466 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283678+0000", 2024-04-19T04:24:55.466 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3992e-05 2024-04-19T04:24:55.466 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.466 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.466 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.466 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:55.466 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:55.466 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:55.467 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:24:55.468 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:24:55.469 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:55.462+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:55.481 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-04-19T04:24:55.501 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:24:55.504 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:24:55.504 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T04:24:55.505 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:24:55.568 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:55.566+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:55.611 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:55.611 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:55.625 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:24:55.670 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:55.663+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:55.719 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.2 primary-affinity to 0.318936 (8209012) 2024-04-19T04:24:55.751 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 11 16 29758 29742 168.969 152.438 0.00805649 0.00591019 2024-04-19T04:24:55.753 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:55.753 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:55.765 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:24:55.772 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:55.766+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:55.866 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:55.866 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:55.874 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:24:55.874 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:55.870+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:55.974 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:55.971+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:55.994 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:55.994 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:56.004 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:24:56.075 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:56.074+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:56.113 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:56.114 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:56.123 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:24:56.176 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:56.174+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:56.229 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:56.229 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:56.238 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:24:56.278 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:56.278+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:56.358 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:56.358 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:56.367 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:24:56.379 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:56.375+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:56.477 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:56.477 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:56.480 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:56.478+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:56.488 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:24:56.581 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:56.578+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:56.593 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:56.593 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:56.602 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:24:56.683 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:56.682+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:56.719 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:56.720 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:56.731 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:24:56.732 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T04:24:56.751 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 12 16 29803 29787 155.122 2.8125 1.01591 0.00607683 2024-04-19T04:24:56.783 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:56.782+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:56.865 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:56.865 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:56.879 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:24:56.884 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:56.882+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:56.984 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:56.982+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:57.017 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:57.017 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:57.030 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:24:57.085 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:57.082+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:57.163 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:57.164 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:57.175 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:24:57.186 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:57.186+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:57.287 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:57.282+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:57.298 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:57.298 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:57.309 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:24:57.388 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:57.386+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:57.428 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:57.428 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:57.440 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:24:57.489 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:57.483+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:57.516 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:24:57.569 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:24:57.570 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:24:57.582 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:24:57.590 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:57.583+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:57.679 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:24:57.690 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:57.690+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:57.700 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-04-19T04:24:57.713 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:57.714 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:24:57.714 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:24:57.714 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:24:57.714 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:57.720 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:24:57.724 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:24:57.724 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:24:57.724 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T04:24:57.724 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:24:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2024-04-19T04:24:57.751 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 13 16 32177 32161 154.602 148.375 0.00556633 0.00646222 2024-04-19T04:24:57.791 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:57.790+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:57.856 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:57.857 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:24:57.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:24:57.857 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:24:57.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.857 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:57.857 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:57.857 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 37.321524486000001, 2024-04-19T04:24:57.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026801078999999998, 2024-04-19T04:24:57.857 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.857 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:57.857 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:57.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:57.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533733+0000", 2024-04-19T04:24:57.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999976 2024-04-19T04:24:57.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533746+0000", 2024-04-19T04:24:57.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2679e-05 2024-04-19T04:24:57.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533769+0000", 2024-04-19T04:24:57.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2832000000000001e-05 2024-04-19T04:24:57.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:24:57.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0599999999999999e-05 2024-04-19T04:24:57.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533907+0000", 2024-04-19T04:24:57.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000118076 2024-04-19T04:24:57.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:57.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533919+0000", 2024-04-19T04:24:57.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1644999999999999e-05 2024-04-19T04:24:57.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553399+0000", 2024-04-19T04:24:57.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019479987000000001 2024-04-19T04:24:57.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553535+0000", 2024-04-19T04:24:57.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553400000000001 2024-04-19T04:24:57.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:57.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553696+0000", 2024-04-19T04:24:57.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000161068 2024-04-19T04:24:57.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:57.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558096+0000", 2024-04-19T04:24:57.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0043998880000000002 2024-04-19T04:24:57.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:57.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560465+0000", 2024-04-19T04:24:57.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023695159999999999 2024-04-19T04:24:57.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:57.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560513+0000", 2024-04-19T04:24:57.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7899000000000003e-05 2024-04-19T04:24:57.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560537+0000", 2024-04-19T04:24:57.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3768e-05 2024-04-19T04:24:57.863 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.863 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.863 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.863 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:57.863 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:57.863 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 37.321447411999998, 2024-04-19T04:24:57.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026864505, 2024-04-19T04:24:57.863 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.863 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:57.863 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:57.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:57.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533812+0000", 2024-04-19T04:24:57.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:57.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533818+0000", 2024-04-19T04:24:57.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2369999999999997e-06 2024-04-19T04:24:57.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533863+0000", 2024-04-19T04:24:57.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4515000000000003e-05 2024-04-19T04:24:57.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533880+0000", 2024-04-19T04:24:57.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7119e-05 2024-04-19T04:24:57.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534029+0000", 2024-04-19T04:24:57.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014955099999999999 2024-04-19T04:24:57.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:57.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534034+0000", 2024-04-19T04:24:57.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1649999999999997e-06 2024-04-19T04:24:57.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554888+0000", 2024-04-19T04:24:57.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020854075 2024-04-19T04:24:57.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554967+0000", 2024-04-19T04:24:57.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8209999999999998e-05 2024-04-19T04:24:57.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:57.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555087+0000", 2024-04-19T04:24:57.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000120411 2024-04-19T04:24:57.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:57.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559328+0000", 2024-04-19T04:24:57.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042409800000000001 2024-04-19T04:24:57.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:57.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560587+0000", 2024-04-19T04:24:57.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012587119999999999 2024-04-19T04:24:57.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:57.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560620+0000", 2024-04-19T04:24:57.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2716999999999999e-05 2024-04-19T04:24:57.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560677+0000", 2024-04-19T04:24:57.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7726999999999998e-05 2024-04-19T04:24:57.868 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.868 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.869 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.869 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:57.869 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:57.869 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 37.321365018999998, 2024-04-19T04:24:57.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027363064999999999, 2024-04-19T04:24:57.869 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.869 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:57.869 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:57.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:57.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533894+0000", 2024-04-19T04:24:57.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:57.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533913+0000", 2024-04-19T04:24:57.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8896e-05 2024-04-19T04:24:57.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533933+0000", 2024-04-19T04:24:57.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9775e-05 2024-04-19T04:24:57.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533967+0000", 2024-04-19T04:24:57.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4536000000000003e-05 2024-04-19T04:24:57.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:57.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553600000000001 2024-04-19T04:24:57.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:57.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534107+0000", 2024-04-19T04:24:57.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1470000000000003e-06 2024-04-19T04:24:57.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556463+0000", 2024-04-19T04:24:57.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022356536999999999 2024-04-19T04:24:57.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556586+0000", 2024-04-19T04:24:57.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122967 2024-04-19T04:24:57.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:57.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556738+0000", 2024-04-19T04:24:57.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015182800000000001 2024-04-19T04:24:57.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:57.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561020+0000", 2024-04-19T04:24:57.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042818819999999999 2024-04-19T04:24:57.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:57.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561183+0000", 2024-04-19T04:24:57.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000162683 2024-04-19T04:24:57.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:57.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561226+0000", 2024-04-19T04:24:57.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3686000000000002e-05 2024-04-19T04:24:57.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561258+0000", 2024-04-19T04:24:57.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1814999999999999e-05 2024-04-19T04:24:57.874 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.875 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.875 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.875 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:57.875 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:57.875 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 37.321274506000002, 2024-04-19T04:24:57.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027417816000000001, 2024-04-19T04:24:57.875 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.875 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:57.875 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:57.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:57.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533984+0000", 2024-04-19T04:24:57.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:57.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:57.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3876000000000001e-05 2024-04-19T04:24:57.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534015+0000", 2024-04-19T04:24:57.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6818999999999999e-05 2024-04-19T04:24:57.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534030+0000", 2024-04-19T04:24:57.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.537e-05 2024-04-19T04:24:57.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534152+0000", 2024-04-19T04:24:57.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121685 2024-04-19T04:24:57.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:57.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534156+0000", 2024-04-19T04:24:57.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9029999999999997e-06 2024-04-19T04:24:57.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557520+0000", 2024-04-19T04:24:57.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023364125999999999 2024-04-19T04:24:57.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557585+0000", 2024-04-19T04:24:57.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5275000000000001e-05 2024-04-19T04:24:57.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:57.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557719+0000", 2024-04-19T04:24:57.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013396299999999999 2024-04-19T04:24:57.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:57.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561133+0000", 2024-04-19T04:24:57.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034140989999999999 2024-04-19T04:24:57.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:57.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561352+0000", 2024-04-19T04:24:57.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0002185 2024-04-19T04:24:57.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:57.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561380+0000", 2024-04-19T04:24:57.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8317999999999999e-05 2024-04-19T04:24:57.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561403+0000", 2024-04-19T04:24:57.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3264999999999998e-05 2024-04-19T04:24:57.880 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.880 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.881 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.881 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:57.881 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:57.881 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 37.321210860999997, 2024-04-19T04:24:57.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029897119999999999, 2024-04-19T04:24:57.881 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.881 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:57.881 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:57.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:57.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534048+0000", 2024-04-19T04:24:57.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:57.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534057+0000", 2024-04-19T04:24:57.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7930000000000003e-06 2024-04-19T04:24:57.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534075+0000", 2024-04-19T04:24:57.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7846000000000002e-05 2024-04-19T04:24:57.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534089+0000", 2024-04-19T04:24:57.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4463e-05 2024-04-19T04:24:57.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534198+0000", 2024-04-19T04:24:57.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109145 2024-04-19T04:24:57.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:57.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534202+0000", 2024-04-19T04:24:57.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.98e-06 2024-04-19T04:24:57.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558221+0000", 2024-04-19T04:24:57.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024018208999999999 2024-04-19T04:24:57.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558320+0000", 2024-04-19T04:24:57.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9642000000000006e-05 2024-04-19T04:24:57.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:57.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558401+0000", 2024-04-19T04:24:57.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1038000000000006e-05 2024-04-19T04:24:57.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:57.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561173+0000", 2024-04-19T04:24:57.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027714549999999999 2024-04-19T04:24:57.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.886 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:57.886 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563851+0000", 2024-04-19T04:24:57.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026786010000000001 2024-04-19T04:24:57.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.886 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:57.886 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563906+0000", 2024-04-19T04:24:57.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4895999999999998e-05 2024-04-19T04:24:57.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.886 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.886 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563946+0000", 2024-04-19T04:24:57.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0116e-05 2024-04-19T04:24:57.887 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.887 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.887 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.887 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:57.887 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:57.887 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 37.321157479999997, 2024-04-19T04:24:57.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029917846000000001, 2024-04-19T04:24:57.887 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.887 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:57.887 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:57.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:57.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534101+0000", 2024-04-19T04:24:57.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:57.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534111+0000", 2024-04-19T04:24:57.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5659999999999996e-06 2024-04-19T04:24:57.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534129+0000", 2024-04-19T04:24:57.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7632999999999999e-05 2024-04-19T04:24:57.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534143+0000", 2024-04-19T04:24:57.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4362000000000001e-05 2024-04-19T04:24:57.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534256+0000", 2024-04-19T04:24:57.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113267 2024-04-19T04:24:57.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:57.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534260+0000", 2024-04-19T04:24:57.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9949999999999999e-06 2024-04-19T04:24:57.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558653+0000", 2024-04-19T04:24:57.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024393182999999999 2024-04-19T04:24:57.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558704+0000", 2024-04-19T04:24:57.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0303999999999998e-05 2024-04-19T04:24:57.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:57.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558782+0000", 2024-04-19T04:24:57.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8079999999999998e-05 2024-04-19T04:24:57.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:57.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561309+0000", 2024-04-19T04:24:57.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002527708 2024-04-19T04:24:57.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:57.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563952+0000", 2024-04-19T04:24:57.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026425450000000001 2024-04-19T04:24:57.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:57.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563996+0000", 2024-04-19T04:24:57.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3606000000000002e-05 2024-04-19T04:24:57.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564021+0000", 2024-04-19T04:24:57.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.491e-05 2024-04-19T04:24:57.892 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.892 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.893 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.893 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:57.893 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:57.893 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 37.321104968999997, 2024-04-19T04:24:57.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:24:57.893 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.893 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:57.893 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.893 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.893 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:57.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:57.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:24:57.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:57.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:24:57.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:24:57.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:24:57.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:24:57.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:24:57.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:24:57.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:24:57.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:24:57.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:57.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:24:57.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:24:57.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:24:57.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:24:57.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:24:57.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:24:57.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:57.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:24:57.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:24:57.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:57.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:24:57.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:24:57.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:57.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:24:57.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:24:57.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.899 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:57.899 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:57.899 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 37.321050423999999, 2024-04-19T04:24:57.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:24:57.899 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.899 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:57.899 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:57.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:57.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:24:57.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:57.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:24:57.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:24:57.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:24:57.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:24:57.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:24:57.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:24:57.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:24:57.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:24:57.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:57.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:24:57.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:24:57.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:24:57.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:24:57.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.903 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.903 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:24:57.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:24:57.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.903 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:57.903 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:24:57.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:24:57.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.903 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:57.903 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:24:57.904 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:24:57.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:57.904 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:24:57.904 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:24:57.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:57.904 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:24:57.904 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:24:57.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:24:57.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:24:57.905 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.905 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.905 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.905 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:57.905 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:24:57.905 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 3.623735838, 2024-04-19T04:24:57.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:24:57.905 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.905 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:57.905 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:57.906 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:57.906 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:57.906 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:24:57.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.906 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:24:57.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:24:57.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:24:57.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:57.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:24:57.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:24:57.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:24:57.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:24:57.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:24:57.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:24:57.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:24:57.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:24:57.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:24:57.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:24:57.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.909 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:57.909 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:24:57.909 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:24:57.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.909 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:57.909 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:24:57.909 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:24:57.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.909 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:57.909 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:24:57.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:24:57.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:57.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:24:57.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:24:57.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:24:57.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:24:57.910 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.910 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.910 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.911 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:57.911 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:24:57.911 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 3.6205546819999999, 2024-04-19T04:24:57.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:24:57.911 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.911 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:57.911 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:57.911 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:57.911 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:57.911 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:24:57.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.911 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:24:57.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:24:57.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:24:57.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:57.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:24:57.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:24:57.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:24:57.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:24:57.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:24:57.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:24:57.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:24:57.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:24:57.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:24:57.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:24:57.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:57.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:24:57.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:24:57.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:57.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:24:57.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:24:57.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:57.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:24:57.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:24:57.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:57.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:24:57.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:24:57.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:24:57.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:24:57.916 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.916 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.916 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.916 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:24:57.916 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:24:57.916 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 3.6199865779999998, 2024-04-19T04:24:57.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:24:57.917 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.917 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:57.917 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:24:57.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:24:57.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:24:57.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:57.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:24:57.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:24:57.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:24:57.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:24:57.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:24:57.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:24:57.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:24:57.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:24:57.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:24:57.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:24:57.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:57.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:24:57.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:24:57.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:24:57.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:24:57.923 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.923 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.923 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.923 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:57.923 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:24:57.923 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 3.6196409169999999, 2024-04-19T04:24:57.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:24:57.923 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.923 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:57.923 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:57.923 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:57.923 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:57.923 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:24:57.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.924 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:24:57.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:24:57.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:24:57.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:57.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:24:57.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:24:57.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:24:57.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:24:57.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:24:57.926 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:24:57.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.926 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.926 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:24:57.926 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:24:57.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.926 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.926 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:24:57.926 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:24:57.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.926 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:57.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:24:57.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:24:57.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:57.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:24:57.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:24:57.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:57.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:24:57.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:24:57.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:57.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:24:57.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:24:57.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:24:57.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:24:57.928 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.928 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.928 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.928 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:24:57.928 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:24:57.929 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 3.6189164790000001, 2024-04-19T04:24:57.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:24:57.929 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.929 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:57.929 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:24:57.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:24:57.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.930 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.930 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:24:57.930 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:57.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.930 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.930 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:24:57.930 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:24:57.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.930 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.930 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:24:57.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:24:57.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:24:57.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:24:57.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:24:57.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:24:57.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:24:57.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:24:57.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.932 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:57.932 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:24:57.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:24:57.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.932 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.932 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:24:57.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:24:57.932 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.932 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.932 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.933 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:24:57.933 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:24:57.933 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 3.6189090840000002, 2024-04-19T04:24:57.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:24:57.933 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.933 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:57.933 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.933 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:24:57.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.934 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.934 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:24:57.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.934 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.934 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:24:57.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:57.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.934 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.934 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:24:57.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:24:57.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.935 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.935 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.935 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:24:57.935 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:24:57.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.935 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.935 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.935 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:24:57.935 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:24:57.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.935 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.935 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.935 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:24:57.935 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:24:57.936 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.936 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.936 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.936 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:24:57.936 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:24:57.936 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.936 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.936 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:57.936 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:24:57.936 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:24:57.936 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.936 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.936 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.936 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:24:57.936 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:24:57.936 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.937 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.937 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.937 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.937 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.937 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:57.937 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:24:57.937 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 3.6170839369999999, 2024-04-19T04:24:57.937 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:24:57.937 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.937 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:57.937 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:57.937 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:57.937 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:57.937 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:24:57.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.938 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.938 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.938 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.938 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:24:57.938 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.938 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.938 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.938 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:24:57.938 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.938 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.938 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.939 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:24:57.939 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:57.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.939 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.939 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.939 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:24:57.939 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:24:57.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.939 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.939 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.939 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:24:57.939 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:24:57.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.939 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.939 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.940 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:24:57.940 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:24:57.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.940 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.940 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:24:57.940 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:24:57.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.940 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.940 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:24:57.940 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:24:57.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.940 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:57.941 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:24:57.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:24:57.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.941 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.941 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:57.941 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:24:57.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:24:57.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.941 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.941 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:57.941 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:24:57.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:24:57.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.941 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.941 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:57.942 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:24:57.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:24:57.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.942 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.942 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.942 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:24:57.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:24:57.942 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.942 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.942 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.942 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.943 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26148 5.9 e27/20 ondisk, result = 0)", 2024-04-19T04:24:57.943 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:24:57.943 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 3.6169836119999998, 2024-04-19T04:24:57.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.042005175999999998, 2024-04-19T04:24:57.943 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.943 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:57.943 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:24:57.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.944 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:24:57.944 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.944 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238276+0000", 2024-04-19T04:24:57.944 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:57.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.944 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238280+0000", 2024-04-19T04:24:57.944 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6399999999999999e-06 2024-04-19T04:24:57.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238286+0000", 2024-04-19T04:24:57.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2099999999999998e-06 2024-04-19T04:24:57.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.945 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238290+0000", 2024-04-19T04:24:57.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2470000000000002e-06 2024-04-19T04:24:57.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.945 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239526+0000", 2024-04-19T04:24:57.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012362619999999999 2024-04-19T04:24:57.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239538+0000", 2024-04-19T04:24:57.946 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1620999999999999e-05 2024-04-19T04:24:57.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280282+0000", 2024-04-19T04:24:57.946 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040743691999999998 2024-04-19T04:24:57.946 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.946 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.946 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.946 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:57.946 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:24:57.947 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 3.6163497319999998, 2024-04-19T04:24:57.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:24:57.947 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.947 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:57.947 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:57.947 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:57.947 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:57.947 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:24:57.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.947 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.947 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.947 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.947 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:24:57.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:24:57.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:24:57.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:57.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:24:57.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:24:57.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:24:57.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:24:57.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:24:57.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:24:57.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:24:57.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:24:57.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:24:57.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:24:57.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:57.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:24:57.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:24:57.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:57.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:24:57.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:24:57.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:57.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:24:57.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:24:57.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:57.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:24:57.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:24:57.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:24:57.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:24:57.952 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.952 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.952 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.952 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.952 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.952 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:24:57.952 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:24:57.952 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 3.615815456, 2024-04-19T04:24:57.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:24:57.952 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.952 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:57.952 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.952 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.952 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.953 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:24:57.953 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.953 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.953 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.953 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.953 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:24:57.953 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.953 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.953 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.953 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.953 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:24:57.953 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:57.953 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.953 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.953 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.954 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:24:57.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:24:57.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.954 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.954 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.954 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:24:57.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:24:57.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.954 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.954 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.954 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:24:57.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:24:57.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.954 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.955 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.955 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:24:57.955 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:24:57.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.955 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.955 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:24:57.955 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:24:57.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.955 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:57.955 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:24:57.955 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:24:57.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:24:57.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:24:57.956 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.956 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.956 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.956 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26160 5.f e27/20 ondisk, result = 0)", 2024-04-19T04:24:57.956 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:24:57.956 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 3.6147000810000001, 2024-04-19T04:24:57.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039752357000000002, 2024-04-19T04:24:57.956 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.956 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:57.956 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:24:57.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:24:57.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240559+0000", 2024-04-19T04:24:57.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:57.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240569+0000", 2024-04-19T04:24:57.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7720000000000006e-06 2024-04-19T04:24:57.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280164+0000", 2024-04-19T04:24:57.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039595324000000001 2024-04-19T04:24:57.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280190+0000", 2024-04-19T04:24:57.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5692000000000001e-05 2024-04-19T04:24:57.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.959 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.959 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.959 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280287+0000", 2024-04-19T04:24:57.959 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7536999999999998e-05 2024-04-19T04:24:57.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.959 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.959 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.959 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280299+0000", 2024-04-19T04:24:57.959 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2057e-05 2024-04-19T04:24:57.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.959 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.959 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.959 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:24:57.959 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3244999999999999e-05 2024-04-19T04:24:57.960 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.960 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.960 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.960 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26179 5.3 e27/20 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head v 27'1624, mlcod=27'1621)", 2024-04-19T04:24:57.960 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:24:57.960 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 3.6115463290000003, 2024-04-19T04:24:57.960 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039964081999999998, 2024-04-19T04:24:57.960 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:57.960 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:57.960 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:57.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.960 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:57.960 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:24:57.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:57.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:24:57.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:57.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:57.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243713+0000", 2024-04-19T04:24:57.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:57.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:57.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243750+0000", 2024-04-19T04:24:57.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6704e-05 2024-04-19T04:24:57.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:57.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280162+0000", 2024-04-19T04:24:57.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036412117000000001 2024-04-19T04:24:57.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:57.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280186+0000", 2024-04-19T04:24:57.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4825999999999999e-05 2024-04-19T04:24:57.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:57.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:24:57.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012540000000000001 2024-04-19T04:24:57.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:57.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280347+0000", 2024-04-19T04:24:57.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4894000000000002e-05 2024-04-19T04:24:57.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:57.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283654+0000", 2024-04-19T04:24:57.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00330716 2024-04-19T04:24:57.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:57.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:57.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:57.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283678+0000", 2024-04-19T04:24:57.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3992e-05 2024-04-19T04:24:57.964 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.964 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.964 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.964 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:57.964 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:57.964 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:57.965 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:24:57.966 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:57.959+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:58.066 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:58.066+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:58.106 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:24:58.106 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [ 2024-04-19T04:24:58.106 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.106 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:33009 5.6 5:62055afb:::benchmark_data_smithi007_19526_object33008:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:24:58.106 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:58.098693+0000", 2024-04-19T04:24:58.106 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0056981840000000002, 2024-04-19T04:24:58.106 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0057175339999999998, 2024-04-19T04:24:58.107 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.107 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:58.107 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:58.107 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:58.107 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.107 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 33009 2024-04-19T04:24:58.107 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.107 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.107 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.107 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.107 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098693+0000", 2024-04-19T04:24:58.108 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.108 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.108 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.108 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.108 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098693+0000", 2024-04-19T04:24:58.108 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.108 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.108 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.108 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.108 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098692+0000", 2024-04-19T04:24:58.108 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.108 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.109 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.109 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.109 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098752+0000", 2024-04-19T04:24:58.109 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.0578999999999997e-05 2024-04-19T04:24:58.109 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.109 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.109 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.109 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098763+0000", 2024-04-19T04:24:58.109 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1229999999999999e-05 2024-04-19T04:24:58.109 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.109 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.109 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.109 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098769+0000", 2024-04-19T04:24:58.109 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.3349999999999997e-06 2024-04-19T04:24:58.110 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.110 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.110 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.110 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098834+0000", 2024-04-19T04:24:58.110 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.5461000000000002e-05 2024-04-19T04:24:58.110 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.110 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.110 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.110 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098975+0000", 2024-04-19T04:24:58.110 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000141013 2024-04-19T04:24:58.110 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.110 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.111 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:58.111 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.099082+0000", 2024-04-19T04:24:58.111 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00010629 2024-04-19T04:24:58.111 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.111 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.111 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.111 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.101481+0000", 2024-04-19T04:24:58.111 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0023997139999999998 2024-04-19T04:24:58.111 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.111 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.111 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.111 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.111 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.111 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:33010 5.8 5:19904bce:::benchmark_data_smithi007_19526_object33009:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:24:58.112 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:58.098784+0000", 2024-04-19T04:24:58.112 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0056064900000000004, 2024-04-19T04:24:58.112 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0056823910000000002, 2024-04-19T04:24:58.112 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.112 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:58.112 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:58.112 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:58.112 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.112 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 33010 2024-04-19T04:24:58.112 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.112 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.112 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.112 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.112 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098784+0000", 2024-04-19T04:24:58.113 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.113 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.113 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.113 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.113 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098784+0000", 2024-04-19T04:24:58.113 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.113 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.113 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.113 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.113 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098784+0000", 2024-04-19T04:24:58.113 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:58.113 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.113 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.113 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.114 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098829+0000", 2024-04-19T04:24:58.114 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.5346999999999998e-05 2024-04-19T04:24:58.114 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.114 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.114 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.114 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098837+0000", 2024-04-19T04:24:58.114 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.8569999999999995e-06 2024-04-19T04:24:58.114 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.114 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.114 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.114 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098843+0000", 2024-04-19T04:24:58.114 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.1959999999999996e-06 2024-04-19T04:24:58.114 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.114 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.115 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.115 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098880+0000", 2024-04-19T04:24:58.115 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6774999999999999e-05 2024-04-19T04:24:58.115 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.115 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.115 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.115 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.099013+0000", 2024-04-19T04:24:58.115 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013271999999999999 2024-04-19T04:24:58.115 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.115 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.115 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:58.115 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.099159+0000", 2024-04-19T04:24:58.115 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014644500000000001 2024-04-19T04:24:58.115 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.116 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.116 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.116 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.104289+0000", 2024-04-19T04:24:58.116 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0051295660000000003 2024-04-19T04:24:58.116 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.116 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.116 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.116 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.116 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.116 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:33007 5.7 e31/20 5:e9189aee:::benchmark_data_smithi007_19526_object33006:head v 31'2094, mlcod=31'2090)", 2024-04-19T04:24:58.116 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:58.098887+0000", 2024-04-19T04:24:58.116 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0055039329999999999, 2024-04-19T04:24:58.116 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0056303079999999997, 2024-04-19T04:24:58.116 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.117 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:58.117 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.117 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.117 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.117 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098887+0000", 2024-04-19T04:24:58.117 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.117 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.117 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.117 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.117 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098887+0000", 2024-04-19T04:24:58.117 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.117 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.117 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.118 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.118 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098886+0000", 2024-04-19T04:24:58.118 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:58.118 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.118 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.118 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.118 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098950+0000", 2024-04-19T04:24:58.118 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.4115000000000005e-05 2024-04-19T04:24:58.118 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.118 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.118 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.118 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098959+0000", 2024-04-19T04:24:58.118 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.7299999999999994e-06 2024-04-19T04:24:58.119 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.119 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.119 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.119 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.098965+0000", 2024-04-19T04:24:58.119 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.0090000000000004e-06 2024-04-19T04:24:58.119 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.119 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.119 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.119 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.099020+0000", 2024-04-19T04:24:58.119 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4676000000000003e-05 2024-04-19T04:24:58.119 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.119 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.119 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.120 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.099038+0000", 2024-04-19T04:24:58.120 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8311000000000001e-05 2024-04-19T04:24:58.120 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.120 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.120 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.120 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.120 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.120 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:33011 5.c 5:3d81924e:::benchmark_data_smithi007_19526_object33010:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:24:58.120 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:58.099683+0000", 2024-04-19T04:24:58.120 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0047076000000000002, 2024-04-19T04:24:58.120 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.004896376, 2024-04-19T04:24:58.120 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.121 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:58.121 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:58.121 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:58.121 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.121 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 33011 2024-04-19T04:24:58.121 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.121 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.121 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.121 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.121 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.099683+0000", 2024-04-19T04:24:58.121 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.122 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.122 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.122 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.122 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.099683+0000", 2024-04-19T04:24:58.122 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.122 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.122 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.122 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.122 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.099682+0000", 2024-04-19T04:24:58.122 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.122 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.122 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.122 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.122 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.099746+0000", 2024-04-19T04:24:58.123 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.3935000000000004e-05 2024-04-19T04:24:58.123 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.123 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.123 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.125 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.099772+0000", 2024-04-19T04:24:58.125 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.5502000000000001e-05 2024-04-19T04:24:58.126 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.126 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.126 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.126 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.099797+0000", 2024-04-19T04:24:58.126 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.5851999999999999e-05 2024-04-19T04:24:58.126 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.126 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.126 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.126 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.099888+0000", 2024-04-19T04:24:58.126 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.0539999999999997e-05 2024-04-19T04:24:58.126 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.126 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.127 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.127 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.100144+0000", 2024-04-19T04:24:58.127 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00025589599999999998 2024-04-19T04:24:58.127 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.127 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.127 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:58.127 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.100418+0000", 2024-04-19T04:24:58.127 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00027402500000000001 2024-04-19T04:24:58.127 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.127 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.127 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.127 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.102613+0000", 2024-04-19T04:24:58.127 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0021953229999999999 2024-04-19T04:24:58.128 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.128 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.128 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.128 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.128 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.128 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:33013 5.0 e31/20 5:0115544b:::benchmark_data_smithi007_19526_object33012:head v 31'2015, mlcod=31'2012)", 2024-04-19T04:24:58.128 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:58.101313+0000", 2024-04-19T04:24:58.128 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0030776839999999998, 2024-04-19T04:24:58.128 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.003318849, 2024-04-19T04:24:58.128 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.128 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:58.128 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.129 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.129 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.129 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.101313+0000", 2024-04-19T04:24:58.129 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.129 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.129 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.129 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.129 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.101313+0000", 2024-04-19T04:24:58.129 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.129 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.129 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.129 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.130 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.101312+0000", 2024-04-19T04:24:58.130 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:58.130 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.130 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.130 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.130 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.101344+0000", 2024-04-19T04:24:58.130 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.1872999999999998e-05 2024-04-19T04:24:58.130 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.130 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.130 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.130 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.101358+0000", 2024-04-19T04:24:58.131 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3852999999999999e-05 2024-04-19T04:24:58.131 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.131 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.131 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.131 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.101364+0000", 2024-04-19T04:24:58.131 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.7869999999999998e-06 2024-04-19T04:24:58.131 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.131 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.131 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.131 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.101409+0000", 2024-04-19T04:24:58.131 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.5571999999999997e-05 2024-04-19T04:24:58.131 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.131 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.132 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.132 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.101422+0000", 2024-04-19T04:24:58.132 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2561999999999999e-05 2024-04-19T04:24:58.132 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.132 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.132 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.132 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.132 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.132 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:33017 5.8 5:1b2e3c8d:::benchmark_data_smithi007_19526_object33016:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:24:58.132 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:58.102780+0000", 2024-04-19T04:24:58.132 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0016104069999999999, 2024-04-19T04:24:58.132 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0018847110000000001, 2024-04-19T04:24:58.132 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.132 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:58.133 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:58.133 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:58.133 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.133 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 33017 2024-04-19T04:24:58.133 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.133 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.133 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.133 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.133 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.102780+0000", 2024-04-19T04:24:58.133 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.133 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.133 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.133 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.133 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.102780+0000", 2024-04-19T04:24:58.134 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.134 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.134 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.134 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.134 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.102779+0000", 2024-04-19T04:24:58.134 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.134 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.134 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.134 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.134 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.102890+0000", 2024-04-19T04:24:58.134 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000110645 2024-04-19T04:24:58.134 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.134 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.135 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.135 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.102900+0000", 2024-04-19T04:24:58.135 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0387999999999999e-05 2024-04-19T04:24:58.135 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.135 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.135 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.135 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.102909+0000", 2024-04-19T04:24:58.135 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.3259999999999996e-06 2024-04-19T04:24:58.135 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.135 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.135 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.135 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.102944+0000", 2024-04-19T04:24:58.135 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.4789000000000002e-05 2024-04-19T04:24:58.135 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.136 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.136 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.136 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103050+0000", 2024-04-19T04:24:58.136 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000106845 2024-04-19T04:24:58.136 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.136 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.136 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:58.136 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103149+0000", 2024-04-19T04:24:58.136 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.8875000000000005e-05 2024-04-19T04:24:58.136 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.136 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.136 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.136 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.136 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.137 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:33020 5.8 5:14a72dec:::benchmark_data_smithi007_19526_object33019:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:24:58.137 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:58.103242+0000", 2024-04-19T04:24:58.137 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0011484030000000001, 2024-04-19T04:24:58.137 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0014635609999999999, 2024-04-19T04:24:58.137 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.137 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:58.137 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:58.137 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:58.137 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.137 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 33020 2024-04-19T04:24:58.137 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.137 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.137 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.138 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.138 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103242+0000", 2024-04-19T04:24:58.138 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.138 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.138 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.138 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.138 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103242+0000", 2024-04-19T04:24:58.138 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.138 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.138 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.138 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.138 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103241+0000", 2024-04-19T04:24:58.138 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.139 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.139 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.139 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.139 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103408+0000", 2024-04-19T04:24:58.139 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000166214 2024-04-19T04:24:58.139 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.139 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.139 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.139 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103417+0000", 2024-04-19T04:24:58.139 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.713e-06 2024-04-19T04:24:58.139 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.139 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.139 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.139 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103425+0000", 2024-04-19T04:24:58.140 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2799999999999998e-06 2024-04-19T04:24:58.140 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.140 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.140 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.140 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.104329+0000", 2024-04-19T04:24:58.140 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00090456300000000005 2024-04-19T04:24:58.140 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.140 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.140 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.140 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.104506+0000", 2024-04-19T04:24:58.140 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017662 2024-04-19T04:24:58.140 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.140 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.141 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:58.141 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.104600+0000", 2024-04-19T04:24:58.141 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.4634000000000002e-05 2024-04-19T04:24:58.141 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.141 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.141 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.141 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.141 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.141 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:33019 5.1 e31/20 5:887f1ae7:::benchmark_data_smithi007_19526_object33018:head v 31'2114, mlcod=31'2112)", 2024-04-19T04:24:58.141 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:58.103509+0000", 2024-04-19T04:24:58.141 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00088200099999999999, 2024-04-19T04:24:58.141 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001240075, 2024-04-19T04:24:58.142 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.142 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:58.142 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.142 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.142 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.142 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103509+0000", 2024-04-19T04:24:58.142 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.142 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.142 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.142 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.142 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103509+0000", 2024-04-19T04:24:58.142 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.143 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.143 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.143 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.143 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103508+0000", 2024-04-19T04:24:58.143 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:58.143 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.143 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.143 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.143 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103572+0000", 2024-04-19T04:24:58.143 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.4085999999999996e-05 2024-04-19T04:24:58.143 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.143 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.143 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.143 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103582+0000", 2024-04-19T04:24:58.144 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0051000000000001e-05 2024-04-19T04:24:58.144 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.144 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.144 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.144 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103587+0000", 2024-04-19T04:24:58.144 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7539999999999997e-06 2024-04-19T04:24:58.144 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.144 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.144 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.144 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103628+0000", 2024-04-19T04:24:58.144 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.0666e-05 2024-04-19T04:24:58.144 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.145 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.145 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.145 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103663+0000", 2024-04-19T04:24:58.145 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.4916000000000002e-05 2024-04-19T04:24:58.145 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.145 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.145 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.145 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.145 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.145 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:33018 5.b e31/20 5:d3c9c11c:::benchmark_data_smithi007_19526_object33017:head v 31'2058, mlcod=31'2056)", 2024-04-19T04:24:58.145 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:58.103674+0000", 2024-04-19T04:24:58.145 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00071670499999999999, 2024-04-19T04:24:58.145 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0011043769999999999, 2024-04-19T04:24:58.145 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.145 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:58.146 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.146 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.146 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.146 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103674+0000", 2024-04-19T04:24:58.146 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.146 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.146 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.146 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.146 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103674+0000", 2024-04-19T04:24:58.146 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.146 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.146 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.146 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.146 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103673+0000", 2024-04-19T04:24:58.147 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:58.147 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.147 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.147 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.147 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103740+0000", 2024-04-19T04:24:58.147 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.6595999999999997e-05 2024-04-19T04:24:58.147 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.147 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.147 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.147 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103764+0000", 2024-04-19T04:24:58.147 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.4121000000000002e-05 2024-04-19T04:24:58.147 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.147 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.147 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.147 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103771+0000", 2024-04-19T04:24:58.148 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.0219999999999999e-06 2024-04-19T04:24:58.148 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.148 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.148 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.148 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103818+0000", 2024-04-19T04:24:58.148 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.6755999999999998e-05 2024-04-19T04:24:58.148 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.148 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.148 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.148 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.103833+0000", 2024-04-19T04:24:58.148 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.5011000000000001e-05 2024-04-19T04:24:58.148 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.148 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.148 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.148 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.149 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.149 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:33021 5.0 e31/20 5:06206c1c:::benchmark_data_smithi007_19526_object33020:head v 31'2016, mlcod=31'2013)", 2024-04-19T04:24:58.149 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:58.104163+0000", 2024-04-19T04:24:58.149 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.000227545, 2024-04-19T04:24:58.149 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00064442099999999995, 2024-04-19T04:24:58.149 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.149 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:58.149 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.149 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.149 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.149 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.104163+0000", 2024-04-19T04:24:58.149 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.149 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.149 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.150 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.150 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.104163+0000", 2024-04-19T04:24:58.150 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.150 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.150 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.150 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.150 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.104162+0000", 2024-04-19T04:24:58.150 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.150 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.150 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.150 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.150 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.104231+0000", 2024-04-19T04:24:58.150 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.8862000000000006e-05 2024-04-19T04:24:58.150 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.151 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.151 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.151 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.104243+0000", 2024-04-19T04:24:58.151 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1326e-05 2024-04-19T04:24:58.151 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.151 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.151 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.151 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.104250+0000", 2024-04-19T04:24:58.151 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2849999999999997e-06 2024-04-19T04:24:58.151 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.151 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.151 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.151 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.104320+0000", 2024-04-19T04:24:58.151 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.0285999999999998e-05 2024-04-19T04:24:58.151 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.152 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.152 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.152 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.104343+0000", 2024-04-19T04:24:58.152 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.3283000000000001e-05 2024-04-19T04:24:58.152 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.152 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.152 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.152 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.152 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-04-19T04:24:58.152 INFO:teuthology.orchestra.run.smithi066.stdout: "num_ops": 10 2024-04-19T04:24:58.152 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:24:58.154 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:24:58.167 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:58.166+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:58.267 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:58.266+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:58.296 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:24:58.296 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [], 2024-04-19T04:24:58.296 INFO:teuthology.orchestra.run.smithi066.stdout: "complaint_time": 30, 2024-04-19T04:24:58.296 INFO:teuthology.orchestra.run.smithi066.stdout: "num_blocked_ops": 0 2024-04-19T04:24:58.296 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:24:58.309 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:24:58.368 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:58.366+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:58.453 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:24:58.453 INFO:teuthology.orchestra.run.smithi066.stdout: "size": 20, 2024-04-19T04:24:58.453 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 600, 2024-04-19T04:24:58.453 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [ 2024-04-19T04:24:58.453 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.453 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:58.453 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:24:58.453 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 37.916416691999999, 2024-04-19T04:24:58.453 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019436790999999998, 2024-04-19T04:24:58.454 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.454 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:58.454 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.454 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.454 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.454 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:24:58.454 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.454 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.454 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.454 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.454 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:24:58.454 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.455 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.455 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.455 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.455 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533562+0000", 2024-04-19T04:24:58.455 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999967 2024-04-19T04:24:58.455 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.455 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.455 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.455 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533588+0000", 2024-04-19T04:24:58.455 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.6128000000000001e-05 2024-04-19T04:24:58.455 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.455 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.455 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.456 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533617+0000", 2024-04-19T04:24:58.456 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.8685000000000001e-05 2024-04-19T04:24:58.456 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.456 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.456 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.456 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533649+0000", 2024-04-19T04:24:58.456 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.2532e-05 2024-04-19T04:24:58.456 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.456 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.456 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.456 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536605+0000", 2024-04-19T04:24:58.456 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0029553130000000002 2024-04-19T04:24:58.456 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.456 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.456 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.457 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536746+0000", 2024-04-19T04:24:58.457 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000141011 2024-04-19T04:24:58.457 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.457 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.457 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:58.457 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536889+0000", 2024-04-19T04:24:58.457 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000143437 2024-04-19T04:24:58.457 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.457 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.457 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:58.457 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542807+0000", 2024-04-19T04:24:58.457 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0059181210000000001 2024-04-19T04:24:58.457 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.457 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.457 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.458 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.552917+0000", 2024-04-19T04:24:58.458 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010110111 2024-04-19T04:24:58.458 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.458 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.458 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:58.458 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.552962+0000", 2024-04-19T04:24:58.458 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.4811999999999997e-05 2024-04-19T04:24:58.458 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.458 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.458 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.458 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553002+0000", 2024-04-19T04:24:58.458 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9957999999999999e-05 2024-04-19T04:24:58.458 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.458 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.459 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.459 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.459 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.459 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:58.459 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:24:58.459 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 37.916300747999998, 2024-04-19T04:24:58.459 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019464940999999999, 2024-04-19T04:24:58.459 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.459 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:58.459 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.459 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.459 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.459 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:24:58.459 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.460 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.460 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.460 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.460 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:24:58.460 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.460 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.460 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.460 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.460 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533680+0000", 2024-04-19T04:24:58.460 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:58.460 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.460 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.460 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.460 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533692+0000", 2024-04-19T04:24:58.460 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2235000000000001e-05 2024-04-19T04:24:58.461 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.461 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.461 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.461 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533770+0000", 2024-04-19T04:24:58.461 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.8248e-05 2024-04-19T04:24:58.461 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.461 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.461 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.461 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:24:58.461 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8671000000000001e-05 2024-04-19T04:24:58.461 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.461 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.461 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.461 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539610+0000", 2024-04-19T04:24:58.461 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0058206669999999999 2024-04-19T04:24:58.462 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.462 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.462 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.462 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539705+0000", 2024-04-19T04:24:58.462 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.5313e-05 2024-04-19T04:24:58.462 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.462 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.462 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:58.462 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539857+0000", 2024-04-19T04:24:58.462 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000151881 2024-04-19T04:24:58.462 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.462 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.462 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:58.462 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542812+0000", 2024-04-19T04:24:58.463 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.002954857 2024-04-19T04:24:58.463 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.463 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.463 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.463 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553058+0000", 2024-04-19T04:24:58.463 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010246570999999999 2024-04-19T04:24:58.463 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.463 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.463 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:58.463 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553104+0000", 2024-04-19T04:24:58.463 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.5235999999999999e-05 2024-04-19T04:24:58.463 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.463 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.463 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.463 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553146+0000", 2024-04-19T04:24:58.464 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2725999999999997e-05 2024-04-19T04:24:58.464 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.464 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.464 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.464 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.464 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.464 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:21 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:58.464 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:24:58.464 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 37.916041647999997, 2024-04-19T04:24:58.464 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019340466000000001, 2024-04-19T04:24:58.464 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.464 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:58.464 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.464 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.464 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.465 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:24:58.465 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.465 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.465 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.465 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.465 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:24:58.465 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.465 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.465 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.465 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.465 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533939+0000", 2024-04-19T04:24:58.465 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.466 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.466 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.466 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.466 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533950+0000", 2024-04-19T04:24:58.466 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0533999999999999e-05 2024-04-19T04:24:58.466 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.466 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.466 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.466 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533973+0000", 2024-04-19T04:24:58.466 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2614000000000001e-05 2024-04-19T04:24:58.466 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.467 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.467 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.467 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:58.467 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3531e-05 2024-04-19T04:24:58.467 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.467 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.467 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.467 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541149+0000", 2024-04-19T04:24:58.467 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0071628780000000001 2024-04-19T04:24:58.467 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.467 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.467 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.467 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541279+0000", 2024-04-19T04:24:58.468 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013014999999999999 2024-04-19T04:24:58.468 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.468 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.468 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:58.468 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541430+0000", 2024-04-19T04:24:58.468 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015048399999999999 2024-04-19T04:24:58.468 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.468 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.468 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:58.468 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.543384+0000", 2024-04-19T04:24:58.468 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001954468 2024-04-19T04:24:58.468 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.468 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.468 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.469 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553193+0000", 2024-04-19T04:24:58.469 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0098089059999999992 2024-04-19T04:24:58.469 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.469 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.469 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:58.469 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553245+0000", 2024-04-19T04:24:58.469 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.1742e-05 2024-04-19T04:24:58.469 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.469 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.469 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.469 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553281+0000", 2024-04-19T04:24:58.469 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6272000000000001e-05 2024-04-19T04:24:58.469 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.469 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.470 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.470 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.470 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.470 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:58.470 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:58.470 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 37.915984397000003, 2024-04-19T04:24:58.470 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019497464999999999, 2024-04-19T04:24:58.470 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.470 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:58.470 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.470 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.470 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.470 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:58.471 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.471 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.471 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.471 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.471 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:58.471 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.471 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.471 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.471 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.471 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533997+0000", 2024-04-19T04:24:58.471 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.471 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.471 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.472 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.472 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534019+0000", 2024-04-19T04:24:58.472 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.1871000000000001e-05 2024-04-19T04:24:58.472 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.472 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.472 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.472 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534036+0000", 2024-04-19T04:24:58.472 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.7073999999999999e-05 2024-04-19T04:24:58.472 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.472 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.472 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.472 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:58.472 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3781000000000001e-05 2024-04-19T04:24:58.472 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.472 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.473 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.473 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534167+0000", 2024-04-19T04:24:58.473 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000117463 2024-04-19T04:24:58.473 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.473 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.473 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.473 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.535182+0000", 2024-04-19T04:24:58.473 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0010149340000000001 2024-04-19T04:24:58.473 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.473 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.473 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:58.473 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.535459+0000", 2024-04-19T04:24:58.473 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000277013 2024-04-19T04:24:58.473 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.474 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.474 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:58.474 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.540338+0000", 2024-04-19T04:24:58.474 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0048786109999999997 2024-04-19T04:24:58.474 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.474 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.474 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.474 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553416+0000", 2024-04-19T04:24:58.474 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013078251000000001 2024-04-19T04:24:58.474 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.474 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.474 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:58.474 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553456+0000", 2024-04-19T04:24:58.474 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.0516999999999998e-05 2024-04-19T04:24:58.475 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.475 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.475 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.475 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553495+0000", 2024-04-19T04:24:58.475 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8899999999999997e-05 2024-04-19T04:24:58.475 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.475 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.475 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.475 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.475 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.475 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:58.475 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:24:58.475 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 37.915886010999998, 2024-04-19T04:24:58.475 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019607754000000002, 2024-04-19T04:24:58.476 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.476 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:58.476 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.476 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.476 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.476 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:24:58.476 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.476 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.476 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.476 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.476 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:24:58.476 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.476 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.476 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.476 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.477 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534095+0000", 2024-04-19T04:24:58.477 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:58.477 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.477 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.477 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.477 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534104+0000", 2024-04-19T04:24:58.477 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.9779999999999994e-06 2024-04-19T04:24:58.477 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.477 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.477 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.477 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534122+0000", 2024-04-19T04:24:58.477 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8464000000000001e-05 2024-04-19T04:24:58.477 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.478 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.478 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.478 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534142+0000", 2024-04-19T04:24:58.478 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.9287999999999999e-05 2024-04-19T04:24:58.478 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.478 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.478 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.478 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.538550+0000", 2024-04-19T04:24:58.478 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0044085560000000001 2024-04-19T04:24:58.478 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.478 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.478 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.478 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.538726+0000", 2024-04-19T04:24:58.479 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017599299999999999 2024-04-19T04:24:58.479 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.479 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.479 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.479 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553704+0000", 2024-04-19T04:24:58.479 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.014977802 2024-04-19T04:24:58.479 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.479 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.479 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.479 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.479 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.479 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:58.479 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:24:58.479 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 37.915799122000003, 2024-04-19T04:24:58.480 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019220208999999999, 2024-04-19T04:24:58.480 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.480 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:58.480 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.481 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.481 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.481 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:24:58.481 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.481 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.481 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.481 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.481 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:24:58.481 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.481 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.481 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.481 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.481 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534182+0000", 2024-04-19T04:24:58.481 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.482 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.482 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.482 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.482 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534189+0000", 2024-04-19T04:24:58.482 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3710000000000002e-06 2024-04-19T04:24:58.482 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.482 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.482 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.482 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534810+0000", 2024-04-19T04:24:58.482 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00062098000000000003 2024-04-19T04:24:58.482 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.482 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.482 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.483 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534829+0000", 2024-04-19T04:24:58.483 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8207999999999999e-05 2024-04-19T04:24:58.483 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.483 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.483 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.483 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542089+0000", 2024-04-19T04:24:58.483 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0072601710000000002 2024-04-19T04:24:58.483 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.483 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.483 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.483 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542225+0000", 2024-04-19T04:24:58.483 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000135988 2024-04-19T04:24:58.483 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.483 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.484 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.484 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553403+0000", 2024-04-19T04:24:58.484 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011178478 2024-04-19T04:24:58.484 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.484 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.484 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.484 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.484 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.484 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:15009 5.6 5:62234a36:::benchmark_data_smithi007_19526_object15008:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:58.484 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:49.911756+0000", 2024-04-19T04:24:58.484 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 8.5382256590000001, 2024-04-19T04:24:58.484 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013813215, 2024-04-19T04:24:58.484 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.484 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:58.484 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:58.485 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:58.485 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.485 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 15009 2024-04-19T04:24:58.485 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.485 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.485 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.485 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.485 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.911756+0000", 2024-04-19T04:24:58.485 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.485 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.485 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.485 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.485 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.911756+0000", 2024-04-19T04:24:58.485 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.486 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.486 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.486 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.486 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.911756+0000", 2024-04-19T04:24:58.486 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.486 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.486 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.486 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.486 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.911841+0000", 2024-04-19T04:24:58.486 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.5323999999999998e-05 2024-04-19T04:24:58.486 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.486 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.486 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.486 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.911863+0000", 2024-04-19T04:24:58.487 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2050999999999999e-05 2024-04-19T04:24:58.487 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.487 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.487 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.487 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.911870+0000", 2024-04-19T04:24:58.487 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.1119999999999998e-06 2024-04-19T04:24:58.487 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.487 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.487 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.487 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.912143+0000", 2024-04-19T04:24:58.487 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00027322799999999998 2024-04-19T04:24:58.487 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.487 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.488 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.488 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.912241+0000", 2024-04-19T04:24:58.488 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.7298000000000003e-05 2024-04-19T04:24:58.488 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.488 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.488 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:58.488 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.912331+0000", 2024-04-19T04:24:58.488 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.0629000000000003e-05 2024-04-19T04:24:58.488 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.488 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.488 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:58.488 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.914184+0000", 2024-04-19T04:24:58.488 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0018523389999999999 2024-04-19T04:24:58.488 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.488 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.489 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.489 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.925442+0000", 2024-04-19T04:24:58.489 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011258696 2024-04-19T04:24:58.489 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.489 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.489 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:58.489 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.925505+0000", 2024-04-19T04:24:58.489 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.3097999999999998e-05 2024-04-19T04:24:58.489 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.489 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.489 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.489 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:49.925570+0000", 2024-04-19T04:24:58.489 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.4238000000000004e-05 2024-04-19T04:24:58.489 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.489 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.490 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.490 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.490 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.490 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25423 5.6 5:6f4ec70e:::benchmark_data_smithi007_19526_object25422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:58.490 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:53.911006+0000", 2024-04-19T04:24:58.490 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.5389759280000002, 2024-04-19T04:24:58.490 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.014609970999999999, 2024-04-19T04:24:58.490 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.490 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:58.490 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:58.490 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:58.490 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.490 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25423 2024-04-19T04:24:58.490 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.491 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.491 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.491 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.491 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.911006+0000", 2024-04-19T04:24:58.491 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.491 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.491 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.491 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.491 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.911006+0000", 2024-04-19T04:24:58.491 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.491 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.491 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.491 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.491 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.911005+0000", 2024-04-19T04:24:58.491 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.492 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.492 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.492 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.492 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.911068+0000", 2024-04-19T04:24:58.492 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.3034000000000007e-05 2024-04-19T04:24:58.492 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.492 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.492 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.492 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.911077+0000", 2024-04-19T04:24:58.492 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.1810000000000007e-06 2024-04-19T04:24:58.492 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.492 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.492 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.492 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.911083+0000", 2024-04-19T04:24:58.492 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.84e-06 2024-04-19T04:24:58.492 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.493 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.493 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.493 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.913975+0000", 2024-04-19T04:24:58.493 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0028923379999999999 2024-04-19T04:24:58.493 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.493 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.493 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.493 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.914167+0000", 2024-04-19T04:24:58.493 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00019184900000000001 2024-04-19T04:24:58.493 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.493 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.493 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:58.493 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.914336+0000", 2024-04-19T04:24:58.493 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000168245 2024-04-19T04:24:58.493 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.494 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.494 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:58.494 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.916211+0000", 2024-04-19T04:24:58.494 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0018751639999999999 2024-04-19T04:24:58.494 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.494 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.494 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.494 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.925521+0000", 2024-04-19T04:24:58.494 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.009309922 2024-04-19T04:24:58.494 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.494 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.494 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:58.494 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.925574+0000", 2024-04-19T04:24:58.494 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.3077e-05 2024-04-19T04:24:58.495 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.495 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.495 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.495 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:53.925616+0000", 2024-04-19T04:24:58.495 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2475000000000002e-05 2024-04-19T04:24:58.495 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.495 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.495 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.495 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.495 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.495 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25792 5.6 5:6ead9788:::benchmark_data_smithi007_19526_object25791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:58.495 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.070174+0000", 2024-04-19T04:24:58.495 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.3798077700000002, 2024-04-19T04:24:58.495 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.018078227999999998, 2024-04-19T04:24:58.495 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.496 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:58.496 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:58.496 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:58.496 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.496 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25792 2024-04-19T04:24:58.496 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.496 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.496 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.496 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.496 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070174+0000", 2024-04-19T04:24:58.496 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.496 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.496 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.496 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.496 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070174+0000", 2024-04-19T04:24:58.496 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.497 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.497 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.497 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.497 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070173+0000", 2024-04-19T04:24:58.497 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.497 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.497 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.497 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.497 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070241+0000", 2024-04-19T04:24:58.497 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7801999999999999e-05 2024-04-19T04:24:58.497 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.497 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.497 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.497 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070252+0000", 2024-04-19T04:24:58.497 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1405e-05 2024-04-19T04:24:58.498 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.498 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.498 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.498 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070258+0000", 2024-04-19T04:24:58.498 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4949999999999999e-06 2024-04-19T04:24:58.498 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.498 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.498 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.498 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070298+0000", 2024-04-19T04:24:58.498 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9932999999999999e-05 2024-04-19T04:24:58.498 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.498 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.498 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.498 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070386+0000", 2024-04-19T04:24:58.499 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8382999999999997e-05 2024-04-19T04:24:58.499 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.499 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.499 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:58.499 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070472+0000", 2024-04-19T04:24:58.499 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.5364999999999993e-05 2024-04-19T04:24:58.499 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.499 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.499 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.499 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.076618+0000", 2024-04-19T04:24:58.499 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.006146037 2024-04-19T04:24:58.499 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.500 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.500 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:58.500 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088147+0000", 2024-04-19T04:24:58.500 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011529634 2024-04-19T04:24:58.500 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.500 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.500 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:58.500 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088209+0000", 2024-04-19T04:24:58.500 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.1760999999999994e-05 2024-04-19T04:24:58.500 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.500 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.500 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.500 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088253+0000", 2024-04-19T04:24:58.500 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.3547000000000002e-05 2024-04-19T04:24:58.501 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.501 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.501 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.501 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.501 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.501 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:25794 5.e e27/20 5:77ddc1c5:::benchmark_data_smithi007_19526_object25793:head v 27'1671, mlcod=27'1669)", 2024-04-19T04:24:58.501 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.072074+0000", 2024-04-19T04:24:58.501 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.377908068, 2024-04-19T04:24:58.501 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.016881862000000001, 2024-04-19T04:24:58.501 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.501 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:58.501 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.501 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.501 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.502 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072074+0000", 2024-04-19T04:24:58.502 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.502 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.502 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.502 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.502 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072074+0000", 2024-04-19T04:24:58.502 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.502 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.502 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.502 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.502 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072073+0000", 2024-04-19T04:24:58.502 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.502 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.502 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.503 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.503 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072119+0000", 2024-04-19T04:24:58.503 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.6301999999999998e-05 2024-04-19T04:24:58.503 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.503 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.503 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.503 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072130+0000", 2024-04-19T04:24:58.503 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1018e-05 2024-04-19T04:24:58.503 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.503 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.503 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.503 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072138+0000", 2024-04-19T04:24:58.503 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.131e-06 2024-04-19T04:24:58.503 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.503 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.504 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.504 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072176+0000", 2024-04-19T04:24:58.504 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8674000000000003e-05 2024-04-19T04:24:58.504 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.504 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.504 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.504 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072191+0000", 2024-04-19T04:24:58.504 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.5245000000000001e-05 2024-04-19T04:24:58.504 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.504 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.504 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:58.504 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088908+0000", 2024-04-19T04:24:58.504 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.016716742 2024-04-19T04:24:58.504 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.505 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.505 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.505 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088956+0000", 2024-04-19T04:24:58.505 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7675e-05 2024-04-19T04:24:58.505 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.505 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.505 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.505 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.505 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.505 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25802 5.6 5:6a01b8d5:::benchmark_data_smithi007_19526_object25801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:58.505 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.074125+0000", 2024-04-19T04:24:58.505 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.37585713, 2024-04-19T04:24:58.505 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.014988691, 2024-04-19T04:24:58.505 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.506 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:58.506 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:58.506 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:58.506 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.506 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25802 2024-04-19T04:24:58.506 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.506 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.506 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.506 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.506 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.074125+0000", 2024-04-19T04:24:58.506 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.506 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.506 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.506 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.506 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.074125+0000", 2024-04-19T04:24:58.507 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.507 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.507 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.507 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.507 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.074124+0000", 2024-04-19T04:24:58.507 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.507 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.507 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.507 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.507 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.074172+0000", 2024-04-19T04:24:58.507 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7700000000000001e-05 2024-04-19T04:24:58.507 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.507 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.507 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.508 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.074180+0000", 2024-04-19T04:24:58.508 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8140000000000007e-06 2024-04-19T04:24:58.508 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.508 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.508 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.508 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.074186+0000", 2024-04-19T04:24:58.508 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.6860000000000003e-06 2024-04-19T04:24:58.508 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.508 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.508 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.508 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.074227+0000", 2024-04-19T04:24:58.508 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1323999999999999e-05 2024-04-19T04:24:58.508 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.509 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.509 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.509 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.074350+0000", 2024-04-19T04:24:58.509 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000122664 2024-04-19T04:24:58.509 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.509 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.509 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:58.509 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.074496+0000", 2024-04-19T04:24:58.509 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014595799999999999 2024-04-19T04:24:58.509 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.509 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.509 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.509 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.077162+0000", 2024-04-19T04:24:58.510 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0026657989999999999 2024-04-19T04:24:58.510 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.510 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.510 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:58.510 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088969+0000", 2024-04-19T04:24:58.510 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011807412999999999 2024-04-19T04:24:58.510 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.510 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.510 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:58.510 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.089072+0000", 2024-04-19T04:24:58.510 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000102915 2024-04-19T04:24:58.511 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.511 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.511 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.511 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.089114+0000", 2024-04-19T04:24:58.511 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1505999999999999e-05 2024-04-19T04:24:58.511 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.511 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.511 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.511 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.511 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.511 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26158 5.3 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:58.511 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.232719+0000", 2024-04-19T04:24:58.511 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.2172631020000004, 2024-04-19T04:24:58.511 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.049770017, 2024-04-19T04:24:58.512 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.512 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:58.512 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:58.512 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:58.512 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.512 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26158 2024-04-19T04:24:58.512 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.512 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.512 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.512 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.512 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232719+0000", 2024-04-19T04:24:58.512 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.512 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.512 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.512 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.513 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232719+0000", 2024-04-19T04:24:58.513 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.513 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.513 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.513 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.513 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232718+0000", 2024-04-19T04:24:58.513 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.513 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.513 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.513 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.513 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232791+0000", 2024-04-19T04:24:58.513 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2421000000000003e-05 2024-04-19T04:24:58.513 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.514 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.514 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.514 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232804+0000", 2024-04-19T04:24:58.514 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3037000000000001e-05 2024-04-19T04:24:58.514 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.514 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.514 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.514 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232812+0000", 2024-04-19T04:24:58.514 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.2630000000000003e-06 2024-04-19T04:24:58.514 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.514 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.514 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.514 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232971+0000", 2024-04-19T04:24:58.514 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000159419 2024-04-19T04:24:58.514 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.515 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.515 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.515 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233124+0000", 2024-04-19T04:24:58.515 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000153182 2024-04-19T04:24:58.515 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.515 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.515 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:58.515 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233283+0000", 2024-04-19T04:24:58.515 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000158321 2024-04-19T04:24:58.515 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.515 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.515 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:58.515 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.236041+0000", 2024-04-19T04:24:58.515 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0027577919999999998 2024-04-19T04:24:58.516 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.516 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.516 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.516 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282307+0000", 2024-04-19T04:24:58.516 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.046266008999999997 2024-04-19T04:24:58.516 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.516 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.516 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:58.516 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282414+0000", 2024-04-19T04:24:58.516 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000107611 2024-04-19T04:24:58.516 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.516 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.516 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.516 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282489+0000", 2024-04-19T04:24:58.516 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.4805e-05 2024-04-19T04:24:58.517 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.517 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.517 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.517 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.517 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.517 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26164 5.6 5:63a08103:::benchmark_data_smithi007_19526_object26163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:58.517 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.233982+0000", 2024-04-19T04:24:58.517 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.2159997149999997, 2024-04-19T04:24:58.517 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.047707233000000002, 2024-04-19T04:24:58.517 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.517 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:58.517 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:58.517 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:58.517 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.517 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26164 2024-04-19T04:24:58.518 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.518 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.518 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.518 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.518 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233982+0000", 2024-04-19T04:24:58.518 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.518 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.518 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.518 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.518 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233982+0000", 2024-04-19T04:24:58.518 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.518 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.518 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.518 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.518 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233981+0000", 2024-04-19T04:24:58.519 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:58.519 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.519 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.519 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.519 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234040+0000", 2024-04-19T04:24:58.519 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.8782000000000001e-05 2024-04-19T04:24:58.519 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.519 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.519 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.519 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234051+0000", 2024-04-19T04:24:58.519 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0822000000000001e-05 2024-04-19T04:24:58.519 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.519 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.519 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.519 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234059+0000", 2024-04-19T04:24:58.520 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.7479999999999993e-06 2024-04-19T04:24:58.520 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.520 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.520 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.520 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234133+0000", 2024-04-19T04:24:58.520 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.4059000000000004e-05 2024-04-19T04:24:58.520 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.520 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.520 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.520 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234356+0000", 2024-04-19T04:24:58.520 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00022300400000000001 2024-04-19T04:24:58.520 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.520 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.520 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:58.520 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234515+0000", 2024-04-19T04:24:58.520 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015913599999999999 2024-04-19T04:24:58.521 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.521 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.521 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:58.521 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.236924+0000", 2024-04-19T04:24:58.521 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0024091989999999999 2024-04-19T04:24:58.521 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.521 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.521 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.521 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.281529+0000", 2024-04-19T04:24:58.521 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.044604984 2024-04-19T04:24:58.521 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.521 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.521 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:58.521 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.281616+0000", 2024-04-19T04:24:58.522 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.6784000000000001e-05 2024-04-19T04:24:58.522 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.522 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.522 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.522 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.281690+0000", 2024-04-19T04:24:58.522 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3907999999999998e-05 2024-04-19T04:24:58.522 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.522 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.522 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.522 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.522 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.522 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26170 5.c 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:58.522 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.237154+0000", 2024-04-19T04:24:58.522 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.2128284520000001, 2024-04-19T04:24:58.522 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.045024630000000003, 2024-04-19T04:24:58.523 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.523 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:58.523 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:58.523 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:58.523 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.523 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26170 2024-04-19T04:24:58.523 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.523 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.523 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.523 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.523 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237154+0000", 2024-04-19T04:24:58.523 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.523 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.524 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.524 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.524 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237154+0000", 2024-04-19T04:24:58.524 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.524 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.524 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.524 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.524 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237153+0000", 2024-04-19T04:24:58.524 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.524 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.524 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.524 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.524 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237230+0000", 2024-04-19T04:24:58.524 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.6827000000000002e-05 2024-04-19T04:24:58.525 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.525 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.525 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.525 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237241+0000", 2024-04-19T04:24:58.525 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1270999999999999e-05 2024-04-19T04:24:58.525 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.525 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.525 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.525 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237248+0000", 2024-04-19T04:24:58.525 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.622e-06 2024-04-19T04:24:58.525 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.525 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.525 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.525 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237341+0000", 2024-04-19T04:24:58.526 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.2417999999999995e-05 2024-04-19T04:24:58.526 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.526 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.526 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.526 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237450+0000", 2024-04-19T04:24:58.526 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00010864700000000001 2024-04-19T04:24:58.526 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.526 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.526 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:58.526 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237554+0000", 2024-04-19T04:24:58.526 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00010459999999999999 2024-04-19T04:24:58.526 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.526 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.526 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:58.527 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.239374+0000", 2024-04-19T04:24:58.527 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0018197370000000001 2024-04-19T04:24:58.527 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.527 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.527 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.527 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282078+0000", 2024-04-19T04:24:58.527 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.042703868999999998 2024-04-19T04:24:58.527 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.527 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.527 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:58.527 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282132+0000", 2024-04-19T04:24:58.527 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4302999999999998e-05 2024-04-19T04:24:58.527 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.527 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.527 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.528 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282178+0000", 2024-04-19T04:24:58.528 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.6224000000000003e-05 2024-04-19T04:24:58.528 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.528 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.528 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.528 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.528 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.528 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26179 5.3 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:58.528 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.241433+0000", 2024-04-19T04:24:58.528 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.2085490569999999, 2024-04-19T04:24:58.528 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.041219473, 2024-04-19T04:24:58.528 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.528 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:58.529 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:58.529 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:58.529 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.529 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26179 2024-04-19T04:24:58.529 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.529 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.529 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.529 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.529 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241433+0000", 2024-04-19T04:24:58.529 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.529 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.529 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.529 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.529 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241433+0000", 2024-04-19T04:24:58.530 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.530 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.530 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.530 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.530 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:24:58.530 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.530 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.530 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.530 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.530 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241517+0000", 2024-04-19T04:24:58.530 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.4895999999999995e-05 2024-04-19T04:24:58.530 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.530 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.530 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.530 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241529+0000", 2024-04-19T04:24:58.531 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1846e-05 2024-04-19T04:24:58.531 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.531 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.531 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.531 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241535+0000", 2024-04-19T04:24:58.531 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.8919999999999997e-06 2024-04-19T04:24:58.531 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.531 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.531 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.531 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241573+0000", 2024-04-19T04:24:58.531 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8936000000000001e-05 2024-04-19T04:24:58.531 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.531 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.531 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.531 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241675+0000", 2024-04-19T04:24:58.531 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000101983 2024-04-19T04:24:58.532 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.532 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.532 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:58.532 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241759+0000", 2024-04-19T04:24:58.532 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.3533000000000001e-05 2024-04-19T04:24:58.532 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.532 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.532 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:58.532 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243038+0000", 2024-04-19T04:24:58.532 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001279449 2024-04-19T04:24:58.532 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.532 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.532 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.532 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282563+0000", 2024-04-19T04:24:58.532 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.039524694999999999 2024-04-19T04:24:58.533 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.533 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.533 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:58.533 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282616+0000", 2024-04-19T04:24:58.533 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2432999999999998e-05 2024-04-19T04:24:58.533 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.533 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.533 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.533 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282653+0000", 2024-04-19T04:24:58.533 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6959999999999998e-05 2024-04-19T04:24:58.533 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.533 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.533 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.533 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.533 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.534 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26181 5.6 5:61db10b4:::benchmark_data_smithi007_19526_object26180:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:58.534 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.243304+0000", 2024-04-19T04:24:58.534 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.206677719, 2024-04-19T04:24:58.534 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.043580885999999999, 2024-04-19T04:24:58.534 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.534 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:58.534 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:58.534 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:58.534 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.534 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26181 2024-04-19T04:24:58.534 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.534 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.535 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.535 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.535 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243304+0000", 2024-04-19T04:24:58.535 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.535 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.535 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.535 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.535 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243304+0000", 2024-04-19T04:24:58.535 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.535 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.535 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.535 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.535 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243303+0000", 2024-04-19T04:24:58.535 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.535 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.536 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.536 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.536 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243370+0000", 2024-04-19T04:24:58.536 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.6778000000000003e-05 2024-04-19T04:24:58.536 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.536 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.536 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.536 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243388+0000", 2024-04-19T04:24:58.536 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.7608000000000001e-05 2024-04-19T04:24:58.536 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.536 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.536 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.536 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243397+0000", 2024-04-19T04:24:58.537 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8279999999999992e-06 2024-04-19T04:24:58.537 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.537 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.537 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.537 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243444+0000", 2024-04-19T04:24:58.537 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7055000000000003e-05 2024-04-19T04:24:58.537 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.537 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.537 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.537 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243532+0000", 2024-04-19T04:24:58.537 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8782000000000005e-05 2024-04-19T04:24:58.537 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.537 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.537 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:58.537 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243614+0000", 2024-04-19T04:24:58.538 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.1199000000000006e-05 2024-04-19T04:24:58.538 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.538 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.538 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:58.538 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244915+0000", 2024-04-19T04:24:58.538 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001300893 2024-04-19T04:24:58.538 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.538 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.538 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.538 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286603+0000", 2024-04-19T04:24:58.539 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.041688847000000001 2024-04-19T04:24:58.539 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.539 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.539 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:58.539 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286792+0000", 2024-04-19T04:24:58.539 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00018885199999999999 2024-04-19T04:24:58.542 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.542 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.542 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.542 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286885+0000", 2024-04-19T04:24:58.542 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.3040000000000004e-05 2024-04-19T04:24:58.542 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.542 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.542 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.542 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.542 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.542 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26182 5.3 5:c032f6e9:::benchmark_data_smithi007_19526_object26181:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:58.542 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.244629+0000", 2024-04-19T04:24:58.543 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.2053526440000004, 2024-04-19T04:24:58.543 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.041622474999999999, 2024-04-19T04:24:58.543 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.543 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:58.543 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:58.543 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:58.543 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.543 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26182 2024-04-19T04:24:58.543 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.543 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.543 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.543 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.543 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244629+0000", 2024-04-19T04:24:58.543 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.543 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.544 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.544 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.544 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244629+0000", 2024-04-19T04:24:58.544 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.544 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.544 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.544 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.544 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244628+0000", 2024-04-19T04:24:58.544 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:58.544 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.544 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.544 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.544 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244752+0000", 2024-04-19T04:24:58.544 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000123802 2024-04-19T04:24:58.544 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.545 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.545 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.545 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244765+0000", 2024-04-19T04:24:58.545 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2908000000000001e-05 2024-04-19T04:24:58.545 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.545 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.545 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.545 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244772+0000", 2024-04-19T04:24:58.545 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.6850000000000004e-06 2024-04-19T04:24:58.545 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.545 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.545 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.545 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244813+0000", 2024-04-19T04:24:58.545 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1211999999999998e-05 2024-04-19T04:24:58.545 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.546 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.546 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.546 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244919+0000", 2024-04-19T04:24:58.546 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000106147 2024-04-19T04:24:58.546 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.546 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.546 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:58.546 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244993+0000", 2024-04-19T04:24:58.546 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3538e-05 2024-04-19T04:24:58.546 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.546 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.546 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:58.546 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.246228+0000", 2024-04-19T04:24:58.546 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001235217 2024-04-19T04:24:58.546 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.547 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.547 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.547 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286111+0000", 2024-04-19T04:24:58.547 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.039882933000000002 2024-04-19T04:24:58.547 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.547 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.547 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:58.547 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286180+0000", 2024-04-19T04:24:58.547 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.9212000000000001e-05 2024-04-19T04:24:58.547 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.547 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.547 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.547 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286252+0000", 2024-04-19T04:24:58.547 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2016999999999998e-05 2024-04-19T04:24:58.547 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.548 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.548 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.548 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.548 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.548 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26607 5.c 5:3b3641dc:::benchmark_data_smithi007_19526_object26606:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:58.548 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.457283+0000", 2024-04-19T04:24:58.548 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 3.9926991250000001, 2024-04-19T04:24:58.548 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013794381, 2024-04-19T04:24:58.548 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.548 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:58.548 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:58.548 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:58.548 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.549 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26607 2024-04-19T04:24:58.549 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.549 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.549 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.549 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.549 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.457283+0000", 2024-04-19T04:24:58.549 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.549 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.549 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.549 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.549 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.457283+0000", 2024-04-19T04:24:58.549 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.549 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.550 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.550 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.550 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.457282+0000", 2024-04-19T04:24:58.550 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.550 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.550 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.550 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.550 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.457414+0000", 2024-04-19T04:24:58.550 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013171400000000001 2024-04-19T04:24:58.550 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.550 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.550 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.550 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.457427+0000", 2024-04-19T04:24:58.550 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3624e-05 2024-04-19T04:24:58.551 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.551 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.551 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.551 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.457435+0000", 2024-04-19T04:24:58.551 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.5519999999999999e-06 2024-04-19T04:24:58.551 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.551 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.551 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.551 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.457499+0000", 2024-04-19T04:24:58.551 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.4182000000000003e-05 2024-04-19T04:24:58.551 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.551 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.551 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.551 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.457679+0000", 2024-04-19T04:24:58.552 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017971 2024-04-19T04:24:58.552 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.552 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.552 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:58.552 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.457888+0000", 2024-04-19T04:24:58.552 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00020956999999999999 2024-04-19T04:24:58.552 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.552 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.552 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.552 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.461365+0000", 2024-04-19T04:24:58.552 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0034765709999999999 2024-04-19T04:24:58.552 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.552 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.552 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:58.552 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.471019+0000", 2024-04-19T04:24:58.553 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0096541430000000004 2024-04-19T04:24:58.553 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.553 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.553 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:58.553 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.471053+0000", 2024-04-19T04:24:58.553 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.4391000000000003e-05 2024-04-19T04:24:58.553 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.553 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.553 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.553 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.471077+0000", 2024-04-19T04:24:58.553 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.3907999999999999e-05 2024-04-19T04:24:58.553 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.553 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.553 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.553 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.554 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.554 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26610 5.c 5:3fdc85e9:::benchmark_data_smithi007_19526_object26609:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:58.554 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.457445+0000", 2024-04-19T04:24:58.554 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 3.9925371589999998, 2024-04-19T04:24:58.554 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013741766000000001, 2024-04-19T04:24:58.554 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.554 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:58.554 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:58.554 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:58.554 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.554 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26610 2024-04-19T04:24:58.554 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.554 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.554 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.554 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.555 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.457445+0000", 2024-04-19T04:24:58.555 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.555 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.555 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.555 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.555 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.457445+0000", 2024-04-19T04:24:58.555 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.555 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.555 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.555 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.555 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.457444+0000", 2024-04-19T04:24:58.555 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:58.555 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.556 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.556 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.556 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.457505+0000", 2024-04-19T04:24:58.556 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.0566000000000003e-05 2024-04-19T04:24:58.556 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.556 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.556 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.556 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.457512+0000", 2024-04-19T04:24:58.556 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.5629999999999997e-06 2024-04-19T04:24:58.556 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.556 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.556 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.556 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.457516+0000", 2024-04-19T04:24:58.556 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2509999999999996e-06 2024-04-19T04:24:58.557 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.557 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.557 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.557 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.459552+0000", 2024-04-19T04:24:58.557 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0020361989999999998 2024-04-19T04:24:58.557 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.557 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.557 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.557 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.459740+0000", 2024-04-19T04:24:58.557 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000188133 2024-04-19T04:24:58.557 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.557 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.557 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:58.557 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.459918+0000", 2024-04-19T04:24:58.557 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017812399999999999 2024-04-19T04:24:58.558 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.558 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.558 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.558 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.461997+0000", 2024-04-19T04:24:58.558 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0020788310000000002 2024-04-19T04:24:58.558 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.558 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.558 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:58.558 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.471119+0000", 2024-04-19T04:24:58.558 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0091221329999999993 2024-04-19T04:24:58.558 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.558 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.558 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:58.559 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.471161+0000", 2024-04-19T04:24:58.559 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2116000000000001e-05 2024-04-19T04:24:58.559 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.559 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.559 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.559 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.471187+0000", 2024-04-19T04:24:58.559 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.5358999999999999e-05 2024-04-19T04:24:58.559 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.559 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.559 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.559 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.559 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.559 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:33738 5.8 5:1c77f9c1:::benchmark_data_smithi007_19526_object33737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:24:58.560 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:58.410208+0000", 2024-04-19T04:24:58.560 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.039774454000000001, 2024-04-19T04:24:58.560 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013435040000000001, 2024-04-19T04:24:58.560 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:58.560 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:58.560 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:58.560 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:58.560 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.560 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 33738 2024-04-19T04:24:58.560 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.560 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:58.560 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.560 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:58.560 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.410208+0000", 2024-04-19T04:24:58.560 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.561 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.561 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.561 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:58.561 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.410208+0000", 2024-04-19T04:24:58.561 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:58.561 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.561 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.561 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:58.561 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.410206+0000", 2024-04-19T04:24:58.561 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:58.561 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.561 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.561 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:58.561 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.410272+0000", 2024-04-19T04:24:58.562 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.5588999999999998e-05 2024-04-19T04:24:58.562 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.562 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.562 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:58.562 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.410293+0000", 2024-04-19T04:24:58.562 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.1661000000000001e-05 2024-04-19T04:24:58.562 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.562 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.562 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.562 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.410305+0000", 2024-04-19T04:24:58.562 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2026e-05 2024-04-19T04:24:58.562 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.562 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.563 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:58.563 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.410591+0000", 2024-04-19T04:24:58.563 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000285207 2024-04-19T04:24:58.563 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.563 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.563 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:58.563 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.410720+0000", 2024-04-19T04:24:58.563 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000129068 2024-04-19T04:24:58.563 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.563 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.563 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:58.563 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.410854+0000", 2024-04-19T04:24:58.563 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000134623 2024-04-19T04:24:58.563 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.564 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.564 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:58.564 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.416845+0000", 2024-04-19T04:24:58.564 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0059904320000000004 2024-04-19T04:24:58.564 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.564 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.564 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:58.564 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.423537+0000", 2024-04-19T04:24:58.564 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0066919029999999999 2024-04-19T04:24:58.564 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.564 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.564 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:24:58.564 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.423608+0000", 2024-04-19T04:24:58.565 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.0922999999999998e-05 2024-04-19T04:24:58.565 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:58.565 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:58.565 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:24:58.565 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.423643+0000", 2024-04-19T04:24:58.565 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.5111000000000003e-05 2024-04-19T04:24:58.565 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.565 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.565 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.565 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:58.565 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:58.565 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:24:58.567 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:24:58.567 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:58.563+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:58.668 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:58.662+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:58.693 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:24:58.693 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:24:58.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.694 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:34369 5.a e31/20 5:5e6cedb3:::benchmark_data_smithi007_19526_object34368:head v 31'2152, mlcod=31'2147)", 2024-04-19T04:24:58.694 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:58.687971+0000", 2024-04-19T04:24:58.694 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0047290279999999997, 2024-04-19T04:24:58.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047476610000000002, 2024-04-19T04:24:58.694 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:58.694 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:24:58.694 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:58.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:58.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.687971+0000", 2024-04-19T04:24:58.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:58.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:58.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.687971+0000", 2024-04-19T04:24:58.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:58.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:58.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.687971+0000", 2024-04-19T04:24:58.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:58.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:58.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.688043+0000", 2024-04-19T04:24:58.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2308e-05 2024-04-19T04:24:58.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:58.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.688051+0000", 2024-04-19T04:24:58.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7559999999999999e-06 2024-04-19T04:24:58.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.688056+0000", 2024-04-19T04:24:58.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3249999999999998e-06 2024-04-19T04:24:58.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:58.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.688088+0000", 2024-04-19T04:24:58.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2347e-05 2024-04-19T04:24:58.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:58.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.688104+0000", 2024-04-19T04:24:58.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5775999999999999e-05 2024-04-19T04:24:58.699 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:58.699 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:58.700 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:58.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.700 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:34373 5.9 e31/20 5:929dcab4:::benchmark_data_smithi007_19526_object34372:head v 31'2248, mlcod=31'2246)", 2024-04-19T04:24:58.700 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:58.690077+0000", 2024-04-19T04:24:58.701 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0026229410000000002, 2024-04-19T04:24:58.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027109149999999999, 2024-04-19T04:24:58.702 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:58.702 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:24:58.702 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:58.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:58.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.690077+0000", 2024-04-19T04:24:58.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:58.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:58.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.690077+0000", 2024-04-19T04:24:58.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:58.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:58.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.690076+0000", 2024-04-19T04:24:58.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:58.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.690152+0000", 2024-04-19T04:24:58.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5974000000000001e-05 2024-04-19T04:24:58.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:58.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.690165+0000", 2024-04-19T04:24:58.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2388999999999999e-05 2024-04-19T04:24:58.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.690171+0000", 2024-04-19T04:24:58.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9479999999999996e-06 2024-04-19T04:24:58.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:58.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.690194+0000", 2024-04-19T04:24:58.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3660999999999999e-05 2024-04-19T04:24:58.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:58.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.690215+0000", 2024-04-19T04:24:58.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0894e-05 2024-04-19T04:24:58.710 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:58.710 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:58.710 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:58.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.711 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:34374 5.4 e31/29 5:24c0f275:::benchmark_data_smithi007_19526_object34373:head v 31'2095, mlcod=31'2093)", 2024-04-19T04:24:58.711 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:58.690942+0000", 2024-04-19T04:24:58.711 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001758396, 2024-04-19T04:24:58.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019412979999999999, 2024-04-19T04:24:58.711 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:58.711 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:24:58.711 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:58.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:58.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.690942+0000", 2024-04-19T04:24:58.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:58.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:58.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.690942+0000", 2024-04-19T04:24:58.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:58.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:58.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.690941+0000", 2024-04-19T04:24:58.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:58.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.691033+0000", 2024-04-19T04:24:58.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2130000000000001e-05 2024-04-19T04:24:58.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:58.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.691047+0000", 2024-04-19T04:24:58.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4316e-05 2024-04-19T04:24:58.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.691055+0000", 2024-04-19T04:24:58.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2320000000000004e-06 2024-04-19T04:24:58.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:58.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.691095+0000", 2024-04-19T04:24:58.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0120000000000002e-05 2024-04-19T04:24:58.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:58.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.691123+0000", 2024-04-19T04:24:58.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7957999999999999e-05 2024-04-19T04:24:58.716 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:58.716 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:58.716 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:58.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.716 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:34377 5.e 5:745eeedd:::benchmark_data_smithi007_19526_object34376:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:24:58.716 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:58.691848+0000", 2024-04-19T04:24:58.716 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00085246300000000003, 2024-04-19T04:24:58.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0011492939999999999, 2024-04-19T04:24:58.716 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:58.716 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:58.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:58.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:58.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:58.717 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 34377 2024-04-19T04:24:58.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.717 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:58.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:58.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.691848+0000", 2024-04-19T04:24:58.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:58.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:58.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.691848+0000", 2024-04-19T04:24:58.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:58.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:58.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.691847+0000", 2024-04-19T04:24:58.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:58.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.691912+0000", 2024-04-19T04:24:58.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5751000000000001e-05 2024-04-19T04:24:58.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:58.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.691927+0000", 2024-04-19T04:24:58.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4231e-05 2024-04-19T04:24:58.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.691934+0000", 2024-04-19T04:24:58.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8550000000000002e-06 2024-04-19T04:24:58.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:58.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.691988+0000", 2024-04-19T04:24:58.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3681999999999999e-05 2024-04-19T04:24:58.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:58.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692122+0000", 2024-04-19T04:24:58.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013423600000000001 2024-04-19T04:24:58.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:58.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692262+0000", 2024-04-19T04:24:58.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013944000000000001 2024-04-19T04:24:58.720 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:58.720 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:58.720 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:58.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.720 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:34382 5.8 e31/29 5:11c7dd0c:::benchmark_data_smithi007_19526_object34381:head v 31'2183, mlcod=31'2181)", 2024-04-19T04:24:58.720 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:58.692616+0000", 2024-04-19T04:24:58.721 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.4085999999999994e-05, 2024-04-19T04:24:58.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00050118500000000002, 2024-04-19T04:24:58.721 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:58.721 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:24:58.721 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:58.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:58.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692616+0000", 2024-04-19T04:24:58.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:58.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:58.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692616+0000", 2024-04-19T04:24:58.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:58.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:58.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692616+0000", 2024-04-19T04:24:58.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:58.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:58.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692717+0000", 2024-04-19T04:24:58.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101124 2024-04-19T04:24:58.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:58.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692726+0000", 2024-04-19T04:24:58.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6309999999999998e-06 2024-04-19T04:24:58.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692732+0000", 2024-04-19T04:24:58.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4519999999999996e-06 2024-04-19T04:24:58.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:58.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692784+0000", 2024-04-19T04:24:58.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1931000000000001e-05 2024-04-19T04:24:58.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:58.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692823+0000", 2024-04-19T04:24:58.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9186000000000001e-05 2024-04-19T04:24:58.724 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:58.724 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:58.724 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:58.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.724 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:34378 5.d e31/29 5:b4339cc5:::benchmark_data_smithi007_19526_object34377:head v 31'2035, mlcod=31'2033)", 2024-04-19T04:24:58.724 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:58.692743+0000", 2024-04-19T04:24:58.724 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9999576, 2024-04-19T04:24:58.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00047029500000000002, 2024-04-19T04:24:58.724 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:58.725 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:24:58.725 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:58.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:58.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692743+0000", 2024-04-19T04:24:58.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:58.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:58.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692743+0000", 2024-04-19T04:24:58.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:58.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:58.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692742+0000", 2024-04-19T04:24:58.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:58.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:58.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692784+0000", 2024-04-19T04:24:58.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1798999999999997e-05 2024-04-19T04:24:58.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:58.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692799+0000", 2024-04-19T04:24:58.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4938e-05 2024-04-19T04:24:58.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692817+0000", 2024-04-19T04:24:58.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8637000000000001e-05 2024-04-19T04:24:58.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:58.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692897+0000", 2024-04-19T04:24:58.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9659000000000004e-05 2024-04-19T04:24:58.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:58.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692912+0000", 2024-04-19T04:24:58.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5252000000000001e-05 2024-04-19T04:24:58.727 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:58.727 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:58.728 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:58.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.728 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:34383 5.9 e31/20 5:9a3cb540:::benchmark_data_smithi007_19526_object34382:head v 31'2249, mlcod=31'2246)", 2024-04-19T04:24:58.728 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:58.692996+0000", 2024-04-19T04:24:58.728 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9997039, 2024-04-19T04:24:58.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00031491800000000002, 2024-04-19T04:24:58.728 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:58.728 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:24:58.728 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:58.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:58.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692996+0000", 2024-04-19T04:24:58.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:58.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:58.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692996+0000", 2024-04-19T04:24:58.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:58.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:58.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.692996+0000", 2024-04-19T04:24:58.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:58.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:58.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.693039+0000", 2024-04-19T04:24:58.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3276999999999999e-05 2024-04-19T04:24:58.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:58.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.693072+0000", 2024-04-19T04:24:58.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3596000000000002e-05 2024-04-19T04:24:58.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.693120+0000", 2024-04-19T04:24:58.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7856999999999999e-05 2024-04-19T04:24:58.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:58.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.693167+0000", 2024-04-19T04:24:58.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6517000000000002e-05 2024-04-19T04:24:58.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:58.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.693189+0000", 2024-04-19T04:24:58.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2623e-05 2024-04-19T04:24:58.732 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:58.733 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:58.733 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:58.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.733 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:34384 5.f e31/20 5:f78d4d9b:::benchmark_data_smithi007_19526_object34383:head v 31'2114, mlcod=31'2112)", 2024-04-19T04:24:58.733 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:58.693149+0000", 2024-04-19T04:24:58.734 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9995513, 2024-04-19T04:24:58.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025788999999999999, 2024-04-19T04:24:58.734 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:58.734 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:24:58.734 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:58.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:58.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.693149+0000", 2024-04-19T04:24:58.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:58.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:58.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.693149+0000", 2024-04-19T04:24:58.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:58.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:58.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.693148+0000", 2024-04-19T04:24:58.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:58.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:58.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.693183+0000", 2024-04-19T04:24:58.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4819e-05 2024-04-19T04:24:58.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:58.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.693193+0000", 2024-04-19T04:24:58.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5219999999999996e-06 2024-04-19T04:24:58.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:58.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.693206+0000", 2024-04-19T04:24:58.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.327e-05 2024-04-19T04:24:58.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:58.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.693253+0000", 2024-04-19T04:24:58.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7236e-05 2024-04-19T04:24:58.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:58.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:58.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:58.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.693273+0000", 2024-04-19T04:24:58.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9361e-05 2024-04-19T04:24:58.740 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:58.740 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:58.740 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:58.740 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:58.740 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:24:58.740 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 8 2024-04-19T04:24:58.741 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:24:58.742 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:24:58.751 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 14 16 34525 34509 154.04 146.75 0.00505748 0.00648556 2024-04-19T04:24:58.769 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:58.766+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:58.869 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:24:58.869 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:24:58.869 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:24:58.870 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:24:58.870 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:24:58.870 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:58.863+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:58.880 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:24:58.970 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:58.963+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:59.003 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:24:59.003 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:24:59.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:24:59.003 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:24:59.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.003 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:59.003 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539530+0000", 2024-04-19T04:24:59.003 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.460418410000003, 2024-04-19T04:24:59.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015136197000000001, 2024-04-19T04:24:59.004 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.004 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.004 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539530+0000", 2024-04-19T04:24:59.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539530+0000", 2024-04-19T04:24:59.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539527+0000", 2024-04-19T04:24:59.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999971 2024-04-19T04:24:59.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539544+0000", 2024-04-19T04:24:59.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7082999999999999e-05 2024-04-19T04:24:59.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539567+0000", 2024-04-19T04:24:59.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3569000000000001e-05 2024-04-19T04:24:59.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539589+0000", 2024-04-19T04:24:59.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1486999999999999e-05 2024-04-19T04:24:59.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539691+0000", 2024-04-19T04:24:59.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010262 2024-04-19T04:24:59.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539876+0000", 2024-04-19T04:24:59.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000184172 2024-04-19T04:24:59.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:59.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541233+0000", 2024-04-19T04:24:59.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013569719999999999 2024-04-19T04:24:59.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547291+0000", 2024-04-19T04:24:59.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060583080000000001 2024-04-19T04:24:59.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554597+0000", 2024-04-19T04:24:59.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0073062800000000001 2024-04-19T04:24:59.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554640+0000", 2024-04-19T04:24:59.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3115999999999999e-05 2024-04-19T04:24:59.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554666+0000", 2024-04-19T04:24:59.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5400000000000001e-05 2024-04-19T04:24:59.009 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.009 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.009 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.010 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:59.010 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539646+0000", 2024-04-19T04:24:59.010 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.460301583000003, 2024-04-19T04:24:59.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015767644000000001, 2024-04-19T04:24:59.010 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.010 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.010 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539646+0000", 2024-04-19T04:24:59.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539646+0000", 2024-04-19T04:24:59.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539645+0000", 2024-04-19T04:24:59.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:59.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539672+0000", 2024-04-19T04:24:59.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7036999999999999e-05 2024-04-19T04:24:59.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539691+0000", 2024-04-19T04:24:59.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8929000000000001e-05 2024-04-19T04:24:59.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539707+0000", 2024-04-19T04:24:59.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5979999999999999e-05 2024-04-19T04:24:59.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542292+0000", 2024-04-19T04:24:59.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025857020000000001 2024-04-19T04:24:59.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542472+0000", 2024-04-19T04:24:59.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018001599999999999 2024-04-19T04:24:59.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:59.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543505+0000", 2024-04-19T04:24:59.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010326739999999999 2024-04-19T04:24:59.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547314+0000", 2024-04-19T04:24:59.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038089349999999998 2024-04-19T04:24:59.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555323+0000", 2024-04-19T04:24:59.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080089979999999998 2024-04-19T04:24:59.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555378+0000", 2024-04-19T04:24:59.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4951999999999998e-05 2024-04-19T04:24:59.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555414+0000", 2024-04-19T04:24:59.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5998000000000003e-05 2024-04-19T04:24:59.016 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.017 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.017 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.017 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:59.017 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539729+0000", 2024-04-19T04:24:59.017 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.460218488000002, 2024-04-19T04:24:59.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015615043, 2024-04-19T04:24:59.017 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.017 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.017 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539729+0000", 2024-04-19T04:24:59.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.018 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539729+0000", 2024-04-19T04:24:59.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.018 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539728+0000", 2024-04-19T04:24:59.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:59.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539737+0000", 2024-04-19T04:24:59.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5799999999999992e-06 2024-04-19T04:24:59.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539753+0000", 2024-04-19T04:24:59.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6373000000000001e-05 2024-04-19T04:24:59.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539770+0000", 2024-04-19T04:24:59.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7516e-05 2024-04-19T04:24:59.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542136+0000", 2024-04-19T04:24:59.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023653440000000001 2024-04-19T04:24:59.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543783+0000", 2024-04-19T04:24:59.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016468209999999999 2024-04-19T04:24:59.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:59.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543971+0000", 2024-04-19T04:24:59.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018871200000000001 2024-04-19T04:24:59.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547318+0000", 2024-04-19T04:24:59.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033471199999999999 2024-04-19T04:24:59.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555276+0000", 2024-04-19T04:24:59.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079574280000000008 2024-04-19T04:24:59.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555320+0000", 2024-04-19T04:24:59.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3664000000000001e-05 2024-04-19T04:24:59.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555344+0000", 2024-04-19T04:24:59.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4905e-05 2024-04-19T04:24:59.023 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.023 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.023 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.023 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:59.023 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539783+0000", 2024-04-19T04:24:59.023 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.460165183000001, 2024-04-19T04:24:59.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014773131, 2024-04-19T04:24:59.024 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.024 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.024 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539783+0000", 2024-04-19T04:24:59.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539783+0000", 2024-04-19T04:24:59.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539782+0000", 2024-04-19T04:24:59.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539790+0000", 2024-04-19T04:24:59.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9440000000000005e-06 2024-04-19T04:24:59.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539807+0000", 2024-04-19T04:24:59.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7036000000000001e-05 2024-04-19T04:24:59.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539822+0000", 2024-04-19T04:24:59.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4939e-05 2024-04-19T04:24:59.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539914+0000", 2024-04-19T04:24:59.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2435000000000005e-05 2024-04-19T04:24:59.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541221+0000", 2024-04-19T04:24:59.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001307358 2024-04-19T04:24:59.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:59.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541403+0000", 2024-04-19T04:24:59.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018113299999999999 2024-04-19T04:24:59.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.545434+0000", 2024-04-19T04:24:59.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040314260000000003 2024-04-19T04:24:59.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554049+0000", 2024-04-19T04:24:59.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0086145500000000003 2024-04-19T04:24:59.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554515+0000", 2024-04-19T04:24:59.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00046650899999999999 2024-04-19T04:24:59.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554556+0000", 2024-04-19T04:24:59.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0850999999999999e-05 2024-04-19T04:24:59.029 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.029 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.029 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.030 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:59.030 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:24:59.030 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.460104923999999, 2024-04-19T04:24:59.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018096054, 2024-04-19T04:24:59.030 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.030 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.030 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:24:59.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:24:59.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539842+0000", 2024-04-19T04:24:59.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:59.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539848+0000", 2024-04-19T04:24:59.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-19T04:24:59.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539859+0000", 2024-04-19T04:24:59.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0783e-05 2024-04-19T04:24:59.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539866+0000", 2024-04-19T04:24:59.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9439999999999999e-06 2024-04-19T04:24:59.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547400+0000", 2024-04-19T04:24:59.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075343729999999996 2024-04-19T04:24:59.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547480+0000", 2024-04-19T04:24:59.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9793e-05 2024-04-19T04:24:59.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:59.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547587+0000", 2024-04-19T04:24:59.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107333 2024-04-19T04:24:59.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.548935+0000", 2024-04-19T04:24:59.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013480639999999999 2024-04-19T04:24:59.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557892+0000", 2024-04-19T04:24:59.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089563939999999995 2024-04-19T04:24:59.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557920+0000", 2024-04-19T04:24:59.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8342000000000001e-05 2024-04-19T04:24:59.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557939+0000", 2024-04-19T04:24:59.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9142000000000001e-05 2024-04-19T04:24:59.036 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.036 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.036 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.036 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:59.036 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539872+0000", 2024-04-19T04:24:59.036 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.460075515, 2024-04-19T04:24:59.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015022429, 2024-04-19T04:24:59.036 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.036 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.036 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539872+0000", 2024-04-19T04:24:59.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539872+0000", 2024-04-19T04:24:59.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539872+0000", 2024-04-19T04:24:59.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:59.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539876+0000", 2024-04-19T04:24:59.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1999999999999996e-06 2024-04-19T04:24:59.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539886+0000", 2024-04-19T04:24:59.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9469999999999998e-06 2024-04-19T04:24:59.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539906+0000", 2024-04-19T04:24:59.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0542000000000001e-05 2024-04-19T04:24:59.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542491+0000", 2024-04-19T04:24:59.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025843530000000002 2024-04-19T04:24:59.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543411+0000", 2024-04-19T04:24:59.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00091973700000000001 2024-04-19T04:24:59.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:59.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543523+0000", 2024-04-19T04:24:59.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112323 2024-04-19T04:24:59.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.546595+0000", 2024-04-19T04:24:59.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003071631 2024-04-19T04:24:59.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554744+0000", 2024-04-19T04:24:59.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081498850000000008 2024-04-19T04:24:59.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554799+0000", 2024-04-19T04:24:59.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5067e-05 2024-04-19T04:24:59.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.554895+0000", 2024-04-19T04:24:59.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5364000000000004e-05 2024-04-19T04:24:59.042 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.042 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.042 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.042 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:59.042 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:24:59.042 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.460028676, 2024-04-19T04:24:59.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018086631999999998, 2024-04-19T04:24:59.042 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.043 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.043 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:24:59.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:24:59.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539918+0000", 2024-04-19T04:24:59.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539931+0000", 2024-04-19T04:24:59.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2566e-05 2024-04-19T04:24:59.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539958+0000", 2024-04-19T04:24:59.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6582999999999999e-05 2024-04-19T04:24:59.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539972+0000", 2024-04-19T04:24:59.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4789e-05 2024-04-19T04:24:59.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547577+0000", 2024-04-19T04:24:59.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0076045979999999997 2024-04-19T04:24:59.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547769+0000", 2024-04-19T04:24:59.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000192034 2024-04-19T04:24:59.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:59.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547929+0000", 2024-04-19T04:24:59.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000159679 2024-04-19T04:24:59.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.548942+0000", 2024-04-19T04:24:59.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010138720000000001 2024-04-19T04:24:59.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557962+0000", 2024-04-19T04:24:59.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090199970000000001 2024-04-19T04:24:59.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557985+0000", 2024-04-19T04:24:59.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2623e-05 2024-04-19T04:24:59.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.558006+0000", 2024-04-19T04:24:59.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0764e-05 2024-04-19T04:24:59.048 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.048 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.048 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.049 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:27 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:59.049 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:24:59.049 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.459962687999997, 2024-04-19T04:24:59.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018047384, 2024-04-19T04:24:59.049 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.049 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:24:59.049 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:24:59.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:24:59.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539984+0000", 2024-04-19T04:24:59.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:59.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539991+0000", 2024-04-19T04:24:59.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7769999999999997e-06 2024-04-19T04:24:59.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540010+0000", 2024-04-19T04:24:59.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9573e-05 2024-04-19T04:24:59.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540025+0000", 2024-04-19T04:24:59.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4796e-05 2024-04-19T04:24:59.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541220+0000", 2024-04-19T04:24:59.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001195172 2024-04-19T04:24:59.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541569+0000", 2024-04-19T04:24:59.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00034836600000000002 2024-04-19T04:24:59.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.558033+0000", 2024-04-19T04:24:59.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.016464092999999999 2024-04-19T04:24:59.053 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.053 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.053 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.053 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:14827 5.8 5:17a0805e:::benchmark_data_smithi007_19526_object14826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:24:59.053 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:49.835039+0000", 2024-04-19T04:24:59.053 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.1649086779999998, 2024-04-19T04:24:59.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015368504, 2024-04-19T04:24:59.054 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.054 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.054 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:59.054 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:59.054 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.054 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 14827 2024-04-19T04:24:59.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.054 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835039+0000", 2024-04-19T04:24:59.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835039+0000", 2024-04-19T04:24:59.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835038+0000", 2024-04-19T04:24:59.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835118+0000", 2024-04-19T04:24:59.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0253000000000006e-05 2024-04-19T04:24:59.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835134+0000", 2024-04-19T04:24:59.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5565000000000001e-05 2024-04-19T04:24:59.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835145+0000", 2024-04-19T04:24:59.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1066e-05 2024-04-19T04:24:59.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.839716+0000", 2024-04-19T04:24:59.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045706610000000002 2024-04-19T04:24:59.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.839880+0000", 2024-04-19T04:24:59.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164272 2024-04-19T04:24:59.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:59.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.840064+0000", 2024-04-19T04:24:59.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018395999999999999 2024-04-19T04:24:59.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.842870+0000", 2024-04-19T04:24:59.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028064790000000002 2024-04-19T04:24:59.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.850315+0000", 2024-04-19T04:24:59.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074444639999999996 2024-04-19T04:24:59.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.850376+0000", 2024-04-19T04:24:59.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.088e-05 2024-04-19T04:24:59.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.850408+0000", 2024-04-19T04:24:59.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2013e-05 2024-04-19T04:24:59.060 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.060 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.060 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.060 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24310 5.0 5:07098fc4:::benchmark_data_smithi007_19526_object24309:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:59.060 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.471082+0000", 2024-04-19T04:24:59.060 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.528865863, 2024-04-19T04:24:59.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018533300999999999, 2024-04-19T04:24:59.060 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.060 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.060 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:59.061 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:59.061 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.061 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24310 2024-04-19T04:24:59.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.061 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.471082+0000", 2024-04-19T04:24:59.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.471082+0000", 2024-04-19T04:24:59.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.471081+0000", 2024-04-19T04:24:59.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472015+0000", 2024-04-19T04:24:59.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00093410800000000001 2024-04-19T04:24:59.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472027+0000", 2024-04-19T04:24:59.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1491000000000001e-05 2024-04-19T04:24:59.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472033+0000", 2024-04-19T04:24:59.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9499999999999998e-06 2024-04-19T04:24:59.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472087+0000", 2024-04-19T04:24:59.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4595999999999997e-05 2024-04-19T04:24:59.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472208+0000", 2024-04-19T04:24:59.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012105299999999999 2024-04-19T04:24:59.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:59.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.475540+0000", 2024-04-19T04:24:59.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033319310000000002 2024-04-19T04:24:59.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481479+0000", 2024-04-19T04:24:59.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059387440000000001 2024-04-19T04:24:59.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489528+0000", 2024-04-19T04:24:59.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080487739999999999 2024-04-19T04:24:59.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489578+0000", 2024-04-19T04:24:59.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0321999999999997e-05 2024-04-19T04:24:59.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489615+0000", 2024-04-19T04:24:59.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7425000000000002e-05 2024-04-19T04:24:59.066 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.066 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.066 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.067 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24318 5.0 5:09636443:::benchmark_data_smithi007_19526_object24317:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:59.067 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.472336+0000", 2024-04-19T04:24:59.067 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.527611834, 2024-04-19T04:24:59.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017477310999999999, 2024-04-19T04:24:59.067 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.067 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.067 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:59.067 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:59.067 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.067 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24318 2024-04-19T04:24:59.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.068 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472336+0000", 2024-04-19T04:24:59.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472336+0000", 2024-04-19T04:24:59.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472335+0000", 2024-04-19T04:24:59.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472373+0000", 2024-04-19T04:24:59.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7876999999999997e-05 2024-04-19T04:24:59.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472384+0000", 2024-04-19T04:24:59.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0513000000000001e-05 2024-04-19T04:24:59.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472391+0000", 2024-04-19T04:24:59.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6680000000000001e-06 2024-04-19T04:24:59.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.476649+0000", 2024-04-19T04:24:59.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004257172 2024-04-19T04:24:59.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.476767+0000", 2024-04-19T04:24:59.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118584 2024-04-19T04:24:59.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:59.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.476868+0000", 2024-04-19T04:24:59.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100912 2024-04-19T04:24:59.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481491+0000", 2024-04-19T04:24:59.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046224990000000004 2024-04-19T04:24:59.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489691+0000", 2024-04-19T04:24:59.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082007529999999999 2024-04-19T04:24:59.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489777+0000", 2024-04-19T04:24:59.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6174000000000005e-05 2024-04-19T04:24:59.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489813+0000", 2024-04-19T04:24:59.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.591e-05 2024-04-19T04:24:59.073 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.073 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.073 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.073 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24322 5.0 5:08733fec:::benchmark_data_smithi007_19526_object24321:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:59.073 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.474319+0000", 2024-04-19T04:24:59.074 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.5256292939999998, 2024-04-19T04:24:59.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015646382, 2024-04-19T04:24:59.074 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.074 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.074 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:59.074 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:59.074 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.074 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24322 2024-04-19T04:24:59.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.074 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474319+0000", 2024-04-19T04:24:59.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474319+0000", 2024-04-19T04:24:59.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474318+0000", 2024-04-19T04:24:59.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474385+0000", 2024-04-19T04:24:59.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6892999999999998e-05 2024-04-19T04:24:59.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474405+0000", 2024-04-19T04:24:59.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9819000000000001e-05 2024-04-19T04:24:59.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474410+0000", 2024-04-19T04:24:59.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4990000000000002e-06 2024-04-19T04:24:59.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477692+0000", 2024-04-19T04:24:59.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032817570000000002 2024-04-19T04:24:59.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477802+0000", 2024-04-19T04:24:59.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0001102 2024-04-19T04:24:59.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:59.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477921+0000", 2024-04-19T04:24:59.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119159 2024-04-19T04:24:59.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481501+0000", 2024-04-19T04:24:59.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003579558 2024-04-19T04:24:59.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489889+0000", 2024-04-19T04:24:59.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083880570000000008 2024-04-19T04:24:59.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489937+0000", 2024-04-19T04:24:59.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8124000000000002e-05 2024-04-19T04:24:59.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489965+0000", 2024-04-19T04:24:59.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8085e-05 2024-04-19T04:24:59.080 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.080 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.080 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.080 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24324 5.0 5:08824c49:::benchmark_data_smithi007_19526_object24323:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:59.080 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.475064+0000", 2024-04-19T04:24:59.080 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.5248841750000004, 2024-04-19T04:24:59.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014990401, 2024-04-19T04:24:59.080 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.080 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.081 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:59.081 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:59.081 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.081 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24324 2024-04-19T04:24:59.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.081 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.475064+0000", 2024-04-19T04:24:59.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.475064+0000", 2024-04-19T04:24:59.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.475063+0000", 2024-04-19T04:24:59.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.475214+0000", 2024-04-19T04:24:59.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015162800000000001 2024-04-19T04:24:59.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.475229+0000", 2024-04-19T04:24:59.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4887e-05 2024-04-19T04:24:59.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.475235+0000", 2024-04-19T04:24:59.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8080000000000001e-06 2024-04-19T04:24:59.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.478738+0000", 2024-04-19T04:24:59.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003503 2024-04-19T04:24:59.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.478891+0000", 2024-04-19T04:24:59.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015284399999999999 2024-04-19T04:24:59.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:59.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.479027+0000", 2024-04-19T04:24:59.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013615099999999999 2024-04-19T04:24:59.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481511+0000", 2024-04-19T04:24:59.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024843819999999998 2024-04-19T04:24:59.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489990+0000", 2024-04-19T04:24:59.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084784960000000003 2024-04-19T04:24:59.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.490030+0000", 2024-04-19T04:24:59.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0470999999999999e-05 2024-04-19T04:24:59.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.490054+0000", 2024-04-19T04:24:59.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3705000000000001e-05 2024-04-19T04:24:59.086 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.086 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.086 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24332 5.0 5:0c25ea80:::benchmark_data_smithi007_19526_object24331:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.477492+0000", 2024-04-19T04:24:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.5224555750000004, 2024-04-19T04:24:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015281972, 2024-04-19T04:24:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24332 2024-04-19T04:24:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477492+0000", 2024-04-19T04:24:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477492+0000", 2024-04-19T04:24:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477491+0000", 2024-04-19T04:24:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477537+0000", 2024-04-19T04:24:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5785999999999998e-05 2024-04-19T04:24:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477554+0000", 2024-04-19T04:24:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6906e-05 2024-04-19T04:24:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477563+0000", 2024-04-19T04:24:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4730000000000006e-06 2024-04-19T04:24:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.480049+0000", 2024-04-19T04:24:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024853319999999998 2024-04-19T04:24:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.480228+0000", 2024-04-19T04:24:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000179502 2024-04-19T04:24:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.480409+0000", 2024-04-19T04:24:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000181168 2024-04-19T04:24:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481997+0000", 2024-04-19T04:24:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015875349999999999 2024-04-19T04:24:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.492645+0000", 2024-04-19T04:24:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010647647 2024-04-19T04:24:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.492715+0000", 2024-04-19T04:24:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0537999999999994e-05 2024-04-19T04:24:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.492774+0000", 2024-04-19T04:24:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9132999999999998e-05 2024-04-19T04:24:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:25794 5.e 5:77ddc1c5:::benchmark_data_smithi007_19526_object25793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.073091+0000", 2024-04-19T04:24:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.9268572630000005, 2024-04-19T04:24:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017751818999999999, 2024-04-19T04:24:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 25794 2024-04-19T04:24:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073091+0000", 2024-04-19T04:24:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073091+0000", 2024-04-19T04:24:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073089+0000", 2024-04-19T04:24:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073146+0000", 2024-04-19T04:24:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6011000000000003e-05 2024-04-19T04:24:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073162+0000", 2024-04-19T04:24:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6949e-05 2024-04-19T04:24:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073174+0000", 2024-04-19T04:24:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1538e-05 2024-04-19T04:24:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073244+0000", 2024-04-19T04:24:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9715000000000006e-05 2024-04-19T04:24:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073463+0000", 2024-04-19T04:24:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021919999999999999 2024-04-19T04:24:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073580+0000", 2024-04-19T04:24:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000116727 2024-04-19T04:24:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.075752+0000", 2024-04-19T04:24:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021724819999999999 2024-04-19T04:24:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.090747+0000", 2024-04-19T04:24:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014995059 2024-04-19T04:24:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.090790+0000", 2024-04-19T04:24:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3244999999999997e-05 2024-04-19T04:24:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.090842+0000", 2024-04-19T04:24:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2052000000000002e-05 2024-04-19T04:24:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:24:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.7644171909999997, 2024-04-19T04:24:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:24:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:24:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:24:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:24:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:24:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:24:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:24:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:24:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:24:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:24:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:24:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:24:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:24:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:24:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:24:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:24:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:24:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:24:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:24:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:24:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:24:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:24:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:24:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:24:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:24:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:24:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.7599682750000003, 2024-04-19T04:24:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:24:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:24:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:24:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:24:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:24:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:24:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:24:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:24:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:24:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:24:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:24:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:24:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:24:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:24:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:24:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:24:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:24:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:24:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:24:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:24:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:24:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:24:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:24:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:24:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:24:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26218 5.e 5:71096b4b:::benchmark_data_smithi007_19526_object26217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.299744+0000", 2024-04-19T04:24:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.7002040479999998, 2024-04-19T04:24:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015765136999999999, 2024-04-19T04:24:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26218 2024-04-19T04:24:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299744+0000", 2024-04-19T04:24:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299744+0000", 2024-04-19T04:24:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299743+0000", 2024-04-19T04:24:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299818+0000", 2024-04-19T04:24:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5840000000000006e-05 2024-04-19T04:24:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299827+0000", 2024-04-19T04:24:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5499999999999995e-06 2024-04-19T04:24:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299832+0000", 2024-04-19T04:24:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3569999999999997e-06 2024-04-19T04:24:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.301136+0000", 2024-04-19T04:24:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013039900000000001 2024-04-19T04:24:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.301220+0000", 2024-04-19T04:24:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3220999999999995e-05 2024-04-19T04:24:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.301339+0000", 2024-04-19T04:24:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119358 2024-04-19T04:24:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.302912+0000", 2024-04-19T04:24:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015726659999999999 2024-04-19T04:24:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.315424+0000", 2024-04-19T04:24:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012512452 2024-04-19T04:24:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.315479+0000", 2024-04-19T04:24:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4732999999999999e-05 2024-04-19T04:24:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.315509+0000", 2024-04-19T04:24:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0260000000000002e-05 2024-04-19T04:24:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:28229 5.4 5:2ef4e134:::benchmark_data_smithi007_19526_object28228:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T04:24:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:55.108574+0000", 2024-04-19T04:24:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.89137355, 2024-04-19T04:24:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015913132, 2024-04-19T04:24:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 28229 2024-04-19T04:24:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.108574+0000", 2024-04-19T04:24:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.108574+0000", 2024-04-19T04:24:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.108573+0000", 2024-04-19T04:24:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.108608+0000", 2024-04-19T04:24:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4468999999999998e-05 2024-04-19T04:24:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.108631+0000", 2024-04-19T04:24:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2928000000000001e-05 2024-04-19T04:24:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.108637+0000", 2024-04-19T04:24:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3080000000000004e-06 2024-04-19T04:24:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.111112+0000", 2024-04-19T04:24:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024749619999999998 2024-04-19T04:24:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.111260+0000", 2024-04-19T04:24:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000147885 2024-04-19T04:24:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.111348+0000", 2024-04-19T04:24:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8392000000000003e-05 2024-04-19T04:24:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.112602+0000", 2024-04-19T04:24:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001253348 2024-04-19T04:24:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.124401+0000", 2024-04-19T04:24:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011799047999999999 2024-04-19T04:24:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.124452+0000", 2024-04-19T04:24:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0946999999999999e-05 2024-04-19T04:24:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.124488+0000", 2024-04-19T04:24:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5750000000000002e-05 2024-04-19T04:24:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:29056 5.e 5:79c0dac4:::benchmark_data_smithi007_19526_object29055:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T04:24:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:55.454750+0000", 2024-04-19T04:24:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.5451979869999999, 2024-04-19T04:24:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015326128, 2024-04-19T04:24:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:24:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:24:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:24:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 29056 2024-04-19T04:24:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:24:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:24:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.454750+0000", 2024-04-19T04:24:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:24:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.454750+0000", 2024-04-19T04:24:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:24:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:24:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.454749+0000", 2024-04-19T04:24:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:24:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.454823+0000", 2024-04-19T04:24:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3337999999999995e-05 2024-04-19T04:24:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:24:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.454831+0000", 2024-04-19T04:24:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3599999999999996e-06 2024-04-19T04:24:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.454838+0000", 2024-04-19T04:24:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7630000000000003e-06 2024-04-19T04:24:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:24:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.454887+0000", 2024-04-19T04:24:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9008000000000002e-05 2024-04-19T04:24:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:24:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.455031+0000", 2024-04-19T04:24:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144182 2024-04-19T04:24:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.455227+0000", 2024-04-19T04:24:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019652299999999999 2024-04-19T04:24:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:24:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.458288+0000", 2024-04-19T04:24:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030609320000000001 2024-04-19T04:24:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.469992+0000", 2024-04-19T04:24:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011704057 2024-04-19T04:24:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:24:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.470042+0000", 2024-04-19T04:24:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9576000000000001e-05 2024-04-19T04:24:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:24:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:24:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:24:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.470076+0000", 2024-04-19T04:24:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4065e-05 2024-04-19T04:24:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.136 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:24:59.136 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:24:59.136 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:24:59.137 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:59.134+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:59.138 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:24:59.238 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:59.235+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:59.274 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:59.274 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:24:59.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.274 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:35672 5.7 5:ef907274:::benchmark_data_smithi007_19526_object35671:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:24:59.274 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:59.268319+0000", 2024-04-19T04:24:59.274 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.006095245, 2024-04-19T04:24:59.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0061146000000000004, 2024-04-19T04:24:59.275 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.275 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:59.275 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:59.275 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:59.275 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.275 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 35672 2024-04-19T04:24:59.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.275 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.268319+0000", 2024-04-19T04:24:59.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.268319+0000", 2024-04-19T04:24:59.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.268318+0000", 2024-04-19T04:24:59.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:59.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.268398+0000", 2024-04-19T04:24:59.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0532999999999996e-05 2024-04-19T04:24:59.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.268411+0000", 2024-04-19T04:24:59.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3261000000000001e-05 2024-04-19T04:24:59.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.268420+0000", 2024-04-19T04:24:59.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0820000000000005e-06 2024-04-19T04:24:59.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.279 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.279 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.268557+0000", 2024-04-19T04:24:59.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000136792 2024-04-19T04:24:59.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.268745+0000", 2024-04-19T04:24:59.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000187615 2024-04-19T04:24:59.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:59.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.268995+0000", 2024-04-19T04:24:59.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00024988000000000001 2024-04-19T04:24:59.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:59.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273015+0000", 2024-04-19T04:24:59.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040207230000000004 2024-04-19T04:24:59.281 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.281 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.281 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.281 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:35678 5.f 5:f99dd0f3:::benchmark_data_smithi007_19526_object35677:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:24:59.281 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:59.269823+0000", 2024-04-19T04:24:59.281 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0045911099999999998, 2024-04-19T04:24:59.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0046592400000000003, 2024-04-19T04:24:59.281 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.281 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:59.281 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:59.281 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:59.281 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.282 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 35678 2024-04-19T04:24:59.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.282 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.269823+0000", 2024-04-19T04:24:59.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.269823+0000", 2024-04-19T04:24:59.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.283 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.283 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.269822+0000", 2024-04-19T04:24:59.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.283 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.283 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.269888+0000", 2024-04-19T04:24:59.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5671000000000002e-05 2024-04-19T04:24:59.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.283 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.283 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.269901+0000", 2024-04-19T04:24:59.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2944e-05 2024-04-19T04:24:59.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.269910+0000", 2024-04-19T04:24:59.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5670000000000001e-06 2024-04-19T04:24:59.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.270935+0000", 2024-04-19T04:24:59.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0010244729999999999 2024-04-19T04:24:59.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.271096+0000", 2024-04-19T04:24:59.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000161423 2024-04-19T04:24:59.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.285 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:59.285 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.271253+0000", 2024-04-19T04:24:59.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000156355 2024-04-19T04:24:59.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.285 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.285 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.274345+0000", 2024-04-19T04:24:59.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0030928710000000001 2024-04-19T04:24:59.285 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.285 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.285 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.285 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:35680 5.1 5:82a49da6:::benchmark_data_smithi007_19526_object35679:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:24:59.286 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:59.270327+0000", 2024-04-19T04:24:59.286 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0040870530000000002, 2024-04-19T04:24:59.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042228989999999996, 2024-04-19T04:24:59.286 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.286 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:59.286 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:59.286 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:59.286 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.286 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 35680 2024-04-19T04:24:59.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.286 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.270327+0000", 2024-04-19T04:24:59.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.270327+0000", 2024-04-19T04:24:59.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.270326+0000", 2024-04-19T04:24:59.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.270403+0000", 2024-04-19T04:24:59.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6668000000000005e-05 2024-04-19T04:24:59.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.270429+0000", 2024-04-19T04:24:59.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6185000000000001e-05 2024-04-19T04:24:59.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.270438+0000", 2024-04-19T04:24:59.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.6220000000000004e-06 2024-04-19T04:24:59.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.270497+0000", 2024-04-19T04:24:59.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8859e-05 2024-04-19T04:24:59.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.270700+0000", 2024-04-19T04:24:59.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00020263099999999999 2024-04-19T04:24:59.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:59.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.270865+0000", 2024-04-19T04:24:59.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000164933 2024-04-19T04:24:59.289 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.289 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.289 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.290 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:35676 5.5 e31/20 5:a37bfe6b:::benchmark_data_smithi007_19526_object35675:head v 31'2275, mlcod=31'2271)", 2024-04-19T04:24:59.290 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:59.270712+0000", 2024-04-19T04:24:59.290 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0037022560000000001, 2024-04-19T04:24:59.290 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0039236970000000003, 2024-04-19T04:24:59.290 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.290 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.290 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.290 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.290 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.270712+0000", 2024-04-19T04:24:59.290 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.270712+0000", 2024-04-19T04:24:59.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.270711+0000", 2024-04-19T04:24:59.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.270763+0000", 2024-04-19T04:24:59.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1972000000000003e-05 2024-04-19T04:24:59.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.292 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.292 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.270773+0000", 2024-04-19T04:24:59.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0591000000000001e-05 2024-04-19T04:24:59.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.292 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.292 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.270780+0000", 2024-04-19T04:24:59.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.754e-06 2024-04-19T04:24:59.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.292 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.292 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.270826+0000", 2024-04-19T04:24:59.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5497000000000002e-05 2024-04-19T04:24:59.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.293 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.293 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.270846+0000", 2024-04-19T04:24:59.293 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0800000000000001e-05 2024-04-19T04:24:59.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.293 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.293 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.274594+0000", 2024-04-19T04:24:59.293 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0037478009999999998 2024-04-19T04:24:59.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.293 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.293 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.274636+0000", 2024-04-19T04:24:59.293 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1575000000000001e-05 2024-04-19T04:24:59.294 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.294 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.294 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.294 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.294 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.294 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:35681 5.3 e31/20 5:cd457aaa:::benchmark_data_smithi007_19526_object35680:head v 31'2176, mlcod=31'2174)", 2024-04-19T04:24:59.294 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:59.271096+0000", 2024-04-19T04:24:59.294 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0033181640000000002, 2024-04-19T04:24:59.294 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0035881419999999999, 2024-04-19T04:24:59.294 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.294 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:59.294 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.294 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.294 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.295 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.271096+0000", 2024-04-19T04:24:59.295 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.295 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.295 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.271096+0000", 2024-04-19T04:24:59.295 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.295 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.271095+0000", 2024-04-19T04:24:59.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:59.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.271179+0000", 2024-04-19T04:24:59.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3574999999999999e-05 2024-04-19T04:24:59.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.271189+0000", 2024-04-19T04:24:59.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0356999999999999e-05 2024-04-19T04:24:59.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.297 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.297 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.271197+0000", 2024-04-19T04:24:59.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5580000000000003e-06 2024-04-19T04:24:59.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.297 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.297 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.271254+0000", 2024-04-19T04:24:59.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7827e-05 2024-04-19T04:24:59.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.297 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.297 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.271268+0000", 2024-04-19T04:24:59.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3239e-05 2024-04-19T04:24:59.297 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.297 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.298 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.298 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:35684 5.7 5:e0fb1e6d:::benchmark_data_smithi007_19526_object35683:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:24:59.298 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:59.272889+0000", 2024-04-19T04:24:59.298 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001524975, 2024-04-19T04:24:59.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001836219, 2024-04-19T04:24:59.298 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.298 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:59.298 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:59.298 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:59.298 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.298 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 35684 2024-04-19T04:24:59.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.299 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.299 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.299 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.272889+0000", 2024-04-19T04:24:59.299 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.299 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.299 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.272889+0000", 2024-04-19T04:24:59.299 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.272888+0000", 2024-04-19T04:24:59.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.272984+0000", 2024-04-19T04:24:59.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5882000000000001e-05 2024-04-19T04:24:59.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.272997+0000", 2024-04-19T04:24:59.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2556e-05 2024-04-19T04:24:59.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273005+0000", 2024-04-19T04:24:59.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3350000000000007e-06 2024-04-19T04:24:59.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273037+0000", 2024-04-19T04:24:59.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2217e-05 2024-04-19T04:24:59.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273249+0000", 2024-04-19T04:24:59.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00021204199999999999 2024-04-19T04:24:59.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:24:59.302 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273502+0000", 2024-04-19T04:24:59.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000252651 2024-04-19T04:24:59.302 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.302 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.302 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.302 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:35679 5.5 e31/20 5:a5bdabce:::benchmark_data_smithi007_19526_object35678:head v 31'2276, mlcod=31'2272)", 2024-04-19T04:24:59.302 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:59.272945+0000", 2024-04-19T04:24:59.302 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001468769, 2024-04-19T04:24:59.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018162219999999999, 2024-04-19T04:24:59.302 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.303 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:59.303 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.272945+0000", 2024-04-19T04:24:59.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.272945+0000", 2024-04-19T04:24:59.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.272945+0000", 2024-04-19T04:24:59.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.304 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.304 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273001+0000", 2024-04-19T04:24:59.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6566e-05 2024-04-19T04:24:59.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.304 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.304 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273010+0000", 2024-04-19T04:24:59.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1689999999999998e-06 2024-04-19T04:24:59.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.304 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273017+0000", 2024-04-19T04:24:59.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2650000000000002e-06 2024-04-19T04:24:59.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273054+0000", 2024-04-19T04:24:59.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7523e-05 2024-04-19T04:24:59.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273083+0000", 2024-04-19T04:24:59.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.934e-05 2024-04-19T04:24:59.305 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.305 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.306 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.306 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:35682 5.3 e31/20 5:cff40462:::benchmark_data_smithi007_19526_object35681:head v 31'2177, mlcod=31'2174)", 2024-04-19T04:24:59.306 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:59.273067+0000", 2024-04-19T04:24:59.306 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0013470369999999999, 2024-04-19T04:24:59.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001725793, 2024-04-19T04:24:59.306 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.306 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:59.306 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273067+0000", 2024-04-19T04:24:59.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273067+0000", 2024-04-19T04:24:59.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273066+0000", 2024-04-19T04:24:59.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:59.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273128+0000", 2024-04-19T04:24:59.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2064999999999996e-05 2024-04-19T04:24:59.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273143+0000", 2024-04-19T04:24:59.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4317e-05 2024-04-19T04:24:59.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273147+0000", 2024-04-19T04:24:59.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5009999999999998e-06 2024-04-19T04:24:59.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273190+0000", 2024-04-19T04:24:59.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2954000000000002e-05 2024-04-19T04:24:59.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.309 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273224+0000", 2024-04-19T04:24:59.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.3250999999999997e-05 2024-04-19T04:24:59.309 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.309 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.309 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.309 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:35683 5.6 e31/20 5:6a1a4f17:::benchmark_data_smithi007_19526_object35682:head v 31'2233, mlcod=31'2230)", 2024-04-19T04:24:59.309 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:59.273290+0000", 2024-04-19T04:24:59.309 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001124519, 2024-04-19T04:24:59.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001531574, 2024-04-19T04:24:59.309 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.309 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:59.310 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273290+0000", 2024-04-19T04:24:59.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273290+0000", 2024-04-19T04:24:59.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273289+0000", 2024-04-19T04:24:59.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:59.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273349+0000", 2024-04-19T04:24:59.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9765000000000001e-05 2024-04-19T04:24:59.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273355+0000", 2024-04-19T04:24:59.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8579999999999996e-06 2024-04-19T04:24:59.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273358+0000", 2024-04-19T04:24:59.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5250000000000001e-06 2024-04-19T04:24:59.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273401+0000", 2024-04-19T04:24:59.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2514e-05 2024-04-19T04:24:59.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:59.273431+0000", 2024-04-19T04:24:59.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.0636999999999998e-05 2024-04-19T04:24:59.313 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.313 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.313 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.313 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.313 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:24:59.313 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 9 2024-04-19T04:24:59.313 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:59.314 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:24:59.340 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:59.338+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:59.440 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:24:59.438+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:24:59.446 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:59.446 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:24:59.446 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:24:59.446 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:24:59.446 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:59.459 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:24:59.542 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:59.535+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:59.593 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:24:59.593 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:24:59.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:24:59.594 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:24:59.594 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.594 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:59.594 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:59.594 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.058304333000002, 2024-04-19T04:24:59.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026801078999999998, 2024-04-19T04:24:59.594 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.594 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.594 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.594 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.594 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.594 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:59.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.595 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.595 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:24:59.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.595 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.595 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533733+0000", 2024-04-19T04:24:59.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999976 2024-04-19T04:24:59.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.595 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.595 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533746+0000", 2024-04-19T04:24:59.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2679e-05 2024-04-19T04:24:59.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533769+0000", 2024-04-19T04:24:59.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2832000000000001e-05 2024-04-19T04:24:59.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:24:59.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0599999999999999e-05 2024-04-19T04:24:59.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533907+0000", 2024-04-19T04:24:59.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000118076 2024-04-19T04:24:59.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:24:59.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533919+0000", 2024-04-19T04:24:59.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1644999999999999e-05 2024-04-19T04:24:59.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553399+0000", 2024-04-19T04:24:59.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019479987000000001 2024-04-19T04:24:59.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553535+0000", 2024-04-19T04:24:59.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553400000000001 2024-04-19T04:24:59.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:59.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553696+0000", 2024-04-19T04:24:59.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000161068 2024-04-19T04:24:59.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:59.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558096+0000", 2024-04-19T04:24:59.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0043998880000000002 2024-04-19T04:24:59.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.599 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.599 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560465+0000", 2024-04-19T04:24:59.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023695159999999999 2024-04-19T04:24:59.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.599 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.599 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560513+0000", 2024-04-19T04:24:59.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7899000000000003e-05 2024-04-19T04:24:59.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560537+0000", 2024-04-19T04:24:59.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3768e-05 2024-04-19T04:24:59.600 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.600 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.600 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.600 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:59.600 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:59.600 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.058227258999999, 2024-04-19T04:24:59.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026864505, 2024-04-19T04:24:59.600 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.600 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.601 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:59.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:24:59.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533812+0000", 2024-04-19T04:24:59.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533818+0000", 2024-04-19T04:24:59.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2369999999999997e-06 2024-04-19T04:24:59.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533863+0000", 2024-04-19T04:24:59.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4515000000000003e-05 2024-04-19T04:24:59.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533880+0000", 2024-04-19T04:24:59.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7119e-05 2024-04-19T04:24:59.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534029+0000", 2024-04-19T04:24:59.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014955099999999999 2024-04-19T04:24:59.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:59.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534034+0000", 2024-04-19T04:24:59.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1649999999999997e-06 2024-04-19T04:24:59.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554888+0000", 2024-04-19T04:24:59.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020854075 2024-04-19T04:24:59.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554967+0000", 2024-04-19T04:24:59.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8209999999999998e-05 2024-04-19T04:24:59.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:59.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555087+0000", 2024-04-19T04:24:59.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000120411 2024-04-19T04:24:59.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:59.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559328+0000", 2024-04-19T04:24:59.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042409800000000001 2024-04-19T04:24:59.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560587+0000", 2024-04-19T04:24:59.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012587119999999999 2024-04-19T04:24:59.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560620+0000", 2024-04-19T04:24:59.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2716999999999999e-05 2024-04-19T04:24:59.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560677+0000", 2024-04-19T04:24:59.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7726999999999998e-05 2024-04-19T04:24:59.606 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.606 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.606 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.606 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:59.606 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:59.606 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.058144865999999, 2024-04-19T04:24:59.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027363064999999999, 2024-04-19T04:24:59.606 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.606 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.606 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:59.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:24:59.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533894+0000", 2024-04-19T04:24:59.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:59.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533913+0000", 2024-04-19T04:24:59.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8896e-05 2024-04-19T04:24:59.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533933+0000", 2024-04-19T04:24:59.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9775e-05 2024-04-19T04:24:59.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533967+0000", 2024-04-19T04:24:59.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4536000000000003e-05 2024-04-19T04:24:59.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:59.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553600000000001 2024-04-19T04:24:59.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:59.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534107+0000", 2024-04-19T04:24:59.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1470000000000003e-06 2024-04-19T04:24:59.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556463+0000", 2024-04-19T04:24:59.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022356536999999999 2024-04-19T04:24:59.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556586+0000", 2024-04-19T04:24:59.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122967 2024-04-19T04:24:59.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:59.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556738+0000", 2024-04-19T04:24:59.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015182800000000001 2024-04-19T04:24:59.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561020+0000", 2024-04-19T04:24:59.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042818819999999999 2024-04-19T04:24:59.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:59.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561183+0000", 2024-04-19T04:24:59.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000162683 2024-04-19T04:24:59.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561226+0000", 2024-04-19T04:24:59.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3686000000000002e-05 2024-04-19T04:24:59.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561258+0000", 2024-04-19T04:24:59.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1814999999999999e-05 2024-04-19T04:24:59.611 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.611 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.612 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.612 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:59.612 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:59.612 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.058054353000003, 2024-04-19T04:24:59.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027417816000000001, 2024-04-19T04:24:59.612 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.612 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.612 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.612 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.612 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:59.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:24:59.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533984+0000", 2024-04-19T04:24:59.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:59.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:24:59.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3876000000000001e-05 2024-04-19T04:24:59.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534015+0000", 2024-04-19T04:24:59.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6818999999999999e-05 2024-04-19T04:24:59.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534030+0000", 2024-04-19T04:24:59.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.537e-05 2024-04-19T04:24:59.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534152+0000", 2024-04-19T04:24:59.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121685 2024-04-19T04:24:59.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:59.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534156+0000", 2024-04-19T04:24:59.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9029999999999997e-06 2024-04-19T04:24:59.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557520+0000", 2024-04-19T04:24:59.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023364125999999999 2024-04-19T04:24:59.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557585+0000", 2024-04-19T04:24:59.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5275000000000001e-05 2024-04-19T04:24:59.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:59.616 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557719+0000", 2024-04-19T04:24:59.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013396299999999999 2024-04-19T04:24:59.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.616 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561133+0000", 2024-04-19T04:24:59.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034140989999999999 2024-04-19T04:24:59.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:59.616 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561352+0000", 2024-04-19T04:24:59.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0002185 2024-04-19T04:24:59.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561380+0000", 2024-04-19T04:24:59.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8317999999999999e-05 2024-04-19T04:24:59.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561403+0000", 2024-04-19T04:24:59.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3264999999999998e-05 2024-04-19T04:24:59.617 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.617 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.617 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.617 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:59.618 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:59.618 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.057990707999998, 2024-04-19T04:24:59.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029897119999999999, 2024-04-19T04:24:59.618 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.618 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.618 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:59.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:24:59.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534048+0000", 2024-04-19T04:24:59.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534057+0000", 2024-04-19T04:24:59.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7930000000000003e-06 2024-04-19T04:24:59.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534075+0000", 2024-04-19T04:24:59.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7846000000000002e-05 2024-04-19T04:24:59.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534089+0000", 2024-04-19T04:24:59.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4463e-05 2024-04-19T04:24:59.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534198+0000", 2024-04-19T04:24:59.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109145 2024-04-19T04:24:59.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:59.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534202+0000", 2024-04-19T04:24:59.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.98e-06 2024-04-19T04:24:59.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558221+0000", 2024-04-19T04:24:59.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024018208999999999 2024-04-19T04:24:59.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558320+0000", 2024-04-19T04:24:59.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9642000000000006e-05 2024-04-19T04:24:59.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:59.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558401+0000", 2024-04-19T04:24:59.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1038000000000006e-05 2024-04-19T04:24:59.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561173+0000", 2024-04-19T04:24:59.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027714549999999999 2024-04-19T04:24:59.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:59.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563851+0000", 2024-04-19T04:24:59.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026786010000000001 2024-04-19T04:24:59.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563906+0000", 2024-04-19T04:24:59.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4895999999999998e-05 2024-04-19T04:24:59.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563946+0000", 2024-04-19T04:24:59.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0116e-05 2024-04-19T04:24:59.623 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.624 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.624 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.624 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:59.624 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:59.624 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.057937326999998, 2024-04-19T04:24:59.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029917846000000001, 2024-04-19T04:24:59.624 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.624 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.624 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:59.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:24:59.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534101+0000", 2024-04-19T04:24:59.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:59.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534111+0000", 2024-04-19T04:24:59.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5659999999999996e-06 2024-04-19T04:24:59.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534129+0000", 2024-04-19T04:24:59.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7632999999999999e-05 2024-04-19T04:24:59.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534143+0000", 2024-04-19T04:24:59.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4362000000000001e-05 2024-04-19T04:24:59.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534256+0000", 2024-04-19T04:24:59.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113267 2024-04-19T04:24:59.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:59.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534260+0000", 2024-04-19T04:24:59.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9949999999999999e-06 2024-04-19T04:24:59.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558653+0000", 2024-04-19T04:24:59.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024393182999999999 2024-04-19T04:24:59.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558704+0000", 2024-04-19T04:24:59.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0303999999999998e-05 2024-04-19T04:24:59.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:59.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558782+0000", 2024-04-19T04:24:59.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8079999999999998e-05 2024-04-19T04:24:59.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561309+0000", 2024-04-19T04:24:59.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002527708 2024-04-19T04:24:59.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:59.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563952+0000", 2024-04-19T04:24:59.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026425450000000001 2024-04-19T04:24:59.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563996+0000", 2024-04-19T04:24:59.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3606000000000002e-05 2024-04-19T04:24:59.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564021+0000", 2024-04-19T04:24:59.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.491e-05 2024-04-19T04:24:59.630 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.630 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.630 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.630 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:59.630 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:59.630 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.057884815999998, 2024-04-19T04:24:59.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:24:59.630 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.630 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.631 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:59.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:24:59.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:24:59.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:24:59.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:24:59.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:24:59.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:24:59.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:24:59.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:24:59.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:24:59.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:24:59.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:59.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:24:59.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:24:59.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:24:59.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:24:59.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:24:59.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:24:59.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:59.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:24:59.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:24:59.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:24:59.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:24:59.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:59.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:24:59.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:24:59.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:24:59.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:24:59.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:24:59.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:24:59.636 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.636 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.636 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.636 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:24:59.636 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:59.636 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.057830271, 2024-04-19T04:24:59.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:24:59.637 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.637 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.637 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:59.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:24:59.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:24:59.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:24:59.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:24:59.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:24:59.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:24:59.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:24:59.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:24:59.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:24:59.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:24:59.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:24:59.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:24:59.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:24:59.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:24:59.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:24:59.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:24:59.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:24:59.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:59.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:24:59.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:24:59.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:24:59.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:24:59.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:59.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:24:59.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:24:59.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:24:59.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:24:59.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.642 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.642 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:24:59.642 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:24:59.642 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.642 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.642 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.642 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:59.642 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:24:59.642 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 5.3605156850000002, 2024-04-19T04:24:59.642 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:24:59.643 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.643 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.643 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:59.643 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:59.643 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.643 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:24:59.643 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.643 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.643 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:24:59.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:24:59.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:24:59.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:24:59.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:24:59.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:24:59.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:24:59.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:24:59.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:24:59.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:24:59.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:24:59.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:24:59.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:24:59.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.647 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:59.647 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:24:59.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:24:59.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.647 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:59.647 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:24:59.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:24:59.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.647 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.647 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:24:59.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:24:59.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.648 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.648 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.648 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:24:59.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:24:59.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.648 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.648 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.648 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:24:59.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:24:59.648 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.648 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.648 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.649 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:59.649 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:24:59.649 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 5.3573345290000001, 2024-04-19T04:24:59.649 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:24:59.649 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.649 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.649 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:59.649 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:59.649 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.649 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:24:59.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.649 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.649 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:24:59.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:24:59.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:24:59.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:24:59.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:24:59.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:24:59.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:24:59.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:24:59.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:24:59.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.652 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:24:59.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:24:59.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.652 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:24:59.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:24:59.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:59.652 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:24:59.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:24:59.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:24:59.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:24:59.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:59.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:24:59.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:24:59.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:24:59.654 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:24:59.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.654 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.654 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:24:59.654 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:24:59.654 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.654 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.654 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.654 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:24:59.654 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:24:59.655 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 5.356766425, 2024-04-19T04:24:59.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:24:59.655 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.655 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.655 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:24:59.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:24:59.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:24:59.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:59.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:24:59.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:24:59.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:24:59.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:24:59.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:24:59.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:24:59.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:24:59.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:24:59.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:24:59.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:24:59.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:24:59.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:24:59.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:24:59.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:24:59.658 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.658 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.658 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.658 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:59.659 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:24:59.659 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 5.3564207640000001, 2024-04-19T04:24:59.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:24:59.659 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.659 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.659 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:59.659 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:59.659 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.659 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:24:59.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.659 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:24:59.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:24:59.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:24:59.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:24:59.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:24:59.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:24:59.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:24:59.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:24:59.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:24:59.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:24:59.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:24:59.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.662 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.662 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:24:59.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:24:59.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.662 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:59.662 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:24:59.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:24:59.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.662 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:24:59.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:24:59.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:59.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:24:59.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:24:59.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:24:59.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:24:59.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:24:59.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:24:59.664 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.664 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.664 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.664 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:24:59.664 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:24:59.664 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 5.3556963260000003, 2024-04-19T04:24:59.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:24:59.664 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.664 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.664 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:24:59.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:24:59.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:24:59.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:24:59.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:24:59.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:24:59.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:24:59.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:24:59.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:24:59.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:24:59.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:24:59.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:24:59.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:24:59.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:24:59.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:24:59.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:24:59.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:24:59.668 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.668 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.668 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.668 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:24:59.669 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:24:59.669 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 5.3556889309999995, 2024-04-19T04:24:59.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:24:59.669 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.669 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.669 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:24:59.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:24:59.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:24:59.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:59.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:24:59.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:24:59.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:24:59.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:24:59.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:24:59.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:24:59.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:24:59.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:24:59.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:24:59.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:24:59.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:24:59.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:24:59.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:24:59.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:24:59.672 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.672 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.672 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.673 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:59.673 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:24:59.673 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 5.3538637839999996, 2024-04-19T04:24:59.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:24:59.673 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.673 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.673 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:59.673 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:59.673 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.673 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:24:59.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.673 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.674 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.674 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:24:59.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.674 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.674 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:24:59.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:24:59.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:24:59.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:24:59.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:24:59.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:24:59.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:24:59.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:24:59.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:24:59.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:24:59.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:24:59.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:24:59.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:59.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:24:59.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:24:59.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:24:59.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:24:59.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:59.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:24:59.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:24:59.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:24:59.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:24:59.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:24:59.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:24:59.678 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.678 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.679 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.679 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26148 5.9 e27/20 ondisk, result = 0)", 2024-04-19T04:24:59.679 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:24:59.679 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 5.3537634589999996, 2024-04-19T04:24:59.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.042005175999999998, 2024-04-19T04:24:59.679 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.679 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:59.679 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:24:59.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:24:59.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238276+0000", 2024-04-19T04:24:59.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:59.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238280+0000", 2024-04-19T04:24:59.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6399999999999999e-06 2024-04-19T04:24:59.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238286+0000", 2024-04-19T04:24:59.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2099999999999998e-06 2024-04-19T04:24:59.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238290+0000", 2024-04-19T04:24:59.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2470000000000002e-06 2024-04-19T04:24:59.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239526+0000", 2024-04-19T04:24:59.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012362619999999999 2024-04-19T04:24:59.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239538+0000", 2024-04-19T04:24:59.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1620999999999999e-05 2024-04-19T04:24:59.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280282+0000", 2024-04-19T04:24:59.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040743691999999998 2024-04-19T04:24:59.682 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.682 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.682 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.683 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:24:59.683 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:24:59.683 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 5.353129579, 2024-04-19T04:24:59.683 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:24:59.683 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.683 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.683 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:24:59.683 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:24:59.683 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.683 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:24:59.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.683 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.684 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:24:59.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.684 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.684 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:24:59.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.684 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.684 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:24:59.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.684 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:24:59.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:24:59.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:24:59.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:24:59.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:24:59.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:24:59.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.686 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:24:59.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:24:59.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.686 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:24:59.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:24:59.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.686 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:59.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:24:59.687 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:24:59.687 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.687 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.687 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:24:59.687 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:24:59.687 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:24:59.687 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.687 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.687 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:24:59.687 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:24:59.687 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:24:59.687 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.687 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.687 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.687 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:24:59.687 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:24:59.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:24:59.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:24:59.688 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.688 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.688 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.688 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:24:59.688 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:24:59.688 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 5.3525953030000002, 2024-04-19T04:24:59.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:24:59.689 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.689 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.689 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:24:59.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:24:59.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:24:59.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.690 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:24:59.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:24:59.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.691 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.691 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:24:59.691 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:24:59.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.691 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.691 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.691 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:24:59.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:24:59.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.692 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.692 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.692 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:24:59.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:24:59.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.692 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.692 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.692 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:24:59.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:24:59.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.693 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.693 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:24:59.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:24:59.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.693 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.693 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:24:59.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:24:59.693 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.693 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.693 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.694 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26160 5.f e27/20 ondisk, result = 0)", 2024-04-19T04:24:59.694 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:24:59.694 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 5.3514799279999998, 2024-04-19T04:24:59.694 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039752357000000002, 2024-04-19T04:24:59.694 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.694 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:24:59.694 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.694 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.694 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.694 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:24:59.694 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.695 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.695 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:24:59.695 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.695 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.695 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240559+0000", 2024-04-19T04:24:59.695 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:59.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.695 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.695 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240569+0000", 2024-04-19T04:24:59.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7720000000000006e-06 2024-04-19T04:24:59.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280164+0000", 2024-04-19T04:24:59.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039595324000000001 2024-04-19T04:24:59.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280190+0000", 2024-04-19T04:24:59.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5692000000000001e-05 2024-04-19T04:24:59.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280287+0000", 2024-04-19T04:24:59.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7536999999999998e-05 2024-04-19T04:24:59.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280299+0000", 2024-04-19T04:24:59.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2057e-05 2024-04-19T04:24:59.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:24:59.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3244999999999999e-05 2024-04-19T04:24:59.697 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.697 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.697 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.698 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.698 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26179 5.3 e27/20 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head v 27'1624, mlcod=27'1621)", 2024-04-19T04:24:59.698 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:24:59.698 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 5.3483261759999996, 2024-04-19T04:24:59.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039964081999999998, 2024-04-19T04:24:59.698 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:24:59.698 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:24:59.698 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:24:59.698 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.698 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:24:59.698 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:24:59.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.699 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:24:59.699 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:24:59.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:24:59.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.699 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:24:59.699 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243713+0000", 2024-04-19T04:24:59.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.700 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:24:59.700 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243750+0000", 2024-04-19T04:24:59.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6704e-05 2024-04-19T04:24:59.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.700 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:24:59.700 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280162+0000", 2024-04-19T04:24:59.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036412117000000001 2024-04-19T04:24:59.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.700 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.700 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280186+0000", 2024-04-19T04:24:59.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4825999999999999e-05 2024-04-19T04:24:59.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:24:59.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:24:59.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012540000000000001 2024-04-19T04:24:59.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:24:59.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280347+0000", 2024-04-19T04:24:59.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4894000000000002e-05 2024-04-19T04:24:59.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:24:59.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283654+0000", 2024-04-19T04:24:59.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00330716 2024-04-19T04:24:59.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:24:59.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:24:59.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:24:59.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283678+0000", 2024-04-19T04:24:59.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3992e-05 2024-04-19T04:24:59.703 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.703 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.703 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.703 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:24:59.703 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:24:59.703 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:24:59.705 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:59.702+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:59.707 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:24:59.741 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:24:59.748 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T04:24:59.752 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 15 15 36763 36748 153.098 139.938 0.00804356 0.00652468 2024-04-19T04:24:59.806 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:24:59.799+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:24:59.848 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:24:59.848 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [ 2024-04-19T04:24:59.848 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.848 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:36976 5.4 5:27c72a54:::benchmark_data_smithi007_19526_object36975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:24:59.848 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:59.840890+0000", 2024-04-19T04:24:59.848 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0049882040000000004, 2024-04-19T04:24:59.848 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0050186170000000004, 2024-04-19T04:24:59.848 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:59.848 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:59.848 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:59.849 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:59.849 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.849 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 36976 2024-04-19T04:24:59.849 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.849 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:59.849 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.849 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:59.849 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.840890+0000", 2024-04-19T04:24:59.849 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.849 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.849 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.849 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:59.850 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.840890+0000", 2024-04-19T04:24:59.850 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.850 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.850 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.850 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:59.850 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.840889+0000", 2024-04-19T04:24:59.850 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.850 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.850 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.850 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:59.850 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841004+0000", 2024-04-19T04:24:59.850 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00011470499999999999 2024-04-19T04:24:59.851 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.851 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.851 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:59.851 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841015+0000", 2024-04-19T04:24:59.851 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1522000000000001e-05 2024-04-19T04:24:59.851 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.851 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.851 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.851 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841021+0000", 2024-04-19T04:24:59.851 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2560000000000002e-06 2024-04-19T04:24:59.851 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.851 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.852 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:59.852 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841060+0000", 2024-04-19T04:24:59.852 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9138999999999999e-05 2024-04-19T04:24:59.852 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.852 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.852 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:59.852 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841190+0000", 2024-04-19T04:24:59.852 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013074899999999999 2024-04-19T04:24:59.852 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.852 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.852 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:59.852 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841277+0000", 2024-04-19T04:24:59.852 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.6385999999999996e-05 2024-04-19T04:24:59.853 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.853 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.853 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:59.853 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.843431+0000", 2024-04-19T04:24:59.853 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0021536799999999998 2024-04-19T04:24:59.853 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.853 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:59.853 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.853 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.853 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.853 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:36977 5.8 5:173f5207:::benchmark_data_smithi007_19526_object36976:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:24:59.854 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:59.841031+0000", 2024-04-19T04:24:59.854 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0048473170000000003, 2024-04-19T04:24:59.854 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.004971095, 2024-04-19T04:24:59.854 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:59.854 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:59.854 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:59.854 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:59.854 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.854 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 36977 2024-04-19T04:24:59.854 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.854 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:59.854 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.855 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:59.855 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841031+0000", 2024-04-19T04:24:59.855 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.855 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.855 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.855 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:59.855 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841031+0000", 2024-04-19T04:24:59.855 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.855 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.855 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.855 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:59.855 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841030+0000", 2024-04-19T04:24:59.856 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:59.856 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.856 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.856 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:59.856 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841097+0000", 2024-04-19T04:24:59.856 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7271e-05 2024-04-19T04:24:59.856 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.856 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.856 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:59.856 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841107+0000", 2024-04-19T04:24:59.856 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.7089999999999997e-06 2024-04-19T04:24:59.856 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.856 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.857 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.857 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841114+0000", 2024-04-19T04:24:59.857 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7360000000000004e-06 2024-04-19T04:24:59.857 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.857 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.857 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:59.857 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841843+0000", 2024-04-19T04:24:59.857 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00072877200000000004 2024-04-19T04:24:59.857 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.857 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.857 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:59.857 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841988+0000", 2024-04-19T04:24:59.858 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000145272 2024-04-19T04:24:59.858 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.858 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.858 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:59.858 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.842143+0000", 2024-04-19T04:24:59.858 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015508300000000001 2024-04-19T04:24:59.858 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.858 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.858 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:59.858 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844474+0000", 2024-04-19T04:24:59.858 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0023309260000000001 2024-04-19T04:24:59.858 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.858 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:59.859 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.859 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.859 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.859 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:36981 5.5 5:a3b008e0:::benchmark_data_smithi007_19526_object36980:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:24:59.859 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:59.842103+0000", 2024-04-19T04:24:59.859 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.003774772, 2024-04-19T04:24:59.859 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0039831390000000001, 2024-04-19T04:24:59.859 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:59.859 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:59.859 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:59.859 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:59.859 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.859 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 36981 2024-04-19T04:24:59.860 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.860 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:59.860 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.860 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:59.860 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.842103+0000", 2024-04-19T04:24:59.860 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.860 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.860 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.860 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:59.860 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.842103+0000", 2024-04-19T04:24:59.860 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.860 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.860 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.861 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:59.861 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.842102+0000", 2024-04-19T04:24:59.861 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.861 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.861 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.861 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:59.861 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.842206+0000", 2024-04-19T04:24:59.861 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000104072 2024-04-19T04:24:59.861 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.861 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.861 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:59.861 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.842222+0000", 2024-04-19T04:24:59.862 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.5727999999999999e-05 2024-04-19T04:24:59.862 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.862 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.862 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.862 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.842245+0000", 2024-04-19T04:24:59.862 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2549999999999999e-05 2024-04-19T04:24:59.862 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.862 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.862 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:59.862 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.842334+0000", 2024-04-19T04:24:59.862 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8912000000000005e-05 2024-04-19T04:24:59.862 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.862 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.863 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:59.863 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.842478+0000", 2024-04-19T04:24:59.863 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014423600000000001 2024-04-19T04:24:59.863 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.863 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.863 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:59.863 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.842635+0000", 2024-04-19T04:24:59.863 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000157625 2024-04-19T04:24:59.863 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.863 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.863 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:24:59.864 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844744+0000", 2024-04-19T04:24:59.864 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0021084400000000001 2024-04-19T04:24:59.864 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.864 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:59.864 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.864 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.864 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.864 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:36978 5.1 e31/20 5:8aa22be6:::benchmark_data_smithi007_19526_object36977:head v 31'2356, mlcod=31'2353)", 2024-04-19T04:24:59.864 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:59.844208+0000", 2024-04-19T04:24:59.864 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0016705649999999999, 2024-04-19T04:24:59.864 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0019592860000000002, 2024-04-19T04:24:59.864 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:59.865 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:59.865 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:59.865 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.865 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:59.865 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844208+0000", 2024-04-19T04:24:59.865 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.865 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.865 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.865 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:59.865 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844208+0000", 2024-04-19T04:24:59.865 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.865 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.866 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.866 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:59.866 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844207+0000", 2024-04-19T04:24:59.866 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.866 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.866 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.866 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:59.866 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844236+0000", 2024-04-19T04:24:59.866 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.8986999999999999e-05 2024-04-19T04:24:59.866 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.866 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.866 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:59.867 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844246+0000", 2024-04-19T04:24:59.867 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.7920000000000004e-06 2024-04-19T04:24:59.867 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.867 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.867 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.867 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844252+0000", 2024-04-19T04:24:59.867 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.6880000000000002e-06 2024-04-19T04:24:59.867 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.867 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.867 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:59.867 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844310+0000", 2024-04-19T04:24:59.867 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.7299999999999997e-05 2024-04-19T04:24:59.868 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.868 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.868 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:59.868 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844322+0000", 2024-04-19T04:24:59.868 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2977e-05 2024-04-19T04:24:59.868 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.868 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:59.868 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.868 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.868 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.868 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:36980 5.1 e31/20 5:86f1d994:::benchmark_data_smithi007_19526_object36979:head v 31'2357, mlcod=31'2353)", 2024-04-19T04:24:59.869 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:59.844329+0000", 2024-04-19T04:24:59.869 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0015487789999999999, 2024-04-19T04:24:59.869 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0018962650000000001, 2024-04-19T04:24:59.869 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:59.869 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:59.869 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:59.869 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.869 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:59.869 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844329+0000", 2024-04-19T04:24:59.869 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.869 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.869 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.870 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:59.870 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844329+0000", 2024-04-19T04:24:59.870 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.870 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.870 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.870 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:59.870 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844329+0000", 2024-04-19T04:24:59.870 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:59.870 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.870 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.870 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:59.870 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844364+0000", 2024-04-19T04:24:59.871 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.4958e-05 2024-04-19T04:24:59.871 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.871 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.871 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:59.871 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844373+0000", 2024-04-19T04:24:59.871 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.0820000000000005e-06 2024-04-19T04:24:59.871 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.871 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.871 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.871 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844378+0000", 2024-04-19T04:24:59.871 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2039999999999996e-06 2024-04-19T04:24:59.872 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.872 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.872 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:59.872 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845433+0000", 2024-04-19T04:24:59.872 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0010547180000000001 2024-04-19T04:24:59.872 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.872 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.872 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:59.872 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845452+0000", 2024-04-19T04:24:59.872 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.9275000000000001e-05 2024-04-19T04:24:59.872 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.872 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:59.873 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.873 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.873 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.873 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:36982 5.3 5:cbeda78d:::benchmark_data_smithi007_19526_object36981:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:24:59.873 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:59.844712+0000", 2024-04-19T04:24:59.873 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0011659420000000001, 2024-04-19T04:24:59.873 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001577784, 2024-04-19T04:24:59.873 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:59.873 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:59.873 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:59.873 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:59.874 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.874 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 36982 2024-04-19T04:24:59.874 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.874 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:59.874 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.874 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:59.874 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844712+0000", 2024-04-19T04:24:59.874 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.874 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.874 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.874 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:59.874 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844712+0000", 2024-04-19T04:24:59.875 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.875 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.875 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.875 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:59.875 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844711+0000", 2024-04-19T04:24:59.875 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:24:59.875 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.875 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.875 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:59.875 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844796+0000", 2024-04-19T04:24:59.875 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.5458999999999996e-05 2024-04-19T04:24:59.875 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.876 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.876 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:59.876 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844805+0000", 2024-04-19T04:24:59.876 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.7600000000000008e-06 2024-04-19T04:24:59.876 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.876 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.876 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.876 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844811+0000", 2024-04-19T04:24:59.876 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.5140000000000001e-06 2024-04-19T04:24:59.876 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.876 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.876 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:59.877 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844847+0000", 2024-04-19T04:24:59.877 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6239999999999999e-05 2024-04-19T04:24:59.877 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.877 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.877 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:59.877 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844938+0000", 2024-04-19T04:24:59.877 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.1335000000000006e-05 2024-04-19T04:24:59.877 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.877 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.877 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:59.877 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845018+0000", 2024-04-19T04:24:59.877 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.9621000000000002e-05 2024-04-19T04:24:59.878 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.878 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:59.878 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.878 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.878 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.878 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:36983 5.6 5:6ba48de3:::benchmark_data_smithi007_19526_object36982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:24:59.878 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:59.844864+0000", 2024-04-19T04:24:59.878 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.001014486, 2024-04-19T04:24:59.878 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001505475, 2024-04-19T04:24:59.878 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:59.878 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:59.878 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:59.879 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:59.879 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.879 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 36983 2024-04-19T04:24:59.879 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.879 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:59.879 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.879 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:59.879 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844864+0000", 2024-04-19T04:24:59.879 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.879 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.879 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.879 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:59.880 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844864+0000", 2024-04-19T04:24:59.880 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.880 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.880 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.880 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:59.880 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844863+0000", 2024-04-19T04:24:59.880 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.880 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.880 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.880 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:59.880 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844943+0000", 2024-04-19T04:24:59.880 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.0377999999999995e-05 2024-04-19T04:24:59.881 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.881 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.881 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:59.881 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844949+0000", 2024-04-19T04:24:59.881 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.2709999999999998e-06 2024-04-19T04:24:59.881 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.881 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.881 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.881 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844953+0000", 2024-04-19T04:24:59.881 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9099999999999998e-06 2024-04-19T04:24:59.881 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.882 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.882 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:59.882 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844993+0000", 2024-04-19T04:24:59.882 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9527999999999998e-05 2024-04-19T04:24:59.882 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.882 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.882 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:59.882 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845135+0000", 2024-04-19T04:24:59.882 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014267199999999999 2024-04-19T04:24:59.882 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.882 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.882 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:24:59.883 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845289+0000", 2024-04-19T04:24:59.883 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000154115 2024-04-19T04:24:59.883 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.883 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:59.883 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.883 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.883 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.883 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:36984 5.a 5:5e37105a:::benchmark_data_smithi007_19526_object36983:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:24:59.883 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:59.844968+0000", 2024-04-19T04:24:59.883 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00091055400000000005, 2024-04-19T04:24:59.883 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001500903, 2024-04-19T04:24:59.883 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:59.884 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:24:59.884 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:59.884 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:59.884 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.884 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 36984 2024-04-19T04:24:59.884 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.884 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:59.884 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.884 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:59.884 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844968+0000", 2024-04-19T04:24:59.884 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.884 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.884 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.885 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:59.885 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844968+0000", 2024-04-19T04:24:59.885 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.885 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.885 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.885 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:59.885 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844967+0000", 2024-04-19T04:24:59.885 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:59.885 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.885 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.885 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:59.885 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845006+0000", 2024-04-19T04:24:59.886 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9146000000000001e-05 2024-04-19T04:24:59.886 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.886 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.886 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:59.886 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845020+0000", 2024-04-19T04:24:59.886 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.4290999999999999e-05 2024-04-19T04:24:59.886 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.886 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.886 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.886 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845027+0000", 2024-04-19T04:24:59.887 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.8689999999999998e-06 2024-04-19T04:24:59.887 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.887 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.887 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:59.887 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845075+0000", 2024-04-19T04:24:59.887 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.8094999999999999e-05 2024-04-19T04:24:59.887 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.887 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.887 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:59.887 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845222+0000", 2024-04-19T04:24:59.888 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000146262 2024-04-19T04:24:59.888 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.888 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.888 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:24:59.888 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845353+0000", 2024-04-19T04:24:59.888 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013087299999999999 2024-04-19T04:24:59.888 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.888 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:59.888 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.888 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.888 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.888 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:36985 5.7 e31/20 5:ec239d5b:::benchmark_data_smithi007_19526_object36984:head v 31'2352, mlcod=31'2349)", 2024-04-19T04:24:59.889 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:59.845687+0000", 2024-04-19T04:24:59.889 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.000191468, 2024-04-19T04:24:59.889 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00086029800000000001, 2024-04-19T04:24:59.889 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:59.889 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:24:59.889 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:59.889 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.889 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:59.889 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845687+0000", 2024-04-19T04:24:59.889 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.889 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.889 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.889 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:59.890 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845687+0000", 2024-04-19T04:24:59.890 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.891 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.891 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.891 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:59.891 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845686+0000", 2024-04-19T04:24:59.892 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:24:59.892 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.892 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.892 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:59.892 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845746+0000", 2024-04-19T04:24:59.892 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.0486000000000003e-05 2024-04-19T04:24:59.893 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.893 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.893 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:59.893 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845761+0000", 2024-04-19T04:24:59.893 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.4433999999999999e-05 2024-04-19T04:24:59.894 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.894 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.894 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.894 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845768+0000", 2024-04-19T04:24:59.895 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7730000000000002e-06 2024-04-19T04:24:59.895 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.895 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.895 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:59.895 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845822+0000", 2024-04-19T04:24:59.896 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4014000000000002e-05 2024-04-19T04:24:59.896 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.896 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.896 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:59.896 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.845838+0000", 2024-04-19T04:24:59.896 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.6796999999999999e-05 2024-04-19T04:24:59.897 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.897 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:59.897 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.897 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.897 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.898 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:36986 5.8 5:17db565b:::benchmark_data_smithi007_19526_object36985:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:24:59.898 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:59.846294+0000", 2024-04-19T04:24:59.898 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4294967295.9995837, 2024-04-19T04:24:59.898 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000320563, 2024-04-19T04:24:59.898 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:24:59.898 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "reached pg", 2024-04-19T04:24:59.899 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:24:59.899 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:24:59.899 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:24:59.899 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 36986 2024-04-19T04:24:59.899 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.899 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:24:59.900 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.900 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:24:59.900 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.846294+0000", 2024-04-19T04:24:59.900 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.900 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.900 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.901 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:24:59.901 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.846294+0000", 2024-04-19T04:24:59.901 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:24:59.901 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.901 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.901 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:24:59.902 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.846293+0000", 2024-04-19T04:24:59.902 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:24:59.902 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.902 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.902 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:24:59.903 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.846415+0000", 2024-04-19T04:24:59.903 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012231500000000001 2024-04-19T04:24:59.903 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.903 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.903 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:24:59.904 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.846426+0000", 2024-04-19T04:24:59.904 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0923e-05 2024-04-19T04:24:59.904 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.904 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.904 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:24:59.904 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.846434+0000", 2024-04-19T04:24:59.905 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.289e-06 2024-04-19T04:24:59.905 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.905 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.905 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:24:59.905 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.846489+0000", 2024-04-19T04:24:59.905 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.5615999999999997e-05 2024-04-19T04:24:59.906 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:24:59.906 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:24:59.906 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:24:59.906 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.846622+0000", 2024-04-19T04:24:59.906 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000132755 2024-04-19T04:24:59.907 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.907 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:24:59.907 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.907 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:24:59.907 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-04-19T04:24:59.907 INFO:teuthology.orchestra.run.smithi066.stdout: "num_ops": 10 2024-04-19T04:24:59.908 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:24:59.910 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:24:59.906+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:24:59.910 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:24:59.911 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-04-19T04:24:59.912 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:24:59.933 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:24:59.935 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:24:59.935 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T04:24:59.935 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:00.011 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:00.006+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:00.057 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:00.057 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:00.070 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:25:00.111 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:00.110+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:00.207 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:00.207 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:00.212 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:00.210+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:00.221 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:00.313 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:00.310+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:00.352 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:00.352 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:00.364 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:00.413 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:00.407+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:00.484 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:00.484 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:00.496 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:00.514 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:00.514+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:00.615 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:00.615 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:00.615 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:00.614+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:00.627 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:00.717 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:00.711+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:00.733 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T04:25:00.733 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T04:25:00.733 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-19T04:25:00.733 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 1.000000 2024-04-19T04:25:00.733 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-19T04:25:00.751 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 16 16 38975 38959 152.166 138.188 0.0123399 0.00656466 2024-04-19T04:25:00.755 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-04-19T04:25:00.758 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:00.758 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:00.774 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:00.818 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:00.814+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:00.900 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:00.901 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:00.911 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:00.919 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:00.918+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:01.021 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:01.015+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:01.039 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:01.039 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:01.051 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:25:01.121 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:01.115+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:01.189 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:01.189 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:01.203 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:25:01.222 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:01.215+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:01.323 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:01.319+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:01.340 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:01.340 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:01.354 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:25:01.424 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:01.422+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:01.525 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:01.522+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:01.538 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:01.538 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:01.553 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:01.626 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:01.622+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:01.678 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:01.678 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:01.691 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:01.727 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:01.723+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:01.752 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 17 16 41123 41107 151.111 134.25 0.00872185 0.00661129 2024-04-19T04:25:01.762 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-19T04:25:01.814 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:01.814 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:01.824 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:01.828 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:01.826+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:01.929 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:01.926+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:01.943 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:01.943 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:01.947 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:25:01.956 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:02.030 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:02.023+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:02.091 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:02.091 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:02.104 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:02.105 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:02.127 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-04-19T04:25:02.131 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:02.130+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:02.147 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:02.150 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:02.150 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T04:25:02.150 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:02.226 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:02.226 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:02.226 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:02.226 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:02.226 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:02.233 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:02.226+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:02.239 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:02.332 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:02.330+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:02.365 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:02.365 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:02.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:02.366 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:02.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.366 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:02.366 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:25:02.366 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.830720049999996, 2024-04-19T04:25:02.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026801078999999998, 2024-04-19T04:25:02.366 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.366 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.366 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:25:02.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.367 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:25:02.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.367 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533733+0000", 2024-04-19T04:25:02.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999976 2024-04-19T04:25:02.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533746+0000", 2024-04-19T04:25:02.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2679e-05 2024-04-19T04:25:02.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533769+0000", 2024-04-19T04:25:02.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2832000000000001e-05 2024-04-19T04:25:02.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:25:02.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0599999999999999e-05 2024-04-19T04:25:02.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533907+0000", 2024-04-19T04:25:02.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000118076 2024-04-19T04:25:02.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:25:02.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533919+0000", 2024-04-19T04:25:02.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1644999999999999e-05 2024-04-19T04:25:02.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553399+0000", 2024-04-19T04:25:02.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019479987000000001 2024-04-19T04:25:02.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553535+0000", 2024-04-19T04:25:02.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553400000000001 2024-04-19T04:25:02.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:02.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553696+0000", 2024-04-19T04:25:02.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000161068 2024-04-19T04:25:02.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:02.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558096+0000", 2024-04-19T04:25:02.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0043998880000000002 2024-04-19T04:25:02.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560465+0000", 2024-04-19T04:25:02.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023695159999999999 2024-04-19T04:25:02.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:02.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560513+0000", 2024-04-19T04:25:02.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7899000000000003e-05 2024-04-19T04:25:02.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560537+0000", 2024-04-19T04:25:02.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3768e-05 2024-04-19T04:25:02.372 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.372 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.372 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.372 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:02.372 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:02.372 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.830642976, 2024-04-19T04:25:02.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026864505, 2024-04-19T04:25:02.372 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.372 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.372 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:02.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:02.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533812+0000", 2024-04-19T04:25:02.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.374 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533818+0000", 2024-04-19T04:25:02.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2369999999999997e-06 2024-04-19T04:25:02.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.374 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533863+0000", 2024-04-19T04:25:02.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4515000000000003e-05 2024-04-19T04:25:02.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533880+0000", 2024-04-19T04:25:02.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7119e-05 2024-04-19T04:25:02.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534029+0000", 2024-04-19T04:25:02.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014955099999999999 2024-04-19T04:25:02.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.376 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:02.376 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534034+0000", 2024-04-19T04:25:02.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1649999999999997e-06 2024-04-19T04:25:02.376 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.376 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.376 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554888+0000", 2024-04-19T04:25:02.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020854075 2024-04-19T04:25:02.376 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.376 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.376 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554967+0000", 2024-04-19T04:25:02.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8209999999999998e-05 2024-04-19T04:25:02.376 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:02.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555087+0000", 2024-04-19T04:25:02.377 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000120411 2024-04-19T04:25:02.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:02.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559328+0000", 2024-04-19T04:25:02.377 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042409800000000001 2024-04-19T04:25:02.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560587+0000", 2024-04-19T04:25:02.377 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012587119999999999 2024-04-19T04:25:02.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.378 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:02.378 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560620+0000", 2024-04-19T04:25:02.378 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2716999999999999e-05 2024-04-19T04:25:02.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.378 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.378 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560677+0000", 2024-04-19T04:25:02.378 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7726999999999998e-05 2024-04-19T04:25:02.378 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.378 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.378 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.379 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.379 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:02.379 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:02.379 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.830560583, 2024-04-19T04:25:02.379 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027363064999999999, 2024-04-19T04:25:02.379 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.379 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.379 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.379 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.379 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.379 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:02.379 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.379 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.379 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.379 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.380 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:02.380 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.380 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.380 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.380 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533894+0000", 2024-04-19T04:25:02.380 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:02.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.380 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.380 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.380 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533913+0000", 2024-04-19T04:25:02.380 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8896e-05 2024-04-19T04:25:02.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.380 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.380 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533933+0000", 2024-04-19T04:25:02.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9775e-05 2024-04-19T04:25:02.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.381 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533967+0000", 2024-04-19T04:25:02.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4536000000000003e-05 2024-04-19T04:25:02.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.381 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:02.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553600000000001 2024-04-19T04:25:02.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.381 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:02.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534107+0000", 2024-04-19T04:25:02.382 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1470000000000003e-06 2024-04-19T04:25:02.382 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.382 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.382 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.382 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556463+0000", 2024-04-19T04:25:02.382 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022356536999999999 2024-04-19T04:25:02.382 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.382 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.382 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.382 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556586+0000", 2024-04-19T04:25:02.382 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122967 2024-04-19T04:25:02.382 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.382 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.382 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:02.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556738+0000", 2024-04-19T04:25:02.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015182800000000001 2024-04-19T04:25:02.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561020+0000", 2024-04-19T04:25:02.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042818819999999999 2024-04-19T04:25:02.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:02.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561183+0000", 2024-04-19T04:25:02.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000162683 2024-04-19T04:25:02.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.384 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:02.384 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561226+0000", 2024-04-19T04:25:02.384 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3686000000000002e-05 2024-04-19T04:25:02.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.384 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.384 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.384 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561258+0000", 2024-04-19T04:25:02.384 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1814999999999999e-05 2024-04-19T04:25:02.384 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.384 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.384 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.384 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.384 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:02.384 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:02.384 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.830470069999997, 2024-04-19T04:25:02.385 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027417816000000001, 2024-04-19T04:25:02.385 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.385 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.385 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.385 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.385 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.385 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:02.385 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.385 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.385 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.385 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.385 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:02.385 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.385 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.385 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.386 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.386 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533984+0000", 2024-04-19T04:25:02.386 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:02.386 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.386 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.386 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.386 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:25:02.386 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3876000000000001e-05 2024-04-19T04:25:02.386 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.386 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.386 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.386 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534015+0000", 2024-04-19T04:25:02.386 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6818999999999999e-05 2024-04-19T04:25:02.386 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.387 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.387 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534030+0000", 2024-04-19T04:25:02.387 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.537e-05 2024-04-19T04:25:02.387 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.387 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.387 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534152+0000", 2024-04-19T04:25:02.387 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121685 2024-04-19T04:25:02.387 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.387 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:02.387 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534156+0000", 2024-04-19T04:25:02.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9029999999999997e-06 2024-04-19T04:25:02.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557520+0000", 2024-04-19T04:25:02.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023364125999999999 2024-04-19T04:25:02.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557585+0000", 2024-04-19T04:25:02.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5275000000000001e-05 2024-04-19T04:25:02.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:02.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557719+0000", 2024-04-19T04:25:02.389 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013396299999999999 2024-04-19T04:25:02.389 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.389 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.389 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.389 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561133+0000", 2024-04-19T04:25:02.389 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034140989999999999 2024-04-19T04:25:02.389 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.389 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.389 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:02.389 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561352+0000", 2024-04-19T04:25:02.389 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0002185 2024-04-19T04:25:02.389 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.389 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.389 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:02.390 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561380+0000", 2024-04-19T04:25:02.390 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8317999999999999e-05 2024-04-19T04:25:02.390 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.390 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.390 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.390 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561403+0000", 2024-04-19T04:25:02.390 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3264999999999998e-05 2024-04-19T04:25:02.390 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.390 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.390 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.390 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.390 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.390 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:02.390 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:02.391 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.830406425, 2024-04-19T04:25:02.391 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029897119999999999, 2024-04-19T04:25:02.391 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.391 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.391 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.391 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.391 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.391 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:02.391 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.391 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.391 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.391 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.392 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:02.392 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.392 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.392 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.392 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534048+0000", 2024-04-19T04:25:02.392 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.392 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.392 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.392 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534057+0000", 2024-04-19T04:25:02.392 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7930000000000003e-06 2024-04-19T04:25:02.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.392 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.392 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.393 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534075+0000", 2024-04-19T04:25:02.393 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7846000000000002e-05 2024-04-19T04:25:02.393 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.393 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.393 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.393 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534089+0000", 2024-04-19T04:25:02.393 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4463e-05 2024-04-19T04:25:02.393 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.393 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.393 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.393 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534198+0000", 2024-04-19T04:25:02.393 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109145 2024-04-19T04:25:02.393 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.393 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.394 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:02.394 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534202+0000", 2024-04-19T04:25:02.394 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.98e-06 2024-04-19T04:25:02.394 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.394 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.394 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.394 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558221+0000", 2024-04-19T04:25:02.394 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024018208999999999 2024-04-19T04:25:02.394 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.394 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.394 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.394 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558320+0000", 2024-04-19T04:25:02.394 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9642000000000006e-05 2024-04-19T04:25:02.394 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.395 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.395 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:02.395 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558401+0000", 2024-04-19T04:25:02.395 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1038000000000006e-05 2024-04-19T04:25:02.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.395 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.395 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.395 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561173+0000", 2024-04-19T04:25:02.395 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027714549999999999 2024-04-19T04:25:02.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.395 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.395 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:02.395 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563851+0000", 2024-04-19T04:25:02.395 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026786010000000001 2024-04-19T04:25:02.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:02.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563906+0000", 2024-04-19T04:25:02.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4895999999999998e-05 2024-04-19T04:25:02.396 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563946+0000", 2024-04-19T04:25:02.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0116e-05 2024-04-19T04:25:02.396 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.396 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.396 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.396 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.397 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:02.397 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:02.397 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.830353043999999, 2024-04-19T04:25:02.397 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029917846000000001, 2024-04-19T04:25:02.397 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.397 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.397 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.397 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.397 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:02.397 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.397 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.397 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:02.398 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.398 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.398 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.398 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534101+0000", 2024-04-19T04:25:02.398 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:02.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.398 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.398 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.398 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534111+0000", 2024-04-19T04:25:02.398 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5659999999999996e-06 2024-04-19T04:25:02.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.398 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.398 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.399 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534129+0000", 2024-04-19T04:25:02.399 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7632999999999999e-05 2024-04-19T04:25:02.399 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.399 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.399 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.399 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534143+0000", 2024-04-19T04:25:02.399 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4362000000000001e-05 2024-04-19T04:25:02.399 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.399 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.399 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.399 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534256+0000", 2024-04-19T04:25:02.399 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113267 2024-04-19T04:25:02.399 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.399 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.399 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:02.400 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534260+0000", 2024-04-19T04:25:02.400 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9949999999999999e-06 2024-04-19T04:25:02.400 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.400 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.400 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.400 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558653+0000", 2024-04-19T04:25:02.400 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024393182999999999 2024-04-19T04:25:02.400 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.400 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.400 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.400 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558704+0000", 2024-04-19T04:25:02.400 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0303999999999998e-05 2024-04-19T04:25:02.400 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.400 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.400 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:02.400 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558782+0000", 2024-04-19T04:25:02.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8079999999999998e-05 2024-04-19T04:25:02.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.401 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.401 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561309+0000", 2024-04-19T04:25:02.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002527708 2024-04-19T04:25:02.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.401 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:02.401 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563952+0000", 2024-04-19T04:25:02.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026425450000000001 2024-04-19T04:25:02.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.401 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:02.402 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563996+0000", 2024-04-19T04:25:02.402 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3606000000000002e-05 2024-04-19T04:25:02.402 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.402 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.402 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.402 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564021+0000", 2024-04-19T04:25:02.402 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.491e-05 2024-04-19T04:25:02.402 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.402 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.402 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.402 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.402 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.402 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:02.402 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:02.403 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.830300532999999, 2024-04-19T04:25:02.403 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:25:02.403 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.403 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.403 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.403 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.403 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:02.403 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.403 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.403 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:02.403 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.404 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:25:02.404 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.404 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:25:02.404 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:25:02.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.404 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:25:02.404 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:25:02.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.405 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.405 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:25:02.405 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:25:02.405 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.405 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.405 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.405 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:25:02.405 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:25:02.405 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.405 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.405 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:02.405 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:25:02.405 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:25:02.405 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.405 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.406 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.406 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:25:02.406 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:25:02.406 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.406 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.406 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.406 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:25:02.406 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:25:02.406 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.406 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.406 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:02.406 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:25:02.406 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:25:02.406 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.407 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.407 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.407 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:25:02.407 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:25:02.407 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.407 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.407 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:02.407 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:25:02.407 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:25:02.407 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.407 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.407 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:02.407 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:25:02.407 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:25:02.407 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.408 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.408 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.408 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:25:02.408 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:25:02.408 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.408 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.408 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.408 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.408 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.408 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:02.408 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:02.408 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.830245988000001, 2024-04-19T04:25:02.408 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:25:02.408 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.409 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.409 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.409 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.409 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.409 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:02.409 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.409 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.409 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.409 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.409 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:02.409 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.409 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.409 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.409 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.409 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:25:02.410 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.410 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.410 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.410 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.410 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:25:02.410 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:25:02.410 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.410 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.410 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.410 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:25:02.410 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:25:02.410 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.410 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.410 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.410 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:25:02.411 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:25:02.411 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.411 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.411 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.411 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:25:02.411 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:25:02.411 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.411 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.411 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:02.411 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:25:02.411 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:25:02.411 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.411 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.411 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.412 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:25:02.412 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:25:02.412 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.412 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.412 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.412 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:25:02.412 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:25:02.412 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.412 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.412 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:02.412 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:25:02.412 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:25:02.412 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.412 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.412 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.413 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:25:02.413 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:25:02.413 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.413 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.413 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:02.413 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:25:02.413 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:25:02.413 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.413 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.413 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:02.413 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:25:02.413 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:25:02.413 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.413 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.413 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.414 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:25:02.414 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:25:02.414 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.414 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.414 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.414 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.414 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.414 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:02.414 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:02.414 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.1329314020000005, 2024-04-19T04:25:02.414 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:02.414 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.414 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.414 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:02.414 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:02.415 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:02.415 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:02.415 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.415 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.415 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.415 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.415 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:02.415 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.415 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.415 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.415 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.415 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:02.415 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.415 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.415 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.416 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.416 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:02.416 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.416 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.416 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.416 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.416 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:02.416 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:02.416 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.416 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.416 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.416 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:02.416 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:02.416 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.416 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.417 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.417 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:02.417 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:02.417 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.417 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.417 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.417 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:02.417 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:02.417 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.417 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.417 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.417 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:02.417 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:02.417 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.417 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.418 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:02.418 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:02.418 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:02.418 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.418 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.418 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:02.418 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:02.418 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:02.418 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.418 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.418 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.418 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:02.418 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:02.418 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.418 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.419 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:02.419 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:02.419 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:02.419 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.419 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.419 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.419 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:02.419 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:02.419 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.419 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.419 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.419 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.419 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.419 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:02.419 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:02.420 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.1297502460000004, 2024-04-19T04:25:02.420 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:02.420 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.420 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.420 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:02.420 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:02.420 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:02.420 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:02.420 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.421 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.421 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.421 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.421 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:02.421 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.421 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.421 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.421 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.421 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:02.421 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.422 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.422 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.422 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.422 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:02.422 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.422 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.422 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.422 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.422 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:02.422 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:02.422 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.422 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.422 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.422 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:02.422 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:02.423 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.423 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.423 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.423 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:02.423 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:02.423 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.423 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.423 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.423 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:02.423 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:02.423 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.423 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.423 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.423 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:02.423 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:02.424 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.424 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.425 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:02.426 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:02.426 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:02.426 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.426 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.426 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.426 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:02.426 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:02.426 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.426 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.426 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:02.426 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:02.426 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:02.426 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.426 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.427 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:02.427 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:02.427 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:02.427 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.427 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.427 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.427 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:02.427 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:02.427 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.427 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.427 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.427 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.427 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.427 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:02.427 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:02.428 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.1291821419999994, 2024-04-19T04:25:02.428 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:02.428 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.428 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.428 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.428 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.428 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.428 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:02.428 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.428 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.428 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.428 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.428 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:02.428 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.428 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.429 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.429 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.429 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:02.429 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:02.429 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.429 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.429 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.429 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:02.429 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:02.429 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.429 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.429 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.429 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:02.429 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:02.429 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.430 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.430 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.430 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:02.430 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:02.430 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.430 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.430 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.430 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:02.430 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:02.430 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.430 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.430 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.430 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:02.430 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:02.430 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.431 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.431 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:02.431 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:02.431 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:02.431 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.431 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.431 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.431 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:02.431 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:02.431 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.431 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.431 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.431 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.431 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.431 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:02.432 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:02.432 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.1288364810000004, 2024-04-19T04:25:02.432 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:02.432 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.432 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.432 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:02.432 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:02.432 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:02.432 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:02.432 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.432 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.432 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.432 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.432 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:02.432 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.433 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.433 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.433 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.433 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:02.433 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.433 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.433 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.433 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.433 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:02.433 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.433 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.433 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.433 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.433 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:02.433 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:02.434 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.434 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.434 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.434 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:02.434 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:02.434 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.434 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.434 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.434 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:02.434 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:02.434 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.434 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.434 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.434 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:02.435 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:02.435 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.435 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.435 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.435 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:02.435 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:02.435 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.435 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.435 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:02.435 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:02.435 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:02.435 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.435 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.435 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.435 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:02.436 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:02.436 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.436 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.436 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:02.436 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:02.436 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:02.436 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.436 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.436 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:02.436 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:02.436 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:02.436 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.436 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.436 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.436 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:02.437 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:02.437 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.437 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.437 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.437 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.437 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.437 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:02.437 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:02.437 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.1281120429999998, 2024-04-19T04:25:02.437 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:02.437 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.437 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.437 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.437 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.437 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.438 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:02.438 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.438 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.438 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.438 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.438 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:02.438 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.438 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.438 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.438 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.438 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:02.438 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.438 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.438 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.439 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.439 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:02.439 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:02.439 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.439 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.439 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.439 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:02.439 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:02.439 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.439 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.439 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.439 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:02.439 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:02.439 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.439 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.440 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.440 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:02.440 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:02.440 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.440 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.440 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.440 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:02.440 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:02.440 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.440 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.440 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:02.440 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:02.440 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:02.440 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.440 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.441 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.441 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:02.441 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:02.441 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.441 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.441 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.441 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.441 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.441 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:02.441 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:02.441 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.1281046480000008, 2024-04-19T04:25:02.441 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:02.441 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.441 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.441 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.442 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.442 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.442 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:02.442 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.442 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.442 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.442 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.442 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:02.442 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.442 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.442 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.442 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.442 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:02.442 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:02.443 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.443 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.443 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.443 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:02.443 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:02.443 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.443 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.443 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.443 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:02.443 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:02.443 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.443 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.443 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.443 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:02.443 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:02.444 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.444 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.444 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.444 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:02.444 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:02.444 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.444 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.444 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.444 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:02.444 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:02.444 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.444 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.444 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:02.444 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:02.444 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:02.445 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.445 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.445 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.445 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:02.445 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:02.445 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.445 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.445 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.445 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.445 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.445 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:02.445 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:02.445 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.1262795010000008, 2024-04-19T04:25:02.445 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:02.445 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.446 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.446 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:02.446 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:02.446 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:02.446 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:02.446 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.446 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.446 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.446 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.446 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:02.446 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.446 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.446 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.446 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.446 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:02.447 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.447 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.447 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.447 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.447 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:02.447 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.447 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.447 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.447 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.447 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:02.447 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:02.447 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.447 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.448 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.448 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:02.448 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:02.448 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.448 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.448 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.448 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:02.448 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:02.448 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.448 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.448 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.448 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:02.448 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:02.448 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.448 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.449 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.449 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:02.449 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:02.449 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.449 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.449 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:02.449 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:02.449 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:02.449 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.449 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.449 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.449 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:02.449 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:02.449 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.449 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.450 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:02.450 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:02.450 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:02.450 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.450 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.450 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:02.450 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:02.450 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:02.450 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.450 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.450 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.450 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:02.450 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:02.450 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26148 5.9 e27/20 ondisk, result = 0)", 2024-04-19T04:25:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.1261791760000008, 2024-04-19T04:25:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.042005175999999998, 2024-04-19T04:25:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238276+0000", 2024-04-19T04:25:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238280+0000", 2024-04-19T04:25:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6399999999999999e-06 2024-04-19T04:25:02.453 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.453 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.453 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.453 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238286+0000", 2024-04-19T04:25:02.453 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2099999999999998e-06 2024-04-19T04:25:02.453 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.453 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.453 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.453 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238290+0000", 2024-04-19T04:25:02.453 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2470000000000002e-06 2024-04-19T04:25:02.453 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.453 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.453 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.453 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239526+0000", 2024-04-19T04:25:02.453 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012362619999999999 2024-04-19T04:25:02.454 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.454 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.454 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.454 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239538+0000", 2024-04-19T04:25:02.454 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1620999999999999e-05 2024-04-19T04:25:02.454 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.454 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.454 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.454 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280282+0000", 2024-04-19T04:25:02.454 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040743691999999998 2024-04-19T04:25:02.454 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.454 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.454 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.454 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.455 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.455 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:02.455 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:02.455 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.1255452960000003, 2024-04-19T04:25:02.455 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:02.455 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.455 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.455 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:02.455 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:02.455 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:02.455 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:02.455 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.455 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.455 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.456 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.456 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:02.456 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.456 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.456 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.456 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.456 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:02.456 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.456 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.456 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.456 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.456 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:02.456 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.456 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.456 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.457 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.457 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:02.457 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:02.457 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.457 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.457 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.457 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:02.457 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:02.457 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.457 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.457 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.457 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:02.457 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:02.457 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.458 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.458 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.458 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:02.458 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:02.458 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.458 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.458 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.458 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:02.458 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:02.458 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.458 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.458 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:02.458 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:02.459 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:02.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.459 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.459 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.459 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:02.459 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:02.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.459 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.459 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:02.459 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:02.459 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:02.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.459 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.459 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:02.459 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:02.460 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:02.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.460 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.460 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:02.460 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:02.460 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.460 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.460 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.460 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:02.460 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:02.460 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.1250110200000005, 2024-04-19T04:25:02.461 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:02.461 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.461 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.461 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.461 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.461 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.461 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:02.461 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.461 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.461 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.461 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.461 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:02.461 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.462 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.462 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.462 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.462 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:02.462 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.462 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.462 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.462 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.462 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:02.463 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:02.463 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.463 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.463 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.463 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:02.463 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:02.463 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.463 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.463 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.463 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:02.463 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:02.463 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.463 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.463 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.464 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:02.464 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:02.464 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.464 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.464 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.464 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:02.464 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:02.464 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.464 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.464 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:02.464 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:02.464 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:02.464 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.464 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.465 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.465 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:02.465 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:02.465 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.465 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.465 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.465 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.465 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.465 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26160 5.f e27/20 ondisk, result = 0)", 2024-04-19T04:25:02.465 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:02.465 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.1238956449999993, 2024-04-19T04:25:02.465 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039752357000000002, 2024-04-19T04:25:02.465 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.465 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:02.466 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.466 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.466 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.466 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:02.466 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.466 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.466 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.466 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.466 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:02.466 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.466 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.466 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.466 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.467 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240559+0000", 2024-04-19T04:25:02.467 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:02.467 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.467 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.467 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.467 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240569+0000", 2024-04-19T04:25:02.467 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7720000000000006e-06 2024-04-19T04:25:02.467 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.467 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.467 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.467 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280164+0000", 2024-04-19T04:25:02.467 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039595324000000001 2024-04-19T04:25:02.467 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.467 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.467 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.468 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280190+0000", 2024-04-19T04:25:02.468 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5692000000000001e-05 2024-04-19T04:25:02.468 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.468 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.468 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.468 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280287+0000", 2024-04-19T04:25:02.468 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7536999999999998e-05 2024-04-19T04:25:02.468 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.468 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.468 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.468 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280299+0000", 2024-04-19T04:25:02.468 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2057e-05 2024-04-19T04:25:02.468 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.468 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.468 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.469 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:02.469 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3244999999999999e-05 2024-04-19T04:25:02.469 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.469 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.469 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.469 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.469 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.469 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26179 5.3 e27/20 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head v 27'1624, mlcod=27'1621)", 2024-04-19T04:25:02.469 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:02.469 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.1207418929999999, 2024-04-19T04:25:02.469 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039964081999999998, 2024-04-19T04:25:02.469 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:02.469 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.469 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:02.469 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.470 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:02.470 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:02.470 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.470 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.470 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.470 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:02.470 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:02.470 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:02.470 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.470 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.470 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:02.470 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243713+0000", 2024-04-19T04:25:02.470 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.470 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.470 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.471 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:02.471 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243750+0000", 2024-04-19T04:25:02.471 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6704e-05 2024-04-19T04:25:02.471 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.471 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.471 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:02.471 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280162+0000", 2024-04-19T04:25:02.471 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036412117000000001 2024-04-19T04:25:02.471 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.471 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.471 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.471 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280186+0000", 2024-04-19T04:25:02.471 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4825999999999999e-05 2024-04-19T04:25:02.471 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.472 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.472 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:02.472 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:02.472 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012540000000000001 2024-04-19T04:25:02.472 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.472 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.472 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:02.472 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280347+0000", 2024-04-19T04:25:02.472 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4894000000000002e-05 2024-04-19T04:25:02.472 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.472 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.472 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:02.472 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283654+0000", 2024-04-19T04:25:02.472 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00330716 2024-04-19T04:25:02.472 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:02.473 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:02.473 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:02.473 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283678+0000", 2024-04-19T04:25:02.473 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3992e-05 2024-04-19T04:25:02.473 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.473 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.473 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.473 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:02.473 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:02.473 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:02.474 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:02.474+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:02.475 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:25:02.575 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:02.570+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:02.608 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:25:02.608 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [ 2024-04-19T04:25:02.608 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.608 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:42943 5.e e33/20 5:7a9ce7c5:::benchmark_data_smithi007_19526_object42942:head v 33'2733, mlcod=33'2731)", 2024-04-19T04:25:02.608 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:02.605843+0000", 2024-04-19T04:25:02.608 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00029243299999999998, 2024-04-19T04:25:02.608 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00031168599999999998, 2024-04-19T04:25:02.608 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.608 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:02.608 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.609 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.609 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.609 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605843+0000", 2024-04-19T04:25:02.609 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.609 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.609 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.609 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.609 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605843+0000", 2024-04-19T04:25:02.609 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.609 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.609 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.609 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.609 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605842+0000", 2024-04-19T04:25:02.609 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.609 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.610 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.610 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.610 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605917+0000", 2024-04-19T04:25:02.610 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.4710999999999997e-05 2024-04-19T04:25:02.610 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.610 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.610 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.610 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605927+0000", 2024-04-19T04:25:02.610 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0183999999999999e-05 2024-04-19T04:25:02.610 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.610 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.610 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.610 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605933+0000", 2024-04-19T04:25:02.611 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.3829999999999997e-06 2024-04-19T04:25:02.611 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.611 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.611 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.611 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605997+0000", 2024-04-19T04:25:02.611 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.3814999999999998e-05 2024-04-19T04:25:02.611 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.611 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.611 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.611 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.606023+0000", 2024-04-19T04:25:02.611 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.6149e-05 2024-04-19T04:25:02.611 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.611 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.611 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.611 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.612 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.612 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:42928 5.a 5:581abf44:::benchmark_data_smithi007_19526_object42927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:02.612 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:02.596961+0000", 2024-04-19T04:25:02.612 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0091746050000000006, 2024-04-19T04:25:02.612 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0092451830000000006, 2024-04-19T04:25:02.612 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.612 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:02.612 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:02.612 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:02.612 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:02.613 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 42928 2024-04-19T04:25:02.613 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.613 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.613 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.613 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.613 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.596961+0000", 2024-04-19T04:25:02.613 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.613 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.613 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.613 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.613 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.596961+0000", 2024-04-19T04:25:02.613 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.613 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.613 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.613 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.614 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.596960+0000", 2024-04-19T04:25:02.614 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.614 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.614 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.614 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.614 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.597033+0000", 2024-04-19T04:25:02.614 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3312999999999994e-05 2024-04-19T04:25:02.614 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.614 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.614 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.614 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.597050+0000", 2024-04-19T04:25:02.614 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.6433999999999999e-05 2024-04-19T04:25:02.614 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.614 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.615 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.615 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.597058+0000", 2024-04-19T04:25:02.615 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.242e-06 2024-04-19T04:25:02.615 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.615 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.615 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.615 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599102+0000", 2024-04-19T04:25:02.615 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0020440319999999999 2024-04-19T04:25:02.615 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.615 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.615 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.615 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599225+0000", 2024-04-19T04:25:02.615 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012287600000000001 2024-04-19T04:25:02.616 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.616 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.616 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:02.616 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599363+0000", 2024-04-19T04:25:02.616 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013869800000000001 2024-04-19T04:25:02.616 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.616 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.616 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:02.616 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.604727+0000", 2024-04-19T04:25:02.616 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.005363647 2024-04-19T04:25:02.616 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.616 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.616 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.617 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.617 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.617 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:42930 5.8 5:11b3905b:::benchmark_data_smithi007_19526_object42929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:02.617 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:02.598933+0000", 2024-04-19T04:25:02.617 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0072022010000000001, 2024-04-19T04:25:02.617 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0073324490000000004, 2024-04-19T04:25:02.617 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.617 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:02.617 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:02.617 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:02.617 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:02.617 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 42930 2024-04-19T04:25:02.617 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.617 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.617 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.618 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.618 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.598933+0000", 2024-04-19T04:25:02.618 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.618 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.618 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.618 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.618 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.598933+0000", 2024-04-19T04:25:02.618 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.618 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.618 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.618 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.618 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.598932+0000", 2024-04-19T04:25:02.619 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.619 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.619 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.619 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.619 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.598963+0000", 2024-04-19T04:25:02.619 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.0953e-05 2024-04-19T04:25:02.619 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.619 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.619 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.619 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.598971+0000", 2024-04-19T04:25:02.619 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.2579999999999995e-06 2024-04-19T04:25:02.619 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.619 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.619 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.620 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.598980+0000", 2024-04-19T04:25:02.620 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.7120000000000006e-06 2024-04-19T04:25:02.620 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.620 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.620 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.620 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599266+0000", 2024-04-19T04:25:02.620 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000285875 2024-04-19T04:25:02.620 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.620 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.620 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.620 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599416+0000", 2024-04-19T04:25:02.620 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014964500000000001 2024-04-19T04:25:02.620 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.620 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.620 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:02.621 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599621+0000", 2024-04-19T04:25:02.621 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00020508899999999999 2024-04-19T04:25:02.621 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.621 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.621 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:02.621 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.604779+0000", 2024-04-19T04:25:02.621 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0051582779999999996 2024-04-19T04:25:02.621 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.621 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.621 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.621 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.621 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.621 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:42931 5.8 5:1f03e3bc:::benchmark_data_smithi007_19526_object42930:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:02.621 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:02.599047+0000", 2024-04-19T04:25:02.621 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0070879150000000002, 2024-04-19T04:25:02.622 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0072721390000000004, 2024-04-19T04:25:02.622 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.622 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:02.622 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:02.622 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:02.622 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:02.622 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 42931 2024-04-19T04:25:02.622 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.622 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.623 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.623 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.623 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599047+0000", 2024-04-19T04:25:02.623 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.623 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.623 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.623 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.623 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599047+0000", 2024-04-19T04:25:02.623 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.623 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.623 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.623 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.623 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599047+0000", 2024-04-19T04:25:02.623 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.624 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.624 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.624 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.624 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599119+0000", 2024-04-19T04:25:02.624 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2328000000000003e-05 2024-04-19T04:25:02.624 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.624 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.624 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.624 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599128+0000", 2024-04-19T04:25:02.624 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.1689999999999998e-06 2024-04-19T04:25:02.624 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.624 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.624 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.625 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599135+0000", 2024-04-19T04:25:02.625 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3069999999999997e-06 2024-04-19T04:25:02.625 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.625 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.625 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.625 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.601720+0000", 2024-04-19T04:25:02.625 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.002584589 2024-04-19T04:25:02.625 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.625 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.625 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.625 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.601968+0000", 2024-04-19T04:25:02.625 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00024836900000000002 2024-04-19T04:25:02.625 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.625 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.626 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:02.626 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602080+0000", 2024-04-19T04:25:02.626 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0001115 2024-04-19T04:25:02.626 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.626 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.626 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.626 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.626 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.626 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:42934 5.6 5:62484d6a:::benchmark_data_smithi007_19526_object42933:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:02.626 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:02.599401+0000", 2024-04-19T04:25:02.626 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0067344980000000002, 2024-04-19T04:25:02.626 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0069676399999999998, 2024-04-19T04:25:02.626 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.627 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:02.627 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:02.627 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:02.627 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:02.627 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 42934 2024-04-19T04:25:02.627 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.627 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.627 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.627 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.627 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599401+0000", 2024-04-19T04:25:02.627 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.627 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.627 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.627 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.628 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599401+0000", 2024-04-19T04:25:02.628 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.628 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.628 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.628 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.628 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599400+0000", 2024-04-19T04:25:02.628 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.628 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.628 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.628 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.628 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599461+0000", 2024-04-19T04:25:02.628 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.1116000000000002e-05 2024-04-19T04:25:02.628 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.628 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.628 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.629 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599471+0000", 2024-04-19T04:25:02.629 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0302999999999999e-05 2024-04-19T04:25:02.629 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.629 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.629 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.629 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599478+0000", 2024-04-19T04:25:02.629 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7920000000000004e-06 2024-04-19T04:25:02.629 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.629 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.630 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.630 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.600725+0000", 2024-04-19T04:25:02.630 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0012464609999999999 2024-04-19T04:25:02.630 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.630 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.630 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.630 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.600851+0000", 2024-04-19T04:25:02.630 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012681500000000001 2024-04-19T04:25:02.630 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.630 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.630 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:02.630 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.600974+0000", 2024-04-19T04:25:02.630 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012309800000000001 2024-04-19T04:25:02.630 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.631 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.631 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.631 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.604928+0000", 2024-04-19T04:25:02.631 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0039535289999999999 2024-04-19T04:25:02.631 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.631 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.631 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.631 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.631 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.631 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:42935 5.4 5:29ff129d:::benchmark_data_smithi007_19526_object42934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:02.631 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:02.599597+0000", 2024-04-19T04:25:02.631 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0065379510000000002, 2024-04-19T04:25:02.631 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0068613579999999997, 2024-04-19T04:25:02.631 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.632 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:02.632 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:02.632 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:02.632 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:02.632 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 42935 2024-04-19T04:25:02.632 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.632 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.632 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.632 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.632 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599597+0000", 2024-04-19T04:25:02.632 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.632 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.632 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.632 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.632 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599597+0000", 2024-04-19T04:25:02.633 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.633 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.633 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.633 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.633 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599596+0000", 2024-04-19T04:25:02.633 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.633 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.633 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.633 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.633 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599695+0000", 2024-04-19T04:25:02.633 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.8735999999999998e-05 2024-04-19T04:25:02.633 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.633 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.633 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.633 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599707+0000", 2024-04-19T04:25:02.634 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1949e-05 2024-04-19T04:25:02.634 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.634 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.634 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.634 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599715+0000", 2024-04-19T04:25:02.634 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.0860000000000002e-06 2024-04-19T04:25:02.634 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.634 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.634 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.634 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599763+0000", 2024-04-19T04:25:02.634 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.8254999999999998e-05 2024-04-19T04:25:02.634 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.634 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.634 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.635 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599883+0000", 2024-04-19T04:25:02.635 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000119394 2024-04-19T04:25:02.635 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.635 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.635 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:02.635 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599998+0000", 2024-04-19T04:25:02.635 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000115133 2024-04-19T04:25:02.635 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.635 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.635 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:02.635 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.604739+0000", 2024-04-19T04:25:02.635 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0047411249999999997 2024-04-19T04:25:02.635 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.635 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.635 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.636 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.636 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.636 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:42933 5.7 e33/20 5:e8384b86:::benchmark_data_smithi007_19526_object42932:head v 33'2710, mlcod=33'2707)", 2024-04-19T04:25:02.636 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:02.599958+0000", 2024-04-19T04:25:02.636 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0061776000000000001, 2024-04-19T04:25:02.636 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0065819310000000001, 2024-04-19T04:25:02.636 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.636 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:02.636 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.636 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.636 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.636 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599958+0000", 2024-04-19T04:25:02.636 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.636 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.637 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.637 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.637 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599958+0000", 2024-04-19T04:25:02.637 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.637 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.637 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.637 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.637 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.599957+0000", 2024-04-19T04:25:02.637 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:02.637 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.637 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.637 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.637 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.600005+0000", 2024-04-19T04:25:02.637 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7623000000000001e-05 2024-04-19T04:25:02.638 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.638 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.638 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.638 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.600015+0000", 2024-04-19T04:25:02.638 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.9140000000000003e-06 2024-04-19T04:25:02.638 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.638 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.638 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.638 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.600021+0000", 2024-04-19T04:25:02.638 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.3389999999999998e-06 2024-04-19T04:25:02.638 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.638 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.638 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.638 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.600070+0000", 2024-04-19T04:25:02.639 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.8964000000000001e-05 2024-04-19T04:25:02.639 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.639 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.639 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.639 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.600091+0000", 2024-04-19T04:25:02.639 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.1163e-05 2024-04-19T04:25:02.639 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.639 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.639 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.639 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.639 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.639 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:42936 5.b e33/20 5:d052a50a:::benchmark_data_smithi007_19526_object42935:head v 33'2691, mlcod=33'2689)", 2024-04-19T04:25:02.639 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:02.601700+0000", 2024-04-19T04:25:02.639 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0044352810000000001, 2024-04-19T04:25:02.640 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0048821339999999998, 2024-04-19T04:25:02.640 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.640 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:02.640 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.640 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.640 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.640 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.601700+0000", 2024-04-19T04:25:02.640 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.640 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.640 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.640 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.640 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.601700+0000", 2024-04-19T04:25:02.640 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.640 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.640 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.641 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.641 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.601699+0000", 2024-04-19T04:25:02.641 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.641 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.641 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.641 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.641 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.601828+0000", 2024-04-19T04:25:02.641 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000128901 2024-04-19T04:25:02.641 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.641 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.641 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.641 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.601838+0000", 2024-04-19T04:25:02.641 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.5380000000000008e-06 2024-04-19T04:25:02.641 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.642 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.642 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.642 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.601844+0000", 2024-04-19T04:25:02.642 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.1639999999999998e-06 2024-04-19T04:25:02.642 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.642 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.642 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.642 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.601890+0000", 2024-04-19T04:25:02.642 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.5668999999999999e-05 2024-04-19T04:25:02.642 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.642 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.642 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.642 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.601908+0000", 2024-04-19T04:25:02.642 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8243000000000001e-05 2024-04-19T04:25:02.643 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.643 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.643 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.643 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.643 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.643 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:42937 5.6 5:655b885a:::benchmark_data_smithi007_19526_object42936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:02.643 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:02.601941+0000", 2024-04-19T04:25:02.643 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0041945089999999999, 2024-04-19T04:25:02.643 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0046830229999999997, 2024-04-19T04:25:02.643 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.643 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:02.643 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:02.643 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:02.643 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:02.644 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 42937 2024-04-19T04:25:02.644 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.644 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.644 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.644 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.644 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.601941+0000", 2024-04-19T04:25:02.644 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.644 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.644 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.644 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.644 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.601941+0000", 2024-04-19T04:25:02.644 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.644 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.644 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.645 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.645 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.601940+0000", 2024-04-19T04:25:02.645 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:02.645 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.645 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.645 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.645 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602011+0000", 2024-04-19T04:25:02.645 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.1068000000000005e-05 2024-04-19T04:25:02.645 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.645 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.645 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.645 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602021+0000", 2024-04-19T04:25:02.645 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0434999999999999e-05 2024-04-19T04:25:02.645 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.646 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.646 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.646 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602029+0000", 2024-04-19T04:25:02.646 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.1689999999999992e-06 2024-04-19T04:25:02.646 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.646 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.646 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.646 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602772+0000", 2024-04-19T04:25:02.646 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00074306600000000002 2024-04-19T04:25:02.646 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.646 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.646 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.646 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602916+0000", 2024-04-19T04:25:02.646 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014352500000000001 2024-04-19T04:25:02.647 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.647 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.647 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:02.647 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.603077+0000", 2024-04-19T04:25:02.647 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00016165999999999999 2024-04-19T04:25:02.647 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.647 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.647 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.647 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605549+0000", 2024-04-19T04:25:02.647 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0024717369999999999 2024-04-19T04:25:02.647 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.647 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.647 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.647 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.648 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.648 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:42938 5.c 5:37951786:::benchmark_data_smithi007_19526_object42937:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:02.648 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:02.602140+0000", 2024-04-19T04:25:02.648 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0039955679999999997, 2024-04-19T04:25:02.648 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0045374889999999996, 2024-04-19T04:25:02.648 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.648 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:02.648 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:02.648 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:02.648 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:02.648 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 42938 2024-04-19T04:25:02.648 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.648 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.648 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.648 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.649 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602140+0000", 2024-04-19T04:25:02.649 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.649 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.649 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.650 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.650 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602140+0000", 2024-04-19T04:25:02.650 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.650 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.650 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.650 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.650 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602139+0000", 2024-04-19T04:25:02.650 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.650 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.650 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.650 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.650 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602218+0000", 2024-04-19T04:25:02.650 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.9023000000000006e-05 2024-04-19T04:25:02.651 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.651 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.651 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.651 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602233+0000", 2024-04-19T04:25:02.651 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.4842e-05 2024-04-19T04:25:02.651 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.651 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.651 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.651 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602240+0000", 2024-04-19T04:25:02.651 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.9840000000000004e-06 2024-04-19T04:25:02.651 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.651 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.651 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.651 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602474+0000", 2024-04-19T04:25:02.651 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00023463299999999999 2024-04-19T04:25:02.652 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.652 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.652 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.652 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602608+0000", 2024-04-19T04:25:02.652 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000133867 2024-04-19T04:25:02.652 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.652 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.652 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:02.652 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602756+0000", 2024-04-19T04:25:02.652 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014815999999999999 2024-04-19T04:25:02.652 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.652 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.652 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.652 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.652 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.653 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:42939 5.a 5:5361163a:::benchmark_data_smithi007_19526_object42938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:02.653 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:02.602434+0000", 2024-04-19T04:25:02.653 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.003701275, 2024-04-19T04:25:02.653 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0042912610000000002, 2024-04-19T04:25:02.653 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.653 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:02.653 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:02.653 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:02.653 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:02.653 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 42939 2024-04-19T04:25:02.653 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.653 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.653 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.653 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.653 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602434+0000", 2024-04-19T04:25:02.654 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.654 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.654 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.654 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.654 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602434+0000", 2024-04-19T04:25:02.654 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.654 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.654 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.654 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.654 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602433+0000", 2024-04-19T04:25:02.654 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.654 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.654 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.655 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.655 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602474+0000", 2024-04-19T04:25:02.655 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.0865999999999998e-05 2024-04-19T04:25:02.655 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.655 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.655 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.655 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602495+0000", 2024-04-19T04:25:02.655 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.0803000000000001e-05 2024-04-19T04:25:02.655 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.655 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.655 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.655 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602502+0000", 2024-04-19T04:25:02.655 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.4449999999999999e-06 2024-04-19T04:25:02.655 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.655 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.656 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.656 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602549+0000", 2024-04-19T04:25:02.656 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.6181999999999999e-05 2024-04-19T04:25:02.656 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.656 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.656 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.656 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602684+0000", 2024-04-19T04:25:02.656 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013535399999999999 2024-04-19T04:25:02.656 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.656 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.656 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:02.656 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.602829+0000", 2024-04-19T04:25:02.656 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014497100000000001 2024-04-19T04:25:02.657 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.657 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.657 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.657 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.657 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.657 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:42944 5.c 5:393f13d3:::benchmark_data_smithi007_19526_object42943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:02.658 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:02.605484+0000", 2024-04-19T04:25:02.658 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00065088799999999997, 2024-04-19T04:25:02.658 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001289084, 2024-04-19T04:25:02.658 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.659 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:02.659 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:02.659 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:02.659 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:02.659 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 42944 2024-04-19T04:25:02.659 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.659 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.659 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.659 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.659 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605484+0000", 2024-04-19T04:25:02.659 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.659 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.660 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.660 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.660 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605484+0000", 2024-04-19T04:25:02.660 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.660 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.660 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.660 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.660 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605483+0000", 2024-04-19T04:25:02.660 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:02.660 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.661 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.661 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.661 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605545+0000", 2024-04-19T04:25:02.661 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.2226999999999999e-05 2024-04-19T04:25:02.661 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.661 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.661 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.661 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605557+0000", 2024-04-19T04:25:02.661 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1931e-05 2024-04-19T04:25:02.661 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.661 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.661 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.661 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605565+0000", 2024-04-19T04:25:02.662 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.9810000000000003e-06 2024-04-19T04:25:02.662 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.662 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.662 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.662 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605611+0000", 2024-04-19T04:25:02.662 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.5342000000000001e-05 2024-04-19T04:25:02.662 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.662 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.662 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.662 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605711+0000", 2024-04-19T04:25:02.662 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000100778 2024-04-19T04:25:02.662 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.662 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.663 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:02.663 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605816+0000", 2024-04-19T04:25:02.663 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00010449499999999999 2024-04-19T04:25:02.663 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.663 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.663 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.663 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.663 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.663 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop_reply(client.4746.0:42938 5.c e33/20)", 2024-04-19T04:25:02.663 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:02.605758+0000", 2024-04-19T04:25:02.663 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00037759499999999999, 2024-04-19T04:25:02.663 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001059527, 2024-04-19T04:25:02.663 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.664 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:02.664 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.664 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.664 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.664 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605758+0000", 2024-04-19T04:25:02.664 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.664 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.664 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.664 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.664 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605758+0000", 2024-04-19T04:25:02.664 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.664 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.664 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.664 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.664 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605757+0000", 2024-04-19T04:25:02.665 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:02.665 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.665 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.665 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.665 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605761+0000", 2024-04-19T04:25:02.665 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8850000000000001e-06 2024-04-19T04:25:02.665 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.665 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.665 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.665 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605767+0000", 2024-04-19T04:25:02.665 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.3369999999999996e-06 2024-04-19T04:25:02.665 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.665 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.666 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.666 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.605773+0000", 2024-04-19T04:25:02.666 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.0039999999999996e-06 2024-04-19T04:25:02.666 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.666 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.666 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.666 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.666 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-04-19T04:25:02.666 INFO:teuthology.orchestra.run.smithi066.stdout: "num_ops": 13 2024-04-19T04:25:02.666 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:25:02.668 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:25:02.677 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:02.674+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:02.752 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 18 16 43255 43239 150.118 133.25 0.0089648 0.00665482 2024-04-19T04:25:02.768 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T04:25:02.778 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:02.778+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:02.800 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:25:02.800 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [], 2024-04-19T04:25:02.800 INFO:teuthology.orchestra.run.smithi066.stdout: "complaint_time": 30, 2024-04-19T04:25:02.800 INFO:teuthology.orchestra.run.smithi066.stdout: "num_blocked_ops": 0 2024-04-19T04:25:02.800 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:25:02.814 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:25:02.879 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:02.874+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:02.952 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:25:02.952 INFO:teuthology.orchestra.run.smithi066.stdout: "size": 20, 2024-04-19T04:25:02.952 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 600, 2024-04-19T04:25:02.952 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [ 2024-04-19T04:25:02.953 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.953 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:02.953 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:25:02.953 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 42.415839339000001, 2024-04-19T04:25:02.953 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019436790999999998, 2024-04-19T04:25:02.953 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.953 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.953 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.953 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.953 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.953 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:25:02.953 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.953 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.953 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.954 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.954 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:25:02.954 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.954 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.954 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.954 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.954 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533562+0000", 2024-04-19T04:25:02.954 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999967 2024-04-19T04:25:02.954 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.954 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.954 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.954 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533588+0000", 2024-04-19T04:25:02.954 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.6128000000000001e-05 2024-04-19T04:25:02.954 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.955 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.955 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.955 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533617+0000", 2024-04-19T04:25:02.955 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.8685000000000001e-05 2024-04-19T04:25:02.955 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.955 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.955 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.955 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533649+0000", 2024-04-19T04:25:02.955 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.2532e-05 2024-04-19T04:25:02.955 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.955 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.955 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.955 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536605+0000", 2024-04-19T04:25:02.955 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0029553130000000002 2024-04-19T04:25:02.955 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.956 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.956 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.956 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536746+0000", 2024-04-19T04:25:02.956 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000141011 2024-04-19T04:25:02.956 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.956 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.956 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:02.956 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536889+0000", 2024-04-19T04:25:02.956 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000143437 2024-04-19T04:25:02.956 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.956 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.956 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:02.956 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542807+0000", 2024-04-19T04:25:02.956 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0059181210000000001 2024-04-19T04:25:02.956 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.957 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.957 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.957 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.552917+0000", 2024-04-19T04:25:02.957 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010110111 2024-04-19T04:25:02.957 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.957 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.957 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:02.957 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.552962+0000", 2024-04-19T04:25:02.957 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.4811999999999997e-05 2024-04-19T04:25:02.957 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.957 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.957 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:02.957 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553002+0000", 2024-04-19T04:25:02.957 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9957999999999999e-05 2024-04-19T04:25:02.958 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.958 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.958 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.958 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.958 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.958 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:02.958 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:25:02.958 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 42.415723395000001, 2024-04-19T04:25:02.958 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019464940999999999, 2024-04-19T04:25:02.958 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.958 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.958 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.958 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.958 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.959 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:25:02.959 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.959 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.959 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.959 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.959 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:25:02.959 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.959 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.959 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.959 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.959 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533680+0000", 2024-04-19T04:25:02.959 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:02.959 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.959 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.959 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.960 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533692+0000", 2024-04-19T04:25:02.960 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2235000000000001e-05 2024-04-19T04:25:02.960 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.960 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.960 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.960 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533770+0000", 2024-04-19T04:25:02.960 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.8248e-05 2024-04-19T04:25:02.960 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.960 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.960 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.960 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:25:02.960 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8671000000000001e-05 2024-04-19T04:25:02.960 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.960 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.960 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.960 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539610+0000", 2024-04-19T04:25:02.961 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0058206669999999999 2024-04-19T04:25:02.961 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.961 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.961 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.961 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539705+0000", 2024-04-19T04:25:02.961 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.5313e-05 2024-04-19T04:25:02.961 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.961 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.961 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:02.961 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539857+0000", 2024-04-19T04:25:02.961 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000151881 2024-04-19T04:25:02.961 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.961 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.961 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:02.961 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542812+0000", 2024-04-19T04:25:02.962 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.002954857 2024-04-19T04:25:02.962 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.962 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.962 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.962 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553058+0000", 2024-04-19T04:25:02.962 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010246570999999999 2024-04-19T04:25:02.962 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.962 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.962 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:02.962 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553104+0000", 2024-04-19T04:25:02.962 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.5235999999999999e-05 2024-04-19T04:25:02.962 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.962 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.962 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:02.962 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553146+0000", 2024-04-19T04:25:02.963 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2725999999999997e-05 2024-04-19T04:25:02.963 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.963 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.963 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.963 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.963 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.963 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:21 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:02.963 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:25:02.963 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 42.415464295, 2024-04-19T04:25:02.963 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019340466000000001, 2024-04-19T04:25:02.963 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.963 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.963 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.963 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.963 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.963 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:25:02.964 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.964 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.964 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.964 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.964 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:25:02.964 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.964 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.964 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.964 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.964 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533939+0000", 2024-04-19T04:25:02.964 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.964 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.964 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.964 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.964 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533950+0000", 2024-04-19T04:25:02.965 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0533999999999999e-05 2024-04-19T04:25:02.965 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.965 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.965 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.965 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533973+0000", 2024-04-19T04:25:02.965 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2614000000000001e-05 2024-04-19T04:25:02.965 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.965 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.965 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.965 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:02.965 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3531e-05 2024-04-19T04:25:02.965 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.965 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.965 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.965 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541149+0000", 2024-04-19T04:25:02.966 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0071628780000000001 2024-04-19T04:25:02.966 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.966 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.966 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.966 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541279+0000", 2024-04-19T04:25:02.966 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013014999999999999 2024-04-19T04:25:02.966 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.966 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.966 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:02.966 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541430+0000", 2024-04-19T04:25:02.966 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015048399999999999 2024-04-19T04:25:02.966 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.966 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.966 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:02.967 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.543384+0000", 2024-04-19T04:25:02.967 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001954468 2024-04-19T04:25:02.967 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.967 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.967 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.967 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553193+0000", 2024-04-19T04:25:02.967 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0098089059999999992 2024-04-19T04:25:02.967 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.967 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.967 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:02.967 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553245+0000", 2024-04-19T04:25:02.967 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.1742e-05 2024-04-19T04:25:02.967 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.967 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.967 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:02.968 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553281+0000", 2024-04-19T04:25:02.968 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6272000000000001e-05 2024-04-19T04:25:02.968 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.968 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.968 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.968 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.968 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.968 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:02.968 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:25:02.968 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 42.415407043999998, 2024-04-19T04:25:02.968 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019497464999999999, 2024-04-19T04:25:02.968 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.968 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.968 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.968 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.969 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.969 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:25:02.969 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.969 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.969 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.969 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.969 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:25:02.969 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.969 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.969 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.969 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.969 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533997+0000", 2024-04-19T04:25:02.969 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.969 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.969 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.970 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.970 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534019+0000", 2024-04-19T04:25:02.970 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.1871000000000001e-05 2024-04-19T04:25:02.970 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.970 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.970 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.970 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534036+0000", 2024-04-19T04:25:02.970 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.7073999999999999e-05 2024-04-19T04:25:02.970 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.970 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.970 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.970 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:02.970 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3781000000000001e-05 2024-04-19T04:25:02.970 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.970 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.971 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.971 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534167+0000", 2024-04-19T04:25:02.971 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000117463 2024-04-19T04:25:02.971 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.971 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.971 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.971 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.535182+0000", 2024-04-19T04:25:02.971 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0010149340000000001 2024-04-19T04:25:02.971 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.971 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.971 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:02.971 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.535459+0000", 2024-04-19T04:25:02.971 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000277013 2024-04-19T04:25:02.971 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.971 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.972 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:02.972 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.540338+0000", 2024-04-19T04:25:02.972 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0048786109999999997 2024-04-19T04:25:02.972 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.972 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.972 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.972 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553416+0000", 2024-04-19T04:25:02.972 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013078251000000001 2024-04-19T04:25:02.972 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.972 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.972 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:02.972 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553456+0000", 2024-04-19T04:25:02.972 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.0516999999999998e-05 2024-04-19T04:25:02.972 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.972 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.973 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:02.973 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553495+0000", 2024-04-19T04:25:02.973 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8899999999999997e-05 2024-04-19T04:25:02.973 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.973 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.973 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.973 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.973 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.973 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:02.973 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:25:02.973 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 42.415308658000001, 2024-04-19T04:25:02.973 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019607754000000002, 2024-04-19T04:25:02.973 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.973 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:02.973 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.973 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.974 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.974 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:25:02.974 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.974 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.974 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.974 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.974 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:25:02.974 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.974 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.974 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.974 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.974 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534095+0000", 2024-04-19T04:25:02.974 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:02.974 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.975 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.975 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.975 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534104+0000", 2024-04-19T04:25:02.975 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.9779999999999994e-06 2024-04-19T04:25:02.975 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.975 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.975 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.975 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534122+0000", 2024-04-19T04:25:02.975 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8464000000000001e-05 2024-04-19T04:25:02.975 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.975 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.975 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.975 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534142+0000", 2024-04-19T04:25:02.975 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.9287999999999999e-05 2024-04-19T04:25:02.975 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.976 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.976 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.976 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.538550+0000", 2024-04-19T04:25:02.976 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0044085560000000001 2024-04-19T04:25:02.976 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.976 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.976 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.976 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.538726+0000", 2024-04-19T04:25:02.976 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017599299999999999 2024-04-19T04:25:02.976 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.976 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.976 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:02.976 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553704+0000", 2024-04-19T04:25:02.976 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.014977802 2024-04-19T04:25:02.976 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.976 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.977 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.977 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.977 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.977 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:02.977 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:25:02.977 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 42.415221768999999, 2024-04-19T04:25:02.977 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019220208999999999, 2024-04-19T04:25:02.977 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.977 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:02.977 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.977 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.977 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.977 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:25:02.977 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.977 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.978 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.978 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.978 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:25:02.978 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.978 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.978 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.978 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.978 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534182+0000", 2024-04-19T04:25:02.978 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.978 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.978 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.978 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.978 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534189+0000", 2024-04-19T04:25:02.978 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3710000000000002e-06 2024-04-19T04:25:02.979 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.979 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.979 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.979 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534810+0000", 2024-04-19T04:25:02.979 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00062098000000000003 2024-04-19T04:25:02.979 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.979 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.979 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.979 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534829+0000", 2024-04-19T04:25:02.979 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8207999999999999e-05 2024-04-19T04:25:02.979 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.979 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.979 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.979 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542089+0000", 2024-04-19T04:25:02.979 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0072601710000000002 2024-04-19T04:25:02.979 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.980 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.980 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.980 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542225+0000", 2024-04-19T04:25:02.980 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000135988 2024-04-19T04:25:02.980 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.980 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.980 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:02.980 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553403+0000", 2024-04-19T04:25:02.980 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011178478 2024-04-19T04:25:02.980 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.980 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.980 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.980 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.980 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.980 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25792 5.6 5:6ead9788:::benchmark_data_smithi007_19526_object25791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:02.981 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.070174+0000", 2024-04-19T04:25:02.981 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 8.8792304170000005, 2024-04-19T04:25:02.981 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.018078227999999998, 2024-04-19T04:25:02.981 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.981 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.981 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:02.981 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:02.981 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:02.981 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25792 2024-04-19T04:25:02.981 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.981 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.981 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.981 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.981 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070174+0000", 2024-04-19T04:25:02.981 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.982 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.982 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.982 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.982 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070174+0000", 2024-04-19T04:25:02.982 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.982 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.982 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.982 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.982 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070173+0000", 2024-04-19T04:25:02.982 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.982 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.982 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.982 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.982 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070241+0000", 2024-04-19T04:25:02.982 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7801999999999999e-05 2024-04-19T04:25:02.983 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.983 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.983 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.983 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070252+0000", 2024-04-19T04:25:02.983 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1405e-05 2024-04-19T04:25:02.983 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.983 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.983 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.983 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070258+0000", 2024-04-19T04:25:02.983 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4949999999999999e-06 2024-04-19T04:25:02.983 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.983 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.983 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.983 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070298+0000", 2024-04-19T04:25:02.983 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9932999999999999e-05 2024-04-19T04:25:02.984 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.984 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.984 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.984 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070386+0000", 2024-04-19T04:25:02.984 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8382999999999997e-05 2024-04-19T04:25:02.984 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.984 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.984 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:02.984 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070472+0000", 2024-04-19T04:25:02.984 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.5364999999999993e-05 2024-04-19T04:25:02.984 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.984 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.984 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.984 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.076618+0000", 2024-04-19T04:25:02.984 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.006146037 2024-04-19T04:25:02.985 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.985 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.985 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:02.985 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088147+0000", 2024-04-19T04:25:02.985 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011529634 2024-04-19T04:25:02.985 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.985 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.985 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:02.985 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088209+0000", 2024-04-19T04:25:02.985 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.1760999999999994e-05 2024-04-19T04:25:02.985 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.985 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.985 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:02.985 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088253+0000", 2024-04-19T04:25:02.985 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.3547000000000002e-05 2024-04-19T04:25:02.986 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.986 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.986 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.986 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.986 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.986 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:25794 5.e e27/20 5:77ddc1c5:::benchmark_data_smithi007_19526_object25793:head v 27'1671, mlcod=27'1669)", 2024-04-19T04:25:02.986 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.072074+0000", 2024-04-19T04:25:02.986 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 8.8773307149999994, 2024-04-19T04:25:02.986 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.016881862000000001, 2024-04-19T04:25:02.986 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.986 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.986 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.986 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.986 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.986 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072074+0000", 2024-04-19T04:25:02.987 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.987 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.987 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.987 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.987 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072074+0000", 2024-04-19T04:25:02.987 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.987 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.987 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.987 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.987 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072073+0000", 2024-04-19T04:25:02.987 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.987 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.987 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.987 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.987 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072119+0000", 2024-04-19T04:25:02.988 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.6301999999999998e-05 2024-04-19T04:25:02.988 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.988 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.988 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.988 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072130+0000", 2024-04-19T04:25:02.988 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1018e-05 2024-04-19T04:25:02.988 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.988 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.988 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.988 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072138+0000", 2024-04-19T04:25:02.988 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.131e-06 2024-04-19T04:25:02.988 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.988 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.988 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.988 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072176+0000", 2024-04-19T04:25:02.989 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8674000000000003e-05 2024-04-19T04:25:02.989 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.989 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.989 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.989 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072191+0000", 2024-04-19T04:25:02.989 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.5245000000000001e-05 2024-04-19T04:25:02.989 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.989 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.989 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:02.989 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088908+0000", 2024-04-19T04:25:02.989 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.016716742 2024-04-19T04:25:02.989 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.989 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.989 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:02.990 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088956+0000", 2024-04-19T04:25:02.990 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7675e-05 2024-04-19T04:25:02.990 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.990 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.990 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.990 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.990 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.990 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26158 5.3 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:02.990 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.232719+0000", 2024-04-19T04:25:02.990 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 8.7166857489999998, 2024-04-19T04:25:02.990 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.049770017, 2024-04-19T04:25:02.990 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.990 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.990 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:02.990 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:02.991 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:02.991 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26158 2024-04-19T04:25:02.991 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.991 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.991 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.991 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.991 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232719+0000", 2024-04-19T04:25:02.991 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.991 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.991 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.991 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.991 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232719+0000", 2024-04-19T04:25:02.991 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.991 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.992 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.992 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.992 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232718+0000", 2024-04-19T04:25:02.992 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:02.992 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.992 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.992 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.992 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232791+0000", 2024-04-19T04:25:02.992 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2421000000000003e-05 2024-04-19T04:25:02.992 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.992 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.992 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.992 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232804+0000", 2024-04-19T04:25:02.992 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3037000000000001e-05 2024-04-19T04:25:02.992 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.993 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.993 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.993 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232812+0000", 2024-04-19T04:25:02.993 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.2630000000000003e-06 2024-04-19T04:25:02.993 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.993 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.993 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.993 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232971+0000", 2024-04-19T04:25:02.993 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000159419 2024-04-19T04:25:02.993 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.993 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.993 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.993 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233124+0000", 2024-04-19T04:25:02.993 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000153182 2024-04-19T04:25:02.994 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.994 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.994 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:02.994 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233283+0000", 2024-04-19T04:25:02.994 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000158321 2024-04-19T04:25:02.994 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.994 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.994 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:02.994 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.236041+0000", 2024-04-19T04:25:02.994 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0027577919999999998 2024-04-19T04:25:02.994 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.994 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.994 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:02.994 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282307+0000", 2024-04-19T04:25:02.995 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.046266008999999997 2024-04-19T04:25:02.995 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.995 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.995 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:02.995 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282414+0000", 2024-04-19T04:25:02.995 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000107611 2024-04-19T04:25:02.995 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.995 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.995 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:02.995 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282489+0000", 2024-04-19T04:25:02.995 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.4805e-05 2024-04-19T04:25:02.995 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.995 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:02.995 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:02.996 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.996 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.996 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26164 5.6 5:63a08103:::benchmark_data_smithi007_19526_object26163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:02.996 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.233982+0000", 2024-04-19T04:25:02.996 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 8.715422362, 2024-04-19T04:25:02.996 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.047707233000000002, 2024-04-19T04:25:02.996 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:02.996 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:02.996 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:02.996 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:02.996 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:02.996 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26164 2024-04-19T04:25:02.996 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.997 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:02.997 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.997 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:02.997 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233982+0000", 2024-04-19T04:25:02.997 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.997 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.997 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.997 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:02.997 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233982+0000", 2024-04-19T04:25:02.997 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:02.997 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.997 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.997 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:02.997 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233981+0000", 2024-04-19T04:25:02.997 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:02.998 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.998 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.998 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:02.998 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234040+0000", 2024-04-19T04:25:02.998 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.8782000000000001e-05 2024-04-19T04:25:02.998 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.998 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.998 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:02.998 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234051+0000", 2024-04-19T04:25:02.998 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0822000000000001e-05 2024-04-19T04:25:02.998 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.998 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.998 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:02.998 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234059+0000", 2024-04-19T04:25:02.999 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.7479999999999993e-06 2024-04-19T04:25:02.999 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.999 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.999 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:02.999 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234133+0000", 2024-04-19T04:25:02.999 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.4059000000000004e-05 2024-04-19T04:25:02.999 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.999 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.999 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:02.999 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234356+0000", 2024-04-19T04:25:02.999 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00022300400000000001 2024-04-19T04:25:02.999 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:02.999 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:02.999 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:02.999 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234515+0000", 2024-04-19T04:25:03.000 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015913599999999999 2024-04-19T04:25:03.000 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.000 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.000 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:03.000 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.236924+0000", 2024-04-19T04:25:03.000 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0024091989999999999 2024-04-19T04:25:03.000 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.000 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.000 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.000 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.281529+0000", 2024-04-19T04:25:03.000 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.044604984 2024-04-19T04:25:03.000 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.000 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.000 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:03.000 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.281616+0000", 2024-04-19T04:25:03.001 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.6784000000000001e-05 2024-04-19T04:25:03.001 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.001 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.001 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:03.001 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.281690+0000", 2024-04-19T04:25:03.001 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3907999999999998e-05 2024-04-19T04:25:03.001 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.001 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:03.001 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.001 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.001 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.001 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26170 5.c 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:03.001 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.237154+0000", 2024-04-19T04:25:03.001 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 8.7122510989999995, 2024-04-19T04:25:03.002 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.045024630000000003, 2024-04-19T04:25:03.002 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:03.002 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.002 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:03.002 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:03.002 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.002 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26170 2024-04-19T04:25:03.002 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.002 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:03.002 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.002 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:03.002 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237154+0000", 2024-04-19T04:25:03.002 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.002 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.003 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.003 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:03.003 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237154+0000", 2024-04-19T04:25:03.003 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.003 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.003 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.003 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:03.003 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237153+0000", 2024-04-19T04:25:03.003 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.003 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.003 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.003 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:03.003 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237230+0000", 2024-04-19T04:25:03.003 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.6827000000000002e-05 2024-04-19T04:25:03.003 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.003 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.004 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:03.004 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237241+0000", 2024-04-19T04:25:03.004 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1270999999999999e-05 2024-04-19T04:25:03.004 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.004 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.004 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.004 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237248+0000", 2024-04-19T04:25:03.004 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.622e-06 2024-04-19T04:25:03.004 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.004 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.004 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:03.004 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237341+0000", 2024-04-19T04:25:03.004 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.2417999999999995e-05 2024-04-19T04:25:03.005 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.005 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.005 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:03.005 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237450+0000", 2024-04-19T04:25:03.005 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00010864700000000001 2024-04-19T04:25:03.005 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.005 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.005 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:03.005 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237554+0000", 2024-04-19T04:25:03.005 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00010459999999999999 2024-04-19T04:25:03.005 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.005 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.005 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:03.005 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.239374+0000", 2024-04-19T04:25:03.005 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0018197370000000001 2024-04-19T04:25:03.006 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.006 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.006 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.006 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282078+0000", 2024-04-19T04:25:03.006 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.042703868999999998 2024-04-19T04:25:03.006 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.006 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.006 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:03.006 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282132+0000", 2024-04-19T04:25:03.006 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4302999999999998e-05 2024-04-19T04:25:03.006 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.006 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.006 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:03.006 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282178+0000", 2024-04-19T04:25:03.007 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.6224000000000003e-05 2024-04-19T04:25:03.007 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.007 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:03.007 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.007 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.007 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.007 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26179 5.3 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:03.007 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.241433+0000", 2024-04-19T04:25:03.007 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 8.7079717040000002, 2024-04-19T04:25:03.007 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.041219473, 2024-04-19T04:25:03.007 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:03.007 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.007 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:03.007 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:03.008 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.008 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26179 2024-04-19T04:25:03.008 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.008 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:03.008 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.008 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:03.008 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241433+0000", 2024-04-19T04:25:03.008 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.008 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.008 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.008 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:03.008 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241433+0000", 2024-04-19T04:25:03.008 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.008 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.009 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.009 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:03.009 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:03.009 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.009 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.009 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.009 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:03.009 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241517+0000", 2024-04-19T04:25:03.009 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.4895999999999995e-05 2024-04-19T04:25:03.009 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.009 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.009 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:03.009 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241529+0000", 2024-04-19T04:25:03.009 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1846e-05 2024-04-19T04:25:03.009 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.010 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.010 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.010 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241535+0000", 2024-04-19T04:25:03.010 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.8919999999999997e-06 2024-04-19T04:25:03.010 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.010 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.010 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:03.010 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241573+0000", 2024-04-19T04:25:03.010 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8936000000000001e-05 2024-04-19T04:25:03.010 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.010 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.010 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:03.010 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241675+0000", 2024-04-19T04:25:03.010 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000101983 2024-04-19T04:25:03.011 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.011 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.011 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:03.011 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241759+0000", 2024-04-19T04:25:03.011 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.3533000000000001e-05 2024-04-19T04:25:03.011 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.011 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.011 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:03.011 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243038+0000", 2024-04-19T04:25:03.011 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001279449 2024-04-19T04:25:03.011 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.011 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.011 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.011 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282563+0000", 2024-04-19T04:25:03.011 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.039524694999999999 2024-04-19T04:25:03.012 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.012 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.012 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:03.012 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282616+0000", 2024-04-19T04:25:03.012 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2432999999999998e-05 2024-04-19T04:25:03.012 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.012 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.012 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:03.012 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282653+0000", 2024-04-19T04:25:03.012 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6959999999999998e-05 2024-04-19T04:25:03.012 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.012 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:03.012 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.012 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.013 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.013 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26181 5.6 5:61db10b4:::benchmark_data_smithi007_19526_object26180:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:03.013 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.243304+0000", 2024-04-19T04:25:03.013 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 8.7061003659999994, 2024-04-19T04:25:03.013 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.043580885999999999, 2024-04-19T04:25:03.013 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:03.013 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.013 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:03.013 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:03.013 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.013 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26181 2024-04-19T04:25:03.013 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.013 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:03.013 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.014 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:03.014 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243304+0000", 2024-04-19T04:25:03.014 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.014 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.014 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.014 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:03.014 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243304+0000", 2024-04-19T04:25:03.014 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.014 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.014 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.014 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:03.014 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243303+0000", 2024-04-19T04:25:03.014 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.014 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.015 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.015 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:03.015 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243370+0000", 2024-04-19T04:25:03.015 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.6778000000000003e-05 2024-04-19T04:25:03.015 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.015 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.015 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:03.015 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243388+0000", 2024-04-19T04:25:03.015 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.7608000000000001e-05 2024-04-19T04:25:03.015 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.015 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.015 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.015 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243397+0000", 2024-04-19T04:25:03.015 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8279999999999992e-06 2024-04-19T04:25:03.015 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.016 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.016 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:03.016 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243444+0000", 2024-04-19T04:25:03.016 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7055000000000003e-05 2024-04-19T04:25:03.016 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.016 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.016 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:03.016 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243532+0000", 2024-04-19T04:25:03.016 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8782000000000005e-05 2024-04-19T04:25:03.016 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.016 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.016 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:03.016 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243614+0000", 2024-04-19T04:25:03.016 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.1199000000000006e-05 2024-04-19T04:25:03.016 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.016 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.017 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:03.017 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244915+0000", 2024-04-19T04:25:03.017 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001300893 2024-04-19T04:25:03.017 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.017 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.017 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.017 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286603+0000", 2024-04-19T04:25:03.017 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.041688847000000001 2024-04-19T04:25:03.017 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.017 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.017 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:03.017 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286792+0000", 2024-04-19T04:25:03.017 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00018885199999999999 2024-04-19T04:25:03.017 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.017 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.018 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:03.018 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286885+0000", 2024-04-19T04:25:03.018 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.3040000000000004e-05 2024-04-19T04:25:03.018 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.018 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:03.018 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.018 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.018 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.018 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26182 5.3 5:c032f6e9:::benchmark_data_smithi007_19526_object26181:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:03.018 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.244629+0000", 2024-04-19T04:25:03.018 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 8.7047752910000007, 2024-04-19T04:25:03.018 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.041622474999999999, 2024-04-19T04:25:03.018 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:03.018 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.019 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:03.019 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:03.019 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.019 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26182 2024-04-19T04:25:03.019 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.019 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:03.019 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.019 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:03.019 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244629+0000", 2024-04-19T04:25:03.019 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.019 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.019 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.019 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:03.019 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244629+0000", 2024-04-19T04:25:03.020 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.020 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.020 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.020 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:03.020 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244628+0000", 2024-04-19T04:25:03.020 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:03.020 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.020 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.020 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:03.020 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244752+0000", 2024-04-19T04:25:03.020 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000123802 2024-04-19T04:25:03.020 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.020 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.020 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:03.021 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244765+0000", 2024-04-19T04:25:03.021 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2908000000000001e-05 2024-04-19T04:25:03.021 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.021 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.021 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.021 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244772+0000", 2024-04-19T04:25:03.021 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.6850000000000004e-06 2024-04-19T04:25:03.021 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.021 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.021 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:03.021 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244813+0000", 2024-04-19T04:25:03.021 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1211999999999998e-05 2024-04-19T04:25:03.021 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.021 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.022 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:03.022 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244919+0000", 2024-04-19T04:25:03.022 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000106147 2024-04-19T04:25:03.022 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.022 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.022 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:03.022 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244993+0000", 2024-04-19T04:25:03.022 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3538e-05 2024-04-19T04:25:03.022 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.022 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.022 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:03.022 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.246228+0000", 2024-04-19T04:25:03.022 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001235217 2024-04-19T04:25:03.022 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.023 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.023 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.023 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286111+0000", 2024-04-19T04:25:03.023 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.039882933000000002 2024-04-19T04:25:03.023 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.023 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.023 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:03.023 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286180+0000", 2024-04-19T04:25:03.023 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.9212000000000001e-05 2024-04-19T04:25:03.023 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.023 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.023 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:03.023 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286252+0000", 2024-04-19T04:25:03.023 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2016999999999998e-05 2024-04-19T04:25:03.024 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.024 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:03.024 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.024 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.024 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.024 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:35013 5.5 5:ab8480aa:::benchmark_data_smithi007_19526_object35012:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:25:03.024 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:58.969205+0000", 2024-04-19T04:25:03.024 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 3.9802000849999999, 2024-04-19T04:25:03.024 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.015889127999999999, 2024-04-19T04:25:03.024 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:03.024 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.024 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:03.024 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:03.024 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.024 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 35013 2024-04-19T04:25:03.025 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.025 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:03.025 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.025 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:03.025 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.969205+0000", 2024-04-19T04:25:03.025 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.025 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.025 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.025 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:03.025 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.969205+0000", 2024-04-19T04:25:03.025 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.025 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.025 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.025 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:03.025 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.969204+0000", 2024-04-19T04:25:03.026 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.026 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.026 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.026 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:03.026 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.969264+0000", 2024-04-19T04:25:03.026 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.0080000000000001e-05 2024-04-19T04:25:03.026 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.026 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.026 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:03.026 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.969305+0000", 2024-04-19T04:25:03.026 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1211000000000002e-05 2024-04-19T04:25:03.026 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.026 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.026 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.027 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.969317+0000", 2024-04-19T04:25:03.027 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1979e-05 2024-04-19T04:25:03.027 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.027 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.027 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:03.027 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.971072+0000", 2024-04-19T04:25:03.027 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001755235 2024-04-19T04:25:03.027 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.027 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.027 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:03.027 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.971186+0000", 2024-04-19T04:25:03.027 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000114027 2024-04-19T04:25:03.027 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.027 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.027 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:03.028 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.971321+0000", 2024-04-19T04:25:03.028 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013452700000000001 2024-04-19T04:25:03.028 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.028 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.028 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:03.028 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.977861+0000", 2024-04-19T04:25:03.028 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.006540466 2024-04-19T04:25:03.028 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.028 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.028 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.028 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.985013+0000", 2024-04-19T04:25:03.028 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0071512479999999998 2024-04-19T04:25:03.028 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.028 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.029 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:03.029 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.985049+0000", 2024-04-19T04:25:03.029 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6195000000000002e-05 2024-04-19T04:25:03.029 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.029 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.029 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:03.029 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.985094+0000", 2024-04-19T04:25:03.029 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.5096999999999999e-05 2024-04-19T04:25:03.029 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.029 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:03.029 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.029 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.029 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.029 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:35062 5.0 e31/20 5:0b09a143:::benchmark_data_smithi007_19526_object35061:head v 31'2153, mlcod=31'2150)", 2024-04-19T04:25:03.029 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:58.996704+0000", 2024-04-19T04:25:03.030 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 3.9527008659999998, 2024-04-19T04:25:03.030 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.016084524999999999, 2024-04-19T04:25:03.030 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:03.030 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.030 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:03.030 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.030 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:03.030 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.996704+0000", 2024-04-19T04:25:03.030 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.030 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.030 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.030 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:03.030 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.996704+0000", 2024-04-19T04:25:03.031 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.031 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.031 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.031 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:03.031 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.996703+0000", 2024-04-19T04:25:03.031 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:03.031 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.031 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.031 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:03.031 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.996807+0000", 2024-04-19T04:25:03.031 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000104097 2024-04-19T04:25:03.031 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.031 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.031 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:03.032 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.996818+0000", 2024-04-19T04:25:03.032 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0513000000000001e-05 2024-04-19T04:25:03.032 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.032 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.032 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.032 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.996825+0000", 2024-04-19T04:25:03.032 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.182e-06 2024-04-19T04:25:03.032 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.032 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.032 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:03.032 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.996929+0000", 2024-04-19T04:25:03.032 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000104246 2024-04-19T04:25:03.032 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.032 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.032 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:03.033 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.996952+0000", 2024-04-19T04:25:03.033 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2770000000000001e-05 2024-04-19T04:25:03.033 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.033 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.033 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:03.033 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.012717+0000", 2024-04-19T04:25:03.033 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.015764916 2024-04-19T04:25:03.033 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.033 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.033 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:03.033 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.012788+0000", 2024-04-19T04:25:03.033 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.1514999999999995e-05 2024-04-19T04:25:03.033 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.033 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:03.034 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.034 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.034 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.034 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:36977 5.8 5:173f5207:::benchmark_data_smithi007_19526_object36976:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:25:03.034 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:59.841031+0000", 2024-04-19T04:25:03.034 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 3.1083739860000001, 2024-04-19T04:25:03.034 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.016294800000000002, 2024-04-19T04:25:03.034 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:03.034 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.034 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:03.034 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:03.034 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.034 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 36977 2024-04-19T04:25:03.034 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.035 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:03.035 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.035 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:03.035 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841031+0000", 2024-04-19T04:25:03.035 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.035 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.035 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.035 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:03.035 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841031+0000", 2024-04-19T04:25:03.035 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.035 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.035 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.035 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:03.035 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841030+0000", 2024-04-19T04:25:03.035 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:03.036 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.036 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.036 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:03.036 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841097+0000", 2024-04-19T04:25:03.037 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7271e-05 2024-04-19T04:25:03.037 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.038 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.038 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:03.038 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841107+0000", 2024-04-19T04:25:03.038 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.7089999999999997e-06 2024-04-19T04:25:03.038 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.038 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.038 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.038 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841114+0000", 2024-04-19T04:25:03.038 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7360000000000004e-06 2024-04-19T04:25:03.038 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.038 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.038 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:03.038 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841843+0000", 2024-04-19T04:25:03.038 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00072877200000000004 2024-04-19T04:25:03.039 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.039 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.039 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:03.039 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841988+0000", 2024-04-19T04:25:03.039 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000145272 2024-04-19T04:25:03.039 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.039 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.039 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:03.039 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.842143+0000", 2024-04-19T04:25:03.039 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015508300000000001 2024-04-19T04:25:03.039 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.039 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.039 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:03.040 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844474+0000", 2024-04-19T04:25:03.040 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0023309260000000001 2024-04-19T04:25:03.040 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.040 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.040 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.040 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.857223+0000", 2024-04-19T04:25:03.040 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.012748894 2024-04-19T04:25:03.040 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.040 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.040 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:03.040 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.857272+0000", 2024-04-19T04:25:03.040 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.9620000000000003e-05 2024-04-19T04:25:03.040 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.040 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.040 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:03.040 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.857326+0000", 2024-04-19T04:25:03.041 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.3149000000000002e-05 2024-04-19T04:25:03.041 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.041 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:03.041 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.041 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.041 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.041 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:42806 5.8 5:1870d2f7:::benchmark_data_smithi007_19526_object42805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:03.041 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:02.535141+0000", 2024-04-19T04:25:03.041 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.41426357800000002, 2024-04-19T04:25:03.041 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.015146177, 2024-04-19T04:25:03.041 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:03.041 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.041 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:03.041 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:03.041 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.042 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 42806 2024-04-19T04:25:03.042 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.042 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:03.042 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.042 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:03.042 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.535141+0000", 2024-04-19T04:25:03.042 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.042 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.042 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.042 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:03.042 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.535141+0000", 2024-04-19T04:25:03.042 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.042 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.043 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.043 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:03.043 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.535140+0000", 2024-04-19T04:25:03.043 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.043 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.043 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.043 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:03.043 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.535215+0000", 2024-04-19T04:25:03.043 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.4281000000000003e-05 2024-04-19T04:25:03.043 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.043 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.043 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:03.043 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.535222+0000", 2024-04-19T04:25:03.043 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.1620000000000002e-06 2024-04-19T04:25:03.043 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.043 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.044 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.044 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.535226+0000", 2024-04-19T04:25:03.044 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2520000000000001e-06 2024-04-19T04:25:03.044 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.044 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.044 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:03.044 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.542958+0000", 2024-04-19T04:25:03.044 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0077314699999999998 2024-04-19T04:25:03.044 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.044 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.044 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:03.044 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.543146+0000", 2024-04-19T04:25:03.044 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00018812599999999999 2024-04-19T04:25:03.044 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.044 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.045 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:03.045 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.543293+0000", 2024-04-19T04:25:03.045 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014733199999999999 2024-04-19T04:25:03.045 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.045 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.045 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.045 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.548855+0000", 2024-04-19T04:25:03.045 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0055621990000000003 2024-04-19T04:25:03.045 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.046 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.046 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:03.046 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.550203+0000", 2024-04-19T04:25:03.046 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001347369 2024-04-19T04:25:03.046 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.046 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.046 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:03.046 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.550247+0000", 2024-04-19T04:25:03.046 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.4348000000000003e-05 2024-04-19T04:25:03.046 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.046 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.046 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:03.046 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.550287+0000", 2024-04-19T04:25:03.047 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.0462e-05 2024-04-19T04:25:03.047 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.047 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:03.047 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.047 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.047 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.047 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:42899 5.8 5:16eae526:::benchmark_data_smithi007_19526_object42898:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:03.047 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:02.582894+0000", 2024-04-19T04:25:03.047 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.36651038499999999, 2024-04-19T04:25:03.047 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.016001320999999999, 2024-04-19T04:25:03.047 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:03.047 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.047 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:03.047 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:03.048 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.048 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 42899 2024-04-19T04:25:03.048 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.048 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:03.048 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.048 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:03.048 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.582894+0000", 2024-04-19T04:25:03.048 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.048 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.048 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.048 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:03.048 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.582894+0000", 2024-04-19T04:25:03.048 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.048 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.048 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.049 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:03.049 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.582893+0000", 2024-04-19T04:25:03.049 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.049 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.049 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.049 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:03.049 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.582953+0000", 2024-04-19T04:25:03.049 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.0022999999999998e-05 2024-04-19T04:25:03.049 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.049 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.049 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:03.049 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.582964+0000", 2024-04-19T04:25:03.049 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0407999999999999e-05 2024-04-19T04:25:03.049 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.050 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.050 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.050 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.582971+0000", 2024-04-19T04:25:03.050 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2409999999999998e-06 2024-04-19T04:25:03.050 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.050 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.050 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:03.050 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.583158+0000", 2024-04-19T04:25:03.050 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000186493 2024-04-19T04:25:03.050 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.050 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.050 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:03.050 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.583292+0000", 2024-04-19T04:25:03.050 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000134726 2024-04-19T04:25:03.051 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.051 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.051 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:03.051 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.583434+0000", 2024-04-19T04:25:03.051 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014172100000000001 2024-04-19T04:25:03.051 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.051 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.051 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:03.051 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.587765+0000", 2024-04-19T04:25:03.051 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0043314080000000001 2024-04-19T04:25:03.051 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.051 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.051 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.051 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.598706+0000", 2024-04-19T04:25:03.051 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010941094 2024-04-19T04:25:03.052 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.052 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.052 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:03.052 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.598836+0000", 2024-04-19T04:25:03.052 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012905600000000001 2024-04-19T04:25:03.052 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.052 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.052 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:03.052 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.598896+0000", 2024-04-19T04:25:03.052 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.0161000000000002e-05 2024-04-19T04:25:03.052 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.052 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:03.052 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.052 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.053 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.053 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:42901 5.a 5:50a75326:::benchmark_data_smithi007_19526_object42900:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:03.053 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:02.582983+0000", 2024-04-19T04:25:03.053 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.36642143599999999, 2024-04-19T04:25:03.053 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.015853308999999999, 2024-04-19T04:25:03.053 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:03.053 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.053 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:03.053 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:03.053 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.053 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 42901 2024-04-19T04:25:03.053 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.053 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:03.053 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.054 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:03.054 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.582983+0000", 2024-04-19T04:25:03.054 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.054 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.054 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.054 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:03.054 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.582983+0000", 2024-04-19T04:25:03.054 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:03.054 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.054 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.054 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:03.054 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.582983+0000", 2024-04-19T04:25:03.054 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:03.054 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.055 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.055 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:03.055 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.583019+0000", 2024-04-19T04:25:03.055 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6222e-05 2024-04-19T04:25:03.055 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.055 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.055 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:03.055 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.583027+0000", 2024-04-19T04:25:03.055 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.9519999999999994e-06 2024-04-19T04:25:03.055 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.055 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.055 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.055 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.583033+0000", 2024-04-19T04:25:03.055 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.7830000000000004e-06 2024-04-19T04:25:03.056 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.056 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.056 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:03.056 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.583069+0000", 2024-04-19T04:25:03.056 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.5927999999999999e-05 2024-04-19T04:25:03.056 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.056 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.056 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:03.056 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.583162+0000", 2024-04-19T04:25:03.056 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.3465e-05 2024-04-19T04:25:03.056 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.056 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.056 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:03.056 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.583240+0000", 2024-04-19T04:25:03.056 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.8022999999999995e-05 2024-04-19T04:25:03.057 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.057 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.057 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:03.057 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.586012+0000", 2024-04-19T04:25:03.057 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0027719379999999998 2024-04-19T04:25:03.057 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.057 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.057 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.057 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.598758+0000", 2024-04-19T04:25:03.057 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.012745556999999999 2024-04-19T04:25:03.057 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.057 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.057 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:03.057 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.598797+0000", 2024-04-19T04:25:03.057 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.96e-05 2024-04-19T04:25:03.058 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:03.058 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:03.058 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:03.058 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.598837+0000", 2024-04-19T04:25:03.058 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9397999999999998e-05 2024-04-19T04:25:03.058 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.058 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:03.058 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.058 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:03.058 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:03.058 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:25:03.059 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:03.054+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:03.060 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:03.160 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:03.158+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:03.184 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:44121 5.e 5:79d174e3:::benchmark_data_smithi007_19526_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:03.181562+0000", 2024-04-19T04:25:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002693824, 2024-04-19T04:25:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002715912, 2024-04-19T04:25:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 44121 2024-04-19T04:25:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181562+0000", 2024-04-19T04:25:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181562+0000", 2024-04-19T04:25:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181561+0000", 2024-04-19T04:25:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181634+0000", 2024-04-19T04:25:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3306999999999995e-05 2024-04-19T04:25:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181649+0000", 2024-04-19T04:25:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5227e-05 2024-04-19T04:25:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181656+0000", 2024-04-19T04:25:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4980000000000003e-06 2024-04-19T04:25:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181692+0000", 2024-04-19T04:25:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6180000000000003e-05 2024-04-19T04:25:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181906+0000", 2024-04-19T04:25:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021364600000000001 2024-04-19T04:25:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182018+0000", 2024-04-19T04:25:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011283 2024-04-19T04:25:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:44110 5.9 e33/20 5:9b567ae5:::benchmark_data_smithi007_19526_object44109:head v 33'2879, mlcod=33'2877)", 2024-04-19T04:25:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:03.181731+0000", 2024-04-19T04:25:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0025247289999999999, 2024-04-19T04:25:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026435450000000002, 2024-04-19T04:25:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181731+0000", 2024-04-19T04:25:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181731+0000", 2024-04-19T04:25:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181730+0000", 2024-04-19T04:25:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181813+0000", 2024-04-19T04:25:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2557000000000003e-05 2024-04-19T04:25:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181827+0000", 2024-04-19T04:25:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4574e-05 2024-04-19T04:25:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181835+0000", 2024-04-19T04:25:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5410000000000003e-06 2024-04-19T04:25:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181907+0000", 2024-04-19T04:25:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2432e-05 2024-04-19T04:25:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181928+0000", 2024-04-19T04:25:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0743000000000001e-05 2024-04-19T04:25:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:44123 5.b 5:d3821ffa:::benchmark_data_smithi007_19526_object44122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:03.181835+0000", 2024-04-19T04:25:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0024209449999999999, 2024-04-19T04:25:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026220620000000001, 2024-04-19T04:25:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 44123 2024-04-19T04:25:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181835+0000", 2024-04-19T04:25:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181835+0000", 2024-04-19T04:25:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181834+0000", 2024-04-19T04:25:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181908+0000", 2024-04-19T04:25:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3696999999999996e-05 2024-04-19T04:25:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181917+0000", 2024-04-19T04:25:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9050000000000003e-06 2024-04-19T04:25:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181924+0000", 2024-04-19T04:25:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8809999999999998e-06 2024-04-19T04:25:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.181996+0000", 2024-04-19T04:25:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2527999999999994e-05 2024-04-19T04:25:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182203+0000", 2024-04-19T04:25:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000206947 2024-04-19T04:25:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182417+0000", 2024-04-19T04:25:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000213477 2024-04-19T04:25:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:44120 5.a e33/20 5:5e2ae70d:::benchmark_data_smithi007_19526_object44119:head v 33'2792, mlcod=33'2790)", 2024-04-19T04:25:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:03.182163+0000", 2024-04-19T04:25:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0020924950000000002, 2024-04-19T04:25:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023592700000000001, 2024-04-19T04:25:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182163+0000", 2024-04-19T04:25:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182163+0000", 2024-04-19T04:25:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182163+0000", 2024-04-19T04:25:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182243+0000", 2024-04-19T04:25:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0152000000000001e-05 2024-04-19T04:25:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182252+0000", 2024-04-19T04:25:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0240000000000003e-06 2024-04-19T04:25:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182258+0000", 2024-04-19T04:25:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4559999999999997e-06 2024-04-19T04:25:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182313+0000", 2024-04-19T04:25:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4826e-05 2024-04-19T04:25:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182334+0000", 2024-04-19T04:25:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1143999999999999e-05 2024-04-19T04:25:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:44122 5.8 e33/29 5:1adda820:::benchmark_data_smithi007_19526_object44121:head v 33'2792, mlcod=33'2790)", 2024-04-19T04:25:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:03.182323+0000", 2024-04-19T04:25:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001933251, 2024-04-19T04:25:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022656349999999998, 2024-04-19T04:25:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182323+0000", 2024-04-19T04:25:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182323+0000", 2024-04-19T04:25:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182322+0000", 2024-04-19T04:25:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182384+0000", 2024-04-19T04:25:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1743999999999997e-05 2024-04-19T04:25:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182391+0000", 2024-04-19T04:25:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6140000000000003e-06 2024-04-19T04:25:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182397+0000", 2024-04-19T04:25:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2259999999999996e-06 2024-04-19T04:25:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182445+0000", 2024-04-19T04:25:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8052e-05 2024-04-19T04:25:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.182465+0000", 2024-04-19T04:25:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9862999999999999e-05 2024-04-19T04:25:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:44112 5.9 e33/20 5:9e35027c:::benchmark_data_smithi007_19526_object44111:head v 33'2880, mlcod=33'2877)", 2024-04-19T04:25:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:03.183811+0000", 2024-04-19T04:25:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.000444933, 2024-04-19T04:25:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00082002400000000004, 2024-04-19T04:25:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.183811+0000", 2024-04-19T04:25:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.183811+0000", 2024-04-19T04:25:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.183810+0000", 2024-04-19T04:25:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.183863+0000", 2024-04-19T04:25:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2969000000000001e-05 2024-04-19T04:25:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.183876+0000", 2024-04-19T04:25:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2819999999999999e-05 2024-04-19T04:25:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.183883+0000", 2024-04-19T04:25:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1570000000000003e-06 2024-04-19T04:25:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.183976+0000", 2024-04-19T04:25:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2674000000000001e-05 2024-04-19T04:25:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:03.183994+0000", 2024-04-19T04:25:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8929000000000001e-05 2024-04-19T04:25:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 6 2024-04-19T04:25:03.207 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:03.209 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:03.261 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:03.258+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:03.328 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:03.328 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:03.328 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:03.328 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:03.328 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:03.340 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:03.361 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:03.355+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:03.464 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:03.459+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:03.506 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:03.506 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:03.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:03.507 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:03.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.507 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:03.507 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539646+0000", 2024-04-19T04:25:03.507 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.964488734, 2024-04-19T04:25:03.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015767644000000001, 2024-04-19T04:25:03.507 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.507 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.507 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539646+0000", 2024-04-19T04:25:03.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539646+0000", 2024-04-19T04:25:03.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539645+0000", 2024-04-19T04:25:03.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:03.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539672+0000", 2024-04-19T04:25:03.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7036999999999999e-05 2024-04-19T04:25:03.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539691+0000", 2024-04-19T04:25:03.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8929000000000001e-05 2024-04-19T04:25:03.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539707+0000", 2024-04-19T04:25:03.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5979999999999999e-05 2024-04-19T04:25:03.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542292+0000", 2024-04-19T04:25:03.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025857020000000001 2024-04-19T04:25:03.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542472+0000", 2024-04-19T04:25:03.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018001599999999999 2024-04-19T04:25:03.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:03.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543505+0000", 2024-04-19T04:25:03.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010326739999999999 2024-04-19T04:25:03.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547314+0000", 2024-04-19T04:25:03.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038089349999999998 2024-04-19T04:25:03.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555323+0000", 2024-04-19T04:25:03.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080089979999999998 2024-04-19T04:25:03.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555378+0000", 2024-04-19T04:25:03.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4951999999999998e-05 2024-04-19T04:25:03.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555414+0000", 2024-04-19T04:25:03.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5998000000000003e-05 2024-04-19T04:25:03.512 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.512 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.512 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.512 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:03.512 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539729+0000", 2024-04-19T04:25:03.512 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.964405638999999, 2024-04-19T04:25:03.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015615043, 2024-04-19T04:25:03.513 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.513 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.513 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539729+0000", 2024-04-19T04:25:03.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539729+0000", 2024-04-19T04:25:03.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539728+0000", 2024-04-19T04:25:03.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:03.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539737+0000", 2024-04-19T04:25:03.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5799999999999992e-06 2024-04-19T04:25:03.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539753+0000", 2024-04-19T04:25:03.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6373000000000001e-05 2024-04-19T04:25:03.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539770+0000", 2024-04-19T04:25:03.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7516e-05 2024-04-19T04:25:03.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542136+0000", 2024-04-19T04:25:03.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023653440000000001 2024-04-19T04:25:03.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543783+0000", 2024-04-19T04:25:03.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016468209999999999 2024-04-19T04:25:03.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:03.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543971+0000", 2024-04-19T04:25:03.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018871200000000001 2024-04-19T04:25:03.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547318+0000", 2024-04-19T04:25:03.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033471199999999999 2024-04-19T04:25:03.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555276+0000", 2024-04-19T04:25:03.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079574280000000008 2024-04-19T04:25:03.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555320+0000", 2024-04-19T04:25:03.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3664000000000001e-05 2024-04-19T04:25:03.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555344+0000", 2024-04-19T04:25:03.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4905e-05 2024-04-19T04:25:03.518 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.518 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.518 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.518 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:03.518 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:25:03.518 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.964292075000003, 2024-04-19T04:25:03.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018096054, 2024-04-19T04:25:03.519 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.519 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.519 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:25:03.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:25:03.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539842+0000", 2024-04-19T04:25:03.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:03.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539848+0000", 2024-04-19T04:25:03.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-19T04:25:03.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539859+0000", 2024-04-19T04:25:03.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0783e-05 2024-04-19T04:25:03.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539866+0000", 2024-04-19T04:25:03.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9439999999999999e-06 2024-04-19T04:25:03.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547400+0000", 2024-04-19T04:25:03.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075343729999999996 2024-04-19T04:25:03.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547480+0000", 2024-04-19T04:25:03.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9793e-05 2024-04-19T04:25:03.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:03.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547587+0000", 2024-04-19T04:25:03.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107333 2024-04-19T04:25:03.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.548935+0000", 2024-04-19T04:25:03.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013480639999999999 2024-04-19T04:25:03.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557892+0000", 2024-04-19T04:25:03.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089563939999999995 2024-04-19T04:25:03.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557920+0000", 2024-04-19T04:25:03.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8342000000000001e-05 2024-04-19T04:25:03.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557939+0000", 2024-04-19T04:25:03.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9142000000000001e-05 2024-04-19T04:25:03.523 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.524 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.524 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.524 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:03.524 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:25:03.524 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.964215826999997, 2024-04-19T04:25:03.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018086631999999998, 2024-04-19T04:25:03.524 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.524 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.524 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:25:03.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:25:03.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539918+0000", 2024-04-19T04:25:03.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539931+0000", 2024-04-19T04:25:03.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2566e-05 2024-04-19T04:25:03.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539958+0000", 2024-04-19T04:25:03.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6582999999999999e-05 2024-04-19T04:25:03.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539972+0000", 2024-04-19T04:25:03.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4789e-05 2024-04-19T04:25:03.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547577+0000", 2024-04-19T04:25:03.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0076045979999999997 2024-04-19T04:25:03.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547769+0000", 2024-04-19T04:25:03.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000192034 2024-04-19T04:25:03.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:03.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547929+0000", 2024-04-19T04:25:03.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000159679 2024-04-19T04:25:03.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.548942+0000", 2024-04-19T04:25:03.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010138720000000001 2024-04-19T04:25:03.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557962+0000", 2024-04-19T04:25:03.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090199970000000001 2024-04-19T04:25:03.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557985+0000", 2024-04-19T04:25:03.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2623e-05 2024-04-19T04:25:03.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.558006+0000", 2024-04-19T04:25:03.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0764e-05 2024-04-19T04:25:03.529 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.529 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.529 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.529 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:27 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:03.529 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:25:03.529 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.964149839000001, 2024-04-19T04:25:03.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018047384, 2024-04-19T04:25:03.529 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.529 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:03.529 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:25:03.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:25:03.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539984+0000", 2024-04-19T04:25:03.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:03.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539991+0000", 2024-04-19T04:25:03.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7769999999999997e-06 2024-04-19T04:25:03.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540010+0000", 2024-04-19T04:25:03.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9573e-05 2024-04-19T04:25:03.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540025+0000", 2024-04-19T04:25:03.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4796e-05 2024-04-19T04:25:03.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541220+0000", 2024-04-19T04:25:03.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001195172 2024-04-19T04:25:03.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541569+0000", 2024-04-19T04:25:03.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00034836600000000002 2024-04-19T04:25:03.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.558033+0000", 2024-04-19T04:25:03.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.016464092999999999 2024-04-19T04:25:03.533 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.533 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.533 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.533 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:14827 5.8 5:17a0805e:::benchmark_data_smithi007_19526_object14826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T04:25:03.533 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:49.835039+0000", 2024-04-19T04:25:03.533 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.669095829, 2024-04-19T04:25:03.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015368504, 2024-04-19T04:25:03.533 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.533 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:03.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:03.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.533 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 14827 2024-04-19T04:25:03.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.534 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835039+0000", 2024-04-19T04:25:03.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835039+0000", 2024-04-19T04:25:03.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835038+0000", 2024-04-19T04:25:03.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835118+0000", 2024-04-19T04:25:03.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0253000000000006e-05 2024-04-19T04:25:03.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835134+0000", 2024-04-19T04:25:03.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5565000000000001e-05 2024-04-19T04:25:03.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.835145+0000", 2024-04-19T04:25:03.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1066e-05 2024-04-19T04:25:03.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.839716+0000", 2024-04-19T04:25:03.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045706610000000002 2024-04-19T04:25:03.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.839880+0000", 2024-04-19T04:25:03.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164272 2024-04-19T04:25:03.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:03.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.840064+0000", 2024-04-19T04:25:03.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018395999999999999 2024-04-19T04:25:03.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.842870+0000", 2024-04-19T04:25:03.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028064790000000002 2024-04-19T04:25:03.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.850315+0000", 2024-04-19T04:25:03.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074444639999999996 2024-04-19T04:25:03.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.850376+0000", 2024-04-19T04:25:03.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.088e-05 2024-04-19T04:25:03.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:49.850408+0000", 2024-04-19T04:25:03.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2013e-05 2024-04-19T04:25:03.538 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.539 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.539 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.539 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24310 5.0 5:07098fc4:::benchmark_data_smithi007_19526_object24309:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:03.539 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.471082+0000", 2024-04-19T04:25:03.539 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.033053014, 2024-04-19T04:25:03.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018533300999999999, 2024-04-19T04:25:03.539 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.539 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.539 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:03.539 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:03.539 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.539 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24310 2024-04-19T04:25:03.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.540 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.471082+0000", 2024-04-19T04:25:03.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.471082+0000", 2024-04-19T04:25:03.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.471081+0000", 2024-04-19T04:25:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472015+0000", 2024-04-19T04:25:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00093410800000000001 2024-04-19T04:25:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472027+0000", 2024-04-19T04:25:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1491000000000001e-05 2024-04-19T04:25:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472033+0000", 2024-04-19T04:25:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9499999999999998e-06 2024-04-19T04:25:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472087+0000", 2024-04-19T04:25:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4595999999999997e-05 2024-04-19T04:25:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472208+0000", 2024-04-19T04:25:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012105299999999999 2024-04-19T04:25:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.475540+0000", 2024-04-19T04:25:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033319310000000002 2024-04-19T04:25:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481479+0000", 2024-04-19T04:25:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059387440000000001 2024-04-19T04:25:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489528+0000", 2024-04-19T04:25:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080487739999999999 2024-04-19T04:25:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489578+0000", 2024-04-19T04:25:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0321999999999997e-05 2024-04-19T04:25:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489615+0000", 2024-04-19T04:25:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7425000000000002e-05 2024-04-19T04:25:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24318 5.0 5:09636443:::benchmark_data_smithi007_19526_object24317:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.472336+0000", 2024-04-19T04:25:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.031798985, 2024-04-19T04:25:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017477310999999999, 2024-04-19T04:25:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24318 2024-04-19T04:25:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472336+0000", 2024-04-19T04:25:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472336+0000", 2024-04-19T04:25:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472335+0000", 2024-04-19T04:25:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472373+0000", 2024-04-19T04:25:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7876999999999997e-05 2024-04-19T04:25:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472384+0000", 2024-04-19T04:25:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0513000000000001e-05 2024-04-19T04:25:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472391+0000", 2024-04-19T04:25:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6680000000000001e-06 2024-04-19T04:25:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.476649+0000", 2024-04-19T04:25:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004257172 2024-04-19T04:25:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.476767+0000", 2024-04-19T04:25:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118584 2024-04-19T04:25:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.476868+0000", 2024-04-19T04:25:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100912 2024-04-19T04:25:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481491+0000", 2024-04-19T04:25:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046224990000000004 2024-04-19T04:25:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489691+0000", 2024-04-19T04:25:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082007529999999999 2024-04-19T04:25:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489777+0000", 2024-04-19T04:25:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6174000000000005e-05 2024-04-19T04:25:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489813+0000", 2024-04-19T04:25:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.591e-05 2024-04-19T04:25:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24322 5.0 5:08733fec:::benchmark_data_smithi007_19526_object24321:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.474319+0000", 2024-04-19T04:25:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.029816445, 2024-04-19T04:25:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015646382, 2024-04-19T04:25:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24322 2024-04-19T04:25:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474319+0000", 2024-04-19T04:25:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474319+0000", 2024-04-19T04:25:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474318+0000", 2024-04-19T04:25:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474385+0000", 2024-04-19T04:25:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6892999999999998e-05 2024-04-19T04:25:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474405+0000", 2024-04-19T04:25:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9819000000000001e-05 2024-04-19T04:25:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474410+0000", 2024-04-19T04:25:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4990000000000002e-06 2024-04-19T04:25:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477692+0000", 2024-04-19T04:25:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032817570000000002 2024-04-19T04:25:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477802+0000", 2024-04-19T04:25:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0001102 2024-04-19T04:25:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477921+0000", 2024-04-19T04:25:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119159 2024-04-19T04:25:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481501+0000", 2024-04-19T04:25:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003579558 2024-04-19T04:25:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489889+0000", 2024-04-19T04:25:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083880570000000008 2024-04-19T04:25:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489937+0000", 2024-04-19T04:25:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8124000000000002e-05 2024-04-19T04:25:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489965+0000", 2024-04-19T04:25:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8085e-05 2024-04-19T04:25:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24332 5.0 5:0c25ea80:::benchmark_data_smithi007_19526_object24331:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.477492+0000", 2024-04-19T04:25:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.026642726, 2024-04-19T04:25:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015281972, 2024-04-19T04:25:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24332 2024-04-19T04:25:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477492+0000", 2024-04-19T04:25:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477492+0000", 2024-04-19T04:25:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477491+0000", 2024-04-19T04:25:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477537+0000", 2024-04-19T04:25:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5785999999999998e-05 2024-04-19T04:25:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477554+0000", 2024-04-19T04:25:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6906e-05 2024-04-19T04:25:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477563+0000", 2024-04-19T04:25:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4730000000000006e-06 2024-04-19T04:25:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.480049+0000", 2024-04-19T04:25:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024853319999999998 2024-04-19T04:25:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.480228+0000", 2024-04-19T04:25:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000179502 2024-04-19T04:25:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.480409+0000", 2024-04-19T04:25:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000181168 2024-04-19T04:25:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481997+0000", 2024-04-19T04:25:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015875349999999999 2024-04-19T04:25:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.492645+0000", 2024-04-19T04:25:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010647647 2024-04-19T04:25:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.492715+0000", 2024-04-19T04:25:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0537999999999994e-05 2024-04-19T04:25:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.492774+0000", 2024-04-19T04:25:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9132999999999998e-05 2024-04-19T04:25:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:25794 5.e 5:77ddc1c5:::benchmark_data_smithi007_19526_object25793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.073091+0000", 2024-04-19T04:25:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.4310444140000005, 2024-04-19T04:25:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017751818999999999, 2024-04-19T04:25:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 25794 2024-04-19T04:25:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073091+0000", 2024-04-19T04:25:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073091+0000", 2024-04-19T04:25:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073089+0000", 2024-04-19T04:25:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073146+0000", 2024-04-19T04:25:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6011000000000003e-05 2024-04-19T04:25:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073162+0000", 2024-04-19T04:25:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6949e-05 2024-04-19T04:25:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073174+0000", 2024-04-19T04:25:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1538e-05 2024-04-19T04:25:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073244+0000", 2024-04-19T04:25:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9715000000000006e-05 2024-04-19T04:25:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073463+0000", 2024-04-19T04:25:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021919999999999999 2024-04-19T04:25:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073580+0000", 2024-04-19T04:25:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000116727 2024-04-19T04:25:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.075752+0000", 2024-04-19T04:25:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021724819999999999 2024-04-19T04:25:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.090747+0000", 2024-04-19T04:25:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014995059 2024-04-19T04:25:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.090790+0000", 2024-04-19T04:25:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3244999999999997e-05 2024-04-19T04:25:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.090842+0000", 2024-04-19T04:25:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2052000000000002e-05 2024-04-19T04:25:03.567 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.567 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.567 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.567 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:03.567 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:03.567 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.2686043419999997, 2024-04-19T04:25:03.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:03.567 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.567 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.567 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:03.567 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:03.567 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.567 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:03.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.568 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:03.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:03.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:03.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:03.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:03.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:03.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:03.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:03.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:03.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:03.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:03.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:03.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:03.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:03.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:03.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:03.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:03.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:03.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:03.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:03.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:03.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:03.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:03.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:03.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:03.572 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.572 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.572 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.573 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:03.573 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:03.573 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.2641554260000003, 2024-04-19T04:25:03.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:03.573 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.573 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.573 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:03.573 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:03.573 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.573 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:03.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.573 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:03.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:03.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:03.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:03.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:03.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:03.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:03.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:03.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:03.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:03.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:03.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:03.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:03.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:03.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:03.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:03.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:03.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:03.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:03.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:03.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:03.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:03.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:03.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:03.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:03.578 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.578 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.578 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.578 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26218 5.e 5:71096b4b:::benchmark_data_smithi007_19526_object26217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:03.579 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.299744+0000", 2024-04-19T04:25:03.579 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.2043911989999998, 2024-04-19T04:25:03.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015765136999999999, 2024-04-19T04:25:03.579 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.579 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.579 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:03.579 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:03.579 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.579 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26218 2024-04-19T04:25:03.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.579 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299744+0000", 2024-04-19T04:25:03.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299744+0000", 2024-04-19T04:25:03.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299743+0000", 2024-04-19T04:25:03.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:03.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299818+0000", 2024-04-19T04:25:03.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5840000000000006e-05 2024-04-19T04:25:03.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299827+0000", 2024-04-19T04:25:03.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5499999999999995e-06 2024-04-19T04:25:03.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299832+0000", 2024-04-19T04:25:03.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3569999999999997e-06 2024-04-19T04:25:03.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.301136+0000", 2024-04-19T04:25:03.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013039900000000001 2024-04-19T04:25:03.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.301220+0000", 2024-04-19T04:25:03.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3220999999999995e-05 2024-04-19T04:25:03.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:03.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.301339+0000", 2024-04-19T04:25:03.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119358 2024-04-19T04:25:03.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.302912+0000", 2024-04-19T04:25:03.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015726659999999999 2024-04-19T04:25:03.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.315424+0000", 2024-04-19T04:25:03.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012512452 2024-04-19T04:25:03.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.315479+0000", 2024-04-19T04:25:03.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4732999999999999e-05 2024-04-19T04:25:03.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.315509+0000", 2024-04-19T04:25:03.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0260000000000002e-05 2024-04-19T04:25:03.584 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.584 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.584 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.584 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:28229 5.4 5:2ef4e134:::benchmark_data_smithi007_19526_object28228:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T04:25:03.584 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:55.108574+0000", 2024-04-19T04:25:03.584 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.3955607010000008, 2024-04-19T04:25:03.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015913132, 2024-04-19T04:25:03.584 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.585 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.585 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:03.585 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:03.585 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.585 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 28229 2024-04-19T04:25:03.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.585 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.108574+0000", 2024-04-19T04:25:03.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.108574+0000", 2024-04-19T04:25:03.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.108573+0000", 2024-04-19T04:25:03.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.108608+0000", 2024-04-19T04:25:03.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4468999999999998e-05 2024-04-19T04:25:03.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.108631+0000", 2024-04-19T04:25:03.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2928000000000001e-05 2024-04-19T04:25:03.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.108637+0000", 2024-04-19T04:25:03.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3080000000000004e-06 2024-04-19T04:25:03.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.111112+0000", 2024-04-19T04:25:03.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024749619999999998 2024-04-19T04:25:03.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.111260+0000", 2024-04-19T04:25:03.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000147885 2024-04-19T04:25:03.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:03.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.111348+0000", 2024-04-19T04:25:03.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8392000000000003e-05 2024-04-19T04:25:03.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.112602+0000", 2024-04-19T04:25:03.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001253348 2024-04-19T04:25:03.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.124401+0000", 2024-04-19T04:25:03.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011799047999999999 2024-04-19T04:25:03.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.124452+0000", 2024-04-19T04:25:03.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0946999999999999e-05 2024-04-19T04:25:03.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.124488+0000", 2024-04-19T04:25:03.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5750000000000002e-05 2024-04-19T04:25:03.589 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.590 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.590 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.590 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:29056 5.e 5:79c0dac4:::benchmark_data_smithi007_19526_object29055:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T04:25:03.590 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:55.454750+0000", 2024-04-19T04:25:03.590 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.0493851379999999, 2024-04-19T04:25:03.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015326128, 2024-04-19T04:25:03.590 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.590 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.590 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:03.590 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:03.590 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.590 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 29056 2024-04-19T04:25:03.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.591 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.454750+0000", 2024-04-19T04:25:03.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.454750+0000", 2024-04-19T04:25:03.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.454749+0000", 2024-04-19T04:25:03.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:03.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.454823+0000", 2024-04-19T04:25:03.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3337999999999995e-05 2024-04-19T04:25:03.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.454831+0000", 2024-04-19T04:25:03.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3599999999999996e-06 2024-04-19T04:25:03.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.454838+0000", 2024-04-19T04:25:03.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7630000000000003e-06 2024-04-19T04:25:03.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.454887+0000", 2024-04-19T04:25:03.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9008000000000002e-05 2024-04-19T04:25:03.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.455031+0000", 2024-04-19T04:25:03.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144182 2024-04-19T04:25:03.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:03.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.455227+0000", 2024-04-19T04:25:03.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019652299999999999 2024-04-19T04:25:03.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.458288+0000", 2024-04-19T04:25:03.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030609320000000001 2024-04-19T04:25:03.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.469992+0000", 2024-04-19T04:25:03.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011704057 2024-04-19T04:25:03.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.470042+0000", 2024-04-19T04:25:03.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9576000000000001e-05 2024-04-19T04:25:03.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.470076+0000", 2024-04-19T04:25:03.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4065e-05 2024-04-19T04:25:03.595 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.595 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.595 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.596 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:35062 5.0 5:0b09a143:::benchmark_data_smithi007_19526_object35061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:25:03.596 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:58.997863+0000", 2024-04-19T04:25:03.596 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.5062718659999996, 2024-04-19T04:25:03.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.016912940000000001, 2024-04-19T04:25:03.596 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.596 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.596 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:03.596 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:03.596 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.596 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35062 2024-04-19T04:25:03.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.596 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997863+0000", 2024-04-19T04:25:03.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997863+0000", 2024-04-19T04:25:03.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997862+0000", 2024-04-19T04:25:03.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997919+0000", 2024-04-19T04:25:03.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7045e-05 2024-04-19T04:25:03.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997931+0000", 2024-04-19T04:25:03.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1989e-05 2024-04-19T04:25:03.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997939+0000", 2024-04-19T04:25:03.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9740000000000002e-06 2024-04-19T04:25:03.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997976+0000", 2024-04-19T04:25:03.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7138999999999998e-05 2024-04-19T04:25:03.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.998076+0000", 2024-04-19T04:25:03.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010001900000000001 2024-04-19T04:25:03.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:03.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.998171+0000", 2024-04-19T04:25:03.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4724999999999999e-05 2024-04-19T04:25:03.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.002805+0000", 2024-04-19T04:25:03.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046342279999999998 2024-04-19T04:25:03.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.014484+0000", 2024-04-19T04:25:03.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011678609 2024-04-19T04:25:03.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.014737+0000", 2024-04-19T04:25:03.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025272800000000002 2024-04-19T04:25:03.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.014776+0000", 2024-04-19T04:25:03.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9539000000000002e-05 2024-04-19T04:25:03.601 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.601 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.601 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.601 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:36968 5.0 5:088937f8:::benchmark_data_smithi007_19526_object36967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:25:03.601 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:59.838557+0000", 2024-04-19T04:25:03.601 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.665577576, 2024-04-19T04:25:03.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015472301000000001, 2024-04-19T04:25:03.601 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.601 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.602 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:03.602 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:03.602 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.602 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 36968 2024-04-19T04:25:03.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.602 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838557+0000", 2024-04-19T04:25:03.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838557+0000", 2024-04-19T04:25:03.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838556+0000", 2024-04-19T04:25:03.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838603+0000", 2024-04-19T04:25:03.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6476e-05 2024-04-19T04:25:03.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838616+0000", 2024-04-19T04:25:03.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2994e-05 2024-04-19T04:25:03.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838626+0000", 2024-04-19T04:25:03.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0299000000000001e-05 2024-04-19T04:25:03.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.841489+0000", 2024-04-19T04:25:03.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028627240000000001 2024-04-19T04:25:03.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.841728+0000", 2024-04-19T04:25:03.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023904199999999999 2024-04-19T04:25:03.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:03.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.841954+0000", 2024-04-19T04:25:03.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022577400000000001 2024-04-19T04:25:03.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.846360+0000", 2024-04-19T04:25:03.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004405862 2024-04-19T04:25:03.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.853938+0000", 2024-04-19T04:25:03.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075784010000000002 2024-04-19T04:25:03.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.853976+0000", 2024-04-19T04:25:03.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8411000000000002e-05 2024-04-19T04:25:03.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.854030+0000", 2024-04-19T04:25:03.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3369999999999999e-05 2024-04-19T04:25:03.606 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.606 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.607 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.607 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:36969 5.0 5:07a2d04d:::benchmark_data_smithi007_19526_object36968:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:25:03.607 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:59.838646+0000", 2024-04-19T04:25:03.607 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.6654892800000001, 2024-04-19T04:25:03.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019867078999999999, 2024-04-19T04:25:03.607 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.607 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.607 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:03.607 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:03.607 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.607 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 36969 2024-04-19T04:25:03.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.608 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838646+0000", 2024-04-19T04:25:03.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838646+0000", 2024-04-19T04:25:03.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838645+0000", 2024-04-19T04:25:03.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838725+0000", 2024-04-19T04:25:03.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0295000000000003e-05 2024-04-19T04:25:03.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838734+0000", 2024-04-19T04:25:03.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6319999999999997e-06 2024-04-19T04:25:03.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838739+0000", 2024-04-19T04:25:03.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4249999999999997e-06 2024-04-19T04:25:03.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.843505+0000", 2024-04-19T04:25:03.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047651689999999997 2024-04-19T04:25:03.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.843611+0000", 2024-04-19T04:25:03.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010608899999999999 2024-04-19T04:25:03.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:03.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.843699+0000", 2024-04-19T04:25:03.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7841000000000001e-05 2024-04-19T04:25:03.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.846376+0000", 2024-04-19T04:25:03.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002677867 2024-04-19T04:25:03.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.858355+0000", 2024-04-19T04:25:03.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011978999000000001 2024-04-19T04:25:03.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.858443+0000", 2024-04-19T04:25:03.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7243000000000005e-05 2024-04-19T04:25:03.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.858513+0000", 2024-04-19T04:25:03.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0235999999999996e-05 2024-04-19T04:25:03.612 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.612 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.612 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.612 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:43351 5.0 5:0f5ecfc6:::benchmark_data_smithi007_19526_object43350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:03.612 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:02.801106+0000", 2024-04-19T04:25:03.612 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.70302898199999997, 2024-04-19T04:25:03.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021198346999999999, 2024-04-19T04:25:03.613 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:03.613 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:03.613 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:03.613 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:03.613 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.613 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 43351 2024-04-19T04:25:03.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.613 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:03.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:03.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801106+0000", 2024-04-19T04:25:03.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:03.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801106+0000", 2024-04-19T04:25:03.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:03.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:03.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801105+0000", 2024-04-19T04:25:03.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:03.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:03.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801159+0000", 2024-04-19T04:25:03.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4181999999999997e-05 2024-04-19T04:25:03.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:03.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801174+0000", 2024-04-19T04:25:03.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5021000000000001e-05 2024-04-19T04:25:03.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801182+0000", 2024-04-19T04:25:03.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7649999999999993e-06 2024-04-19T04:25:03.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:03.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.809365+0000", 2024-04-19T04:25:03.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081836159999999995 2024-04-19T04:25:03.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:03.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.809463+0000", 2024-04-19T04:25:03.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7486999999999997e-05 2024-04-19T04:25:03.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:03.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.809549+0000", 2024-04-19T04:25:03.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5729999999999994e-05 2024-04-19T04:25:03.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:03.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.814132+0000", 2024-04-19T04:25:03.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045836039999999998 2024-04-19T04:25:03.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.822206+0000", 2024-04-19T04:25:03.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080738500000000005 2024-04-19T04:25:03.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:03.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.822255+0000", 2024-04-19T04:25:03.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8730000000000003e-05 2024-04-19T04:25:03.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:03.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:03.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:03.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.822304+0000", 2024-04-19T04:25:03.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.973e-05 2024-04-19T04:25:03.618 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.618 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.618 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.618 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:03.618 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:03.618 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:03.620 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:03.618+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:03.620 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:03.720 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:03.715+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:03.752 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 19 16 45303 45287 148.953 128 0.00648464 0.00670715 2024-04-19T04:25:03.753 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:03.753 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:03.753 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.753 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:45293 5.9 5:98c8eb65:::benchmark_data_smithi007_19526_object45292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:03.753 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:03.748859+0000", 2024-04-19T04:25:03.754 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0044864780000000003, 2024-04-19T04:25:03.754 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0045223829999999996, 2024-04-19T04:25:03.754 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:03.754 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:03.754 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:03.754 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:03.754 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.754 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 45293 2024-04-19T04:25:03.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.754 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:03.754 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.754 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:03.755 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.748859+0000", 2024-04-19T04:25:03.755 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:03.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.755 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:03.755 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.748859+0000", 2024-04-19T04:25:03.755 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:03.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.755 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:03.755 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.748858+0000", 2024-04-19T04:25:03.755 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.756 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:03.756 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.748959+0000", 2024-04-19T04:25:03.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000100598 2024-04-19T04:25:03.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.756 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:03.756 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.748967+0000", 2024-04-19T04:25:03.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3469999999999999e-06 2024-04-19T04:25:03.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.756 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.756 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.748972+0000", 2024-04-19T04:25:03.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2719999999999997e-06 2024-04-19T04:25:03.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.757 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.757 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:03.757 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.749033+0000", 2024-04-19T04:25:03.757 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0284000000000001e-05 2024-04-19T04:25:03.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.757 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.757 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:03.757 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.749208+0000", 2024-04-19T04:25:03.757 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000175045 2024-04-19T04:25:03.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.757 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.757 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:03.757 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.749388+0000", 2024-04-19T04:25:03.757 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017985500000000001 2024-04-19T04:25:03.758 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:03.758 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:03.758 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:03.758 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.758 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.758 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:45295 5.2 5:4a104831:::benchmark_data_smithi007_19526_object45294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:03.758 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:03.751205+0000", 2024-04-19T04:25:03.758 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.002141006, 2024-04-19T04:25:03.758 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0022934880000000002, 2024-04-19T04:25:03.758 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:03.758 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:03.758 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:03.759 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:03.759 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.759 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 45295 2024-04-19T04:25:03.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.759 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:03.759 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.759 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:03.759 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751205+0000", 2024-04-19T04:25:03.759 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:03.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.759 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.759 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:03.759 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751205+0000", 2024-04-19T04:25:03.759 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:03.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.760 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.760 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:03.760 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751204+0000", 2024-04-19T04:25:03.760 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.760 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.760 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.760 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:03.760 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751256+0000", 2024-04-19T04:25:03.760 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2286e-05 2024-04-19T04:25:03.760 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.760 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.760 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:03.760 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751275+0000", 2024-04-19T04:25:03.760 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.914e-05 2024-04-19T04:25:03.761 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.761 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.761 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751284+0000", 2024-04-19T04:25:03.761 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5799999999999992e-06 2024-04-19T04:25:03.761 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.761 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:03.761 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751350+0000", 2024-04-19T04:25:03.761 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6649000000000005e-05 2024-04-19T04:25:03.761 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.761 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:03.761 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751538+0000", 2024-04-19T04:25:03.762 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000187558 2024-04-19T04:25:03.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.762 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.762 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:03.762 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751721+0000", 2024-04-19T04:25:03.762 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000183117 2024-04-19T04:25:03.762 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:03.762 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:03.762 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:03.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.762 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.762 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:45298 5.9 5:9e7d3a44:::benchmark_data_smithi007_19526_object45297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:03.762 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:03.751340+0000", 2024-04-19T04:25:03.762 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0020054560000000001, 2024-04-19T04:25:03.763 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0022699650000000001, 2024-04-19T04:25:03.763 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:03.763 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:03.763 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:03.763 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:03.763 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.763 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 45298 2024-04-19T04:25:03.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.763 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:03.763 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.763 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:03.763 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751340+0000", 2024-04-19T04:25:03.763 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:03.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.763 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.764 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:03.764 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751340+0000", 2024-04-19T04:25:03.764 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:03.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.764 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.764 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:03.764 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751339+0000", 2024-04-19T04:25:03.764 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.764 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.764 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:03.764 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751397+0000", 2024-04-19T04:25:03.764 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7839e-05 2024-04-19T04:25:03.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.764 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.765 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:03.765 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751405+0000", 2024-04-19T04:25:03.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5449999999999998e-06 2024-04-19T04:25:03.765 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.765 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.765 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.765 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751410+0000", 2024-04-19T04:25:03.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.079e-06 2024-04-19T04:25:03.765 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.765 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.765 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:03.765 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751453+0000", 2024-04-19T04:25:03.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2901999999999997e-05 2024-04-19T04:25:03.765 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.766 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.766 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:03.766 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751557+0000", 2024-04-19T04:25:03.766 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010393800000000001 2024-04-19T04:25:03.766 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.766 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.766 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:03.766 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751645+0000", 2024-04-19T04:25:03.766 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.8814999999999996e-05 2024-04-19T04:25:03.766 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:03.766 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:03.766 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:03.766 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.766 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.767 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:45299 5.7 5:e5c31771:::benchmark_data_smithi007_19526_object45298:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:03.767 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:03.751456+0000", 2024-04-19T04:25:03.767 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0018898669999999999, 2024-04-19T04:25:03.767 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0022669130000000002, 2024-04-19T04:25:03.767 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:03.767 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:03.767 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:03.767 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:03.767 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.767 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 45299 2024-04-19T04:25:03.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.767 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:03.767 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.767 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:03.768 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751456+0000", 2024-04-19T04:25:03.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:03.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.768 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:03.768 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751456+0000", 2024-04-19T04:25:03.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:03.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.768 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:03.768 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751455+0000", 2024-04-19T04:25:03.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.768 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:03.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751512+0000", 2024-04-19T04:25:03.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6960999999999999e-05 2024-04-19T04:25:03.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.769 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:03.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751519+0000", 2024-04-19T04:25:03.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.515e-06 2024-04-19T04:25:03.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.769 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751523+0000", 2024-04-19T04:25:03.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9689999999999996e-06 2024-04-19T04:25:03.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.770 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:03.770 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751557+0000", 2024-04-19T04:25:03.770 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.3997e-05 2024-04-19T04:25:03.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.770 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.770 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:03.770 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751661+0000", 2024-04-19T04:25:03.770 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000103602 2024-04-19T04:25:03.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.770 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.770 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:03.770 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751802+0000", 2024-04-19T04:25:03.770 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000140968 2024-04-19T04:25:03.770 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:03.771 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:03.771 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:03.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.771 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.771 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:45300 5.f 5:fb03fc2b:::benchmark_data_smithi007_19526_object45299:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:03.771 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:03.751626+0000", 2024-04-19T04:25:03.771 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0017197580000000001, 2024-04-19T04:25:03.771 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002201396, 2024-04-19T04:25:03.771 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:03.771 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:03.771 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:03.771 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:03.771 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.771 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 45300 2024-04-19T04:25:03.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.772 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:03.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.772 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:03.772 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751626+0000", 2024-04-19T04:25:03.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:03.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.772 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:03.772 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751626+0000", 2024-04-19T04:25:03.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:03.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.772 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:03.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751625+0000", 2024-04-19T04:25:03.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:03.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751722+0000", 2024-04-19T04:25:03.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.6815000000000001e-05 2024-04-19T04:25:03.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:03.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751732+0000", 2024-04-19T04:25:03.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.008e-05 2024-04-19T04:25:03.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.774 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751739+0000", 2024-04-19T04:25:03.774 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4830000000000002e-06 2024-04-19T04:25:03.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.774 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.774 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:03.774 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751781+0000", 2024-04-19T04:25:03.774 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2166999999999998e-05 2024-04-19T04:25:03.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.774 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.774 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:03.774 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751913+0000", 2024-04-19T04:25:03.774 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000131342 2024-04-19T04:25:03.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.775 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:03.775 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.752044+0000", 2024-04-19T04:25:03.775 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013155799999999999 2024-04-19T04:25:03.775 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:03.775 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:03.775 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:03.775 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.775 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:45301 5.3 e33/20 5:c066319c:::benchmark_data_smithi007_19526_object45300:head v 33'2786, mlcod=33'2783)", 2024-04-19T04:25:03.775 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:03.753097+0000", 2024-04-19T04:25:03.775 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00024885899999999998, 2024-04-19T04:25:03.775 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00084438000000000004, 2024-04-19T04:25:03.775 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:03.775 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:03.776 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:03.776 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.776 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:03.776 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.753097+0000", 2024-04-19T04:25:03.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:03.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.776 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.776 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:03.776 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.753097+0000", 2024-04-19T04:25:03.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:03.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.776 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.776 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:03.776 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.753096+0000", 2024-04-19T04:25:03.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:03.777 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.753130+0000", 2024-04-19T04:25:03.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4425999999999999e-05 2024-04-19T04:25:03.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:03.777 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.753141+0000", 2024-04-19T04:25:03.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0156999999999999e-05 2024-04-19T04:25:03.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.777 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.753171+0000", 2024-04-19T04:25:03.778 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.0599000000000003e-05 2024-04-19T04:25:03.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.778 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.778 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:03.778 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.753232+0000", 2024-04-19T04:25:03.778 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0613999999999999e-05 2024-04-19T04:25:03.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.778 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.778 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:03.778 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.753345+0000", 2024-04-19T04:25:03.778 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113602 2024-04-19T04:25:03.778 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:03.778 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:03.778 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:03.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.779 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.779 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:45289 5.2 5:4ec1bcef:::benchmark_data_smithi007_19526_object45288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:03.779 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:03.746139+0000", 2024-04-19T04:25:03.779 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0072066220000000002, 2024-04-19T04:25:03.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0078808239999999998, 2024-04-19T04:25:03.779 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:03.779 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:03.779 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:03.779 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:03.779 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:03.779 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 45289 2024-04-19T04:25:03.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.779 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:03.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:03.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.746139+0000", 2024-04-19T04:25:03.780 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:03.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:03.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.746139+0000", 2024-04-19T04:25:03.780 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:03.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:03.781 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.746138+0000", 2024-04-19T04:25:03.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:03.781 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.746175+0000", 2024-04-19T04:25:03.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6845999999999999e-05 2024-04-19T04:25:03.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:03.781 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.746184+0000", 2024-04-19T04:25:03.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6829999999999997e-06 2024-04-19T04:25:03.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.782 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.746190+0000", 2024-04-19T04:25:03.782 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3990000000000001e-06 2024-04-19T04:25:03.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.782 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.782 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:03.782 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.748213+0000", 2024-04-19T04:25:03.782 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020226810000000001 2024-04-19T04:25:03.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.782 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.782 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:03.782 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.748356+0000", 2024-04-19T04:25:03.782 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014368900000000001 2024-04-19T04:25:03.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.782 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.783 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:03.783 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.748510+0000", 2024-04-19T04:25:03.783 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153652 2024-04-19T04:25:03.783 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.783 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.783 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:03.783 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.751316+0000", 2024-04-19T04:25:03.783 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002806069 2024-04-19T04:25:03.783 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.783 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.783 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:03.783 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.753955+0000", 2024-04-19T04:25:03.783 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002638545 2024-04-19T04:25:03.783 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:03.784 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:03.784 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:03.784 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.784 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.784 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:45292 5.3 e33/20 5:c938383c:::benchmark_data_smithi007_19526_object45291:head v 33'2785, mlcod=33'2782)", 2024-04-19T04:25:03.784 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:03.748160+0000", 2024-04-19T04:25:03.784 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0051855019999999998, 2024-04-19T04:25:03.784 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0059282370000000003, 2024-04-19T04:25:03.784 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:03.784 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:03.784 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:03.784 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.784 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:03.784 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.748160+0000", 2024-04-19T04:25:03.784 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:03.785 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.785 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.785 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:03.785 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.748160+0000", 2024-04-19T04:25:03.785 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:03.785 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.785 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.785 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:03.785 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.748159+0000", 2024-04-19T04:25:03.785 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:03.785 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.785 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.785 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:03.785 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.748217+0000", 2024-04-19T04:25:03.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7658999999999998e-05 2024-04-19T04:25:03.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.786 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:03.786 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.748229+0000", 2024-04-19T04:25:03.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1883e-05 2024-04-19T04:25:03.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.786 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:03.786 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.748237+0000", 2024-04-19T04:25:03.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1559999999999995e-06 2024-04-19T04:25:03.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.786 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:03.787 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.748287+0000", 2024-04-19T04:25:03.787 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9672999999999997e-05 2024-04-19T04:25:03.787 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:03.787 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:03.787 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:03.787 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:03.748312+0000", 2024-04-19T04:25:03.787 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5429999999999999e-05 2024-04-19T04:25:03.787 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:03.787 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:03.787 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:03.787 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:03.787 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:03.787 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 8 2024-04-19T04:25:03.787 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:03.789 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-04-19T04:25:03.789 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:03.821 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:03.818+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:03.922 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:03.918+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:03.925 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:03.925 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:03.925 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:03.925 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:03.925 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:03.939 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:04.023 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:04.019+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:04.068 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:04.068 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:04.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:04.068 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:04.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.068 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:04.068 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:25:04.068 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.533227076999999, 2024-04-19T04:25:04.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026801078999999998, 2024-04-19T04:25:04.069 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.069 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:04.069 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:25:04.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:25:04.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.070 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.070 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533733+0000", 2024-04-19T04:25:04.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999976 2024-04-19T04:25:04.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.070 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.070 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533746+0000", 2024-04-19T04:25:04.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2679e-05 2024-04-19T04:25:04.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.070 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.070 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533769+0000", 2024-04-19T04:25:04.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2832000000000001e-05 2024-04-19T04:25:04.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:25:04.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0599999999999999e-05 2024-04-19T04:25:04.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533907+0000", 2024-04-19T04:25:04.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000118076 2024-04-19T04:25:04.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:25:04.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533919+0000", 2024-04-19T04:25:04.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1644999999999999e-05 2024-04-19T04:25:04.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553399+0000", 2024-04-19T04:25:04.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019479987000000001 2024-04-19T04:25:04.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553535+0000", 2024-04-19T04:25:04.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553400000000001 2024-04-19T04:25:04.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:04.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553696+0000", 2024-04-19T04:25:04.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000161068 2024-04-19T04:25:04.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:04.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558096+0000", 2024-04-19T04:25:04.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0043998880000000002 2024-04-19T04:25:04.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:04.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560465+0000", 2024-04-19T04:25:04.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023695159999999999 2024-04-19T04:25:04.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:04.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560513+0000", 2024-04-19T04:25:04.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7899000000000003e-05 2024-04-19T04:25:04.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560537+0000", 2024-04-19T04:25:04.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3768e-05 2024-04-19T04:25:04.074 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.074 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.074 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.074 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:04.074 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:04.074 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.533150003000003, 2024-04-19T04:25:04.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026864505, 2024-04-19T04:25:04.075 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.075 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:04.075 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:04.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:04.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.076 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.076 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533812+0000", 2024-04-19T04:25:04.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.076 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.076 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533818+0000", 2024-04-19T04:25:04.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2369999999999997e-06 2024-04-19T04:25:04.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.076 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.076 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533863+0000", 2024-04-19T04:25:04.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4515000000000003e-05 2024-04-19T04:25:04.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533880+0000", 2024-04-19T04:25:04.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7119e-05 2024-04-19T04:25:04.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534029+0000", 2024-04-19T04:25:04.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014955099999999999 2024-04-19T04:25:04.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:04.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534034+0000", 2024-04-19T04:25:04.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1649999999999997e-06 2024-04-19T04:25:04.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554888+0000", 2024-04-19T04:25:04.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020854075 2024-04-19T04:25:04.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554967+0000", 2024-04-19T04:25:04.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8209999999999998e-05 2024-04-19T04:25:04.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:04.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555087+0000", 2024-04-19T04:25:04.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000120411 2024-04-19T04:25:04.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:04.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559328+0000", 2024-04-19T04:25:04.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042409800000000001 2024-04-19T04:25:04.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:04.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560587+0000", 2024-04-19T04:25:04.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012587119999999999 2024-04-19T04:25:04.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:04.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560620+0000", 2024-04-19T04:25:04.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2716999999999999e-05 2024-04-19T04:25:04.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560677+0000", 2024-04-19T04:25:04.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7726999999999998e-05 2024-04-19T04:25:04.080 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.080 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.080 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.081 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:04.081 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:04.081 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.533067610000003, 2024-04-19T04:25:04.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027363064999999999, 2024-04-19T04:25:04.082 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.082 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:04.082 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.082 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.082 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.082 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:04.082 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.082 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.082 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.082 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.082 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:04.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533894+0000", 2024-04-19T04:25:04.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:04.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533913+0000", 2024-04-19T04:25:04.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8896e-05 2024-04-19T04:25:04.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533933+0000", 2024-04-19T04:25:04.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9775e-05 2024-04-19T04:25:04.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533967+0000", 2024-04-19T04:25:04.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4536000000000003e-05 2024-04-19T04:25:04.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:04.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553600000000001 2024-04-19T04:25:04.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:04.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534107+0000", 2024-04-19T04:25:04.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1470000000000003e-06 2024-04-19T04:25:04.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556463+0000", 2024-04-19T04:25:04.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022356536999999999 2024-04-19T04:25:04.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.086 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.086 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556586+0000", 2024-04-19T04:25:04.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122967 2024-04-19T04:25:04.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.086 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:04.086 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556738+0000", 2024-04-19T04:25:04.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015182800000000001 2024-04-19T04:25:04.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:04.087 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561020+0000", 2024-04-19T04:25:04.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042818819999999999 2024-04-19T04:25:04.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:04.087 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561183+0000", 2024-04-19T04:25:04.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000162683 2024-04-19T04:25:04.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:04.087 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561226+0000", 2024-04-19T04:25:04.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3686000000000002e-05 2024-04-19T04:25:04.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561258+0000", 2024-04-19T04:25:04.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1814999999999999e-05 2024-04-19T04:25:04.088 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.088 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.088 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.088 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:04.089 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:04.089 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.532977097, 2024-04-19T04:25:04.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027417816000000001, 2024-04-19T04:25:04.089 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.089 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:04.089 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:04.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.090 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:04.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.090 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533984+0000", 2024-04-19T04:25:04.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:04.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.090 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:25:04.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3876000000000001e-05 2024-04-19T04:25:04.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.091 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534015+0000", 2024-04-19T04:25:04.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6818999999999999e-05 2024-04-19T04:25:04.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.091 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534030+0000", 2024-04-19T04:25:04.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.537e-05 2024-04-19T04:25:04.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.092 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.092 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534152+0000", 2024-04-19T04:25:04.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121685 2024-04-19T04:25:04.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.092 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:04.092 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534156+0000", 2024-04-19T04:25:04.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9029999999999997e-06 2024-04-19T04:25:04.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557520+0000", 2024-04-19T04:25:04.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023364125999999999 2024-04-19T04:25:04.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557585+0000", 2024-04-19T04:25:04.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5275000000000001e-05 2024-04-19T04:25:04.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:04.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557719+0000", 2024-04-19T04:25:04.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013396299999999999 2024-04-19T04:25:04.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:04.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561133+0000", 2024-04-19T04:25:04.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034140989999999999 2024-04-19T04:25:04.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:04.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561352+0000", 2024-04-19T04:25:04.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0002185 2024-04-19T04:25:04.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:04.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561380+0000", 2024-04-19T04:25:04.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8317999999999999e-05 2024-04-19T04:25:04.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561403+0000", 2024-04-19T04:25:04.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3264999999999998e-05 2024-04-19T04:25:04.095 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.096 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.096 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.096 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:04.096 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:04.096 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.532913452000003, 2024-04-19T04:25:04.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029897119999999999, 2024-04-19T04:25:04.096 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.096 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:04.096 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:04.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:04.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534048+0000", 2024-04-19T04:25:04.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534057+0000", 2024-04-19T04:25:04.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7930000000000003e-06 2024-04-19T04:25:04.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534075+0000", 2024-04-19T04:25:04.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7846000000000002e-05 2024-04-19T04:25:04.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534089+0000", 2024-04-19T04:25:04.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4463e-05 2024-04-19T04:25:04.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534198+0000", 2024-04-19T04:25:04.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109145 2024-04-19T04:25:04.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:04.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534202+0000", 2024-04-19T04:25:04.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.98e-06 2024-04-19T04:25:04.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558221+0000", 2024-04-19T04:25:04.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024018208999999999 2024-04-19T04:25:04.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558320+0000", 2024-04-19T04:25:04.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9642000000000006e-05 2024-04-19T04:25:04.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:04.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558401+0000", 2024-04-19T04:25:04.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1038000000000006e-05 2024-04-19T04:25:04.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:04.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561173+0000", 2024-04-19T04:25:04.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027714549999999999 2024-04-19T04:25:04.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:04.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563851+0000", 2024-04-19T04:25:04.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026786010000000001 2024-04-19T04:25:04.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:04.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563906+0000", 2024-04-19T04:25:04.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4895999999999998e-05 2024-04-19T04:25:04.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563946+0000", 2024-04-19T04:25:04.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0116e-05 2024-04-19T04:25:04.102 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.102 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.102 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.103 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:04.103 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:04.103 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.532860071000002, 2024-04-19T04:25:04.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029917846000000001, 2024-04-19T04:25:04.103 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.103 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:04.103 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:04.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:04.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534101+0000", 2024-04-19T04:25:04.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:04.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534111+0000", 2024-04-19T04:25:04.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5659999999999996e-06 2024-04-19T04:25:04.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534129+0000", 2024-04-19T04:25:04.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7632999999999999e-05 2024-04-19T04:25:04.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534143+0000", 2024-04-19T04:25:04.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4362000000000001e-05 2024-04-19T04:25:04.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534256+0000", 2024-04-19T04:25:04.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113267 2024-04-19T04:25:04.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:04.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534260+0000", 2024-04-19T04:25:04.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9949999999999999e-06 2024-04-19T04:25:04.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558653+0000", 2024-04-19T04:25:04.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024393182999999999 2024-04-19T04:25:04.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558704+0000", 2024-04-19T04:25:04.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0303999999999998e-05 2024-04-19T04:25:04.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.107 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:04.107 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558782+0000", 2024-04-19T04:25:04.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8079999999999998e-05 2024-04-19T04:25:04.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.107 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:04.107 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561309+0000", 2024-04-19T04:25:04.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002527708 2024-04-19T04:25:04.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:04.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563952+0000", 2024-04-19T04:25:04.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026425450000000001 2024-04-19T04:25:04.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:04.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563996+0000", 2024-04-19T04:25:04.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3606000000000002e-05 2024-04-19T04:25:04.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564021+0000", 2024-04-19T04:25:04.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.491e-05 2024-04-19T04:25:04.109 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.109 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.109 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.109 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:04.109 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:04.109 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.532807560000002, 2024-04-19T04:25:04.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:25:04.109 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.110 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:04.110 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:04.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:04.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:25:04.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:25:04.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:25:04.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.112 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.112 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:25:04.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:25:04.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.112 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.112 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:25:04.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:25:04.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.112 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:25:04.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:25:04.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.113 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.113 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:04.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:25:04.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:25:04.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.113 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.113 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:25:04.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:25:04.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:25:04.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:25:04.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:04.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:25:04.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:25:04.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:04.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:25:04.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:25:04.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:04.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:25:04.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:25:04.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:04.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:25:04.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:25:04.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.116 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:25:04.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:25:04.116 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.116 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.116 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.116 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:04.116 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:04.116 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.532753014999997, 2024-04-19T04:25:04.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:25:04.116 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.117 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:04.117 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.117 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:04.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.117 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:04.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:25:04.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:25:04.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:25:04.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:25:04.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:25:04.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:25:04.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:25:04.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:25:04.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:25:04.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:04.120 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:25:04.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:25:04.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.120 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:25:04.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:25:04.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:25:04.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:25:04.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:04.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:25:04.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:25:04.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:04.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:25:04.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:25:04.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:04.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:25:04.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:25:04.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:04.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:25:04.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:25:04.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:25:04.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:25:04.123 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.123 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.123 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.123 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:04.123 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:04.123 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.8354384289999999, 2024-04-19T04:25:04.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:04.124 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.124 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:04.124 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:04.124 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:04.124 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:04.124 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:04.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.124 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:04.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.125 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.125 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:04.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.125 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.125 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:04.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:04.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:04.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:04.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:04.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:04.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:04.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:04.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:04.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:04.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:04.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:04.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:04.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:04.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:04.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:04.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:04.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:04.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:04.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:04.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:04.129 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:04.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:04.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.129 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:04.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:04.129 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.129 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.129 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.130 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:04.130 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:04.130 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.8322572729999997, 2024-04-19T04:25:04.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:04.130 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.130 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:04.130 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:04.130 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:04.130 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:04.130 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:04.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.131 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:04.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:04.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:04.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:04.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:04.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:04.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:04.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:04.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:04.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:04.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:04.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:04.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:04.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:04.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:04.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:04.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:04.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:04.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:04.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:04.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:04.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:04.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:04.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:04.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:04.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:04.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:04.136 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.136 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.136 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.136 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:04.136 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:04.136 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.8316891690000006, 2024-04-19T04:25:04.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:04.136 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.136 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:04.136 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.137 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:04.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.137 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:04.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.138 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:04.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:04.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.138 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:04.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:04.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:04.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:04.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.139 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:04.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:04.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.139 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:04.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:04.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:04.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:04.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:04.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:04.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:04.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:04.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:04.141 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.141 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.141 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.141 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:04.141 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:04.141 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.8313435079999998, 2024-04-19T04:25:04.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:04.141 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.141 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:04.141 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:04.141 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:04.141 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:04.142 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:04.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.142 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.142 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.142 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:04.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.142 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.142 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:04.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.143 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.143 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:04.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.143 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.143 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:04.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:04.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:04.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:04.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:04.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:04.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:04.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:04.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:04.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:04.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:04.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:04.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:04.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:04.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:04.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:04.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:04.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:04.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:04.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:04.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:04.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:04.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.147 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:04.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:04.147 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.147 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.147 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.147 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:04.147 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:04.147 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.8306190700000009, 2024-04-19T04:25:04.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:04.147 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.147 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:04.148 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.148 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:04.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.148 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:04.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:04.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:04.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:04.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:04.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:04.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:04.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:04.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:04.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:04.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.151 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:04.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:04.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.151 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.151 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:04.151 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:04.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:04.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.151 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.151 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.151 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:04.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:04.151 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.151 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.152 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.152 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:04.152 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:04.152 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.8306116750000001, 2024-04-19T04:25:04.152 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:04.152 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.152 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:04.152 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.152 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.152 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:04.152 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:04.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:04.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:04.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.154 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.154 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:04.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:04.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.154 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.154 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.154 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:04.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:04.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.154 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.154 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.154 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:04.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:04.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.155 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.155 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.155 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:04.155 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:04.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.155 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.155 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.155 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:04.155 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:04.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.155 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.155 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:04.155 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:04.156 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:04.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.156 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.156 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.156 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:04.156 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:04.156 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.156 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.156 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.156 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.156 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:04.156 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:04.157 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.8287865280000002, 2024-04-19T04:25:04.157 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:04.157 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.157 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:04.157 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:04.157 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:04.157 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:04.157 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:04.157 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.157 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.157 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.157 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.157 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:04.157 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.157 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:04.158 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:04.158 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:04.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:04.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.159 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.159 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:04.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:04.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.159 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.159 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:04.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:04.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.159 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.159 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:04.160 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:04.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.160 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.160 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.160 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:04.160 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:04.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.160 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.160 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:04.160 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:04.160 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:04.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.160 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.161 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:04.161 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:04.161 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:04.161 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.161 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.161 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:04.161 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:04.161 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:04.161 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.161 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.161 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:04.161 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:04.161 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:04.162 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.162 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.162 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.162 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:04.162 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:04.162 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.162 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.162 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.162 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.162 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.162 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26148 5.9 e27/20 ondisk, result = 0)", 2024-04-19T04:25:04.162 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:04.163 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.8286862030000002, 2024-04-19T04:25:04.163 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.042005175999999998, 2024-04-19T04:25:04.163 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.163 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:04.163 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.163 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.163 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.163 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:04.163 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.163 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.163 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.164 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.164 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:04.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.164 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.164 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.164 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238276+0000", 2024-04-19T04:25:04.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:04.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.164 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.164 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.164 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238280+0000", 2024-04-19T04:25:04.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6399999999999999e-06 2024-04-19T04:25:04.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238286+0000", 2024-04-19T04:25:04.165 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2099999999999998e-06 2024-04-19T04:25:04.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238290+0000", 2024-04-19T04:25:04.165 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2470000000000002e-06 2024-04-19T04:25:04.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239526+0000", 2024-04-19T04:25:04.165 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012362619999999999 2024-04-19T04:25:04.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.166 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.166 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.166 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239538+0000", 2024-04-19T04:25:04.166 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1620999999999999e-05 2024-04-19T04:25:04.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.166 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.166 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.166 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280282+0000", 2024-04-19T04:25:04.166 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040743691999999998 2024-04-19T04:25:04.166 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.166 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.166 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.8280523229999996, 2024-04-19T04:25:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.169 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.169 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.169 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.169 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:04.169 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:04.169 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.169 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.169 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.169 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:04.169 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:04.169 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.169 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.169 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.170 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:04.170 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:04.170 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.170 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.170 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.170 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:04.170 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:04.170 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.170 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.170 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.170 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:04.170 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:04.170 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.170 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.171 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:04.171 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:04.171 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:04.171 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.171 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.171 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:04.171 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:04.171 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:04.171 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.171 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.171 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:04.171 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:04.171 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:04.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.172 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.172 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:04.172 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:04.172 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:04.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.172 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.172 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.172 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:04.172 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:04.172 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.172 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.173 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.173 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.173 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.173 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:04.173 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:04.173 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.8275180469999999, 2024-04-19T04:25:04.173 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:04.173 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.173 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:04.173 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.173 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.173 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.174 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:04.174 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.174 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.174 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.174 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:04.174 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.174 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.174 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.174 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:04.175 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.175 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.175 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.175 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:04.175 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:04.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.175 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.175 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.175 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:04.175 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:04.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.176 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.176 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.176 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:04.176 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:04.176 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.176 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.176 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.176 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:04.176 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:04.176 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.176 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.176 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.176 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:04.176 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:04.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.177 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.177 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:04.177 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:04.177 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:04.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.177 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.177 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.177 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:04.177 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:04.177 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.177 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.177 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.178 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26160 5.f e27/20 ondisk, result = 0)", 2024-04-19T04:25:04.178 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:04.178 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.8264026720000004, 2024-04-19T04:25:04.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039752357000000002, 2024-04-19T04:25:04.178 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.178 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:04.178 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:04.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:04.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240559+0000", 2024-04-19T04:25:04.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:04.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240569+0000", 2024-04-19T04:25:04.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7720000000000006e-06 2024-04-19T04:25:04.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.180 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.180 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.180 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280164+0000", 2024-04-19T04:25:04.180 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039595324000000001 2024-04-19T04:25:04.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.180 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.180 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.181 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280190+0000", 2024-04-19T04:25:04.181 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5692000000000001e-05 2024-04-19T04:25:04.181 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.181 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.181 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.181 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280287+0000", 2024-04-19T04:25:04.181 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7536999999999998e-05 2024-04-19T04:25:04.181 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.181 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.181 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.181 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280299+0000", 2024-04-19T04:25:04.181 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2057e-05 2024-04-19T04:25:04.181 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.182 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.182 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.182 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:04.182 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3244999999999999e-05 2024-04-19T04:25:04.182 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.182 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.182 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.182 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.182 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.182 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26179 5.3 e27/20 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head v 27'1624, mlcod=27'1621)", 2024-04-19T04:25:04.182 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:04.182 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.8232489199999993, 2024-04-19T04:25:04.182 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039964081999999998, 2024-04-19T04:25:04.183 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:04.183 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:04.183 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:04.183 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.183 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:04.183 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:04.183 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.183 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.183 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:04.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:04.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:04.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:04.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243713+0000", 2024-04-19T04:25:04.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:04.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243750+0000", 2024-04-19T04:25:04.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6704e-05 2024-04-19T04:25:04.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:04.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280162+0000", 2024-04-19T04:25:04.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036412117000000001 2024-04-19T04:25:04.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280186+0000", 2024-04-19T04:25:04.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4825999999999999e-05 2024-04-19T04:25:04.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:04.186 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:04.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012540000000000001 2024-04-19T04:25:04.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.186 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:04.186 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280347+0000", 2024-04-19T04:25:04.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4894000000000002e-05 2024-04-19T04:25:04.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.186 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:04.186 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283654+0000", 2024-04-19T04:25:04.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00330716 2024-04-19T04:25:04.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:04.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:04.187 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:04.187 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283678+0000", 2024-04-19T04:25:04.187 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3992e-05 2024-04-19T04:25:04.187 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.187 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.187 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.187 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:04.187 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:04.187 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:04.188 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:25:04.189 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:04.183+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:04.190 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:25:04.289 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:04.286+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:04.328 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:25:04.328 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [ 2024-04-19T04:25:04.328 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.328 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:46481 5.c 5:3101ad3d:::benchmark_data_smithi007_19526_object46480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T04:25:04.329 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:04.320599+0000", 2024-04-19T04:25:04.329 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0058529749999999998, 2024-04-19T04:25:04.329 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0058842080000000001, 2024-04-19T04:25:04.329 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:04.329 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:04.329 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:04.329 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:04.329 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:04.329 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 46481 2024-04-19T04:25:04.329 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.329 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:04.329 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.329 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:04.329 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.320599+0000", 2024-04-19T04:25:04.329 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.330 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.330 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.330 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:04.330 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.320599+0000", 2024-04-19T04:25:04.330 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.330 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.330 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.330 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:04.330 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.320598+0000", 2024-04-19T04:25:04.330 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.330 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.330 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.330 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:04.330 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.320647+0000", 2024-04-19T04:25:04.331 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.8720000000000001e-05 2024-04-19T04:25:04.331 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.331 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.331 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:04.331 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.320658+0000", 2024-04-19T04:25:04.331 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0895e-05 2024-04-19T04:25:04.331 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.331 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.331 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.331 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.320663+0000", 2024-04-19T04:25:04.331 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.524e-06 2024-04-19T04:25:04.331 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.331 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.331 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:04.331 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.321804+0000", 2024-04-19T04:25:04.332 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001141073 2024-04-19T04:25:04.332 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.332 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.332 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:04.332 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.321931+0000", 2024-04-19T04:25:04.332 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000126783 2024-04-19T04:25:04.332 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.332 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.332 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:04.332 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.322073+0000", 2024-04-19T04:25:04.332 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000142218 2024-04-19T04:25:04.332 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.332 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:04.332 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.333 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.333 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.333 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:46479 5.2 e34/20 5:451179cc:::benchmark_data_smithi007_19526_object46478:head v 34'2927, mlcod=34'2925)", 2024-04-19T04:25:04.333 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:04.320928+0000", 2024-04-19T04:25:04.333 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0055243209999999996, 2024-04-19T04:25:04.333 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0056321180000000002, 2024-04-19T04:25:04.333 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:04.333 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:04.333 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:04.333 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.333 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:04.333 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.320928+0000", 2024-04-19T04:25:04.333 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.333 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.333 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.334 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:04.334 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.320928+0000", 2024-04-19T04:25:04.334 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.334 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.334 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.334 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:04.334 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.320922+0000", 2024-04-19T04:25:04.334 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999938 2024-04-19T04:25:04.334 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.334 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.334 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:04.334 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.320982+0000", 2024-04-19T04:25:04.335 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.0318000000000001e-05 2024-04-19T04:25:04.335 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.335 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.335 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:04.335 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.320991+0000", 2024-04-19T04:25:04.335 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.1840000000000005e-06 2024-04-19T04:25:04.335 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.335 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.335 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.335 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.320997+0000", 2024-04-19T04:25:04.335 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.6840000000000001e-06 2024-04-19T04:25:04.335 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.335 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.335 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:04.335 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.321040+0000", 2024-04-19T04:25:04.336 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.3343999999999997e-05 2024-04-19T04:25:04.336 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.336 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.336 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:04.336 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.321059+0000", 2024-04-19T04:25:04.336 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8834e-05 2024-04-19T04:25:04.336 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.336 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:04.336 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.336 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.336 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.336 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:46477 5.e e34/20 5:7648f867:::benchmark_data_smithi007_19526_object46476:head v 34'2963, mlcod=34'2959)", 2024-04-19T04:25:04.336 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:04.320877+0000", 2024-04-19T04:25:04.336 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0055751489999999997, 2024-04-19T04:25:04.336 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0057155740000000002, 2024-04-19T04:25:04.336 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.320877+0000", 2024-04-19T04:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.320877+0000", 2024-04-19T04:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.320876+0000", 2024-04-19T04:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.321003+0000", 2024-04-19T04:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012732499999999999 2024-04-19T04:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.321023+0000", 2024-04-19T04:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.9774000000000001e-05 2024-04-19T04:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.321031+0000", 2024-04-19T04:25:04.339 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.7889999999999995e-06 2024-04-19T04:25:04.339 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.339 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.339 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:04.339 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.321077+0000", 2024-04-19T04:25:04.339 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.6387000000000002e-05 2024-04-19T04:25:04.339 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.339 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.339 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:04.339 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.321110+0000", 2024-04-19T04:25:04.339 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.2057999999999997e-05 2024-04-19T04:25:04.339 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.339 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:04.339 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.339 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.340 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.340 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:46483 5.5 5:aa94001f:::benchmark_data_smithi007_19526_object46482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T04:25:04.340 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:04.321191+0000", 2024-04-19T04:25:04.340 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0052610979999999996, 2024-04-19T04:25:04.340 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0054346330000000003, 2024-04-19T04:25:04.340 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:04.340 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:04.340 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:04.340 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:04.340 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:04.340 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 46483 2024-04-19T04:25:04.340 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.340 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:04.340 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.341 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:04.341 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.321191+0000", 2024-04-19T04:25:04.341 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.341 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.341 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.341 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:04.341 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.321191+0000", 2024-04-19T04:25:04.341 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.341 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.341 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.341 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:04.341 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.321190+0000", 2024-04-19T04:25:04.341 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.341 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.342 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.342 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:04.342 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.321224+0000", 2024-04-19T04:25:04.342 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.3637000000000003e-05 2024-04-19T04:25:04.342 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.342 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.342 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:04.342 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.321236+0000", 2024-04-19T04:25:04.342 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.183e-05 2024-04-19T04:25:04.342 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.342 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.342 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.342 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.321243+0000", 2024-04-19T04:25:04.342 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.644e-06 2024-04-19T04:25:04.343 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.343 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.343 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:04.343 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.321296+0000", 2024-04-19T04:25:04.343 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2315000000000003e-05 2024-04-19T04:25:04.343 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.343 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.343 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:04.343 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.321516+0000", 2024-04-19T04:25:04.343 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000220208 2024-04-19T04:25:04.343 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.344 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.344 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:04.344 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.321755+0000", 2024-04-19T04:25:04.344 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00023954 2024-04-19T04:25:04.344 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.344 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:04.344 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.344 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.344 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.344 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:46484 5.c 5:3da5b206:::benchmark_data_smithi007_19526_object46483:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T04:25:04.344 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:04.323345+0000", 2024-04-19T04:25:04.344 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0031069520000000001, 2024-04-19T04:25:04.344 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00334024, 2024-04-19T04:25:04.344 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:04.345 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:04.345 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:04.345 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:04.345 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:04.345 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 46484 2024-04-19T04:25:04.345 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.345 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:04.345 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.345 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:04.345 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323345+0000", 2024-04-19T04:25:04.345 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.345 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.345 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.345 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:04.346 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323345+0000", 2024-04-19T04:25:04.346 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.346 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.346 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.346 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:04.346 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323344+0000", 2024-04-19T04:25:04.346 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.346 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.346 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.346 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:04.346 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323409+0000", 2024-04-19T04:25:04.346 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.4667999999999998e-05 2024-04-19T04:25:04.346 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.347 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.347 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:04.347 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323416+0000", 2024-04-19T04:25:04.347 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.5159999999999997e-06 2024-04-19T04:25:04.347 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.347 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.347 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.347 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323422+0000", 2024-04-19T04:25:04.347 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.276e-06 2024-04-19T04:25:04.347 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.347 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.347 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:04.347 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323770+0000", 2024-04-19T04:25:04.347 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00034831899999999998 2024-04-19T04:25:04.348 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.348 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.348 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:04.348 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323886+0000", 2024-04-19T04:25:04.348 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000115648 2024-04-19T04:25:04.348 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.348 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.348 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:04.348 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.324017+0000", 2024-04-19T04:25:04.348 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013104600000000001 2024-04-19T04:25:04.348 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.348 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:04.348 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.348 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.348 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.349 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:46485 5.c 5:3279b840:::benchmark_data_smithi007_19526_object46484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T04:25:04.349 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:04.323485+0000", 2024-04-19T04:25:04.349 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.002966738, 2024-04-19T04:25:04.349 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0032669769999999999, 2024-04-19T04:25:04.349 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:04.349 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:04.349 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:04.349 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:04.349 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:04.349 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 46485 2024-04-19T04:25:04.349 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.349 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:04.349 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.349 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:04.350 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323485+0000", 2024-04-19T04:25:04.350 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.350 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.350 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.350 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:04.350 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323485+0000", 2024-04-19T04:25:04.350 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.350 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.350 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.350 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:04.350 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323485+0000", 2024-04-19T04:25:04.350 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.350 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.350 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.351 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:04.351 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323570+0000", 2024-04-19T04:25:04.351 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.5663999999999998e-05 2024-04-19T04:25:04.351 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.351 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.351 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:04.351 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323578+0000", 2024-04-19T04:25:04.351 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.8739999999999995e-06 2024-04-19T04:25:04.351 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.351 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.351 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.351 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323587+0000", 2024-04-19T04:25:04.351 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.2849999999999995e-06 2024-04-19T04:25:04.351 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.351 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.351 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:04.352 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.325610+0000", 2024-04-19T04:25:04.352 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.002023937 2024-04-19T04:25:04.352 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.352 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.352 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:04.352 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.325817+0000", 2024-04-19T04:25:04.352 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00020691399999999999 2024-04-19T04:25:04.352 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.352 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.352 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:04.352 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.325894+0000", 2024-04-19T04:25:04.352 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.6898999999999997e-05 2024-04-19T04:25:04.352 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.352 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:04.353 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.353 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.353 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.353 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:46486 5.a 5:5cb4ebc3:::benchmark_data_smithi007_19526_object46485:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T04:25:04.353 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:04.323599+0000", 2024-04-19T04:25:04.353 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0028531519999999999, 2024-04-19T04:25:04.353 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0032241710000000001, 2024-04-19T04:25:04.353 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:04.353 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:04.353 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:04.353 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:04.353 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:04.353 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 46486 2024-04-19T04:25:04.353 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.354 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:04.354 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.354 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:04.354 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323599+0000", 2024-04-19T04:25:04.354 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.354 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.354 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.354 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:04.354 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323599+0000", 2024-04-19T04:25:04.354 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.354 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.354 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.354 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:04.354 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323599+0000", 2024-04-19T04:25:04.354 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:04.355 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.355 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.355 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:04.355 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323637+0000", 2024-04-19T04:25:04.355 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8185000000000001e-05 2024-04-19T04:25:04.355 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.355 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.355 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:04.355 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323648+0000", 2024-04-19T04:25:04.355 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1165999999999999e-05 2024-04-19T04:25:04.355 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.355 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.355 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.355 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323652+0000", 2024-04-19T04:25:04.356 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.527e-06 2024-04-19T04:25:04.356 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.356 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.356 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:04.356 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323687+0000", 2024-04-19T04:25:04.356 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.4242000000000002e-05 2024-04-19T04:25:04.356 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.356 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.356 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:04.356 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323801+0000", 2024-04-19T04:25:04.356 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00011461800000000001 2024-04-19T04:25:04.356 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.356 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.356 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:04.356 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323934+0000", 2024-04-19T04:25:04.357 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000132743 2024-04-19T04:25:04.357 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.357 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:04.357 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.357 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.357 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.357 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:46488 5.8 5:1a6ff6d6:::benchmark_data_smithi007_19526_object46487:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T04:25:04.357 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:04.323737+0000", 2024-04-19T04:25:04.357 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.002714958, 2024-04-19T04:25:04.357 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0031636350000000001, 2024-04-19T04:25:04.357 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:04.357 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:04.357 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:04.357 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:04.357 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:04.358 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 46488 2024-04-19T04:25:04.358 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.358 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:04.358 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.358 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:04.358 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323737+0000", 2024-04-19T04:25:04.358 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.358 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.358 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.358 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:04.358 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323737+0000", 2024-04-19T04:25:04.358 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.358 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.358 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.359 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:04.359 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323736+0000", 2024-04-19T04:25:04.359 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.359 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.359 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.359 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:04.359 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323794+0000", 2024-04-19T04:25:04.359 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.7686999999999998e-05 2024-04-19T04:25:04.359 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.359 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.359 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:04.359 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323799+0000", 2024-04-19T04:25:04.359 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2909999999999998e-06 2024-04-19T04:25:04.359 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.359 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.360 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.360 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323803+0000", 2024-04-19T04:25:04.360 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.4350000000000001e-06 2024-04-19T04:25:04.360 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.360 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.360 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:04.360 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323842+0000", 2024-04-19T04:25:04.360 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9212999999999999e-05 2024-04-19T04:25:04.360 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.360 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.360 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:04.360 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.323979+0000", 2024-04-19T04:25:04.360 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013729500000000001 2024-04-19T04:25:04.360 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.360 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.361 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:04.361 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.324103+0000", 2024-04-19T04:25:04.361 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000123814 2024-04-19T04:25:04.361 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.361 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:04.361 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.361 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.361 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.361 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:46489 5.6 5:6d1eac1d:::benchmark_data_smithi007_19526_object46488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T04:25:04.361 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:04.324736+0000", 2024-04-19T04:25:04.361 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0017161310000000001, 2024-04-19T04:25:04.361 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0022379470000000001, 2024-04-19T04:25:04.361 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:04.361 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:04.361 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:04.362 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:04.362 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:04.362 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 46489 2024-04-19T04:25:04.362 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.362 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:04.362 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.362 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:04.362 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.324736+0000", 2024-04-19T04:25:04.362 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.362 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.362 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.362 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:04.362 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.324736+0000", 2024-04-19T04:25:04.362 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.362 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.363 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.363 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:04.363 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.324735+0000", 2024-04-19T04:25:04.363 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.363 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.363 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.363 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:04.363 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.324823+0000", 2024-04-19T04:25:04.363 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8035999999999995e-05 2024-04-19T04:25:04.363 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.363 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.363 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:04.363 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.324833+0000", 2024-04-19T04:25:04.363 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0018e-05 2024-04-19T04:25:04.363 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.364 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.364 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.364 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.324838+0000", 2024-04-19T04:25:04.364 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.8829999999999997e-06 2024-04-19T04:25:04.364 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.364 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.364 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:04.364 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.324894+0000", 2024-04-19T04:25:04.364 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.5340999999999998e-05 2024-04-19T04:25:04.364 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.364 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.364 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:04.364 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.325048+0000", 2024-04-19T04:25:04.364 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000154363 2024-04-19T04:25:04.364 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.365 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.365 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:04.365 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.325238+0000", 2024-04-19T04:25:04.365 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000190182 2024-04-19T04:25:04.365 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.365 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:04.365 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.365 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.365 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.365 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:46492 5.4 5:27dda72a:::benchmark_data_smithi007_19526_object46491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T04:25:04.365 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:04.326077+0000", 2024-04-19T04:25:04.365 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00037518399999999998, 2024-04-19T04:25:04.365 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00096934500000000004, 2024-04-19T04:25:04.365 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:04.365 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:04.366 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:04.366 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:04.366 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:04.366 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 46492 2024-04-19T04:25:04.366 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.366 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:04.366 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.366 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:04.366 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326077+0000", 2024-04-19T04:25:04.366 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.366 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.366 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.366 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:04.366 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326077+0000", 2024-04-19T04:25:04.366 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.367 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.367 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.367 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:04.367 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326076+0000", 2024-04-19T04:25:04.367 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.367 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.367 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.367 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:04.367 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326165+0000", 2024-04-19T04:25:04.367 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.9064e-05 2024-04-19T04:25:04.367 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.367 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.367 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:04.367 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326179+0000", 2024-04-19T04:25:04.367 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3684e-05 2024-04-19T04:25:04.368 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.368 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.368 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.368 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326186+0000", 2024-04-19T04:25:04.368 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.1199999999999996e-06 2024-04-19T04:25:04.368 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.368 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.368 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:04.368 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326216+0000", 2024-04-19T04:25:04.368 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.0096000000000001e-05 2024-04-19T04:25:04.368 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.368 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.368 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:04.368 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326306+0000", 2024-04-19T04:25:04.368 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.0037000000000005e-05 2024-04-19T04:25:04.368 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.369 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.369 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:04.369 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326385+0000", 2024-04-19T04:25:04.369 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.9142999999999998e-05 2024-04-19T04:25:04.369 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.369 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:04.369 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.369 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.369 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.369 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:46493 5.c 5.684acefc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T04:25:04.369 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:04.326195+0000", 2024-04-19T04:25:04.369 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00025703299999999999, 2024-04-19T04:25:04.369 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00092058500000000002, 2024-04-19T04:25:04.369 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:04.369 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:04.370 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:04.370 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:04.370 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:04.370 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 46493 2024-04-19T04:25:04.370 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.370 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:04.370 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.370 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:04.370 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326195+0000", 2024-04-19T04:25:04.370 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.370 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.370 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.370 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:04.370 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326195+0000", 2024-04-19T04:25:04.370 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.371 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.371 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.371 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:04.371 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326195+0000", 2024-04-19T04:25:04.371 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:04.371 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.371 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.371 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:04.371 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326225+0000", 2024-04-19T04:25:04.371 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.0077999999999999e-05 2024-04-19T04:25:04.371 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.371 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.371 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:04.371 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326232+0000", 2024-04-19T04:25:04.372 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.1060000000000002e-06 2024-04-19T04:25:04.372 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.372 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.372 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.372 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326237+0000", 2024-04-19T04:25:04.372 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.1889999999999998e-06 2024-04-19T04:25:04.372 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.372 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:04.372 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.372 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.372 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.372 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:46490 5.0 e34/20 5:0e58e1a0:::benchmark_data_smithi007_19526_object46489:head v 34'2891, mlcod=34'2889)", 2024-04-19T04:25:04.372 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:04.326580+0000", 2024-04-19T04:25:04.372 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4294967295.9998722, 2024-04-19T04:25:04.372 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00058532699999999996, 2024-04-19T04:25:04.373 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:04.373 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:04.373 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:04.373 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.373 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:04.373 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326580+0000", 2024-04-19T04:25:04.373 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.373 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.373 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.373 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:04.373 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326580+0000", 2024-04-19T04:25:04.373 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.373 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.373 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.373 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:04.374 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326579+0000", 2024-04-19T04:25:04.374 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:04.374 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.374 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.374 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:04.374 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326634+0000", 2024-04-19T04:25:04.374 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4595000000000002e-05 2024-04-19T04:25:04.374 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.374 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.374 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:04.374 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326647+0000", 2024-04-19T04:25:04.374 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3487e-05 2024-04-19T04:25:04.374 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.374 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.375 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.375 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326653+0000", 2024-04-19T04:25:04.375 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.891e-06 2024-04-19T04:25:04.375 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.375 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.375 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:04.375 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326698+0000", 2024-04-19T04:25:04.375 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.4926000000000003e-05 2024-04-19T04:25:04.375 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.375 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.375 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:04.375 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.326723+0000", 2024-04-19T04:25:04.375 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.4856000000000001e-05 2024-04-19T04:25:04.375 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.375 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:04.376 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.376 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.376 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.376 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop_reply(client.4746.0:46486 5.a e34/20 ondisk, result = 0)", 2024-04-19T04:25:04.376 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:04.327144+0000", 2024-04-19T04:25:04.376 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4294967295.9993081, 2024-04-19T04:25:04.376 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3299000000000004e-05, 2024-04-19T04:25:04.376 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:04.376 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:04.376 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:04.376 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.376 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:04.376 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.327144+0000", 2024-04-19T04:25:04.376 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.376 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.377 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.377 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:04.377 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.327144+0000", 2024-04-19T04:25:04.377 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:04.377 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.377 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.377 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:04.377 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.327143+0000", 2024-04-19T04:25:04.377 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:04.377 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.377 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.377 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:04.377 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.327147+0000", 2024-04-19T04:25:04.377 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1289999999999998e-06 2024-04-19T04:25:04.377 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.378 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.378 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:04.378 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.327155+0000", 2024-04-19T04:25:04.378 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.9130000000000003e-06 2024-04-19T04:25:04.378 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.378 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.378 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:04.378 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.327161+0000", 2024-04-19T04:25:04.378 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.5600000000000001e-06 2024-04-19T04:25:04.378 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.378 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.378 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:04.378 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.327203+0000", 2024-04-19T04:25:04.378 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2592999999999997e-05 2024-04-19T04:25:04.378 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.379 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.379 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:04.379 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.327210+0000", 2024-04-19T04:25:04.379 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7449999999999998e-06 2024-04-19T04:25:04.379 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:04.379 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:04.379 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:04.379 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:04.327217+0000", 2024-04-19T04:25:04.379 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.007e-06 2024-04-19T04:25:04.379 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.379 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:04.379 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.379 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:04.379 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-04-19T04:25:04.379 INFO:teuthology.orchestra.run.smithi066.stdout: "num_ops": 13 2024-04-19T04:25:04.380 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:25:04.381 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:04.381 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-04-19T04:25:04.381 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:25:04.390 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:04.386+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:04.393 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:04.396 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:04.396 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T04:25:04.396 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:04.491 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:04.486+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:04.514 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:04.515 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:04.528 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:25:04.591 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:04.590+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:04.661 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:04.661 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:04.679 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:04.695 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:04.687+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:04.752 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:2024-04-19T04:25:04.752498+0000 min lat: 0.00185991 max lat: 1.0345 avg lat: 0.00675308 2024-04-19T04:25:04.752 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-19T04:25:04.752 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 20 16 47363 47347 147.942 128.75 0.00618303 0.00675308 2024-04-19T04:25:04.794 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:04.791+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:04.800 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:04.800 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:04.810 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:04.895 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:04.894+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:04.934 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:04.935 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:04.947 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:04.996 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:04.991+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:05.067 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:05.068 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:05.081 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:05.096 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:05.091+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:05.197 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:05.194+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:05.214 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:05.215 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:05.226 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:05.298 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:05.294+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:05.355 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:05.355 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:05.367 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:05.399 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:05.398+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:05.494 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:05.498 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:05.500 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:05.498+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:05.507 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:25:05.601 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:05.598+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:05.644 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:05.644 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:05.657 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:25:05.702 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:05.702+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:05.752 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 21 16 49359 49343 146.837 124.75 0.00929753 0.00680328 2024-04-19T04:25:05.791 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T04:25:05.792 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:05.793 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:05.804 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:05.798+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:05.808 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:25:05.907 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:05.902+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:05.949 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:05.949 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:05.963 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:06.008 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:06.003+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:06.085 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:06.086 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:06.096 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:06.110 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:06.107+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:06.211 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:06.210+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:06.217 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:06.217 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:06.230 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:06.312 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:06.306+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:06.351 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:06.351 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:06.362 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:06.409 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:25:06.414 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:06.407+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:06.491 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:06.492 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:06.504 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:06.514 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:06.514+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:06.563 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:06.586 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-04-19T04:25:06.606 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:06.607 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:06.608 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T04:25:06.608 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:06.615 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:06.610+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:06.633 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:06.634 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:06.634 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:06.634 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:06.634 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:06.645 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:06.716 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:06.711+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:06.752 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 22 16 51367 51351 145.866 125.5 0.00794951 0.00684916 2024-04-19T04:25:06.775 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:25:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 46.239673123999999, 2024-04-19T04:25:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026801078999999998, 2024-04-19T04:25:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:25:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:25:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.777 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533733+0000", 2024-04-19T04:25:06.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999976 2024-04-19T04:25:06.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.777 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533746+0000", 2024-04-19T04:25:06.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2679e-05 2024-04-19T04:25:06.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.778 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533769+0000", 2024-04-19T04:25:06.778 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2832000000000001e-05 2024-04-19T04:25:06.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.778 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.778 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.778 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:25:06.778 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0599999999999999e-05 2024-04-19T04:25:06.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.778 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.778 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.778 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533907+0000", 2024-04-19T04:25:06.778 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000118076 2024-04-19T04:25:06.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.778 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.779 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:25:06.779 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533919+0000", 2024-04-19T04:25:06.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1644999999999999e-05 2024-04-19T04:25:06.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.779 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.779 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.779 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553399+0000", 2024-04-19T04:25:06.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019479987000000001 2024-04-19T04:25:06.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.779 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.779 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.779 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553535+0000", 2024-04-19T04:25:06.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553400000000001 2024-04-19T04:25:06.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.779 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:06.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553696+0000", 2024-04-19T04:25:06.780 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000161068 2024-04-19T04:25:06.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:06.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558096+0000", 2024-04-19T04:25:06.780 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0043998880000000002 2024-04-19T04:25:06.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:06.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560465+0000", 2024-04-19T04:25:06.780 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023695159999999999 2024-04-19T04:25:06.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:06.781 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560513+0000", 2024-04-19T04:25:06.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7899000000000003e-05 2024-04-19T04:25:06.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.781 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560537+0000", 2024-04-19T04:25:06.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3768e-05 2024-04-19T04:25:06.781 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.781 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.781 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.781 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:06.782 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:06.782 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 46.239596050000003, 2024-04-19T04:25:06.782 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026864505, 2024-04-19T04:25:06.782 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.782 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:06.782 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.782 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.782 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.782 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:06.782 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.782 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.782 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.782 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:06.782 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.783 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.783 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.783 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.783 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533812+0000", 2024-04-19T04:25:06.783 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:06.783 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.783 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.783 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.783 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533818+0000", 2024-04-19T04:25:06.783 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2369999999999997e-06 2024-04-19T04:25:06.783 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.783 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.783 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.783 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533863+0000", 2024-04-19T04:25:06.784 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4515000000000003e-05 2024-04-19T04:25:06.784 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.784 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.784 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.784 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533880+0000", 2024-04-19T04:25:06.784 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7119e-05 2024-04-19T04:25:06.784 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.784 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.784 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.784 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534029+0000", 2024-04-19T04:25:06.784 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014955099999999999 2024-04-19T04:25:06.784 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.784 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.784 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:06.784 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534034+0000", 2024-04-19T04:25:06.785 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1649999999999997e-06 2024-04-19T04:25:06.785 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.785 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.785 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.785 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554888+0000", 2024-04-19T04:25:06.785 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020854075 2024-04-19T04:25:06.785 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.785 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.785 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.785 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554967+0000", 2024-04-19T04:25:06.785 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8209999999999998e-05 2024-04-19T04:25:06.785 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.785 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.785 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:06.785 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555087+0000", 2024-04-19T04:25:06.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000120411 2024-04-19T04:25:06.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.786 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:06.786 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559328+0000", 2024-04-19T04:25:06.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042409800000000001 2024-04-19T04:25:06.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.786 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:06.786 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560587+0000", 2024-04-19T04:25:06.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012587119999999999 2024-04-19T04:25:06.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.786 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:06.787 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560620+0000", 2024-04-19T04:25:06.787 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2716999999999999e-05 2024-04-19T04:25:06.787 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.787 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.787 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.787 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560677+0000", 2024-04-19T04:25:06.787 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7726999999999998e-05 2024-04-19T04:25:06.787 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.787 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.787 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.787 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.787 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.787 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:06.787 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:06.787 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 46.239513657000003, 2024-04-19T04:25:06.788 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027363064999999999, 2024-04-19T04:25:06.788 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.788 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:06.788 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.788 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.788 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.788 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:06.788 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.788 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.788 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.788 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.788 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:06.788 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.788 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.789 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.789 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.789 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533894+0000", 2024-04-19T04:25:06.789 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:06.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.789 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.789 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.789 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533913+0000", 2024-04-19T04:25:06.789 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8896e-05 2024-04-19T04:25:06.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.789 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.789 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.789 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533933+0000", 2024-04-19T04:25:06.789 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9775e-05 2024-04-19T04:25:06.790 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.790 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.790 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.790 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533967+0000", 2024-04-19T04:25:06.790 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4536000000000003e-05 2024-04-19T04:25:06.790 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.790 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.790 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.790 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:06.790 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553600000000001 2024-04-19T04:25:06.790 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.790 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.790 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:06.790 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534107+0000", 2024-04-19T04:25:06.791 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1470000000000003e-06 2024-04-19T04:25:06.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.791 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.791 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.791 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556463+0000", 2024-04-19T04:25:06.791 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022356536999999999 2024-04-19T04:25:06.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.791 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.791 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.791 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556586+0000", 2024-04-19T04:25:06.791 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122967 2024-04-19T04:25:06.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.791 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.791 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:06.791 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556738+0000", 2024-04-19T04:25:06.792 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015182800000000001 2024-04-19T04:25:06.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.792 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.792 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:06.792 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561020+0000", 2024-04-19T04:25:06.792 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042818819999999999 2024-04-19T04:25:06.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.792 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.792 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:06.792 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561183+0000", 2024-04-19T04:25:06.792 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000162683 2024-04-19T04:25:06.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.792 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.792 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:06.792 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561226+0000", 2024-04-19T04:25:06.793 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3686000000000002e-05 2024-04-19T04:25:06.793 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.793 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.793 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.793 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561258+0000", 2024-04-19T04:25:06.793 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1814999999999999e-05 2024-04-19T04:25:06.793 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.793 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.793 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.793 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.793 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.793 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:06.793 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:06.793 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 46.239423144, 2024-04-19T04:25:06.793 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027417816000000001, 2024-04-19T04:25:06.794 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.794 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:06.794 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.794 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.794 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.794 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:06.794 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.794 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.794 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.794 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.794 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:06.794 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.794 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.794 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.795 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.795 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533984+0000", 2024-04-19T04:25:06.795 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:06.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.795 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.795 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.795 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:25:06.795 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3876000000000001e-05 2024-04-19T04:25:06.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.795 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.795 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.795 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534015+0000", 2024-04-19T04:25:06.795 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6818999999999999e-05 2024-04-19T04:25:06.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.796 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.796 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534030+0000", 2024-04-19T04:25:06.796 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.537e-05 2024-04-19T04:25:06.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.796 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.796 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534152+0000", 2024-04-19T04:25:06.796 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121685 2024-04-19T04:25:06.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.796 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:06.796 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534156+0000", 2024-04-19T04:25:06.796 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9029999999999997e-06 2024-04-19T04:25:06.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.797 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.797 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.797 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557520+0000", 2024-04-19T04:25:06.797 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023364125999999999 2024-04-19T04:25:06.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.797 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.797 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.797 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557585+0000", 2024-04-19T04:25:06.797 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5275000000000001e-05 2024-04-19T04:25:06.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.797 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.797 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:06.797 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557719+0000", 2024-04-19T04:25:06.797 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013396299999999999 2024-04-19T04:25:06.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.798 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.798 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:06.798 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561133+0000", 2024-04-19T04:25:06.798 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034140989999999999 2024-04-19T04:25:06.798 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.798 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.798 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:06.798 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561352+0000", 2024-04-19T04:25:06.798 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0002185 2024-04-19T04:25:06.798 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.798 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.798 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:06.798 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561380+0000", 2024-04-19T04:25:06.798 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8317999999999999e-05 2024-04-19T04:25:06.798 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.799 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.799 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.799 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561403+0000", 2024-04-19T04:25:06.799 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3264999999999998e-05 2024-04-19T04:25:06.799 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.799 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.799 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.799 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.799 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.799 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:06.799 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:06.799 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 46.239359499000003, 2024-04-19T04:25:06.799 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029897119999999999, 2024-04-19T04:25:06.799 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.799 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:06.800 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.800 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.800 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.800 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:06.800 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.800 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.800 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.800 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.800 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:06.800 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.800 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.800 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.800 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.800 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534048+0000", 2024-04-19T04:25:06.801 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:06.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.801 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.801 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.801 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534057+0000", 2024-04-19T04:25:06.801 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7930000000000003e-06 2024-04-19T04:25:06.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.801 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.801 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.801 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534075+0000", 2024-04-19T04:25:06.801 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7846000000000002e-05 2024-04-19T04:25:06.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.801 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.801 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.801 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534089+0000", 2024-04-19T04:25:06.802 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4463e-05 2024-04-19T04:25:06.802 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.802 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.802 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.802 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534198+0000", 2024-04-19T04:25:06.802 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109145 2024-04-19T04:25:06.802 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.802 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.802 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:06.802 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534202+0000", 2024-04-19T04:25:06.802 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.98e-06 2024-04-19T04:25:06.802 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.802 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.802 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.803 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558221+0000", 2024-04-19T04:25:06.803 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024018208999999999 2024-04-19T04:25:06.803 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.803 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.803 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.803 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558320+0000", 2024-04-19T04:25:06.803 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9642000000000006e-05 2024-04-19T04:25:06.803 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.803 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.803 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:06.803 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558401+0000", 2024-04-19T04:25:06.803 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1038000000000006e-05 2024-04-19T04:25:06.803 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.803 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.803 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:06.804 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561173+0000", 2024-04-19T04:25:06.804 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027714549999999999 2024-04-19T04:25:06.804 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.804 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.804 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:06.804 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563851+0000", 2024-04-19T04:25:06.804 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026786010000000001 2024-04-19T04:25:06.804 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.804 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.804 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:06.804 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563906+0000", 2024-04-19T04:25:06.804 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4895999999999998e-05 2024-04-19T04:25:06.804 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.804 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.804 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.805 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563946+0000", 2024-04-19T04:25:06.805 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0116e-05 2024-04-19T04:25:06.805 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.805 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.805 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.805 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.805 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.805 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:06.805 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:06.805 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 46.239306118000002, 2024-04-19T04:25:06.805 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029917846000000001, 2024-04-19T04:25:06.805 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.805 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:06.805 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.806 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.806 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.806 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:06.806 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.806 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.806 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.806 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.806 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:06.806 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.806 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.806 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.806 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.806 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534101+0000", 2024-04-19T04:25:06.806 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:06.806 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.807 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.807 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.807 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534111+0000", 2024-04-19T04:25:06.807 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5659999999999996e-06 2024-04-19T04:25:06.807 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.807 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.807 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.807 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534129+0000", 2024-04-19T04:25:06.807 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7632999999999999e-05 2024-04-19T04:25:06.807 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.807 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.807 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.807 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534143+0000", 2024-04-19T04:25:06.807 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4362000000000001e-05 2024-04-19T04:25:06.807 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.808 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.808 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.808 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534256+0000", 2024-04-19T04:25:06.808 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113267 2024-04-19T04:25:06.808 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.808 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.808 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:06.808 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534260+0000", 2024-04-19T04:25:06.808 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9949999999999999e-06 2024-04-19T04:25:06.808 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.808 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.808 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.808 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558653+0000", 2024-04-19T04:25:06.808 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024393182999999999 2024-04-19T04:25:06.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.809 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.809 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.809 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558704+0000", 2024-04-19T04:25:06.809 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0303999999999998e-05 2024-04-19T04:25:06.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.809 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.809 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:06.809 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558782+0000", 2024-04-19T04:25:06.809 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8079999999999998e-05 2024-04-19T04:25:06.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.809 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.809 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:06.809 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561309+0000", 2024-04-19T04:25:06.809 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002527708 2024-04-19T04:25:06.810 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.810 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.810 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:06.810 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563952+0000", 2024-04-19T04:25:06.810 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026425450000000001 2024-04-19T04:25:06.810 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.810 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.810 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:06.810 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563996+0000", 2024-04-19T04:25:06.810 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3606000000000002e-05 2024-04-19T04:25:06.810 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.810 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.810 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.810 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564021+0000", 2024-04-19T04:25:06.810 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.491e-05 2024-04-19T04:25:06.811 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.811 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.811 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.811 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.811 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.811 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:06.811 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:06.811 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 46.239253607000002, 2024-04-19T04:25:06.811 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:25:06.811 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.811 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:06.811 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.811 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.811 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.811 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:06.812 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.812 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.812 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.812 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:06.812 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.812 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.812 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.812 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:25:06.812 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:06.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.812 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.812 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.812 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:25:06.813 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:25:06.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.813 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.813 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:25:06.813 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:25:06.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.813 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.813 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:25:06.813 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:25:06.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.813 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.813 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:25:06.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:25:06.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:06.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:25:06.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:25:06.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:25:06.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:25:06.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:25:06.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:25:06.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:06.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:25:06.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:25:06.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:06.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:25:06.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:25:06.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:06.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:25:06.816 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:25:06.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.816 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:06.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:25:06.816 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:25:06.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.816 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:25:06.816 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:25:06.816 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.816 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.817 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.817 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:06.817 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:06.817 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 46.239199061999997, 2024-04-19T04:25:06.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:25:06.817 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.817 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:06.817 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.817 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.817 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:06.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.818 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.818 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:06.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.818 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.818 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:25:06.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:06.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.818 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.818 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:25:06.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:25:06.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:25:06.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:25:06.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:25:06.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:25:06.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:25:06.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:25:06.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:06.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:25:06.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:25:06.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:25:06.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:25:06.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:25:06.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:25:06.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:06.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:25:06.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:25:06.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:06.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:25:06.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:25:06.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:06.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:25:06.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:25:06.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:06.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:25:06.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:25:06.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:25:06.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:25:06.822 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.822 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.822 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.823 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:06.823 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:06.823 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.541884476, 2024-04-19T04:25:06.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:06.823 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.823 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:06.823 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:06.823 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:06.823 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:06.823 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:06.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.823 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:06.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:06.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:06.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:06.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:06.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:06.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:06.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:06.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:06.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:06.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:06.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:06.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:06.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:06.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:06.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:06.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:06.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:06.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:06.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:06.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:06.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:06.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:06.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:06.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:06.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:06.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:06.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:06.828 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.828 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.828 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.828 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:06.828 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:06.828 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.53870332, 2024-04-19T04:25:06.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:06.828 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.828 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:06.829 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:06.829 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:06.829 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:06.829 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:06.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.829 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:06.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:06.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:06.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:06.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:06.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:06.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:06.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:06.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:06.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:06.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:06.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:06.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:06.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:06.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:06.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:06.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:06.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:06.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:06.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:06.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:06.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:06.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:06.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:06.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:06.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:06.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:06.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:06.833 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.833 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.833 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.834 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:06.834 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:06.834 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.538135216000001, 2024-04-19T04:25:06.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:06.834 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.834 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:06.834 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:06.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:06.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:06.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:06.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:06.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:06.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:06.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:06.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:06.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:06.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:06.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:06.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:06.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:06.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:06.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:06.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:06.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:06.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:06.838 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.838 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.838 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.838 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:06.838 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:06.838 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.537789555, 2024-04-19T04:25:06.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:06.838 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.838 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:06.838 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:06.839 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:06.839 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:06.839 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:06.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.839 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:06.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:06.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:06.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:06.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:06.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:06.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:06.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:06.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:06.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:06.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:06.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:06.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:06.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:06.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:06.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:06.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:06.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:06.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:06.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:06.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:06.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:06.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:06.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:06.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:06.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:06.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:06.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:06.843 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.843 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.843 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.844 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:06.844 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:06.844 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.537065117000001, 2024-04-19T04:25:06.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:06.844 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.844 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:06.844 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:06.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:06.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:06.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:06.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:06.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:06.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:06.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:06.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:06.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:06.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:06.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:06.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:06.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:06.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:06.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:06.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:06.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:06.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:06.847 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.848 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.848 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.848 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:06.848 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:06.848 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.537057722, 2024-04-19T04:25:06.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:06.848 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.848 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:06.848 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:06.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:06.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:06.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:06.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:06.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:06.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:06.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:06.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:06.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:06.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:06.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:06.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:06.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:06.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:06.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:06.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:06.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:06.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:06.852 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.852 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.852 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.852 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:06.852 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:06.852 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.535232575, 2024-04-19T04:25:06.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:06.852 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.852 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:06.852 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:06.852 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:06.852 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:06.852 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:06.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.853 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:06.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:06.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:06.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:06.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:06.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:06.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:06.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:06.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:06.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:06.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:06.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:06.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:06.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:06.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:06.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:06.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:06.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:06.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:06.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:06.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:06.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:06.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:06.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:06.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:06.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:06.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:06.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:06.857 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.857 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.857 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.857 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26148 5.9 e27/20 ondisk, result = 0)", 2024-04-19T04:25:06.857 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:06.858 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.53513225, 2024-04-19T04:25:06.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.042005175999999998, 2024-04-19T04:25:06.858 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.858 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:06.858 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:06.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:06.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238276+0000", 2024-04-19T04:25:06.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:06.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238280+0000", 2024-04-19T04:25:06.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6399999999999999e-06 2024-04-19T04:25:06.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238286+0000", 2024-04-19T04:25:06.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2099999999999998e-06 2024-04-19T04:25:06.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238290+0000", 2024-04-19T04:25:06.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2470000000000002e-06 2024-04-19T04:25:06.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239526+0000", 2024-04-19T04:25:06.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012362619999999999 2024-04-19T04:25:06.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239538+0000", 2024-04-19T04:25:06.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1620999999999999e-05 2024-04-19T04:25:06.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280282+0000", 2024-04-19T04:25:06.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040743691999999998 2024-04-19T04:25:06.861 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.861 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.861 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.861 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:06.861 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:06.861 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.53449837, 2024-04-19T04:25:06.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:06.861 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.862 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:06.862 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:06.862 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:06.862 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:06.862 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:06.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.862 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:06.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:06.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:06.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:06.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:06.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:06.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:06.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:06.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:06.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:06.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:06.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:06.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:06.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:06.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:06.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:06.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:06.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:06.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:06.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:06.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:06.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:06.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:06.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:06.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:06.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:06.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:06.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:06.866 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.867 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.867 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.867 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:06.867 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:06.867 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.533964094, 2024-04-19T04:25:06.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:06.867 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.867 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:06.867 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:06.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:06.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:06.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:06.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:06.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:06.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:06.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:06.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:06.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:06.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:06.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:06.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:06.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:06.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:06.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:06.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:06.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:06.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:06.871 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.871 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.871 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.871 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26160 5.f e27/20 ondisk, result = 0)", 2024-04-19T04:25:06.871 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:06.871 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.532848719, 2024-04-19T04:25:06.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039752357000000002, 2024-04-19T04:25:06.871 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.871 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:06.871 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:06.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:06.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240559+0000", 2024-04-19T04:25:06.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:06.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240569+0000", 2024-04-19T04:25:06.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7720000000000006e-06 2024-04-19T04:25:06.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280164+0000", 2024-04-19T04:25:06.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039595324000000001 2024-04-19T04:25:06.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280190+0000", 2024-04-19T04:25:06.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5692000000000001e-05 2024-04-19T04:25:06.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280287+0000", 2024-04-19T04:25:06.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7536999999999998e-05 2024-04-19T04:25:06.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280299+0000", 2024-04-19T04:25:06.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2057e-05 2024-04-19T04:25:06.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:06.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3244999999999999e-05 2024-04-19T04:25:06.874 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.875 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.875 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.875 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26179 5.3 e27/20 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head v 27'1624, mlcod=27'1621)", 2024-04-19T04:25:06.875 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:06.875 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.529694966999999, 2024-04-19T04:25:06.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039964081999999998, 2024-04-19T04:25:06.875 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:06.875 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:06.875 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:06.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:06.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:06.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:06.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:06.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:06.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:06.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243713+0000", 2024-04-19T04:25:06.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:06.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:06.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243750+0000", 2024-04-19T04:25:06.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6704e-05 2024-04-19T04:25:06.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:06.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280162+0000", 2024-04-19T04:25:06.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036412117000000001 2024-04-19T04:25:06.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:06.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280186+0000", 2024-04-19T04:25:06.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4825999999999999e-05 2024-04-19T04:25:06.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:06.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:06.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012540000000000001 2024-04-19T04:25:06.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:06.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280347+0000", 2024-04-19T04:25:06.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4894000000000002e-05 2024-04-19T04:25:06.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:06.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283654+0000", 2024-04-19T04:25:06.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00330716 2024-04-19T04:25:06.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:06.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:06.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:06.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283678+0000", 2024-04-19T04:25:06.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3992e-05 2024-04-19T04:25:06.879 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.879 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.879 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.879 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:06.879 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:06.879 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:06.879 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T04:25:06.879 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T04:25:06.879 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-19T04:25:06.880 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-19T04:25:06.880 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-19T04:25:06.880 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-19T04:25:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-04-19T04:25:06.882 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:25:06.883 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:06.878+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:06.982 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:06.975+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:07.024 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:25:07.024 INFO:teuthology.orchestra.run.smithi066.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-19T04:25:07.024 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:25:07.036 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:25:07.036 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [ 2024-04-19T04:25:07.036 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.036 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:51898 5.e e35/20 5:7994da44:::benchmark_data_smithi007_19526_object51897:head v 35'3333, mlcod=35'3331)", 2024-04-19T04:25:07.036 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:07.030806+0000", 2024-04-19T04:25:07.036 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0042220169999999998, 2024-04-19T04:25:07.036 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0042399309999999997, 2024-04-19T04:25:07.036 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.036 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:07.037 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.037 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.037 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.037 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.030806+0000", 2024-04-19T04:25:07.037 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.037 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.037 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.037 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.037 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.030806+0000", 2024-04-19T04:25:07.037 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.037 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.037 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.037 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.037 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.030806+0000", 2024-04-19T04:25:07.038 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.038 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.038 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.038 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.038 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.030859+0000", 2024-04-19T04:25:07.038 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.3647999999999999e-05 2024-04-19T04:25:07.038 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.038 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.038 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.038 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.030873+0000", 2024-04-19T04:25:07.038 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3784999999999999e-05 2024-04-19T04:25:07.038 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.038 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.039 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.039 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.030880+0000", 2024-04-19T04:25:07.039 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.1110000000000002e-06 2024-04-19T04:25:07.039 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.039 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.039 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.039 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.030923+0000", 2024-04-19T04:25:07.039 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2848e-05 2024-04-19T04:25:07.039 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.039 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.039 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.039 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.030943+0000", 2024-04-19T04:25:07.039 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.0304000000000001e-05 2024-04-19T04:25:07.039 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.040 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.040 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.040 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.040 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.040 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:51900 5.1 e35/20 5:82e50e37:::benchmark_data_smithi007_19526_object51899:head v 35'3298, mlcod=35'3295)", 2024-04-19T04:25:07.040 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:07.030812+0000", 2024-04-19T04:25:07.040 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0042165559999999998, 2024-04-19T04:25:07.040 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0042739320000000003, 2024-04-19T04:25:07.040 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.040 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:07.040 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.040 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.040 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.040 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.030812+0000", 2024-04-19T04:25:07.040 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.041 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.041 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.041 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.041 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.030812+0000", 2024-04-19T04:25:07.041 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.041 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.041 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.041 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.041 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.030811+0000", 2024-04-19T04:25:07.041 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.041 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.041 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.041 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.041 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.030904+0000", 2024-04-19T04:25:07.042 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.3072999999999995e-05 2024-04-19T04:25:07.042 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.042 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.042 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.042 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.030913+0000", 2024-04-19T04:25:07.042 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.0110000000000006e-06 2024-04-19T04:25:07.042 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.042 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.042 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.042 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.030919+0000", 2024-04-19T04:25:07.042 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.0990000000000004e-06 2024-04-19T04:25:07.042 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.042 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.042 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.043 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.030960+0000", 2024-04-19T04:25:07.043 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.0812999999999997e-05 2024-04-19T04:25:07.043 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.043 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.043 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.043 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.030983+0000", 2024-04-19T04:25:07.043 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2671999999999999e-05 2024-04-19T04:25:07.043 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.043 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.043 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.043 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.043 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.043 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:51901 5.c 5:3e33de73:::benchmark_data_smithi007_19526_object51900:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:07.043 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:07.032840+0000", 2024-04-19T04:25:07.043 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.002188588, 2024-04-19T04:25:07.044 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.002284913, 2024-04-19T04:25:07.044 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.044 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:07.044 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:07.044 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:07.044 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.044 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 51901 2024-04-19T04:25:07.044 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.044 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.044 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.044 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.045 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.032840+0000", 2024-04-19T04:25:07.045 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.045 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.045 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.045 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.045 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.032840+0000", 2024-04-19T04:25:07.045 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.045 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.045 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.045 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.045 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.032839+0000", 2024-04-19T04:25:07.045 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:07.045 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.045 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.045 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.046 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.032879+0000", 2024-04-19T04:25:07.046 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.0556999999999998e-05 2024-04-19T04:25:07.046 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.046 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.046 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.046 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.032888+0000", 2024-04-19T04:25:07.046 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.4670000000000004e-06 2024-04-19T04:25:07.046 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.046 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.046 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.046 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.032893+0000", 2024-04-19T04:25:07.046 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.6470000000000003e-06 2024-04-19T04:25:07.046 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.046 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.046 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.047 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.032936+0000", 2024-04-19T04:25:07.047 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2670000000000003e-05 2024-04-19T04:25:07.047 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.047 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.047 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.047 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.033141+0000", 2024-04-19T04:25:07.047 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000204997 2024-04-19T04:25:07.047 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.047 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.047 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.047 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.033331+0000", 2024-04-19T04:25:07.047 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00019042000000000001 2024-04-19T04:25:07.047 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.048 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.048 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.048 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.048 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.048 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:51904 5.8 5.8708b728 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:07.048 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:07.034829+0000", 2024-04-19T04:25:07.048 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00019923799999999999, 2024-04-19T04:25:07.048 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00034727800000000002, 2024-04-19T04:25:07.048 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.048 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:07.048 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:07.048 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:07.048 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.048 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 51904 2024-04-19T04:25:07.048 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.049 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.049 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.049 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.049 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.034829+0000", 2024-04-19T04:25:07.049 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.049 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.049 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.049 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.049 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.034829+0000", 2024-04-19T04:25:07.049 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.049 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.049 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.049 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.049 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.034828+0000", 2024-04-19T04:25:07.049 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:07.050 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.050 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.050 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.050 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.034934+0000", 2024-04-19T04:25:07.050 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000106334 2024-04-19T04:25:07.050 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.050 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.050 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.050 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.034950+0000", 2024-04-19T04:25:07.050 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.5566999999999999e-05 2024-04-19T04:25:07.050 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.050 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.050 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.051 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.034958+0000", 2024-04-19T04:25:07.051 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.6479999999999992e-06 2024-04-19T04:25:07.051 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.051 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.051 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.051 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.051 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.051 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:51886 5.c 5:3350c2ab:::benchmark_data_smithi007_19526_object51885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:07.051 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:07.023057+0000", 2024-04-19T04:25:07.051 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.011971021, 2024-04-19T04:25:07.051 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.012173274, 2024-04-19T04:25:07.051 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.051 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:07.051 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:07.051 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:07.052 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.052 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 51886 2024-04-19T04:25:07.052 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.052 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.052 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.052 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.052 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.023057+0000", 2024-04-19T04:25:07.052 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.052 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.052 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.052 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.052 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.023057+0000", 2024-04-19T04:25:07.052 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.052 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.053 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.053 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.053 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.023056+0000", 2024-04-19T04:25:07.053 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.053 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.053 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.053 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.053 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.023176+0000", 2024-04-19T04:25:07.053 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000119509 2024-04-19T04:25:07.053 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.053 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.053 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.053 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.023189+0000", 2024-04-19T04:25:07.053 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2887999999999999e-05 2024-04-19T04:25:07.053 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.054 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.054 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.054 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.023212+0000", 2024-04-19T04:25:07.054 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.3331000000000001e-05 2024-04-19T04:25:07.054 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.054 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.054 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.054 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.024947+0000", 2024-04-19T04:25:07.054 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0017349679999999999 2024-04-19T04:25:07.054 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.054 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.054 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.054 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.025097+0000", 2024-04-19T04:25:07.054 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000150116 2024-04-19T04:25:07.055 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.055 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.055 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.055 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.025241+0000", 2024-04-19T04:25:07.055 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014343099999999999 2024-04-19T04:25:07.055 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.055 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.055 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.055 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.032619+0000", 2024-04-19T04:25:07.055 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0073779730000000003 2024-04-19T04:25:07.055 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.055 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.055 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:07.056 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.035207+0000", 2024-04-19T04:25:07.056 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0025883759999999999 2024-04-19T04:25:07.056 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.056 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.056 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.056 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.056 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.056 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:51897 5.0 e35/20 5:01352c91:::benchmark_data_smithi007_19526_object51896:head v 35'3227, mlcod=35'3223)", 2024-04-19T04:25:07.056 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:07.028742+0000", 2024-04-19T04:25:07.056 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0062863830000000004, 2024-04-19T04:25:07.056 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0065593090000000001, 2024-04-19T04:25:07.056 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.056 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:07.056 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.056 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.057 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.057 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.028742+0000", 2024-04-19T04:25:07.057 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.057 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.057 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.057 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.057 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.028742+0000", 2024-04-19T04:25:07.057 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.057 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.057 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.057 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.057 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.028742+0000", 2024-04-19T04:25:07.057 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:07.057 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.057 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.058 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.058 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.028789+0000", 2024-04-19T04:25:07.058 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7052999999999998e-05 2024-04-19T04:25:07.058 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.058 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.058 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.058 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.028803+0000", 2024-04-19T04:25:07.058 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.4236000000000001e-05 2024-04-19T04:25:07.058 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.058 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.058 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.058 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.028809+0000", 2024-04-19T04:25:07.058 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.083e-06 2024-04-19T04:25:07.058 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.059 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.059 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.059 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.029954+0000", 2024-04-19T04:25:07.059 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0011455289999999999 2024-04-19T04:25:07.059 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.059 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.059 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.059 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.029967+0000", 2024-04-19T04:25:07.059 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2594e-05 2024-04-19T04:25:07.059 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.059 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.059 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.059 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.059 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-04-19T04:25:07.059 INFO:teuthology.orchestra.run.smithi066.stdout: "num_ops": 6 2024-04-19T04:25:07.060 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:25:07.061 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:25:07.082 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:07.078+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:07.183 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:07.182+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:07.202 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:25:07.202 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [], 2024-04-19T04:25:07.202 INFO:teuthology.orchestra.run.smithi066.stdout: "complaint_time": 30, 2024-04-19T04:25:07.202 INFO:teuthology.orchestra.run.smithi066.stdout: "num_blocked_ops": 0 2024-04-19T04:25:07.202 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:25:07.216 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:25:07.284 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:07.279+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:07.353 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:25:07.353 INFO:teuthology.orchestra.run.smithi066.stdout: "size": 20, 2024-04-19T04:25:07.353 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 600, 2024-04-19T04:25:07.353 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [ 2024-04-19T04:25:07.353 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.353 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:07.354 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:25:07.354 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 46.816747939999999, 2024-04-19T04:25:07.354 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019436790999999998, 2024-04-19T04:25:07.354 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.354 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.354 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.354 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.354 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.354 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:25:07.354 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.354 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.354 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.354 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.354 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:25:07.355 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.355 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.355 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.355 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.355 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533562+0000", 2024-04-19T04:25:07.355 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999967 2024-04-19T04:25:07.355 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.355 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.355 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.355 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533588+0000", 2024-04-19T04:25:07.355 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.6128000000000001e-05 2024-04-19T04:25:07.355 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.355 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.355 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.355 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533617+0000", 2024-04-19T04:25:07.356 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.8685000000000001e-05 2024-04-19T04:25:07.356 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.356 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.356 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.356 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533649+0000", 2024-04-19T04:25:07.356 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.2532e-05 2024-04-19T04:25:07.356 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.356 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.356 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.356 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536605+0000", 2024-04-19T04:25:07.356 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0029553130000000002 2024-04-19T04:25:07.356 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.356 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.356 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.356 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536746+0000", 2024-04-19T04:25:07.357 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000141011 2024-04-19T04:25:07.357 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.357 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.357 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.357 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536889+0000", 2024-04-19T04:25:07.357 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000143437 2024-04-19T04:25:07.357 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.357 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.357 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:07.357 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542807+0000", 2024-04-19T04:25:07.357 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0059181210000000001 2024-04-19T04:25:07.357 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.357 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.357 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.358 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.552917+0000", 2024-04-19T04:25:07.358 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010110111 2024-04-19T04:25:07.358 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.358 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.358 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:07.358 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.552962+0000", 2024-04-19T04:25:07.358 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.4811999999999997e-05 2024-04-19T04:25:07.359 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.359 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.359 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.359 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553002+0000", 2024-04-19T04:25:07.359 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9957999999999999e-05 2024-04-19T04:25:07.359 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.359 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.360 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.360 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.360 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.360 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:07.360 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:25:07.360 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 46.816631995999998, 2024-04-19T04:25:07.360 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019464940999999999, 2024-04-19T04:25:07.360 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.360 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.360 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.360 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.360 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.360 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:25:07.360 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.360 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.361 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.361 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.361 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:25:07.361 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.361 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.361 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.361 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.361 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533680+0000", 2024-04-19T04:25:07.361 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:07.361 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.361 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.361 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.361 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533692+0000", 2024-04-19T04:25:07.361 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2235000000000001e-05 2024-04-19T04:25:07.361 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.362 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.362 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.362 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533770+0000", 2024-04-19T04:25:07.362 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.8248e-05 2024-04-19T04:25:07.362 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.362 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.362 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.362 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:25:07.362 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8671000000000001e-05 2024-04-19T04:25:07.362 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.362 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.362 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.362 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539610+0000", 2024-04-19T04:25:07.362 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0058206669999999999 2024-04-19T04:25:07.363 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.363 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.363 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.363 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539705+0000", 2024-04-19T04:25:07.363 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.5313e-05 2024-04-19T04:25:07.363 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.363 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.363 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.363 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539857+0000", 2024-04-19T04:25:07.363 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000151881 2024-04-19T04:25:07.363 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.363 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.363 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:07.363 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542812+0000", 2024-04-19T04:25:07.363 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.002954857 2024-04-19T04:25:07.364 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.364 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.364 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.364 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553058+0000", 2024-04-19T04:25:07.364 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010246570999999999 2024-04-19T04:25:07.364 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.364 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.364 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:07.364 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553104+0000", 2024-04-19T04:25:07.364 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.5235999999999999e-05 2024-04-19T04:25:07.364 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.364 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.364 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.364 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553146+0000", 2024-04-19T04:25:07.364 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2725999999999997e-05 2024-04-19T04:25:07.365 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.365 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.365 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.365 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.365 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.365 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:21 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:07.365 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:25:07.365 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 46.816372895999997, 2024-04-19T04:25:07.365 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019340466000000001, 2024-04-19T04:25:07.365 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.365 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.365 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.365 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.365 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.365 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:25:07.366 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.366 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.366 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.366 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.366 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:25:07.366 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.366 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.366 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.366 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.366 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533939+0000", 2024-04-19T04:25:07.366 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.366 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.366 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.366 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.366 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533950+0000", 2024-04-19T04:25:07.367 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0533999999999999e-05 2024-04-19T04:25:07.367 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.367 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.367 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.367 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533973+0000", 2024-04-19T04:25:07.367 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2614000000000001e-05 2024-04-19T04:25:07.367 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.367 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.367 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.367 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:07.367 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3531e-05 2024-04-19T04:25:07.367 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.367 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.367 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.367 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541149+0000", 2024-04-19T04:25:07.368 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0071628780000000001 2024-04-19T04:25:07.368 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.368 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.368 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.368 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541279+0000", 2024-04-19T04:25:07.368 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013014999999999999 2024-04-19T04:25:07.368 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.368 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.368 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.368 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541430+0000", 2024-04-19T04:25:07.368 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015048399999999999 2024-04-19T04:25:07.368 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.368 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.368 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:07.369 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.543384+0000", 2024-04-19T04:25:07.369 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001954468 2024-04-19T04:25:07.369 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.369 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.369 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.369 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553193+0000", 2024-04-19T04:25:07.369 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0098089059999999992 2024-04-19T04:25:07.369 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.369 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.369 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:07.369 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553245+0000", 2024-04-19T04:25:07.369 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.1742e-05 2024-04-19T04:25:07.369 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.369 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.370 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.370 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553281+0000", 2024-04-19T04:25:07.370 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6272000000000001e-05 2024-04-19T04:25:07.370 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.370 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.370 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.370 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.370 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.370 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:07.370 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:25:07.370 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 46.816315645000003, 2024-04-19T04:25:07.370 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019497464999999999, 2024-04-19T04:25:07.370 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.370 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.370 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.371 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.371 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.371 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:25:07.371 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.371 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.371 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.371 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.371 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:25:07.371 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.371 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.371 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.371 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.371 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533997+0000", 2024-04-19T04:25:07.371 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.371 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.372 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.372 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.372 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534019+0000", 2024-04-19T04:25:07.372 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.1871000000000001e-05 2024-04-19T04:25:07.372 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.372 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.372 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.372 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534036+0000", 2024-04-19T04:25:07.372 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.7073999999999999e-05 2024-04-19T04:25:07.372 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.372 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.372 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.372 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:07.372 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3781000000000001e-05 2024-04-19T04:25:07.373 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.373 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.373 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.373 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534167+0000", 2024-04-19T04:25:07.373 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000117463 2024-04-19T04:25:07.373 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.373 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.373 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.373 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.535182+0000", 2024-04-19T04:25:07.373 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0010149340000000001 2024-04-19T04:25:07.373 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.373 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.373 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.373 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.535459+0000", 2024-04-19T04:25:07.373 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000277013 2024-04-19T04:25:07.374 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.374 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.374 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:07.374 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.540338+0000", 2024-04-19T04:25:07.374 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0048786109999999997 2024-04-19T04:25:07.374 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.374 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.374 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.374 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553416+0000", 2024-04-19T04:25:07.374 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013078251000000001 2024-04-19T04:25:07.374 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.374 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.374 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:07.375 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553456+0000", 2024-04-19T04:25:07.375 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.0516999999999998e-05 2024-04-19T04:25:07.375 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.375 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.375 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.375 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553495+0000", 2024-04-19T04:25:07.375 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8899999999999997e-05 2024-04-19T04:25:07.375 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.375 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.375 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.375 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.375 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.375 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:07.375 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:25:07.375 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 46.816217258999998, 2024-04-19T04:25:07.375 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019607754000000002, 2024-04-19T04:25:07.376 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.376 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:07.376 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.376 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.376 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.376 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:25:07.376 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.376 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.376 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.376 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.376 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:25:07.376 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.376 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.376 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.377 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.377 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534095+0000", 2024-04-19T04:25:07.377 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:07.377 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.377 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.377 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.377 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534104+0000", 2024-04-19T04:25:07.378 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.9779999999999994e-06 2024-04-19T04:25:07.378 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.378 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.378 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.378 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534122+0000", 2024-04-19T04:25:07.378 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8464000000000001e-05 2024-04-19T04:25:07.378 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.378 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.378 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.378 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534142+0000", 2024-04-19T04:25:07.378 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.9287999999999999e-05 2024-04-19T04:25:07.378 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.378 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.378 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.379 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.538550+0000", 2024-04-19T04:25:07.379 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0044085560000000001 2024-04-19T04:25:07.379 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.379 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.379 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.379 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.538726+0000", 2024-04-19T04:25:07.379 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017599299999999999 2024-04-19T04:25:07.379 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.379 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.379 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.379 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553704+0000", 2024-04-19T04:25:07.379 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.014977802 2024-04-19T04:25:07.379 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.379 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.379 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.380 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.380 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.380 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:07.380 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:25:07.380 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 46.816130370000003, 2024-04-19T04:25:07.380 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019220208999999999, 2024-04-19T04:25:07.380 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.380 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:07.380 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.380 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.380 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.380 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:25:07.380 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.380 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.380 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.380 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.381 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:25:07.381 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.381 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.381 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.381 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.381 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534182+0000", 2024-04-19T04:25:07.381 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.381 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.381 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.381 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.381 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534189+0000", 2024-04-19T04:25:07.381 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3710000000000002e-06 2024-04-19T04:25:07.381 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.381 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.382 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.382 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534810+0000", 2024-04-19T04:25:07.382 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00062098000000000003 2024-04-19T04:25:07.382 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.382 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.382 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.382 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534829+0000", 2024-04-19T04:25:07.382 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8207999999999999e-05 2024-04-19T04:25:07.382 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.382 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.382 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.382 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542089+0000", 2024-04-19T04:25:07.382 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0072601710000000002 2024-04-19T04:25:07.382 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.382 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.383 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.383 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542225+0000", 2024-04-19T04:25:07.383 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000135988 2024-04-19T04:25:07.383 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.383 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.383 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.383 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553403+0000", 2024-04-19T04:25:07.383 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011178478 2024-04-19T04:25:07.383 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.383 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.383 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.383 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.383 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.383 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25792 5.6 5:6ead9788:::benchmark_data_smithi007_19526_object25791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:07.383 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.070174+0000", 2024-04-19T04:25:07.384 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 13.280139018, 2024-04-19T04:25:07.384 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.018078227999999998, 2024-04-19T04:25:07.384 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.384 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.384 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:07.384 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:07.384 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.384 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25792 2024-04-19T04:25:07.384 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.384 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.384 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.384 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.384 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070174+0000", 2024-04-19T04:25:07.384 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.384 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.385 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.385 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.385 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070174+0000", 2024-04-19T04:25:07.385 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.385 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.385 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.385 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.385 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070173+0000", 2024-04-19T04:25:07.385 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.385 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.385 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.385 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.385 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070241+0000", 2024-04-19T04:25:07.385 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7801999999999999e-05 2024-04-19T04:25:07.385 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.385 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.386 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.386 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070252+0000", 2024-04-19T04:25:07.386 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1405e-05 2024-04-19T04:25:07.386 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.386 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.386 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.386 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070258+0000", 2024-04-19T04:25:07.386 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4949999999999999e-06 2024-04-19T04:25:07.386 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.386 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.386 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.386 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070298+0000", 2024-04-19T04:25:07.386 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9932999999999999e-05 2024-04-19T04:25:07.386 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.387 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.387 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.387 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070386+0000", 2024-04-19T04:25:07.387 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8382999999999997e-05 2024-04-19T04:25:07.387 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.387 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.387 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.387 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070472+0000", 2024-04-19T04:25:07.387 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.5364999999999993e-05 2024-04-19T04:25:07.387 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.387 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.387 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.387 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.076618+0000", 2024-04-19T04:25:07.387 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.006146037 2024-04-19T04:25:07.387 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.388 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.388 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:07.388 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088147+0000", 2024-04-19T04:25:07.388 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011529634 2024-04-19T04:25:07.388 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.388 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.388 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:07.388 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088209+0000", 2024-04-19T04:25:07.388 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.1760999999999994e-05 2024-04-19T04:25:07.388 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.388 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.388 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.388 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088253+0000", 2024-04-19T04:25:07.388 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.3547000000000002e-05 2024-04-19T04:25:07.388 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.388 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.389 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.389 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.389 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.389 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:25794 5.e e27/20 5:77ddc1c5:::benchmark_data_smithi007_19526_object25793:head v 27'1671, mlcod=27'1669)", 2024-04-19T04:25:07.389 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.072074+0000", 2024-04-19T04:25:07.389 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 13.278239316000001, 2024-04-19T04:25:07.389 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.016881862000000001, 2024-04-19T04:25:07.389 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.389 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.389 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.389 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.389 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.389 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072074+0000", 2024-04-19T04:25:07.389 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.389 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.390 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.390 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.390 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072074+0000", 2024-04-19T04:25:07.390 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.390 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.390 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.390 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.390 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072073+0000", 2024-04-19T04:25:07.390 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.390 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.390 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.390 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.390 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072119+0000", 2024-04-19T04:25:07.390 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.6301999999999998e-05 2024-04-19T04:25:07.390 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.391 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.391 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.391 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072130+0000", 2024-04-19T04:25:07.391 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1018e-05 2024-04-19T04:25:07.391 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.391 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.391 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.391 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072138+0000", 2024-04-19T04:25:07.391 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.131e-06 2024-04-19T04:25:07.391 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.391 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.391 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.391 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072176+0000", 2024-04-19T04:25:07.391 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8674000000000003e-05 2024-04-19T04:25:07.391 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.392 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.392 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.392 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.072191+0000", 2024-04-19T04:25:07.392 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.5245000000000001e-05 2024-04-19T04:25:07.392 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.392 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.392 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:07.392 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088908+0000", 2024-04-19T04:25:07.392 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.016716742 2024-04-19T04:25:07.392 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.392 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.392 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.392 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088956+0000", 2024-04-19T04:25:07.392 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7675e-05 2024-04-19T04:25:07.392 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.392 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.393 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.393 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.393 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.393 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26158 5.3 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:07.393 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.232719+0000", 2024-04-19T04:25:07.393 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 13.117594349999999, 2024-04-19T04:25:07.393 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.049770017, 2024-04-19T04:25:07.393 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.393 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.393 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:07.393 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:07.393 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.393 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26158 2024-04-19T04:25:07.393 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.394 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.394 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.394 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.394 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232719+0000", 2024-04-19T04:25:07.394 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.394 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.394 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.394 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.394 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232719+0000", 2024-04-19T04:25:07.394 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.394 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.394 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.394 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.394 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232718+0000", 2024-04-19T04:25:07.394 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.395 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.395 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.395 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.395 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232791+0000", 2024-04-19T04:25:07.395 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2421000000000003e-05 2024-04-19T04:25:07.395 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.395 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.395 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.395 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232804+0000", 2024-04-19T04:25:07.395 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3037000000000001e-05 2024-04-19T04:25:07.395 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.395 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.395 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.395 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232812+0000", 2024-04-19T04:25:07.395 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.2630000000000003e-06 2024-04-19T04:25:07.396 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.396 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.396 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.396 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232971+0000", 2024-04-19T04:25:07.396 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000159419 2024-04-19T04:25:07.396 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.396 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.396 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.396 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233124+0000", 2024-04-19T04:25:07.396 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000153182 2024-04-19T04:25:07.396 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.396 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.396 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.396 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233283+0000", 2024-04-19T04:25:07.396 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000158321 2024-04-19T04:25:07.397 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.397 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.397 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:07.397 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.236041+0000", 2024-04-19T04:25:07.397 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0027577919999999998 2024-04-19T04:25:07.397 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.397 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.397 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.397 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282307+0000", 2024-04-19T04:25:07.397 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.046266008999999997 2024-04-19T04:25:07.397 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.397 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.397 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:07.397 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282414+0000", 2024-04-19T04:25:07.397 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000107611 2024-04-19T04:25:07.398 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.398 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.398 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.398 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282489+0000", 2024-04-19T04:25:07.398 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.4805e-05 2024-04-19T04:25:07.398 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.398 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.398 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.399 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.399 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.399 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26164 5.6 5:63a08103:::benchmark_data_smithi007_19526_object26163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:07.399 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.233982+0000", 2024-04-19T04:25:07.399 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 13.116330962999999, 2024-04-19T04:25:07.399 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.047707233000000002, 2024-04-19T04:25:07.399 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.399 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.399 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:07.399 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:07.399 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.400 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26164 2024-04-19T04:25:07.400 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.400 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.400 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.400 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.400 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233982+0000", 2024-04-19T04:25:07.400 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.400 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.400 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.400 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.400 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233982+0000", 2024-04-19T04:25:07.400 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.400 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.400 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.400 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.401 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233981+0000", 2024-04-19T04:25:07.401 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:07.401 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.401 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.401 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.401 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234040+0000", 2024-04-19T04:25:07.401 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.8782000000000001e-05 2024-04-19T04:25:07.401 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.401 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.401 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.401 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234051+0000", 2024-04-19T04:25:07.401 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0822000000000001e-05 2024-04-19T04:25:07.401 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.401 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.401 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.402 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234059+0000", 2024-04-19T04:25:07.402 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.7479999999999993e-06 2024-04-19T04:25:07.402 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.402 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.402 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.402 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234133+0000", 2024-04-19T04:25:07.402 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.4059000000000004e-05 2024-04-19T04:25:07.402 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.402 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.402 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.402 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234356+0000", 2024-04-19T04:25:07.402 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00022300400000000001 2024-04-19T04:25:07.402 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.402 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.402 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.403 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234515+0000", 2024-04-19T04:25:07.403 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015913599999999999 2024-04-19T04:25:07.403 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.403 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.403 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:07.403 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.236924+0000", 2024-04-19T04:25:07.403 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0024091989999999999 2024-04-19T04:25:07.403 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.403 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.403 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.403 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.281529+0000", 2024-04-19T04:25:07.403 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.044604984 2024-04-19T04:25:07.403 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.403 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.403 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:07.404 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.281616+0000", 2024-04-19T04:25:07.404 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.6784000000000001e-05 2024-04-19T04:25:07.404 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.404 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.404 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.404 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.281690+0000", 2024-04-19T04:25:07.404 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3907999999999998e-05 2024-04-19T04:25:07.404 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.404 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.404 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.404 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.404 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.404 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26170 5.c 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:07.405 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.237154+0000", 2024-04-19T04:25:07.405 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 13.113159700000001, 2024-04-19T04:25:07.405 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.045024630000000003, 2024-04-19T04:25:07.405 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.405 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.405 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:07.405 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:07.405 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.405 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26170 2024-04-19T04:25:07.405 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.405 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.405 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.405 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.405 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237154+0000", 2024-04-19T04:25:07.405 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.406 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.406 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.406 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.406 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237154+0000", 2024-04-19T04:25:07.406 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.406 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.406 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.406 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.406 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237153+0000", 2024-04-19T04:25:07.406 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.406 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.406 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.406 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.406 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237230+0000", 2024-04-19T04:25:07.407 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.6827000000000002e-05 2024-04-19T04:25:07.407 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.407 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.407 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.407 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237241+0000", 2024-04-19T04:25:07.407 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1270999999999999e-05 2024-04-19T04:25:07.407 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.407 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.407 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.407 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237248+0000", 2024-04-19T04:25:07.407 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.622e-06 2024-04-19T04:25:07.407 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.407 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.407 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.408 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237341+0000", 2024-04-19T04:25:07.408 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.2417999999999995e-05 2024-04-19T04:25:07.408 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.408 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.408 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.408 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237450+0000", 2024-04-19T04:25:07.408 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00010864700000000001 2024-04-19T04:25:07.408 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.408 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.408 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.408 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237554+0000", 2024-04-19T04:25:07.408 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00010459999999999999 2024-04-19T04:25:07.408 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.408 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.409 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:07.409 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.239374+0000", 2024-04-19T04:25:07.409 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0018197370000000001 2024-04-19T04:25:07.409 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.409 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.409 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.409 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282078+0000", 2024-04-19T04:25:07.409 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.042703868999999998 2024-04-19T04:25:07.409 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.409 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.409 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:07.409 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282132+0000", 2024-04-19T04:25:07.409 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4302999999999998e-05 2024-04-19T04:25:07.409 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.409 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.410 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.410 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282178+0000", 2024-04-19T04:25:07.410 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.6224000000000003e-05 2024-04-19T04:25:07.410 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.410 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.410 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.410 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.410 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.410 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26179 5.3 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:07.410 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.241433+0000", 2024-04-19T04:25:07.410 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 13.108880305, 2024-04-19T04:25:07.410 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.041219473, 2024-04-19T04:25:07.410 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.410 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.410 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:07.411 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:07.411 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.411 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26179 2024-04-19T04:25:07.411 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.411 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.411 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.411 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.411 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241433+0000", 2024-04-19T04:25:07.411 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.411 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.411 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.411 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.411 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241433+0000", 2024-04-19T04:25:07.411 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.411 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.412 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.412 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.412 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:07.412 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.412 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.412 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.412 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.412 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241517+0000", 2024-04-19T04:25:07.412 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.4895999999999995e-05 2024-04-19T04:25:07.412 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.412 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.412 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.412 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241529+0000", 2024-04-19T04:25:07.412 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1846e-05 2024-04-19T04:25:07.412 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241535+0000", 2024-04-19T04:25:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.8919999999999997e-06 2024-04-19T04:25:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241573+0000", 2024-04-19T04:25:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8936000000000001e-05 2024-04-19T04:25:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241675+0000", 2024-04-19T04:25:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000101983 2024-04-19T04:25:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241759+0000", 2024-04-19T04:25:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.3533000000000001e-05 2024-04-19T04:25:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243038+0000", 2024-04-19T04:25:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001279449 2024-04-19T04:25:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282563+0000", 2024-04-19T04:25:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.039524694999999999 2024-04-19T04:25:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282616+0000", 2024-04-19T04:25:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2432999999999998e-05 2024-04-19T04:25:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282653+0000", 2024-04-19T04:25:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6959999999999998e-05 2024-04-19T04:25:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26181 5.6 5:61db10b4:::benchmark_data_smithi007_19526_object26180:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.243304+0000", 2024-04-19T04:25:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 13.107008967000001, 2024-04-19T04:25:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.043580885999999999, 2024-04-19T04:25:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26181 2024-04-19T04:25:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243304+0000", 2024-04-19T04:25:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243304+0000", 2024-04-19T04:25:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243303+0000", 2024-04-19T04:25:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243370+0000", 2024-04-19T04:25:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.6778000000000003e-05 2024-04-19T04:25:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243388+0000", 2024-04-19T04:25:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.7608000000000001e-05 2024-04-19T04:25:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243397+0000", 2024-04-19T04:25:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8279999999999992e-06 2024-04-19T04:25:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243444+0000", 2024-04-19T04:25:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7055000000000003e-05 2024-04-19T04:25:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243532+0000", 2024-04-19T04:25:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8782000000000005e-05 2024-04-19T04:25:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243614+0000", 2024-04-19T04:25:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.1199000000000006e-05 2024-04-19T04:25:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244915+0000", 2024-04-19T04:25:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001300893 2024-04-19T04:25:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286603+0000", 2024-04-19T04:25:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.041688847000000001 2024-04-19T04:25:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286792+0000", 2024-04-19T04:25:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00018885199999999999 2024-04-19T04:25:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286885+0000", 2024-04-19T04:25:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.3040000000000004e-05 2024-04-19T04:25:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26182 5.3 5:c032f6e9:::benchmark_data_smithi007_19526_object26181:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.244629+0000", 2024-04-19T04:25:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 13.105683892, 2024-04-19T04:25:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.041622474999999999, 2024-04-19T04:25:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26182 2024-04-19T04:25:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244629+0000", 2024-04-19T04:25:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244629+0000", 2024-04-19T04:25:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244628+0000", 2024-04-19T04:25:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244752+0000", 2024-04-19T04:25:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000123802 2024-04-19T04:25:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244765+0000", 2024-04-19T04:25:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2908000000000001e-05 2024-04-19T04:25:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244772+0000", 2024-04-19T04:25:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.6850000000000004e-06 2024-04-19T04:25:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244813+0000", 2024-04-19T04:25:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1211999999999998e-05 2024-04-19T04:25:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244919+0000", 2024-04-19T04:25:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000106147 2024-04-19T04:25:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244993+0000", 2024-04-19T04:25:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3538e-05 2024-04-19T04:25:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.246228+0000", 2024-04-19T04:25:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001235217 2024-04-19T04:25:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286111+0000", 2024-04-19T04:25:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.039882933000000002 2024-04-19T04:25:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286180+0000", 2024-04-19T04:25:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.9212000000000001e-05 2024-04-19T04:25:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286252+0000", 2024-04-19T04:25:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2016999999999998e-05 2024-04-19T04:25:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:35062 5.0 e31/20 5:0b09a143:::benchmark_data_smithi007_19526_object35061:head v 31'2153, mlcod=31'2150)", 2024-04-19T04:25:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:58.996704+0000", 2024-04-19T04:25:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 8.3536094670000001, 2024-04-19T04:25:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.016084524999999999, 2024-04-19T04:25:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.996704+0000", 2024-04-19T04:25:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.996704+0000", 2024-04-19T04:25:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.996703+0000", 2024-04-19T04:25:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.996807+0000", 2024-04-19T04:25:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000104097 2024-04-19T04:25:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.996818+0000", 2024-04-19T04:25:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0513000000000001e-05 2024-04-19T04:25:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.996825+0000", 2024-04-19T04:25:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.182e-06 2024-04-19T04:25:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.996929+0000", 2024-04-19T04:25:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000104246 2024-04-19T04:25:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:58.996952+0000", 2024-04-19T04:25:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2770000000000001e-05 2024-04-19T04:25:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.012717+0000", 2024-04-19T04:25:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.015764916 2024-04-19T04:25:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.012788+0000", 2024-04-19T04:25:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.1514999999999995e-05 2024-04-19T04:25:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:36977 5.8 5:173f5207:::benchmark_data_smithi007_19526_object36976:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:25:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:59.841031+0000", 2024-04-19T04:25:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 7.5092825869999995, 2024-04-19T04:25:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.016294800000000002, 2024-04-19T04:25:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 36977 2024-04-19T04:25:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841031+0000", 2024-04-19T04:25:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841031+0000", 2024-04-19T04:25:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841030+0000", 2024-04-19T04:25:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841097+0000", 2024-04-19T04:25:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7271e-05 2024-04-19T04:25:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841107+0000", 2024-04-19T04:25:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.7089999999999997e-06 2024-04-19T04:25:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841114+0000", 2024-04-19T04:25:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7360000000000004e-06 2024-04-19T04:25:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841843+0000", 2024-04-19T04:25:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00072877200000000004 2024-04-19T04:25:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.841988+0000", 2024-04-19T04:25:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000145272 2024-04-19T04:25:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.842143+0000", 2024-04-19T04:25:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015508300000000001 2024-04-19T04:25:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.844474+0000", 2024-04-19T04:25:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0023309260000000001 2024-04-19T04:25:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.857223+0000", 2024-04-19T04:25:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.012748894 2024-04-19T04:25:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.857272+0000", 2024-04-19T04:25:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.9620000000000003e-05 2024-04-19T04:25:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:59.857326+0000", 2024-04-19T04:25:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.3149000000000002e-05 2024-04-19T04:25:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:42899 5.8 5:16eae526:::benchmark_data_smithi007_19526_object42898:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:02.582894+0000", 2024-04-19T04:25:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.767418986, 2024-04-19T04:25:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.016001320999999999, 2024-04-19T04:25:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 42899 2024-04-19T04:25:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.582894+0000", 2024-04-19T04:25:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.582894+0000", 2024-04-19T04:25:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.582893+0000", 2024-04-19T04:25:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.582953+0000", 2024-04-19T04:25:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.0022999999999998e-05 2024-04-19T04:25:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.582964+0000", 2024-04-19T04:25:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0407999999999999e-05 2024-04-19T04:25:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.582971+0000", 2024-04-19T04:25:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2409999999999998e-06 2024-04-19T04:25:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.583158+0000", 2024-04-19T04:25:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000186493 2024-04-19T04:25:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.583292+0000", 2024-04-19T04:25:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000134726 2024-04-19T04:25:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.583434+0000", 2024-04-19T04:25:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014172100000000001 2024-04-19T04:25:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.587765+0000", 2024-04-19T04:25:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0043314080000000001 2024-04-19T04:25:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.598706+0000", 2024-04-19T04:25:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010941094 2024-04-19T04:25:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.598836+0000", 2024-04-19T04:25:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012905600000000001 2024-04-19T04:25:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:02.598896+0000", 2024-04-19T04:25:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.0161000000000002e-05 2024-04-19T04:25:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:44965 5.4 5:2784f732:::benchmark_data_smithi007_19526_object44964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:03.583573+0000", 2024-04-19T04:25:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 3.7667402999999999, 2024-04-19T04:25:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.015982224, 2024-04-19T04:25:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 44965 2024-04-19T04:25:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.583573+0000", 2024-04-19T04:25:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.583573+0000", 2024-04-19T04:25:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.583572+0000", 2024-04-19T04:25:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.583627+0000", 2024-04-19T04:25:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4740000000000001e-05 2024-04-19T04:25:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.583649+0000", 2024-04-19T04:25:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.1752000000000001e-05 2024-04-19T04:25:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.583661+0000", 2024-04-19T04:25:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2147000000000001e-05 2024-04-19T04:25:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.583727+0000", 2024-04-19T04:25:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.5701e-05 2024-04-19T04:25:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.583921+0000", 2024-04-19T04:25:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00019453100000000001 2024-04-19T04:25:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.584099+0000", 2024-04-19T04:25:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017755700000000001 2024-04-19T04:25:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.590868+0000", 2024-04-19T04:25:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0067690679999999996 2024-04-19T04:25:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.599487+0000", 2024-04-19T04:25:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0086186500000000003 2024-04-19T04:25:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.599530+0000", 2024-04-19T04:25:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.3736000000000003e-05 2024-04-19T04:25:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.599555+0000", 2024-04-19T04:25:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.499e-05 2024-04-19T04:25:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:44971 5.a 5:5cbf4e21:::benchmark_data_smithi007_19526_object44970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:03.587775+0000", 2024-04-19T04:25:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 3.7625386389999997, 2024-04-19T04:25:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.01799914, 2024-04-19T04:25:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 44971 2024-04-19T04:25:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.587775+0000", 2024-04-19T04:25:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.587775+0000", 2024-04-19T04:25:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.587774+0000", 2024-04-19T04:25:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.587846+0000", 2024-04-19T04:25:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2090999999999998e-05 2024-04-19T04:25:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.587899+0000", 2024-04-19T04:25:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2967000000000003e-05 2024-04-19T04:25:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.587905+0000", 2024-04-19T04:25:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.9939999999999997e-06 2024-04-19T04:25:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.587953+0000", 2024-04-19T04:25:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.8470999999999997e-05 2024-04-19T04:25:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.588120+0000", 2024-04-19T04:25:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00016616299999999999 2024-04-19T04:25:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.588297+0000", 2024-04-19T04:25:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017755000000000001 2024-04-19T04:25:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.596500+0000", 2024-04-19T04:25:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0082027469999999998 2024-04-19T04:25:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.605704+0000", 2024-04-19T04:25:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0092041310000000008 2024-04-19T04:25:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.605746+0000", 2024-04-19T04:25:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2293000000000003e-05 2024-04-19T04:25:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.605774+0000", 2024-04-19T04:25:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.7525000000000002e-05 2024-04-19T04:25:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:52299 5.2 e35/20 5:416eb181:::benchmark_data_smithi007_19526_object52298:head v 35'3275, mlcod=35'3272)", 2024-04-19T04:25:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:07.240826+0000", 2024-04-19T04:25:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.109487319, 2024-04-19T04:25:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.015917147, 2024-04-19T04:25:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.240826+0000", 2024-04-19T04:25:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.240826+0000", 2024-04-19T04:25:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.240826+0000", 2024-04-19T04:25:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.240868+0000", 2024-04-19T04:25:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1977000000000001e-05 2024-04-19T04:25:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.240875+0000", 2024-04-19T04:25:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.8170000000000001e-06 2024-04-19T04:25:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.240879+0000", 2024-04-19T04:25:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7010000000000004e-06 2024-04-19T04:25:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.241716+0000", 2024-04-19T04:25:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000836383 2024-04-19T04:25:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.241734+0000", 2024-04-19T04:25:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8720999999999999e-05 2024-04-19T04:25:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.256695+0000", 2024-04-19T04:25:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.014960539 2024-04-19T04:25:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.256743+0000", 2024-04-19T04:25:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.8312000000000001e-05 2024-04-19T04:25:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.457 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:07.457 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:07.457 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:25:07.458 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:07.459 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:07.455+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:07.559 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:07.555+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:07.576 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:07.577 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:07.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.577 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:52916 5.9 e35/20 5:9409a48e:::benchmark_data_smithi007_19526_object52915:head v 35'3423, mlcod=35'3420)", 2024-04-19T04:25:07.577 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:07.576109+0000", 2024-04-19T04:25:07.577 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0012417859999999999, 2024-04-19T04:25:07.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012616369999999999, 2024-04-19T04:25:07.577 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.577 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:07.577 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.576109+0000", 2024-04-19T04:25:07.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.576109+0000", 2024-04-19T04:25:07.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.576108+0000", 2024-04-19T04:25:07.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.576164+0000", 2024-04-19T04:25:07.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6032000000000002e-05 2024-04-19T04:25:07.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.576179+0000", 2024-04-19T04:25:07.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4525999999999999e-05 2024-04-19T04:25:07.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.576186+0000", 2024-04-19T04:25:07.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0520000000000004e-06 2024-04-19T04:25:07.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.576228+0000", 2024-04-19T04:25:07.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1730999999999997e-05 2024-04-19T04:25:07.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.576246+0000", 2024-04-19T04:25:07.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8757999999999999e-05 2024-04-19T04:25:07.580 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.580 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.580 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.580 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:52919 5.a e35/20 5:520f41c2:::benchmark_data_smithi007_19526_object52918:head v 35'3316, mlcod=35'3313)", 2024-04-19T04:25:07.580 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:07.576585+0000", 2024-04-19T04:25:07.580 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00076638800000000001, 2024-04-19T04:25:07.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00083041099999999997, 2024-04-19T04:25:07.581 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.581 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:07.581 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.576585+0000", 2024-04-19T04:25:07.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.576585+0000", 2024-04-19T04:25:07.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.576584+0000", 2024-04-19T04:25:07.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.576651+0000", 2024-04-19T04:25:07.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7361999999999996e-05 2024-04-19T04:25:07.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.576669+0000", 2024-04-19T04:25:07.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8213999999999999e-05 2024-04-19T04:25:07.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.576677+0000", 2024-04-19T04:25:07.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6890000000000004e-06 2024-04-19T04:25:07.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.576735+0000", 2024-04-19T04:25:07.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8371000000000001e-05 2024-04-19T04:25:07.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.576757+0000", 2024-04-19T04:25:07.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2266e-05 2024-04-19T04:25:07.585 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.585 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.585 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.585 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.585 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:07.585 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 2 2024-04-19T04:25:07.585 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:07.587 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:07.659 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:07.658+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:07.708 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:07.708 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:07.708 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:07.708 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:07.709 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:07.721 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:07.752 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 23 16 53258 53242 144.662 118.188 0.00322079 0.00690635 2024-04-19T04:25:07.761 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:07.758+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:07.843 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:07.843 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:07.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:07.843 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:07.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.843 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:07.843 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539646+0000", 2024-04-19T04:25:07.843 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 47.301140979000003, 2024-04-19T04:25:07.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015767644000000001, 2024-04-19T04:25:07.843 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.843 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.844 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539646+0000", 2024-04-19T04:25:07.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539646+0000", 2024-04-19T04:25:07.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.845 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539645+0000", 2024-04-19T04:25:07.845 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:07.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.845 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539672+0000", 2024-04-19T04:25:07.845 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7036999999999999e-05 2024-04-19T04:25:07.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.845 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539691+0000", 2024-04-19T04:25:07.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8929000000000001e-05 2024-04-19T04:25:07.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.846 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.846 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539707+0000", 2024-04-19T04:25:07.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5979999999999999e-05 2024-04-19T04:25:07.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.846 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.846 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542292+0000", 2024-04-19T04:25:07.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025857020000000001 2024-04-19T04:25:07.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.847 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.847 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.847 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542472+0000", 2024-04-19T04:25:07.847 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018001599999999999 2024-04-19T04:25:07.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.847 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.847 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543505+0000", 2024-04-19T04:25:07.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010326739999999999 2024-04-19T04:25:07.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547314+0000", 2024-04-19T04:25:07.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038089349999999998 2024-04-19T04:25:07.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555323+0000", 2024-04-19T04:25:07.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080089979999999998 2024-04-19T04:25:07.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555378+0000", 2024-04-19T04:25:07.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4951999999999998e-05 2024-04-19T04:25:07.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555414+0000", 2024-04-19T04:25:07.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5998000000000003e-05 2024-04-19T04:25:07.849 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.849 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.849 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.850 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:07.850 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539729+0000", 2024-04-19T04:25:07.850 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 47.301057884000002, 2024-04-19T04:25:07.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015615043, 2024-04-19T04:25:07.850 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.850 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.850 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.850 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539729+0000", 2024-04-19T04:25:07.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539729+0000", 2024-04-19T04:25:07.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539728+0000", 2024-04-19T04:25:07.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:07.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.852 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539737+0000", 2024-04-19T04:25:07.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5799999999999992e-06 2024-04-19T04:25:07.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539753+0000", 2024-04-19T04:25:07.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6373000000000001e-05 2024-04-19T04:25:07.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539770+0000", 2024-04-19T04:25:07.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7516e-05 2024-04-19T04:25:07.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.542136+0000", 2024-04-19T04:25:07.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023653440000000001 2024-04-19T04:25:07.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543783+0000", 2024-04-19T04:25:07.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016468209999999999 2024-04-19T04:25:07.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.543971+0000", 2024-04-19T04:25:07.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018871200000000001 2024-04-19T04:25:07.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547318+0000", 2024-04-19T04:25:07.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033471199999999999 2024-04-19T04:25:07.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555276+0000", 2024-04-19T04:25:07.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079574280000000008 2024-04-19T04:25:07.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555320+0000", 2024-04-19T04:25:07.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3664000000000001e-05 2024-04-19T04:25:07.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.555344+0000", 2024-04-19T04:25:07.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4905e-05 2024-04-19T04:25:07.856 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.856 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.856 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.856 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:07.856 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:25:07.856 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 47.300944319999999, 2024-04-19T04:25:07.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018096054, 2024-04-19T04:25:07.856 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.856 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.856 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:25:07.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:25:07.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539842+0000", 2024-04-19T04:25:07.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:07.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539848+0000", 2024-04-19T04:25:07.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-19T04:25:07.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539859+0000", 2024-04-19T04:25:07.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0783e-05 2024-04-19T04:25:07.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539866+0000", 2024-04-19T04:25:07.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9439999999999999e-06 2024-04-19T04:25:07.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547400+0000", 2024-04-19T04:25:07.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075343729999999996 2024-04-19T04:25:07.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547480+0000", 2024-04-19T04:25:07.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9793e-05 2024-04-19T04:25:07.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547587+0000", 2024-04-19T04:25:07.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107333 2024-04-19T04:25:07.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.548935+0000", 2024-04-19T04:25:07.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013480639999999999 2024-04-19T04:25:07.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557892+0000", 2024-04-19T04:25:07.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089563939999999995 2024-04-19T04:25:07.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557920+0000", 2024-04-19T04:25:07.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8342000000000001e-05 2024-04-19T04:25:07.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557939+0000", 2024-04-19T04:25:07.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9142000000000001e-05 2024-04-19T04:25:07.861 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.861 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.861 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.861 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:07.861 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:25:07.861 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 47.300868072, 2024-04-19T04:25:07.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018086631999999998, 2024-04-19T04:25:07.862 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.862 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.862 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:25:07.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:25:07.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539918+0000", 2024-04-19T04:25:07.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539931+0000", 2024-04-19T04:25:07.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2566e-05 2024-04-19T04:25:07.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539958+0000", 2024-04-19T04:25:07.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6582999999999999e-05 2024-04-19T04:25:07.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539972+0000", 2024-04-19T04:25:07.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4789e-05 2024-04-19T04:25:07.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547577+0000", 2024-04-19T04:25:07.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0076045979999999997 2024-04-19T04:25:07.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547769+0000", 2024-04-19T04:25:07.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000192034 2024-04-19T04:25:07.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547929+0000", 2024-04-19T04:25:07.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000159679 2024-04-19T04:25:07.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.548942+0000", 2024-04-19T04:25:07.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010138720000000001 2024-04-19T04:25:07.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557962+0000", 2024-04-19T04:25:07.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090199970000000001 2024-04-19T04:25:07.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557985+0000", 2024-04-19T04:25:07.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2623e-05 2024-04-19T04:25:07.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.558006+0000", 2024-04-19T04:25:07.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0764e-05 2024-04-19T04:25:07.866 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.866 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.866 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.866 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:27 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:07.867 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:25:07.867 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 47.300802083999997, 2024-04-19T04:25:07.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018047384, 2024-04-19T04:25:07.867 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.867 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:07.867 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:25:07.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:25:07.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539984+0000", 2024-04-19T04:25:07.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:07.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539991+0000", 2024-04-19T04:25:07.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7769999999999997e-06 2024-04-19T04:25:07.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540010+0000", 2024-04-19T04:25:07.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9573e-05 2024-04-19T04:25:07.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540025+0000", 2024-04-19T04:25:07.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4796e-05 2024-04-19T04:25:07.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541220+0000", 2024-04-19T04:25:07.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001195172 2024-04-19T04:25:07.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541569+0000", 2024-04-19T04:25:07.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00034836600000000002 2024-04-19T04:25:07.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.558033+0000", 2024-04-19T04:25:07.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.016464092999999999 2024-04-19T04:25:07.870 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.870 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.870 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.870 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24310 5.0 5:07098fc4:::benchmark_data_smithi007_19526_object24309:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:07.870 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.471082+0000", 2024-04-19T04:25:07.870 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.369705259, 2024-04-19T04:25:07.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018533300999999999, 2024-04-19T04:25:07.871 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.871 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.871 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:07.871 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:07.871 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.871 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24310 2024-04-19T04:25:07.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.871 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.471082+0000", 2024-04-19T04:25:07.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.471082+0000", 2024-04-19T04:25:07.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.471081+0000", 2024-04-19T04:25:07.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472015+0000", 2024-04-19T04:25:07.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00093410800000000001 2024-04-19T04:25:07.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472027+0000", 2024-04-19T04:25:07.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1491000000000001e-05 2024-04-19T04:25:07.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472033+0000", 2024-04-19T04:25:07.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9499999999999998e-06 2024-04-19T04:25:07.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472087+0000", 2024-04-19T04:25:07.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4595999999999997e-05 2024-04-19T04:25:07.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472208+0000", 2024-04-19T04:25:07.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012105299999999999 2024-04-19T04:25:07.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:07.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.475540+0000", 2024-04-19T04:25:07.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033319310000000002 2024-04-19T04:25:07.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481479+0000", 2024-04-19T04:25:07.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059387440000000001 2024-04-19T04:25:07.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489528+0000", 2024-04-19T04:25:07.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080487739999999999 2024-04-19T04:25:07.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489578+0000", 2024-04-19T04:25:07.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0321999999999997e-05 2024-04-19T04:25:07.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489615+0000", 2024-04-19T04:25:07.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7425000000000002e-05 2024-04-19T04:25:07.876 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.876 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.876 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.876 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24318 5.0 5:09636443:::benchmark_data_smithi007_19526_object24317:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:07.876 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.472336+0000", 2024-04-19T04:25:07.876 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.36845123, 2024-04-19T04:25:07.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017477310999999999, 2024-04-19T04:25:07.876 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.876 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.876 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:07.876 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:07.876 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.876 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24318 2024-04-19T04:25:07.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.877 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472336+0000", 2024-04-19T04:25:07.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472336+0000", 2024-04-19T04:25:07.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472335+0000", 2024-04-19T04:25:07.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472373+0000", 2024-04-19T04:25:07.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7876999999999997e-05 2024-04-19T04:25:07.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472384+0000", 2024-04-19T04:25:07.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0513000000000001e-05 2024-04-19T04:25:07.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472391+0000", 2024-04-19T04:25:07.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6680000000000001e-06 2024-04-19T04:25:07.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.476649+0000", 2024-04-19T04:25:07.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004257172 2024-04-19T04:25:07.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.476767+0000", 2024-04-19T04:25:07.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118584 2024-04-19T04:25:07.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:07.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.476868+0000", 2024-04-19T04:25:07.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100912 2024-04-19T04:25:07.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481491+0000", 2024-04-19T04:25:07.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046224990000000004 2024-04-19T04:25:07.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489691+0000", 2024-04-19T04:25:07.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082007529999999999 2024-04-19T04:25:07.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489777+0000", 2024-04-19T04:25:07.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6174000000000005e-05 2024-04-19T04:25:07.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489813+0000", 2024-04-19T04:25:07.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.591e-05 2024-04-19T04:25:07.881 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.881 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.881 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.881 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24322 5.0 5:08733fec:::benchmark_data_smithi007_19526_object24321:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:07.881 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.474319+0000", 2024-04-19T04:25:07.882 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.36646869, 2024-04-19T04:25:07.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015646382, 2024-04-19T04:25:07.882 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.882 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.882 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:07.882 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:07.882 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.882 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24322 2024-04-19T04:25:07.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.882 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474319+0000", 2024-04-19T04:25:07.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474319+0000", 2024-04-19T04:25:07.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474318+0000", 2024-04-19T04:25:07.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474385+0000", 2024-04-19T04:25:07.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6892999999999998e-05 2024-04-19T04:25:07.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474405+0000", 2024-04-19T04:25:07.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9819000000000001e-05 2024-04-19T04:25:07.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.474410+0000", 2024-04-19T04:25:07.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4990000000000002e-06 2024-04-19T04:25:07.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477692+0000", 2024-04-19T04:25:07.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032817570000000002 2024-04-19T04:25:07.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477802+0000", 2024-04-19T04:25:07.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0001102 2024-04-19T04:25:07.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:07.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.477921+0000", 2024-04-19T04:25:07.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119159 2024-04-19T04:25:07.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481501+0000", 2024-04-19T04:25:07.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003579558 2024-04-19T04:25:07.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489889+0000", 2024-04-19T04:25:07.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083880570000000008 2024-04-19T04:25:07.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489937+0000", 2024-04-19T04:25:07.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8124000000000002e-05 2024-04-19T04:25:07.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489965+0000", 2024-04-19T04:25:07.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8085e-05 2024-04-19T04:25:07.887 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.887 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.887 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.887 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:25794 5.e 5:77ddc1c5:::benchmark_data_smithi007_19526_object25793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:07.887 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.073091+0000", 2024-04-19T04:25:07.887 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.767696659, 2024-04-19T04:25:07.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017751818999999999, 2024-04-19T04:25:07.887 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.887 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.887 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:07.887 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:07.887 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.888 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 25794 2024-04-19T04:25:07.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.888 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073091+0000", 2024-04-19T04:25:07.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073091+0000", 2024-04-19T04:25:07.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073089+0000", 2024-04-19T04:25:07.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073146+0000", 2024-04-19T04:25:07.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6011000000000003e-05 2024-04-19T04:25:07.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073162+0000", 2024-04-19T04:25:07.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6949e-05 2024-04-19T04:25:07.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073174+0000", 2024-04-19T04:25:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1538e-05 2024-04-19T04:25:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073244+0000", 2024-04-19T04:25:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9715000000000006e-05 2024-04-19T04:25:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073463+0000", 2024-04-19T04:25:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021919999999999999 2024-04-19T04:25:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:07.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073580+0000", 2024-04-19T04:25:07.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000116727 2024-04-19T04:25:07.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.075752+0000", 2024-04-19T04:25:07.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021724819999999999 2024-04-19T04:25:07.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.090747+0000", 2024-04-19T04:25:07.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014995059 2024-04-19T04:25:07.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.090790+0000", 2024-04-19T04:25:07.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3244999999999997e-05 2024-04-19T04:25:07.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.090842+0000", 2024-04-19T04:25:07.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2052000000000002e-05 2024-04-19T04:25:07.892 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.892 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.892 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.892 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:07.892 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:07.893 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.605256587, 2024-04-19T04:25:07.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:07.893 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.893 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.893 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:07.893 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:07.893 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.893 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:07.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.893 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:07.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:07.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:07.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:07.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:07.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:07.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:07.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:07.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:07.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:07.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:07.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:07.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:07.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:07.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:07.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:07.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:07.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:07.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:07.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:07.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:07.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:07.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:07.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:07.898 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.898 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.898 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.898 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:07.898 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:07.898 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.600807671, 2024-04-19T04:25:07.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:07.898 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.898 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.899 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:07.899 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:07.899 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.899 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:07.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.899 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:07.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:07.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:07.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:07.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:07.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:07.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:07.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:07.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:07.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:07.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:07.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:07.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:07.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:07.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:07.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:07.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:07.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:07.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:07.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:07.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:07.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:07.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:07.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:07.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:07.903 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.903 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.904 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.904 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26218 5.e 5:71096b4b:::benchmark_data_smithi007_19526_object26217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:07.904 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.299744+0000", 2024-04-19T04:25:07.904 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.541043444, 2024-04-19T04:25:07.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015765136999999999, 2024-04-19T04:25:07.904 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.904 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.904 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:07.904 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:07.904 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.904 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26218 2024-04-19T04:25:07.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.904 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299744+0000", 2024-04-19T04:25:07.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299744+0000", 2024-04-19T04:25:07.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299743+0000", 2024-04-19T04:25:07.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:07.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299818+0000", 2024-04-19T04:25:07.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5840000000000006e-05 2024-04-19T04:25:07.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299827+0000", 2024-04-19T04:25:07.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5499999999999995e-06 2024-04-19T04:25:07.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.299832+0000", 2024-04-19T04:25:07.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3569999999999997e-06 2024-04-19T04:25:07.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.301136+0000", 2024-04-19T04:25:07.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013039900000000001 2024-04-19T04:25:07.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.301220+0000", 2024-04-19T04:25:07.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3220999999999995e-05 2024-04-19T04:25:07.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:07.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.301339+0000", 2024-04-19T04:25:07.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119358 2024-04-19T04:25:07.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.302912+0000", 2024-04-19T04:25:07.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015726659999999999 2024-04-19T04:25:07.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.315424+0000", 2024-04-19T04:25:07.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012512452 2024-04-19T04:25:07.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.315479+0000", 2024-04-19T04:25:07.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4732999999999999e-05 2024-04-19T04:25:07.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.315509+0000", 2024-04-19T04:25:07.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0260000000000002e-05 2024-04-19T04:25:07.909 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.909 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.909 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.909 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:28229 5.4 5:2ef4e134:::benchmark_data_smithi007_19526_object28228:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T04:25:07.909 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:55.108574+0000", 2024-04-19T04:25:07.909 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.732212946000001, 2024-04-19T04:25:07.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015913132, 2024-04-19T04:25:07.909 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.909 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.910 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:07.910 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:07.910 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.910 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 28229 2024-04-19T04:25:07.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.910 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.108574+0000", 2024-04-19T04:25:07.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.108574+0000", 2024-04-19T04:25:07.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.108573+0000", 2024-04-19T04:25:07.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.108608+0000", 2024-04-19T04:25:07.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4468999999999998e-05 2024-04-19T04:25:07.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.108631+0000", 2024-04-19T04:25:07.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2928000000000001e-05 2024-04-19T04:25:07.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.108637+0000", 2024-04-19T04:25:07.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3080000000000004e-06 2024-04-19T04:25:07.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.111112+0000", 2024-04-19T04:25:07.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024749619999999998 2024-04-19T04:25:07.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.111260+0000", 2024-04-19T04:25:07.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000147885 2024-04-19T04:25:07.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:07.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.111348+0000", 2024-04-19T04:25:07.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8392000000000003e-05 2024-04-19T04:25:07.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.112602+0000", 2024-04-19T04:25:07.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001253348 2024-04-19T04:25:07.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.124401+0000", 2024-04-19T04:25:07.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011799047999999999 2024-04-19T04:25:07.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.124452+0000", 2024-04-19T04:25:07.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0946999999999999e-05 2024-04-19T04:25:07.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:55.124488+0000", 2024-04-19T04:25:07.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5750000000000002e-05 2024-04-19T04:25:07.914 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.914 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.915 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.915 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:35062 5.0 5:0b09a143:::benchmark_data_smithi007_19526_object35061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:25:07.915 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:58.997863+0000", 2024-04-19T04:25:07.915 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.8429241110000003, 2024-04-19T04:25:07.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.016912940000000001, 2024-04-19T04:25:07.915 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.915 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.915 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:07.915 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:07.915 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.915 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35062 2024-04-19T04:25:07.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.915 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997863+0000", 2024-04-19T04:25:07.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997863+0000", 2024-04-19T04:25:07.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997862+0000", 2024-04-19T04:25:07.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997919+0000", 2024-04-19T04:25:07.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7045e-05 2024-04-19T04:25:07.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997931+0000", 2024-04-19T04:25:07.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1989e-05 2024-04-19T04:25:07.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997939+0000", 2024-04-19T04:25:07.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9740000000000002e-06 2024-04-19T04:25:07.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997976+0000", 2024-04-19T04:25:07.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7138999999999998e-05 2024-04-19T04:25:07.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.998076+0000", 2024-04-19T04:25:07.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010001900000000001 2024-04-19T04:25:07.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:07.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.998171+0000", 2024-04-19T04:25:07.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4724999999999999e-05 2024-04-19T04:25:07.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.002805+0000", 2024-04-19T04:25:07.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046342279999999998 2024-04-19T04:25:07.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.014484+0000", 2024-04-19T04:25:07.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011678609 2024-04-19T04:25:07.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.014737+0000", 2024-04-19T04:25:07.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025272800000000002 2024-04-19T04:25:07.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.014776+0000", 2024-04-19T04:25:07.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9539000000000002e-05 2024-04-19T04:25:07.920 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.920 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.920 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.920 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:36969 5.0 5:07a2d04d:::benchmark_data_smithi007_19526_object36968:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:25:07.920 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:59.838646+0000", 2024-04-19T04:25:07.920 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.0021415250000008, 2024-04-19T04:25:07.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019867078999999999, 2024-04-19T04:25:07.921 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.921 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.921 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:07.921 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:07.921 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.921 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 36969 2024-04-19T04:25:07.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.921 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838646+0000", 2024-04-19T04:25:07.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838646+0000", 2024-04-19T04:25:07.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838645+0000", 2024-04-19T04:25:07.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838725+0000", 2024-04-19T04:25:07.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0295000000000003e-05 2024-04-19T04:25:07.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838734+0000", 2024-04-19T04:25:07.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6319999999999997e-06 2024-04-19T04:25:07.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838739+0000", 2024-04-19T04:25:07.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4249999999999997e-06 2024-04-19T04:25:07.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.843505+0000", 2024-04-19T04:25:07.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047651689999999997 2024-04-19T04:25:07.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.843611+0000", 2024-04-19T04:25:07.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010608899999999999 2024-04-19T04:25:07.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:07.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.843699+0000", 2024-04-19T04:25:07.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7841000000000001e-05 2024-04-19T04:25:07.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.846376+0000", 2024-04-19T04:25:07.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002677867 2024-04-19T04:25:07.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.858355+0000", 2024-04-19T04:25:07.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011978999000000001 2024-04-19T04:25:07.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.858443+0000", 2024-04-19T04:25:07.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7243000000000005e-05 2024-04-19T04:25:07.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.858513+0000", 2024-04-19T04:25:07.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0235999999999996e-05 2024-04-19T04:25:07.926 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.926 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.926 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.926 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:43351 5.0 5:0f5ecfc6:::benchmark_data_smithi007_19526_object43350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:07.926 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:02.801106+0000", 2024-04-19T04:25:07.926 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.039681227, 2024-04-19T04:25:07.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021198346999999999, 2024-04-19T04:25:07.926 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.926 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.926 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:07.927 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:07.927 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.927 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 43351 2024-04-19T04:25:07.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.927 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801106+0000", 2024-04-19T04:25:07.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801106+0000", 2024-04-19T04:25:07.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801105+0000", 2024-04-19T04:25:07.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:07.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801159+0000", 2024-04-19T04:25:07.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4181999999999997e-05 2024-04-19T04:25:07.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801174+0000", 2024-04-19T04:25:07.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5021000000000001e-05 2024-04-19T04:25:07.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801182+0000", 2024-04-19T04:25:07.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7649999999999993e-06 2024-04-19T04:25:07.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.809365+0000", 2024-04-19T04:25:07.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081836159999999995 2024-04-19T04:25:07.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.809463+0000", 2024-04-19T04:25:07.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7486999999999997e-05 2024-04-19T04:25:07.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:07.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.809549+0000", 2024-04-19T04:25:07.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5729999999999994e-05 2024-04-19T04:25:07.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.814132+0000", 2024-04-19T04:25:07.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045836039999999998 2024-04-19T04:25:07.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.822206+0000", 2024-04-19T04:25:07.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080738500000000005 2024-04-19T04:25:07.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.822255+0000", 2024-04-19T04:25:07.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8730000000000003e-05 2024-04-19T04:25:07.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.822304+0000", 2024-04-19T04:25:07.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.973e-05 2024-04-19T04:25:07.931 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.931 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.931 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.932 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:51199 5.b 5:d84eb785:::benchmark_data_smithi007_19526_object51198:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T04:25:07.932 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:06.668882+0000", 2024-04-19T04:25:07.932 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.1719056670000001, 2024-04-19T04:25:07.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018380380000000002, 2024-04-19T04:25:07.932 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.932 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.932 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:07.932 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:07.932 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.932 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 51199 2024-04-19T04:25:07.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.932 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.668882+0000", 2024-04-19T04:25:07.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.668882+0000", 2024-04-19T04:25:07.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.668881+0000", 2024-04-19T04:25:07.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.668943+0000", 2024-04-19T04:25:07.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2914000000000001e-05 2024-04-19T04:25:07.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.668959+0000", 2024-04-19T04:25:07.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5843999999999999e-05 2024-04-19T04:25:07.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.668970+0000", 2024-04-19T04:25:07.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1127e-05 2024-04-19T04:25:07.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.676381+0000", 2024-04-19T04:25:07.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074101649999999998 2024-04-19T04:25:07.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.676638+0000", 2024-04-19T04:25:07.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025765599999999999 2024-04-19T04:25:07.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:07.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.676884+0000", 2024-04-19T04:25:07.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00024564900000000002 2024-04-19T04:25:07.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.936 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.679902+0000", 2024-04-19T04:25:07.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030181190000000001 2024-04-19T04:25:07.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.936 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.687142+0000", 2024-04-19T04:25:07.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072396539999999999 2024-04-19T04:25:07.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.936 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.687212+0000", 2024-04-19T04:25:07.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0734000000000004e-05 2024-04-19T04:25:07.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.687262+0000", 2024-04-19T04:25:07.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9583000000000003e-05 2024-04-19T04:25:07.937 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.937 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.937 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.937 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:51410 5.e 5:75a150f8:::benchmark_data_smithi007_19526_object51409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T04:25:07.937 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:06.772497+0000", 2024-04-19T04:25:07.937 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.0682904120000001, 2024-04-19T04:25:07.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017100197000000001, 2024-04-19T04:25:07.938 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.938 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.938 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:07.938 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:07.938 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.938 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 51410 2024-04-19T04:25:07.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.938 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.772497+0000", 2024-04-19T04:25:07.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.772497+0000", 2024-04-19T04:25:07.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.772496+0000", 2024-04-19T04:25:07.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.772578+0000", 2024-04-19T04:25:07.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2471000000000004e-05 2024-04-19T04:25:07.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.772593+0000", 2024-04-19T04:25:07.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4905e-05 2024-04-19T04:25:07.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.772612+0000", 2024-04-19T04:25:07.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8465999999999999e-05 2024-04-19T04:25:07.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.774252+0000", 2024-04-19T04:25:07.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001640416 2024-04-19T04:25:07.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.774446+0000", 2024-04-19T04:25:07.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000193771 2024-04-19T04:25:07.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:07.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.774599+0000", 2024-04-19T04:25:07.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015292600000000001 2024-04-19T04:25:07.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.779417+0000", 2024-04-19T04:25:07.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048176390000000003 2024-04-19T04:25:07.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.789497+0000", 2024-04-19T04:25:07.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.01008069 2024-04-19T04:25:07.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.789560+0000", 2024-04-19T04:25:07.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2267999999999994e-05 2024-04-19T04:25:07.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.789597+0000", 2024-04-19T04:25:07.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7580999999999998e-05 2024-04-19T04:25:07.943 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.943 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.943 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.943 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:52035 5.e 5:7b28ce5f:::benchmark_data_smithi007_19526_object52034:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:07.943 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:07.095686+0000", 2024-04-19T04:25:07.943 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.74510162300000005, 2024-04-19T04:25:07.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015768148999999999, 2024-04-19T04:25:07.943 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.943 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.943 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:07.943 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:07.943 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.944 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 52035 2024-04-19T04:25:07.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.944 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.095686+0000", 2024-04-19T04:25:07.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.095686+0000", 2024-04-19T04:25:07.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.095685+0000", 2024-04-19T04:25:07.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.095849+0000", 2024-04-19T04:25:07.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016458900000000001 2024-04-19T04:25:07.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.095864+0000", 2024-04-19T04:25:07.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5051e-05 2024-04-19T04:25:07.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.095872+0000", 2024-04-19T04:25:07.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9510000000000006e-06 2024-04-19T04:25:07.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.095927+0000", 2024-04-19T04:25:07.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5095e-05 2024-04-19T04:25:07.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.096040+0000", 2024-04-19T04:25:07.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011239399999999999 2024-04-19T04:25:07.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:07.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.096165+0000", 2024-04-19T04:25:07.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012517999999999999 2024-04-19T04:25:07.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.098343+0000", 2024-04-19T04:25:07.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021783599999999998 2024-04-19T04:25:07.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.111383+0000", 2024-04-19T04:25:07.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013040252 2024-04-19T04:25:07.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.111418+0000", 2024-04-19T04:25:07.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4221000000000003e-05 2024-04-19T04:25:07.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.111454+0000", 2024-04-19T04:25:07.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6186999999999998e-05 2024-04-19T04:25:07.948 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.948 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.948 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.948 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:52266 5.0 5:0626f1f7:::benchmark_data_smithi007_19526_object52265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:07.948 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:07.223700+0000", 2024-04-19T04:25:07.949 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.617087422, 2024-04-19T04:25:07.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.016571881, 2024-04-19T04:25:07.949 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:07.949 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:07.949 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:07.949 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:07.949 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:07.949 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 52266 2024-04-19T04:25:07.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.949 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:07.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:07.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.223700+0000", 2024-04-19T04:25:07.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:07.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.223700+0000", 2024-04-19T04:25:07.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:07.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:07.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.223699+0000", 2024-04-19T04:25:07.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:07.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:07.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.223848+0000", 2024-04-19T04:25:07.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014860599999999999 2024-04-19T04:25:07.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:07.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.223858+0000", 2024-04-19T04:25:07.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0876000000000001e-05 2024-04-19T04:25:07.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:07.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.223865+0000", 2024-04-19T04:25:07.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8410000000000002e-06 2024-04-19T04:25:07.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:07.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.223905+0000", 2024-04-19T04:25:07.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9891000000000001e-05 2024-04-19T04:25:07.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:07.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.224016+0000", 2024-04-19T04:25:07.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011105800000000001 2024-04-19T04:25:07.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:07.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.224114+0000", 2024-04-19T04:25:07.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7717e-05 2024-04-19T04:25:07.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:07.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.227421+0000", 2024-04-19T04:25:07.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033074139999999998 2024-04-19T04:25:07.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:07.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.240152+0000", 2024-04-19T04:25:07.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012731169000000001 2024-04-19T04:25:07.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:07.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.240228+0000", 2024-04-19T04:25:07.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5760000000000006e-05 2024-04-19T04:25:07.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:07.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:07.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:07.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.240272+0000", 2024-04-19T04:25:07.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3545999999999999e-05 2024-04-19T04:25:07.954 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.954 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.954 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.954 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:07.954 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:07.954 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:07.955 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:07.954+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:07.956 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:08.056 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:08.050+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:08.083 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:08.083 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:08.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.083 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:53878 5.7 5:e68fb05e:::benchmark_data_smithi007_19526_object53877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.083 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:08.074327+0000", 2024-04-19T04:25:08.083 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.007691186, 2024-04-19T04:25:08.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.007713915, 2024-04-19T04:25:08.083 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.083 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:08.083 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:08.083 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:08.083 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.084 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 53878 2024-04-19T04:25:08.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.084 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.074327+0000", 2024-04-19T04:25:08.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.074327+0000", 2024-04-19T04:25:08.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.074327+0000", 2024-04-19T04:25:08.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.074406+0000", 2024-04-19T04:25:08.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9382999999999995e-05 2024-04-19T04:25:08.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.074418+0000", 2024-04-19T04:25:08.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1698999999999999e-05 2024-04-19T04:25:08.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.086 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.086 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.074425+0000", 2024-04-19T04:25:08.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9600000000000003e-06 2024-04-19T04:25:08.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.086 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.086 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.074984+0000", 2024-04-19T04:25:08.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00055934400000000003 2024-04-19T04:25:08.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.086 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.086 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.075130+0000", 2024-04-19T04:25:08.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145914 2024-04-19T04:25:08.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:08.087 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.075278+0000", 2024-04-19T04:25:08.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014829200000000001 2024-04-19T04:25:08.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:08.087 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.079462+0000", 2024-04-19T04:25:08.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0041840619999999997 2024-04-19T04:25:08.087 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.087 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.087 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.087 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:53880 5.2 5:4309a234:::benchmark_data_smithi007_19526_object53879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.088 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:08.074779+0000", 2024-04-19T04:25:08.088 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0072397529999999998, 2024-04-19T04:25:08.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0073622460000000002, 2024-04-19T04:25:08.088 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.088 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:08.088 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:08.088 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:08.088 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.088 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 53880 2024-04-19T04:25:08.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.088 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.074779+0000", 2024-04-19T04:25:08.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.074779+0000", 2024-04-19T04:25:08.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.074778+0000", 2024-04-19T04:25:08.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.074864+0000", 2024-04-19T04:25:08.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6030000000000001e-05 2024-04-19T04:25:08.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.090 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.074876+0000", 2024-04-19T04:25:08.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2197e-05 2024-04-19T04:25:08.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.090 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.074885+0000", 2024-04-19T04:25:08.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1759999999999993e-06 2024-04-19T04:25:08.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.090 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.074926+0000", 2024-04-19T04:25:08.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1668999999999997e-05 2024-04-19T04:25:08.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.091 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.075046+0000", 2024-04-19T04:25:08.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000119663 2024-04-19T04:25:08.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:08.091 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.075161+0000", 2024-04-19T04:25:08.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114969 2024-04-19T04:25:08.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:08.091 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.082095+0000", 2024-04-19T04:25:08.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069338630000000002 2024-04-19T04:25:08.092 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.092 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.092 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.092 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:53882 5.d 5:bebceffa:::benchmark_data_smithi007_19526_object53881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.092 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:08.075208+0000", 2024-04-19T04:25:08.092 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0068110799999999997, 2024-04-19T04:25:08.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0070325209999999999, 2024-04-19T04:25:08.092 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.092 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:08.092 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:08.092 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:08.092 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.093 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 53882 2024-04-19T04:25:08.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.093 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.075208+0000", 2024-04-19T04:25:08.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.075208+0000", 2024-04-19T04:25:08.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.075206+0000", 2024-04-19T04:25:08.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.075309+0000", 2024-04-19T04:25:08.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000102626 2024-04-19T04:25:08.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.075322+0000", 2024-04-19T04:25:08.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2852e-05 2024-04-19T04:25:08.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.075330+0000", 2024-04-19T04:25:08.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5290000000000008e-06 2024-04-19T04:25:08.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.075474+0000", 2024-04-19T04:25:08.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143688 2024-04-19T04:25:08.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.075560+0000", 2024-04-19T04:25:08.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6137999999999994e-05 2024-04-19T04:25:08.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:08.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.075644+0000", 2024-04-19T04:25:08.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3671999999999994e-05 2024-04-19T04:25:08.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:08.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.078318+0000", 2024-04-19T04:25:08.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026740230000000002 2024-04-19T04:25:08.097 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.097 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.097 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.098 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:53881 5.3 e35/20 5:cd2b50e8:::benchmark_data_smithi007_19526_object53880:head v 35'3282, mlcod=35'3280)", 2024-04-19T04:25:08.098 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:08.076258+0000", 2024-04-19T04:25:08.098 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0057610580000000003, 2024-04-19T04:25:08.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0060869449999999999, 2024-04-19T04:25:08.098 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.098 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:08.098 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.076258+0000", 2024-04-19T04:25:08.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.076258+0000", 2024-04-19T04:25:08.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.076257+0000", 2024-04-19T04:25:08.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:08.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.076298+0000", 2024-04-19T04:25:08.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1022999999999997e-05 2024-04-19T04:25:08.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.076306+0000", 2024-04-19T04:25:08.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6290000000000001e-06 2024-04-19T04:25:08.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.076311+0000", 2024-04-19T04:25:08.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1560000000000003e-06 2024-04-19T04:25:08.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.076364+0000", 2024-04-19T04:25:08.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2522999999999998e-05 2024-04-19T04:25:08.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.076384+0000", 2024-04-19T04:25:08.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0038999999999999e-05 2024-04-19T04:25:08.101 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.101 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.101 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.101 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:53888 5.2 5:489f6825:::benchmark_data_smithi007_19526_object53887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.101 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:08.078562+0000", 2024-04-19T04:25:08.101 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0034563269999999999, 2024-04-19T04:25:08.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038682819999999998, 2024-04-19T04:25:08.101 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.101 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:08.101 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:08.101 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:08.102 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.102 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 53888 2024-04-19T04:25:08.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.102 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.078562+0000", 2024-04-19T04:25:08.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.078562+0000", 2024-04-19T04:25:08.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.078561+0000", 2024-04-19T04:25:08.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.078650+0000", 2024-04-19T04:25:08.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.8797999999999999e-05 2024-04-19T04:25:08.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.078665+0000", 2024-04-19T04:25:08.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5281000000000002e-05 2024-04-19T04:25:08.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.078673+0000", 2024-04-19T04:25:08.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0169999999999996e-06 2024-04-19T04:25:08.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.078713+0000", 2024-04-19T04:25:08.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9345999999999999e-05 2024-04-19T04:25:08.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.078858+0000", 2024-04-19T04:25:08.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014487500000000001 2024-04-19T04:25:08.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:08.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.078956+0000", 2024-04-19T04:25:08.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8094e-05 2024-04-19T04:25:08.105 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.105 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.105 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.105 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:53886 5.6 e35/20 5:6f9f9bb5:::benchmark_data_smithi007_19526_object53885:head v 35'3363, mlcod=35'3361)", 2024-04-19T04:25:08.105 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:08.078811+0000", 2024-04-19T04:25:08.105 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0032073409999999998, 2024-04-19T04:25:08.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0037119660000000001, 2024-04-19T04:25:08.105 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.105 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:08.106 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.078811+0000", 2024-04-19T04:25:08.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.078811+0000", 2024-04-19T04:25:08.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.078811+0000", 2024-04-19T04:25:08.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:08.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.107 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.107 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.078880+0000", 2024-04-19T04:25:08.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9349000000000003e-05 2024-04-19T04:25:08.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.107 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.107 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.078890+0000", 2024-04-19T04:25:08.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.6430000000000007e-06 2024-04-19T04:25:08.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.107 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.107 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.078896+0000", 2024-04-19T04:25:08.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5089999999999999e-06 2024-04-19T04:25:08.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.078929+0000", 2024-04-19T04:25:08.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2829e-05 2024-04-19T04:25:08.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.078941+0000", 2024-04-19T04:25:08.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1489e-05 2024-04-19T04:25:08.108 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.108 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.108 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.109 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:53889 5.7 5:edbcf738:::benchmark_data_smithi007_19526_object53888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.109 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:08.079909+0000", 2024-04-19T04:25:08.109 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.002109624, 2024-04-19T04:25:08.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026949449999999998, 2024-04-19T04:25:08.109 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.109 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:08.109 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:08.109 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:08.109 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.109 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 53889 2024-04-19T04:25:08.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.109 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.079909+0000", 2024-04-19T04:25:08.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.079909+0000", 2024-04-19T04:25:08.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.079908+0000", 2024-04-19T04:25:08.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.079986+0000", 2024-04-19T04:25:08.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8158000000000006e-05 2024-04-19T04:25:08.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.080001+0000", 2024-04-19T04:25:08.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4883e-05 2024-04-19T04:25:08.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.080010+0000", 2024-04-19T04:25:08.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7620000000000001e-06 2024-04-19T04:25:08.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.112 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.112 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.080057+0000", 2024-04-19T04:25:08.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6964e-05 2024-04-19T04:25:08.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.112 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.112 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.080247+0000", 2024-04-19T04:25:08.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00018992799999999999 2024-04-19T04:25:08.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.112 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:08.112 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.080488+0000", 2024-04-19T04:25:08.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00024158 2024-04-19T04:25:08.112 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.112 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.113 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.113 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.113 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:53892 5.7 5:e1fdfa5f:::benchmark_data_smithi007_19526_object53891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.113 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:08.080026+0000", 2024-04-19T04:25:08.113 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0019929370000000002, 2024-04-19T04:25:08.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002674821, 2024-04-19T04:25:08.113 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.113 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:08.113 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:08.113 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:08.113 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.113 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 53892 2024-04-19T04:25:08.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.113 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.080026+0000", 2024-04-19T04:25:08.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.080026+0000", 2024-04-19T04:25:08.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.080025+0000", 2024-04-19T04:25:08.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.080072+0000", 2024-04-19T04:25:08.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7456000000000001e-05 2024-04-19T04:25:08.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.080083+0000", 2024-04-19T04:25:08.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0407999999999999e-05 2024-04-19T04:25:08.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.080091+0000", 2024-04-19T04:25:08.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1030000000000002e-06 2024-04-19T04:25:08.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.116 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.082232+0000", 2024-04-19T04:25:08.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00214094 2024-04-19T04:25:08.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.116 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.082391+0000", 2024-04-19T04:25:08.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015871799999999999 2024-04-19T04:25:08.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.117 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:08.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.082514+0000", 2024-04-19T04:25:08.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012301200000000001 2024-04-19T04:25:08.117 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.117 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.117 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.117 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:53893 5.7 5.ed967387 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.118 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:08.081066+0000", 2024-04-19T04:25:08.118 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00095304999999999999, 2024-04-19T04:25:08.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001720664, 2024-04-19T04:25:08.118 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.118 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:08.118 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:08.118 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:08.118 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.118 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 53893 2024-04-19T04:25:08.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.118 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081066+0000", 2024-04-19T04:25:08.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081066+0000", 2024-04-19T04:25:08.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081065+0000", 2024-04-19T04:25:08.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081161+0000", 2024-04-19T04:25:08.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.6102999999999998e-05 2024-04-19T04:25:08.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.120 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081178+0000", 2024-04-19T04:25:08.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6674e-05 2024-04-19T04:25:08.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.120 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081186+0000", 2024-04-19T04:25:08.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5790000000000004e-06 2024-04-19T04:25:08.120 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.120 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.120 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.121 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:53894 5.9 5:9fc4425e:::benchmark_data_smithi007_19526_object53893:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.121 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:08.081194+0000", 2024-04-19T04:25:08.121 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00082429300000000003, 2024-04-19T04:25:08.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016402299999999999, 2024-04-19T04:25:08.121 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.121 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:08.121 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:08.121 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:08.121 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.121 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 53894 2024-04-19T04:25:08.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.121 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081194+0000", 2024-04-19T04:25:08.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081194+0000", 2024-04-19T04:25:08.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081194+0000", 2024-04-19T04:25:08.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:08.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081233+0000", 2024-04-19T04:25:08.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9477999999999997e-05 2024-04-19T04:25:08.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081243+0000", 2024-04-19T04:25:08.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.3880000000000006e-06 2024-04-19T04:25:08.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081249+0000", 2024-04-19T04:25:08.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8580000000000002e-06 2024-04-19T04:25:08.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081298+0000", 2024-04-19T04:25:08.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8344000000000003e-05 2024-04-19T04:25:08.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081448+0000", 2024-04-19T04:25:08.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150073 2024-04-19T04:25:08.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:08.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081610+0000", 2024-04-19T04:25:08.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000161831 2024-04-19T04:25:08.124 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.125 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.125 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.125 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:53887 5.6 e35/20 5:6942c9d9:::benchmark_data_smithi007_19526_object53886:head v 35'3364, mlcod=35'3361)", 2024-04-19T04:25:08.125 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:08.081163+0000", 2024-04-19T04:25:08.125 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00085544199999999999, 2024-04-19T04:25:08.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001749586, 2024-04-19T04:25:08.125 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.125 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:08.125 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.125 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.125 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081163+0000", 2024-04-19T04:25:08.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081163+0000", 2024-04-19T04:25:08.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081163+0000", 2024-04-19T04:25:08.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:08.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081246+0000", 2024-04-19T04:25:08.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3854e-05 2024-04-19T04:25:08.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081253+0000", 2024-04-19T04:25:08.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0350000000000004e-06 2024-04-19T04:25:08.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081258+0000", 2024-04-19T04:25:08.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4660000000000001e-06 2024-04-19T04:25:08.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081290+0000", 2024-04-19T04:25:08.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2023999999999997e-05 2024-04-19T04:25:08.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081303+0000", 2024-04-19T04:25:08.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2649999999999999e-05 2024-04-19T04:25:08.128 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.128 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.128 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.128 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:53895 5.9 5.d5922729 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.128 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:08.081659+0000", 2024-04-19T04:25:08.128 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00035949400000000002, 2024-04-19T04:25:08.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0013072050000000001, 2024-04-19T04:25:08.129 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.129 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:08.129 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:08.129 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:08.129 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.129 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 53895 2024-04-19T04:25:08.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.129 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.129 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081659+0000", 2024-04-19T04:25:08.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081659+0000", 2024-04-19T04:25:08.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081658+0000", 2024-04-19T04:25:08.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081710+0000", 2024-04-19T04:25:08.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2015000000000003e-05 2024-04-19T04:25:08.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081722+0000", 2024-04-19T04:25:08.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1279e-05 2024-04-19T04:25:08.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.081734+0000", 2024-04-19T04:25:08.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1873e-05 2024-04-19T04:25:08.131 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.131 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.131 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.131 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:53896 5.7 5.ec97777 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.131 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:08.082736+0000", 2024-04-19T04:25:08.132 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9992824, 2024-04-19T04:25:08.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00029174399999999998, 2024-04-19T04:25:08.132 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.132 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:08.132 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:08.132 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:08.132 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.132 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 53896 2024-04-19T04:25:08.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.132 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.082736+0000", 2024-04-19T04:25:08.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.082736+0000", 2024-04-19T04:25:08.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.082735+0000", 2024-04-19T04:25:08.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.082839+0000", 2024-04-19T04:25:08.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000103776 2024-04-19T04:25:08.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.082850+0000", 2024-04-19T04:25:08.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1270999999999999e-05 2024-04-19T04:25:08.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.082856+0000", 2024-04-19T04:25:08.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5910000000000003e-06 2024-04-19T04:25:08.134 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.134 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.134 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.134 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:53897 5.1 5.15b46581 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.135 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:08.082900+0000", 2024-04-19T04:25:08.135 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9991183, 2024-04-19T04:25:08.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019209199999999999, 2024-04-19T04:25:08.135 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.135 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:08.135 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:08.135 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:08.135 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.135 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 53897 2024-04-19T04:25:08.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.135 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.082900+0000", 2024-04-19T04:25:08.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.082900+0000", 2024-04-19T04:25:08.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.082900+0000", 2024-04-19T04:25:08.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:08.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.082966+0000", 2024-04-19T04:25:08.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6771000000000002e-05 2024-04-19T04:25:08.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.137 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.082976+0000", 2024-04-19T04:25:08.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0037999999999999e-05 2024-04-19T04:25:08.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.137 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.082980+0000", 2024-04-19T04:25:08.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0060000000000003e-06 2024-04-19T04:25:08.137 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.137 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.137 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.138 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:53898 5.d 5.1330526d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.138 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:08.083074+0000", 2024-04-19T04:25:08.138 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9989443, 2024-04-19T04:25:08.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7532000000000002e-05, 2024-04-19T04:25:08.138 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.138 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:08.138 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:08.138 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:08.138 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.138 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 53898 2024-04-19T04:25:08.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.138 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.083074+0000", 2024-04-19T04:25:08.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.139 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.083074+0000", 2024-04-19T04:25:08.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.139 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.083074+0000", 2024-04-19T04:25:08.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.139 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.083130+0000", 2024-04-19T04:25:08.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6208999999999997e-05 2024-04-19T04:25:08.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.083139+0000", 2024-04-19T04:25:08.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.8999999999999995e-06 2024-04-19T04:25:08.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:08.083143+0000", 2024-04-19T04:25:08.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9380000000000002e-06 2024-04-19T04:25:08.140 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.140 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.140 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.141 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.141 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:08.141 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 15 2024-04-19T04:25:08.141 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:08.142 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:08.157 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:08.154+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:08.258 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:08.258+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:08.316 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:08.316 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:08.316 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:08.316 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:08.316 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:08.329 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:08.359 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:08.358+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:08.458 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:08.458 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:08.458 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:08.458 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:08.458 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.458 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:08.459 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:25:08.459 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 47.923313968000002, 2024-04-19T04:25:08.459 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026801078999999998, 2024-04-19T04:25:08.459 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.459 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:08.459 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.459 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.459 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.459 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:25:08.459 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.459 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.459 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.459 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:25:08.460 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.460 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.460 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533733+0000", 2024-04-19T04:25:08.460 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999976 2024-04-19T04:25:08.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.460 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.460 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533746+0000", 2024-04-19T04:25:08.460 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2679e-05 2024-04-19T04:25:08.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.460 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.460 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533769+0000", 2024-04-19T04:25:08.461 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2832000000000001e-05 2024-04-19T04:25:08.461 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.461 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.461 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.461 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:25:08.461 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0599999999999999e-05 2024-04-19T04:25:08.461 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.461 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.461 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.461 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533907+0000", 2024-04-19T04:25:08.461 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000118076 2024-04-19T04:25:08.461 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.461 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.461 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:25:08.461 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533919+0000", 2024-04-19T04:25:08.462 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1644999999999999e-05 2024-04-19T04:25:08.462 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.462 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.462 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.462 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553399+0000", 2024-04-19T04:25:08.462 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019479987000000001 2024-04-19T04:25:08.462 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.462 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.462 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.462 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553535+0000", 2024-04-19T04:25:08.462 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553400000000001 2024-04-19T04:25:08.462 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.462 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.462 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:08.463 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553696+0000", 2024-04-19T04:25:08.463 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000161068 2024-04-19T04:25:08.463 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.463 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.463 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:08.463 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558096+0000", 2024-04-19T04:25:08.463 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0043998880000000002 2024-04-19T04:25:08.463 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.463 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.463 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:08.463 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560465+0000", 2024-04-19T04:25:08.463 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023695159999999999 2024-04-19T04:25:08.463 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.463 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.463 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:08.464 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560513+0000", 2024-04-19T04:25:08.464 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7899000000000003e-05 2024-04-19T04:25:08.464 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.464 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.464 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.464 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560537+0000", 2024-04-19T04:25:08.464 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3768e-05 2024-04-19T04:25:08.464 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.464 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.464 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.464 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.464 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.464 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:08.464 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:08.465 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 47.923236893999999, 2024-04-19T04:25:08.465 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026864505, 2024-04-19T04:25:08.465 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.465 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:08.465 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.465 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.465 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.465 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:08.465 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.465 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.465 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.465 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.465 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:08.465 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.465 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.466 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.466 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.466 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533812+0000", 2024-04-19T04:25:08.466 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.466 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.466 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.466 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.466 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533818+0000", 2024-04-19T04:25:08.466 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2369999999999997e-06 2024-04-19T04:25:08.466 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.466 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.466 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.466 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533863+0000", 2024-04-19T04:25:08.466 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4515000000000003e-05 2024-04-19T04:25:08.467 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.467 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.467 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.467 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533880+0000", 2024-04-19T04:25:08.467 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7119e-05 2024-04-19T04:25:08.467 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.467 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.467 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.467 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534029+0000", 2024-04-19T04:25:08.467 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014955099999999999 2024-04-19T04:25:08.467 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.467 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.467 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:08.467 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534034+0000", 2024-04-19T04:25:08.467 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1649999999999997e-06 2024-04-19T04:25:08.468 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.468 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.468 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.468 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554888+0000", 2024-04-19T04:25:08.468 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020854075 2024-04-19T04:25:08.468 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.468 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.468 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.468 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554967+0000", 2024-04-19T04:25:08.468 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8209999999999998e-05 2024-04-19T04:25:08.468 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.468 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.468 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:08.468 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555087+0000", 2024-04-19T04:25:08.468 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000120411 2024-04-19T04:25:08.469 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.469 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.469 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:08.469 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559328+0000", 2024-04-19T04:25:08.469 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042409800000000001 2024-04-19T04:25:08.469 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.469 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.469 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:08.469 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560587+0000", 2024-04-19T04:25:08.469 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012587119999999999 2024-04-19T04:25:08.469 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.469 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.469 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:08.469 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560620+0000", 2024-04-19T04:25:08.469 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2716999999999999e-05 2024-04-19T04:25:08.470 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.470 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.470 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.470 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560677+0000", 2024-04-19T04:25:08.470 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7726999999999998e-05 2024-04-19T04:25:08.470 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.470 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.470 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.470 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.470 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.470 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:08.470 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:08.470 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 47.923154500999999, 2024-04-19T04:25:08.470 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027363064999999999, 2024-04-19T04:25:08.471 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.471 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:08.471 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.471 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.471 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.471 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:08.471 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.471 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.471 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.471 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.471 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:08.471 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.471 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.471 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.471 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.472 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533894+0000", 2024-04-19T04:25:08.472 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:08.472 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.472 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.472 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.472 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533913+0000", 2024-04-19T04:25:08.472 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8896e-05 2024-04-19T04:25:08.472 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.472 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.472 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.472 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533933+0000", 2024-04-19T04:25:08.472 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9775e-05 2024-04-19T04:25:08.472 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.472 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.473 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.473 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533967+0000", 2024-04-19T04:25:08.473 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4536000000000003e-05 2024-04-19T04:25:08.473 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.473 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.473 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.473 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:08.473 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553600000000001 2024-04-19T04:25:08.473 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.473 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.473 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:08.473 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534107+0000", 2024-04-19T04:25:08.473 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1470000000000003e-06 2024-04-19T04:25:08.473 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.473 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.474 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.474 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556463+0000", 2024-04-19T04:25:08.474 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022356536999999999 2024-04-19T04:25:08.474 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.474 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.474 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.474 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556586+0000", 2024-04-19T04:25:08.474 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122967 2024-04-19T04:25:08.474 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.474 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.474 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:08.474 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556738+0000", 2024-04-19T04:25:08.474 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015182800000000001 2024-04-19T04:25:08.474 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.475 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.475 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:08.475 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561020+0000", 2024-04-19T04:25:08.475 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042818819999999999 2024-04-19T04:25:08.475 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.475 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.475 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:08.475 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561183+0000", 2024-04-19T04:25:08.475 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000162683 2024-04-19T04:25:08.475 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.475 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.475 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:08.475 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561226+0000", 2024-04-19T04:25:08.475 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3686000000000002e-05 2024-04-19T04:25:08.475 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.476 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.476 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.476 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561258+0000", 2024-04-19T04:25:08.476 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1814999999999999e-05 2024-04-19T04:25:08.476 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.476 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.476 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.476 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.476 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.476 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:08.476 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:08.476 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 47.923063988000003, 2024-04-19T04:25:08.476 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027417816000000001, 2024-04-19T04:25:08.476 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.477 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:08.477 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.477 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.477 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.477 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:08.477 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.477 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.477 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.477 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.477 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:08.477 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.477 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.477 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.477 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.477 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533984+0000", 2024-04-19T04:25:08.478 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:08.478 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.478 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.479 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.479 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:25:08.479 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3876000000000001e-05 2024-04-19T04:25:08.479 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.479 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.479 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.479 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534015+0000", 2024-04-19T04:25:08.479 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6818999999999999e-05 2024-04-19T04:25:08.479 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.479 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.479 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.479 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534030+0000", 2024-04-19T04:25:08.479 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.537e-05 2024-04-19T04:25:08.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.480 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.480 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.480 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534152+0000", 2024-04-19T04:25:08.480 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121685 2024-04-19T04:25:08.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.480 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.480 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:08.480 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534156+0000", 2024-04-19T04:25:08.480 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9029999999999997e-06 2024-04-19T04:25:08.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.480 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.480 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.480 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557520+0000", 2024-04-19T04:25:08.481 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023364125999999999 2024-04-19T04:25:08.481 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.481 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.481 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.481 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557585+0000", 2024-04-19T04:25:08.481 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5275000000000001e-05 2024-04-19T04:25:08.481 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.481 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.481 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:08.481 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557719+0000", 2024-04-19T04:25:08.481 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013396299999999999 2024-04-19T04:25:08.481 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.481 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.482 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:08.482 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561133+0000", 2024-04-19T04:25:08.482 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034140989999999999 2024-04-19T04:25:08.482 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.482 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.482 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:08.482 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561352+0000", 2024-04-19T04:25:08.482 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0002185 2024-04-19T04:25:08.482 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.482 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.482 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:08.482 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561380+0000", 2024-04-19T04:25:08.482 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8317999999999999e-05 2024-04-19T04:25:08.483 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.483 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.483 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.483 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561403+0000", 2024-04-19T04:25:08.483 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3264999999999998e-05 2024-04-19T04:25:08.483 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.483 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.483 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.483 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.483 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.483 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:08.483 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:08.483 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 47.923000342999998, 2024-04-19T04:25:08.483 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029897119999999999, 2024-04-19T04:25:08.484 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.484 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:08.484 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.484 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.484 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.484 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:08.484 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.484 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.484 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.484 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.484 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:08.484 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.484 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.484 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.485 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.485 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534048+0000", 2024-04-19T04:25:08.485 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.485 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.485 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.485 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.485 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534057+0000", 2024-04-19T04:25:08.485 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7930000000000003e-06 2024-04-19T04:25:08.485 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.485 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.485 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.485 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534075+0000", 2024-04-19T04:25:08.485 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7846000000000002e-05 2024-04-19T04:25:08.485 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.486 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.486 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.486 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534089+0000", 2024-04-19T04:25:08.486 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4463e-05 2024-04-19T04:25:08.486 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.486 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.486 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.486 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534198+0000", 2024-04-19T04:25:08.486 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109145 2024-04-19T04:25:08.486 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.486 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.486 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:08.486 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534202+0000", 2024-04-19T04:25:08.486 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.98e-06 2024-04-19T04:25:08.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.487 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.487 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.487 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558221+0000", 2024-04-19T04:25:08.487 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024018208999999999 2024-04-19T04:25:08.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.487 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.487 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.487 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558320+0000", 2024-04-19T04:25:08.487 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9642000000000006e-05 2024-04-19T04:25:08.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.487 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.487 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:08.487 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558401+0000", 2024-04-19T04:25:08.488 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1038000000000006e-05 2024-04-19T04:25:08.488 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.488 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.488 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:08.488 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561173+0000", 2024-04-19T04:25:08.488 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027714549999999999 2024-04-19T04:25:08.488 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.488 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.488 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:08.488 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563851+0000", 2024-04-19T04:25:08.488 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026786010000000001 2024-04-19T04:25:08.488 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.488 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.488 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:08.488 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563906+0000", 2024-04-19T04:25:08.489 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4895999999999998e-05 2024-04-19T04:25:08.489 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.489 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.489 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.489 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563946+0000", 2024-04-19T04:25:08.489 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0116e-05 2024-04-19T04:25:08.489 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.489 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.489 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.489 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.489 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.489 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:08.489 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:08.489 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 47.922946961999997, 2024-04-19T04:25:08.490 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029917846000000001, 2024-04-19T04:25:08.490 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.490 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:08.490 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.490 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.490 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.490 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:08.490 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.490 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.490 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.491 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.491 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:08.491 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.491 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.491 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.491 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.491 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534101+0000", 2024-04-19T04:25:08.491 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:08.491 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.491 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.491 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.491 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534111+0000", 2024-04-19T04:25:08.491 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5659999999999996e-06 2024-04-19T04:25:08.491 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.492 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.492 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.492 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534129+0000", 2024-04-19T04:25:08.492 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7632999999999999e-05 2024-04-19T04:25:08.492 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.492 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.492 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.492 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534143+0000", 2024-04-19T04:25:08.492 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4362000000000001e-05 2024-04-19T04:25:08.492 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.493 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.493 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.493 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534256+0000", 2024-04-19T04:25:08.493 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113267 2024-04-19T04:25:08.493 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.493 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.493 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:08.493 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534260+0000", 2024-04-19T04:25:08.493 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9949999999999999e-06 2024-04-19T04:25:08.493 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.493 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.493 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.493 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558653+0000", 2024-04-19T04:25:08.493 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024393182999999999 2024-04-19T04:25:08.493 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.494 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.494 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.494 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558704+0000", 2024-04-19T04:25:08.494 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0303999999999998e-05 2024-04-19T04:25:08.494 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.494 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.494 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:08.494 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558782+0000", 2024-04-19T04:25:08.494 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8079999999999998e-05 2024-04-19T04:25:08.494 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.494 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.494 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:08.494 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561309+0000", 2024-04-19T04:25:08.494 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002527708 2024-04-19T04:25:08.495 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.495 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.495 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:08.495 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563952+0000", 2024-04-19T04:25:08.495 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026425450000000001 2024-04-19T04:25:08.495 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.495 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.495 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:08.495 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563996+0000", 2024-04-19T04:25:08.495 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3606000000000002e-05 2024-04-19T04:25:08.495 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.495 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.495 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.495 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564021+0000", 2024-04-19T04:25:08.496 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.491e-05 2024-04-19T04:25:08.496 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.496 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.496 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.496 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.496 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.496 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:08.496 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:08.496 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 47.922894450999998, 2024-04-19T04:25:08.496 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:25:08.496 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.496 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:08.496 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.496 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.497 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.497 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:08.497 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.497 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.497 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.497 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.497 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:08.497 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.497 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.497 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.497 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.497 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:25:08.497 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.497 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.497 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.498 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.498 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:25:08.498 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:25:08.498 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.498 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.498 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.498 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:25:08.498 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:25:08.498 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.498 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.498 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.498 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:25:08.498 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:25:08.498 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.499 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.499 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.499 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:25:08.499 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:25:08.499 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.499 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.499 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:08.499 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:25:08.499 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:25:08.499 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.499 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.499 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.500 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:25:08.500 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:25:08.500 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.500 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.500 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.500 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:25:08.500 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:25:08.500 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.500 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.500 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:08.500 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:25:08.500 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:25:08.500 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.501 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.501 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:08.501 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:25:08.501 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:25:08.501 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.501 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.501 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:08.501 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:25:08.501 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:25:08.501 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.501 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.502 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:08.502 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:25:08.502 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:25:08.502 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.502 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.502 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.502 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:25:08.502 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:25:08.502 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.502 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.502 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.502 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.502 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.502 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:08.503 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:08.503 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 47.922839906, 2024-04-19T04:25:08.503 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:25:08.503 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.503 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:08.503 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.503 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.503 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.504 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:08.504 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.504 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.504 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.504 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.504 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:08.504 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.504 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.504 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.504 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.504 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:25:08.504 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.504 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.504 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.505 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.505 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:25:08.505 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:25:08.505 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.505 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.505 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.505 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:25:08.505 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:25:08.505 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.505 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.505 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.505 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:25:08.505 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:25:08.505 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.506 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.506 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.506 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:25:08.506 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:25:08.506 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.506 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.506 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:08.506 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:25:08.506 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:25:08.506 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.506 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.506 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.506 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:25:08.506 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:25:08.507 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.507 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.507 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.507 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:25:08.507 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:25:08.507 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.507 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.507 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:08.507 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:25:08.507 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:25:08.507 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.507 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.507 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:08.507 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:25:08.508 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:25:08.508 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.508 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:08.508 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:25:08.508 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:25:08.508 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.508 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:08.508 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:25:08.508 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:25:08.508 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.508 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.508 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:25:08.509 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:25:08.509 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.509 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.509 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.509 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.509 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.509 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:08.509 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:08.509 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.225525319999999, 2024-04-19T04:25:08.509 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:08.509 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.509 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:08.509 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:08.509 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:08.510 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.510 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:08.510 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.510 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.510 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.510 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.510 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:08.510 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.510 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.510 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.511 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.511 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:08.511 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.511 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.511 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.511 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.511 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:08.511 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.511 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.511 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.511 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.511 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:08.512 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:08.512 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.512 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.512 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.512 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:08.512 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:08.512 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.512 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.512 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.512 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:08.512 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:08.512 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.512 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.512 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.512 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:08.513 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:08.513 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.513 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.513 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.513 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:08.513 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:08.513 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.513 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.513 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:08.513 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:08.513 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:08.513 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.513 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.514 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:08.514 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:08.514 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:08.514 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.514 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.514 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:08.514 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:08.514 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:08.514 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.514 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.514 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:08.514 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:08.514 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:08.515 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.515 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.515 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.515 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:08.515 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:08.515 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.515 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.515 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.515 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.515 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.515 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:08.516 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:08.516 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.222344164000001, 2024-04-19T04:25:08.516 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:08.516 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.516 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:08.516 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:08.516 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:08.516 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.516 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:08.516 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.516 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.516 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.516 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.516 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:08.517 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.517 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.517 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.517 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.517 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:08.517 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.517 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.517 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.517 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.517 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:08.517 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.517 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.517 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.518 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.518 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:08.518 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:08.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.518 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.518 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.518 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:08.518 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:08.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.518 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.518 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.518 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:08.518 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:08.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.519 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.519 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.519 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:08.519 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:08.519 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.519 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.519 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.519 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:08.519 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:08.519 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.519 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.519 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:08.519 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:08.520 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:08.520 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.520 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.520 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:08.520 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:08.520 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:08.520 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.520 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.520 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:08.520 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:08.520 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:08.520 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.520 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.520 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:08.521 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:08.521 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:08.521 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.521 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.521 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.521 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:08.521 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:08.521 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.521 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.521 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.521 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.521 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.521 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:08.521 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:08.522 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.22177606, 2024-04-19T04:25:08.522 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:08.522 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.522 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:08.522 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.522 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.522 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.522 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:08.522 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.522 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.522 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.522 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.522 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:08.522 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.523 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.523 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.523 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.523 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:08.523 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:08.523 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.523 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.523 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.523 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:08.523 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:08.523 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.523 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.523 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.523 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:08.523 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:08.524 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.524 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.524 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.524 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:08.524 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:08.524 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.524 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.524 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.524 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:08.524 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:08.524 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.524 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.524 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.524 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:08.524 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:08.525 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.525 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.525 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:08.525 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:08.525 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:08.525 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.525 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.525 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.525 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:08.525 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:08.525 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.525 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.525 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.526 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.526 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.526 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:08.526 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:08.526 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.221430399000001, 2024-04-19T04:25:08.526 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:08.526 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.526 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:08.526 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:08.526 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:08.526 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.526 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:08.526 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.527 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.527 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.527 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.527 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:08.527 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.527 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.527 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.527 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.527 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:08.527 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.527 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.527 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.527 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.527 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:08.527 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.528 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.528 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.528 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.528 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:08.528 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:08.528 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.528 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.528 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.528 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:08.528 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:08.528 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.528 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.528 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.220705961, 2024-04-19T04:25:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.220698565999999, 2024-04-19T04:25:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.218873418999999, 2024-04-19T04:25:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26148 5.9 e27/20 ondisk, result = 0)", 2024-04-19T04:25:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.218773093999999, 2024-04-19T04:25:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.042005175999999998, 2024-04-19T04:25:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238276+0000", 2024-04-19T04:25:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238280+0000", 2024-04-19T04:25:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6399999999999999e-06 2024-04-19T04:25:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238286+0000", 2024-04-19T04:25:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2099999999999998e-06 2024-04-19T04:25:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238290+0000", 2024-04-19T04:25:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2470000000000002e-06 2024-04-19T04:25:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239526+0000", 2024-04-19T04:25:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012362619999999999 2024-04-19T04:25:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239538+0000", 2024-04-19T04:25:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1620999999999999e-05 2024-04-19T04:25:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280282+0000", 2024-04-19T04:25:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040743691999999998 2024-04-19T04:25:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.218139214000001, 2024-04-19T04:25:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.217604937999999, 2024-04-19T04:25:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26160 5.f e27/20 ondisk, result = 0)", 2024-04-19T04:25:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.216489563, 2024-04-19T04:25:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039752357000000002, 2024-04-19T04:25:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240559+0000", 2024-04-19T04:25:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240569+0000", 2024-04-19T04:25:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7720000000000006e-06 2024-04-19T04:25:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280164+0000", 2024-04-19T04:25:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039595324000000001 2024-04-19T04:25:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280190+0000", 2024-04-19T04:25:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5692000000000001e-05 2024-04-19T04:25:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280287+0000", 2024-04-19T04:25:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7536999999999998e-05 2024-04-19T04:25:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280299+0000", 2024-04-19T04:25:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2057e-05 2024-04-19T04:25:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3244999999999999e-05 2024-04-19T04:25:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26179 5.3 e27/20 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head v 27'1624, mlcod=27'1621)", 2024-04-19T04:25:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.213335811, 2024-04-19T04:25:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039964081999999998, 2024-04-19T04:25:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243713+0000", 2024-04-19T04:25:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243750+0000", 2024-04-19T04:25:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6704e-05 2024-04-19T04:25:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280162+0000", 2024-04-19T04:25:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036412117000000001 2024-04-19T04:25:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280186+0000", 2024-04-19T04:25:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4825999999999999e-05 2024-04-19T04:25:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012540000000000001 2024-04-19T04:25:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280347+0000", 2024-04-19T04:25:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4894000000000002e-05 2024-04-19T04:25:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283654+0000", 2024-04-19T04:25:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00330716 2024-04-19T04:25:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283678+0000", 2024-04-19T04:25:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3992e-05 2024-04-19T04:25:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:08.569 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:08.571 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:25:08.571 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:08.566+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:08.626 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:25:08.671 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:08.666+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:08.707 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:25:08.707 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [ 2024-04-19T04:25:08.707 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.707 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:55079 5.5 5:ad1fa6ae:::benchmark_data_smithi007_19526_object55078:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.707 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:08.704570+0000", 2024-04-19T04:25:08.707 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00059239999999999998, 2024-04-19T04:25:08.707 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00061984500000000005, 2024-04-19T04:25:08.707 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:08.707 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:08.707 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:08.708 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:08.708 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.708 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 55079 2024-04-19T04:25:08.708 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.708 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:08.708 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.708 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:08.708 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704570+0000", 2024-04-19T04:25:08.708 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.708 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.708 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.708 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:08.708 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704570+0000", 2024-04-19T04:25:08.708 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.708 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.709 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.709 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:08.709 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704569+0000", 2024-04-19T04:25:08.709 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.709 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.709 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.709 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:08.709 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704619+0000", 2024-04-19T04:25:08.709 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.9919000000000001e-05 2024-04-19T04:25:08.709 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.709 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.709 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:08.709 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704628+0000", 2024-04-19T04:25:08.709 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.6889999999999993e-06 2024-04-19T04:25:08.709 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.710 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.710 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.710 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704634+0000", 2024-04-19T04:25:08.710 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.5050000000000004e-06 2024-04-19T04:25:08.710 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.710 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.710 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:08.710 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704676+0000", 2024-04-19T04:25:08.710 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1338999999999998e-05 2024-04-19T04:25:08.710 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.711 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.711 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:08.711 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704809+0000", 2024-04-19T04:25:08.711 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013308100000000001 2024-04-19T04:25:08.711 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.711 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.711 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:08.711 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704938+0000", 2024-04-19T04:25:08.711 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012963499999999999 2024-04-19T04:25:08.711 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.711 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:08.711 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.711 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.711 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.711 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:55080 5.c 5.68e95b9c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.712 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:08.704649+0000", 2024-04-19T04:25:08.712 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00051308400000000002, 2024-04-19T04:25:08.712 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00061912600000000001, 2024-04-19T04:25:08.712 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:08.712 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:08.712 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:08.712 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:08.712 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.712 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 55080 2024-04-19T04:25:08.712 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.712 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:08.712 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.712 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:08.712 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704649+0000", 2024-04-19T04:25:08.712 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.713 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.713 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.713 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:08.713 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704649+0000", 2024-04-19T04:25:08.713 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.713 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.713 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.713 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:08.713 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704649+0000", 2024-04-19T04:25:08.713 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:08.713 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.713 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.713 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:08.713 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704691+0000", 2024-04-19T04:25:08.713 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2778000000000003e-05 2024-04-19T04:25:08.714 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.714 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.714 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:08.714 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704700+0000", 2024-04-19T04:25:08.714 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8140000000000007e-06 2024-04-19T04:25:08.714 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.714 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.714 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.714 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704707+0000", 2024-04-19T04:25:08.714 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.3969999999999999e-06 2024-04-19T04:25:08.714 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.714 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:08.714 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.714 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.715 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.715 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:55069 5.a 5:540800ae:::benchmark_data_smithi007_19526_object55068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.715 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:08.700500+0000", 2024-04-19T04:25:08.715 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0046622340000000003, 2024-04-19T04:25:08.715 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0048293099999999999, 2024-04-19T04:25:08.715 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:08.715 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:08.715 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:08.715 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:08.715 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.715 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 55069 2024-04-19T04:25:08.715 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.715 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:08.715 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.715 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:08.715 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700500+0000", 2024-04-19T04:25:08.716 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.716 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.716 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.716 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:08.716 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700500+0000", 2024-04-19T04:25:08.716 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.716 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.716 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.716 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:08.716 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700499+0000", 2024-04-19T04:25:08.716 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:08.716 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.716 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.717 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:08.717 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700563+0000", 2024-04-19T04:25:08.717 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.3949999999999996e-05 2024-04-19T04:25:08.717 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.717 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.717 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:08.717 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700579+0000", 2024-04-19T04:25:08.717 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.6118999999999999e-05 2024-04-19T04:25:08.718 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.718 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.718 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.718 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700587+0000", 2024-04-19T04:25:08.718 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.2050000000000002e-06 2024-04-19T04:25:08.718 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.718 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.718 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:08.718 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700628+0000", 2024-04-19T04:25:08.718 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1341999999999998e-05 2024-04-19T04:25:08.718 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.719 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.719 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:08.719 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700745+0000", 2024-04-19T04:25:08.719 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000116344 2024-04-19T04:25:08.719 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.719 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.719 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:08.719 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700841+0000", 2024-04-19T04:25:08.719 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.5810999999999995e-05 2024-04-19T04:25:08.719 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.719 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:08.719 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.719 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.719 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.719 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:55070 5.a 5:5577644c:::benchmark_data_smithi007_19526_object55069:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.720 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:08.700600+0000", 2024-04-19T04:25:08.720 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0045620529999999999, 2024-04-19T04:25:08.720 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0048029559999999997, 2024-04-19T04:25:08.720 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:08.720 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:08.720 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:08.720 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:08.720 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.720 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 55070 2024-04-19T04:25:08.720 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.720 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:08.720 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.720 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:08.720 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700600+0000", 2024-04-19T04:25:08.720 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.721 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.721 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.721 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:08.721 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700600+0000", 2024-04-19T04:25:08.721 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.721 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.721 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.721 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:08.721 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700600+0000", 2024-04-19T04:25:08.721 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:08.721 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.721 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.721 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:08.721 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700636+0000", 2024-04-19T04:25:08.721 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6109999999999998e-05 2024-04-19T04:25:08.722 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.722 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.722 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:08.722 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700650+0000", 2024-04-19T04:25:08.722 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.4708e-05 2024-04-19T04:25:08.722 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.722 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.722 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.722 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700657+0000", 2024-04-19T04:25:08.722 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.1639999999999998e-06 2024-04-19T04:25:08.722 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.722 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.722 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:08.722 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.702972+0000", 2024-04-19T04:25:08.722 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0023157 2024-04-19T04:25:08.723 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.723 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.723 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:08.723 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.703085+0000", 2024-04-19T04:25:08.723 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000113158 2024-04-19T04:25:08.723 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.723 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.723 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:08.723 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.703167+0000", 2024-04-19T04:25:08.723 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.1606000000000004e-05 2024-04-19T04:25:08.723 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.723 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:08.723 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.723 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.723 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.724 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:55068 5.7 e35/20 5:eb4b6d27:::benchmark_data_smithi007_19526_object55067:head v 35'3442, mlcod=35'3438)", 2024-04-19T04:25:08.724 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:08.700770+0000", 2024-04-19T04:25:08.724 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0043925479999999996, 2024-04-19T04:25:08.724 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.004704654, 2024-04-19T04:25:08.724 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:08.724 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:08.724 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:08.724 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.724 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:08.724 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700770+0000", 2024-04-19T04:25:08.724 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.724 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.724 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.724 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:08.725 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700770+0000", 2024-04-19T04:25:08.725 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.725 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.725 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.725 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:08.725 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700769+0000", 2024-04-19T04:25:08.725 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:08.725 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.725 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.725 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:08.726 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700820+0000", 2024-04-19T04:25:08.726 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.0739999999999999e-05 2024-04-19T04:25:08.726 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.726 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.726 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:08.726 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700833+0000", 2024-04-19T04:25:08.726 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3661e-05 2024-04-19T04:25:08.726 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.726 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.726 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.726 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700840+0000", 2024-04-19T04:25:08.726 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.9120000000000001e-06 2024-04-19T04:25:08.726 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.726 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.726 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:08.727 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700882+0000", 2024-04-19T04:25:08.727 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1906000000000002e-05 2024-04-19T04:25:08.727 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.727 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.727 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:08.727 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.700895+0000", 2024-04-19T04:25:08.727 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2676e-05 2024-04-19T04:25:08.727 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.727 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:08.727 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.727 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.727 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.727 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:55072 5.c 5:35cf7eac:::benchmark_data_smithi007_19526_object55071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.728 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:08.701389+0000", 2024-04-19T04:25:08.728 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.003773097, 2024-04-19T04:25:08.728 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0041464010000000001, 2024-04-19T04:25:08.728 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:08.728 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:08.728 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:08.729 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:08.729 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.729 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 55072 2024-04-19T04:25:08.729 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.729 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:08.729 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.729 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:08.729 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701389+0000", 2024-04-19T04:25:08.729 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.729 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.729 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.729 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:08.729 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701389+0000", 2024-04-19T04:25:08.729 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.729 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.730 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.730 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:08.730 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701388+0000", 2024-04-19T04:25:08.730 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.730 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.730 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.730 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:08.730 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701491+0000", 2024-04-19T04:25:08.730 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000102284 2024-04-19T04:25:08.730 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.730 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.730 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:08.730 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701505+0000", 2024-04-19T04:25:08.730 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.4173e-05 2024-04-19T04:25:08.731 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.731 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.731 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.731 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701515+0000", 2024-04-19T04:25:08.731 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0137e-05 2024-04-19T04:25:08.731 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.731 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.731 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:08.731 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701578+0000", 2024-04-19T04:25:08.731 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.2807999999999999e-05 2024-04-19T04:25:08.732 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.732 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.732 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:08.732 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701724+0000", 2024-04-19T04:25:08.732 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014583200000000001 2024-04-19T04:25:08.732 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.732 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.732 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:08.732 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701856+0000", 2024-04-19T04:25:08.732 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013228799999999999 2024-04-19T04:25:08.732 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.732 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:08.733 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.733 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.733 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.733 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:55074 5.4 5:2cbddb7e:::benchmark_data_smithi007_19526_object55073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.733 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:08.701568+0000", 2024-04-19T04:25:08.733 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.003594585, 2024-04-19T04:25:08.733 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00404164, 2024-04-19T04:25:08.733 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:08.733 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:08.733 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:08.733 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:08.733 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.734 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 55074 2024-04-19T04:25:08.734 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.734 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:08.734 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.734 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:08.734 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701568+0000", 2024-04-19T04:25:08.734 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.734 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.734 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.734 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:08.734 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701568+0000", 2024-04-19T04:25:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701567+0000", 2024-04-19T04:25:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701663+0000", 2024-04-19T04:25:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.5622e-05 2024-04-19T04:25:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:08.736 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701673+0000", 2024-04-19T04:25:08.736 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0311e-05 2024-04-19T04:25:08.736 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.736 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.736 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.736 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701680+0000", 2024-04-19T04:25:08.736 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.888e-06 2024-04-19T04:25:08.736 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.736 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.736 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:08.736 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701717+0000", 2024-04-19T04:25:08.736 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.7205e-05 2024-04-19T04:25:08.736 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.736 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.737 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:08.737 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701838+0000", 2024-04-19T04:25:08.737 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000121388 2024-04-19T04:25:08.737 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.737 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.737 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:08.737 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701964+0000", 2024-04-19T04:25:08.737 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012582399999999999 2024-04-19T04:25:08.737 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.737 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:08.737 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.737 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.737 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.737 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:55071 5.1 e35/20 5:86bb2f2d:::benchmark_data_smithi007_19526_object55070:head v 35'3494, mlcod=35'3492)", 2024-04-19T04:25:08.737 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:08.701834+0000", 2024-04-19T04:25:08.738 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0033284230000000001, 2024-04-19T04:25:08.738 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0038467610000000002, 2024-04-19T04:25:08.738 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:08.738 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:08.738 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:08.738 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.738 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:08.738 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701834+0000", 2024-04-19T04:25:08.738 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.738 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.738 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.738 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:08.738 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701834+0000", 2024-04-19T04:25:08.739 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.739 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.739 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.739 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:08.739 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701833+0000", 2024-04-19T04:25:08.739 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.739 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.739 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.739 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:08.739 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701904+0000", 2024-04-19T04:25:08.739 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.0533999999999999e-05 2024-04-19T04:25:08.739 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.739 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.739 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:08.739 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701913+0000", 2024-04-19T04:25:08.740 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.2799999999999992e-06 2024-04-19T04:25:08.740 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.740 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.740 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.740 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701919+0000", 2024-04-19T04:25:08.740 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.3799999999999999e-06 2024-04-19T04:25:08.740 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.740 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.740 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:08.740 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701974+0000", 2024-04-19T04:25:08.740 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4416999999999998e-05 2024-04-19T04:25:08.740 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.740 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.740 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:08.741 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.701993+0000", 2024-04-19T04:25:08.741 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.9136000000000001e-05 2024-04-19T04:25:08.741 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.741 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:08.741 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.741 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.741 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.741 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:55078 5.3 5:c8d7bead:::benchmark_data_smithi007_19526_object55077:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:08.741 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:08.704421+0000", 2024-04-19T04:25:08.741 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00074161099999999998, 2024-04-19T04:25:08.741 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0013720570000000001, 2024-04-19T04:25:08.741 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:08.741 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:08.741 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:08.742 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:08.742 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:08.742 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 55078 2024-04-19T04:25:08.742 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.742 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:08.742 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.742 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:08.742 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704421+0000", 2024-04-19T04:25:08.742 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.742 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.742 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.742 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:08.742 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704421+0000", 2024-04-19T04:25:08.742 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.742 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.743 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.743 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:08.743 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704420+0000", 2024-04-19T04:25:08.743 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.743 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.743 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.743 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:08.743 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704539+0000", 2024-04-19T04:25:08.743 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00011984 2024-04-19T04:25:08.744 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.744 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.744 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:08.744 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704550+0000", 2024-04-19T04:25:08.744 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0699e-05 2024-04-19T04:25:08.744 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.744 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.744 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.744 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704556+0000", 2024-04-19T04:25:08.744 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.7150000000000003e-06 2024-04-19T04:25:08.744 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.744 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.745 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:08.745 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704600+0000", 2024-04-19T04:25:08.745 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.4438999999999999e-05 2024-04-19T04:25:08.745 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.745 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.745 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:08.745 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704753+0000", 2024-04-19T04:25:08.745 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015298699999999999 2024-04-19T04:25:08.745 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.745 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.745 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:08.745 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704836+0000", 2024-04-19T04:25:08.745 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.2331999999999997e-05 2024-04-19T04:25:08.745 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.745 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:08.746 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.746 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.746 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.746 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:55077 5.0 e35/20 5:06e14b0a:::benchmark_data_smithi007_19526_object55076:head v 35'3447, mlcod=35'3444)", 2024-04-19T04:25:08.746 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:08.704440+0000", 2024-04-19T04:25:08.746 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00072276700000000003, 2024-04-19T04:25:08.746 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001433201, 2024-04-19T04:25:08.746 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:08.746 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:08.746 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:08.746 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.746 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:08.746 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704440+0000", 2024-04-19T04:25:08.746 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.746 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.747 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.747 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:08.747 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704440+0000", 2024-04-19T04:25:08.747 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.747 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.747 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.747 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:08.747 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704439+0000", 2024-04-19T04:25:08.747 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.747 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.747 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.747 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:08.747 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704557+0000", 2024-04-19T04:25:08.747 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000118794 2024-04-19T04:25:08.747 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.748 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.748 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:08.748 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704568+0000", 2024-04-19T04:25:08.748 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0158e-05 2024-04-19T04:25:08.748 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.748 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.748 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.748 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704574+0000", 2024-04-19T04:25:08.748 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7900000000000002e-06 2024-04-19T04:25:08.748 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.748 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.748 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:08.748 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704641+0000", 2024-04-19T04:25:08.748 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.6676999999999999e-05 2024-04-19T04:25:08.748 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.749 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.749 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:08.749 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704662+0000", 2024-04-19T04:25:08.749 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.1288999999999999e-05 2024-04-19T04:25:08.749 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.749 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:08.749 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.749 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.749 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.749 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:55075 5.1 e35/20 5:84cc4158:::benchmark_data_smithi007_19526_object55074:head v 35'3495, mlcod=35'3492)", 2024-04-19T04:25:08.749 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:08.704434+0000", 2024-04-19T04:25:08.749 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00072802200000000004, 2024-04-19T04:25:08.749 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0014953670000000001, 2024-04-19T04:25:08.749 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:08.749 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:08.750 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:08.750 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.750 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:08.750 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704434+0000", 2024-04-19T04:25:08.750 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.750 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.750 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.750 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:08.750 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704434+0000", 2024-04-19T04:25:08.750 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:08.750 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.750 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.750 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:08.750 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704434+0000", 2024-04-19T04:25:08.750 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:08.751 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.751 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.751 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:08.751 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704560+0000", 2024-04-19T04:25:08.751 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012646599999999999 2024-04-19T04:25:08.751 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.751 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.751 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:08.751 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704570+0000", 2024-04-19T04:25:08.751 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0040999999999999e-05 2024-04-19T04:25:08.751 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.751 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.751 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:08.751 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704577+0000", 2024-04-19T04:25:08.751 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.6139999999999997e-06 2024-04-19T04:25:08.751 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.752 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.752 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:08.752 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704615+0000", 2024-04-19T04:25:08.752 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8420999999999997e-05 2024-04-19T04:25:08.752 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:08.752 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:08.752 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:08.752 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.704634+0000", 2024-04-19T04:25:08.752 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8768000000000001e-05 2024-04-19T04:25:08.752 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.752 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:08.752 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.752 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:08.752 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-04-19T04:25:08.752 INFO:teuthology.orchestra.run.smithi066.stdout: "num_ops": 11 2024-04-19T04:25:08.752 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:25:08.753 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 24 16 55167 55151 143.605 119.312 0.0114801 0.00695698 2024-04-19T04:25:08.754 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:25:08.772 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:08.766+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:08.790 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:08.810 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-04-19T04:25:08.830 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:08.833 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:08.833 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T04:25:08.833 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:08.873 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:08.870+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:08.884 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T04:25:08.894 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:08.894 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:08.906 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:25:08.975 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:08.970+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:09.040 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:09.041 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:09.055 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:09.076 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:09.074+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:09.179 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:09.179 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:09.180 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:09.174+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:09.191 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:09.281 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:09.278+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:09.316 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:09.316 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:09.328 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:09.383 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:09.378+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:09.445 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:09.445 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:09.456 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:09.504 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:09.502+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:09.585 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:09.582+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:09.591 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:09.591 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:09.604 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:09.687 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:09.684+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:09.734 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:09.734 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:09.747 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:09.752 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 25 16 57049 57033 142.565 117.625 0.00547589 0.00700807 2024-04-19T04:25:09.790 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:09.786+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:09.800 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2024-04-19T04:25:09.877 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:09.878 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:09.889 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:09.884+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:09.890 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:25:09.991 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:09.988+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:10.032 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:10.032 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:10.047 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:25:10.092 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:10.090+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:10.181 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:10.182 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:10.193 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:10.190+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:10.194 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:25:10.293 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:10.290+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:10.331 INFO:teuthology.orchestra.run.smithi066.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:10.331 INFO:teuthology.orchestra.run.smithi066.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:10.345 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:10.394 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:10.394+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:10.469 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:10.469 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:10.481 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:10.494 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:10.492+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:10.598 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:10.592+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:10.606 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:10.606 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:10.618 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:10.696 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:10.692+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:10.742 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:10.743 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:10.753 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 26 16 58885 58869 141.495 114.75 0.00455293 0.00706122 2024-04-19T04:25:10.756 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:10.797 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:10.794+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:10.850 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:25:10.889 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:10.890 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:10.898 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:10.898+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:10.904 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:10.999 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:10.994+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:11.010 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:11.030 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-04-19T04:25:11.033 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:11.033 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:11.034 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:11.034 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:11.034 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:11.046 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:11.050 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:11.053 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:11.053 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T04:25:11.053 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:11.099 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:11.094+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:11.170 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:11.170 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:11.170 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:11.170 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:11.170 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.171 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:11.171 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:25:11.171 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 50.634798715000002, 2024-04-19T04:25:11.171 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026801078999999998, 2024-04-19T04:25:11.171 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.171 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.171 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.171 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.171 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.171 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:25:11.171 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.171 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.171 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.171 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.172 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:25:11.172 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.172 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.172 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.172 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533733+0000", 2024-04-19T04:25:11.172 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999976 2024-04-19T04:25:11.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.172 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.172 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.172 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533746+0000", 2024-04-19T04:25:11.172 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2679e-05 2024-04-19T04:25:11.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.172 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.172 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.173 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533769+0000", 2024-04-19T04:25:11.173 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2832000000000001e-05 2024-04-19T04:25:11.173 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.173 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.173 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.173 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:25:11.173 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0599999999999999e-05 2024-04-19T04:25:11.173 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.173 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.173 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.173 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533907+0000", 2024-04-19T04:25:11.173 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000118076 2024-04-19T04:25:11.173 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.173 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.173 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:25:11.174 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533919+0000", 2024-04-19T04:25:11.174 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1644999999999999e-05 2024-04-19T04:25:11.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.174 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.174 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.174 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553399+0000", 2024-04-19T04:25:11.174 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019479987000000001 2024-04-19T04:25:11.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.174 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.174 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.174 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553535+0000", 2024-04-19T04:25:11.174 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553400000000001 2024-04-19T04:25:11.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.175 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.175 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.175 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553696+0000", 2024-04-19T04:25:11.175 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000161068 2024-04-19T04:25:11.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.175 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.175 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:11.175 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558096+0000", 2024-04-19T04:25:11.175 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0043998880000000002 2024-04-19T04:25:11.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.175 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.175 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.175 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560465+0000", 2024-04-19T04:25:11.175 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023695159999999999 2024-04-19T04:25:11.176 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.176 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.176 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:11.176 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560513+0000", 2024-04-19T04:25:11.176 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7899000000000003e-05 2024-04-19T04:25:11.176 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.176 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.176 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.176 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560537+0000", 2024-04-19T04:25:11.176 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3768e-05 2024-04-19T04:25:11.176 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.176 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.176 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.177 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.177 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:11.177 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:11.177 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 50.634721640999999, 2024-04-19T04:25:11.177 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026864505, 2024-04-19T04:25:11.177 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.177 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.177 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.177 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.177 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.177 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:11.177 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.177 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:11.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533812+0000", 2024-04-19T04:25:11.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533818+0000", 2024-04-19T04:25:11.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2369999999999997e-06 2024-04-19T04:25:11.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533863+0000", 2024-04-19T04:25:11.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4515000000000003e-05 2024-04-19T04:25:11.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533880+0000", 2024-04-19T04:25:11.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7119e-05 2024-04-19T04:25:11.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534029+0000", 2024-04-19T04:25:11.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014955099999999999 2024-04-19T04:25:11.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.180 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.180 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:11.180 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534034+0000", 2024-04-19T04:25:11.180 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1649999999999997e-06 2024-04-19T04:25:11.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.180 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.180 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.180 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554888+0000", 2024-04-19T04:25:11.180 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020854075 2024-04-19T04:25:11.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.180 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.180 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.180 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554967+0000", 2024-04-19T04:25:11.181 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8209999999999998e-05 2024-04-19T04:25:11.181 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.181 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.181 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.181 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555087+0000", 2024-04-19T04:25:11.181 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000120411 2024-04-19T04:25:11.181 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.181 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.181 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:11.181 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559328+0000", 2024-04-19T04:25:11.181 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042409800000000001 2024-04-19T04:25:11.181 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.181 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.181 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.182 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560587+0000", 2024-04-19T04:25:11.182 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012587119999999999 2024-04-19T04:25:11.182 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.182 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.182 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:11.182 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560620+0000", 2024-04-19T04:25:11.182 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2716999999999999e-05 2024-04-19T04:25:11.182 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.182 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.182 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.182 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560677+0000", 2024-04-19T04:25:11.182 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7726999999999998e-05 2024-04-19T04:25:11.182 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.182 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.183 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.183 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.183 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.183 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:11.183 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:11.183 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 50.634639247999999, 2024-04-19T04:25:11.183 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027363064999999999, 2024-04-19T04:25:11.183 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.183 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.183 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.183 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.183 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.183 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:11.183 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:11.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533894+0000", 2024-04-19T04:25:11.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:11.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533913+0000", 2024-04-19T04:25:11.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8896e-05 2024-04-19T04:25:11.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533933+0000", 2024-04-19T04:25:11.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9775e-05 2024-04-19T04:25:11.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533967+0000", 2024-04-19T04:25:11.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4536000000000003e-05 2024-04-19T04:25:11.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.186 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.186 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:11.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553600000000001 2024-04-19T04:25:11.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.186 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:11.186 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534107+0000", 2024-04-19T04:25:11.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1470000000000003e-06 2024-04-19T04:25:11.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.186 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.186 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556463+0000", 2024-04-19T04:25:11.187 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022356536999999999 2024-04-19T04:25:11.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.187 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.187 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556586+0000", 2024-04-19T04:25:11.187 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122967 2024-04-19T04:25:11.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.187 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.187 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556738+0000", 2024-04-19T04:25:11.187 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015182800000000001 2024-04-19T04:25:11.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.187 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.187 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561020+0000", 2024-04-19T04:25:11.187 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042818819999999999 2024-04-19T04:25:11.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.188 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.188 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:11.188 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561183+0000", 2024-04-19T04:25:11.188 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000162683 2024-04-19T04:25:11.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.188 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.188 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:11.188 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561226+0000", 2024-04-19T04:25:11.188 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3686000000000002e-05 2024-04-19T04:25:11.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.189 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.189 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.189 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561258+0000", 2024-04-19T04:25:11.189 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1814999999999999e-05 2024-04-19T04:25:11.189 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.189 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.189 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.189 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.189 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:11.189 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:11.189 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 50.634548735000003, 2024-04-19T04:25:11.189 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027417816000000001, 2024-04-19T04:25:11.189 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.190 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.190 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.190 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.190 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:11.190 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.190 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.190 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:11.190 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.191 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.191 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533984+0000", 2024-04-19T04:25:11.191 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:11.191 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.191 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.191 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.191 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:25:11.191 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3876000000000001e-05 2024-04-19T04:25:11.191 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.191 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.191 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.191 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534015+0000", 2024-04-19T04:25:11.191 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6818999999999999e-05 2024-04-19T04:25:11.191 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.192 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.192 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.192 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534030+0000", 2024-04-19T04:25:11.192 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.537e-05 2024-04-19T04:25:11.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.192 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.192 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.192 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534152+0000", 2024-04-19T04:25:11.192 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121685 2024-04-19T04:25:11.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.192 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.192 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:11.192 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534156+0000", 2024-04-19T04:25:11.192 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9029999999999997e-06 2024-04-19T04:25:11.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.192 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.193 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.193 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557520+0000", 2024-04-19T04:25:11.193 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023364125999999999 2024-04-19T04:25:11.193 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.193 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.193 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.193 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557585+0000", 2024-04-19T04:25:11.193 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5275000000000001e-05 2024-04-19T04:25:11.193 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.194 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.194 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.194 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557719+0000", 2024-04-19T04:25:11.194 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013396299999999999 2024-04-19T04:25:11.194 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.194 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.194 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.194 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561133+0000", 2024-04-19T04:25:11.194 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034140989999999999 2024-04-19T04:25:11.194 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.194 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.194 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:11.194 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561352+0000", 2024-04-19T04:25:11.195 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0002185 2024-04-19T04:25:11.195 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.195 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.195 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:11.195 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561380+0000", 2024-04-19T04:25:11.195 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8317999999999999e-05 2024-04-19T04:25:11.195 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.195 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.195 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.195 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561403+0000", 2024-04-19T04:25:11.195 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3264999999999998e-05 2024-04-19T04:25:11.195 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.195 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.195 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.196 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.196 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.196 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:11.196 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:11.196 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 50.634485089999998, 2024-04-19T04:25:11.196 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029897119999999999, 2024-04-19T04:25:11.196 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.196 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.196 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.196 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.196 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.196 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:11.196 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.196 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.196 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.196 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.197 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:11.197 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.197 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.197 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.197 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534048+0000", 2024-04-19T04:25:11.197 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.197 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.197 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.197 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534057+0000", 2024-04-19T04:25:11.197 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7930000000000003e-06 2024-04-19T04:25:11.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.197 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.197 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.197 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534075+0000", 2024-04-19T04:25:11.197 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7846000000000002e-05 2024-04-19T04:25:11.198 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.198 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.198 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.198 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534089+0000", 2024-04-19T04:25:11.198 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4463e-05 2024-04-19T04:25:11.198 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.198 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.198 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.198 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534198+0000", 2024-04-19T04:25:11.198 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109145 2024-04-19T04:25:11.198 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.198 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.198 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:11.198 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534202+0000", 2024-04-19T04:25:11.198 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.98e-06 2024-04-19T04:25:11.199 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.199 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.199 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.199 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558221+0000", 2024-04-19T04:25:11.199 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024018208999999999 2024-04-19T04:25:11.199 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.199 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.199 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.199 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558320+0000", 2024-04-19T04:25:11.199 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9642000000000006e-05 2024-04-19T04:25:11.199 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.199 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.199 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.199 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558401+0000", 2024-04-19T04:25:11.199 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1038000000000006e-05 2024-04-19T04:25:11.199 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.200 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.200 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.200 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561173+0000", 2024-04-19T04:25:11.200 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027714549999999999 2024-04-19T04:25:11.200 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.200 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.200 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:11.200 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563851+0000", 2024-04-19T04:25:11.200 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026786010000000001 2024-04-19T04:25:11.200 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.200 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.200 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:11.200 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563906+0000", 2024-04-19T04:25:11.200 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4895999999999998e-05 2024-04-19T04:25:11.201 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.201 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.201 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.201 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563946+0000", 2024-04-19T04:25:11.201 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0116e-05 2024-04-19T04:25:11.201 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.201 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.201 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.201 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.201 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.201 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:11.201 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:11.201 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 50.634431708999998, 2024-04-19T04:25:11.201 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029917846000000001, 2024-04-19T04:25:11.202 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.202 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.202 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.202 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.202 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.202 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:11.202 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.202 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.202 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.202 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.202 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:11.202 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.203 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.203 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.203 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534101+0000", 2024-04-19T04:25:11.203 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:11.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.203 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.203 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.203 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534111+0000", 2024-04-19T04:25:11.203 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5659999999999996e-06 2024-04-19T04:25:11.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.203 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.203 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.204 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534129+0000", 2024-04-19T04:25:11.204 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7632999999999999e-05 2024-04-19T04:25:11.204 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.204 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.204 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.204 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534143+0000", 2024-04-19T04:25:11.204 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4362000000000001e-05 2024-04-19T04:25:11.204 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.204 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.204 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.204 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534256+0000", 2024-04-19T04:25:11.204 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113267 2024-04-19T04:25:11.205 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.205 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.205 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:11.205 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534260+0000", 2024-04-19T04:25:11.205 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9949999999999999e-06 2024-04-19T04:25:11.205 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.205 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.205 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.205 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558653+0000", 2024-04-19T04:25:11.205 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024393182999999999 2024-04-19T04:25:11.205 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.205 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.206 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.206 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558704+0000", 2024-04-19T04:25:11.206 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0303999999999998e-05 2024-04-19T04:25:11.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.206 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.206 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.206 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558782+0000", 2024-04-19T04:25:11.206 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8079999999999998e-05 2024-04-19T04:25:11.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.206 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.206 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.206 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561309+0000", 2024-04-19T04:25:11.206 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002527708 2024-04-19T04:25:11.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.206 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.207 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:11.207 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563952+0000", 2024-04-19T04:25:11.207 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026425450000000001 2024-04-19T04:25:11.207 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.207 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.207 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:11.207 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563996+0000", 2024-04-19T04:25:11.207 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3606000000000002e-05 2024-04-19T04:25:11.207 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.207 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.207 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.207 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564021+0000", 2024-04-19T04:25:11.207 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.491e-05 2024-04-19T04:25:11.208 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.208 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.208 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.208 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.208 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.208 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:11.208 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:11.208 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 50.634379197999998, 2024-04-19T04:25:11.208 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:25:11.208 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.208 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.208 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.208 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.208 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.209 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:11.209 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.209 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.209 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.209 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.209 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:11.209 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.209 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.209 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.209 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.209 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:25:11.209 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.209 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.209 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.209 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.210 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:25:11.210 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:25:11.210 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.210 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.210 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.210 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:25:11.210 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:25:11.210 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.210 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.210 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.210 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:25:11.210 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:25:11.210 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.211 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.211 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.211 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:25:11.211 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:25:11.211 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.211 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.211 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:11.211 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:25:11.211 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:25:11.211 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.211 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.211 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.211 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:25:11.211 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:25:11.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.212 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.212 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.212 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:25:11.212 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:25:11.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.212 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.212 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.212 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:25:11.212 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:25:11.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.212 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.212 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.212 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:25:11.213 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:25:11.213 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.213 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.213 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:11.213 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:25:11.213 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:25:11.213 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.213 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.213 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:11.213 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:25:11.213 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:25:11.213 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.213 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.213 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.213 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:25:11.214 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:25:11.214 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.214 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.214 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.214 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.214 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.214 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:11.214 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:11.214 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 50.634324653, 2024-04-19T04:25:11.214 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:25:11.214 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.214 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.214 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.214 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.215 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.215 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:11.215 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.215 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.215 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.215 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.215 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:11.215 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.215 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.215 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.215 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.215 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:25:11.215 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.216 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.216 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.216 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.216 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:25:11.216 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:25:11.216 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.216 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.216 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.216 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:25:11.216 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:25:11.216 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.216 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.216 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.216 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:25:11.216 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:25:11.217 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.217 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.217 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.217 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:25:11.217 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:25:11.217 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.217 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.217 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:11.217 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:25:11.217 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:25:11.217 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.217 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.217 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.217 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:25:11.218 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:25:11.218 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.218 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.218 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.218 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:25:11.218 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:25:11.218 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.218 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.218 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.218 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:25:11.218 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:25:11.218 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.218 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.219 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.219 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:25:11.219 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:25:11.219 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.219 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.219 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:11.219 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:25:11.219 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:25:11.219 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.219 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.219 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:11.219 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:25:11.219 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:25:11.219 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.219 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.220 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.220 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:25:11.220 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:25:11.220 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.220 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.220 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.220 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.220 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.220 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:11.220 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:11.220 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 16.937010066999999, 2024-04-19T04:25:11.220 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:11.220 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.220 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.220 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:11.221 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:11.221 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.221 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:11.221 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.221 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.221 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.221 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.221 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:11.221 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.221 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.221 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.221 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.221 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:11.221 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.222 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.222 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.222 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.222 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:11.222 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.222 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.222 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.222 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.222 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:11.222 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:11.222 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.222 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.222 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.222 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:11.223 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:11.223 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.223 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.223 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.223 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:11.223 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:11.223 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.223 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.223 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.223 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:11.223 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:11.223 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.223 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.223 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.223 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:11.223 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:11.224 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.224 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.224 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.224 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:11.224 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:11.224 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.224 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.224 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:11.224 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:11.224 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:11.224 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.224 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.224 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.224 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:11.224 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:11.225 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.225 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.225 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:11.225 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:11.225 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:11.225 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.225 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.225 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.225 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:11.225 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:11.225 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.225 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.225 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.225 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.225 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.226 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:11.226 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:11.226 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 16.933828910999999, 2024-04-19T04:25:11.226 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:11.226 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.226 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.226 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:11.226 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:11.226 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.226 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:11.226 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.226 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.227 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.227 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.227 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:11.227 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.227 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.227 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.227 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.227 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:11.227 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.227 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.227 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.227 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.227 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:11.227 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.228 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.228 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.228 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.228 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:11.228 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:11.228 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.228 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.228 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.228 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:11.228 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:11.228 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.228 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.228 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.228 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:11.229 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:11.229 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.229 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.229 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.229 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:11.229 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:11.229 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.229 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.229 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.229 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:11.229 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:11.229 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.229 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.229 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.230 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:11.230 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:11.230 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.230 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.230 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.230 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:11.230 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:11.230 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.230 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.230 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:11.230 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:11.230 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:11.230 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.230 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.231 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:11.231 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:11.231 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:11.231 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.231 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.231 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.231 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:11.231 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:11.231 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.231 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.231 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.231 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.231 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.231 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:11.231 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:11.232 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 16.933260807, 2024-04-19T04:25:11.232 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:11.232 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.232 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.232 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.232 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.232 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.232 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:11.232 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.232 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.232 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.232 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.232 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:11.233 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.233 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.233 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.233 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.233 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:11.233 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:11.233 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.233 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.233 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.233 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:11.233 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:11.233 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.233 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.233 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.233 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:11.234 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:11.234 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.234 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.234 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.234 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:11.234 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:11.234 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.234 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.234 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.234 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:11.234 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:11.234 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.234 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.234 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.235 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:11.235 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:11.235 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.235 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.235 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:11.235 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:11.235 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:11.235 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.235 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.235 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.235 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:11.235 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:11.235 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.235 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.235 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.236 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.236 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.236 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:11.236 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:11.236 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 16.932915145999999, 2024-04-19T04:25:11.236 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:11.236 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.236 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.236 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:11.236 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:11.236 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.236 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:11.236 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.236 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.237 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.237 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.237 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:11.237 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.237 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.237 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.237 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.237 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:11.237 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.237 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.237 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.237 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.237 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:11.237 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.237 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.238 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.238 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.238 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:11.238 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:11.238 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.238 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.238 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.238 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:11.238 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:11.238 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.238 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.238 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.238 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:11.238 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:11.239 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.239 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.239 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.239 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:11.239 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:11.239 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.239 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.239 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.239 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:11.239 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:11.239 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.239 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.239 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.239 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:11.240 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:11.240 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.240 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.240 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.240 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:11.240 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:11.240 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.240 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.240 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:11.240 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:11.240 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:11.240 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.240 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.240 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:11.240 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:11.241 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:11.241 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.241 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.241 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.241 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:11.241 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:11.241 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.241 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.241 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.241 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.241 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.241 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:11.241 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:11.241 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 16.932190708, 2024-04-19T04:25:11.241 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:11.242 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.242 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.242 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.242 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.242 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.242 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:11.242 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.242 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.242 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.242 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.242 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:11.242 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.242 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.242 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.243 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.243 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:11.243 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.243 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.243 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.243 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.243 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:11.243 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:11.243 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.243 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.243 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.243 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:11.243 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:11.243 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.244 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.244 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.244 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:11.244 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:11.244 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.244 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.244 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.244 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:11.244 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:11.244 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.244 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.244 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.244 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:11.244 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:11.245 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.245 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.245 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:11.245 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:11.245 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:11.245 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.245 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.245 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.245 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:11.245 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:11.245 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.245 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.245 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.245 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.245 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.246 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:11.246 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:11.246 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 16.932183312999999, 2024-04-19T04:25:11.246 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:11.246 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.246 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.246 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.246 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.246 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.246 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:11.246 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.246 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.246 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.246 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.247 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:11.247 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.247 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.247 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.247 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.247 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:11.247 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:11.247 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.247 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.247 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.247 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:11.247 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:11.247 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.247 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.247 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.248 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:11.248 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:11.248 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.248 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.248 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.248 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:11.248 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:11.248 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.248 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.248 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.248 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:11.248 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:11.248 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.248 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.248 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.249 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:11.249 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:11.249 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.249 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.249 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:11.249 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:11.249 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:11.249 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.249 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.249 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.249 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:11.249 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:11.249 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.249 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.250 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.250 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.250 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.250 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:11.250 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:11.250 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 16.930358166000001, 2024-04-19T04:25:11.250 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:11.250 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.250 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.250 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:11.250 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:11.250 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.251 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:11.251 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.251 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.251 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.251 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.251 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:11.251 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.251 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.251 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.251 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.251 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:11.251 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.252 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.252 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.252 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.252 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:11.252 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.252 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.252 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.252 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.252 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:11.252 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:11.252 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.252 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.253 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.253 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:11.253 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:11.253 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.253 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.253 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.253 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:11.253 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:11.253 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.253 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.253 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.253 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:11.253 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:11.253 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.253 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.254 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.254 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:11.254 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:11.254 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.254 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.254 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.254 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:11.254 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:11.254 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.254 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.254 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.254 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:11.254 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:11.255 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.255 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.255 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:11.255 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:11.255 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:11.255 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.255 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.255 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:11.255 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:11.255 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:11.255 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.255 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.255 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.255 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:11.255 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:11.256 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.256 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.256 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.256 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.256 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.256 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26148 5.9 e27/20 ondisk, result = 0)", 2024-04-19T04:25:11.256 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:11.256 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 16.930257841, 2024-04-19T04:25:11.256 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.042005175999999998, 2024-04-19T04:25:11.256 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.256 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:11.256 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.256 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.256 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.257 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:11.257 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.257 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.257 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.257 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:11.257 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.257 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.257 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.257 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238276+0000", 2024-04-19T04:25:11.257 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:11.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.257 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.258 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.258 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238280+0000", 2024-04-19T04:25:11.258 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6399999999999999e-06 2024-04-19T04:25:11.258 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.258 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.258 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.258 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238286+0000", 2024-04-19T04:25:11.258 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2099999999999998e-06 2024-04-19T04:25:11.258 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.258 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.258 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.258 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238290+0000", 2024-04-19T04:25:11.258 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2470000000000002e-06 2024-04-19T04:25:11.258 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.259 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.259 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.259 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239526+0000", 2024-04-19T04:25:11.259 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012362619999999999 2024-04-19T04:25:11.259 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.259 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.259 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.259 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239538+0000", 2024-04-19T04:25:11.259 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1620999999999999e-05 2024-04-19T04:25:11.259 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.259 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.259 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.259 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280282+0000", 2024-04-19T04:25:11.259 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040743691999999998 2024-04-19T04:25:11.260 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.260 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.260 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.260 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.260 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:11.260 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:11.260 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 16.929623961000001, 2024-04-19T04:25:11.260 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:11.260 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.260 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.260 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:11.260 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:11.260 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.261 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:11.261 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.261 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.261 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.261 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.261 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:11.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.261 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.262 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.262 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.262 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:11.262 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.262 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.262 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.262 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.262 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:11.262 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.263 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.263 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.263 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:11.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:11.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.263 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.263 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.263 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:11.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:11.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.263 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.263 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.264 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:11.264 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:11.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.264 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.264 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:11.264 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:11.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.264 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.264 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:11.264 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:11.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:11.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:11.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:11.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:11.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:11.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:11.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:11.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.266 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:11.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:11.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:11.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.266 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:11.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:11.266 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.266 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.266 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.267 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.267 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.267 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:11.267 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:11.267 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 16.929089685000001, 2024-04-19T04:25:11.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:11.267 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.267 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.267 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.267 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.267 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.267 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:11.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.268 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.268 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:11.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.268 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.268 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:11.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.268 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.268 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:11.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:11.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.269 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.269 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:11.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:11.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.269 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.269 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:11.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:11.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:11.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:11.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:11.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:11.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:11.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:11.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:11.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:11.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:11.272 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.272 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.272 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.272 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.272 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26160 5.f e27/20 ondisk, result = 0)", 2024-04-19T04:25:11.272 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:11.272 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 16.92797431, 2024-04-19T04:25:11.272 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039752357000000002, 2024-04-19T04:25:11.272 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.272 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:11.272 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.273 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:11.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.273 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:11.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.273 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240559+0000", 2024-04-19T04:25:11.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:11.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.274 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240569+0000", 2024-04-19T04:25:11.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7720000000000006e-06 2024-04-19T04:25:11.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.274 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280164+0000", 2024-04-19T04:25:11.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039595324000000001 2024-04-19T04:25:11.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.274 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280190+0000", 2024-04-19T04:25:11.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5692000000000001e-05 2024-04-19T04:25:11.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280287+0000", 2024-04-19T04:25:11.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7536999999999998e-05 2024-04-19T04:25:11.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280299+0000", 2024-04-19T04:25:11.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2057e-05 2024-04-19T04:25:11.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:11.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3244999999999999e-05 2024-04-19T04:25:11.276 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.276 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.276 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.276 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26179 5.3 e27/20 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head v 27'1624, mlcod=27'1621)", 2024-04-19T04:25:11.276 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:11.276 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 16.924820558, 2024-04-19T04:25:11.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039964081999999998, 2024-04-19T04:25:11.277 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:11.277 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.277 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:11.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:11.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:11.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:11.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:11.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:11.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:11.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243713+0000", 2024-04-19T04:25:11.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:11.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243750+0000", 2024-04-19T04:25:11.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6704e-05 2024-04-19T04:25:11.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:11.279 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280162+0000", 2024-04-19T04:25:11.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036412117000000001 2024-04-19T04:25:11.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.279 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.279 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280186+0000", 2024-04-19T04:25:11.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4825999999999999e-05 2024-04-19T04:25:11.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.279 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:11.279 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:11.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012540000000000001 2024-04-19T04:25:11.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:11.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280347+0000", 2024-04-19T04:25:11.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4894000000000002e-05 2024-04-19T04:25:11.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:11.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283654+0000", 2024-04-19T04:25:11.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00330716 2024-04-19T04:25:11.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:11.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:11.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:11.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283678+0000", 2024-04-19T04:25:11.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3992e-05 2024-04-19T04:25:11.281 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.281 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.281 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.281 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:11.281 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:11.281 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:11.283 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:25:11.284 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:11.278+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:11.383 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:11.382+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:11.422 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:25:11.422 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [ 2024-04-19T04:25:11.423 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.423 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:60079 5.b e36/20 5:d1cecbcc:::benchmark_data_smithi007_19526_object60078:head v 36'3737, mlcod=36'3732)", 2024-04-19T04:25:11.423 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:11.414936+0000", 2024-04-19T04:25:11.423 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0061112229999999998, 2024-04-19T04:25:11.423 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.006133019, 2024-04-19T04:25:11.423 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.423 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:11.423 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.423 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.423 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.423 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.414936+0000", 2024-04-19T04:25:11.423 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.423 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.423 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.424 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.424 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.414936+0000", 2024-04-19T04:25:11.424 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.424 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.424 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.424 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.424 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.414935+0000", 2024-04-19T04:25:11.424 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:11.424 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.424 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.424 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.424 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.414984+0000", 2024-04-19T04:25:11.424 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.8958000000000001e-05 2024-04-19T04:25:11.424 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.424 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.425 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.425 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.414993+0000", 2024-04-19T04:25:11.425 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.6719999999999993e-06 2024-04-19T04:25:11.425 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.425 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.425 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.425 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.414999+0000", 2024-04-19T04:25:11.425 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.8139999999999997e-06 2024-04-19T04:25:11.425 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.425 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.425 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.425 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.416561+0000", 2024-04-19T04:25:11.425 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001562117 2024-04-19T04:25:11.426 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.426 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.426 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.426 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.416626+0000", 2024-04-19T04:25:11.426 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.4592999999999996e-05 2024-04-19T04:25:11.426 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.426 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.426 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.426 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.426 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.427 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:60081 5.3 5:cac77bd6:::benchmark_data_smithi007_19526_object60080:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:11.427 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:11.415231+0000", 2024-04-19T04:25:11.427 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0058165320000000001, 2024-04-19T04:25:11.427 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0058939029999999998, 2024-04-19T04:25:11.427 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.427 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:11.427 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.427 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.427 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.427 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 60081 2024-04-19T04:25:11.427 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.427 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.427 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.427 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.428 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.415231+0000", 2024-04-19T04:25:11.428 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.428 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.428 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.428 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.428 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.415231+0000", 2024-04-19T04:25:11.428 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.428 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.428 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.428 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.428 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.415229+0000", 2024-04-19T04:25:11.428 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:11.428 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.428 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.428 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.429 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.415281+0000", 2024-04-19T04:25:11.429 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.1947999999999998e-05 2024-04-19T04:25:11.429 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.429 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.429 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.429 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.415297+0000", 2024-04-19T04:25:11.429 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.5851000000000001e-05 2024-04-19T04:25:11.429 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.429 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.429 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.429 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.415308+0000", 2024-04-19T04:25:11.429 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1088e-05 2024-04-19T04:25:11.429 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.429 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.429 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.430 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419169+0000", 2024-04-19T04:25:11.430 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.003861307 2024-04-19T04:25:11.430 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.430 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.430 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.430 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419312+0000", 2024-04-19T04:25:11.430 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000142652 2024-04-19T04:25:11.430 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.430 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.430 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:11.430 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419484+0000", 2024-04-19T04:25:11.430 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000171993 2024-04-19T04:25:11.430 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.430 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.431 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.431 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.431 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.431 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:60082 5.4 5:2e8c6619:::benchmark_data_smithi007_19526_object60081:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:11.431 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:11.417151+0000", 2024-04-19T04:25:11.431 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0038966729999999998, 2024-04-19T04:25:11.431 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0040502569999999998, 2024-04-19T04:25:11.431 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.431 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:11.431 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.431 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.431 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.431 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 60082 2024-04-19T04:25:11.431 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.431 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.432 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.432 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.432 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.417151+0000", 2024-04-19T04:25:11.432 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.432 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.432 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.432 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.432 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.417151+0000", 2024-04-19T04:25:11.432 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.432 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.432 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.432 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.432 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.417150+0000", 2024-04-19T04:25:11.432 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.433 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.433 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.433 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.433 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.417239+0000", 2024-04-19T04:25:11.433 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8889999999999998e-05 2024-04-19T04:25:11.433 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.433 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.433 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.433 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.417251+0000", 2024-04-19T04:25:11.433 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1938e-05 2024-04-19T04:25:11.433 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.433 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.433 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.433 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.417256+0000", 2024-04-19T04:25:11.434 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.3920000000000002e-06 2024-04-19T04:25:11.434 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.434 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.434 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.434 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.417296+0000", 2024-04-19T04:25:11.434 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9625000000000001e-05 2024-04-19T04:25:11.434 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.434 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.434 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.434 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.417409+0000", 2024-04-19T04:25:11.434 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00011322100000000001 2024-04-19T04:25:11.434 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.434 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.434 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.434 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.417527+0000", 2024-04-19T04:25:11.435 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00011838 2024-04-19T04:25:11.435 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.435 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.435 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.435 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.435 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.435 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:60083 5.1 e36/20 5:81dca73e:::benchmark_data_smithi007_19526_object60082:head v 36'3830, mlcod=36'3828)", 2024-04-19T04:25:11.435 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:11.417682+0000", 2024-04-19T04:25:11.435 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0033651750000000002, 2024-04-19T04:25:11.435 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.003587743, 2024-04-19T04:25:11.435 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.435 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:11.435 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.435 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.435 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.435 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.417682+0000", 2024-04-19T04:25:11.436 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.436 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.436 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.436 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.436 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.417682+0000", 2024-04-19T04:25:11.436 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.436 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.436 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.436 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.436 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.417681+0000", 2024-04-19T04:25:11.436 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:11.436 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.436 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.436 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.437 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.417742+0000", 2024-04-19T04:25:11.437 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.0495000000000003e-05 2024-04-19T04:25:11.437 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.437 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.437 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.437 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.417751+0000", 2024-04-19T04:25:11.437 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.7690000000000002e-06 2024-04-19T04:25:11.437 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.437 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.437 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.437 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.417755+0000", 2024-04-19T04:25:11.437 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9079999999999997e-06 2024-04-19T04:25:11.437 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.437 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.437 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.438 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.417801+0000", 2024-04-19T04:25:11.438 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.5911999999999997e-05 2024-04-19T04:25:11.438 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.438 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.438 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.438 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.417813+0000", 2024-04-19T04:25:11.438 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2088e-05 2024-04-19T04:25:11.438 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.438 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.438 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.438 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.421272+0000", 2024-04-19T04:25:11.438 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00345955 2024-04-19T04:25:11.438 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.438 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.438 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.439 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.439 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.439 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:60084 5.e e36/20 5:71b3ccca:::benchmark_data_smithi007_19526_object60083:head v 36'3864, mlcod=36'3862)", 2024-04-19T04:25:11.439 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:11.418261+0000", 2024-04-19T04:25:11.439 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.002786022, 2024-04-19T04:25:11.439 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.003076474, 2024-04-19T04:25:11.439 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.439 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:11.439 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.439 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.439 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.439 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418261+0000", 2024-04-19T04:25:11.439 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.439 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.439 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.440 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.440 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418261+0000", 2024-04-19T04:25:11.440 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.440 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.440 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.440 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.440 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418261+0000", 2024-04-19T04:25:11.440 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:11.440 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.440 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.440 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.440 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418325+0000", 2024-04-19T04:25:11.440 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.4376999999999997e-05 2024-04-19T04:25:11.440 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.440 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.441 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.441 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418334+0000", 2024-04-19T04:25:11.441 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.3510000000000008e-06 2024-04-19T04:25:11.441 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.441 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.441 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.441 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418341+0000", 2024-04-19T04:25:11.441 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.6780000000000003e-06 2024-04-19T04:25:11.441 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.441 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.441 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.441 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418420+0000", 2024-04-19T04:25:11.441 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.9239999999999993e-05 2024-04-19T04:25:11.441 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.441 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.441 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418440+0000", 2024-04-19T04:25:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.9482000000000001e-05 2024-04-19T04:25:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:60085 5.4 5:245bc862:::benchmark_data_smithi007_19526_object60084:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:11.418787+0000", 2024-04-19T04:25:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0022604790000000001, 2024-04-19T04:25:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.002591267, 2024-04-19T04:25:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:11.442 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 60085 2024-04-19T04:25:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418787+0000", 2024-04-19T04:25:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418787+0000", 2024-04-19T04:25:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.443 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.444 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.444 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.444 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418785+0000", 2024-04-19T04:25:11.444 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:11.444 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.444 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.444 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.444 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418870+0000", 2024-04-19T04:25:11.444 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.4407999999999996e-05 2024-04-19T04:25:11.444 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.444 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.444 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.444 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418885+0000", 2024-04-19T04:25:11.444 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.5099999999999999e-05 2024-04-19T04:25:11.444 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.445 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.445 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.445 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418893+0000", 2024-04-19T04:25:11.445 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.9359999999999999e-06 2024-04-19T04:25:11.445 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.445 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.445 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.445 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419668+0000", 2024-04-19T04:25:11.445 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00077501399999999998 2024-04-19T04:25:11.445 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.445 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.445 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.445 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419786+0000", 2024-04-19T04:25:11.445 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00011793100000000001 2024-04-19T04:25:11.445 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.446 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.446 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.446 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419918+0000", 2024-04-19T04:25:11.446 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013211000000000001 2024-04-19T04:25:11.446 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.446 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.446 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.446 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.446 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.446 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:60086 5.4 5.a8ea4424 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:11.446 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:11.418903+0000", 2024-04-19T04:25:11.446 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0021444519999999998, 2024-04-19T04:25:11.446 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0025114170000000002, 2024-04-19T04:25:11.446 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.446 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:11.447 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.447 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.447 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.447 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 60086 2024-04-19T04:25:11.447 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.447 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.447 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.447 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.447 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418903+0000", 2024-04-19T04:25:11.447 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.447 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.447 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.447 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.447 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418903+0000", 2024-04-19T04:25:11.447 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.448 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.448 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.448 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.448 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418902+0000", 2024-04-19T04:25:11.448 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:11.448 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.448 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.448 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.448 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418939+0000", 2024-04-19T04:25:11.448 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6301999999999999e-05 2024-04-19T04:25:11.448 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.448 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.448 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.448 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418946+0000", 2024-04-19T04:25:11.448 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.7379999999999994e-06 2024-04-19T04:25:11.449 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.449 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.449 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.449 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418952+0000", 2024-04-19T04:25:11.449 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.677e-06 2024-04-19T04:25:11.449 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.449 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.449 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.449 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.449 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.449 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:60088 5.a 5:5b460f09:::benchmark_data_smithi007_19526_object60087:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:11.449 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:11.418959+0000", 2024-04-19T04:25:11.449 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0020883630000000002, 2024-04-19T04:25:11.449 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.002487291, 2024-04-19T04:25:11.450 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.450 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:11.450 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.450 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.450 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.450 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 60088 2024-04-19T04:25:11.450 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.450 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.450 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.450 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.450 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418959+0000", 2024-04-19T04:25:11.450 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.450 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.450 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.450 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.451 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418959+0000", 2024-04-19T04:25:11.451 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.451 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.451 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.451 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.451 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.418958+0000", 2024-04-19T04:25:11.451 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:11.451 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.451 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.451 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.451 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419015+0000", 2024-04-19T04:25:11.451 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.6560000000000001e-05 2024-04-19T04:25:11.451 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.451 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.451 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.452 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419024+0000", 2024-04-19T04:25:11.452 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.7129999999999994e-06 2024-04-19T04:25:11.452 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.452 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.452 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.452 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419030+0000", 2024-04-19T04:25:11.452 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.9190000000000004e-06 2024-04-19T04:25:11.452 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.452 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.452 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.452 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419066+0000", 2024-04-19T04:25:11.452 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6084999999999998e-05 2024-04-19T04:25:11.452 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.452 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.452 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.453 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419185+0000", 2024-04-19T04:25:11.453 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00011972300000000001 2024-04-19T04:25:11.453 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.453 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.453 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.453 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419323+0000", 2024-04-19T04:25:11.453 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013805999999999999 2024-04-19T04:25:11.453 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.453 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.453 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.453 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.453 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.453 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:60089 5.3 5.5c515123 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:11.453 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:11.419040+0000", 2024-04-19T04:25:11.454 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0020069350000000001, 2024-04-19T04:25:11.454 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0024408810000000002, 2024-04-19T04:25:11.454 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.454 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:11.454 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.454 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.454 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.454 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 60089 2024-04-19T04:25:11.454 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.454 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.454 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.454 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.454 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419040+0000", 2024-04-19T04:25:11.454 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.455 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.455 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.455 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.455 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419040+0000", 2024-04-19T04:25:11.455 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.455 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.455 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.455 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.455 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419040+0000", 2024-04-19T04:25:11.455 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:11.455 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.455 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.455 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.455 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419076+0000", 2024-04-19T04:25:11.456 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6301999999999999e-05 2024-04-19T04:25:11.456 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.456 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.456 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.456 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419084+0000", 2024-04-19T04:25:11.456 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.9929999999999995e-06 2024-04-19T04:25:11.456 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.456 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.456 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.456 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419090+0000", 2024-04-19T04:25:11.456 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.7219999999999996e-06 2024-04-19T04:25:11.456 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.456 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.456 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.456 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.456 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.457 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:60090 5.4 5.ba4948b4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:11.457 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:11.419113+0000", 2024-04-19T04:25:11.457 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.001934346, 2024-04-19T04:25:11.457 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0023946530000000001, 2024-04-19T04:25:11.457 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.457 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:11.457 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.457 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.457 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.457 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 60090 2024-04-19T04:25:11.457 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.457 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.457 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.457 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.457 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419113+0000", 2024-04-19T04:25:11.458 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.458 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.458 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.458 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.458 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419113+0000", 2024-04-19T04:25:11.458 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.458 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.458 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.458 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.458 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419112+0000", 2024-04-19T04:25:11.458 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:11.458 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.458 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.458 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.458 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419146+0000", 2024-04-19T04:25:11.459 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.3516000000000002e-05 2024-04-19T04:25:11.459 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.459 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.459 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.459 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419153+0000", 2024-04-19T04:25:11.459 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.605e-06 2024-04-19T04:25:11.459 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.459 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.459 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.459 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419159+0000", 2024-04-19T04:25:11.459 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.3210000000000004e-06 2024-04-19T04:25:11.459 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.459 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.459 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.460 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.460 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.460 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_repop(client.4746.0:60087 5.7 e36/20 5:eea6e332:::benchmark_data_smithi007_19526_object60086:head v 36'3755, mlcod=36'3753)", 2024-04-19T04:25:11.460 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:11.419828+0000", 2024-04-19T04:25:11.460 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.001219618, 2024-04-19T04:25:11.460 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00170703, 2024-04-19T04:25:11.460 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.460 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:11.460 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.460 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.460 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.460 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419828+0000", 2024-04-19T04:25:11.460 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.460 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.460 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.461 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.461 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419828+0000", 2024-04-19T04:25:11.461 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.461 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.461 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.461 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.461 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419827+0000", 2024-04-19T04:25:11.461 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.461 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.461 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.461 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.461 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419890+0000", 2024-04-19T04:25:11.461 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.2626000000000007e-05 2024-04-19T04:25:11.461 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.462 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.462 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.462 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419898+0000", 2024-04-19T04:25:11.462 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.6039999999999993e-06 2024-04-19T04:25:11.462 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.462 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.462 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.462 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419905+0000", 2024-04-19T04:25:11.462 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.8539999999999999e-06 2024-04-19T04:25:11.462 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.462 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.462 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.462 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419946+0000", 2024-04-19T04:25:11.463 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1220999999999997e-05 2024-04-19T04:25:11.463 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.463 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.463 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.463 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419962+0000", 2024-04-19T04:25:11.463 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.5593000000000001e-05 2024-04-19T04:25:11.463 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.463 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.463 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.463 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.463 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.463 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:60093 5.c 5.a238889c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:11.463 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:11.420247+0000", 2024-04-19T04:25:11.463 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.00080073700000000004, 2024-04-19T04:25:11.463 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0013169880000000001, 2024-04-19T04:25:11.464 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.464 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:11.464 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.464 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.464 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.464 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 60093 2024-04-19T04:25:11.464 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.464 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.464 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.464 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.464 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.420247+0000", 2024-04-19T04:25:11.464 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.464 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.465 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.465 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.465 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.420247+0000", 2024-04-19T04:25:11.465 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.465 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.465 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.465 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.465 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.420246+0000", 2024-04-19T04:25:11.465 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.465 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.465 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.465 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.465 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.420308+0000", 2024-04-19T04:25:11.466 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.2385999999999995e-05 2024-04-19T04:25:11.466 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.466 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.466 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.466 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.420321+0000", 2024-04-19T04:25:11.466 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3414999999999999e-05 2024-04-19T04:25:11.466 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.466 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.466 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.466 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.420328+0000", 2024-04-19T04:25:11.466 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.8159999999999996e-06 2024-04-19T04:25:11.466 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.466 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.467 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.467 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.467 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.467 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:60069 5.3 5:ce85523a:::benchmark_data_smithi007_19526_object60068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:11.467 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:11.408554+0000", 2024-04-19T04:25:11.467 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.012492845000000001, 2024-04-19T04:25:11.467 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013038961, 2024-04-19T04:25:11.467 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.467 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:11.467 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.467 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.467 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.467 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 60069 2024-04-19T04:25:11.467 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.467 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.467 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.468 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.468 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.408554+0000", 2024-04-19T04:25:11.468 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.468 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.468 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.468 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.468 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.408554+0000", 2024-04-19T04:25:11.468 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.468 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.468 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.468 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.468 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.408554+0000", 2024-04-19T04:25:11.468 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.468 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.468 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.469 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.469 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.408615+0000", 2024-04-19T04:25:11.469 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.1418e-05 2024-04-19T04:25:11.469 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.469 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.469 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.469 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.408631+0000", 2024-04-19T04:25:11.469 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.6430999999999999e-05 2024-04-19T04:25:11.469 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.469 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.469 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.469 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.408640+0000", 2024-04-19T04:25:11.469 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.7539999999999995e-06 2024-04-19T04:25:11.469 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.469 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.470 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.470 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.408684+0000", 2024-04-19T04:25:11.470 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.3377999999999997e-05 2024-04-19T04:25:11.470 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.470 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.470 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.470 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.408817+0000", 2024-04-19T04:25:11.470 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013388199999999999 2024-04-19T04:25:11.470 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.470 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.470 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:11.470 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.408956+0000", 2024-04-19T04:25:11.470 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013878600000000001 2024-04-19T04:25:11.470 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.471 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.471 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.471 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.414638+0000", 2024-04-19T04:25:11.471 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0056812800000000004 2024-04-19T04:25:11.471 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.471 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.471 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.471 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.471 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.471 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:60072 5.3 5:cff6247e:::benchmark_data_smithi007_19526_object60071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:11.471 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:11.409950+0000", 2024-04-19T04:25:11.471 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.011097697, 2024-04-19T04:25:11.471 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011684683, 2024-04-19T04:25:11.471 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.471 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:11.472 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.472 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.472 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.472 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 60072 2024-04-19T04:25:11.472 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.472 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.472 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.472 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.472 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.409950+0000", 2024-04-19T04:25:11.472 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.472 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.472 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.472 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.472 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.409950+0000", 2024-04-19T04:25:11.472 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.473 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.473 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.473 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.473 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.409949+0000", 2024-04-19T04:25:11.473 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:11.473 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.473 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.473 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.473 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.410004+0000", 2024-04-19T04:25:11.473 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.5022000000000003e-05 2024-04-19T04:25:11.473 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.473 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.473 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.473 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.410014+0000", 2024-04-19T04:25:11.474 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.8160000000000005e-06 2024-04-19T04:25:11.474 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.474 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.474 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.474 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.410021+0000", 2024-04-19T04:25:11.474 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.9099999999999999e-06 2024-04-19T04:25:11.474 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.474 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.474 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.474 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.414697+0000", 2024-04-19T04:25:11.474 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0046762549999999998 2024-04-19T04:25:11.474 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.474 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.474 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.475 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.414843+0000", 2024-04-19T04:25:11.475 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014583599999999999 2024-04-19T04:25:11.475 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.475 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.475 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:11.475 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.414929+0000", 2024-04-19T04:25:11.475 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.5923999999999999e-05 2024-04-19T04:25:11.475 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.475 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.475 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.475 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.419142+0000", 2024-04-19T04:25:11.475 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.004213105 2024-04-19T04:25:11.475 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.475 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.475 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.476 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.476 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-04-19T04:25:11.476 INFO:teuthology.orchestra.run.smithi066.stdout: "num_ops": 14 2024-04-19T04:25:11.476 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:25:11.477 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T04:25:11.485 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:11.480+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:11.586 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:11.584+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:11.615 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:25:11.615 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [], 2024-04-19T04:25:11.615 INFO:teuthology.orchestra.run.smithi066.stdout: "complaint_time": 30, 2024-04-19T04:25:11.615 INFO:teuthology.orchestra.run.smithi066.stdout: "num_blocked_ops": 0 2024-04-19T04:25:11.616 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:25:11.633 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T04:25:11.687 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:11.684+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:11.753 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 27 16 60696 60680 140.446 113.188 0.0139223 0.00711395 2024-04-19T04:25:11.787 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:11.786+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:11.810 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:25:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "size": 20, 2024-04-19T04:25:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 600, 2024-04-19T04:25:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [ 2024-04-19T04:25:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:25:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 51.274460583, 2024-04-19T04:25:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019436790999999998, 2024-04-19T04:25:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:25:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533565+0000", 2024-04-19T04:25:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533562+0000", 2024-04-19T04:25:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999967 2024-04-19T04:25:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533588+0000", 2024-04-19T04:25:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.6128000000000001e-05 2024-04-19T04:25:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533617+0000", 2024-04-19T04:25:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.8685000000000001e-05 2024-04-19T04:25:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533649+0000", 2024-04-19T04:25:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.2532e-05 2024-04-19T04:25:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536605+0000", 2024-04-19T04:25:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0029553130000000002 2024-04-19T04:25:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536746+0000", 2024-04-19T04:25:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000141011 2024-04-19T04:25:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.536889+0000", 2024-04-19T04:25:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000143437 2024-04-19T04:25:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542807+0000", 2024-04-19T04:25:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0059181210000000001 2024-04-19T04:25:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.552917+0000", 2024-04-19T04:25:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010110111 2024-04-19T04:25:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.552962+0000", 2024-04-19T04:25:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.4811999999999997e-05 2024-04-19T04:25:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553002+0000", 2024-04-19T04:25:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9957999999999999e-05 2024-04-19T04:25:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:25:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 51.274344638999999, 2024-04-19T04:25:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019464940999999999, 2024-04-19T04:25:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:25:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533681+0000", 2024-04-19T04:25:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533680+0000", 2024-04-19T04:25:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533692+0000", 2024-04-19T04:25:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2235000000000001e-05 2024-04-19T04:25:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533770+0000", 2024-04-19T04:25:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.8248e-05 2024-04-19T04:25:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:25:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8671000000000001e-05 2024-04-19T04:25:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539610+0000", 2024-04-19T04:25:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0058206669999999999 2024-04-19T04:25:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539705+0000", 2024-04-19T04:25:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.5313e-05 2024-04-19T04:25:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.539857+0000", 2024-04-19T04:25:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000151881 2024-04-19T04:25:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542812+0000", 2024-04-19T04:25:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.002954857 2024-04-19T04:25:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553058+0000", 2024-04-19T04:25:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.010246570999999999 2024-04-19T04:25:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553104+0000", 2024-04-19T04:25:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.5235999999999999e-05 2024-04-19T04:25:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553146+0000", 2024-04-19T04:25:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2725999999999997e-05 2024-04-19T04:25:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:21 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:25:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 51.274085538999998, 2024-04-19T04:25:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019340466000000001, 2024-04-19T04:25:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:25:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533940+0000", 2024-04-19T04:25:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533939+0000", 2024-04-19T04:25:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533950+0000", 2024-04-19T04:25:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0533999999999999e-05 2024-04-19T04:25:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533973+0000", 2024-04-19T04:25:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2614000000000001e-05 2024-04-19T04:25:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3531e-05 2024-04-19T04:25:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541149+0000", 2024-04-19T04:25:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0071628780000000001 2024-04-19T04:25:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541279+0000", 2024-04-19T04:25:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00013014999999999999 2024-04-19T04:25:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.541430+0000", 2024-04-19T04:25:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015048399999999999 2024-04-19T04:25:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.543384+0000", 2024-04-19T04:25:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001954468 2024-04-19T04:25:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553193+0000", 2024-04-19T04:25:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0098089059999999992 2024-04-19T04:25:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553245+0000", 2024-04-19T04:25:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.1742e-05 2024-04-19T04:25:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553281+0000", 2024-04-19T04:25:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6272000000000001e-05 2024-04-19T04:25:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:25:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 51.274028287999997, 2024-04-19T04:25:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019497464999999999, 2024-04-19T04:25:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:25:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:25:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.533997+0000", 2024-04-19T04:25:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534019+0000", 2024-04-19T04:25:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.1871000000000001e-05 2024-04-19T04:25:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534036+0000", 2024-04-19T04:25:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.7073999999999999e-05 2024-04-19T04:25:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3781000000000001e-05 2024-04-19T04:25:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534167+0000", 2024-04-19T04:25:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000117463 2024-04-19T04:25:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.535182+0000", 2024-04-19T04:25:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0010149340000000001 2024-04-19T04:25:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.535459+0000", 2024-04-19T04:25:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000277013 2024-04-19T04:25:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.540338+0000", 2024-04-19T04:25:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0048786109999999997 2024-04-19T04:25:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553416+0000", 2024-04-19T04:25:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.013078251000000001 2024-04-19T04:25:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553456+0000", 2024-04-19T04:25:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.0516999999999998e-05 2024-04-19T04:25:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553495+0000", 2024-04-19T04:25:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8899999999999997e-05 2024-04-19T04:25:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:25:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 51.273929901999999, 2024-04-19T04:25:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019607754000000002, 2024-04-19T04:25:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:25:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534096+0000", 2024-04-19T04:25:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534095+0000", 2024-04-19T04:25:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534104+0000", 2024-04-19T04:25:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.9779999999999994e-06 2024-04-19T04:25:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534122+0000", 2024-04-19T04:25:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8464000000000001e-05 2024-04-19T04:25:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534142+0000", 2024-04-19T04:25:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.9287999999999999e-05 2024-04-19T04:25:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.538550+0000", 2024-04-19T04:25:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0044085560000000001 2024-04-19T04:25:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.538726+0000", 2024-04-19T04:25:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017599299999999999 2024-04-19T04:25:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553704+0000", 2024-04-19T04:25:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.014977802 2024-04-19T04:25:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:25:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 51.273843012999997, 2024-04-19T04:25:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019220208999999999, 2024-04-19T04:25:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "started", 2024-04-19T04:25:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:25:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534183+0000", 2024-04-19T04:25:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534182+0000", 2024-04-19T04:25:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534189+0000", 2024-04-19T04:25:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3710000000000002e-06 2024-04-19T04:25:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534810+0000", 2024-04-19T04:25:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00062098000000000003 2024-04-19T04:25:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.534829+0000", 2024-04-19T04:25:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.8207999999999999e-05 2024-04-19T04:25:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542089+0000", 2024-04-19T04:25:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0072601710000000002 2024-04-19T04:25:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.542225+0000", 2024-04-19T04:25:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000135988 2024-04-19T04:25:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:20.553403+0000", 2024-04-19T04:25:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011178478 2024-04-19T04:25:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:25792 5.6 5:6ead9788:::benchmark_data_smithi007_19526_object25791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.070174+0000", 2024-04-19T04:25:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 17.737851661000001, 2024-04-19T04:25:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.018078227999999998, 2024-04-19T04:25:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 25792 2024-04-19T04:25:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070174+0000", 2024-04-19T04:25:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070174+0000", 2024-04-19T04:25:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070173+0000", 2024-04-19T04:25:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070241+0000", 2024-04-19T04:25:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.7801999999999999e-05 2024-04-19T04:25:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070252+0000", 2024-04-19T04:25:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1405e-05 2024-04-19T04:25:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070258+0000", 2024-04-19T04:25:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4949999999999999e-06 2024-04-19T04:25:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070298+0000", 2024-04-19T04:25:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.9932999999999999e-05 2024-04-19T04:25:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070386+0000", 2024-04-19T04:25:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8382999999999997e-05 2024-04-19T04:25:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.070472+0000", 2024-04-19T04:25:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.5364999999999993e-05 2024-04-19T04:25:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.076618+0000", 2024-04-19T04:25:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.006146037 2024-04-19T04:25:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088147+0000", 2024-04-19T04:25:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.011529634 2024-04-19T04:25:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088209+0000", 2024-04-19T04:25:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.1760999999999994e-05 2024-04-19T04:25:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.088253+0000", 2024-04-19T04:25:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.3547000000000002e-05 2024-04-19T04:25:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26158 5.3 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.232719+0000", 2024-04-19T04:25:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 17.575306993000002, 2024-04-19T04:25:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.049770017, 2024-04-19T04:25:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26158 2024-04-19T04:25:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232719+0000", 2024-04-19T04:25:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232719+0000", 2024-04-19T04:25:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232718+0000", 2024-04-19T04:25:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232791+0000", 2024-04-19T04:25:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2421000000000003e-05 2024-04-19T04:25:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232804+0000", 2024-04-19T04:25:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3037000000000001e-05 2024-04-19T04:25:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232812+0000", 2024-04-19T04:25:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.2630000000000003e-06 2024-04-19T04:25:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.232971+0000", 2024-04-19T04:25:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000159419 2024-04-19T04:25:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233124+0000", 2024-04-19T04:25:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000153182 2024-04-19T04:25:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233283+0000", 2024-04-19T04:25:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000158321 2024-04-19T04:25:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.236041+0000", 2024-04-19T04:25:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0027577919999999998 2024-04-19T04:25:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282307+0000", 2024-04-19T04:25:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.046266008999999997 2024-04-19T04:25:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282414+0000", 2024-04-19T04:25:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000107611 2024-04-19T04:25:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282489+0000", 2024-04-19T04:25:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.4805e-05 2024-04-19T04:25:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26164 5.6 5:63a08103:::benchmark_data_smithi007_19526_object26163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.233982+0000", 2024-04-19T04:25:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 17.574043606, 2024-04-19T04:25:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.047707233000000002, 2024-04-19T04:25:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26164 2024-04-19T04:25:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233982+0000", 2024-04-19T04:25:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233982+0000", 2024-04-19T04:25:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.233981+0000", 2024-04-19T04:25:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234040+0000", 2024-04-19T04:25:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.8782000000000001e-05 2024-04-19T04:25:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234051+0000", 2024-04-19T04:25:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0822000000000001e-05 2024-04-19T04:25:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234059+0000", 2024-04-19T04:25:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.7479999999999993e-06 2024-04-19T04:25:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234133+0000", 2024-04-19T04:25:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.4059000000000004e-05 2024-04-19T04:25:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234356+0000", 2024-04-19T04:25:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00022300400000000001 2024-04-19T04:25:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.234515+0000", 2024-04-19T04:25:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015913599999999999 2024-04-19T04:25:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.236924+0000", 2024-04-19T04:25:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0024091989999999999 2024-04-19T04:25:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.281529+0000", 2024-04-19T04:25:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.044604984 2024-04-19T04:25:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.281616+0000", 2024-04-19T04:25:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.6784000000000001e-05 2024-04-19T04:25:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.281690+0000", 2024-04-19T04:25:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3907999999999998e-05 2024-04-19T04:25:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26170 5.c 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.237154+0000", 2024-04-19T04:25:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 17.570872343000001, 2024-04-19T04:25:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.045024630000000003, 2024-04-19T04:25:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26170 2024-04-19T04:25:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237154+0000", 2024-04-19T04:25:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237154+0000", 2024-04-19T04:25:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237153+0000", 2024-04-19T04:25:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237230+0000", 2024-04-19T04:25:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.6827000000000002e-05 2024-04-19T04:25:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237241+0000", 2024-04-19T04:25:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1270999999999999e-05 2024-04-19T04:25:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237248+0000", 2024-04-19T04:25:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.622e-06 2024-04-19T04:25:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237341+0000", 2024-04-19T04:25:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.2417999999999995e-05 2024-04-19T04:25:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237450+0000", 2024-04-19T04:25:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00010864700000000001 2024-04-19T04:25:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.237554+0000", 2024-04-19T04:25:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00010459999999999999 2024-04-19T04:25:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.239374+0000", 2024-04-19T04:25:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0018197370000000001 2024-04-19T04:25:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282078+0000", 2024-04-19T04:25:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.042703868999999998 2024-04-19T04:25:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282132+0000", 2024-04-19T04:25:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4302999999999998e-05 2024-04-19T04:25:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282178+0000", 2024-04-19T04:25:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.6224000000000003e-05 2024-04-19T04:25:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26179 5.3 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.241433+0000", 2024-04-19T04:25:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 17.566592948, 2024-04-19T04:25:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.041219473, 2024-04-19T04:25:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26179 2024-04-19T04:25:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241433+0000", 2024-04-19T04:25:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241433+0000", 2024-04-19T04:25:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241517+0000", 2024-04-19T04:25:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.4895999999999995e-05 2024-04-19T04:25:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241529+0000", 2024-04-19T04:25:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1846e-05 2024-04-19T04:25:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241535+0000", 2024-04-19T04:25:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.8919999999999997e-06 2024-04-19T04:25:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241573+0000", 2024-04-19T04:25:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8936000000000001e-05 2024-04-19T04:25:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241675+0000", 2024-04-19T04:25:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000101983 2024-04-19T04:25:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.241759+0000", 2024-04-19T04:25:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.3533000000000001e-05 2024-04-19T04:25:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243038+0000", 2024-04-19T04:25:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001279449 2024-04-19T04:25:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282563+0000", 2024-04-19T04:25:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.039524694999999999 2024-04-19T04:25:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282616+0000", 2024-04-19T04:25:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2432999999999998e-05 2024-04-19T04:25:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.282653+0000", 2024-04-19T04:25:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6959999999999998e-05 2024-04-19T04:25:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26181 5.6 5:61db10b4:::benchmark_data_smithi007_19526_object26180:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.243304+0000", 2024-04-19T04:25:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 17.564721609999999, 2024-04-19T04:25:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.043580885999999999, 2024-04-19T04:25:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26181 2024-04-19T04:25:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243304+0000", 2024-04-19T04:25:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243304+0000", 2024-04-19T04:25:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243303+0000", 2024-04-19T04:25:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243370+0000", 2024-04-19T04:25:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.6778000000000003e-05 2024-04-19T04:25:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243388+0000", 2024-04-19T04:25:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.7608000000000001e-05 2024-04-19T04:25:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243397+0000", 2024-04-19T04:25:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8279999999999992e-06 2024-04-19T04:25:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243444+0000", 2024-04-19T04:25:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.7055000000000003e-05 2024-04-19T04:25:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243532+0000", 2024-04-19T04:25:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.8782000000000005e-05 2024-04-19T04:25:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.243614+0000", 2024-04-19T04:25:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.1199000000000006e-05 2024-04-19T04:25:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244915+0000", 2024-04-19T04:25:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001300893 2024-04-19T04:25:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286603+0000", 2024-04-19T04:25:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.041688847000000001 2024-04-19T04:25:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286792+0000", 2024-04-19T04:25:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00018885199999999999 2024-04-19T04:25:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286885+0000", 2024-04-19T04:25:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.3040000000000004e-05 2024-04-19T04:25:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:26182 5.3 5:c032f6e9:::benchmark_data_smithi007_19526_object26181:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:24:54.244629+0000", 2024-04-19T04:25:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 17.563396534999999, 2024-04-19T04:25:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.041622474999999999, 2024-04-19T04:25:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 26182 2024-04-19T04:25:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244629+0000", 2024-04-19T04:25:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244629+0000", 2024-04-19T04:25:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244628+0000", 2024-04-19T04:25:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244752+0000", 2024-04-19T04:25:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000123802 2024-04-19T04:25:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244765+0000", 2024-04-19T04:25:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.2908000000000001e-05 2024-04-19T04:25:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244772+0000", 2024-04-19T04:25:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.6850000000000004e-06 2024-04-19T04:25:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244813+0000", 2024-04-19T04:25:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.1211999999999998e-05 2024-04-19T04:25:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244919+0000", 2024-04-19T04:25:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000106147 2024-04-19T04:25:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.244993+0000", 2024-04-19T04:25:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.3538e-05 2024-04-19T04:25:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.246228+0000", 2024-04-19T04:25:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.001235217 2024-04-19T04:25:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286111+0000", 2024-04-19T04:25:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.039882933000000002 2024-04-19T04:25:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286180+0000", 2024-04-19T04:25:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.9212000000000001e-05 2024-04-19T04:25:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:24:54.286252+0000", 2024-04-19T04:25:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2016999999999998e-05 2024-04-19T04:25:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:44971 5.a 5:5cbf4e21:::benchmark_data_smithi007_19526_object44970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:03.587775+0000", 2024-04-19T04:25:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 8.2202512819999995, 2024-04-19T04:25:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.01799914, 2024-04-19T04:25:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 44971 2024-04-19T04:25:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.587775+0000", 2024-04-19T04:25:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.587775+0000", 2024-04-19T04:25:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.587774+0000", 2024-04-19T04:25:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.587846+0000", 2024-04-19T04:25:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.2090999999999998e-05 2024-04-19T04:25:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.587899+0000", 2024-04-19T04:25:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.2967000000000003e-05 2024-04-19T04:25:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.587905+0000", 2024-04-19T04:25:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.9939999999999997e-06 2024-04-19T04:25:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.587953+0000", 2024-04-19T04:25:11.888 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.8470999999999997e-05 2024-04-19T04:25:11.888 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.888 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.888 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.888 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.588120+0000", 2024-04-19T04:25:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00016616299999999999 2024-04-19T04:25:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.588297+0000", 2024-04-19T04:25:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017755000000000001 2024-04-19T04:25:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.596500+0000", 2024-04-19T04:25:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0082027469999999998 2024-04-19T04:25:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.605704+0000", 2024-04-19T04:25:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0092041310000000008 2024-04-19T04:25:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.605746+0000", 2024-04-19T04:25:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.2293000000000003e-05 2024-04-19T04:25:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:03.605774+0000", 2024-04-19T04:25:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.7525000000000002e-05 2024-04-19T04:25:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:52762 5.5 5:a9605501:::benchmark_data_smithi007_19526_object52761:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:07.483402+0000", 2024-04-19T04:25:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 4.324624204, 2024-04-19T04:25:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.018905216999999998, 2024-04-19T04:25:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 52762 2024-04-19T04:25:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.483402+0000", 2024-04-19T04:25:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.483402+0000", 2024-04-19T04:25:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.483401+0000", 2024-04-19T04:25:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.483477+0000", 2024-04-19T04:25:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.6200999999999998e-05 2024-04-19T04:25:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.483486+0000", 2024-04-19T04:25:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.0969999999999995e-06 2024-04-19T04:25:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.483492+0000", 2024-04-19T04:25:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.3890000000000004e-06 2024-04-19T04:25:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.487682+0000", 2024-04-19T04:25:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0041905850000000001 2024-04-19T04:25:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.487805+0000", 2024-04-19T04:25:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012297299999999999 2024-04-19T04:25:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.487893+0000", 2024-04-19T04:25:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.7453000000000004e-05 2024-04-19T04:25:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.494448+0000", 2024-04-19T04:25:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0065553510000000001 2024-04-19T04:25:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.502094+0000", 2024-04-19T04:25:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0076457390000000004 2024-04-19T04:25:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.502219+0000", 2024-04-19T04:25:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012557700000000001 2024-04-19T04:25:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:07.502307+0000", 2024-04-19T04:25:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 8.7822e-05 2024-04-19T04:25:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:55092 5.8 5:1e3eb757:::benchmark_data_smithi007_19526_object55091:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:08.712072+0000", 2024-04-19T04:25:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 3.0959541119999998, 2024-04-19T04:25:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019028003000000002, 2024-04-19T04:25:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 55092 2024-04-19T04:25:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.712072+0000", 2024-04-19T04:25:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.712072+0000", 2024-04-19T04:25:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.712071+0000", 2024-04-19T04:25:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.712167+0000", 2024-04-19T04:25:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.6064999999999996e-05 2024-04-19T04:25:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.712184+0000", 2024-04-19T04:25:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.7397e-05 2024-04-19T04:25:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.712192+0000", 2024-04-19T04:25:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 7.1099999999999997e-06 2024-04-19T04:25:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.717104+0000", 2024-04-19T04:25:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0049123489999999999 2024-04-19T04:25:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.717292+0000", 2024-04-19T04:25:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000188402 2024-04-19T04:25:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.717469+0000", 2024-04-19T04:25:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00017630099999999999 2024-04-19T04:25:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.724722+0000", 2024-04-19T04:25:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0072533099999999998 2024-04-19T04:25:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.731032+0000", 2024-04-19T04:25:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.006309617 2024-04-19T04:25:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.731067+0000", 2024-04-19T04:25:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.5809999999999998e-05 2024-04-19T04:25:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.731100+0000", 2024-04-19T04:25:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.2509999999999999e-05 2024-04-19T04:25:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:55098 5.8 5:15cf9781:::benchmark_data_smithi007_19526_object55097:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:08.713026+0000", 2024-04-19T04:25:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 3.0949995910000001, 2024-04-19T04:25:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019950717999999999, 2024-04-19T04:25:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 55098 2024-04-19T04:25:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.713026+0000", 2024-04-19T04:25:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.713026+0000", 2024-04-19T04:25:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.713026+0000", 2024-04-19T04:25:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.713071+0000", 2024-04-19T04:25:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.5324999999999997e-05 2024-04-19T04:25:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.713078+0000", 2024-04-19T04:25:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.8460000000000002e-06 2024-04-19T04:25:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.713083+0000", 2024-04-19T04:25:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.0170000000000004e-06 2024-04-19T04:25:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.906 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.906 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.722150+0000", 2024-04-19T04:25:11.906 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0090671499999999995 2024-04-19T04:25:11.906 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.906 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.906 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.906 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.722336+0000", 2024-04-19T04:25:11.906 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000185852 2024-04-19T04:25:11.906 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.906 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.906 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.906 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.722538+0000", 2024-04-19T04:25:11.906 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000201924 2024-04-19T04:25:11.906 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.907 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.907 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.907 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.731147+0000", 2024-04-19T04:25:11.907 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0086086380000000001 2024-04-19T04:25:11.907 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.907 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.907 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:11.907 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.732893+0000", 2024-04-19T04:25:11.907 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0017466440000000001 2024-04-19T04:25:11.907 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.907 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.907 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.907 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.732937+0000", 2024-04-19T04:25:11.907 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.3312000000000001e-05 2024-04-19T04:25:11.907 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:08.732977+0000", 2024-04-19T04:25:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.0405999999999999e-05 2024-04-19T04:25:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:59956 5.3 5:c9c3694a:::benchmark_data_smithi007_19526_object59955:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:11.344034+0000", 2024-04-19T04:25:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.46399173900000001, 2024-04-19T04:25:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.017245645, 2024-04-19T04:25:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 59956 2024-04-19T04:25:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.344034+0000", 2024-04-19T04:25:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.344034+0000", 2024-04-19T04:25:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.344033+0000", 2024-04-19T04:25:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.344131+0000", 2024-04-19T04:25:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 9.7676999999999993e-05 2024-04-19T04:25:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.344142+0000", 2024-04-19T04:25:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.1378e-05 2024-04-19T04:25:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.344156+0000", 2024-04-19T04:25:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.3427e-05 2024-04-19T04:25:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.348639+0000", 2024-04-19T04:25:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0044836750000000003 2024-04-19T04:25:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.348798+0000", 2024-04-19T04:25:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00015811199999999999 2024-04-19T04:25:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.348996+0000", 2024-04-19T04:25:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00019806199999999999 2024-04-19T04:25:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.353375+0000", 2024-04-19T04:25:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0043797890000000003 2024-04-19T04:25:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.361208+0000", 2024-04-19T04:25:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0078329039999999999 2024-04-19T04:25:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.361257+0000", 2024-04-19T04:25:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4.9144999999999998e-05 2024-04-19T04:25:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.361280+0000", 2024-04-19T04:25:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.2450999999999999e-05 2024-04-19T04:25:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:60406 5.a 5:5a0f7868:::benchmark_data_smithi007_19526_object60405:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:11.593815+0000", 2024-04-19T04:25:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.214210544, 2024-04-19T04:25:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019804929999999998, 2024-04-19T04:25:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 60406 2024-04-19T04:25:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.593815+0000", 2024-04-19T04:25:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.593815+0000", 2024-04-19T04:25:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.593814+0000", 2024-04-19T04:25:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.999999 2024-04-19T04:25:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.593851+0000", 2024-04-19T04:25:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6387000000000002e-05 2024-04-19T04:25:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.593861+0000", 2024-04-19T04:25:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0543999999999999e-05 2024-04-19T04:25:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.593872+0000", 2024-04-19T04:25:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 1.0273e-05 2024-04-19T04:25:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.602777+0000", 2024-04-19T04:25:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0089051059999999994 2024-04-19T04:25:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.602901+0000", 2024-04-19T04:25:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00012392699999999999 2024-04-19T04:25:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.603041+0000", 2024-04-19T04:25:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.000140662 2024-04-19T04:25:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.605660+0000", 2024-04-19T04:25:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0026192170000000001 2024-04-19T04:25:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.613568+0000", 2024-04-19T04:25:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0079080000000000001 2024-04-19T04:25:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.613596+0000", 2024-04-19T04:25:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.7647000000000001e-05 2024-04-19T04:25:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.613620+0000", 2024-04-19T04:25:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 2.4264e-05 2024-04-19T04:25:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: "description": "osd_op(client.4746.0:60414 5.a 5:57f39c85:::benchmark_data_smithi007_19526_object60413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: "initiated_at": "2024-04-19T04:25:11.596075+0000", 2024-04-19T04:25:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.21195077800000001, 2024-04-19T04:25:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.019647251000000001, 2024-04-19T04:25:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "type_data": { 2024-04-19T04:25:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "client_info": { 2024-04-19T04:25:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "client": "client.4746", 2024-04-19T04:25:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "tid": 60414 2024-04-19T04:25:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "events": [ 2024-04-19T04:25:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "initiated", 2024-04-19T04:25:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.596075+0000", 2024-04-19T04:25:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "throttled", 2024-04-19T04:25:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.596075+0000", 2024-04-19T04:25:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0 2024-04-19T04:25:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "header_read", 2024-04-19T04:25:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.596075+0000", 2024-04-19T04:25:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "all_read", 2024-04-19T04:25:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.596112+0000", 2024-04-19T04:25:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.7355999999999999e-05 2024-04-19T04:25:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "dispatched", 2024-04-19T04:25:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.596117+0000", 2024-04-19T04:25:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 5.4219999999999999e-06 2024-04-19T04:25:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "queued_for_pg", 2024-04-19T04:25:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.596121+0000", 2024-04-19T04:25:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.6550000000000002e-06 2024-04-19T04:25:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "reached_pg", 2024-04-19T04:25:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.605684+0000", 2024-04-19T04:25:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0095628420000000002 2024-04-19T04:25:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "started", 2024-04-19T04:25:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.606023+0000", 2024-04-19T04:25:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00033874000000000003 2024-04-19T04:25:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.606166+0000", 2024-04-19T04:25:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.00014374599999999999 2024-04-19T04:25:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.615589+0000", 2024-04-19T04:25:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 0.0094227589999999993 2024-04-19T04:25:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "op_commit", 2024-04-19T04:25:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.615622+0000", 2024-04-19T04:25:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.3250000000000002e-05 2024-04-19T04:25:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "commit_sent", 2024-04-19T04:25:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.615684+0000", 2024-04-19T04:25:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 6.1728000000000003e-05 2024-04-19T04:25:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-04-19T04:25:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-04-19T04:25:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "event": "done", 2024-04-19T04:25:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "time": "2024-04-19T04:25:11.615722+0000", 2024-04-19T04:25:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "duration": 3.8278999999999997e-05 2024-04-19T04:25:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.926 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.926 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.926 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-04-19T04:25:11.926 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-04-19T04:25:11.926 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:25:11.926 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T04:25:11.928 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:11.922+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:11.928 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:12.028 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:25:12.024+0000 7f4927fa3700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18184) UID: 0 2024-04-19T04:25:12.057 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:12.057 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:12.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.057 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:61221 5.8 e36/29 5:147dedac:::benchmark_data_smithi007_19526_object61220:head v 36'3863, mlcod=36'3861)", 2024-04-19T04:25:12.057 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:12.049654+0000", 2024-04-19T04:25:12.058 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0079963380000000004, 2024-04-19T04:25:12.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080320830000000006, 2024-04-19T04:25:12.058 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.058 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:12.058 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.049654+0000", 2024-04-19T04:25:12.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.049654+0000", 2024-04-19T04:25:12.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.049653+0000", 2024-04-19T04:25:12.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.049693+0000", 2024-04-19T04:25:12.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0500000000000002e-05 2024-04-19T04:25:12.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.049711+0000", 2024-04-19T04:25:12.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7515000000000001e-05 2024-04-19T04:25:12.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.049718+0000", 2024-04-19T04:25:12.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3860000000000001e-06 2024-04-19T04:25:12.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.049759+0000", 2024-04-19T04:25:12.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1291999999999997e-05 2024-04-19T04:25:12.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.049774+0000", 2024-04-19T04:25:12.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5016e-05 2024-04-19T04:25:12.061 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.061 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.061 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.061 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:61225 5.0 5:09ff77f3:::benchmark_data_smithi007_19526_object61224:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:12.061 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:12.051704+0000", 2024-04-19T04:25:12.061 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0059457549999999996, 2024-04-19T04:25:12.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0061029960000000003, 2024-04-19T04:25:12.062 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.062 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:12.062 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.062 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.062 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.062 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 61225 2024-04-19T04:25:12.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.063 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.051704+0000", 2024-04-19T04:25:12.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.051704+0000", 2024-04-19T04:25:12.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.051703+0000", 2024-04-19T04:25:12.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:12.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.051749+0000", 2024-04-19T04:25:12.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6076999999999999e-05 2024-04-19T04:25:12.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.051765+0000", 2024-04-19T04:25:12.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5835999999999999e-05 2024-04-19T04:25:12.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.051773+0000", 2024-04-19T04:25:12.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:12.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.051828+0000", 2024-04-19T04:25:12.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4905999999999999e-05 2024-04-19T04:25:12.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.052081+0000", 2024-04-19T04:25:12.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025284199999999998 2024-04-19T04:25:12.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.052307+0000", 2024-04-19T04:25:12.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022589800000000001 2024-04-19T04:25:12.066 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.066 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.066 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.067 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:61229 5.9 e36/20 5:9a99b035:::benchmark_data_smithi007_19526_object61228:head v 36'3955, mlcod=36'3952)", 2024-04-19T04:25:12.067 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:12.055548+0000", 2024-04-19T04:25:12.067 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0021022520000000002, 2024-04-19T04:25:12.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023502570000000001, 2024-04-19T04:25:12.067 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.067 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:12.067 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.055548+0000", 2024-04-19T04:25:12.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.055548+0000", 2024-04-19T04:25:12.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.055547+0000", 2024-04-19T04:25:12.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.055608+0000", 2024-04-19T04:25:12.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0766000000000001e-05 2024-04-19T04:25:12.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.055620+0000", 2024-04-19T04:25:12.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2441e-05 2024-04-19T04:25:12.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.055629+0000", 2024-04-19T04:25:12.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6910000000000003e-06 2024-04-19T04:25:12.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.055681+0000", 2024-04-19T04:25:12.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2166999999999997e-05 2024-04-19T04:25:12.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.055705+0000", 2024-04-19T04:25:12.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4541000000000001e-05 2024-04-19T04:25:12.070 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.070 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.070 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.071 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:61234 5.0 5:0fc83ff2:::benchmark_data_smithi007_19526_object61233:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:12.071 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:12.055980+0000", 2024-04-19T04:25:12.071 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0016699289999999999, 2024-04-19T04:25:12.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019858279999999998, 2024-04-19T04:25:12.071 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.071 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:12.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.071 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 61234 2024-04-19T04:25:12.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.071 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.055980+0000", 2024-04-19T04:25:12.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.055980+0000", 2024-04-19T04:25:12.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.055973+0000", 2024-04-19T04:25:12.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999933 2024-04-19T04:25:12.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.056036+0000", 2024-04-19T04:25:12.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3145999999999995e-05 2024-04-19T04:25:12.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.056049+0000", 2024-04-19T04:25:12.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3045e-05 2024-04-19T04:25:12.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.056056+0000", 2024-04-19T04:25:12.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0489999999999998e-06 2024-04-19T04:25:12.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.056101+0000", 2024-04-19T04:25:12.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4812999999999999e-05 2024-04-19T04:25:12.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.056239+0000", 2024-04-19T04:25:12.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013811300000000001 2024-04-19T04:25:12.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.056350+0000", 2024-04-19T04:25:12.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110542 2024-04-19T04:25:12.075 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.075 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.075 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.075 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:61238 5.d e36/29 5:b165560f:::benchmark_data_smithi007_19526_object61237:head v 36'3630, mlcod=36'3627)", 2024-04-19T04:25:12.075 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:12.057645+0000", 2024-04-19T04:25:12.075 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.5940000000000004e-06, 2024-04-19T04:25:12.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000397255, 2024-04-19T04:25:12.075 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.075 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:12.076 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.057645+0000", 2024-04-19T04:25:12.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.057645+0000", 2024-04-19T04:25:12.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.057645+0000", 2024-04-19T04:25:12.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:12.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.057699+0000", 2024-04-19T04:25:12.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4110999999999997e-05 2024-04-19T04:25:12.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.057708+0000", 2024-04-19T04:25:12.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0990000000000005e-06 2024-04-19T04:25:12.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.057713+0000", 2024-04-19T04:25:12.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.561e-06 2024-04-19T04:25:12.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.057754+0000", 2024-04-19T04:25:12.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1808999999999999e-05 2024-04-19T04:25:12.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:12.057777+0000", 2024-04-19T04:25:12.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2404000000000001e-05 2024-04-19T04:25:12.078 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.078 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.079 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.079 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.079 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:12.079 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 5 2024-04-19T04:25:12.079 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:12.079 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T04:25:12.079 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T04:25:12.079 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2] 2024-04-19T04:25:12.079 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi066.front.sepia.ceph.com 2024-04-19T04:25:12.080 INFO:teuthology.orchestra.console.smithi066:Power off 2024-04-19T04:25:12.080 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-19T04:25:12.092 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:12.103 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off 2024-04-19T04:25:12.104 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T04:25:12.127 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-04-19T04:25:12.129 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:12.126+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:12.217 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:12.217 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:12.217 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:12.217 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:12.217 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:12.229 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:12.230 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:12.226+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:12.331 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:12.326+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:12.351 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:12.351 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:12.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:12.351 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:12.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.352 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:12.352 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:25:12.352 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 51.808499707999999, 2024-04-19T04:25:12.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018096054, 2024-04-19T04:25:12.352 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.352 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.352 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:25:12.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539843+0000", 2024-04-19T04:25:12.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539842+0000", 2024-04-19T04:25:12.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:12.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539848+0000", 2024-04-19T04:25:12.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-19T04:25:12.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539859+0000", 2024-04-19T04:25:12.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0783e-05 2024-04-19T04:25:12.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539866+0000", 2024-04-19T04:25:12.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9439999999999999e-06 2024-04-19T04:25:12.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547400+0000", 2024-04-19T04:25:12.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075343729999999996 2024-04-19T04:25:12.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547480+0000", 2024-04-19T04:25:12.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9793e-05 2024-04-19T04:25:12.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:12.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547587+0000", 2024-04-19T04:25:12.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107333 2024-04-19T04:25:12.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.548935+0000", 2024-04-19T04:25:12.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013480639999999999 2024-04-19T04:25:12.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557892+0000", 2024-04-19T04:25:12.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089563939999999995 2024-04-19T04:25:12.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557920+0000", 2024-04-19T04:25:12.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8342000000000001e-05 2024-04-19T04:25:12.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557939+0000", 2024-04-19T04:25:12.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9142000000000001e-05 2024-04-19T04:25:12.357 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.357 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.357 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.357 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:12.357 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:25:12.357 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 51.80842346, 2024-04-19T04:25:12.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018086631999999998, 2024-04-19T04:25:12.357 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.357 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.357 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:25:12.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539919+0000", 2024-04-19T04:25:12.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539918+0000", 2024-04-19T04:25:12.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539931+0000", 2024-04-19T04:25:12.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2566e-05 2024-04-19T04:25:12.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539958+0000", 2024-04-19T04:25:12.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6582999999999999e-05 2024-04-19T04:25:12.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539972+0000", 2024-04-19T04:25:12.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4789e-05 2024-04-19T04:25:12.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547577+0000", 2024-04-19T04:25:12.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0076045979999999997 2024-04-19T04:25:12.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547769+0000", 2024-04-19T04:25:12.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000192034 2024-04-19T04:25:12.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:12.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.547929+0000", 2024-04-19T04:25:12.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000159679 2024-04-19T04:25:12.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.548942+0000", 2024-04-19T04:25:12.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010138720000000001 2024-04-19T04:25:12.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557962+0000", 2024-04-19T04:25:12.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090199970000000001 2024-04-19T04:25:12.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.557985+0000", 2024-04-19T04:25:12.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2623e-05 2024-04-19T04:25:12.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.558006+0000", 2024-04-19T04:25:12.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0764e-05 2024-04-19T04:25:12.362 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.362 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.362 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.362 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:27 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:12.362 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:25:12.362 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 51.808357471999997, 2024-04-19T04:25:12.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018047384, 2024-04-19T04:25:12.362 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.362 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:12.362 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:25:12.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539985+0000", 2024-04-19T04:25:12.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539984+0000", 2024-04-19T04:25:12.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:12.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.539991+0000", 2024-04-19T04:25:12.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7769999999999997e-06 2024-04-19T04:25:12.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540010+0000", 2024-04-19T04:25:12.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9573e-05 2024-04-19T04:25:12.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.540025+0000", 2024-04-19T04:25:12.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4796e-05 2024-04-19T04:25:12.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541220+0000", 2024-04-19T04:25:12.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001195172 2024-04-19T04:25:12.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.541569+0000", 2024-04-19T04:25:12.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00034836600000000002 2024-04-19T04:25:12.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:20.558033+0000", 2024-04-19T04:25:12.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.016464092999999999 2024-04-19T04:25:12.366 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.366 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.366 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.366 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24310 5.0 5:07098fc4:::benchmark_data_smithi007_19526_object24309:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:12.366 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.471082+0000", 2024-04-19T04:25:12.366 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.877260647, 2024-04-19T04:25:12.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018533300999999999, 2024-04-19T04:25:12.367 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.367 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.367 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.367 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.367 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.367 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24310 2024-04-19T04:25:12.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.367 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.471082+0000", 2024-04-19T04:25:12.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.471082+0000", 2024-04-19T04:25:12.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.471081+0000", 2024-04-19T04:25:12.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472015+0000", 2024-04-19T04:25:12.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00093410800000000001 2024-04-19T04:25:12.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472027+0000", 2024-04-19T04:25:12.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1491000000000001e-05 2024-04-19T04:25:12.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472033+0000", 2024-04-19T04:25:12.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9499999999999998e-06 2024-04-19T04:25:12.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472087+0000", 2024-04-19T04:25:12.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4595999999999997e-05 2024-04-19T04:25:12.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472208+0000", 2024-04-19T04:25:12.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012105299999999999 2024-04-19T04:25:12.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.475540+0000", 2024-04-19T04:25:12.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033319310000000002 2024-04-19T04:25:12.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481479+0000", 2024-04-19T04:25:12.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059387440000000001 2024-04-19T04:25:12.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489528+0000", 2024-04-19T04:25:12.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080487739999999999 2024-04-19T04:25:12.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489578+0000", 2024-04-19T04:25:12.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0321999999999997e-05 2024-04-19T04:25:12.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489615+0000", 2024-04-19T04:25:12.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7425000000000002e-05 2024-04-19T04:25:12.371 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.372 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.372 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.372 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:24318 5.0 5:09636443:::benchmark_data_smithi007_19526_object24317:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:12.372 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:53.472336+0000", 2024-04-19T04:25:12.372 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.876006618000002, 2024-04-19T04:25:12.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017477310999999999, 2024-04-19T04:25:12.372 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.372 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.372 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.372 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.372 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.372 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24318 2024-04-19T04:25:12.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.373 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472336+0000", 2024-04-19T04:25:12.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472336+0000", 2024-04-19T04:25:12.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472335+0000", 2024-04-19T04:25:12.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472373+0000", 2024-04-19T04:25:12.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7876999999999997e-05 2024-04-19T04:25:12.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472384+0000", 2024-04-19T04:25:12.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0513000000000001e-05 2024-04-19T04:25:12.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.472391+0000", 2024-04-19T04:25:12.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6680000000000001e-06 2024-04-19T04:25:12.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.476649+0000", 2024-04-19T04:25:12.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004257172 2024-04-19T04:25:12.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.476767+0000", 2024-04-19T04:25:12.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118584 2024-04-19T04:25:12.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.476868+0000", 2024-04-19T04:25:12.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100912 2024-04-19T04:25:12.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.481491+0000", 2024-04-19T04:25:12.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046224990000000004 2024-04-19T04:25:12.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489691+0000", 2024-04-19T04:25:12.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082007529999999999 2024-04-19T04:25:12.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489777+0000", 2024-04-19T04:25:12.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6174000000000005e-05 2024-04-19T04:25:12.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:53.489813+0000", 2024-04-19T04:25:12.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.591e-05 2024-04-19T04:25:12.377 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.377 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.377 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.377 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:25794 5.e 5:77ddc1c5:::benchmark_data_smithi007_19526_object25793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:12.377 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.073091+0000", 2024-04-19T04:25:12.377 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.275252046999999, 2024-04-19T04:25:12.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017751818999999999, 2024-04-19T04:25:12.378 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.378 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.378 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.378 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.378 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.378 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 25794 2024-04-19T04:25:12.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.378 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073091+0000", 2024-04-19T04:25:12.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073091+0000", 2024-04-19T04:25:12.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073089+0000", 2024-04-19T04:25:12.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073146+0000", 2024-04-19T04:25:12.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6011000000000003e-05 2024-04-19T04:25:12.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073162+0000", 2024-04-19T04:25:12.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6949e-05 2024-04-19T04:25:12.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073174+0000", 2024-04-19T04:25:12.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1538e-05 2024-04-19T04:25:12.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073244+0000", 2024-04-19T04:25:12.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9715000000000006e-05 2024-04-19T04:25:12.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073463+0000", 2024-04-19T04:25:12.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021919999999999999 2024-04-19T04:25:12.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.073580+0000", 2024-04-19T04:25:12.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000116727 2024-04-19T04:25:12.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.075752+0000", 2024-04-19T04:25:12.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021724819999999999 2024-04-19T04:25:12.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.090747+0000", 2024-04-19T04:25:12.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014995059 2024-04-19T04:25:12.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.090790+0000", 2024-04-19T04:25:12.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3244999999999997e-05 2024-04-19T04:25:12.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.090842+0000", 2024-04-19T04:25:12.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2052000000000002e-05 2024-04-19T04:25:12.382 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.382 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.382 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.383 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:12.383 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:12.383 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.112811975, 2024-04-19T04:25:12.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:12.383 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.383 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.383 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.383 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.383 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.383 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:12.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.383 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:12.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:12.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:12.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:12.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:12.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:12.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:12.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:12.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:12.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:12.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:12.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:12.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:12.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:12.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:12.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.108363058999998, 2024-04-19T04:25:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:12.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:12.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:12.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:12.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:12.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:12.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:12.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:12.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:12.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:12.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:12.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:12.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:12.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:12.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:12.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:12.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:12.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:12.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:12.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:12.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:12.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:12.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:12.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:12.393 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.393 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.394 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.394 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:35062 5.0 5:0b09a143:::benchmark_data_smithi007_19526_object35061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:25:12.394 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:58.997863+0000", 2024-04-19T04:25:12.394 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.350479499, 2024-04-19T04:25:12.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.016912940000000001, 2024-04-19T04:25:12.394 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.394 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.394 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.394 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.394 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.394 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35062 2024-04-19T04:25:12.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.395 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997863+0000", 2024-04-19T04:25:12.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997863+0000", 2024-04-19T04:25:12.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997862+0000", 2024-04-19T04:25:12.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997919+0000", 2024-04-19T04:25:12.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7045e-05 2024-04-19T04:25:12.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997931+0000", 2024-04-19T04:25:12.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1989e-05 2024-04-19T04:25:12.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997939+0000", 2024-04-19T04:25:12.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9740000000000002e-06 2024-04-19T04:25:12.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.997976+0000", 2024-04-19T04:25:12.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7138999999999998e-05 2024-04-19T04:25:12.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.998076+0000", 2024-04-19T04:25:12.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010001900000000001 2024-04-19T04:25:12.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:58.998171+0000", 2024-04-19T04:25:12.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4724999999999999e-05 2024-04-19T04:25:12.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.002805+0000", 2024-04-19T04:25:12.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046342279999999998 2024-04-19T04:25:12.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.014484+0000", 2024-04-19T04:25:12.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011678609 2024-04-19T04:25:12.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.014737+0000", 2024-04-19T04:25:12.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025272800000000002 2024-04-19T04:25:12.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.014776+0000", 2024-04-19T04:25:12.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9539000000000002e-05 2024-04-19T04:25:12.399 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.399 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.399 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.399 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:36969 5.0 5:07a2d04d:::benchmark_data_smithi007_19526_object36968:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:25:12.399 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:59.838646+0000", 2024-04-19T04:25:12.399 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.509696912999999, 2024-04-19T04:25:12.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019867078999999999, 2024-04-19T04:25:12.400 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.400 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.400 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.400 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.400 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.400 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 36969 2024-04-19T04:25:12.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.400 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838646+0000", 2024-04-19T04:25:12.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838646+0000", 2024-04-19T04:25:12.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838645+0000", 2024-04-19T04:25:12.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838725+0000", 2024-04-19T04:25:12.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0295000000000003e-05 2024-04-19T04:25:12.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838734+0000", 2024-04-19T04:25:12.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6319999999999997e-06 2024-04-19T04:25:12.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838739+0000", 2024-04-19T04:25:12.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4249999999999997e-06 2024-04-19T04:25:12.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.843505+0000", 2024-04-19T04:25:12.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047651689999999997 2024-04-19T04:25:12.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.843611+0000", 2024-04-19T04:25:12.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010608899999999999 2024-04-19T04:25:12.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.843699+0000", 2024-04-19T04:25:12.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7841000000000001e-05 2024-04-19T04:25:12.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.846376+0000", 2024-04-19T04:25:12.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002677867 2024-04-19T04:25:12.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.858355+0000", 2024-04-19T04:25:12.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011978999000000001 2024-04-19T04:25:12.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.858443+0000", 2024-04-19T04:25:12.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7243000000000005e-05 2024-04-19T04:25:12.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.858513+0000", 2024-04-19T04:25:12.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0235999999999996e-05 2024-04-19T04:25:12.404 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.404 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.405 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.405 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:43351 5.0 5:0f5ecfc6:::benchmark_data_smithi007_19526_object43350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:12.405 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:02.801106+0000", 2024-04-19T04:25:12.405 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.5472366149999992, 2024-04-19T04:25:12.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021198346999999999, 2024-04-19T04:25:12.405 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.405 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.405 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.405 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.405 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.405 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 43351 2024-04-19T04:25:12.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.406 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801106+0000", 2024-04-19T04:25:12.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801106+0000", 2024-04-19T04:25:12.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801105+0000", 2024-04-19T04:25:12.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:12.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801159+0000", 2024-04-19T04:25:12.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4181999999999997e-05 2024-04-19T04:25:12.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801174+0000", 2024-04-19T04:25:12.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5021000000000001e-05 2024-04-19T04:25:12.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801182+0000", 2024-04-19T04:25:12.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7649999999999993e-06 2024-04-19T04:25:12.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.809365+0000", 2024-04-19T04:25:12.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081836159999999995 2024-04-19T04:25:12.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.809463+0000", 2024-04-19T04:25:12.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7486999999999997e-05 2024-04-19T04:25:12.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.809549+0000", 2024-04-19T04:25:12.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5729999999999994e-05 2024-04-19T04:25:12.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.814132+0000", 2024-04-19T04:25:12.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045836039999999998 2024-04-19T04:25:12.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.822206+0000", 2024-04-19T04:25:12.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080738500000000005 2024-04-19T04:25:12.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.822255+0000", 2024-04-19T04:25:12.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8730000000000003e-05 2024-04-19T04:25:12.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.822304+0000", 2024-04-19T04:25:12.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.973e-05 2024-04-19T04:25:12.410 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.410 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.410 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.410 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:51199 5.b 5:d84eb785:::benchmark_data_smithi007_19526_object51198:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T04:25:12.410 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:06.668882+0000", 2024-04-19T04:25:12.410 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.679461055, 2024-04-19T04:25:12.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018380380000000002, 2024-04-19T04:25:12.410 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.411 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.411 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.411 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.411 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.411 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 51199 2024-04-19T04:25:12.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.411 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.668882+0000", 2024-04-19T04:25:12.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.668882+0000", 2024-04-19T04:25:12.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.668881+0000", 2024-04-19T04:25:12.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.668943+0000", 2024-04-19T04:25:12.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2914000000000001e-05 2024-04-19T04:25:12.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.668959+0000", 2024-04-19T04:25:12.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5843999999999999e-05 2024-04-19T04:25:12.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.668970+0000", 2024-04-19T04:25:12.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1127e-05 2024-04-19T04:25:12.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.676381+0000", 2024-04-19T04:25:12.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074101649999999998 2024-04-19T04:25:12.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.676638+0000", 2024-04-19T04:25:12.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025765599999999999 2024-04-19T04:25:12.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.676884+0000", 2024-04-19T04:25:12.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00024564900000000002 2024-04-19T04:25:12.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.679902+0000", 2024-04-19T04:25:12.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030181190000000001 2024-04-19T04:25:12.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.687142+0000", 2024-04-19T04:25:12.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072396539999999999 2024-04-19T04:25:12.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.687212+0000", 2024-04-19T04:25:12.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0734000000000004e-05 2024-04-19T04:25:12.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.687262+0000", 2024-04-19T04:25:12.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9583000000000003e-05 2024-04-19T04:25:12.415 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.416 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.416 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.416 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:51410 5.e 5:75a150f8:::benchmark_data_smithi007_19526_object51409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T04:25:12.416 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:06.772497+0000", 2024-04-19T04:25:12.416 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.5758457999999997, 2024-04-19T04:25:12.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017100197000000001, 2024-04-19T04:25:12.416 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.416 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.416 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.416 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.416 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.416 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 51410 2024-04-19T04:25:12.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.417 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.772497+0000", 2024-04-19T04:25:12.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.772497+0000", 2024-04-19T04:25:12.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.772496+0000", 2024-04-19T04:25:12.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.772578+0000", 2024-04-19T04:25:12.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2471000000000004e-05 2024-04-19T04:25:12.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.772593+0000", 2024-04-19T04:25:12.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4905e-05 2024-04-19T04:25:12.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.772612+0000", 2024-04-19T04:25:12.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8465999999999999e-05 2024-04-19T04:25:12.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.774252+0000", 2024-04-19T04:25:12.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001640416 2024-04-19T04:25:12.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.774446+0000", 2024-04-19T04:25:12.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000193771 2024-04-19T04:25:12.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.774599+0000", 2024-04-19T04:25:12.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015292600000000001 2024-04-19T04:25:12.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.779417+0000", 2024-04-19T04:25:12.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048176390000000003 2024-04-19T04:25:12.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.789497+0000", 2024-04-19T04:25:12.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.01008069 2024-04-19T04:25:12.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.789560+0000", 2024-04-19T04:25:12.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2267999999999994e-05 2024-04-19T04:25:12.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:06.789597+0000", 2024-04-19T04:25:12.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7580999999999998e-05 2024-04-19T04:25:12.421 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.421 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.421 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.422 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:53388 5.0 5:01d29fef:::benchmark_data_smithi007_19526_object53387:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:12.422 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:07.820792+0000", 2024-04-19T04:25:12.422 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.5275508479999997, 2024-04-19T04:25:12.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020513581999999999, 2024-04-19T04:25:12.422 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.422 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.422 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.422 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.422 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.422 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 53388 2024-04-19T04:25:12.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.422 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.820792+0000", 2024-04-19T04:25:12.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.820792+0000", 2024-04-19T04:25:12.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.820791+0000", 2024-04-19T04:25:12.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.820928+0000", 2024-04-19T04:25:12.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000136868 2024-04-19T04:25:12.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.820935+0000", 2024-04-19T04:25:12.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7259999999999996e-06 2024-04-19T04:25:12.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.820939+0000", 2024-04-19T04:25:12.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6240000000000001e-06 2024-04-19T04:25:12.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.827186+0000", 2024-04-19T04:25:12.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0062470609999999999 2024-04-19T04:25:12.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.827291+0000", 2024-04-19T04:25:12.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000104805 2024-04-19T04:25:12.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.827395+0000", 2024-04-19T04:25:12.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000104205 2024-04-19T04:25:12.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.832315+0000", 2024-04-19T04:25:12.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049199049999999996 2024-04-19T04:25:12.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.841158+0000", 2024-04-19T04:25:12.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088432739999999999 2024-04-19T04:25:12.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.841243+0000", 2024-04-19T04:25:12.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4655999999999997e-05 2024-04-19T04:25:12.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.841305+0000", 2024-04-19T04:25:12.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2324999999999997e-05 2024-04-19T04:25:12.427 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.427 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.427 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.427 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:53665 5.0 5:0127a50e:::benchmark_data_smithi007_19526_object53664:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:12.427 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:07.966509+0000", 2024-04-19T04:25:12.427 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.3818332709999996, 2024-04-19T04:25:12.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017662832999999999, 2024-04-19T04:25:12.428 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.428 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.428 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.428 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.428 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.428 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 53665 2024-04-19T04:25:12.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.428 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.966509+0000", 2024-04-19T04:25:12.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.966509+0000", 2024-04-19T04:25:12.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.966509+0000", 2024-04-19T04:25:12.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:12.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.966617+0000", 2024-04-19T04:25:12.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107748 2024-04-19T04:25:12.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.966627+0000", 2024-04-19T04:25:12.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0322e-05 2024-04-19T04:25:12.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.966632+0000", 2024-04-19T04:25:12.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.558e-06 2024-04-19T04:25:12.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.967915+0000", 2024-04-19T04:25:12.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012822809999999999 2024-04-19T04:25:12.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.968133+0000", 2024-04-19T04:25:12.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021824400000000001 2024-04-19T04:25:12.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.968230+0000", 2024-04-19T04:25:12.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6880999999999996e-05 2024-04-19T04:25:12.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.971483+0000", 2024-04-19T04:25:12.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032534690000000002 2024-04-19T04:25:12.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.984078+0000", 2024-04-19T04:25:12.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012594908 2024-04-19T04:25:12.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.984147+0000", 2024-04-19T04:25:12.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8559000000000005e-05 2024-04-19T04:25:12.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.984172+0000", 2024-04-19T04:25:12.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5477999999999999e-05 2024-04-19T04:25:12.433 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.433 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.433 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.433 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:54961 5.0 5:0b2a6d58:::benchmark_data_smithi007_19526_object54960:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:12.433 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:08.643532+0000", 2024-04-19T04:25:12.433 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.7048105339999999, 2024-04-19T04:25:12.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018557797000000001, 2024-04-19T04:25:12.433 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.433 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.433 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.433 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.433 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.433 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 54961 2024-04-19T04:25:12.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.434 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.643532+0000", 2024-04-19T04:25:12.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.643532+0000", 2024-04-19T04:25:12.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.643525+0000", 2024-04-19T04:25:12.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999933 2024-04-19T04:25:12.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.643696+0000", 2024-04-19T04:25:12.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017063700000000001 2024-04-19T04:25:12.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.643706+0000", 2024-04-19T04:25:12.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4590000000000004e-06 2024-04-19T04:25:12.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.643711+0000", 2024-04-19T04:25:12.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2229999999999998e-06 2024-04-19T04:25:12.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.645213+0000", 2024-04-19T04:25:12.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001501968 2024-04-19T04:25:12.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.645403+0000", 2024-04-19T04:25:12.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000190263 2024-04-19T04:25:12.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.645554+0000", 2024-04-19T04:25:12.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000151101 2024-04-19T04:25:12.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.650090+0000", 2024-04-19T04:25:12.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045363820000000003 2024-04-19T04:25:12.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.661953+0000", 2024-04-19T04:25:12.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011862997 2024-04-19T04:25:12.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.662002+0000", 2024-04-19T04:25:12.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8594999999999998e-05 2024-04-19T04:25:12.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.662090+0000", 2024-04-19T04:25:12.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7929000000000005e-05 2024-04-19T04:25:12.438 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.439 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.439 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.439 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:55086 5.0 5:0187c457:::benchmark_data_smithi007_19526_object55085:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:12.439 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:08.708760+0000", 2024-04-19T04:25:12.439 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.6395827359999999, 2024-04-19T04:25:12.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017623585000000001, 2024-04-19T04:25:12.439 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.439 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.439 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.439 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.439 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.439 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 55086 2024-04-19T04:25:12.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.440 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.708760+0000", 2024-04-19T04:25:12.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.708760+0000", 2024-04-19T04:25:12.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.708759+0000", 2024-04-19T04:25:12.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.708848+0000", 2024-04-19T04:25:12.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9283000000000006e-05 2024-04-19T04:25:12.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.708865+0000", 2024-04-19T04:25:12.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6398000000000001e-05 2024-04-19T04:25:12.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.708873+0000", 2024-04-19T04:25:12.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5879999999999998e-06 2024-04-19T04:25:12.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.710117+0000", 2024-04-19T04:25:12.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012435129999999999 2024-04-19T04:25:12.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.710220+0000", 2024-04-19T04:25:12.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010351 2024-04-19T04:25:12.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.710310+0000", 2024-04-19T04:25:12.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9327999999999996e-05 2024-04-19T04:25:12.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.716233+0000", 2024-04-19T04:25:12.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059232429999999999 2024-04-19T04:25:12.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.726274+0000", 2024-04-19T04:25:12.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010040762 2024-04-19T04:25:12.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.726337+0000", 2024-04-19T04:25:12.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3072999999999997e-05 2024-04-19T04:25:12.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.726384+0000", 2024-04-19T04:25:12.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6919000000000003e-05 2024-04-19T04:25:12.444 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.444 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.444 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.445 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:55104 5.0 5:02336de7:::benchmark_data_smithi007_19526_object55103:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:12.445 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:08.720236+0000", 2024-04-19T04:25:12.445 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.6281067999999999, 2024-04-19T04:25:12.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.016739804, 2024-04-19T04:25:12.445 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.445 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.445 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.445 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.445 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.445 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 55104 2024-04-19T04:25:12.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.445 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.720236+0000", 2024-04-19T04:25:12.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.720236+0000", 2024-04-19T04:25:12.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.720235+0000", 2024-04-19T04:25:12.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:12.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.720280+0000", 2024-04-19T04:25:12.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4542000000000001e-05 2024-04-19T04:25:12.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.720289+0000", 2024-04-19T04:25:12.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7940000000000008e-06 2024-04-19T04:25:12.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.720295+0000", 2024-04-19T04:25:12.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5429999999999999e-06 2024-04-19T04:25:12.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.722706+0000", 2024-04-19T04:25:12.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024104859999999999 2024-04-19T04:25:12.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.722851+0000", 2024-04-19T04:25:12.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014503500000000001 2024-04-19T04:25:12.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.722962+0000", 2024-04-19T04:25:12.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011100800000000001 2024-04-19T04:25:12.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.725390+0000", 2024-04-19T04:25:12.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024283040000000001 2024-04-19T04:25:12.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.736809+0000", 2024-04-19T04:25:12.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011419545 2024-04-19T04:25:12.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.736873+0000", 2024-04-19T04:25:12.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3971000000000001e-05 2024-04-19T04:25:12.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:08.736976+0000", 2024-04-19T04:25:12.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010225699999999999 2024-04-19T04:25:12.450 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.450 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.450 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.451 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:59645 5.e 5:7601d3a3:::benchmark_data_smithi007_19526_object59644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:12.451 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:11.169080+0000", 2024-04-19T04:25:12.451 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.1792622449999999, 2024-04-19T04:25:12.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020340757000000001, 2024-04-19T04:25:12.451 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.451 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.451 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.451 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.451 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.451 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 59645 2024-04-19T04:25:12.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.451 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.169080+0000", 2024-04-19T04:25:12.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.169080+0000", 2024-04-19T04:25:12.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.169080+0000", 2024-04-19T04:25:12.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.169155+0000", 2024-04-19T04:25:12.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5130999999999996e-05 2024-04-19T04:25:12.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.169176+0000", 2024-04-19T04:25:12.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0763000000000001e-05 2024-04-19T04:25:12.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.169199+0000", 2024-04-19T04:25:12.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3742000000000001e-05 2024-04-19T04:25:12.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.175900+0000", 2024-04-19T04:25:12.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0067002049999999999 2024-04-19T04:25:12.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.176060+0000", 2024-04-19T04:25:12.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016083300000000001 2024-04-19T04:25:12.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.176288+0000", 2024-04-19T04:25:12.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000227944 2024-04-19T04:25:12.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.183739+0000", 2024-04-19T04:25:12.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074506290000000003 2024-04-19T04:25:12.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.189249+0000", 2024-04-19T04:25:12.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055097719999999996 2024-04-19T04:25:12.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.189344+0000", 2024-04-19T04:25:12.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5055000000000004e-05 2024-04-19T04:25:12.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.189421+0000", 2024-04-19T04:25:12.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7465000000000005e-05 2024-04-19T04:25:12.456 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.456 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.456 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.456 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:60195 5.e 5:7a105d17:::benchmark_data_smithi007_19526_object60194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:12.456 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:11.478721+0000", 2024-04-19T04:25:12.456 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.86962211199999995, 2024-04-19T04:25:12.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.016745431000000002, 2024-04-19T04:25:12.456 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:12.456 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.457 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:12.457 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:12.457 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.457 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 60195 2024-04-19T04:25:12.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.457 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:12.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:12.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.478721+0000", 2024-04-19T04:25:12.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:12.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.478721+0000", 2024-04-19T04:25:12.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:12.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:12.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.478720+0000", 2024-04-19T04:25:12.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:12.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.478805+0000", 2024-04-19T04:25:12.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4930000000000002e-05 2024-04-19T04:25:12.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:12.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.478815+0000", 2024-04-19T04:25:12.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8879999999999992e-06 2024-04-19T04:25:12.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.478823+0000", 2024-04-19T04:25:12.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.157e-06 2024-04-19T04:25:12.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:12.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.481203+0000", 2024-04-19T04:25:12.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023803359999999998 2024-04-19T04:25:12.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:12.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.481386+0000", 2024-04-19T04:25:12.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018270100000000001 2024-04-19T04:25:12.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.481568+0000", 2024-04-19T04:25:12.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018224199999999999 2024-04-19T04:25:12.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:12.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.486706+0000", 2024-04-19T04:25:12.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051378600000000002 2024-04-19T04:25:12.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.495374+0000", 2024-04-19T04:25:12.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0086679570000000004 2024-04-19T04:25:12.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:12.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.495429+0000", 2024-04-19T04:25:12.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4880000000000003e-05 2024-04-19T04:25:12.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:12.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:12.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:12.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.495466+0000", 2024-04-19T04:25:12.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7292999999999997e-05 2024-04-19T04:25:12.461 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.461 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.461 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.461 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:12.461 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:12.461 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:12.463 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:12.462+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:12.463 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:12.564 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:12.562+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:12.595 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:12.595 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:12.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.596 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:62192 5.2 5:493d7e18:::benchmark_data_smithi007_19526_object62191:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:12.596 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:12.589697+0000", 2024-04-19T04:25:12.596 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0059498509999999999, 2024-04-19T04:25:12.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0059728510000000004, 2024-04-19T04:25:12.596 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.596 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:12.596 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:12.597 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:12.597 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.597 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 62192 2024-04-19T04:25:12.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.597 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.589697+0000", 2024-04-19T04:25:12.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.589697+0000", 2024-04-19T04:25:12.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.599 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.599 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.589696+0000", 2024-04-19T04:25:12.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.599 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.599 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.589752+0000", 2024-04-19T04:25:12.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5986000000000002e-05 2024-04-19T04:25:12.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.589762+0000", 2024-04-19T04:25:12.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8609999999999993e-06 2024-04-19T04:25:12.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.589767+0000", 2024-04-19T04:25:12.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1340000000000003e-06 2024-04-19T04:25:12.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.589817+0000", 2024-04-19T04:25:12.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9295999999999997e-05 2024-04-19T04:25:12.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.589926+0000", 2024-04-19T04:25:12.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010885100000000001 2024-04-19T04:25:12.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590143+0000", 2024-04-19T04:25:12.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00021732500000000001 2024-04-19T04:25:12.601 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.601 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.602 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.602 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:62195 5.1 5:8d19ceb8:::benchmark_data_smithi007_19526_object62194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:12.602 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:12.589988+0000", 2024-04-19T04:25:12.602 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0056598009999999999, 2024-04-19T04:25:12.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0057601429999999997, 2024-04-19T04:25:12.602 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.602 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:12.602 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:12.603 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:12.603 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.603 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 62195 2024-04-19T04:25:12.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.603 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.589988+0000", 2024-04-19T04:25:12.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.589988+0000", 2024-04-19T04:25:12.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.589986+0000", 2024-04-19T04:25:12.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590060+0000", 2024-04-19T04:25:12.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3925999999999997e-05 2024-04-19T04:25:12.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590070+0000", 2024-04-19T04:25:12.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5240000000000006e-06 2024-04-19T04:25:12.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590076+0000", 2024-04-19T04:25:12.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5910000000000003e-06 2024-04-19T04:25:12.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590120+0000", 2024-04-19T04:25:12.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4092999999999999e-05 2024-04-19T04:25:12.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590274+0000", 2024-04-19T04:25:12.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000154456 2024-04-19T04:25:12.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590412+0000", 2024-04-19T04:25:12.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000138312 2024-04-19T04:25:12.606 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.606 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.606 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.607 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:62191 5.c e36/20 5:3f63662d:::benchmark_data_smithi007_19526_object62190:head v 36'3766, mlcod=36'3764)", 2024-04-19T04:25:12.607 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:12.590204+0000", 2024-04-19T04:25:12.607 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0054436750000000002, 2024-04-19T04:25:12.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055979890000000003, 2024-04-19T04:25:12.607 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.607 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:12.607 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590204+0000", 2024-04-19T04:25:12.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590204+0000", 2024-04-19T04:25:12.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590203+0000", 2024-04-19T04:25:12.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:12.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590289+0000", 2024-04-19T04:25:12.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5410999999999999e-05 2024-04-19T04:25:12.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590298+0000", 2024-04-19T04:25:12.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7599999999999997e-06 2024-04-19T04:25:12.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590303+0000", 2024-04-19T04:25:12.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6700000000000002e-06 2024-04-19T04:25:12.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590351+0000", 2024-04-19T04:25:12.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7769000000000003e-05 2024-04-19T04:25:12.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590373+0000", 2024-04-19T04:25:12.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2637999999999999e-05 2024-04-19T04:25:12.610 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.610 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.610 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.610 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:62198 5.7 5:eb5ba42a:::benchmark_data_smithi007_19526_object62197:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:12.610 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:12.590264+0000", 2024-04-19T04:25:12.610 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0053830049999999997, 2024-04-19T04:25:12.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055830389999999997, 2024-04-19T04:25:12.611 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.611 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:12.611 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:12.611 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:12.611 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.611 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 62198 2024-04-19T04:25:12.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.611 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590264+0000", 2024-04-19T04:25:12.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.612 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.612 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590264+0000", 2024-04-19T04:25:12.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.612 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.612 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590264+0000", 2024-04-19T04:25:12.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:12.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590357+0000", 2024-04-19T04:25:12.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.3716999999999997e-05 2024-04-19T04:25:12.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590367+0000", 2024-04-19T04:25:12.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8470000000000008e-06 2024-04-19T04:25:12.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590374+0000", 2024-04-19T04:25:12.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0360000000000001e-06 2024-04-19T04:25:12.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590416+0000", 2024-04-19T04:25:12.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1999999999999998e-05 2024-04-19T04:25:12.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590629+0000", 2024-04-19T04:25:12.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00021246200000000001 2024-04-19T04:25:12.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590758+0000", 2024-04-19T04:25:12.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012934900000000001 2024-04-19T04:25:12.615 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.615 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.615 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.615 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:62194 5.5 e36/20 5:a77457f5:::benchmark_data_smithi007_19526_object62193:head v 36'3959, mlcod=36'3957)", 2024-04-19T04:25:12.615 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:12.590575+0000", 2024-04-19T04:25:12.615 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0050722379999999997, 2024-04-19T04:25:12.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0053225199999999999, 2024-04-19T04:25:12.616 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.616 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:12.616 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.616 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590575+0000", 2024-04-19T04:25:12.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.616 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590575+0000", 2024-04-19T04:25:12.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590574+0000", 2024-04-19T04:25:12.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590623+0000", 2024-04-19T04:25:12.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8928000000000003e-05 2024-04-19T04:25:12.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590633+0000", 2024-04-19T04:25:12.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0355e-05 2024-04-19T04:25:12.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590641+0000", 2024-04-19T04:25:12.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.503e-06 2024-04-19T04:25:12.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590692+0000", 2024-04-19T04:25:12.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1156000000000003e-05 2024-04-19T04:25:12.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.590711+0000", 2024-04-19T04:25:12.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9296999999999998e-05 2024-04-19T04:25:12.619 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.619 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.619 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.619 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:62200 5.2 5:40f31f50:::benchmark_data_smithi007_19526_object62199:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:12.619 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:12.593154+0000", 2024-04-19T04:25:12.619 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0024931469999999998, 2024-04-19T04:25:12.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027864320000000001, 2024-04-19T04:25:12.619 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.619 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:12.620 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:12.620 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:12.620 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.620 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 62200 2024-04-19T04:25:12.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.620 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.593154+0000", 2024-04-19T04:25:12.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.593154+0000", 2024-04-19T04:25:12.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.593153+0000", 2024-04-19T04:25:12.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.593221+0000", 2024-04-19T04:25:12.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7868999999999997e-05 2024-04-19T04:25:12.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.593232+0000", 2024-04-19T04:25:12.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0472000000000001e-05 2024-04-19T04:25:12.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.593237+0000", 2024-04-19T04:25:12.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4870000000000002e-06 2024-04-19T04:25:12.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.593273+0000", 2024-04-19T04:25:12.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5973999999999998e-05 2024-04-19T04:25:12.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.593395+0000", 2024-04-19T04:25:12.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121746 2024-04-19T04:25:12.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:12.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.593581+0000", 2024-04-19T04:25:12.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00018617899999999999 2024-04-19T04:25:12.623 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.623 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.623 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.624 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:62204 5.3 e36/20 5:c4c43231:::benchmark_data_smithi007_19526_object62203:head v 36'3816, mlcod=36'3814)", 2024-04-19T04:25:12.624 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:12.595578+0000", 2024-04-19T04:25:12.624 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 6.8937999999999996e-05, 2024-04-19T04:25:12.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00041043299999999998, 2024-04-19T04:25:12.624 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.624 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:12.624 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.595578+0000", 2024-04-19T04:25:12.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.595578+0000", 2024-04-19T04:25:12.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.595578+0000", 2024-04-19T04:25:12.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:12.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.595655+0000", 2024-04-19T04:25:12.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6839000000000001e-05 2024-04-19T04:25:12.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.595667+0000", 2024-04-19T04:25:12.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2819e-05 2024-04-19T04:25:12.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.595673+0000", 2024-04-19T04:25:12.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8669999999999999e-06 2024-04-19T04:25:12.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.595712+0000", 2024-04-19T04:25:12.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.8523999999999999e-05 2024-04-19T04:25:12.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:12.595729+0000", 2024-04-19T04:25:12.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7297999999999999e-05 2024-04-19T04:25:12.627 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.627 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.627 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.627 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.627 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:12.627 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 7 2024-04-19T04:25:12.627 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:12.628 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:12.664 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:12.662+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:12.753 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 28 16 62488 62472 139.43 112 0.00721208 0.00716614 2024-04-19T04:25:12.756 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:12.756 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:12.757 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:12.757 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:12.757 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:12.765 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:12.762+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:12.769 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:12.819 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-04-19T04:25:12.865 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:12.866+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:12.902 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:12.902 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:12.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:12.903 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:12.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.903 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:12.903 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:25:12.903 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.367794564, 2024-04-19T04:25:12.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026801078999999998, 2024-04-19T04:25:12.903 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.903 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.903 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.903 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.903 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:25:12.904 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.904 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533736+0000", 2024-04-19T04:25:12.904 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.904 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533733+0000", 2024-04-19T04:25:12.904 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999976 2024-04-19T04:25:12.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533746+0000", 2024-04-19T04:25:12.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2679e-05 2024-04-19T04:25:12.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533769+0000", 2024-04-19T04:25:12.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2832000000000001e-05 2024-04-19T04:25:12.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533789+0000", 2024-04-19T04:25:12.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0599999999999999e-05 2024-04-19T04:25:12.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533907+0000", 2024-04-19T04:25:12.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000118076 2024-04-19T04:25:12.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op must wait for map", 2024-04-19T04:25:12.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533919+0000", 2024-04-19T04:25:12.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1644999999999999e-05 2024-04-19T04:25:12.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553399+0000", 2024-04-19T04:25:12.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.019479987000000001 2024-04-19T04:25:12.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553535+0000", 2024-04-19T04:25:12.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553400000000001 2024-04-19T04:25:12.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:12.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.553696+0000", 2024-04-19T04:25:12.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000161068 2024-04-19T04:25:12.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:12.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558096+0000", 2024-04-19T04:25:12.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0043998880000000002 2024-04-19T04:25:12.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560465+0000", 2024-04-19T04:25:12.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023695159999999999 2024-04-19T04:25:12.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:12.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560513+0000", 2024-04-19T04:25:12.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7899000000000003e-05 2024-04-19T04:25:12.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:12.909 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560537+0000", 2024-04-19T04:25:12.909 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3768e-05 2024-04-19T04:25:12.909 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.909 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.909 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.909 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:12.909 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:12.909 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.367717489999997, 2024-04-19T04:25:12.909 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026864505, 2024-04-19T04:25:12.909 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.909 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.909 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:12.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:12.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533812+0000", 2024-04-19T04:25:12.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533818+0000", 2024-04-19T04:25:12.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2369999999999997e-06 2024-04-19T04:25:12.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533863+0000", 2024-04-19T04:25:12.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4515000000000003e-05 2024-04-19T04:25:12.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533880+0000", 2024-04-19T04:25:12.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7119e-05 2024-04-19T04:25:12.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534029+0000", 2024-04-19T04:25:12.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014955099999999999 2024-04-19T04:25:12.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:12.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534034+0000", 2024-04-19T04:25:12.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1649999999999997e-06 2024-04-19T04:25:12.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554888+0000", 2024-04-19T04:25:12.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020854075 2024-04-19T04:25:12.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554967+0000", 2024-04-19T04:25:12.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8209999999999998e-05 2024-04-19T04:25:12.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:12.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555087+0000", 2024-04-19T04:25:12.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000120411 2024-04-19T04:25:12.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:12.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559328+0000", 2024-04-19T04:25:12.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042409800000000001 2024-04-19T04:25:12.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560587+0000", 2024-04-19T04:25:12.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012587119999999999 2024-04-19T04:25:12.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:12.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560620+0000", 2024-04-19T04:25:12.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2716999999999999e-05 2024-04-19T04:25:12.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:12.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560677+0000", 2024-04-19T04:25:12.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7726999999999998e-05 2024-04-19T04:25:12.915 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.915 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.915 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.915 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:12.915 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:12.915 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.367635096999997, 2024-04-19T04:25:12.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027363064999999999, 2024-04-19T04:25:12.915 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.915 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.916 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:12.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:12.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533894+0000", 2024-04-19T04:25:12.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:12.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533913+0000", 2024-04-19T04:25:12.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8896e-05 2024-04-19T04:25:12.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533933+0000", 2024-04-19T04:25:12.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9775e-05 2024-04-19T04:25:12.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533967+0000", 2024-04-19T04:25:12.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4536000000000003e-05 2024-04-19T04:25:12.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:12.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553600000000001 2024-04-19T04:25:12.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:12.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534107+0000", 2024-04-19T04:25:12.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1470000000000003e-06 2024-04-19T04:25:12.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556463+0000", 2024-04-19T04:25:12.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022356536999999999 2024-04-19T04:25:12.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556586+0000", 2024-04-19T04:25:12.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122967 2024-04-19T04:25:12.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:12.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556738+0000", 2024-04-19T04:25:12.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015182800000000001 2024-04-19T04:25:12.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.920 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561020+0000", 2024-04-19T04:25:12.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042818819999999999 2024-04-19T04:25:12.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.920 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:12.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561183+0000", 2024-04-19T04:25:12.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000162683 2024-04-19T04:25:12.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.920 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:12.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561226+0000", 2024-04-19T04:25:12.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3686000000000002e-05 2024-04-19T04:25:12.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:12.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561258+0000", 2024-04-19T04:25:12.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1814999999999999e-05 2024-04-19T04:25:12.921 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.921 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.921 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.921 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:12.921 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:12.921 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.367544584000001, 2024-04-19T04:25:12.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027417816000000001, 2024-04-19T04:25:12.922 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.922 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.922 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:12.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:12.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533984+0000", 2024-04-19T04:25:12.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:12.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:25:12.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3876000000000001e-05 2024-04-19T04:25:12.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534015+0000", 2024-04-19T04:25:12.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6818999999999999e-05 2024-04-19T04:25:12.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534030+0000", 2024-04-19T04:25:12.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.537e-05 2024-04-19T04:25:12.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534152+0000", 2024-04-19T04:25:12.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121685 2024-04-19T04:25:12.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:12.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534156+0000", 2024-04-19T04:25:12.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9029999999999997e-06 2024-04-19T04:25:12.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557520+0000", 2024-04-19T04:25:12.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023364125999999999 2024-04-19T04:25:12.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557585+0000", 2024-04-19T04:25:12.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5275000000000001e-05 2024-04-19T04:25:12.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.926 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:12.926 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557719+0000", 2024-04-19T04:25:12.926 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013396299999999999 2024-04-19T04:25:12.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.926 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.926 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561133+0000", 2024-04-19T04:25:12.926 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034140989999999999 2024-04-19T04:25:12.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.926 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:12.926 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561352+0000", 2024-04-19T04:25:12.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0002185 2024-04-19T04:25:12.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:12.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561380+0000", 2024-04-19T04:25:12.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8317999999999999e-05 2024-04-19T04:25:12.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:12.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561403+0000", 2024-04-19T04:25:12.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3264999999999998e-05 2024-04-19T04:25:12.927 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.927 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.927 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.928 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:12.928 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:12.928 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.367480939000004, 2024-04-19T04:25:12.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029897119999999999, 2024-04-19T04:25:12.928 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.928 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.928 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:12.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:12.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534048+0000", 2024-04-19T04:25:12.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534057+0000", 2024-04-19T04:25:12.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7930000000000003e-06 2024-04-19T04:25:12.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.930 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.930 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534075+0000", 2024-04-19T04:25:12.930 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7846000000000002e-05 2024-04-19T04:25:12.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.930 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.930 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534089+0000", 2024-04-19T04:25:12.930 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4463e-05 2024-04-19T04:25:12.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.930 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.930 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534198+0000", 2024-04-19T04:25:12.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109145 2024-04-19T04:25:12.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:12.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534202+0000", 2024-04-19T04:25:12.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.98e-06 2024-04-19T04:25:12.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558221+0000", 2024-04-19T04:25:12.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024018208999999999 2024-04-19T04:25:12.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.932 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558320+0000", 2024-04-19T04:25:12.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9642000000000006e-05 2024-04-19T04:25:12.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.932 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:12.932 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558401+0000", 2024-04-19T04:25:12.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1038000000000006e-05 2024-04-19T04:25:12.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.932 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.932 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561173+0000", 2024-04-19T04:25:12.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027714549999999999 2024-04-19T04:25:12.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:12.933 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563851+0000", 2024-04-19T04:25:12.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026786010000000001 2024-04-19T04:25:12.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:12.933 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563906+0000", 2024-04-19T04:25:12.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4895999999999998e-05 2024-04-19T04:25:12.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:12.933 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563946+0000", 2024-04-19T04:25:12.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0116e-05 2024-04-19T04:25:12.933 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.934 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.934 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.934 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:12.934 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:12.934 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.367427558000003, 2024-04-19T04:25:12.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029917846000000001, 2024-04-19T04:25:12.934 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.934 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.934 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.934 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.935 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:12.935 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.935 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.935 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.935 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:12.935 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.935 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.935 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.935 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534101+0000", 2024-04-19T04:25:12.935 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:12.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.935 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.936 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.936 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534111+0000", 2024-04-19T04:25:12.936 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5659999999999996e-06 2024-04-19T04:25:12.936 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.936 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.936 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.936 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534129+0000", 2024-04-19T04:25:12.936 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7632999999999999e-05 2024-04-19T04:25:12.936 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.936 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.936 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.936 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534143+0000", 2024-04-19T04:25:12.936 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4362000000000001e-05 2024-04-19T04:25:12.937 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.937 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.937 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.937 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534256+0000", 2024-04-19T04:25:12.937 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113267 2024-04-19T04:25:12.937 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.937 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.937 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:12.937 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534260+0000", 2024-04-19T04:25:12.937 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9949999999999999e-06 2024-04-19T04:25:12.937 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.937 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.937 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.937 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558653+0000", 2024-04-19T04:25:12.938 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024393182999999999 2024-04-19T04:25:12.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.938 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.938 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.938 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558704+0000", 2024-04-19T04:25:12.938 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0303999999999998e-05 2024-04-19T04:25:12.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.938 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.938 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:12.938 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558782+0000", 2024-04-19T04:25:12.938 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8079999999999998e-05 2024-04-19T04:25:12.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.939 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.939 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.939 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561309+0000", 2024-04-19T04:25:12.939 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002527708 2024-04-19T04:25:12.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.939 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.939 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:12.939 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563952+0000", 2024-04-19T04:25:12.939 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026425450000000001 2024-04-19T04:25:12.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.939 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.939 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:12.939 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563996+0000", 2024-04-19T04:25:12.940 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3606000000000002e-05 2024-04-19T04:25:12.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.940 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:12.940 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564021+0000", 2024-04-19T04:25:12.940 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.491e-05 2024-04-19T04:25:12.940 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.940 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.940 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.940 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:12.940 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:12.940 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.367375047000003, 2024-04-19T04:25:12.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:25:12.941 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.941 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.941 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.941 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.941 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.941 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:12.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.941 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.941 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.941 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:12.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.942 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.942 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.942 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:25:12.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.942 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.942 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.942 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:25:12.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:25:12.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.942 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.942 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.942 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:25:12.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:25:12.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:25:12.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:25:12.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:25:12.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:25:12.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:12.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:25:12.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:25:12.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.944 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:25:12.944 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:25:12.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.944 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:25:12.944 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:25:12.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:12.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:25:12.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:25:12.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.945 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:25:12.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:25:12.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.945 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:12.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:25:12.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:25:12.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:12.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:25:12.946 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:25:12.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:12.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:25:12.946 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:25:12.946 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.946 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.946 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.947 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:12.947 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:12.947 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.367320501999998, 2024-04-19T04:25:12.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:25:12.947 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.947 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.947 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.947 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.947 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.947 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:12.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.947 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:12.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:25:12.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:25:12.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:25:12.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:25:12.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:25:12.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:25:12.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:25:12.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:25:12.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:25:12.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:12.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:25:12.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:25:12.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:25:12.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:25:12.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:25:12.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:25:12.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:12.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:25:12.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:25:12.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:25:12.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:25:12.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.952 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:12.952 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:25:12.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:25:12.952 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.952 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.952 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:12.952 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:25:12.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:25:12.952 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.952 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.952 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:12.952 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:25:12.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:25:12.952 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.952 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.953 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.953 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.953 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.953 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:12.953 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:12.954 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.670005916000001, 2024-04-19T04:25:12.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:12.954 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.954 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.954 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:12.954 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:12.954 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.954 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:12.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.954 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.954 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.954 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.954 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:12.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.955 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.955 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:12.955 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.955 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.955 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:12.955 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.955 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.955 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:12.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:12.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:12.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:12.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:12.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:12.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:12.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:12.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:12.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:12.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:12.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:12.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:12.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:12.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:12.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:12.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:12.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:12.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:12.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:12.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:12.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.959 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:12.959 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:12.959 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:12.959 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.959 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.959 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.959 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.959 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:12.959 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:12.959 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.666824760000001, 2024-04-19T04:25:12.959 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:12.959 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.959 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.959 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:12.960 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:12.960 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.960 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:12.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.960 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.960 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.960 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:12.960 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.960 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.960 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:12.960 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:12.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:12.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:12.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:12.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:12.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:12.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:12.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:12.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:12.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:12.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:12.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:12.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:12.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:12.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:12.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:12.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:12.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:12.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:12.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:12.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:12.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:12.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:12.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:12.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:12.964 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.964 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.965 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.965 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:12.965 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:12.965 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.666256656000002, 2024-04-19T04:25:12.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:12.965 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.965 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.965 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.965 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.965 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:12.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.966 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.966 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.966 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:12.966 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.966 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.966 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.966 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:12.966 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:12.966 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.966 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.966 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:12.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:12.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:12.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:12.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:12.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:12.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:12.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:12.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:12.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:12.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:12.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:12.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:12.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:12.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:12.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:12.969 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.969 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.969 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.969 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:12.969 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:12.969 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.665910995000001, 2024-04-19T04:25:12.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:12.969 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.969 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.969 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:12.969 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:12.970 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.970 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:12.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.970 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:12.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:12.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.971 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.971 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:12.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.971 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.971 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:12.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:12.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.971 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.971 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:12.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:12.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:12.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:12.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:12.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:12.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:12.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:12.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:12.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:12.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:12.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:12.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:12.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:12.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:12.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:12.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.974 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:12.974 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:12.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:12.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.974 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:12.974 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:12.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:12.974 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.974 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.974 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.975 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:12.975 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:12.975 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.665186556999998, 2024-04-19T04:25:12.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:12.975 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.975 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.975 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.975 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.975 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:12.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:12.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:12.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:12.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:12.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:12.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:12.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:12.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:12.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:12.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:12.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.978 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.978 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.978 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:12.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:12.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.978 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.978 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:12.978 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:12.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:12.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.978 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.665179162000001, 2024-04-19T04:25:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:12.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:12.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.982 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:12.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:12.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.982 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:12.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:12.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.982 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:12.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:12.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:12.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:12.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:12.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:12.983 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.983 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.983 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.983 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:12.983 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:12.983 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.663354014999999, 2024-04-19T04:25:12.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:12.984 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.984 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.984 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:12.984 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:12.984 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.984 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:12.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.984 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:12.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:12.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:12.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.986 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:12.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:12.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.986 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:12.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:12.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.986 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:12.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:12.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.987 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.987 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.987 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:12.987 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:12.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.987 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.987 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.987 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:12.987 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:12.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.987 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.987 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:12.987 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:12.987 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:12.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:12.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:12.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:12.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:12.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:12.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:12.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:12.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:12.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.989 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:12.989 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:12.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:12.989 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.989 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.989 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.989 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26148 5.9 e27/20 ondisk, result = 0)", 2024-04-19T04:25:12.989 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:12.989 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.663253690000001, 2024-04-19T04:25:12.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.042005175999999998, 2024-04-19T04:25:12.990 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.990 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:12.990 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:12.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.990 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:12.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.990 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238276+0000", 2024-04-19T04:25:12.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:12.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238280+0000", 2024-04-19T04:25:12.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6399999999999999e-06 2024-04-19T04:25:12.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238286+0000", 2024-04-19T04:25:12.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2099999999999998e-06 2024-04-19T04:25:12.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238290+0000", 2024-04-19T04:25:12.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2470000000000002e-06 2024-04-19T04:25:12.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239526+0000", 2024-04-19T04:25:12.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012362619999999999 2024-04-19T04:25:12.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239538+0000", 2024-04-19T04:25:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1620999999999999e-05 2024-04-19T04:25:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280282+0000", 2024-04-19T04:25:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040743691999999998 2024-04-19T04:25:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.662619809999999, 2024-04-19T04:25:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.662085533999999, 2024-04-19T04:25:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.003 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:13.003 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:13.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:13.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.003 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:13.003 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:13.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:13.003 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:13.003 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:13.003 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:13.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.003 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26160 5.f e27/20 ondisk, result = 0)", 2024-04-19T04:25:13.003 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:13.004 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.660970159000001, 2024-04-19T04:25:13.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039752357000000002, 2024-04-19T04:25:13.004 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:13.004 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:13.004 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:13.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.004 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:13.004 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:13.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:13.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.004 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:13.004 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:13.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:13.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:13.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240559+0000", 2024-04-19T04:25:13.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:13.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:13.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240569+0000", 2024-04-19T04:25:13.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7720000000000006e-06 2024-04-19T04:25:13.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:13.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280164+0000", 2024-04-19T04:25:13.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039595324000000001 2024-04-19T04:25:13.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:13.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280190+0000", 2024-04-19T04:25:13.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5692000000000001e-05 2024-04-19T04:25:13.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:13.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280287+0000", 2024-04-19T04:25:13.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7536999999999998e-05 2024-04-19T04:25:13.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.007 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:13.007 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280299+0000", 2024-04-19T04:25:13.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2057e-05 2024-04-19T04:25:13.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.007 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:13.007 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:13.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3244999999999999e-05 2024-04-19T04:25:13.007 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:13.007 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:13.007 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:13.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.007 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26179 5.3 e27/20 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head v 27'1624, mlcod=27'1621)", 2024-04-19T04:25:13.007 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:13.008 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.657816406999999, 2024-04-19T04:25:13.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039964081999999998, 2024-04-19T04:25:13.008 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:13.008 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:13.008 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:13.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:13.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:13.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:13.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:13.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:13.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:13.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:13.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243713+0000", 2024-04-19T04:25:13.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:13.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:13.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243750+0000", 2024-04-19T04:25:13.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6704e-05 2024-04-19T04:25:13.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:13.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280162+0000", 2024-04-19T04:25:13.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036412117000000001 2024-04-19T04:25:13.010 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.010 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.010 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:13.010 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280186+0000", 2024-04-19T04:25:13.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4825999999999999e-05 2024-04-19T04:25:13.010 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.010 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.010 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:13.010 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:13.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012540000000000001 2024-04-19T04:25:13.010 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.010 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.010 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:13.010 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280347+0000", 2024-04-19T04:25:13.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4894000000000002e-05 2024-04-19T04:25:13.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.011 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.011 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:13.011 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283654+0000", 2024-04-19T04:25:13.011 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00330716 2024-04-19T04:25:13.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:13.011 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:13.011 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:13.011 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283678+0000", 2024-04-19T04:25:13.011 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3992e-05 2024-04-19T04:25:13.011 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:13.011 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:13.011 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:13.011 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:13.012 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:13.012 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:13.013 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:13.010+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:13.013 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:13.071 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:25:13.114 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:13.114+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:13.137 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:13.137 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63162 5.b 5:d41f7519:::benchmark_data_smithi007_19526_object63161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.128812+0000", 2024-04-19T04:25:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0095430280000000003, 2024-04-19T04:25:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0095621530000000003, 2024-04-19T04:25:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63162 2024-04-19T04:25:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.128812+0000", 2024-04-19T04:25:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.128812+0000", 2024-04-19T04:25:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.128810+0000", 2024-04-19T04:25:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.128946+0000", 2024-04-19T04:25:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013583399999999999 2024-04-19T04:25:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.128958+0000", 2024-04-19T04:25:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1854e-05 2024-04-19T04:25:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.128964+0000", 2024-04-19T04:25:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0599999999999996e-06 2024-04-19T04:25:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.129010+0000", 2024-04-19T04:25:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5921999999999998e-05 2024-04-19T04:25:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.129135+0000", 2024-04-19T04:25:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012462700000000001 2024-04-19T04:25:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.129335+0000", 2024-04-19T04:25:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020071499999999999 2024-04-19T04:25:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.131393+0000", 2024-04-19T04:25:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020571370000000001 2024-04-19T04:25:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63168 5.0 5:06a300f0:::benchmark_data_smithi007_19526_object63167:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.131932+0000", 2024-04-19T04:25:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0064230010000000002, 2024-04-19T04:25:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0064914539999999998, 2024-04-19T04:25:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63168 2024-04-19T04:25:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.131932+0000", 2024-04-19T04:25:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.131932+0000", 2024-04-19T04:25:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.131930+0000", 2024-04-19T04:25:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.132004+0000", 2024-04-19T04:25:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3286000000000003e-05 2024-04-19T04:25:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.132016+0000", 2024-04-19T04:25:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2594e-05 2024-04-19T04:25:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.132022+0000", 2024-04-19T04:25:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9529999999999996e-06 2024-04-19T04:25:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.132075+0000", 2024-04-19T04:25:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2673999999999997e-05 2024-04-19T04:25:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.132236+0000", 2024-04-19T04:25:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016088300000000001 2024-04-19T04:25:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.132404+0000", 2024-04-19T04:25:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016788600000000001 2024-04-19T04:25:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.135062+0000", 2024-04-19T04:25:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026577599999999999 2024-04-19T04:25:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63173 5.e 5:7e40b726:::benchmark_data_smithi007_19526_object63172:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.134325+0000", 2024-04-19T04:25:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0040300570000000001, 2024-04-19T04:25:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0041425070000000001, 2024-04-19T04:25:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63173 2024-04-19T04:25:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.134325+0000", 2024-04-19T04:25:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.134325+0000", 2024-04-19T04:25:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.134323+0000", 2024-04-19T04:25:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.134391+0000", 2024-04-19T04:25:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7376e-05 2024-04-19T04:25:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.134408+0000", 2024-04-19T04:25:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7745999999999999e-05 2024-04-19T04:25:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.134417+0000", 2024-04-19T04:25:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0410000000000003e-06 2024-04-19T04:25:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.134478+0000", 2024-04-19T04:25:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0100999999999999e-05 2024-04-19T04:25:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.134750+0000", 2024-04-19T04:25:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027248600000000001 2024-04-19T04:25:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.134980+0000", 2024-04-19T04:25:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022960999999999999 2024-04-19T04:25:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.137467+0000", 2024-04-19T04:25:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024870309999999998 2024-04-19T04:25:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:63172 5.8 e37/29 5:1ab24368:::benchmark_data_smithi007_19526_object63171:head v 37'4001, mlcod=37'3998)", 2024-04-19T04:25:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.136000+0000", 2024-04-19T04:25:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002355003, 2024-04-19T04:25:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025077400000000001, 2024-04-19T04:25:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.136000+0000", 2024-04-19T04:25:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.136000+0000", 2024-04-19T04:25:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.135999+0000", 2024-04-19T04:25:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.136054+0000", 2024-04-19T04:25:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5566999999999998e-05 2024-04-19T04:25:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.136065+0000", 2024-04-19T04:25:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1129e-05 2024-04-19T04:25:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.136075+0000", 2024-04-19T04:25:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7909999999999999e-06 2024-04-19T04:25:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.136120+0000", 2024-04-19T04:25:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4313000000000001e-05 2024-04-19T04:25:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.136144+0000", 2024-04-19T04:25:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4499999999999999e-05 2024-04-19T04:25:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63177 5.0 5:0b5ae3a9:::benchmark_data_smithi007_19526_object63176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.138032+0000", 2024-04-19T04:25:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00032223899999999999, 2024-04-19T04:25:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00050749300000000003, 2024-04-19T04:25:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:13.157 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63177 2024-04-19T04:25:13.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.157 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:13.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:13.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.138032+0000", 2024-04-19T04:25:13.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:13.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:13.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.138032+0000", 2024-04-19T04:25:13.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:13.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:13.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.138031+0000", 2024-04-19T04:25:13.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:13.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:13.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.138166+0000", 2024-04-19T04:25:13.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013447700000000001 2024-04-19T04:25:13.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.138181+0000", 2024-04-19T04:25:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5084e-05 2024-04-19T04:25:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.138187+0000", 2024-04-19T04:25:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7379999999999999e-06 2024-04-19T04:25:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.138267+0000", 2024-04-19T04:25:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9785999999999998e-05 2024-04-19T04:25:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.138487+0000", 2024-04-19T04:25:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022030899999999999 2024-04-19T04:25:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4746.0:63162 5.b e37/20 ondisk, result = 0)", 2024-04-19T04:25:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.138490+0000", 2024-04-19T04:25:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9998646, 2024-04-19T04:25:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2233999999999999e-05, 2024-04-19T04:25:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.138490+0000", 2024-04-19T04:25:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.138490+0000", 2024-04-19T04:25:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.138490+0000", 2024-04-19T04:25:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.138495+0000", 2024-04-19T04:25:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4060000000000004e-06 2024-04-19T04:25:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.138502+0000", 2024-04-19T04:25:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2300000000000002e-06 2024-04-19T04:25:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.138508+0000", 2024-04-19T04:25:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.054e-06 2024-04-19T04:25:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.138550+0000", 2024-04-19T04:25:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2178999999999997e-05 2024-04-19T04:25:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.138556+0000", 2024-04-19T04:25:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4070000000000001e-06 2024-04-19T04:25:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:13.164 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:13.164 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 6 2024-04-19T04:25:13.164 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:13.165 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:13.214 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:13.214+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:13.230 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:13.252 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-04-19T04:25:13.273 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:13.275 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:13.275 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T04:25:13.275 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:13.283 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:13.283 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:13.295 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:13.338 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:13.338+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:13.417 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:13.414+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:13.463 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:13.463 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:13.475 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:13.517 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:13.514+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:13.609 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:13.609 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:13.619 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:13.614+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:13.622 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:13.720 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:13.714+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:13.753 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 29 16 64274 64258 138.471 111.625 0.010275 0.00721551 2024-04-19T04:25:13.795 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:13.795 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:13.807 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:13.852 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:13.850+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:13.921 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:13.918+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:13.934 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:13.934 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:13.947 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:14.022 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:14.022+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:14.069 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:14.069 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:14.081 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:14.123 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:14.122+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:14.224 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:14.222+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:14.244 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:14.244 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:14.256 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:14.325 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:14.322+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:14.383 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:14.383 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:14.396 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:14.441 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:14.438+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:14.526 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:14.522+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:14.528 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:14.528 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:14.541 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:14.628 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:14.622+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:14.673 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:14.673 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:14.686 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:14.728 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:14.726+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:14.754 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 30 16 66092 66076 137.642 113.625 0.00838245 0.00725866 2024-04-19T04:25:14.830 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:14.830+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:14.831 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T04:25:14.865 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:14.865 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:14.878 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:14.931 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:14.930+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:14.999 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:14.999 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:15.012 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:15.032 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:15.030+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:15.133 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:15.130+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:15.134 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:15.135 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:15.147 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:15.235 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:15.230+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:15.293 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:25:15.309 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:15.309 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:15.324 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:15.335 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:15.334+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:15.435 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:15.434+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:15.448 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:15.448 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:15.455 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:15.461 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:15.479 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-04-19T04:25:15.502 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T04:25:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:15.537 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:15.534+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:15.581 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:15.581 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:15.581 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:15.581 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:15.581 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:15.594 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:15.638 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:15.634+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:15.721 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:15.721 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:15.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:15.721 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:15.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.722 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:15.722 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:15.722 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 55.186267749000002, 2024-04-19T04:25:15.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026864505, 2024-04-19T04:25:15.722 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.722 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:15.722 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.722 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.722 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:15.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:15.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533812+0000", 2024-04-19T04:25:15.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:15.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533818+0000", 2024-04-19T04:25:15.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2369999999999997e-06 2024-04-19T04:25:15.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533863+0000", 2024-04-19T04:25:15.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4515000000000003e-05 2024-04-19T04:25:15.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533880+0000", 2024-04-19T04:25:15.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7119e-05 2024-04-19T04:25:15.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534029+0000", 2024-04-19T04:25:15.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014955099999999999 2024-04-19T04:25:15.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:15.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534034+0000", 2024-04-19T04:25:15.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1649999999999997e-06 2024-04-19T04:25:15.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554888+0000", 2024-04-19T04:25:15.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020854075 2024-04-19T04:25:15.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554967+0000", 2024-04-19T04:25:15.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8209999999999998e-05 2024-04-19T04:25:15.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.726 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:15.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555087+0000", 2024-04-19T04:25:15.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000120411 2024-04-19T04:25:15.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.726 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:15.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559328+0000", 2024-04-19T04:25:15.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042409800000000001 2024-04-19T04:25:15.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.726 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:15.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560587+0000", 2024-04-19T04:25:15.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012587119999999999 2024-04-19T04:25:15.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:15.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560620+0000", 2024-04-19T04:25:15.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2716999999999999e-05 2024-04-19T04:25:15.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560677+0000", 2024-04-19T04:25:15.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7726999999999998e-05 2024-04-19T04:25:15.727 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.727 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.727 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.727 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:15.728 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:15.728 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 55.186185356000003, 2024-04-19T04:25:15.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027363064999999999, 2024-04-19T04:25:15.728 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.728 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:15.728 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:15.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:15.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533894+0000", 2024-04-19T04:25:15.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:15.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533913+0000", 2024-04-19T04:25:15.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8896e-05 2024-04-19T04:25:15.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.730 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533933+0000", 2024-04-19T04:25:15.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9775e-05 2024-04-19T04:25:15.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.730 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533967+0000", 2024-04-19T04:25:15.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4536000000000003e-05 2024-04-19T04:25:15.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.730 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:15.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553600000000001 2024-04-19T04:25:15.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.731 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.731 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:15.731 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534107+0000", 2024-04-19T04:25:15.731 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1470000000000003e-06 2024-04-19T04:25:15.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.731 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.731 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.731 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556463+0000", 2024-04-19T04:25:15.731 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022356536999999999 2024-04-19T04:25:15.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.731 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.731 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.731 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556586+0000", 2024-04-19T04:25:15.731 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122967 2024-04-19T04:25:15.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:15.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556738+0000", 2024-04-19T04:25:15.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015182800000000001 2024-04-19T04:25:15.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:15.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561020+0000", 2024-04-19T04:25:15.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042818819999999999 2024-04-19T04:25:15.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:15.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561183+0000", 2024-04-19T04:25:15.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000162683 2024-04-19T04:25:15.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:15.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561226+0000", 2024-04-19T04:25:15.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3686000000000002e-05 2024-04-19T04:25:15.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561258+0000", 2024-04-19T04:25:15.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1814999999999999e-05 2024-04-19T04:25:15.733 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.733 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.733 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.733 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:15.733 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:15.734 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 55.186094842999999, 2024-04-19T04:25:15.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027417816000000001, 2024-04-19T04:25:15.734 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.734 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:15.734 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:15.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:15.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533984+0000", 2024-04-19T04:25:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:25:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3876000000000001e-05 2024-04-19T04:25:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534015+0000", 2024-04-19T04:25:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6818999999999999e-05 2024-04-19T04:25:15.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534030+0000", 2024-04-19T04:25:15.736 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.537e-05 2024-04-19T04:25:15.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534152+0000", 2024-04-19T04:25:15.736 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121685 2024-04-19T04:25:15.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:15.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534156+0000", 2024-04-19T04:25:15.736 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9029999999999997e-06 2024-04-19T04:25:15.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.737 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557520+0000", 2024-04-19T04:25:15.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023364125999999999 2024-04-19T04:25:15.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.737 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557585+0000", 2024-04-19T04:25:15.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5275000000000001e-05 2024-04-19T04:25:15.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:15.737 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557719+0000", 2024-04-19T04:25:15.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013396299999999999 2024-04-19T04:25:15.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.738 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.738 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:15.738 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561133+0000", 2024-04-19T04:25:15.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034140989999999999 2024-04-19T04:25:15.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.738 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.738 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:15.738 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561352+0000", 2024-04-19T04:25:15.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0002185 2024-04-19T04:25:15.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.739 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:15.739 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561380+0000", 2024-04-19T04:25:15.739 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8317999999999999e-05 2024-04-19T04:25:15.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.739 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.739 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561403+0000", 2024-04-19T04:25:15.739 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3264999999999998e-05 2024-04-19T04:25:15.739 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.739 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.739 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.739 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:15.740 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:15.740 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 55.186031198000002, 2024-04-19T04:25:15.740 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029897119999999999, 2024-04-19T04:25:15.740 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.740 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:15.740 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.740 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.740 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.740 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:15.740 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.740 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.740 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.740 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:15.740 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534048+0000", 2024-04-19T04:25:15.741 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:15.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534057+0000", 2024-04-19T04:25:15.741 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7930000000000003e-06 2024-04-19T04:25:15.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534075+0000", 2024-04-19T04:25:15.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7846000000000002e-05 2024-04-19T04:25:15.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534089+0000", 2024-04-19T04:25:15.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4463e-05 2024-04-19T04:25:15.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534198+0000", 2024-04-19T04:25:15.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109145 2024-04-19T04:25:15.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:15.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534202+0000", 2024-04-19T04:25:15.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.98e-06 2024-04-19T04:25:15.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.743 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558221+0000", 2024-04-19T04:25:15.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024018208999999999 2024-04-19T04:25:15.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.743 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558320+0000", 2024-04-19T04:25:15.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9642000000000006e-05 2024-04-19T04:25:15.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.743 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:15.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558401+0000", 2024-04-19T04:25:15.744 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1038000000000006e-05 2024-04-19T04:25:15.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.744 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.744 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:15.744 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561173+0000", 2024-04-19T04:25:15.744 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027714549999999999 2024-04-19T04:25:15.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.744 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.744 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:15.744 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563851+0000", 2024-04-19T04:25:15.744 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026786010000000001 2024-04-19T04:25:15.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.744 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.744 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:15.744 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563906+0000", 2024-04-19T04:25:15.745 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4895999999999998e-05 2024-04-19T04:25:15.745 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.745 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.745 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.745 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563946+0000", 2024-04-19T04:25:15.745 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0116e-05 2024-04-19T04:25:15.745 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.745 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.745 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.745 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.745 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.745 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:15.745 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:15.745 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 55.185977817000001, 2024-04-19T04:25:15.745 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029917846000000001, 2024-04-19T04:25:15.746 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.746 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:15.746 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.746 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.746 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.746 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:15.746 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.746 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.746 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.746 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.746 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:15.746 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.747 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.747 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.747 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534101+0000", 2024-04-19T04:25:15.747 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:15.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.747 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.747 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.747 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534111+0000", 2024-04-19T04:25:15.747 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5659999999999996e-06 2024-04-19T04:25:15.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.747 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.747 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.747 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534129+0000", 2024-04-19T04:25:15.748 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7632999999999999e-05 2024-04-19T04:25:15.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.748 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.748 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.748 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534143+0000", 2024-04-19T04:25:15.748 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4362000000000001e-05 2024-04-19T04:25:15.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.748 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.748 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.748 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534256+0000", 2024-04-19T04:25:15.748 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113267 2024-04-19T04:25:15.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.748 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.748 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:15.748 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534260+0000", 2024-04-19T04:25:15.749 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9949999999999999e-06 2024-04-19T04:25:15.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.749 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.749 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.749 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558653+0000", 2024-04-19T04:25:15.749 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024393182999999999 2024-04-19T04:25:15.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.749 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.749 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.749 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558704+0000", 2024-04-19T04:25:15.749 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0303999999999998e-05 2024-04-19T04:25:15.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.749 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.749 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:15.750 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558782+0000", 2024-04-19T04:25:15.750 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8079999999999998e-05 2024-04-19T04:25:15.750 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.750 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.750 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:15.750 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561309+0000", 2024-04-19T04:25:15.750 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002527708 2024-04-19T04:25:15.750 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.750 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.750 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:15.750 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563952+0000", 2024-04-19T04:25:15.750 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026425450000000001 2024-04-19T04:25:15.750 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.750 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.751 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:15.751 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563996+0000", 2024-04-19T04:25:15.751 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3606000000000002e-05 2024-04-19T04:25:15.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.751 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.751 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.751 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564021+0000", 2024-04-19T04:25:15.751 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.491e-05 2024-04-19T04:25:15.751 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.751 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.751 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.751 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.751 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:15.751 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:15.752 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 55.185925306000001, 2024-04-19T04:25:15.752 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:25:15.752 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.752 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:15.752 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.752 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.752 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.752 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:15.752 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.752 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.752 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.752 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:15.752 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.753 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.753 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.753 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:25:15.753 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:15.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.753 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.753 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.753 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:25:15.753 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:25:15.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.753 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.753 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.753 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:25:15.753 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:25:15.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.754 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.754 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.754 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:25:15.754 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:25:15.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.754 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.754 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.754 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:25:15.754 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:25:15.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.754 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.754 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:15.754 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:25:15.754 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:25:15.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.755 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.755 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:25:15.755 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:25:15.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.755 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.755 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:25:15.755 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:25:15.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.755 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:15.755 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:25:15.755 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:25:15.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.756 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:15.756 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:25:15.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:25:15.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.756 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:15.756 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:25:15.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:25:15.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.756 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:15.756 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:25:15.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:25:15.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.757 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.757 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.757 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:25:15.757 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:25:15.757 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.757 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.757 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.757 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.757 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:15.757 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:15.757 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 55.185870760999997, 2024-04-19T04:25:15.757 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:25:15.757 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.758 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:15.758 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.758 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.758 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.758 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:15.758 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.758 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.758 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.758 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.758 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:15.758 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.758 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.758 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.758 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.759 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:25:15.759 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:15.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.759 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.759 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.759 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:25:15.759 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:25:15.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.759 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.759 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.759 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:25:15.759 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:25:15.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.759 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.759 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.760 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:25:15.760 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:25:15.760 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.760 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.760 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.760 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:25:15.760 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:25:15.760 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.760 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.760 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:15.760 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:25:15.760 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:25:15.760 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.760 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.760 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.761 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:25:15.761 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:25:15.761 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.761 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.761 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:25:15.761 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:25:15.761 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.761 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:15.761 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:25:15.761 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:25:15.761 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.762 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:15.762 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:25:15.762 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:25:15.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.762 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.762 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:15.762 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:25:15.762 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:25:15.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.762 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.762 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:15.762 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:25:15.762 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:25:15.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.762 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.763 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.763 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:25:15.763 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:25:15.763 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.763 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.763 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.763 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.763 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:15.763 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:15.763 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.488556174999999, 2024-04-19T04:25:15.763 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:15.763 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.763 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:15.764 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:15.764 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:15.764 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:15.764 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:15.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.764 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.764 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.764 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.764 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:15.764 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.764 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.764 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.764 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:15.764 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.765 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.765 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.765 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.765 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:15.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:15.765 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.765 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.765 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.765 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:15.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:15.765 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.765 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.765 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.765 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:15.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:15.766 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.766 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.766 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.766 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:15.766 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:15.766 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.766 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.766 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.766 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:15.766 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:15.766 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.766 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.766 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.766 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:15.767 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:15.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.767 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.767 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:15.767 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:15.767 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:15.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.767 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.767 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:15.767 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:15.767 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:15.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.767 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.767 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:15.767 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:15.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:15.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.768 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:15.768 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:15.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:15.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.768 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.768 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:15.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:15.768 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.768 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.768 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.769 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:15.769 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:15.769 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.485375018999999, 2024-04-19T04:25:15.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:15.769 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.769 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:15.769 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:15.769 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:15.769 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:15.769 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:15.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.769 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.769 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.770 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:15.770 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.770 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.770 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.770 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:15.770 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.770 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.770 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.770 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:15.770 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:15.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.771 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.771 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.771 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:15.771 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:15.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.771 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.771 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.771 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:15.771 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:15.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.771 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.771 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.771 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:15.771 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:15.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.772 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.772 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:15.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:15.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.772 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.772 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:15.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:15.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.772 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:15.772 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:15.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:15.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:15.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:15.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:15.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:15.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:15.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:15.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:15.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:15.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:15.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.774 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.774 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.774 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:15.774 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:15.774 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.774 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.774 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.774 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.774 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:15.774 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:15.774 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.484806915, 2024-04-19T04:25:15.774 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:15.774 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.775 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:15.775 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.775 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.775 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:15.775 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.775 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.775 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.775 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:15.775 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.775 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.775 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.775 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:15.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:15.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.776 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.776 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.776 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:15.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:15.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.776 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.776 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.776 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:15.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:15.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.776 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.776 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.777 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:15.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:15.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.777 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:15.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:15.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.777 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:15.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:15.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:15.778 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:15.778 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:15.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.778 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.778 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.778 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:15.778 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:15.778 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.778 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.778 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.778 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.778 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:15.778 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:15.779 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.484461253999999, 2024-04-19T04:25:15.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:15.779 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.779 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:15.779 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:15.779 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:15.779 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:15.779 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:15.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.779 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.779 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.779 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.779 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:15.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:15.780 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:15.780 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:15.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:15.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:15.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.781 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:15.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:15.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.781 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:15.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:15.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.781 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:15.782 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:15.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.782 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.782 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.782 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:15.782 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:15.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.782 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.782 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:15.782 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:15.782 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:15.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.782 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.783 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:15.783 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:15.783 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:15.783 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.783 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.783 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:15.783 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:15.783 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:15.783 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.783 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.783 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:15.783 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:15.783 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:15.783 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.784 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.784 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.784 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:15.784 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:15.784 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.784 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.784 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.784 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.784 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.785 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:15.785 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:15.785 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.483736816, 2024-04-19T04:25:15.785 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:15.785 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.785 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:15.785 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.785 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.785 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.785 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:15.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.786 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.786 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:15.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.786 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.786 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:15.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:15.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.786 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.787 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:15.787 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:15.787 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.787 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.787 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.787 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:15.787 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:15.787 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.787 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.787 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.787 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:15.787 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:15.787 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.787 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.787 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.788 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:15.788 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:15.788 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.788 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.788 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.788 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:15.788 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:15.788 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.788 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.788 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:15.788 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:15.788 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:15.788 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.788 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.788 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.789 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:15.789 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:15.789 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.789 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.789 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.789 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.789 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:15.789 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:15.789 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.483729421, 2024-04-19T04:25:15.789 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:15.789 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.789 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:15.789 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.789 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.790 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.790 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:15.790 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.790 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.790 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.790 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.790 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:15.790 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.790 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.790 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.790 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.790 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:15.790 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:15.790 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.791 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.791 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.791 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:15.791 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:15.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.791 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.791 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.791 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:15.791 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:15.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.791 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.791 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.791 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:15.791 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:15.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.792 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.792 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.792 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:15.792 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:15.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.792 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.792 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.792 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:15.792 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:15.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.792 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.792 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:15.792 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:15.792 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:15.793 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.793 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.793 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.793 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:15.793 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:15.793 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.793 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.793 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.793 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.793 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.793 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:15.793 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:15.793 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.481904274000001, 2024-04-19T04:25:15.793 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:15.794 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.794 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:15.794 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:15.794 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:15.794 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:15.794 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:15.794 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.794 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.794 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.794 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.794 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:15.795 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.795 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.795 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.795 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:15.795 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.795 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.795 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.795 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:15.795 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:15.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.795 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.795 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.795 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:15.796 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:15.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.796 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.796 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:15.796 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:15.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.796 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.796 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:15.796 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:15.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.796 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.796 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:15.797 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:15.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.797 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.797 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.797 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:15.797 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:15.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.797 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.797 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:15.797 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:15.797 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:15.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.797 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.797 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:15.797 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:15.798 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:15.798 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.798 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.798 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:15.798 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:15.798 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:15.798 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.798 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.798 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:15.798 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:15.798 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:15.798 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.798 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.798 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.799 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:15.799 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:15.799 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.799 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.799 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.799 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.799 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.799 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26148 5.9 e27/20 ondisk, result = 0)", 2024-04-19T04:25:15.799 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:15.799 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.481803949, 2024-04-19T04:25:15.799 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.042005175999999998, 2024-04-19T04:25:15.799 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.799 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:15.799 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.799 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.800 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.800 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:15.800 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.800 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.800 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.800 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.800 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:15.800 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.800 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.800 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.800 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.801 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238276+0000", 2024-04-19T04:25:15.801 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:15.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.801 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.801 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.801 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238280+0000", 2024-04-19T04:25:15.801 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6399999999999999e-06 2024-04-19T04:25:15.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.801 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.801 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.801 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238286+0000", 2024-04-19T04:25:15.801 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2099999999999998e-06 2024-04-19T04:25:15.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.801 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.802 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.802 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238290+0000", 2024-04-19T04:25:15.802 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2470000000000002e-06 2024-04-19T04:25:15.802 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.802 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.802 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.802 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239526+0000", 2024-04-19T04:25:15.802 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012362619999999999 2024-04-19T04:25:15.802 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.802 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.802 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.802 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239538+0000", 2024-04-19T04:25:15.802 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1620999999999999e-05 2024-04-19T04:25:15.802 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.803 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.803 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.803 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280282+0000", 2024-04-19T04:25:15.803 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040743691999999998 2024-04-19T04:25:15.803 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.803 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.803 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.803 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.803 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.803 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:15.803 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:15.803 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.481170069000001, 2024-04-19T04:25:15.803 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:15.803 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.803 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:15.804 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:15.804 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:15.804 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:15.804 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:15.804 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.804 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.804 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.804 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.804 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:15.804 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.804 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.804 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.804 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.804 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:15.804 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.805 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.805 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.805 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.805 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:15.805 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:15.805 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.805 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.805 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.805 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:15.805 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:15.805 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.805 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.805 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.805 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:15.806 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:15.806 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.806 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.806 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.806 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:15.806 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:15.806 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.806 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.806 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.806 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:15.807 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:15.807 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.807 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.807 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.807 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:15.807 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:15.807 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.808 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.808 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:15.808 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:15.808 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:15.808 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.808 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.809 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:15.809 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:15.809 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:15.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.809 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.809 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:15.809 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:15.809 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:15.810 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.810 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.810 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:15.810 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:15.810 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:15.810 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.810 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.810 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.811 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:15.811 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:15.811 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.811 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.811 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.811 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.811 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.811 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:15.812 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:15.812 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.480635793000001, 2024-04-19T04:25:15.812 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:15.812 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.812 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:15.812 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.813 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.813 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:15.813 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.813 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.813 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:15.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:15.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:15.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:15.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:15.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:15.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:15.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.816 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:15.816 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:15.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.817 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.817 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:15.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:15.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.818 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.818 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:15.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:15.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.818 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:15.818 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:15.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:15.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:15.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:15.819 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.819 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.820 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.820 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26160 5.f e27/20 ondisk, result = 0)", 2024-04-19T04:25:15.821 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:15.821 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.479520418, 2024-04-19T04:25:15.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039752357000000002, 2024-04-19T04:25:15.821 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.821 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:15.821 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:15.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:15.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240559+0000", 2024-04-19T04:25:15.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:15.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240569+0000", 2024-04-19T04:25:15.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7720000000000006e-06 2024-04-19T04:25:15.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280164+0000", 2024-04-19T04:25:15.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039595324000000001 2024-04-19T04:25:15.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280190+0000", 2024-04-19T04:25:15.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5692000000000001e-05 2024-04-19T04:25:15.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280287+0000", 2024-04-19T04:25:15.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7536999999999998e-05 2024-04-19T04:25:15.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280299+0000", 2024-04-19T04:25:15.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2057e-05 2024-04-19T04:25:15.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:15.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3244999999999999e-05 2024-04-19T04:25:15.827 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.827 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.827 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.828 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26179 5.3 e27/20 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head v 27'1624, mlcod=27'1621)", 2024-04-19T04:25:15.828 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:15.828 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.476366666000001, 2024-04-19T04:25:15.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039964081999999998, 2024-04-19T04:25:15.828 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.828 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:15.828 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:15.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:15.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243713+0000", 2024-04-19T04:25:15.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:15.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243750+0000", 2024-04-19T04:25:15.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6704e-05 2024-04-19T04:25:15.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280162+0000", 2024-04-19T04:25:15.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036412117000000001 2024-04-19T04:25:15.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280186+0000", 2024-04-19T04:25:15.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4825999999999999e-05 2024-04-19T04:25:15.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:15.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012540000000000001 2024-04-19T04:25:15.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280347+0000", 2024-04-19T04:25:15.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4894000000000002e-05 2024-04-19T04:25:15.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:15.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283654+0000", 2024-04-19T04:25:15.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00330716 2024-04-19T04:25:15.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283678+0000", 2024-04-19T04:25:15.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3992e-05 2024-04-19T04:25:15.835 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.835 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.835 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.835 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:67426 5.2 5:4aa7fb06:::benchmark_data_smithi007_19526_object67425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:15.836 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.503400+0000", 2024-04-19T04:25:15.836 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.21668083499999999, 2024-04-19T04:25:15.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026855061, 2024-04-19T04:25:15.836 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:15.836 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:15.836 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:15.836 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:15.836 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:15.837 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 67426 2024-04-19T04:25:15.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.837 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:15.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:15.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.503400+0000", 2024-04-19T04:25:15.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:15.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.503400+0000", 2024-04-19T04:25:15.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:15.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:15.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.503399+0000", 2024-04-19T04:25:15.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:15.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:15.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.503461+0000", 2024-04-19T04:25:15.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2426000000000002e-05 2024-04-19T04:25:15.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:15.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.503472+0000", 2024-04-19T04:25:15.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1199999999999999e-05 2024-04-19T04:25:15.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.503481+0000", 2024-04-19T04:25:15.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5790000000000004e-06 2024-04-19T04:25:15.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:15.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.505244+0000", 2024-04-19T04:25:15.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001763592 2024-04-19T04:25:15.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:15.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.505355+0000", 2024-04-19T04:25:15.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000110513 2024-04-19T04:25:15.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:15.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.505459+0000", 2024-04-19T04:25:15.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000104027 2024-04-19T04:25:15.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:15.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.509400+0000", 2024-04-19T04:25:15.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0039410390000000003 2024-04-19T04:25:15.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:15.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.530149+0000", 2024-04-19T04:25:15.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020749195000000002 2024-04-19T04:25:15.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:15.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.530212+0000", 2024-04-19T04:25:15.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3040999999999995e-05 2024-04-19T04:25:15.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:15.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:15.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:15.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.530255+0000", 2024-04-19T04:25:15.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2524999999999997e-05 2024-04-19T04:25:15.845 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.845 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.845 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.845 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:15.845 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:15.846 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:15.847 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 31 16 67807 67791 136.659 107.188 0.00795965 0.00731087 2024-04-19T04:25:15.848 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:15.846+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:15.849 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:15.948 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:15.942+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:15.961 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-04-19T04:25:15.975 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:15.975 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:15.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.975 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:15.975 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:15.975 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.024249245999999999, 2024-04-19T04:25:15.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024269369999999998, 2024-04-19T04:25:15.976 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:15.976 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for peered", 2024-04-19T04:25:15.976 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:15.976 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:15.976 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:15.976 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:15.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.976 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:15.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:15.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:15.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:15.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:15.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:15.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:15.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:15.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:15.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:15.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:15.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:15.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:15.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:15.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:15.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:15.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:15.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:15.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:15.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:15.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:15.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:15.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:15.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:15.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:15.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:15.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:15.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:15.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:15.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:15.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:15.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:15.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:15.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:15.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:15.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:15.981 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:15.981 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:15.981 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:15.981 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.981 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:15.981 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:15.981 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.019187599999999999, 2024-04-19T04:25:15.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019268799999999999, 2024-04-19T04:25:15.981 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:15.981 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for peered", 2024-04-19T04:25:15.981 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:15.981 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:15.982 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:15.982 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:15.982 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.982 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:15.982 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.982 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:15.982 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:15.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:15.982 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.982 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.982 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:15.982 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:15.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:15.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:15.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:15.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:15.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:15.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:15.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:15.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:15.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:15.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:15.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:15.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:15.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:15.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:15.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:15.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:15.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:15.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:15.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:15.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:15.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:15.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:15.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:15.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:15.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:15.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:15.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:15.986 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:15.986 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:15.986 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:15.986 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.986 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.986 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:15.986 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:15.986 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.019087687999999998, 2024-04-19T04:25:15.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019220984999999999, 2024-04-19T04:25:15.986 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:15.986 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for peered", 2024-04-19T04:25:15.986 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:15.986 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:15.986 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:15.987 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:15.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.987 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:15.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:15.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:15.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:15.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:15.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:15.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:15.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:15.988 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:15.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:15.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.988 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:15.988 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:15.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:15.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.988 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:15.988 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:15.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:15.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.988 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.989 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:15.989 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:15.989 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.989 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.989 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:15.989 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:15.989 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:15.989 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.989 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.989 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:15.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:15.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:15.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:15.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:15.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:15.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:15.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:15.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:15.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:15.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:15.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:15.991 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:15.991 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:15.991 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:15.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.991 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:15.991 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:15.991 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.018961934999999999, 2024-04-19T04:25:15.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019144906, 2024-04-19T04:25:15.991 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:15.991 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for peered", 2024-04-19T04:25:15.991 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:15.991 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:15.992 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:15.992 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:15.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.992 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:15.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:15.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:15.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:15.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:15.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:15.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:15.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:15.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:15.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:15.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:15.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:15.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:15.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:15.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:15.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:15.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.994 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.994 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:15.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:15.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.994 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:15.994 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:15.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:15.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.994 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:15.994 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:15.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:15.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:15.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:15.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:15.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:15.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:15.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:15.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:15.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:15.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:15.996 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:15.996 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:15.996 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:15.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.996 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5.42715deb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:15.996 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:15.996 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.01511799, 2024-04-19T04:25:15.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015347499000000001, 2024-04-19T04:25:15.996 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:15.996 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for peered", 2024-04-19T04:25:15.996 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:15.996 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:15.996 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:15.996 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:15.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.997 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:15.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:15.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:15.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:15.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:15.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:15.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:15.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:15.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:15.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:15.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:15.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:15.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:15.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:15.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:15.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:15.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:15.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:15.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:15.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:15.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:15.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:15.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:16.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:16.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:16.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:16.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:16.000 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.000 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.000 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.000 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5.78566714 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:16.000 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:16.000 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0079468890000000004, 2024-04-19T04:25:16.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082136819999999999, 2024-04-19T04:25:16.001 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.001 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for peered", 2024-04-19T04:25:16.001 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.001 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.001 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.001 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:16.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.001 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:16.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:16.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:16.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:16.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:16.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:16.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:16.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:16.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:16.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:16.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:16.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:16.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:16.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:16.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:16.004 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.004 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.004 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.005 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5.79bb65f4 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:16.005 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:16.005 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0077747850000000002, 2024-04-19T04:25:16.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080796779999999999, 2024-04-19T04:25:16.005 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.005 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for peered", 2024-04-19T04:25:16.005 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.005 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.006 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.006 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:16.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.006 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:16.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:16.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:16.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:16.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:16.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:16.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:16.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:16.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:16.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:16.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:16.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:16.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:16.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:16.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:16.009 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.009 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.009 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.009 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5.ba68ba64 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:16.009 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:16.009 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0077116600000000004, 2024-04-19T04:25:16.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080525670000000001, 2024-04-19T04:25:16.009 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.009 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for peered", 2024-04-19T04:25:16.009 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.010 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.010 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.010 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:16.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.010 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:16.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:16.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:16.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:16.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:16.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:16.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:16.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:16.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:16.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:16.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:16.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:16.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:16.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:16.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:16.013 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.013 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.013 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.013 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5.b1e4325a (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:16.013 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:16.013 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0075830630000000001, 2024-04-19T04:25:16.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079600390000000004, 2024-04-19T04:25:16.013 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.013 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for peered", 2024-04-19T04:25:16.013 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.013 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.014 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.014 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:16.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.014 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:16.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:16.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:16.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:16.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:16.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:16.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:16.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:16.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:16.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:16.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:16.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:16.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:16.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:16.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:16.016 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.016 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.017 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.017 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5.dee9bf6a (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:16.017 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:16.017 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0075150920000000001, 2024-04-19T04:25:16.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079281449999999993, 2024-04-19T04:25:16.017 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.017 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for peered", 2024-04-19T04:25:16.017 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.017 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.017 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.017 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:16.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.017 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.018 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:16.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.018 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:16.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:16.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:16.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:16.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:16.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:16.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:16.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:16.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:16.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:16.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:16.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:16.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:16.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:16.020 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.021 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.021 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.021 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.021 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:16.021 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 10 2024-04-19T04:25:16.021 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:16.022 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:16.050 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:16.050+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:16.129 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T04:25:16.140 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:16.141 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:16.141 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:16.141 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:16.141 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:16.141 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:16.150 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:16.150+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:16.242 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-04-19T04:25:16.251 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:16.250+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:16.253 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:16.253 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:16.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:16.253 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:16.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.253 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:16.253 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:16.253 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.014535214999999, 2024-04-19T04:25:16.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:16.253 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.254 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.254 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.255 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.255 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.255 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:16.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.255 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:16.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:16.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:16.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:16.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:16.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:16.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:16.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:16.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:16.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:16.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:16.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:16.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:16.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:16.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:16.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:16.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:16.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:16.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:16.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:16.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:16.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:16.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:16.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:16.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:16.260 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.260 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.260 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.260 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:16.261 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:16.261 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.010086299000001, 2024-04-19T04:25:16.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:16.261 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.261 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.261 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.261 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.261 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.261 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:16.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.261 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:16.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:16.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:16.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:16.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:16.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:16.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:16.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:16.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:16.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:16.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:16.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:16.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:16.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:16.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:16.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:16.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:16.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:16.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:16.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:16.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:16.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:16.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:16.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:16.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:16.268 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.268 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.268 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.268 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:36969 5.0 5:07a2d04d:::benchmark_data_smithi007_19526_object36968:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T04:25:16.268 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:59.838646+0000", 2024-04-19T04:25:16.268 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.411420153000002, 2024-04-19T04:25:16.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019867078999999999, 2024-04-19T04:25:16.268 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.269 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.269 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.269 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.269 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.269 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 36969 2024-04-19T04:25:16.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.269 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838646+0000", 2024-04-19T04:25:16.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838646+0000", 2024-04-19T04:25:16.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838645+0000", 2024-04-19T04:25:16.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838725+0000", 2024-04-19T04:25:16.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0295000000000003e-05 2024-04-19T04:25:16.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838734+0000", 2024-04-19T04:25:16.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6319999999999997e-06 2024-04-19T04:25:16.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.838739+0000", 2024-04-19T04:25:16.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4249999999999997e-06 2024-04-19T04:25:16.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.843505+0000", 2024-04-19T04:25:16.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047651689999999997 2024-04-19T04:25:16.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.843611+0000", 2024-04-19T04:25:16.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010608899999999999 2024-04-19T04:25:16.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.843699+0000", 2024-04-19T04:25:16.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7841000000000001e-05 2024-04-19T04:25:16.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.846376+0000", 2024-04-19T04:25:16.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002677867 2024-04-19T04:25:16.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.858355+0000", 2024-04-19T04:25:16.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011978999000000001 2024-04-19T04:25:16.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.858443+0000", 2024-04-19T04:25:16.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7243000000000005e-05 2024-04-19T04:25:16.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:59.858513+0000", 2024-04-19T04:25:16.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0235999999999996e-05 2024-04-19T04:25:16.274 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.274 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.274 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.274 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:43351 5.0 5:0f5ecfc6:::benchmark_data_smithi007_19526_object43350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T04:25:16.275 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:02.801106+0000", 2024-04-19T04:25:16.275 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.448959855, 2024-04-19T04:25:16.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021198346999999999, 2024-04-19T04:25:16.275 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.275 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.275 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.275 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.275 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.275 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 43351 2024-04-19T04:25:16.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.276 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801106+0000", 2024-04-19T04:25:16.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801106+0000", 2024-04-19T04:25:16.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801105+0000", 2024-04-19T04:25:16.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:16.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801159+0000", 2024-04-19T04:25:16.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4181999999999997e-05 2024-04-19T04:25:16.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801174+0000", 2024-04-19T04:25:16.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5021000000000001e-05 2024-04-19T04:25:16.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.801182+0000", 2024-04-19T04:25:16.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7649999999999993e-06 2024-04-19T04:25:16.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.809365+0000", 2024-04-19T04:25:16.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081836159999999995 2024-04-19T04:25:16.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.809463+0000", 2024-04-19T04:25:16.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7486999999999997e-05 2024-04-19T04:25:16.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.809549+0000", 2024-04-19T04:25:16.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5729999999999994e-05 2024-04-19T04:25:16.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.814132+0000", 2024-04-19T04:25:16.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045836039999999998 2024-04-19T04:25:16.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.822206+0000", 2024-04-19T04:25:16.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080738500000000005 2024-04-19T04:25:16.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.822255+0000", 2024-04-19T04:25:16.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8730000000000003e-05 2024-04-19T04:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:02.822304+0000", 2024-04-19T04:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.973e-05 2024-04-19T04:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:53388 5.0 5:01d29fef:::benchmark_data_smithi007_19526_object53387:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T04:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:07.820792+0000", 2024-04-19T04:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.4292740879999997, 2024-04-19T04:25:16.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020513581999999999, 2024-04-19T04:25:16.282 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.282 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.282 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.282 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.282 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.282 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 53388 2024-04-19T04:25:16.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.282 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.820792+0000", 2024-04-19T04:25:16.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.820792+0000", 2024-04-19T04:25:16.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.820791+0000", 2024-04-19T04:25:16.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.820928+0000", 2024-04-19T04:25:16.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000136868 2024-04-19T04:25:16.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.820935+0000", 2024-04-19T04:25:16.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7259999999999996e-06 2024-04-19T04:25:16.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.820939+0000", 2024-04-19T04:25:16.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6240000000000001e-06 2024-04-19T04:25:16.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.827186+0000", 2024-04-19T04:25:16.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0062470609999999999 2024-04-19T04:25:16.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.827291+0000", 2024-04-19T04:25:16.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000104805 2024-04-19T04:25:16.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.827395+0000", 2024-04-19T04:25:16.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000104205 2024-04-19T04:25:16.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.832315+0000", 2024-04-19T04:25:16.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049199049999999996 2024-04-19T04:25:16.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.841158+0000", 2024-04-19T04:25:16.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088432739999999999 2024-04-19T04:25:16.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.841243+0000", 2024-04-19T04:25:16.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4655999999999997e-05 2024-04-19T04:25:16.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:07.841305+0000", 2024-04-19T04:25:16.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2324999999999997e-05 2024-04-19T04:25:16.288 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.288 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.288 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.288 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:59645 5.e 5:7601d3a3:::benchmark_data_smithi007_19526_object59644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T04:25:16.288 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:11.169080+0000", 2024-04-19T04:25:16.288 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.0809854850000002, 2024-04-19T04:25:16.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020340757000000001, 2024-04-19T04:25:16.288 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.288 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.288 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.288 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.289 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.289 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 59645 2024-04-19T04:25:16.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.289 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.169080+0000", 2024-04-19T04:25:16.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.169080+0000", 2024-04-19T04:25:16.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.169080+0000", 2024-04-19T04:25:16.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.169155+0000", 2024-04-19T04:25:16.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5130999999999996e-05 2024-04-19T04:25:16.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.169176+0000", 2024-04-19T04:25:16.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0763000000000001e-05 2024-04-19T04:25:16.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.169199+0000", 2024-04-19T04:25:16.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3742000000000001e-05 2024-04-19T04:25:16.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.175900+0000", 2024-04-19T04:25:16.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0067002049999999999 2024-04-19T04:25:16.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.176060+0000", 2024-04-19T04:25:16.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016083300000000001 2024-04-19T04:25:16.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.176288+0000", 2024-04-19T04:25:16.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000227944 2024-04-19T04:25:16.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.183739+0000", 2024-04-19T04:25:16.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074506290000000003 2024-04-19T04:25:16.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.189249+0000", 2024-04-19T04:25:16.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055097719999999996 2024-04-19T04:25:16.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.189344+0000", 2024-04-19T04:25:16.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5055000000000004e-05 2024-04-19T04:25:16.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:11.189421+0000", 2024-04-19T04:25:16.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7465000000000005e-05 2024-04-19T04:25:16.294 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.294 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.294 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.294 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63058 5.b 5:d15847b4:::benchmark_data_smithi007_19526_object63057:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:16.294 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067550+0000", 2024-04-19T04:25:16.294 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.1825155760000001, 2024-04-19T04:25:16.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018735424000000001, 2024-04-19T04:25:16.294 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.295 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.295 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.295 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.295 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.295 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63058 2024-04-19T04:25:16.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.295 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067550+0000", 2024-04-19T04:25:16.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067550+0000", 2024-04-19T04:25:16.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067549+0000", 2024-04-19T04:25:16.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067663+0000", 2024-04-19T04:25:16.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011321 2024-04-19T04:25:16.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067672+0000", 2024-04-19T04:25:16.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2180000000000005e-06 2024-04-19T04:25:16.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067677+0000", 2024-04-19T04:25:16.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4550000000000003e-06 2024-04-19T04:25:16.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.072609+0000", 2024-04-19T04:25:16.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049318280000000001 2024-04-19T04:25:16.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.072852+0000", 2024-04-19T04:25:16.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00024240500000000001 2024-04-19T04:25:16.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.073088+0000", 2024-04-19T04:25:16.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023648399999999999 2024-04-19T04:25:16.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078251+0000", 2024-04-19T04:25:16.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051629969999999999 2024-04-19T04:25:16.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.086161+0000", 2024-04-19T04:25:16.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079094669999999999 2024-04-19T04:25:16.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.086226+0000", 2024-04-19T04:25:16.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5055999999999995e-05 2024-04-19T04:25:16.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.086286+0000", 2024-04-19T04:25:16.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0205999999999999e-05 2024-04-19T04:25:16.300 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.300 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.300 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.300 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:16.300 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:16.300 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.1821540559999999, 2024-04-19T04:25:16.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:16.300 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.300 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.300 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.301 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.301 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.301 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:16.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.301 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:16.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:16.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:16.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:16.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:16.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:16.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:16.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:16.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:16.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:16.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:16.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:16.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:16.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:16.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:16.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:16.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:16.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:16.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:16.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:16.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:16.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:16.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:16.306 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.306 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.306 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.307 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63077 5.e 5:75bbd923:::benchmark_data_smithi007_19526_object63076:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:16.307 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.078536+0000", 2024-04-19T04:25:16.307 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.1715301729999998, 2024-04-19T04:25:16.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019146983999999999, 2024-04-19T04:25:16.307 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.307 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.307 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.307 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.307 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.307 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63077 2024-04-19T04:25:16.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.307 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078536+0000", 2024-04-19T04:25:16.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078536+0000", 2024-04-19T04:25:16.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078535+0000", 2024-04-19T04:25:16.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078571+0000", 2024-04-19T04:25:16.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6705999999999997e-05 2024-04-19T04:25:16.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078581+0000", 2024-04-19T04:25:16.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6930000000000002e-06 2024-04-19T04:25:16.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078597+0000", 2024-04-19T04:25:16.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5515e-05 2024-04-19T04:25:16.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078654+0000", 2024-04-19T04:25:16.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7258e-05 2024-04-19T04:25:16.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078830+0000", 2024-04-19T04:25:16.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017595100000000001 2024-04-19T04:25:16.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078968+0000", 2024-04-19T04:25:16.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013772900000000001 2024-04-19T04:25:16.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.083980+0000", 2024-04-19T04:25:16.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050123549999999996 2024-04-19T04:25:16.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.097501+0000", 2024-04-19T04:25:16.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013521307999999999 2024-04-19T04:25:16.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.097622+0000", 2024-04-19T04:25:16.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120431 2024-04-19T04:25:16.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.097683+0000", 2024-04-19T04:25:16.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1094999999999997e-05 2024-04-19T04:25:16.314 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.314 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.314 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.314 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63378 5.b 5:d5d2e284:::benchmark_data_smithi007_19526_object63377:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:16.314 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.251594+0000", 2024-04-19T04:25:16.314 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 2.9984716580000002, 2024-04-19T04:25:16.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019131999, 2024-04-19T04:25:16.315 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.315 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.315 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.315 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.315 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.315 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63378 2024-04-19T04:25:16.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.315 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.251594+0000", 2024-04-19T04:25:16.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.251594+0000", 2024-04-19T04:25:16.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.251593+0000", 2024-04-19T04:25:16.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.251684+0000", 2024-04-19T04:25:16.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0513999999999994e-05 2024-04-19T04:25:16.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.251701+0000", 2024-04-19T04:25:16.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6928000000000001e-05 2024-04-19T04:25:16.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.251711+0000", 2024-04-19T04:25:16.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0457e-05 2024-04-19T04:25:16.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.251771+0000", 2024-04-19T04:25:16.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9691000000000002e-05 2024-04-19T04:25:16.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.251954+0000", 2024-04-19T04:25:16.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018263099999999999 2024-04-19T04:25:16.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.252147+0000", 2024-04-19T04:25:16.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000193265 2024-04-19T04:25:16.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.258487+0000", 2024-04-19T04:25:16.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006340455 2024-04-19T04:25:16.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.270634+0000", 2024-04-19T04:25:16.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012146278 2024-04-19T04:25:16.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.270689+0000", 2024-04-19T04:25:16.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5485000000000002e-05 2024-04-19T04:25:16.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.270726+0000", 2024-04-19T04:25:16.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7255000000000002e-05 2024-04-19T04:25:16.323 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.323 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.324 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.324 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:16.324 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:16.324 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.74630001899999998, 2024-04-19T04:25:16.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:16.324 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.324 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.324 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.324 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.324 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.324 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:16.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.325 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:16.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:16.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:16.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:16.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:16.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:16.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:16.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:16.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:16.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:16.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:16.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:16.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:16.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:16.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:16.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:16.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:16.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:16.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:16.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:16.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:16.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:16.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:16.330 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.330 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.330 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.331 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:16.331 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:16.331 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.74586959900000005, 2024-04-19T04:25:16.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:16.331 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.331 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.331 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.331 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.331 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.331 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:16.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.331 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:16.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:16.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:16.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:16.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:16.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:16.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:16.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:16.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:16.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:16.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:16.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:16.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:16.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:16.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:16.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:16.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:16.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:16.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:16.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:16.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:16.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:16.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:16.336 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.336 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.336 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.336 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:16.336 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:16.336 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.74363833499999998, 2024-04-19T04:25:16.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:16.336 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.336 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.336 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.337 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.337 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.337 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:16.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.337 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:16.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:16.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:16.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:16.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:16.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:16.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:16.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:16.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:16.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:16.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:16.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:16.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:16.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:16.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:16.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:16.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:16.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:16.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:16.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:16.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:16.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:16.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:16.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:16.341 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.341 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.342 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.342 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:16.342 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:16.342 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.74024129699999996, 2024-04-19T04:25:16.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:16.342 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.342 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.342 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.342 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.342 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.342 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:16.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.343 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:16.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:16.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:16.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:16.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:16.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:16.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:16.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:16.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:16.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:16.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:16.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:16.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:16.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:16.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:16.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:16.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:16.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:16.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:16.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:16.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:16.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:16.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:16.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:16.347 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.347 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.347 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.347 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:16.347 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:16.347 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.73511309899999999, 2024-04-19T04:25:16.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:16.348 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.348 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.348 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.348 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.348 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.348 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:16.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.348 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:16.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:16.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:16.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:16.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:16.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:16.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:16.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:16.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:16.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:16.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:16.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:16.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:16.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:16.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:16.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:16.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:16.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:16.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:16.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:16.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:16.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:16.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:16.352 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.352 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.353 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.353 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67567 5.0 5:0bc0424d:::benchmark_data_smithi007_19526_object67566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:16.353 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.601575+0000", 2024-04-19T04:25:16.353 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.64849057499999996, 2024-04-19T04:25:16.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018928486000000001, 2024-04-19T04:25:16.353 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.353 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.353 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.353 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.353 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.353 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67567 2024-04-19T04:25:16.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.601575+0000", 2024-04-19T04:25:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.601575+0000", 2024-04-19T04:25:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.601574+0000", 2024-04-19T04:25:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.601691+0000", 2024-04-19T04:25:16.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011639899999999999 2024-04-19T04:25:16.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.601707+0000", 2024-04-19T04:25:16.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6288000000000001e-05 2024-04-19T04:25:16.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.601714+0000", 2024-04-19T04:25:16.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.357e-06 2024-04-19T04:25:16.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.604413+0000", 2024-04-19T04:25:16.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002698279 2024-04-19T04:25:16.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.604537+0000", 2024-04-19T04:25:16.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124797 2024-04-19T04:25:16.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.604675+0000", 2024-04-19T04:25:16.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013789499999999999 2024-04-19T04:25:16.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.614168+0000", 2024-04-19T04:25:16.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0094926980000000008 2024-04-19T04:25:16.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.620380+0000", 2024-04-19T04:25:16.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0062124859999999997 2024-04-19T04:25:16.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.620450+0000", 2024-04-19T04:25:16.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9518999999999996e-05 2024-04-19T04:25:16.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.620504+0000", 2024-04-19T04:25:16.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3950999999999999e-05 2024-04-19T04:25:16.358 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.358 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.358 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.358 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67652 5.b 5:d78042d4:::benchmark_data_smithi007_19526_object67651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:16.358 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.656252+0000", 2024-04-19T04:25:16.358 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.59381409600000001, 2024-04-19T04:25:16.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019039851999999999, 2024-04-19T04:25:16.358 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.359 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.359 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.359 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.359 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.359 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67652 2024-04-19T04:25:16.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.359 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.656252+0000", 2024-04-19T04:25:16.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.656252+0000", 2024-04-19T04:25:16.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.656250+0000", 2024-04-19T04:25:16.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:16.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.656381+0000", 2024-04-19T04:25:16.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000130736 2024-04-19T04:25:16.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.656399+0000", 2024-04-19T04:25:16.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7456e-05 2024-04-19T04:25:16.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.656414+0000", 2024-04-19T04:25:16.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5003e-05 2024-04-19T04:25:16.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.656470+0000", 2024-04-19T04:25:16.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6706999999999998e-05 2024-04-19T04:25:16.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.656585+0000", 2024-04-19T04:25:16.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000115096 2024-04-19T04:25:16.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.656695+0000", 2024-04-19T04:25:16.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000109616 2024-04-19T04:25:16.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.666311+0000", 2024-04-19T04:25:16.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096165109999999995 2024-04-19T04:25:16.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.675204+0000", 2024-04-19T04:25:16.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088922089999999999 2024-04-19T04:25:16.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.675256+0000", 2024-04-19T04:25:16.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2092999999999997e-05 2024-04-19T04:25:16.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.675292+0000", 2024-04-19T04:25:16.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5916e-05 2024-04-19T04:25:16.363 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.363 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.363 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.364 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:16.364 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:16.364 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.42108459399999998, 2024-04-19T04:25:16.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:16.364 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.364 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.364 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.364 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.364 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.364 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:16.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.364 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:16.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:16.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:16.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:16.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:16.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:16.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:16.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:16.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:16.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:16.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:16.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:16.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:16.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:16.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:16.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:16.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:16.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:16.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:16.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:16.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:16.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:16.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:16.369 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.369 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.369 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.369 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67949 5.b 5:d725bcef:::benchmark_data_smithi007_19526_object67948:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:16.369 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:16.369 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.417966316, 2024-04-19T04:25:16.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022537248999999999, 2024-04-19T04:25:16.369 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.369 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.369 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.369 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.369 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.370 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67949 2024-04-19T04:25:16.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.370 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:16.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:16.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832099+0000", 2024-04-19T04:25:16.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832148+0000", 2024-04-19T04:25:16.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9517e-05 2024-04-19T04:25:16.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832154+0000", 2024-04-19T04:25:16.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5319999999999997e-06 2024-04-19T04:25:16.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832158+0000", 2024-04-19T04:25:16.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9099999999999998e-06 2024-04-19T04:25:16.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.833836+0000", 2024-04-19T04:25:16.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001678817 2024-04-19T04:25:16.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834007+0000", 2024-04-19T04:25:16.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000170151 2024-04-19T04:25:16.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834238+0000", 2024-04-19T04:25:16.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023146700000000001 2024-04-19T04:25:16.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.839447+0000", 2024-04-19T04:25:16.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005209272 2024-04-19T04:25:16.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854573+0000", 2024-04-19T04:25:16.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015125945 2024-04-19T04:25:16.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854607+0000", 2024-04-19T04:25:16.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3782000000000003e-05 2024-04-19T04:25:16.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854637+0000", 2024-04-19T04:25:16.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9827000000000001e-05 2024-04-19T04:25:16.374 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.374 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.374 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.374 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68062 5.b 5:dfa1dcc3:::benchmark_data_smithi007_19526_object68061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:16.374 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.910515+0000", 2024-04-19T04:25:16.374 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.33955105000000002, 2024-04-19T04:25:16.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019820850000000001, 2024-04-19T04:25:16.375 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:16.375 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.375 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:16.375 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:16.375 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.375 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68062 2024-04-19T04:25:16.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.375 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:16.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:16.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.910515+0000", 2024-04-19T04:25:16.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:16.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.910515+0000", 2024-04-19T04:25:16.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:16.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:16.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.910514+0000", 2024-04-19T04:25:16.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:16.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:16.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.910587+0000", 2024-04-19T04:25:16.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3318999999999994e-05 2024-04-19T04:25:16.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:16.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.910600+0000", 2024-04-19T04:25:16.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2717e-05 2024-04-19T04:25:16.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.910608+0000", 2024-04-19T04:25:16.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2239999999999995e-06 2024-04-19T04:25:16.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:16.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.910653+0000", 2024-04-19T04:25:16.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4935000000000003e-05 2024-04-19T04:25:16.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:16.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.910768+0000", 2024-04-19T04:25:16.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011491 2024-04-19T04:25:16.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.910875+0000", 2024-04-19T04:25:16.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107129 2024-04-19T04:25:16.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:16.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.914333+0000", 2024-04-19T04:25:16.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034580840000000002 2024-04-19T04:25:16.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.930258+0000", 2024-04-19T04:25:16.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015925192000000001 2024-04-19T04:25:16.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:16.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.930297+0000", 2024-04-19T04:25:16.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9359e-05 2024-04-19T04:25:16.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:16.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:16.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:16.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.930336+0000", 2024-04-19T04:25:16.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8282999999999999e-05 2024-04-19T04:25:16.380 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.380 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.380 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.380 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:16.380 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:16.380 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:16.381 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:16.382 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:16.382+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:16.483 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:16.478+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:16.501 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:16.501 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:16.501 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.501 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:16.501 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:16.501 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.54476848899999997, 2024-04-19T04:25:16.501 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.544822531, 2024-04-19T04:25:16.501 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.501 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for peered", 2024-04-19T04:25:16.501 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:16.501 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:16.502 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.502 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:16.502 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.502 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.502 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.502 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.502 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:16.502 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.502 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.502 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.502 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.502 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:16.502 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.503 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.503 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.503 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.503 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:16.503 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:16.503 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.503 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.503 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.503 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:16.503 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:16.504 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.504 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.504 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.504 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:16.504 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:16.504 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.504 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.504 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.504 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:16.504 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:16.504 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.505 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.505 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.505 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:16.505 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:16.505 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.506 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.506 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.506 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:16.506 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:16.506 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.507 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.507 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.507 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:16.507 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:16.507 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.507 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:16.509 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:16.509 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:16.509 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.509 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.509 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.509 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.509 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.509 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5.278dd336 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:16.510 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:16.510 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.52453804000000004, 2024-04-19T04:25:16.510 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.52473719900000004, 2024-04-19T04:25:16.510 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.510 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for peered", 2024-04-19T04:25:16.510 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:16.510 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:16.513 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:16.513 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.513 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.513 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.513 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:16.513 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:16.513 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.513 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.514 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.514 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:16.514 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:16.514 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.514 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.514 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:16.514 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:16.514 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:16.514 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.514 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5.fb2bd5cc (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.52443018299999999, 2024-04-19T04:25:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.52472560000000001, 2024-04-19T04:25:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for peered", 2024-04-19T04:25:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5.18280977 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.52246349400000003, 2024-04-19T04:25:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.52285385500000003, 2024-04-19T04:25:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for peered", 2024-04-19T04:25:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.521 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:16.521 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:16.521 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.521 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.521 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.521 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:16.521 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:16.521 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.521 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.521 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.521 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:16.522 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:16.522 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.522 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.522 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.522 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:16.522 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:16.522 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.522 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.522 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.522 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5.97f1f451 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.51909929899999996, 2024-04-19T04:25:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.51958120799999996, 2024-04-19T04:25:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for peered", 2024-04-19T04:25:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5.78c1ae01 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.51528832099999999, 2024-04-19T04:25:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.51586176500000003, 2024-04-19T04:25:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for peered", 2024-04-19T04:25:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:16.530 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.530 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.530 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.530 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.530 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:16.530 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:16.530 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.530 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.530 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.530 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:16.530 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:16.530 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.530 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.531 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.531 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:16.531 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:16.531 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.531 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.531 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.531 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:16.531 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:16.531 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.531 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.531 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:16.531 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:16.531 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:16.531 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.532 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.532 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.532 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.532 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:16.532 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 6 2024-04-19T04:25:16.532 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:16.533 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:16.584 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:16.578+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:16.641 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:16.641 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:16.641 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:16.641 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:16.641 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:16.650 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:16.685 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:16.682+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:16.754 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 32 16 68152 68136 133.062 21.5625 0.00338892 0.00732374 2024-04-19T04:25:16.786 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:16.782+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:16.809 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:16.809 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:16.809 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:16.809 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:16.809 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.809 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:16.809 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:16.810 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 56.272733703999997, 2024-04-19T04:25:16.810 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026864505, 2024-04-19T04:25:16.810 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.810 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.810 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.810 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.810 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.810 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:16.810 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.810 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.810 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.810 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.810 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533813+0000", 2024-04-19T04:25:16.811 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.811 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.811 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.811 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.811 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533812+0000", 2024-04-19T04:25:16.811 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.811 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.811 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.811 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.811 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533818+0000", 2024-04-19T04:25:16.811 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2369999999999997e-06 2024-04-19T04:25:16.811 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.812 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.812 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.812 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533863+0000", 2024-04-19T04:25:16.812 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4515000000000003e-05 2024-04-19T04:25:16.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.812 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.812 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.812 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533880+0000", 2024-04-19T04:25:16.812 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7119e-05 2024-04-19T04:25:16.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.812 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.813 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.813 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534029+0000", 2024-04-19T04:25:16.813 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014955099999999999 2024-04-19T04:25:16.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.813 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:16.813 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534034+0000", 2024-04-19T04:25:16.813 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1649999999999997e-06 2024-04-19T04:25:16.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.813 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.813 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554888+0000", 2024-04-19T04:25:16.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020854075 2024-04-19T04:25:16.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.554967+0000", 2024-04-19T04:25:16.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8209999999999998e-05 2024-04-19T04:25:16.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:16.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.555087+0000", 2024-04-19T04:25:16.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000120411 2024-04-19T04:25:16.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:16.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559328+0000", 2024-04-19T04:25:16.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042409800000000001 2024-04-19T04:25:16.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560587+0000", 2024-04-19T04:25:16.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012587119999999999 2024-04-19T04:25:16.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:16.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560620+0000", 2024-04-19T04:25:16.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2716999999999999e-05 2024-04-19T04:25:16.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.816 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.560677+0000", 2024-04-19T04:25:16.816 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7726999999999998e-05 2024-04-19T04:25:16.816 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.816 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.816 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.816 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:16.816 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:16.816 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 56.272651310999997, 2024-04-19T04:25:16.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027363064999999999, 2024-04-19T04:25:16.817 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.817 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.817 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.817 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.817 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:16.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.817 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.817 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533895+0000", 2024-04-19T04:25:16.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.818 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.818 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533894+0000", 2024-04-19T04:25:16.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:16.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.818 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.818 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533913+0000", 2024-04-19T04:25:16.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8896e-05 2024-04-19T04:25:16.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.818 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533933+0000", 2024-04-19T04:25:16.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9775e-05 2024-04-19T04:25:16.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533967+0000", 2024-04-19T04:25:16.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4536000000000003e-05 2024-04-19T04:25:16.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:16.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013553600000000001 2024-04-19T04:25:16.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:16.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534107+0000", 2024-04-19T04:25:16.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1470000000000003e-06 2024-04-19T04:25:16.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556463+0000", 2024-04-19T04:25:16.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.022356536999999999 2024-04-19T04:25:16.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556586+0000", 2024-04-19T04:25:16.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122967 2024-04-19T04:25:16.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:16.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.556738+0000", 2024-04-19T04:25:16.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015182800000000001 2024-04-19T04:25:16.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561020+0000", 2024-04-19T04:25:16.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042818819999999999 2024-04-19T04:25:16.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:16.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561183+0000", 2024-04-19T04:25:16.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000162683 2024-04-19T04:25:16.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:16.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561226+0000", 2024-04-19T04:25:16.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3686000000000002e-05 2024-04-19T04:25:16.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561258+0000", 2024-04-19T04:25:16.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1814999999999999e-05 2024-04-19T04:25:16.824 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.824 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.824 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.824 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:16.824 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:16.824 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 56.272560798000001, 2024-04-19T04:25:16.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.027417816000000001, 2024-04-19T04:25:16.825 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.825 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.825 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:16.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533986+0000", 2024-04-19T04:25:16.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533984+0000", 2024-04-19T04:25:16.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:16.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.533998+0000", 2024-04-19T04:25:16.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3876000000000001e-05 2024-04-19T04:25:16.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534015+0000", 2024-04-19T04:25:16.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6818999999999999e-05 2024-04-19T04:25:16.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534030+0000", 2024-04-19T04:25:16.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.537e-05 2024-04-19T04:25:16.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534152+0000", 2024-04-19T04:25:16.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121685 2024-04-19T04:25:16.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:16.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534156+0000", 2024-04-19T04:25:16.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9029999999999997e-06 2024-04-19T04:25:16.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557520+0000", 2024-04-19T04:25:16.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.023364125999999999 2024-04-19T04:25:16.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557585+0000", 2024-04-19T04:25:16.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5275000000000001e-05 2024-04-19T04:25:16.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:16.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.557719+0000", 2024-04-19T04:25:16.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013396299999999999 2024-04-19T04:25:16.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561133+0000", 2024-04-19T04:25:16.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034140989999999999 2024-04-19T04:25:16.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:16.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561352+0000", 2024-04-19T04:25:16.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0002185 2024-04-19T04:25:16.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:16.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561380+0000", 2024-04-19T04:25:16.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8317999999999999e-05 2024-04-19T04:25:16.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561403+0000", 2024-04-19T04:25:16.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3264999999999998e-05 2024-04-19T04:25:16.832 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.832 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.833 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.833 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:16.833 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:16.833 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 56.272497153000003, 2024-04-19T04:25:16.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029897119999999999, 2024-04-19T04:25:16.833 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.833 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.833 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:16.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534049+0000", 2024-04-19T04:25:16.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534048+0000", 2024-04-19T04:25:16.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534057+0000", 2024-04-19T04:25:16.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7930000000000003e-06 2024-04-19T04:25:16.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534075+0000", 2024-04-19T04:25:16.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7846000000000002e-05 2024-04-19T04:25:16.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534089+0000", 2024-04-19T04:25:16.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4463e-05 2024-04-19T04:25:16.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534198+0000", 2024-04-19T04:25:16.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109145 2024-04-19T04:25:16.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:16.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534202+0000", 2024-04-19T04:25:16.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.98e-06 2024-04-19T04:25:16.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558221+0000", 2024-04-19T04:25:16.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024018208999999999 2024-04-19T04:25:16.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558320+0000", 2024-04-19T04:25:16.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9642000000000006e-05 2024-04-19T04:25:16.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:16.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558401+0000", 2024-04-19T04:25:16.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1038000000000006e-05 2024-04-19T04:25:16.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561173+0000", 2024-04-19T04:25:16.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027714549999999999 2024-04-19T04:25:16.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:16.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563851+0000", 2024-04-19T04:25:16.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026786010000000001 2024-04-19T04:25:16.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:16.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563906+0000", 2024-04-19T04:25:16.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4895999999999998e-05 2024-04-19T04:25:16.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563946+0000", 2024-04-19T04:25:16.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0116e-05 2024-04-19T04:25:16.839 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.839 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.839 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.839 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:16.839 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:16.839 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 56.272443772000003, 2024-04-19T04:25:16.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029917846000000001, 2024-04-19T04:25:16.839 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.840 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.840 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:16.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534103+0000", 2024-04-19T04:25:16.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534101+0000", 2024-04-19T04:25:16.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:16.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534111+0000", 2024-04-19T04:25:16.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5659999999999996e-06 2024-04-19T04:25:16.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534129+0000", 2024-04-19T04:25:16.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7632999999999999e-05 2024-04-19T04:25:16.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534143+0000", 2024-04-19T04:25:16.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4362000000000001e-05 2024-04-19T04:25:16.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534256+0000", 2024-04-19T04:25:16.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113267 2024-04-19T04:25:16.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:16.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534260+0000", 2024-04-19T04:25:16.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9949999999999999e-06 2024-04-19T04:25:16.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558653+0000", 2024-04-19T04:25:16.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024393182999999999 2024-04-19T04:25:16.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558704+0000", 2024-04-19T04:25:16.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0303999999999998e-05 2024-04-19T04:25:16.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:16.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558782+0000", 2024-04-19T04:25:16.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8079999999999998e-05 2024-04-19T04:25:16.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561309+0000", 2024-04-19T04:25:16.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002527708 2024-04-19T04:25:16.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:16.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563952+0000", 2024-04-19T04:25:16.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026425450000000001 2024-04-19T04:25:16.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:16.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.563996+0000", 2024-04-19T04:25:16.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3606000000000002e-05 2024-04-19T04:25:16.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564021+0000", 2024-04-19T04:25:16.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.491e-05 2024-04-19T04:25:16.845 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.845 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.845 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.845 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:16.846 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:16.846 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 56.272391261000003, 2024-04-19T04:25:16.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:25:16.846 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.846 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.846 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:16.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:16.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:25:16.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:25:16.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:25:16.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:25:16.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:25:16.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:25:16.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:25:16.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:25:16.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:25:16.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:16.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:25:16.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:25:16.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:25:16.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:25:16.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:25:16.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:25:16.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:16.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:25:16.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:25:16.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:25:16.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:25:16.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:16.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:25:16.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:25:16.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:16.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:25:16.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:25:16.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:25:16.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:25:16.852 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.852 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.852 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.852 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:16.852 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:16.852 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 56.272336715999998, 2024-04-19T04:25:16.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:25:16.852 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.852 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.852 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:16.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:16.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:25:16.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:25:16.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:25:16.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:25:16.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:25:16.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:25:16.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:25:16.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:25:16.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:25:16.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:16.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:25:16.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:25:16.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:25:16.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:25:16.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:25:16.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:25:16.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:16.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:25:16.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:25:16.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:25:16.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:25:16.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:16.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:25:16.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:25:16.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:16.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:25:16.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:25:16.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:25:16.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:25:16.858 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.858 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.858 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.858 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:16.858 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:16.858 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.575022130000001, 2024-04-19T04:25:16.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:16.858 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.858 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.858 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:16.859 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:16.859 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.859 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:16.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.859 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:16.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:16.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:16.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:16.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:16.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:16.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:16.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:16.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:16.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:16.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:16.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:16.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:16.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:16.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:16.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:16.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:16.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:16.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:16.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:16.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:16.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:16.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:16.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:16.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:16.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:16.863 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.864 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.864 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.864 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:16.864 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:16.864 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.571840974000001, 2024-04-19T04:25:16.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:16.864 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.864 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.864 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:16.864 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:16.864 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.864 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:16.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.865 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:16.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:16.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:16.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:16.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:16.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:16.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:16.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:16.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:16.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:16.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:16.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:16.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:16.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:16.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:16.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:16.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:16.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:16.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:16.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:16.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:16.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:16.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:16.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:16.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:16.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:16.870 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.870 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.870 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.871 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:16.871 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:16.871 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.571272870000001, 2024-04-19T04:25:16.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:16.871 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.871 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.871 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:16.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:16.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:16.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:16.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:16.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:16.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:16.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:16.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:16.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:16.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:16.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:16.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:16.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:16.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:16.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:16.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:16.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:16.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:16.875 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.875 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.876 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.876 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:16.876 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:16.876 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.570927209000001, 2024-04-19T04:25:16.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:16.876 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.876 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.876 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:16.876 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:16.876 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.876 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:16.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.877 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:16.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:16.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:16.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:16.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:16.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:16.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:16.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:16.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:16.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:16.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:16.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:16.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:16.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:16.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:16.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:16.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:16.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:16.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:16.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:16.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:16.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:16.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:16.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:16.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:16.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:16.882 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.882 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.882 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.882 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:16.882 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:16.882 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.570202771000002, 2024-04-19T04:25:16.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:16.882 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.882 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.882 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:16.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:16.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:16.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:16.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:16.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:16.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:16.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:16.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:16.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:16.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:16.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:16.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:16.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:16.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:16.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:16.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.886 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.886 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:16.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:16.886 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.886 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.886 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.886 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:16.886 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:16.886 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.570195376000001, 2024-04-19T04:25:16.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:16.887 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.887 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.887 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:16.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:16.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:16.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:16.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:16.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:16.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:16.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:16.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:16.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:16.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:16.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:16.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:16.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:16.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:16.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:16.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:16.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:16.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:16.890 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.890 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.890 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.890 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:16.890 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:16.890 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.568370228999999, 2024-04-19T04:25:16.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:16.891 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.891 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.891 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:16.891 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:16.891 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.891 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:16.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.891 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:16.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:16.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:16.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:16.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:16.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.893 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.893 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:16.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:16.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.893 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.893 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:16.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:16.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.893 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.893 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:16.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:16.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:16.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:16.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:16.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:16.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:16.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:16.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:16.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:16.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:16.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:16.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:16.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:16.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:16.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:16.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:16.896 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.896 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.896 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.896 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26148 5.9 e27/20 ondisk, result = 0)", 2024-04-19T04:25:16.896 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:16.896 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.568269904000001, 2024-04-19T04:25:16.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.042005175999999998, 2024-04-19T04:25:16.897 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.897 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:16.897 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:16.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:16.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.898 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.898 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238276+0000", 2024-04-19T04:25:16.898 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:16.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.898 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.898 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238280+0000", 2024-04-19T04:25:16.898 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6399999999999999e-06 2024-04-19T04:25:16.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.898 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.898 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238286+0000", 2024-04-19T04:25:16.898 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2099999999999998e-06 2024-04-19T04:25:16.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238290+0000", 2024-04-19T04:25:16.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2470000000000002e-06 2024-04-19T04:25:16.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239526+0000", 2024-04-19T04:25:16.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012362619999999999 2024-04-19T04:25:16.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239538+0000", 2024-04-19T04:25:16.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1620999999999999e-05 2024-04-19T04:25:16.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280282+0000", 2024-04-19T04:25:16.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040743691999999998 2024-04-19T04:25:16.900 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.900 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.900 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.900 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:16.900 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:16.900 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.567636023999999, 2024-04-19T04:25:16.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:16.900 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.900 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.900 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:16.900 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:16.901 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.901 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:16.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.901 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:16.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:16.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:16.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:16.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:16.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:16.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:16.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.903 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.903 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:16.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:16.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.903 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.903 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:16.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:16.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.903 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.903 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:16.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:16.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:16.904 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:16.904 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:16.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.904 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:16.904 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:16.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:16.904 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:16.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:16.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:16.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:16.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:16.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:16.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:16.906 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.906 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.906 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.906 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:16.906 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:16.906 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.567101747999999, 2024-04-19T04:25:16.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:16.906 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.906 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.906 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:16.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:16.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:16.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:16.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:16.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:16.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:16.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:16.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:16.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.909 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.909 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:16.909 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:16.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.909 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.909 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:16.909 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:16.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.909 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:16.909 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:16.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:16.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:16.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:16.910 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.910 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.910 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.910 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26160 5.f e27/20 ondisk, result = 0)", 2024-04-19T04:25:16.910 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:16.910 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.565986373000001, 2024-04-19T04:25:16.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039752357000000002, 2024-04-19T04:25:16.911 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.911 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:16.911 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:16.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:16.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240559+0000", 2024-04-19T04:25:16.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:16.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240569+0000", 2024-04-19T04:25:16.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7720000000000006e-06 2024-04-19T04:25:16.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280164+0000", 2024-04-19T04:25:16.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039595324000000001 2024-04-19T04:25:16.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280190+0000", 2024-04-19T04:25:16.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5692000000000001e-05 2024-04-19T04:25:16.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280287+0000", 2024-04-19T04:25:16.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7536999999999998e-05 2024-04-19T04:25:16.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280299+0000", 2024-04-19T04:25:16.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2057e-05 2024-04-19T04:25:16.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:16.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3244999999999999e-05 2024-04-19T04:25:16.914 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.914 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.914 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.915 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26179 5.3 e27/20 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head v 27'1624, mlcod=27'1621)", 2024-04-19T04:25:16.915 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:16.915 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.562832620999998, 2024-04-19T04:25:16.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039964081999999998, 2024-04-19T04:25:16.915 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.915 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.915 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:16.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:16.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243713+0000", 2024-04-19T04:25:16.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243750+0000", 2024-04-19T04:25:16.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6704e-05 2024-04-19T04:25:16.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280162+0000", 2024-04-19T04:25:16.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036412117000000001 2024-04-19T04:25:16.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280186+0000", 2024-04-19T04:25:16.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4825999999999999e-05 2024-04-19T04:25:16.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:16.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012540000000000001 2024-04-19T04:25:16.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280347+0000", 2024-04-19T04:25:16.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4894000000000002e-05 2024-04-19T04:25:16.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:16.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283654+0000", 2024-04-19T04:25:16.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00330716 2024-04-19T04:25:16.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283678+0000", 2024-04-19T04:25:16.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3992e-05 2024-04-19T04:25:16.919 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.919 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.919 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.919 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:67426 5.2 5:4aa7fb06:::benchmark_data_smithi007_19526_object67425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:16.919 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.503400+0000", 2024-04-19T04:25:16.919 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.30314679, 2024-04-19T04:25:16.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.026855061, 2024-04-19T04:25:16.919 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:16.920 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:16.920 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:16.920 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:16.920 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:16.920 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 67426 2024-04-19T04:25:16.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.920 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:16.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.920 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:16.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.503400+0000", 2024-04-19T04:25:16.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:16.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.503400+0000", 2024-04-19T04:25:16.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:16.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:16.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.503399+0000", 2024-04-19T04:25:16.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:16.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:16.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.503461+0000", 2024-04-19T04:25:16.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2426000000000002e-05 2024-04-19T04:25:16.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:16.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.503472+0000", 2024-04-19T04:25:16.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1199999999999999e-05 2024-04-19T04:25:16.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:16.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.503481+0000", 2024-04-19T04:25:16.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5790000000000004e-06 2024-04-19T04:25:16.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:16.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.505244+0000", 2024-04-19T04:25:16.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001763592 2024-04-19T04:25:16.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:16.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.505355+0000", 2024-04-19T04:25:16.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000110513 2024-04-19T04:25:16.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:16.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.505459+0000", 2024-04-19T04:25:16.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000104027 2024-04-19T04:25:16.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:16.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.509400+0000", 2024-04-19T04:25:16.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0039410390000000003 2024-04-19T04:25:16.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:16.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.530149+0000", 2024-04-19T04:25:16.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.020749195000000002 2024-04-19T04:25:16.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:16.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.530212+0000", 2024-04-19T04:25:16.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3040999999999995e-05 2024-04-19T04:25:16.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:16.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:16.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:16.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.530255+0000", 2024-04-19T04:25:16.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2524999999999997e-05 2024-04-19T04:25:16.925 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.925 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.925 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.925 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:16.925 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:16.925 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:16.926 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-19T04:25:16.927 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:16.928 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:16.926+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:17.027 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:17.022+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:17.067 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:17.067 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:17.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.068 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:68310 5.f e39/20 5:fd529471:::benchmark_data_smithi007_19526_object68309:head v 39'4193, mlcod=39'4190)", 2024-04-19T04:25:17.068 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:17.062270+0000", 2024-04-19T04:25:17.068 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0057935950000000003, 2024-04-19T04:25:17.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058219120000000003, 2024-04-19T04:25:17.068 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.068 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:17.068 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.062270+0000", 2024-04-19T04:25:17.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.062270+0000", 2024-04-19T04:25:17.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.062269+0000", 2024-04-19T04:25:17.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:17.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.062330+0000", 2024-04-19T04:25:17.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1128000000000002e-05 2024-04-19T04:25:17.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.062345+0000", 2024-04-19T04:25:17.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5463000000000001e-05 2024-04-19T04:25:17.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.062353+0000", 2024-04-19T04:25:17.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4869999999999996e-06 2024-04-19T04:25:17.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.062428+0000", 2024-04-19T04:25:17.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4833000000000007e-05 2024-04-19T04:25:17.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.062446+0000", 2024-04-19T04:25:17.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.891e-05 2024-04-19T04:25:17.071 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.071 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.071 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.071 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:68313 5.9 e39/20 5:948fe728:::benchmark_data_smithi007_19526_object68312:head v 39'4452, mlcod=39'4450)", 2024-04-19T04:25:17.072 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:17.065933+0000", 2024-04-19T04:25:17.072 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0021304610000000002, 2024-04-19T04:25:17.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022400279999999998, 2024-04-19T04:25:17.072 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.072 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:17.072 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.065933+0000", 2024-04-19T04:25:17.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.065933+0000", 2024-04-19T04:25:17.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.065932+0000", 2024-04-19T04:25:17.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:17.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066006+0000", 2024-04-19T04:25:17.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4190000000000006e-05 2024-04-19T04:25:17.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066016+0000", 2024-04-19T04:25:17.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0124e-05 2024-04-19T04:25:17.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066021+0000", 2024-04-19T04:25:17.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0719999999999999e-06 2024-04-19T04:25:17.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066077+0000", 2024-04-19T04:25:17.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6059e-05 2024-04-19T04:25:17.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066101+0000", 2024-04-19T04:25:17.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3731e-05 2024-04-19T04:25:17.076 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.076 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.076 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.076 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68320 5.a 5:542fe38a:::benchmark_data_smithi007_19526_object68319:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T04:25:17.077 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:17.066359+0000", 2024-04-19T04:25:17.077 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001704075, 2024-04-19T04:25:17.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001894731, 2024-04-19T04:25:17.077 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.077 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:17.077 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.077 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.077 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.077 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68320 2024-04-19T04:25:17.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.077 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066359+0000", 2024-04-19T04:25:17.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066359+0000", 2024-04-19T04:25:17.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066358+0000", 2024-04-19T04:25:17.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:17.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066426+0000", 2024-04-19T04:25:17.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8378000000000002e-05 2024-04-19T04:25:17.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066443+0000", 2024-04-19T04:25:17.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6402e-05 2024-04-19T04:25:17.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066450+0000", 2024-04-19T04:25:17.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8959999999999997e-06 2024-04-19T04:25:17.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066515+0000", 2024-04-19T04:25:17.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5265000000000006e-05 2024-04-19T04:25:17.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066737+0000", 2024-04-19T04:25:17.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000222375 2024-04-19T04:25:17.080 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.080 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.080 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.080 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68322 5.8 5:1c9fb478:::benchmark_data_smithi007_19526_object68321:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T04:25:17.080 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:17.066463+0000", 2024-04-19T04:25:17.080 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0015997229999999999, 2024-04-19T04:25:17.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001877987, 2024-04-19T04:25:17.081 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.081 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:17.081 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.081 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.081 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.081 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68322 2024-04-19T04:25:17.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.081 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066463+0000", 2024-04-19T04:25:17.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066463+0000", 2024-04-19T04:25:17.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066463+0000", 2024-04-19T04:25:17.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:17.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066494+0000", 2024-04-19T04:25:17.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1040000000000001e-05 2024-04-19T04:25:17.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066499+0000", 2024-04-19T04:25:17.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3600000000000004e-06 2024-04-19T04:25:17.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066510+0000", 2024-04-19T04:25:17.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0267e-05 2024-04-19T04:25:17.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066570+0000", 2024-04-19T04:25:17.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0928999999999999e-05 2024-04-19T04:25:17.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.066742+0000", 2024-04-19T04:25:17.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017170799999999999 2024-04-19T04:25:17.084 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.084 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.084 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.084 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68324 5.b 5:d69b075b:::benchmark_data_smithi007_19526_object68323:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T04:25:17.084 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:17.067010+0000", 2024-04-19T04:25:17.084 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0010528239999999999, 2024-04-19T04:25:17.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001418208, 2024-04-19T04:25:17.084 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.084 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:17.085 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.085 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.085 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.085 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68324 2024-04-19T04:25:17.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.085 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.067010+0000", 2024-04-19T04:25:17.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.067010+0000", 2024-04-19T04:25:17.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.067010+0000", 2024-04-19T04:25:17.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:17.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.067121+0000", 2024-04-19T04:25:17.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111595 2024-04-19T04:25:17.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.067130+0000", 2024-04-19T04:25:17.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5369999999999997e-06 2024-04-19T04:25:17.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.067134+0000", 2024-04-19T04:25:17.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9750000000000001e-06 2024-04-19T04:25:17.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.067165+0000", 2024-04-19T04:25:17.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1433999999999998e-05 2024-04-19T04:25:17.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:17.067251+0000", 2024-04-19T04:25:17.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6249999999999996e-05 2024-04-19T04:25:17.088 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.088 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.088 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.088 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.088 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:17.088 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 5 2024-04-19T04:25:17.088 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:17.089 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:17.128 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:17.126+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:17.215 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:17.215 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:17.215 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:17.216 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:17.216 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:17.227 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:17.229 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:17.226+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:17.330 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:17.326+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:17.355 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:17.356 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:17.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:17.356 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:17.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.356 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:17.356 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:17.356 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.117879965, 2024-04-19T04:25:17.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:17.356 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.356 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:17.356 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.356 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.357 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.357 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:17.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.357 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:17.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:17.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:17.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:17.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:17.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:17.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:17.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:17.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:17.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:17.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:17.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:17.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:17.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:17.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:17.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:17.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:17.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:17.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:17.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:17.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:17.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:17.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:17.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:17.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:17.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:17.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:17.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:17.363 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.363 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.363 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.363 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:17.363 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:17.363 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.113431048999999, 2024-04-19T04:25:17.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:17.364 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.364 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:17.364 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.364 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.364 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.364 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:17.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.364 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:17.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:17.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:17.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:17.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:17.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:17.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:17.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:17.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:17.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:17.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:17.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:17.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:17.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:17.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:17.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:17.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:17.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:17.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:17.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:17.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:17.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:17.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:17.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:17.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:17.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:17.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:17.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:17.369 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.369 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.369 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.369 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:17.369 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:17.369 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.2854988059999997, 2024-04-19T04:25:17.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:17.369 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.370 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:17.370 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.370 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.370 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.370 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:17.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.370 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:17.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:17.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:17.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:17.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:17.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:17.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:17.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:17.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:17.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:17.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:17.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:17.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:17.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:17.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:17.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:17.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:17.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:17.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:17.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:17.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:17.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:17.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:17.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:17.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:17.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:17.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:17.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:17.375 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.375 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.375 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.375 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:17.375 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:17.375 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.849644769, 2024-04-19T04:25:17.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:17.375 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.375 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:17.375 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.376 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.376 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.376 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:17.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.376 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:17.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:17.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:17.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:17.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:17.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:17.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:17.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:17.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:17.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:17.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:17.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:17.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:17.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:17.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:17.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:17.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:17.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:17.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:17.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:17.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:17.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:17.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:17.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:17.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:17.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:17.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:17.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:17.380 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.380 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.380 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.381 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:17.381 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:17.381 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.8492143489999999, 2024-04-19T04:25:17.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:17.381 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.381 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:17.381 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.381 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.381 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.381 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:17.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.381 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:17.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:17.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:17.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:17.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:17.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:17.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:17.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:17.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:17.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:17.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:17.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:17.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:17.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:17.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:17.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:17.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:17.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:17.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:17.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:17.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:17.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:17.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:17.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:17.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:17.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:17.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:17.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:17.386 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.386 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.386 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.386 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:17.386 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:17.386 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.846983085, 2024-04-19T04:25:17.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:17.387 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.387 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:17.387 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.387 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.387 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.387 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:17.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.387 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:17.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:17.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:17.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:17.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:17.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:17.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:17.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:17.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:17.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:17.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:17.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:17.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:17.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:17.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:17.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:17.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:17.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:17.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:17.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:17.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:17.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:17.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:17.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:17.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:17.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:17.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:17.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:17.392 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.392 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.392 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.392 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:17.392 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:17.392 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.8435860470000001, 2024-04-19T04:25:17.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:17.392 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.392 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:17.392 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.393 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.393 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.393 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:17.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.393 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:17.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:17.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:17.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:17.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:17.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:17.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:17.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:17.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:17.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:17.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:17.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:17.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:17.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:17.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:17.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:17.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:17.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:17.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:17.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:17.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:17.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:17.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:17.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:17.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:17.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:17.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:17.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:17.398 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.398 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.398 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.398 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:17.398 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:17.398 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.8384578490000001, 2024-04-19T04:25:17.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:17.398 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.398 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:17.398 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.398 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.399 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.399 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:17.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.399 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:17.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:17.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:17.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:17.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:17.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:17.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:17.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:17.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:17.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:17.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:17.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:17.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:17.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:17.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:17.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:17.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:17.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:17.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:17.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:17.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:17.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:17.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:17.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:17.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:17.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:17.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:17.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:17.403 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.403 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.403 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.404 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:17.404 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:17.404 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.5244293440000001, 2024-04-19T04:25:17.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:17.404 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.404 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:17.404 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.404 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.404 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.404 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:17.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.404 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:17.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:17.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:17.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:17.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:17.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:17.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:17.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:17.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:17.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:17.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:17.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:17.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:17.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:17.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:17.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:17.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:17.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:17.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:17.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:17.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:17.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:17.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:17.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:17.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:17.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:17.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:17.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:17.409 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.409 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.409 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.409 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67949 5.b 5:d725bcef:::benchmark_data_smithi007_19526_object67948:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:17.409 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:17.409 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.521311066, 2024-04-19T04:25:17.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022537248999999999, 2024-04-19T04:25:17.409 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.409 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:17.409 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.410 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.410 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.410 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67949 2024-04-19T04:25:17.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.410 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:17.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:17.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832099+0000", 2024-04-19T04:25:17.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:17.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832148+0000", 2024-04-19T04:25:17.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9517e-05 2024-04-19T04:25:17.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832154+0000", 2024-04-19T04:25:17.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5319999999999997e-06 2024-04-19T04:25:17.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832158+0000", 2024-04-19T04:25:17.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9099999999999998e-06 2024-04-19T04:25:17.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.833836+0000", 2024-04-19T04:25:17.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001678817 2024-04-19T04:25:17.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834007+0000", 2024-04-19T04:25:17.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000170151 2024-04-19T04:25:17.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:17.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834238+0000", 2024-04-19T04:25:17.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023146700000000001 2024-04-19T04:25:17.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:17.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.839447+0000", 2024-04-19T04:25:17.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005209272 2024-04-19T04:25:17.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:17.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854573+0000", 2024-04-19T04:25:17.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015125945 2024-04-19T04:25:17.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:17.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854607+0000", 2024-04-19T04:25:17.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3782000000000003e-05 2024-04-19T04:25:17.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854637+0000", 2024-04-19T04:25:17.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9827000000000001e-05 2024-04-19T04:25:17.414 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.414 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.414 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.415 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:17.415 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:17.415 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.402069934, 2024-04-19T04:25:17.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:25:17.415 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.415 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:17.415 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.415 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.415 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.415 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:17.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.415 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:17.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:17.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:17.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:17.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:17.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:17.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:17.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:17.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:17.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:17.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:17.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:17.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:17.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:17.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:17.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:17.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:17.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:17.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:17.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:17.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:17.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:17.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:17.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:17.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:17.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:25:17.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:25:17.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:25:17.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:25:17.420 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.420 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.420 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.421 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:17.421 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:17.421 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3970082879999999, 2024-04-19T04:25:17.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:25:17.421 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.421 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:17.421 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.421 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.421 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.421 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:17.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.421 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:17.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:17.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:17.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:17.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:17.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:17.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:17.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:17.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:17.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:17.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:17.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:17.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:17.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:17.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:17.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:17.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:17.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:17.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:17.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:17.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:17.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:17.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:25:17.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:25:17.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:25:17.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:25:17.426 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.426 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.426 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.427 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:17.427 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:17.427 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3969083760000001, 2024-04-19T04:25:17.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:25:17.427 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.427 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:17.427 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.427 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.427 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.427 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:17.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.427 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:17.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:17.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:17.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:17.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:17.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:17.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:17.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:17.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:17.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:17.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:17.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:17.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:17.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:17.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:17.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:17.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:17.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:17.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:17.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:17.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:17.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:17.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:25:17.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:25:17.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:25:17.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:25:17.432 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.432 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.432 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.432 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:17.432 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:17.432 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.396782623, 2024-04-19T04:25:17.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:25:17.433 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.433 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:17.433 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.433 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.433 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.433 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:17.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.433 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:17.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:17.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:17.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:17.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:17.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:17.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:17.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:17.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:17.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:17.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:17.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:17.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:17.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:17.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:17.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:17.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:17.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:17.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:17.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:17.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:17.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:17.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:25:17.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:25:17.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:25:17.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:25:17.438 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.438 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.438 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.438 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:17.438 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:17.438 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3929386779999999, 2024-04-19T04:25:17.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:25:17.438 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.438 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:17.438 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.439 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.439 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.439 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:17.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.439 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:17.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:17.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:17.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:17.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:17.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:17.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:17.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:17.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:17.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:17.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:17.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:17.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:17.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:17.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:17.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:25:17.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:25:17.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:25:17.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:25:17.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:17.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:25:17.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:25:17.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:17.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:25:17.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:25:17.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:25:17.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:25:17.443 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.443 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.444 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.444 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:17.444 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:17.444 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.385767577, 2024-04-19T04:25:17.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:25:17.444 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.444 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:17.444 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.444 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.444 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.444 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:17.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.445 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:17.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:17.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:17.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:17.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:17.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:17.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:17.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:17.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:17.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:17.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:17.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:17.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:17.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:17.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:17.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:25:17.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:25:17.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:25:17.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:25:17.448 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.448 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.448 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.448 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:17.448 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:17.448 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.385595473, 2024-04-19T04:25:17.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:25:17.449 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.449 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:17.449 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.449 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.449 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.449 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:17.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.449 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:17.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:17.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:17.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:17.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:17.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:17.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:17.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:17.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:17.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:17.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:17.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:17.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:17.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:17.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:17.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:25:17.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:25:17.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:25:17.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:25:17.453 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.453 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.453 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.453 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:17.453 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:17.453 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3855323479999999, 2024-04-19T04:25:17.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:25:17.453 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.453 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:17.454 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.454 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.454 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.454 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:17.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.454 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:17.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:17.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:17.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:17.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:17.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:17.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:17.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:17.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:17.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:17.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:17.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:17.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:17.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:17.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:17.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:25:17.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:25:17.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:25:17.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:25:17.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:17.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:25:17.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:25:17.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:17.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:25:17.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:25:17.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:25:17.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:25:17.458 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.459 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.459 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.459 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:17.459 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:17.459 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3854037510000001, 2024-04-19T04:25:17.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:25:17.459 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.459 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:17.459 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.459 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.459 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.459 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:17.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.460 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:17.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:17.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:17.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:17.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:17.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:17.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:17.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:17.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:17.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:17.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:17.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:17.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:17.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:17.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:17.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:25:17.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:25:17.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:25:17.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:25:17.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:17.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:25:17.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:25:17.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:17.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:25:17.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:25:17.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:25:17.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:25:17.464 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.464 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.464 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.465 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:17.465 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:17.465 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3853357800000001, 2024-04-19T04:25:17.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:25:17.465 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:17.465 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:17.465 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:17.465 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:17.465 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.465 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:17.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.465 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:17.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:17.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:17.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:17.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:17.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:17.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:17.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:17.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:17.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:17.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:17.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:17.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:17.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:17.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:17.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:17.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:17.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:17.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:17.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:17.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:17.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:17.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:17.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:25:17.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:25:17.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:17.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:25:17.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:25:17.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:17.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:25:17.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:25:17.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:17.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:25:17.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:25:17.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:17.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:17.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:17.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:25:17.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:25:17.470 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.470 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.470 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.470 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:17.470 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:17.470 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:17.472 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:17.473 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:17.466+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:17.518 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:25:17.573 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:17.570+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:17.607 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:17.607 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:69475 5.7 5:e28a4377:::benchmark_data_smithi007_19526_object69474:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T04:25:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:17.600796+0000", 2024-04-19T04:25:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0066377509999999999, 2024-04-19T04:25:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0066675609999999998, 2024-04-19T04:25:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 69475 2024-04-19T04:25:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.600796+0000", 2024-04-19T04:25:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.600796+0000", 2024-04-19T04:25:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.600795+0000", 2024-04-19T04:25:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.600867+0000", 2024-04-19T04:25:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1840000000000003e-05 2024-04-19T04:25:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.600881+0000", 2024-04-19T04:25:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4156e-05 2024-04-19T04:25:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.600889+0000", 2024-04-19T04:25:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0539999999999995e-06 2024-04-19T04:25:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.600936+0000", 2024-04-19T04:25:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6337e-05 2024-04-19T04:25:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.602855+0000", 2024-04-19T04:25:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001918962 2024-04-19T04:25:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:69478 5.7 5:eb7797e9:::benchmark_data_smithi007_19526_object69477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T04:25:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:17.601436+0000", 2024-04-19T04:25:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0059985719999999998, 2024-04-19T04:25:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0061048450000000002, 2024-04-19T04:25:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 69478 2024-04-19T04:25:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.601436+0000", 2024-04-19T04:25:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.601436+0000", 2024-04-19T04:25:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.601435+0000", 2024-04-19T04:25:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.601503+0000", 2024-04-19T04:25:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8571000000000005e-05 2024-04-19T04:25:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.601518+0000", 2024-04-19T04:25:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.456e-05 2024-04-19T04:25:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.601525+0000", 2024-04-19T04:25:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4680000000000003e-06 2024-04-19T04:25:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.605133+0000", 2024-04-19T04:25:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0036076709999999998 2024-04-19T04:25:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.605330+0000", 2024-04-19T04:25:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019690800000000001 2024-04-19T04:25:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:69479 5.f 5:fa4782cf:::benchmark_data_smithi007_19526_object69478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T04:25:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:17.601824+0000", 2024-04-19T04:25:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0056106250000000002, 2024-04-19T04:25:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0057860689999999996, 2024-04-19T04:25:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 69479 2024-04-19T04:25:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.601824+0000", 2024-04-19T04:25:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.601824+0000", 2024-04-19T04:25:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.601823+0000", 2024-04-19T04:25:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.601884+0000", 2024-04-19T04:25:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1284999999999993e-05 2024-04-19T04:25:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.601893+0000", 2024-04-19T04:25:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9479999999999997e-06 2024-04-19T04:25:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.601899+0000", 2024-04-19T04:25:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.772e-06 2024-04-19T04:25:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.605123+0000", 2024-04-19T04:25:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032243800000000002 2024-04-19T04:25:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.605270+0000", 2024-04-19T04:25:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014706699999999999 2024-04-19T04:25:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.605415+0000", 2024-04-19T04:25:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014530000000000001 2024-04-19T04:25:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:69481 5.d 5:bfcdff78:::benchmark_data_smithi007_19526_object69480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T04:25:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:17.603305+0000", 2024-04-19T04:25:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0041294579999999999, 2024-04-19T04:25:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0043788819999999997, 2024-04-19T04:25:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 69481 2024-04-19T04:25:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.603305+0000", 2024-04-19T04:25:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.603305+0000", 2024-04-19T04:25:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.603304+0000", 2024-04-19T04:25:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.603369+0000", 2024-04-19T04:25:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5536000000000004e-05 2024-04-19T04:25:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.603384+0000", 2024-04-19T04:25:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4948e-05 2024-04-19T04:25:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.603392+0000", 2024-04-19T04:25:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5739999999999998e-06 2024-04-19T04:25:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.603454+0000", 2024-04-19T04:25:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2084999999999999e-05 2024-04-19T04:25:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.603604+0000", 2024-04-19T04:25:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150147 2024-04-19T04:25:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.603779+0000", 2024-04-19T04:25:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017504599999999999 2024-04-19T04:25:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:69482 5.3 5:c5a66519:::benchmark_data_smithi007_19526_object69481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T04:25:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:17.604568+0000", 2024-04-19T04:25:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0028660159999999999, 2024-04-19T04:25:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031943430000000001, 2024-04-19T04:25:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 69482 2024-04-19T04:25:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604568+0000", 2024-04-19T04:25:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604568+0000", 2024-04-19T04:25:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604567+0000", 2024-04-19T04:25:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604672+0000", 2024-04-19T04:25:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010509399999999999 2024-04-19T04:25:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604696+0000", 2024-04-19T04:25:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3388999999999999e-05 2024-04-19T04:25:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604703+0000", 2024-04-19T04:25:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6329999999999996e-06 2024-04-19T04:25:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604792+0000", 2024-04-19T04:25:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9101e-05 2024-04-19T04:25:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604977+0000", 2024-04-19T04:25:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000184957 2024-04-19T04:25:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:69483 5.6 5:65789fe1:::benchmark_data_smithi007_19526_object69482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T04:25:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:17.604743+0000", 2024-04-19T04:25:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0026907620000000002, 2024-04-19T04:25:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0030851139999999999, 2024-04-19T04:25:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 69483 2024-04-19T04:25:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604743+0000", 2024-04-19T04:25:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604743+0000", 2024-04-19T04:25:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604743+0000", 2024-04-19T04:25:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604803+0000", 2024-04-19T04:25:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0183000000000003e-05 2024-04-19T04:25:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604815+0000", 2024-04-19T04:25:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1605e-05 2024-04-19T04:25:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604834+0000", 2024-04-19T04:25:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9196999999999999e-05 2024-04-19T04:25:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604892+0000", 2024-04-19T04:25:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8072999999999998e-05 2024-04-19T04:25:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.605044+0000", 2024-04-19T04:25:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015195599999999999 2024-04-19T04:25:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:69484 5.c 5:3d9cb121:::benchmark_data_smithi007_19526_object69483:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T04:25:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:17.604848+0000", 2024-04-19T04:25:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.002586227, 2024-04-19T04:25:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0030485769999999998, 2024-04-19T04:25:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 69484 2024-04-19T04:25:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604848+0000", 2024-04-19T04:25:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604848+0000", 2024-04-19T04:25:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604847+0000", 2024-04-19T04:25:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604887+0000", 2024-04-19T04:25:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9799000000000003e-05 2024-04-19T04:25:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604897+0000", 2024-04-19T04:25:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0132999999999999e-05 2024-04-19T04:25:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604905+0000", 2024-04-19T04:25:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4649999999999997e-06 2024-04-19T04:25:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604972+0000", 2024-04-19T04:25:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7039999999999995e-05 2024-04-19T04:25:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.605115+0000", 2024-04-19T04:25:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143831 2024-04-19T04:25:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:69485 5.3 5:c2228b4d:::benchmark_data_smithi007_19526_object69484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T04:25:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:17.604931+0000", 2024-04-19T04:25:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00250315, 2024-04-19T04:25:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0030379420000000001, 2024-04-19T04:25:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 69485 2024-04-19T04:25:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604931+0000", 2024-04-19T04:25:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604931+0000", 2024-04-19T04:25:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604930+0000", 2024-04-19T04:25:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604979+0000", 2024-04-19T04:25:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8514999999999999e-05 2024-04-19T04:25:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604988+0000", 2024-04-19T04:25:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2229999999999996e-06 2024-04-19T04:25:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.604994+0000", 2024-04-19T04:25:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2999999999999998e-06 2024-04-19T04:25:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.607596+0000", 2024-04-19T04:25:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026013960000000002 2024-04-19T04:25:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.607701+0000", 2024-04-19T04:25:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000105455 2024-04-19T04:25:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:69490 5.2 5:485fc150:::benchmark_data_smithi007_19526_object69489:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T04:25:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:17.605509+0000", 2024-04-19T04:25:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001925368, 2024-04-19T04:25:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0025290999999999998, 2024-04-19T04:25:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 69490 2024-04-19T04:25:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.605509+0000", 2024-04-19T04:25:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.605509+0000", 2024-04-19T04:25:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.605508+0000", 2024-04-19T04:25:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.605543+0000", 2024-04-19T04:25:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5026e-05 2024-04-19T04:25:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.605556+0000", 2024-04-19T04:25:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3505e-05 2024-04-19T04:25:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.605566+0000", 2024-04-19T04:25:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7799999999999995e-06 2024-04-19T04:25:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.605629+0000", 2024-04-19T04:25:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2316000000000004e-05 2024-04-19T04:25:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:17.605737+0000", 2024-04-19T04:25:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010864 2024-04-19T04:25:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 9 2024-04-19T04:25:17.647 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:17.649 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:17.674 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:17.674+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:17.683 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:17.705 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:17.705 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:17.705 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:17.705 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:17.710 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:17.710 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:17.753 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 33 16 69810 69794 132.17 103.625 0.00701028 0.0075603 2024-04-19T04:25:17.774 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:17.774+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:17.781 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:17.781 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:17.794 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:17.874 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:17.874+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:17.930 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:17.930 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:17.944 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:17.974 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T04:25:17.978 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:17.970+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:18.071 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:18.071 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:18.076 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:18.074+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:18.082 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:18.177 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:18.178+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:18.203 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:18.203 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:18.215 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:18.278 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:18.278+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:18.341 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:18.341 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:18.353 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:18.379 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:18.378+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:18.480 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:18.474+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:18.487 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:18.487 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:18.499 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:18.580 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:18.578+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:18.628 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:18.628 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:18.639 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:18.682 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:18.678+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:18.754 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 34 16 71948 71932 132.212 133.625 0.00571043 0.0075574 2024-04-19T04:25:18.782 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:18.778+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:18.815 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:18.816 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:18.831 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:18.883 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:18.878+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:18.957 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:18.957 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:18.971 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:18.979 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-04-19T04:25:18.987 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:18.986+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:19.085 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:19.082+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:19.094 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:19.094 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:19.107 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:19.186 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:19.182+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:19.231 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:19.232 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:19.244 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:19.288 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:19.286+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:19.387 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:19.387 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:19.388 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:19.386+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:19.400 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:19.490 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:19.486+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:19.533 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:19.533 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:19.547 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:19.590 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:19.586+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:19.692 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:19.690+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:19.711 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:25:19.723 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:19.723 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:19.735 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:19.754 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 35 16 74062 74046 132.209 132.125 0.00920485 0.00755795 2024-04-19T04:25:19.794 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:19.794+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:19.862 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:19.862 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:19.874 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:19.875 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:19.896 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:19.894+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:19.897 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:19.901 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:19.902 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:19.997 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:19.994+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:20.063 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:20.063 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:20.063 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:20.063 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:20.063 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:20.063 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:20.098 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:20.094+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:20.199 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:20.194+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:20.233 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:20.233 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:20.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:20.233 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:20.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.233 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:20.233 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:20.233 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.995023433, 2024-04-19T04:25:20.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:20.233 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.233 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.234 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.234 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.234 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.234 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:20.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.234 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:20.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:20.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:20.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:20.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:20.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:20.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:20.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:20.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:20.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:20.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:20.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:20.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:20.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:20.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:20.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:20.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:20.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:20.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:20.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:20.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:20.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:20.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:20.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:20.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:20.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:20.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:20.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:20.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:20.238 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.238 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.238 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.239 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:20.239 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:20.239 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.990574516999999, 2024-04-19T04:25:20.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:20.239 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.239 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.239 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.239 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.239 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.239 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:20.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.239 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:20.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:20.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:20.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:20.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:20.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:20.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:20.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:20.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:20.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:20.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:20.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:20.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:20.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:20.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:20.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:20.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:20.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:20.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:20.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:20.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:20.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:20.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:20.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:20.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:20.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:20.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:20.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:20.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:20.244 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.244 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.244 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.244 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:20.244 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:20.244 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.1626422740000004, 2024-04-19T04:25:20.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:20.244 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.244 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.244 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.245 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.245 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.245 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:20.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.245 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:20.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:20.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:20.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:20.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:20.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:20.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:20.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:20.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:20.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:20.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:20.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:20.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:20.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:20.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:20.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:20.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:20.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:20.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:20.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:20.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:20.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:20.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:20.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:20.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:20.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:20.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:20.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:20.249 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.249 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.249 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.250 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:20.250 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:20.250 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.7267882370000001, 2024-04-19T04:25:20.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:20.250 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.250 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.250 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.250 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.250 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.250 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:20.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.250 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:20.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:20.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:20.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:20.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:20.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:20.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:20.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:20.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:20.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:20.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:20.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:20.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:20.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:20.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:20.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:20.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:20.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:20.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:20.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:20.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:20.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:20.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:20.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:20.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:20.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:20.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:20.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:20.255 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.255 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.255 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.255 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:20.255 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:20.255 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.7263578170000002, 2024-04-19T04:25:20.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:20.255 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.255 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.256 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.256 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.256 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.256 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:20.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.256 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:20.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:20.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:20.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:20.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:20.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:20.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:20.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:20.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:20.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:20.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:20.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:20.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:20.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:20.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:20.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:20.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:20.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:20.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:20.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:20.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:20.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:20.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:20.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:20.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:20.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:20.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:20.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:20.260 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.260 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.260 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.261 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:20.261 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:20.261 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.7241265529999996, 2024-04-19T04:25:20.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:20.261 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.261 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.261 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.261 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.261 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.261 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:20.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.261 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:20.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:20.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:20.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:20.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:20.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:20.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:20.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:20.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:20.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:20.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:20.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:20.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:20.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:20.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:20.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:20.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:20.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:20.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:20.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:20.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:20.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:20.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:20.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:20.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:20.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:20.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:20.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:20.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:20.266 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.266 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.266 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.266 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:20.266 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:20.266 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.7207295150000004, 2024-04-19T04:25:20.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:20.267 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.267 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.267 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.267 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.267 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.267 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:20.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.267 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:20.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:20.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:20.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:20.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:20.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:20.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:20.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:20.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:20.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:20.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:20.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:20.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:20.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:20.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:20.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:20.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:20.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:20.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:20.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:20.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:20.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:20.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:20.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:20.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:20.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:20.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:20.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:20.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:20.271 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.272 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.272 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.272 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:20.272 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:20.272 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.715601317, 2024-04-19T04:25:20.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:20.272 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.272 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.272 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.272 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.272 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.272 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:20.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.273 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:20.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:20.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:20.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:20.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:20.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:20.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:20.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:20.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:20.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:20.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:20.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:20.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:20.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:20.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:20.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:20.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:20.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:20.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:20.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:20.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:20.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:20.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:20.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:20.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:20.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:20.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:20.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:20.277 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.277 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.277 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.278 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:20.278 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:20.278 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.4015728120000004, 2024-04-19T04:25:20.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:20.278 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.278 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.278 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.278 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.278 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.278 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:20.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.278 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:20.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:20.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:20.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:20.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:20.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:20.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:20.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:20.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:20.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:20.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:20.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:20.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:20.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:20.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:20.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:20.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:20.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:20.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:20.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:20.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:20.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:20.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:20.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:20.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:20.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:20.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:20.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:20.283 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.283 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.283 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.283 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67949 5.b 5:d725bcef:::benchmark_data_smithi007_19526_object67948:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:20.283 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:20.283 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.3984545339999999, 2024-04-19T04:25:20.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022537248999999999, 2024-04-19T04:25:20.283 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.283 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.283 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.284 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.284 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.284 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67949 2024-04-19T04:25:20.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.284 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:20.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:20.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832099+0000", 2024-04-19T04:25:20.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832148+0000", 2024-04-19T04:25:20.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9517e-05 2024-04-19T04:25:20.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832154+0000", 2024-04-19T04:25:20.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5319999999999997e-06 2024-04-19T04:25:20.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832158+0000", 2024-04-19T04:25:20.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9099999999999998e-06 2024-04-19T04:25:20.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.833836+0000", 2024-04-19T04:25:20.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001678817 2024-04-19T04:25:20.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:20.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834007+0000", 2024-04-19T04:25:20.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000170151 2024-04-19T04:25:20.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:20.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834238+0000", 2024-04-19T04:25:20.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023146700000000001 2024-04-19T04:25:20.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:20.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.839447+0000", 2024-04-19T04:25:20.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005209272 2024-04-19T04:25:20.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:20.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854573+0000", 2024-04-19T04:25:20.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015125945 2024-04-19T04:25:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854607+0000", 2024-04-19T04:25:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3782000000000003e-05 2024-04-19T04:25:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854637+0000", 2024-04-19T04:25:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9827000000000001e-05 2024-04-19T04:25:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.289 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:20.289 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:20.289 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.2792134019999999, 2024-04-19T04:25:20.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:25:20.289 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.289 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:20.289 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.289 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.289 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.289 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:20.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.289 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:20.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:20.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:20.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:20.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:20.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:20.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:20.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:20.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:20.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:20.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:20.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:20.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:20.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:20.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:20.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:20.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:20.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:20.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:20.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:20.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:20.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:20.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:20.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:20.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:20.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:20.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:25:20.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:25:20.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:25:20.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:25:20.294 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.295 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.295 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.295 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:20.295 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:20.295 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.2741517560000002, 2024-04-19T04:25:20.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:25:20.295 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.295 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:20.295 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.295 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.295 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.295 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:20.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.296 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:20.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:20.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:20.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:20.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:20.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:20.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:20.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:20.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:20.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:20.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:20.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:20.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:20.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:20.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:20.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:20.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:20.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:20.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:20.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:20.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:20.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:20.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:20.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:25:20.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:25:20.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:25:20.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:25:20.300 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.300 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.300 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.300 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:20.301 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:20.301 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.2740518439999997, 2024-04-19T04:25:20.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:25:20.301 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.301 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:20.301 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.301 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.301 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.301 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:20.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.301 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:20.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:20.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:20.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:20.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:20.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:20.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:20.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:20.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:20.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:20.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:20.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:20.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:20.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:20.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:20.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:20.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:20.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:20.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:20.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:20.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:20.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:20.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:20.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:25:20.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:25:20.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:25:20.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:25:20.306 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.306 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.306 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.306 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:20.306 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:20.306 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.2739260909999999, 2024-04-19T04:25:20.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:25:20.306 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.306 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:20.306 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.307 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.307 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.307 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:20.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.307 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:20.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:20.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:20.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:20.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:20.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:20.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:20.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:20.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:20.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:20.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:20.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:20.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:20.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:20.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:20.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:20.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:20.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:20.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:20.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:20.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:20.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:20.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:25:20.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:25:20.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:25:20.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:25:20.311 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.311 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.311 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.312 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:20.312 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:20.312 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.270082146, 2024-04-19T04:25:20.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:25:20.312 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.312 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.312 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.312 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.312 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.312 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:20.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.312 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:20.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:20.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:20.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:20.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:20.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:20.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:20.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:20.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:20.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:20.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:20.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:20.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:20.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:20.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:20.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:25:20.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:25:20.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:20.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:25:20.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:25:20.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:20.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:25:20.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:25:20.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:20.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:25:20.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:25:20.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:25:20.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:25:20.317 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.317 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.317 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.317 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:20.317 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:20.317 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.2629110450000001, 2024-04-19T04:25:20.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:25:20.317 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.318 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:20.318 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.318 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.318 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.318 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:20.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.318 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:20.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:20.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:20.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:20.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:20.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:20.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:20.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:20.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:20.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:20.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:20.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:20.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:20.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:20.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:20.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:25:20.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:25:20.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:25:20.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:25:20.321 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.321 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.321 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.322 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:20.322 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:20.322 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.2627389410000003, 2024-04-19T04:25:20.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:25:20.322 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.322 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:20.322 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.322 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.322 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.322 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:20.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.322 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:20.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:20.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:20.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:20.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:20.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:20.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:20.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:20.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:20.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:20.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:20.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:20.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:20.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:20.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:20.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:25:20.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:25:20.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:25:20.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:25:20.326 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.326 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.326 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.326 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:20.326 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:20.326 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.2626758159999998, 2024-04-19T04:25:20.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:25:20.326 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.326 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.327 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:20.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.327 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:20.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:20.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:20.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:20.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:20.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:20.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:20.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:20.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:20.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:20.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:20.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:20.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:20.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:20.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:20.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:25:20.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:25:20.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:20.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:25:20.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:25:20.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:20.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:25:20.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:25:20.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:20.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:25:20.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:25:20.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:25:20.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:25:20.331 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.331 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.331 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.332 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:20.332 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:20.332 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.262547219, 2024-04-19T04:25:20.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:25:20.332 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.332 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.332 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.332 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.332 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.332 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:20.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.332 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:20.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:20.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:20.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:20.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:20.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:20.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:20.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:20.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:20.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:20.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:20.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:20.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:20.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:20.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:20.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:25:20.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:25:20.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:20.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:25:20.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:25:20.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:20.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:25:20.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:25:20.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:20.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:25:20.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:25:20.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:25:20.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:25:20.337 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.337 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.337 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.337 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:20.337 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:20.337 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.262479248, 2024-04-19T04:25:20.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:25:20.337 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:20.338 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.338 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:20.338 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:20.338 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.338 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:20.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.338 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:20.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:20.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:20.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:20.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:20.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:20.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:20.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:20.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:20.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:20.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:20.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:20.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:20.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:20.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:20.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:20.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:20.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:20.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:20.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:20.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:20.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:20.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:20.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:25:20.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:25:20.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:20.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:25:20.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:25:20.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:20.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:25:20.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:25:20.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:20.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:25:20.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:25:20.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:20.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:20.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:20.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:25:20.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:25:20.342 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.342 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.342 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.342 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:20.343 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:20.343 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:20.343 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T04:25:20.354 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:20.350+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:20.354 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:20.454 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-04-19T04:25:20.454 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:20.450+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:20.485 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:20.485 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:20.485 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.485 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:75588 5.5 5:a616b6ee:::benchmark_data_smithi007_19526_object75587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:20.485 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:20.478371+0000", 2024-04-19T04:25:20.485 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0062546160000000002, 2024-04-19T04:25:20.485 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062797520000000004, 2024-04-19T04:25:20.485 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.486 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:20.486 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.486 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.486 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.486 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 75588 2024-04-19T04:25:20.486 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.486 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.486 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.486 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.486 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.478371+0000", 2024-04-19T04:25:20.486 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.487 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.487 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.487 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.478371+0000", 2024-04-19T04:25:20.487 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.487 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.487 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.487 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.478370+0000", 2024-04-19T04:25:20.487 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.487 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.487 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.488 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.478467+0000", 2024-04-19T04:25:20.488 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.6706000000000005e-05 2024-04-19T04:25:20.488 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.488 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.488 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.488 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.478476+0000", 2024-04-19T04:25:20.488 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9730000000000003e-06 2024-04-19T04:25:20.488 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.488 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.488 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.488 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.478481+0000", 2024-04-19T04:25:20.488 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5509999999999999e-06 2024-04-19T04:25:20.488 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.488 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.488 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.489 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.478570+0000", 2024-04-19T04:25:20.489 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9154999999999996e-05 2024-04-19T04:25:20.489 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.489 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.489 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.489 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.478810+0000", 2024-04-19T04:25:20.489 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00023917099999999999 2024-04-19T04:25:20.489 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.489 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.489 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.489 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.489 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.489 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:75590 5.5 5:a786a8c2:::benchmark_data_smithi007_19526_object75589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:20.489 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:20.478504+0000", 2024-04-19T04:25:20.490 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0061216880000000001, 2024-04-19T04:25:20.490 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062266719999999999, 2024-04-19T04:25:20.490 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.490 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:20.490 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.490 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.490 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.490 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 75590 2024-04-19T04:25:20.490 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.490 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.490 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.490 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.490 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.478504+0000", 2024-04-19T04:25:20.490 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.491 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.491 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.491 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.491 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.478504+0000", 2024-04-19T04:25:20.491 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.491 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.491 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.491 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.491 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.478503+0000", 2024-04-19T04:25:20.491 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.491 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.491 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.491 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.491 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.478552+0000", 2024-04-19T04:25:20.492 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8894000000000003e-05 2024-04-19T04:25:20.492 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.492 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.492 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.492 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.478560+0000", 2024-04-19T04:25:20.492 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2870000000000004e-06 2024-04-19T04:25:20.492 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.492 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.492 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.492 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.478566+0000", 2024-04-19T04:25:20.492 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2489999999999998e-06 2024-04-19T04:25:20.492 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.492 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.493 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.493 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.481156+0000", 2024-04-19T04:25:20.493 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0025894580000000002 2024-04-19T04:25:20.493 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.493 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.493 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.493 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.481341+0000", 2024-04-19T04:25:20.493 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00018509599999999999 2024-04-19T04:25:20.493 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.493 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.493 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.493 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.493 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.493 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:75593 5.c 5:3e3768b6:::benchmark_data_smithi007_19526_object75592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:20.494 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:20.480507+0000", 2024-04-19T04:25:20.494 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0041179880000000004, 2024-04-19T04:25:20.494 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042815680000000004, 2024-04-19T04:25:20.494 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.494 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:20.494 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.494 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.494 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.494 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 75593 2024-04-19T04:25:20.494 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.494 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.494 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.494 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.494 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.480507+0000", 2024-04-19T04:25:20.495 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.495 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.495 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.495 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.495 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.480507+0000", 2024-04-19T04:25:20.495 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.495 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.495 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.495 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.495 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.480507+0000", 2024-04-19T04:25:20.495 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.495 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.495 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.495 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.496 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.480598+0000", 2024-04-19T04:25:20.496 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1191000000000002e-05 2024-04-19T04:25:20.496 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.496 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.496 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.496 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.480608+0000", 2024-04-19T04:25:20.496 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0472000000000001e-05 2024-04-19T04:25:20.496 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.496 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.496 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.496 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.480613+0000", 2024-04-19T04:25:20.496 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7119999999999999e-06 2024-04-19T04:25:20.496 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.496 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.496 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.497 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.480673+0000", 2024-04-19T04:25:20.497 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9845e-05 2024-04-19T04:25:20.497 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.497 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.497 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.497 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.480788+0000", 2024-04-19T04:25:20.497 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115195 2024-04-19T04:25:20.497 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.497 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.497 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.497 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.497 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.497 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:75595 5.2 5:49393763:::benchmark_data_smithi007_19526_object75594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:20.497 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:20.480651+0000", 2024-04-19T04:25:20.497 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0039741769999999997, 2024-04-19T04:25:20.498 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.004210961, 2024-04-19T04:25:20.498 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.498 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:20.498 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.498 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.498 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.498 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 75595 2024-04-19T04:25:20.498 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.498 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.498 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.498 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.498 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.480651+0000", 2024-04-19T04:25:20.498 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.499 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.499 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.499 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.499 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.480651+0000", 2024-04-19T04:25:20.499 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.499 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.499 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.499 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.499 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.480651+0000", 2024-04-19T04:25:20.499 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:20.499 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.499 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.499 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.499 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.480716+0000", 2024-04-19T04:25:20.500 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5278999999999996e-05 2024-04-19T04:25:20.500 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.500 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.500 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.500 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.480722+0000", 2024-04-19T04:25:20.500 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6590000000000004e-06 2024-04-19T04:25:20.500 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.500 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.500 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.500 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.480725+0000", 2024-04-19T04:25:20.500 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7160000000000001e-06 2024-04-19T04:25:20.500 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.500 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.500 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.500 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.480768+0000", 2024-04-19T04:25:20.501 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2682999999999998e-05 2024-04-19T04:25:20.501 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.501 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.501 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.501 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.480855+0000", 2024-04-19T04:25:20.501 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6892999999999996e-05 2024-04-19T04:25:20.501 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.501 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.501 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.501 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.501 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.501 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:75596 5.5 5:ac318fe8:::benchmark_data_smithi007_19526_object75595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:20.501 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:20.483130+0000", 2024-04-19T04:25:20.501 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001495733, 2024-04-19T04:25:20.502 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00180916, 2024-04-19T04:25:20.502 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.502 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:20.502 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.502 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.502 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.502 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 75596 2024-04-19T04:25:20.502 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.502 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.502 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.502 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.502 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483130+0000", 2024-04-19T04:25:20.502 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.503 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.503 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.503 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.503 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483130+0000", 2024-04-19T04:25:20.503 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.503 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.503 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.503 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.503 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483129+0000", 2024-04-19T04:25:20.503 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.503 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.503 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.503 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.503 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483179+0000", 2024-04-19T04:25:20.504 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9923999999999998e-05 2024-04-19T04:25:20.504 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.504 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.504 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.504 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483192+0000", 2024-04-19T04:25:20.504 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3018e-05 2024-04-19T04:25:20.504 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.504 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.504 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.504 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483197+0000", 2024-04-19T04:25:20.504 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4670000000000003e-06 2024-04-19T04:25:20.504 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.504 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.504 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.505 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483477+0000", 2024-04-19T04:25:20.505 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00027946500000000001 2024-04-19T04:25:20.505 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.505 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.505 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.505 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483559+0000", 2024-04-19T04:25:20.505 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2324000000000007e-05 2024-04-19T04:25:20.505 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.505 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.505 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.505 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.505 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.505 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:75597 5.3 5:c143f78f:::benchmark_data_smithi007_19526_object75596:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:20.506 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:20.483205+0000", 2024-04-19T04:25:20.506 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001420262, 2024-04-19T04:25:20.506 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018038279999999999, 2024-04-19T04:25:20.506 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.506 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:20.506 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.506 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.506 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.506 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 75597 2024-04-19T04:25:20.506 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.506 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.506 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.506 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.507 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483205+0000", 2024-04-19T04:25:20.507 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.507 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.507 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.507 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.507 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483205+0000", 2024-04-19T04:25:20.507 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.507 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.507 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.507 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.507 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483205+0000", 2024-04-19T04:25:20.507 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:20.507 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.508 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.508 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483241+0000", 2024-04-19T04:25:20.508 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6402999999999997e-05 2024-04-19T04:25:20.508 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.508 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.508 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483249+0000", 2024-04-19T04:25:20.508 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2930000000000001e-06 2024-04-19T04:25:20.508 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.508 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.508 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483253+0000", 2024-04-19T04:25:20.508 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5250000000000001e-06 2024-04-19T04:25:20.509 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.509 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.509 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.509 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483306+0000", 2024-04-19T04:25:20.509 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3192999999999997e-05 2024-04-19T04:25:20.509 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.509 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.509 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.509 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483457+0000", 2024-04-19T04:25:20.509 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015111599999999999 2024-04-19T04:25:20.509 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.509 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.509 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.509 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.510 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.510 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:75598 5.2 5:49f459ec:::benchmark_data_smithi007_19526_object75597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:20.510 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:20.483262+0000", 2024-04-19T04:25:20.510 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0013632589999999999, 2024-04-19T04:25:20.510 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00179729, 2024-04-19T04:25:20.510 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.510 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:20.510 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.510 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.510 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.510 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 75598 2024-04-19T04:25:20.510 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.510 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.510 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.511 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.511 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483262+0000", 2024-04-19T04:25:20.511 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.511 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.511 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.511 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.511 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483262+0000", 2024-04-19T04:25:20.511 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.511 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.511 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.511 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.511 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483262+0000", 2024-04-19T04:25:20.511 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:20.511 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.512 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.512 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.512 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483296+0000", 2024-04-19T04:25:20.512 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4489000000000001e-05 2024-04-19T04:25:20.512 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.512 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.512 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.512 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483303+0000", 2024-04-19T04:25:20.512 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9890000000000003e-06 2024-04-19T04:25:20.512 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.512 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.512 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.512 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483307+0000", 2024-04-19T04:25:20.512 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.782e-06 2024-04-19T04:25:20.513 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.513 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.513 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.513 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483347+0000", 2024-04-19T04:25:20.513 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9718000000000002e-05 2024-04-19T04:25:20.513 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.513 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.513 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.513 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.483481+0000", 2024-04-19T04:25:20.513 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013428999999999999 2024-04-19T04:25:20.513 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.513 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.513 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.513 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.513 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.514 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:75599 5.c 5:309be5a2:::benchmark_data_smithi007_19526_object75598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:20.514 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:20.484442+0000", 2024-04-19T04:25:20.514 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00018324500000000001, 2024-04-19T04:25:20.514 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00065861999999999995, 2024-04-19T04:25:20.514 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.514 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:20.514 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.514 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.514 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.514 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 75599 2024-04-19T04:25:20.514 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.514 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.514 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.515 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.515 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.484442+0000", 2024-04-19T04:25:20.515 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.515 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.515 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.515 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.515 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.484442+0000", 2024-04-19T04:25:20.515 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.515 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.515 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.515 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.515 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.484441+0000", 2024-04-19T04:25:20.515 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.515 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.515 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.516 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.516 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.484603+0000", 2024-04-19T04:25:20.516 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016158000000000001 2024-04-19T04:25:20.516 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.516 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.516 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.516 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.484617+0000", 2024-04-19T04:25:20.516 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4241e-05 2024-04-19T04:25:20.516 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.516 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.516 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.516 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.484623+0000", 2024-04-19T04:25:20.516 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7919999999999998e-06 2024-04-19T04:25:20.516 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.517 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.517 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.517 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.484672+0000", 2024-04-19T04:25:20.517 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9162999999999997e-05 2024-04-19T04:25:20.517 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.517 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.517 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.517 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.484812+0000", 2024-04-19T04:25:20.517 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014001700000000001 2024-04-19T04:25:20.517 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.517 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.517 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.517 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.517 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.518 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:75601 5.2 5.ad676792 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:20.518 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:20.484695+0000", 2024-04-19T04:25:20.518 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9999299, 2024-04-19T04:25:20.518 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000462557, 2024-04-19T04:25:20.518 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.518 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:20.518 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.518 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.518 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.518 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 75601 2024-04-19T04:25:20.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.518 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.518 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.518 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.519 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.484695+0000", 2024-04-19T04:25:20.519 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.519 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.519 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.519 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.519 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.484695+0000", 2024-04-19T04:25:20.519 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.519 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.519 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.519 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.519 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.484694+0000", 2024-04-19T04:25:20.519 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.519 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.520 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.520 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.520 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.484801+0000", 2024-04-19T04:25:20.520 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000106889 2024-04-19T04:25:20.520 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.520 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.520 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.520 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.484820+0000", 2024-04-19T04:25:20.520 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8532000000000001e-05 2024-04-19T04:25:20.520 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.520 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.520 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.520 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.484827+0000", 2024-04-19T04:25:20.520 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4340000000000003e-06 2024-04-19T04:25:20.520 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.521 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.521 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.521 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.521 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.521 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:75602 5.5 5:a1d387c5:::benchmark_data_smithi007_19526_object75601:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:20.521 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:20.484985+0000", 2024-04-19T04:25:20.521 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9996405, 2024-04-19T04:25:20.521 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022397500000000001, 2024-04-19T04:25:20.521 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.521 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:20.521 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.521 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.521 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.521 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 75602 2024-04-19T04:25:20.522 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.522 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.522 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.522 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.522 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.484985+0000", 2024-04-19T04:25:20.522 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.522 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.522 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.522 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.522 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.484985+0000", 2024-04-19T04:25:20.522 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.522 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.522 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.522 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.523 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.484984+0000", 2024-04-19T04:25:20.523 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.523 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.523 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.523 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.523 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.485079+0000", 2024-04-19T04:25:20.523 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.4648999999999995e-05 2024-04-19T04:25:20.523 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.523 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.523 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.523 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.485093+0000", 2024-04-19T04:25:20.523 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4144999999999999e-05 2024-04-19T04:25:20.523 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.523 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.524 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.524 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.485100+0000", 2024-04-19T04:25:20.524 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9469999999999997e-06 2024-04-19T04:25:20.524 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.524 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.524 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.524 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.485141+0000", 2024-04-19T04:25:20.524 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0824000000000001e-05 2024-04-19T04:25:20.524 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.524 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.524 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.524 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.524 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.524 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:75585 5.f 5:fbb1ee5b:::benchmark_data_smithi007_19526_object75584:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:20.524 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:20.476489+0000", 2024-04-19T04:25:20.524 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0081365559999999996, 2024-04-19T04:25:20.525 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0087760770000000002, 2024-04-19T04:25:20.525 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.525 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:20.525 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.525 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.525 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.525 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 75585 2024-04-19T04:25:20.525 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.525 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.525 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.525 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.525 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.476489+0000", 2024-04-19T04:25:20.525 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.525 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.525 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.526 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.526 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.476489+0000", 2024-04-19T04:25:20.526 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.526 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.526 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.526 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.526 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.476488+0000", 2024-04-19T04:25:20.526 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.527 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.527 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.527 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.527 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.476549+0000", 2024-04-19T04:25:20.527 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0801999999999998e-05 2024-04-19T04:25:20.527 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.527 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.527 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.527 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.476563+0000", 2024-04-19T04:25:20.527 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4312e-05 2024-04-19T04:25:20.527 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.527 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.527 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.527 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.476570+0000", 2024-04-19T04:25:20.528 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8310000000000003e-06 2024-04-19T04:25:20.528 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.528 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.528 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.528 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.478008+0000", 2024-04-19T04:25:20.528 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014379169999999999 2024-04-19T04:25:20.528 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.528 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.528 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.528 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.478118+0000", 2024-04-19T04:25:20.528 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000110065 2024-04-19T04:25:20.528 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.528 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.528 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:20.529 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.478276+0000", 2024-04-19T04:25:20.529 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015768600000000001 2024-04-19T04:25:20.529 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.529 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.529 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:20.529 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:20.481752+0000", 2024-04-19T04:25:20.529 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034764280000000002 2024-04-19T04:25:20.529 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.529 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.529 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.529 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.529 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:20.529 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 11 2024-04-19T04:25:20.529 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:20.531 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:20.554 INFO:teuthology.orchestra.console.smithi066:Power off completed 2024-04-19T04:25:20.555 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:20.554+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:20.656 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:20.650+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:20.666 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:20.666 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:20.666 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:20.666 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:20.666 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:20.680 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:20.754 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 36 16 76177 76161 132.208 132.188 0.00737452 0.00755785 2024-04-19T04:25:20.758 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:20.754+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:20.857 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:20.854+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:20.860 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 60.325127172000002, 2024-04-19T04:25:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:25:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:25:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:25:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:25:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:25:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:25:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:25:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:25:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:25:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:25:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:25:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:25:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:25:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:25:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:25:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:25:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:25:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:25:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:25:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:25:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:25:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:25:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:25:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:25:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:25:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:25:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 60.325072626999997, 2024-04-19T04:25:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:25:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:25:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:25:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:25:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:25:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:25:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:25:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:25:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:25:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:25:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:25:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:25:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:25:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:25:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:25:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:25:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:25:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:25:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:25:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:25:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:25:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:25:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:25:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:25:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:25:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:25:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.627758041, 2024-04-19T04:25:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.624576885, 2024-04-19T04:25:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.624008781000001, 2024-04-19T04:25:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.62366312, 2024-04-19T04:25:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:20.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:20.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:20.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:20.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:20.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:20.897 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.897 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.897 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.898 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:20.898 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:20.898 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.622938682000001, 2024-04-19T04:25:20.898 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:20.898 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.898 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.898 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.898 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.898 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:20.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:20.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:20.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:20.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:20.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:20.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:20.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:20.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:20.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:20.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:20.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:20.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:20.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:20.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:20.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:20.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:20.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:20.902 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.902 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.902 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.903 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:20.903 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:20.903 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.622931287, 2024-04-19T04:25:20.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:20.903 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.903 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.903 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.903 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.903 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:20.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.904 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:20.904 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.904 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:20.904 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:20.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.904 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:20.904 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:20.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:20.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:20.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:20.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:20.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:20.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:20.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:20.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:20.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:20.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:20.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:20.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:20.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:20.907 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.907 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.907 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.907 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:20.907 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:20.907 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.621106139999998, 2024-04-19T04:25:20.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:20.907 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.907 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.907 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.907 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.907 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.907 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:20.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.908 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:20.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:20.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.909 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.909 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:20.909 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.909 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.909 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:20.909 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:20.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:20.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:20.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:20.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:20.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:20.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:20.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:20.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:20.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:20.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:20.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:20.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:20.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:20.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:20.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:20.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:20.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:20.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:20.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:20.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:20.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:20.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:20.913 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.913 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.913 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.913 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26148 5.9 e27/20 ondisk, result = 0)", 2024-04-19T04:25:20.913 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:20.913 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.621005815, 2024-04-19T04:25:20.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.042005175999999998, 2024-04-19T04:25:20.913 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.913 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:20.913 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:20.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:20.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238276+0000", 2024-04-19T04:25:20.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:20.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238280+0000", 2024-04-19T04:25:20.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6399999999999999e-06 2024-04-19T04:25:20.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238286+0000", 2024-04-19T04:25:20.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2099999999999998e-06 2024-04-19T04:25:20.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238290+0000", 2024-04-19T04:25:20.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2470000000000002e-06 2024-04-19T04:25:20.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239526+0000", 2024-04-19T04:25:20.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012362619999999999 2024-04-19T04:25:20.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239538+0000", 2024-04-19T04:25:20.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1620999999999999e-05 2024-04-19T04:25:20.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280282+0000", 2024-04-19T04:25:20.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040743691999999998 2024-04-19T04:25:20.917 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.917 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.917 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.917 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:20.917 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:20.917 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.620371935000001, 2024-04-19T04:25:20.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:20.917 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.918 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.918 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.918 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.918 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.918 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:20.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.918 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:20.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:20.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:20.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:20.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:20.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.920 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:20.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:20.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.920 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:20.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:20.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.920 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:20.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:20.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:20.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:20.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:20.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:20.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:20.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:20.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:20.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:20.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:20.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:20.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:20.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:20.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:20.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:20.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:20.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:20.923 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.923 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.923 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.923 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:20.923 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:20.923 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.619837659000002, 2024-04-19T04:25:20.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:20.924 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.924 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.924 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:20.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:20.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:20.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:20.926 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:20.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.926 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.926 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:20.926 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:20.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.926 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.926 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:20.926 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:20.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:20.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:20.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:20.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:20.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:20.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:20.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:20.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:20.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:20.928 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.928 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.928 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.928 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26160 5.f e27/20 ondisk, result = 0)", 2024-04-19T04:25:20.928 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:20.929 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.618722284, 2024-04-19T04:25:20.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039752357000000002, 2024-04-19T04:25:20.929 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.929 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:20.929 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:20.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.930 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.930 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:20.930 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.930 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.930 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240559+0000", 2024-04-19T04:25:20.930 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:20.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.930 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.930 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240569+0000", 2024-04-19T04:25:20.930 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7720000000000006e-06 2024-04-19T04:25:20.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280164+0000", 2024-04-19T04:25:20.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039595324000000001 2024-04-19T04:25:20.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280190+0000", 2024-04-19T04:25:20.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5692000000000001e-05 2024-04-19T04:25:20.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280287+0000", 2024-04-19T04:25:20.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7536999999999998e-05 2024-04-19T04:25:20.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.932 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.932 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280299+0000", 2024-04-19T04:25:20.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2057e-05 2024-04-19T04:25:20.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.932 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.932 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:20.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3244999999999999e-05 2024-04-19T04:25:20.932 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.932 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.932 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.933 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26179 5.3 e27/20 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head v 27'1624, mlcod=27'1621)", 2024-04-19T04:25:20.933 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:20.933 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.615568532000001, 2024-04-19T04:25:20.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039964081999999998, 2024-04-19T04:25:20.933 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.933 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.933 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.933 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:20.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.934 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:20.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.934 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.934 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243713+0000", 2024-04-19T04:25:20.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.934 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.934 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243750+0000", 2024-04-19T04:25:20.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6704e-05 2024-04-19T04:25:20.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.935 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.935 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280162+0000", 2024-04-19T04:25:20.935 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036412117000000001 2024-04-19T04:25:20.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.935 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.935 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.935 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280186+0000", 2024-04-19T04:25:20.935 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4825999999999999e-05 2024-04-19T04:25:20.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.935 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.935 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.935 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:20.935 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012540000000000001 2024-04-19T04:25:20.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.936 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.936 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.936 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280347+0000", 2024-04-19T04:25:20.936 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4894000000000002e-05 2024-04-19T04:25:20.936 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.936 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.936 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:20.936 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283654+0000", 2024-04-19T04:25:20.936 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00330716 2024-04-19T04:25:20.936 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.936 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.936 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.936 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283678+0000", 2024-04-19T04:25:20.937 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3992e-05 2024-04-19T04:25:20.937 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.937 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.937 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.937 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.937 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.937 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:20.937 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:20.937 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.9029824699999995, 2024-04-19T04:25:20.937 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:20.937 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.937 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:20.937 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.937 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.938 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.938 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:20.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.938 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.938 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.938 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.938 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:20.938 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.938 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.938 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.938 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:20.938 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.939 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.939 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.939 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:20.939 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:20.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.939 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.939 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.939 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:20.939 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:20.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.939 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.939 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.940 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:20.940 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:20.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.940 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.940 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:20.940 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:20.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.940 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.940 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:20.940 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:20.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.940 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.941 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:20.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:20.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.941 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.941 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:20.941 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:20.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:20.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.941 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.941 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:20.941 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:20.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:20.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.941 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.942 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.942 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:20.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:20.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.942 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.942 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:20.942 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:20.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:20.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.942 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.942 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.942 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:20.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:20.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:20.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:20.943 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.943 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.943 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.943 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:20.943 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:20.943 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.8827520209999999, 2024-04-19T04:25:20.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:20.943 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.943 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:20.944 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.944 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.944 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.944 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:20.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.944 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.944 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:20.944 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.944 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:20.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.945 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:20.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:20.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.945 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:20.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:20.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:20.946 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:20.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:20.946 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:20.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:20.946 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:20.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.947 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.947 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:20.947 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:20.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:20.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.947 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.947 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.947 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:20.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:20.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.947 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.947 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.947 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:20.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:20.948 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.948 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.948 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.948 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:20.948 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:20.948 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.8826441640000002, 2024-04-19T04:25:20.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:20.948 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.948 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:20.948 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.948 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.949 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.949 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:20.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.949 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:20.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:20.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:20.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:20.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:20.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:20.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:20.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:20.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:20.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:20.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:20.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:20.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:20.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:20.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:20.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.952 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.952 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:20.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:20.952 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.952 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.952 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.952 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:20.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:20.952 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.952 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.952 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.952 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.952 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.952 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:20.953 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:20.953 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.8806774749999997, 2024-04-19T04:25:20.953 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:20.953 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.953 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.953 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.953 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.953 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.953 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:20.953 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.953 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.953 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.954 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.954 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:20.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.954 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.954 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.954 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:20.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.954 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.954 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.955 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:20.955 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:20.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.955 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.955 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:20.955 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:20.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.955 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.955 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:20.955 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:20.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:20.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:20.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:20.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:20.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:20.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:20.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:20.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:20.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:20.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:20.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:20.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:20.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:20.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:20.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:20.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:20.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:20.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.959 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:20.959 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:20.959 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.959 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.959 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.959 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.959 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:20.959 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:20.959 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.8773132800000001, 2024-04-19T04:25:20.959 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:20.959 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.959 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.960 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.960 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.960 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.960 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:20.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.960 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.960 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.960 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:20.960 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:20.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:20.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:20.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:20.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:20.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:20.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:20.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:20.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:20.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:20.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:20.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:20.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:20.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:20.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:20.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:20.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:20.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:20.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:20.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:20.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.965 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:20.965 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:20.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:20.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.965 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.965 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:20.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:20.965 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.965 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.965 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.966 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:20.966 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:20.966 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.8735023020000003, 2024-04-19T04:25:20.966 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:20.966 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:20.966 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:20.966 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:20.966 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:20.966 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:20.966 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:20.966 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.966 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:20.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:20.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:20.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:20.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:20.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:20.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:20.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:20.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:20.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:20.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:20.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:20.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:20.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:20.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:20.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:20.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:20.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:20.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:20.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:20.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:20.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:20.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:20.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:20.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:20.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:20.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:20.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:20.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:20.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:20.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:20.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:20.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:20.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:20.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:20.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:20.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:20.971 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:20.971 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:20.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:20.971 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.971 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.971 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.971 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:20.971 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:20.971 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:20.973 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:20.970+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:20.974 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:20.993 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T04:25:21.074 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:21.074+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:21.099 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:21.099 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:21.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.099 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:76824 5.0 5:07d1d1e7:::benchmark_data_smithi007_19526_object76823:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.099 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:21.088884+0000", 2024-04-19T04:25:21.100 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.010449440000000001, 2024-04-19T04:25:21.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010486560000000001, 2024-04-19T04:25:21.100 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.100 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:21.100 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.100 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.100 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.100 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 76824 2024-04-19T04:25:21.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.100 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088884+0000", 2024-04-19T04:25:21.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088884+0000", 2024-04-19T04:25:21.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088883+0000", 2024-04-19T04:25:21.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:21.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088925+0000", 2024-04-19T04:25:21.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2522999999999999e-05 2024-04-19T04:25:21.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088933+0000", 2024-04-19T04:25:21.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6760000000000007e-06 2024-04-19T04:25:21.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088939+0000", 2024-04-19T04:25:21.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8250000000000001e-06 2024-04-19T04:25:21.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.091433+0000", 2024-04-19T04:25:21.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024941360000000001 2024-04-19T04:25:21.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.091586+0000", 2024-04-19T04:25:21.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015322400000000001 2024-04-19T04:25:21.103 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.103 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.103 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.103 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:76821 5.d e40/29 5:b4f3f673:::benchmark_data_smithi007_19526_object76820:head v 40'4606, mlcod=40'4604)", 2024-04-19T04:25:21.104 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:21.089052+0000", 2024-04-19T04:25:21.104 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.010280578, 2024-04-19T04:25:21.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010369954000000001, 2024-04-19T04:25:21.104 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.104 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:21.104 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.089052+0000", 2024-04-19T04:25:21.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.089052+0000", 2024-04-19T04:25:21.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.089051+0000", 2024-04-19T04:25:21.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:21.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.089129+0000", 2024-04-19T04:25:21.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7585999999999999e-05 2024-04-19T04:25:21.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.089137+0000", 2024-04-19T04:25:21.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4940000000000003e-06 2024-04-19T04:25:21.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.089143+0000", 2024-04-19T04:25:21.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2299999999999996e-06 2024-04-19T04:25:21.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.089177+0000", 2024-04-19T04:25:21.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3022000000000003e-05 2024-04-19T04:25:21.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.089190+0000", 2024-04-19T04:25:21.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3602e-05 2024-04-19T04:25:21.107 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.107 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.108 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.108 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:76826 5.9 e40/20 5:96917e97:::benchmark_data_smithi007_19526_object76825:head v 40'4980, mlcod=40'4977)", 2024-04-19T04:25:21.108 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:21.089729+0000", 2024-04-19T04:25:21.108 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0096041430000000007, 2024-04-19T04:25:21.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0097346670000000007, 2024-04-19T04:25:21.108 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.108 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:21.108 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.089729+0000", 2024-04-19T04:25:21.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.089729+0000", 2024-04-19T04:25:21.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.089728+0000", 2024-04-19T04:25:21.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:21.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.089790+0000", 2024-04-19T04:25:21.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1655000000000005e-05 2024-04-19T04:25:21.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.089807+0000", 2024-04-19T04:25:21.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6807999999999999e-05 2024-04-19T04:25:21.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.089814+0000", 2024-04-19T04:25:21.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3350000000000001e-06 2024-04-19T04:25:21.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.089861+0000", 2024-04-19T04:25:21.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6733999999999997e-05 2024-04-19T04:25:21.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.089886+0000", 2024-04-19T04:25:21.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4686999999999999e-05 2024-04-19T04:25:21.111 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.111 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.111 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.111 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:76827 5.a 5:5be91d19:::benchmark_data_smithi007_19526_object76826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.111 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:21.091052+0000", 2024-04-19T04:25:21.111 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.008280964, 2024-04-19T04:25:21.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084549810000000003, 2024-04-19T04:25:21.112 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.112 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:21.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.112 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 76827 2024-04-19T04:25:21.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.112 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.091052+0000", 2024-04-19T04:25:21.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.091052+0000", 2024-04-19T04:25:21.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.091051+0000", 2024-04-19T04:25:21.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.091118+0000", 2024-04-19T04:25:21.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6753000000000003e-05 2024-04-19T04:25:21.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.091129+0000", 2024-04-19T04:25:21.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0961000000000001e-05 2024-04-19T04:25:21.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.091135+0000", 2024-04-19T04:25:21.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9529999999999996e-06 2024-04-19T04:25:21.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.091228+0000", 2024-04-19T04:25:21.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3673999999999998e-05 2024-04-19T04:25:21.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.091411+0000", 2024-04-19T04:25:21.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000182931 2024-04-19T04:25:21.115 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.115 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.115 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.115 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:76828 5.0 5:0e26c464:::benchmark_data_smithi007_19526_object76827:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.115 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:21.091153+0000", 2024-04-19T04:25:21.115 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0081802200000000002, 2024-04-19T04:25:21.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084009589999999995, 2024-04-19T04:25:21.115 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.116 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:21.116 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.116 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.116 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.116 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 76828 2024-04-19T04:25:21.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.116 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.091153+0000", 2024-04-19T04:25:21.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.091153+0000", 2024-04-19T04:25:21.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.091152+0000", 2024-04-19T04:25:21.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.091199+0000", 2024-04-19T04:25:21.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6678000000000003e-05 2024-04-19T04:25:21.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.091227+0000", 2024-04-19T04:25:21.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8804999999999999e-05 2024-04-19T04:25:21.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.091245+0000", 2024-04-19T04:25:21.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7039000000000001e-05 2024-04-19T04:25:21.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.093802+0000", 2024-04-19T04:25:21.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025578839999999999 2024-04-19T04:25:21.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.094015+0000", 2024-04-19T04:25:21.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021265800000000001 2024-04-19T04:25:21.119 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.119 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.119 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.119 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:76831 5.9 e40/20 5:9b36db10:::benchmark_data_smithi007_19526_object76830:head v 40'4981, mlcod=40'4978)", 2024-04-19T04:25:21.119 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:21.092604+0000", 2024-04-19T04:25:21.119 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0067291080000000001, 2024-04-19T04:25:21.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069914670000000003, 2024-04-19T04:25:21.119 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.119 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:21.119 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.092604+0000", 2024-04-19T04:25:21.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.092604+0000", 2024-04-19T04:25:21.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.092603+0000", 2024-04-19T04:25:21.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.092654+0000", 2024-04-19T04:25:21.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0992999999999998e-05 2024-04-19T04:25:21.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.092673+0000", 2024-04-19T04:25:21.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9154e-05 2024-04-19T04:25:21.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.092681+0000", 2024-04-19T04:25:21.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2369999999999992e-06 2024-04-19T04:25:21.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.092773+0000", 2024-04-19T04:25:21.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1737000000000006e-05 2024-04-19T04:25:21.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.092794+0000", 2024-04-19T04:25:21.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.156e-05 2024-04-19T04:25:21.122 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.122 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.122 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.123 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:76833 5.e 5:7f80574b:::benchmark_data_smithi007_19526_object76832:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.123 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:21.093662+0000", 2024-04-19T04:25:21.123 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0056709320000000001, 2024-04-19T04:25:21.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059733989999999999, 2024-04-19T04:25:21.123 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.123 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:21.123 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.123 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.123 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.123 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 76833 2024-04-19T04:25:21.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.123 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.093662+0000", 2024-04-19T04:25:21.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.093662+0000", 2024-04-19T04:25:21.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.093661+0000", 2024-04-19T04:25:21.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:21.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.093821+0000", 2024-04-19T04:25:21.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015993800000000001 2024-04-19T04:25:21.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.093828+0000", 2024-04-19T04:25:21.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5480000000000004e-06 2024-04-19T04:25:21.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.093833+0000", 2024-04-19T04:25:21.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1059999999999999e-06 2024-04-19T04:25:21.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.093885+0000", 2024-04-19T04:25:21.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1439e-05 2024-04-19T04:25:21.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.094117+0000", 2024-04-19T04:25:21.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000232523 2024-04-19T04:25:21.126 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.126 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.126 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.127 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:76832 5.f e40/20 5:fd7ddd4f:::benchmark_data_smithi007_19526_object76831:head v 40'4682, mlcod=40'4680)", 2024-04-19T04:25:21.127 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:21.093885+0000", 2024-04-19T04:25:21.127 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0054478369999999996, 2024-04-19T04:25:21.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057937830000000003, 2024-04-19T04:25:21.127 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.127 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:21.127 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.093885+0000", 2024-04-19T04:25:21.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.093885+0000", 2024-04-19T04:25:21.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.093885+0000", 2024-04-19T04:25:21.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:21.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.093931+0000", 2024-04-19T04:25:21.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6100000000000002e-05 2024-04-19T04:25:21.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.093943+0000", 2024-04-19T04:25:21.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2326e-05 2024-04-19T04:25:21.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.093947+0000", 2024-04-19T04:25:21.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8340000000000001e-06 2024-04-19T04:25:21.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.093988+0000", 2024-04-19T04:25:21.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0954000000000001e-05 2024-04-19T04:25:21.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.094001+0000", 2024-04-19T04:25:21.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3121e-05 2024-04-19T04:25:21.130 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.130 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.130 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.130 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:76835 5.0 5.cca980a0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.130 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:21.094037+0000", 2024-04-19T04:25:21.130 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0052959569999999996, 2024-04-19T04:25:21.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056792739999999998, 2024-04-19T04:25:21.131 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.131 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:21.131 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.131 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.131 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.131 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 76835 2024-04-19T04:25:21.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.131 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.094037+0000", 2024-04-19T04:25:21.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.094037+0000", 2024-04-19T04:25:21.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.094036+0000", 2024-04-19T04:25:21.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.094112+0000", 2024-04-19T04:25:21.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6211999999999995e-05 2024-04-19T04:25:21.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.094128+0000", 2024-04-19T04:25:21.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5495e-05 2024-04-19T04:25:21.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.094134+0000", 2024-04-19T04:25:21.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6610000000000003e-06 2024-04-19T04:25:21.133 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.133 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.133 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.133 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:76838 5.4 5:21c93fd3:::benchmark_data_smithi007_19526_object76837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.133 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:21.099096+0000", 2024-04-19T04:25:21.133 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00023676200000000001, 2024-04-19T04:25:21.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00065723599999999995, 2024-04-19T04:25:21.134 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.134 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:21.134 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.134 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.134 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.134 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 76838 2024-04-19T04:25:21.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.134 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.099096+0000", 2024-04-19T04:25:21.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.099096+0000", 2024-04-19T04:25:21.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.099095+0000", 2024-04-19T04:25:21.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.099135+0000", 2024-04-19T04:25:21.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9950000000000002e-05 2024-04-19T04:25:21.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.099147+0000", 2024-04-19T04:25:21.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1590000000000001e-05 2024-04-19T04:25:21.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.099152+0000", 2024-04-19T04:25:21.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6330000000000001e-06 2024-04-19T04:25:21.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.099195+0000", 2024-04-19T04:25:21.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2978000000000001e-05 2024-04-19T04:25:21.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.099302+0000", 2024-04-19T04:25:21.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106795 2024-04-19T04:25:21.137 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.137 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.137 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.138 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:76822 5.0 5:04ba5de2:::benchmark_data_smithi007_19526_object76821:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.138 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:21.088712+0000", 2024-04-19T04:25:21.138 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.010621204, 2024-04-19T04:25:21.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011086439999999999, 2024-04-19T04:25:21.138 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.138 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:21.138 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.138 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.138 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.138 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 76822 2024-04-19T04:25:21.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.138 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088712+0000", 2024-04-19T04:25:21.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088712+0000", 2024-04-19T04:25:21.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088711+0000", 2024-04-19T04:25:21.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088774+0000", 2024-04-19T04:25:21.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3175000000000004e-05 2024-04-19T04:25:21.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088787+0000", 2024-04-19T04:25:21.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3229e-05 2024-04-19T04:25:21.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088796+0000", 2024-04-19T04:25:21.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6370000000000005e-06 2024-04-19T04:25:21.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088853+0000", 2024-04-19T04:25:21.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6505000000000002e-05 2024-04-19T04:25:21.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088990+0000", 2024-04-19T04:25:21.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000137587 2024-04-19T04:25:21.141 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.141 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.141 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.141 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:76823 5.e 5:71a2a935:::benchmark_data_smithi007_19526_object76822:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.141 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:21.088814+0000", 2024-04-19T04:25:21.141 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.010518504999999999, 2024-04-19T04:25:21.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011028013, 2024-04-19T04:25:21.142 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.142 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:21.142 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.142 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.142 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.142 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 76823 2024-04-19T04:25:21.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.142 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088814+0000", 2024-04-19T04:25:21.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088814+0000", 2024-04-19T04:25:21.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088814+0000", 2024-04-19T04:25:21.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088856+0000", 2024-04-19T04:25:21.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2750000000000002e-05 2024-04-19T04:25:21.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088864+0000", 2024-04-19T04:25:21.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.435e-06 2024-04-19T04:25:21.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.088870+0000", 2024-04-19T04:25:21.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9950000000000002e-06 2024-04-19T04:25:21.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.089007+0000", 2024-04-19T04:25:21.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013688700000000001 2024-04-19T04:25:21.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:21.089134+0000", 2024-04-19T04:25:21.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012721 2024-04-19T04:25:21.145 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.145 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.145 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.145 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.145 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:21.145 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 12 2024-04-19T04:25:21.145 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:21.146 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:21.175 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:21.174+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:21.275 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:21.275 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:21.275 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:21.276 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:21.276 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:21.276 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:21.270+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:21.288 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:21.376 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:21.374+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:21.455 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:21.455 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:21.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:21.455 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:21.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.455 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:21.457 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:21.457 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.218410090999999, 2024-04-19T04:25:21.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:21.457 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.457 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:21.458 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.458 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.458 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.458 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:21.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.458 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:21.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:21.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:21.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:21.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:21.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:21.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:21.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:21.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:21.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:21.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:21.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:21.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:21.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:21.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:21.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:21.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:21.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:21.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:21.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:21.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:21.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:21.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:21.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:21.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:21.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:21.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:21.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:21.463 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.463 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.463 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.463 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:21.464 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:21.464 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.213961175000001, 2024-04-19T04:25:21.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:21.464 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.464 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:21.464 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.464 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.464 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.464 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:21.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.464 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:21.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:21.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:21.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:21.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:21.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:21.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:21.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:21.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:21.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:21.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:21.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:21.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:21.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:21.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:21.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:21.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:21.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:21.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:21.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:21.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:21.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:21.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:21.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:21.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:21.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:21.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:21.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:21.469 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.469 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.469 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.469 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:21.469 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:21.469 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.3860289320000003, 2024-04-19T04:25:21.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:21.470 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.470 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:21.470 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.470 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.470 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.470 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:21.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.470 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:21.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:21.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:21.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:21.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:21.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:21.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:21.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:21.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:21.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:21.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:21.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:21.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:21.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:21.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:21.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:21.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:21.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:21.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:21.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:21.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:21.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:21.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:21.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:21.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:21.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:21.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:21.474 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.475 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.475 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.475 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:21.475 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:21.475 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.950174895, 2024-04-19T04:25:21.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:21.475 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.475 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:21.475 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.475 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.475 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.475 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:21.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.476 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:21.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:21.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:21.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:21.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:21.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:21.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:21.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:21.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:21.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:21.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:21.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:21.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:21.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:21.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:21.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:21.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:21.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:21.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:21.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:21.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:21.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:21.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:21.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:21.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:21.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:21.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:21.480 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.480 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.480 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.480 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:21.480 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:21.480 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.9497444750000001, 2024-04-19T04:25:21.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:21.481 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.481 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:21.481 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.481 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.481 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.481 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:21.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.481 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:21.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:21.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:21.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:21.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:21.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:21.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:21.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:21.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:21.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:21.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:21.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:21.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:21.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:21.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:21.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:21.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:21.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:21.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:21.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:21.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:21.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:21.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:21.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:21.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:21.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:21.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:21.486 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.486 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.486 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.486 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:21.486 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:21.486 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.9475132110000004, 2024-04-19T04:25:21.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:21.486 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.486 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:21.487 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.487 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.487 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.487 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:21.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.487 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:21.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:21.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:21.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:21.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:21.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:21.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:21.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:21.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:21.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:21.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:21.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:21.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:21.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:21.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:21.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:21.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:21.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:21.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:21.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:21.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:21.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:21.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:21.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:21.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:21.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:21.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:21.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:21.491 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.492 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.492 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.492 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:21.492 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:21.492 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.9441161730000003, 2024-04-19T04:25:21.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:21.492 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.492 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:21.492 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.492 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.492 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.493 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:21.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.493 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:21.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:21.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:21.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:21.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:21.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:21.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:21.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:21.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:21.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:21.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:21.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:21.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:21.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:21.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:21.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:21.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:21.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:21.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:21.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:21.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:21.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:21.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:21.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:21.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:21.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:21.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:21.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:21.497 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.497 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.498 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.498 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:21.498 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:21.498 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.9389879749999999, 2024-04-19T04:25:21.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:21.498 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.498 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:21.498 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.498 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.498 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.498 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:21.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.499 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:21.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:21.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:21.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:21.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:21.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:21.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:21.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:21.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:21.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:21.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:21.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:21.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:21.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:21.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:21.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:21.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:21.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:21.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:21.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:21.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:21.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:21.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:21.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:21.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:21.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:21.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:21.503 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.503 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.504 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.504 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:21.504 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:21.504 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.6249594700000003, 2024-04-19T04:25:21.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:21.504 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.504 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:21.504 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.504 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.504 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.504 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:21.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.505 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:21.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:21.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:21.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:21.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:21.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:21.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:21.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:21.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:21.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:21.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:21.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:21.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:21.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:21.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:21.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:21.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:21.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:21.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:21.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:21.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:21.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:21.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:21.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:21.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:21.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:21.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:21.509 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.509 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.509 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.509 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67949 5.b 5:d725bcef:::benchmark_data_smithi007_19526_object67948:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:21.509 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:21.510 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.6218411919999998, 2024-04-19T04:25:21.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022537248999999999, 2024-04-19T04:25:21.510 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.510 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:21.510 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.510 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.510 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.510 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67949 2024-04-19T04:25:21.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.510 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:21.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:21.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832099+0000", 2024-04-19T04:25:21.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832148+0000", 2024-04-19T04:25:21.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9517e-05 2024-04-19T04:25:21.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832154+0000", 2024-04-19T04:25:21.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5319999999999997e-06 2024-04-19T04:25:21.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832158+0000", 2024-04-19T04:25:21.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9099999999999998e-06 2024-04-19T04:25:21.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.833836+0000", 2024-04-19T04:25:21.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001678817 2024-04-19T04:25:21.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834007+0000", 2024-04-19T04:25:21.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000170151 2024-04-19T04:25:21.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:21.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834238+0000", 2024-04-19T04:25:21.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023146700000000001 2024-04-19T04:25:21.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:21.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.839447+0000", 2024-04-19T04:25:21.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005209272 2024-04-19T04:25:21.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:21.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854573+0000", 2024-04-19T04:25:21.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015125945 2024-04-19T04:25:21.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:21.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854607+0000", 2024-04-19T04:25:21.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3782000000000003e-05 2024-04-19T04:25:21.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854637+0000", 2024-04-19T04:25:21.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9827000000000001e-05 2024-04-19T04:25:21.515 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.515 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.515 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.515 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:21.515 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:21.515 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.5026000599999998, 2024-04-19T04:25:21.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:25:21.516 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.516 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:21.516 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.516 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.516 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.516 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:21.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.516 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:21.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:21.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:21.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:21.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:21.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:21.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:21.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:21.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:21.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:21.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:21.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:21.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:21.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:21.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:21.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:21.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:21.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:21.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:21.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:21.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:21.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:21.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:21.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:21.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:21.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:25:21.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:25:21.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:25:21.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:25:21.521 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.521 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.521 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.521 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:21.522 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:21.522 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.4975384140000001, 2024-04-19T04:25:21.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:25:21.522 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.522 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:21.522 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.522 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.522 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.522 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:21.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.522 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:21.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:21.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:21.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:21.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:21.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:21.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:21.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:21.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:21.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:21.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:21.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:21.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:21.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:21.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:21.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:21.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:21.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:21.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:21.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:21.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:21.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:21.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:25:21.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:25:21.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:25:21.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:25:21.527 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.527 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.527 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.527 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:21.527 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:21.527 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.4974385019999996, 2024-04-19T04:25:21.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:25:21.527 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.527 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:21.527 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.528 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.528 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.528 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:21.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.528 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:21.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:21.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:21.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:21.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:21.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:21.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:21.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:21.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:21.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:21.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:21.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:21.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:21.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:21.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:21.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:21.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:21.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:21.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:21.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:21.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:21.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:21.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:25:21.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:25:21.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:25:21.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:25:21.532 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.532 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.532 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.533 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:21.533 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:21.533 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.4973127489999998, 2024-04-19T04:25:21.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:25:21.533 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.533 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:21.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.533 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:21.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.533 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:21.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:21.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:21.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:21.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:21.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:21.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:21.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:21.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:21.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:21.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:21.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:21.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:21.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:21.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:21.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:21.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:21.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:21.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:21.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:21.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:21.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:25:21.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:25:21.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:25:21.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:25:21.538 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.538 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.538 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.538 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:21.538 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:21.538 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.4934688039999999, 2024-04-19T04:25:21.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:25:21.539 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.539 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:21.539 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.539 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.539 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.539 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:21.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.539 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:21.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:21.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:21.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:21.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:21.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:21.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:21.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:21.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:21.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:21.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:21.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:21.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:21.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:21.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:21.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:25:21.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:25:21.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:25:21.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:25:21.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:21.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:25:21.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:25:21.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:21.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:25:21.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:25:21.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:25:21.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:25:21.544 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.544 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.544 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.544 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:21.544 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:21.544 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.486297703, 2024-04-19T04:25:21.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:25:21.544 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.544 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:21.544 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.544 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.545 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:21.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.545 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:21.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:21.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:21.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:21.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:21.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:21.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:21.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:21.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:21.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:21.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:21.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:21.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:21.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:21.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:21.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:25:21.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:25:21.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:25:21.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:25:21.548 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.548 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.548 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.549 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:21.549 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:21.549 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.4861255990000002, 2024-04-19T04:25:21.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:25:21.549 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.549 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:21.549 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.549 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.549 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.549 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:21.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.549 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:21.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:21.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:21.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:21.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:21.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:21.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:21.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:21.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:21.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:21.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:21.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:21.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:21.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:21.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:21.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:25:21.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:25:21.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:25:21.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:25:21.553 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.553 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.553 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.553 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:21.553 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:21.553 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.4860624739999997, 2024-04-19T04:25:21.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:25:21.553 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.553 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:21.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.554 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.554 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:21.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.554 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:21.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:21.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:21.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:21.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:21.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:21.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:21.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:21.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:21.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:21.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:21.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:21.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:21.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:21.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:21.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:25:21.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:25:21.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:25:21.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:25:21.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:21.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:25:21.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:25:21.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:21.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:25:21.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:25:21.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:25:21.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:25:21.558 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.559 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.559 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.559 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:21.559 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:21.559 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.4859338769999999, 2024-04-19T04:25:21.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:25:21.559 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.559 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:21.559 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.559 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.559 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.559 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:21.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.560 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:21.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:21.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:21.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:21.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:21.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:21.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:21.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:21.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:21.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:21.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:21.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:21.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:21.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:21.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:21.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:25:21.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:25:21.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:25:21.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:25:21.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:21.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:25:21.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:25:21.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:21.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:25:21.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:25:21.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:25:21.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:25:21.564 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.564 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.564 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.564 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:21.564 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:21.564 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.4858659059999999, 2024-04-19T04:25:21.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:25:21.565 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:21.565 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:21.565 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:21.565 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:21.565 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.565 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:21.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.565 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:21.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:21.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:21.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:21.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:21.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:21.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:21.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:21.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:21.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:21.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:21.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:21.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:21.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:21.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:21.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:21.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:21.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:21.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:21.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:21.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:21.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:21.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:21.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:25:21.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:25:21.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:21.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:25:21.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:25:21.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:21.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:25:21.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:25:21.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:21.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:25:21.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:25:21.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:21.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:21.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:21.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:25:21.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:25:21.569 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.570 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.570 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.570 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:21.570 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:21.570 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:21.571 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:21.572 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:21.570+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:21.672 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:21.666+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:21.704 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:21.704 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:21.704 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.704 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:78074 5.1 5:8ae6fde1:::benchmark_data_smithi007_19526_object78073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.705 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:21.693857+0000", 2024-04-19T04:25:21.705 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0094833859999999999, 2024-04-19T04:25:21.705 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0095122109999999996, 2024-04-19T04:25:21.705 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:21.705 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:21.705 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:21.705 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:21.705 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.705 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 78074 2024-04-19T04:25:21.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.705 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:21.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.705 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:21.705 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.693857+0000", 2024-04-19T04:25:21.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:21.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.693857+0000", 2024-04-19T04:25:21.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:21.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.693857+0000", 2024-04-19T04:25:21.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:21.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.693960+0000", 2024-04-19T04:25:21.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000103766 2024-04-19T04:25:21.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.707 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:21.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.693974+0000", 2024-04-19T04:25:21.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3713000000000001e-05 2024-04-19T04:25:21.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.707 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.693981+0000", 2024-04-19T04:25:21.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9120000000000001e-06 2024-04-19T04:25:21.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.708 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:21.708 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695305+0000", 2024-04-19T04:25:21.708 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0013237570000000001 2024-04-19T04:25:21.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.708 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.708 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:21.708 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695505+0000", 2024-04-19T04:25:21.708 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00020049799999999999 2024-04-19T04:25:21.708 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.708 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:21.708 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.708 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.708 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:78075 5.9 5:940e60ee:::benchmark_data_smithi007_19526_object78074:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.709 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:21.693991+0000", 2024-04-19T04:25:21.709 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.009349408, 2024-04-19T04:25:21.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0094612250000000002, 2024-04-19T04:25:21.709 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:21.709 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:21.709 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:21.709 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:21.709 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.709 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 78075 2024-04-19T04:25:21.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.709 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:21.709 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.710 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:21.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.693991+0000", 2024-04-19T04:25:21.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.710 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.710 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:21.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.693991+0000", 2024-04-19T04:25:21.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.710 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.710 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:21.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.693991+0000", 2024-04-19T04:25:21.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:21.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:21.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.694027+0000", 2024-04-19T04:25:21.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6177999999999998e-05 2024-04-19T04:25:21.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:21.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.694036+0000", 2024-04-19T04:25:21.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.8070000000000006e-06 2024-04-19T04:25:21.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.694041+0000", 2024-04-19T04:25:21.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8890000000000001e-06 2024-04-19T04:25:21.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:21.712 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695277+0000", 2024-04-19T04:25:21.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001236355 2024-04-19T04:25:21.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:21.712 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695439+0000", 2024-04-19T04:25:21.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016197499999999999 2024-04-19T04:25:21.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:21.713 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695600+0000", 2024-04-19T04:25:21.713 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016065400000000001 2024-04-19T04:25:21.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.713 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.713 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:21.713 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698246+0000", 2024-04-19T04:25:21.713 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026462819999999998 2024-04-19T04:25:21.713 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.713 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:21.713 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.713 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.713 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:78076 5.1 5:8fbc26aa:::benchmark_data_smithi007_19526_object78075:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.713 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:21.695452+0000", 2024-04-19T04:25:21.713 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0078891410000000006, 2024-04-19T04:25:21.714 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.008087571, 2024-04-19T04:25:21.714 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:21.714 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:21.714 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:21.714 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:21.714 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.714 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 78076 2024-04-19T04:25:21.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.714 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:21.714 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.714 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:21.714 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695452+0000", 2024-04-19T04:25:21.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:21.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695452+0000", 2024-04-19T04:25:21.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:21.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695451+0000", 2024-04-19T04:25:21.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:21.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695524+0000", 2024-04-19T04:25:21.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3339999999999999e-05 2024-04-19T04:25:21.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:21.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695533+0000", 2024-04-19T04:25:21.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6430000000000001e-06 2024-04-19T04:25:21.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695539+0000", 2024-04-19T04:25:21.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6549999999999998e-06 2024-04-19T04:25:21.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:21.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698204+0000", 2024-04-19T04:25:21.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026649109999999998 2024-04-19T04:25:21.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:21.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698434+0000", 2024-04-19T04:25:21.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022937500000000001 2024-04-19T04:25:21.717 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.717 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:21.717 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.717 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:78077 5.f 5:f8438e46:::benchmark_data_smithi007_19526_object78076:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.718 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:21.695576+0000", 2024-04-19T04:25:21.718 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0077650840000000002, 2024-04-19T04:25:21.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0080363710000000005, 2024-04-19T04:25:21.718 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:21.718 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:21.718 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:21.718 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:21.718 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.718 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 78077 2024-04-19T04:25:21.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.718 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:21.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.718 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:21.719 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695576+0000", 2024-04-19T04:25:21.719 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.719 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:21.719 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695576+0000", 2024-04-19T04:25:21.719 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.719 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:21.719 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695575+0000", 2024-04-19T04:25:21.719 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.719 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:21.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695654+0000", 2024-04-19T04:25:21.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9202999999999994e-05 2024-04-19T04:25:21.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:21.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695663+0000", 2024-04-19T04:25:21.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9199999999999993e-06 2024-04-19T04:25:21.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695669+0000", 2024-04-19T04:25:21.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.823e-06 2024-04-19T04:25:21.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:21.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695728+0000", 2024-04-19T04:25:21.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9030000000000002e-05 2024-04-19T04:25:21.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:21.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695913+0000", 2024-04-19T04:25:21.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00018479999999999999 2024-04-19T04:25:21.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:21.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696069+0000", 2024-04-19T04:25:21.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000155833 2024-04-19T04:25:21.722 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.722 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:21.722 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.722 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:78078 5.f 5:f3840110:::benchmark_data_smithi007_19526_object78077:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.722 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:21.695690+0000", 2024-04-19T04:25:21.722 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.007650759, 2024-04-19T04:25:21.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0080029090000000008, 2024-04-19T04:25:21.722 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:21.722 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:21.722 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:21.722 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:21.722 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.723 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 78078 2024-04-19T04:25:21.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.723 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:21.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:21.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695690+0000", 2024-04-19T04:25:21.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:21.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695690+0000", 2024-04-19T04:25:21.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:21.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695689+0000", 2024-04-19T04:25:21.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:21.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:21.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695785+0000", 2024-04-19T04:25:21.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5847999999999994e-05 2024-04-19T04:25:21.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:21.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695795+0000", 2024-04-19T04:25:21.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5699999999999999e-06 2024-04-19T04:25:21.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695802+0000", 2024-04-19T04:25:21.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6279999999999996e-06 2024-04-19T04:25:21.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:21.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698596+0000", 2024-04-19T04:25:21.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027931200000000001 2024-04-19T04:25:21.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:21.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698752+0000", 2024-04-19T04:25:21.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015670500000000001 2024-04-19T04:25:21.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.726 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:21.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698895+0000", 2024-04-19T04:25:21.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014286100000000001 2024-04-19T04:25:21.726 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.726 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:21.726 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.726 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:78079 5.6 5:6619ac32:::benchmark_data_smithi007_19526_object78078:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.726 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:21.695892+0000", 2024-04-19T04:25:21.726 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00744855, 2024-04-19T04:25:21.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0078792429999999993, 2024-04-19T04:25:21.727 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:21.727 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:21.727 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:21.727 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:21.727 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.727 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 78079 2024-04-19T04:25:21.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.727 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:21.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:21.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695892+0000", 2024-04-19T04:25:21.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:21.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695892+0000", 2024-04-19T04:25:21.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:21.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695891+0000", 2024-04-19T04:25:21.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:21.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695957+0000", 2024-04-19T04:25:21.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6194999999999999e-05 2024-04-19T04:25:21.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:21.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695969+0000", 2024-04-19T04:25:21.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1292e-05 2024-04-19T04:25:21.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.695976+0000", 2024-04-19T04:25:21.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6109999999999996e-06 2024-04-19T04:25:21.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.730 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:21.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696028+0000", 2024-04-19T04:25:21.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1347999999999997e-05 2024-04-19T04:25:21.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.730 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:21.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696180+0000", 2024-04-19T04:25:21.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015262000000000001 2024-04-19T04:25:21.730 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.730 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:21.730 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.731 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.731 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:78080 5.6 5:6b642a6b:::benchmark_data_smithi007_19526_object78079:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.731 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:21.696475+0000", 2024-04-19T04:25:21.731 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0068662239999999998, 2024-04-19T04:25:21.731 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0073682859999999999, 2024-04-19T04:25:21.731 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:21.731 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:21.731 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:21.731 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:21.731 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.731 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 78080 2024-04-19T04:25:21.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.731 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:21.731 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.731 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:21.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696475+0000", 2024-04-19T04:25:21.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:21.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696475+0000", 2024-04-19T04:25:21.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:21.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696474+0000", 2024-04-19T04:25:21.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:21.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696596+0000", 2024-04-19T04:25:21.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122373 2024-04-19T04:25:21.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:21.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696611+0000", 2024-04-19T04:25:21.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5182e-05 2024-04-19T04:25:21.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696619+0000", 2024-04-19T04:25:21.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9950000000000005e-06 2024-04-19T04:25:21.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:21.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698779+0000", 2024-04-19T04:25:21.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0021597000000000001 2024-04-19T04:25:21.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:21.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698885+0000", 2024-04-19T04:25:21.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000106013 2024-04-19T04:25:21.734 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.735 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:21.735 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.735 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:78081 5.f 5:f76b6fd4:::benchmark_data_smithi007_19526_object78080:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.735 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:21.696627+0000", 2024-04-19T04:25:21.735 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0067137000000000004, 2024-04-19T04:25:21.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0072893209999999996, 2024-04-19T04:25:21.735 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:21.735 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:21.735 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:21.735 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:21.735 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.735 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 78081 2024-04-19T04:25:21.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.736 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:21.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:21.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696627+0000", 2024-04-19T04:25:21.736 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:21.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696627+0000", 2024-04-19T04:25:21.736 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:21.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696626+0000", 2024-04-19T04:25:21.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:21.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:21.737 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696676+0000", 2024-04-19T04:25:21.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9740000000000001e-05 2024-04-19T04:25:21.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:21.737 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696689+0000", 2024-04-19T04:25:21.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2561999999999999e-05 2024-04-19T04:25:21.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.738 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696695+0000", 2024-04-19T04:25:21.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5579999999999997e-06 2024-04-19T04:25:21.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.738 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.738 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:21.738 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.701601+0000", 2024-04-19T04:25:21.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0049060220000000003 2024-04-19T04:25:21.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.738 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.738 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:21.738 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.702080+0000", 2024-04-19T04:25:21.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000478729 2024-04-19T04:25:21.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.738 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.739 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:21.739 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.702268+0000", 2024-04-19T04:25:21.739 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00018793600000000001 2024-04-19T04:25:21.739 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.739 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:21.739 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.739 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:78084 5.f 5.7861b44f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.739 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:21.696745+0000", 2024-04-19T04:25:21.739 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0065957170000000001, 2024-04-19T04:25:21.739 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0072448010000000004, 2024-04-19T04:25:21.739 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:21.739 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:21.740 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:21.740 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:21.740 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.740 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 78084 2024-04-19T04:25:21.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.740 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:21.740 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.740 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:21.740 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696745+0000", 2024-04-19T04:25:21.740 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.740 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:21.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696745+0000", 2024-04-19T04:25:21.741 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:21.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696744+0000", 2024-04-19T04:25:21.741 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:21.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696840+0000", 2024-04-19T04:25:21.741 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.6039999999999995e-05 2024-04-19T04:25:21.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:21.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696854+0000", 2024-04-19T04:25:21.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3804e-05 2024-04-19T04:25:21.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.696861+0000", 2024-04-19T04:25:21.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0600000000000002e-06 2024-04-19T04:25:21.742 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.742 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:21.742 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.743 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:78085 5.1 5:86ff4bde:::benchmark_data_smithi007_19526_object78084:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.743 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:21.698087+0000", 2024-04-19T04:25:21.743 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0052535159999999997, 2024-04-19T04:25:21.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005963912, 2024-04-19T04:25:21.743 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:21.743 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:21.743 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:21.743 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:21.743 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.743 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 78085 2024-04-19T04:25:21.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.743 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:21.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.743 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:21.744 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698087+0000", 2024-04-19T04:25:21.744 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.744 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.744 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:21.744 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698087+0000", 2024-04-19T04:25:21.744 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.744 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.744 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:21.744 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698086+0000", 2024-04-19T04:25:21.744 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.744 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.745 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:21.745 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698249+0000", 2024-04-19T04:25:21.745 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016251500000000001 2024-04-19T04:25:21.745 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.745 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.745 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:21.745 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698260+0000", 2024-04-19T04:25:21.745 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0730999999999999e-05 2024-04-19T04:25:21.745 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.745 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.745 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.745 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698267+0000", 2024-04-19T04:25:21.745 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0620000000000003e-06 2024-04-19T04:25:21.745 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.745 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.746 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:21.746 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.701996+0000", 2024-04-19T04:25:21.746 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003729376 2024-04-19T04:25:21.746 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.746 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.746 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:21.746 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.702164+0000", 2024-04-19T04:25:21.746 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016839900000000001 2024-04-19T04:25:21.746 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.746 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:21.746 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.747 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.747 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:78086 5.9 5:91f6a4cc:::benchmark_data_smithi007_19526_object78085:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.747 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:21.698286+0000", 2024-04-19T04:25:21.747 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0050547359999999998, 2024-04-19T04:25:21.747 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0058386200000000001, 2024-04-19T04:25:21.747 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:21.747 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:21.747 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:21.747 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:21.747 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.747 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 78086 2024-04-19T04:25:21.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.747 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:21.748 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.748 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:21.748 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698286+0000", 2024-04-19T04:25:21.748 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.748 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.748 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:21.748 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698286+0000", 2024-04-19T04:25:21.748 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.748 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.748 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:21.748 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698285+0000", 2024-04-19T04:25:21.749 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.749 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.749 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:21.749 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698317+0000", 2024-04-19T04:25:21.749 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1372999999999999e-05 2024-04-19T04:25:21.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.749 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.749 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:21.749 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698325+0000", 2024-04-19T04:25:21.749 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5799999999999992e-06 2024-04-19T04:25:21.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.749 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.750 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.750 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698331+0000", 2024-04-19T04:25:21.750 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9490000000000001e-06 2024-04-19T04:25:21.750 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.750 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.750 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:21.750 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.701933+0000", 2024-04-19T04:25:21.750 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003601983 2024-04-19T04:25:21.750 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.750 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.750 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:21.750 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.702119+0000", 2024-04-19T04:25:21.750 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00018604400000000001 2024-04-19T04:25:21.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.751 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.751 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:21.751 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.702331+0000", 2024-04-19T04:25:21.751 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000212222 2024-04-19T04:25:21.751 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.751 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:21.751 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.751 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.751 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:78077 5.f e40/20)", 2024-04-19T04:25:21.751 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:21.698884+0000", 2024-04-19T04:25:21.752 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0044565059999999998, 2024-04-19T04:25:21.752 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005311634, 2024-04-19T04:25:21.752 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:21.752 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:21.752 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:21.752 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.752 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:21.752 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698884+0000", 2024-04-19T04:25:21.752 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.752 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.752 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:21.752 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698884+0000", 2024-04-19T04:25:21.752 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.753 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.753 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:21.753 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698883+0000", 2024-04-19T04:25:21.753 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.753 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.753 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:21.753 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698889+0000", 2024-04-19T04:25:21.753 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9580000000000004e-06 2024-04-19T04:25:21.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.753 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.753 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:21.753 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698899+0000", 2024-04-19T04:25:21.754 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.4360000000000008e-06 2024-04-19T04:25:21.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.754 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.754 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.754 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.698905+0000", 2024-04-19T04:25:21.754 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0639999999999999e-06 2024-04-19T04:25:21.754 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.754 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:21.754 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.754 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.754 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:78087 5.3 5:c30e8d49:::benchmark_data_smithi007_19526_object78086:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.754 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:21.699052+0000", 2024-04-19T04:25:21.754 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0042892850000000003, 2024-04-19T04:25:21.755 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0052065460000000003, 2024-04-19T04:25:21.755 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:21.755 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:21.755 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:21.755 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:21.755 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.755 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 78087 2024-04-19T04:25:21.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.755 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:21.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.755 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:21.755 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699052+0000", 2024-04-19T04:25:21.755 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.756 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:21.756 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699052+0000", 2024-04-19T04:25:21.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.756 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:21.756 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699050+0000", 2024-04-19T04:25:21.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:21.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.757 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:21.757 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699114+0000", 2024-04-19T04:25:21.757 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3467999999999996e-05 2024-04-19T04:25:21.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.757 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.757 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:21.757 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699132+0000", 2024-04-19T04:25:21.757 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8006e-05 2024-04-19T04:25:21.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.757 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.757 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.757 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699139+0000", 2024-04-19T04:25:21.758 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7190000000000001e-06 2024-04-19T04:25:21.758 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.758 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.758 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:21.758 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699209+0000", 2024-04-19T04:25:21.758 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9224e-05 2024-04-19T04:25:21.758 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.758 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.758 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:21.758 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699409+0000", 2024-04-19T04:25:21.758 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000200225 2024-04-19T04:25:21.758 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.758 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:21.758 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.759 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.759 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:78088 5.2 5:49179411:::benchmark_data_smithi007_19526_object78087:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.759 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:21.699157+0000", 2024-04-19T04:25:21.759 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0041838789999999997, 2024-04-19T04:25:21.759 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0051833000000000001, 2024-04-19T04:25:21.759 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:21.759 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:21.759 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:21.759 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:21.759 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.759 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 78088 2024-04-19T04:25:21.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.759 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:21.759 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.760 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:21.760 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699157+0000", 2024-04-19T04:25:21.760 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.760 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.760 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.760 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:21.760 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699157+0000", 2024-04-19T04:25:21.760 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.761 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.761 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:21.761 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699156+0000", 2024-04-19T04:25:21.761 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.761 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.761 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:21.761 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699212+0000", 2024-04-19T04:25:21.761 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6013000000000001e-05 2024-04-19T04:25:21.761 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.761 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:21.761 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699238+0000", 2024-04-19T04:25:21.762 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6369000000000001e-05 2024-04-19T04:25:21.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.762 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.762 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.762 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699256+0000", 2024-04-19T04:25:21.762 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7435000000000002e-05 2024-04-19T04:25:21.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.762 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.762 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:21.762 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699333+0000", 2024-04-19T04:25:21.762 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7663999999999994e-05 2024-04-19T04:25:21.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.762 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.763 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:21.763 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.701701+0000", 2024-04-19T04:25:21.763 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002368092 2024-04-19T04:25:21.763 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.763 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:21.763 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.763 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.763 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:78089 5.5 5:af123ca9:::benchmark_data_smithi007_19526_object78088:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.763 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:21.699566+0000", 2024-04-19T04:25:21.763 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0037743439999999998, 2024-04-19T04:25:21.763 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0048778420000000003, 2024-04-19T04:25:21.763 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:21.763 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:21.764 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:21.764 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:21.764 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.764 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 78089 2024-04-19T04:25:21.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.764 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:21.764 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.764 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:21.764 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699566+0000", 2024-04-19T04:25:21.764 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.764 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.764 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:21.764 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699566+0000", 2024-04-19T04:25:21.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.765 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.765 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.765 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:21.765 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699565+0000", 2024-04-19T04:25:21.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:21.765 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.765 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.765 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:21.765 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699687+0000", 2024-04-19T04:25:21.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121416 2024-04-19T04:25:21.765 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.765 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.765 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:21.765 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699706+0000", 2024-04-19T04:25:21.766 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9062000000000001e-05 2024-04-19T04:25:21.766 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.766 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.766 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.766 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699720+0000", 2024-04-19T04:25:21.766 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.413e-05 2024-04-19T04:25:21.766 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.766 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.766 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:21.766 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699804+0000", 2024-04-19T04:25:21.766 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3799000000000002e-05 2024-04-19T04:25:21.766 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.766 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.767 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:21.767 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.700000+0000", 2024-04-19T04:25:21.767 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019631499999999999 2024-04-19T04:25:21.767 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.767 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:21.767 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.767 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.767 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:78090 5.7 5.115497f7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T04:25:21.767 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:21.699749+0000", 2024-04-19T04:25:21.767 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0035915980000000001, 2024-04-19T04:25:21.767 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0047616489999999997, 2024-04-19T04:25:21.767 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:21.767 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:21.768 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:21.768 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:21.768 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:21.768 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 78090 2024-04-19T04:25:21.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.768 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:21.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.768 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:21.768 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699749+0000", 2024-04-19T04:25:21.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.768 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:21.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699749+0000", 2024-04-19T04:25:21.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.769 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:21.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699748+0000", 2024-04-19T04:25:21.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.769 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:21.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699786+0000", 2024-04-19T04:25:21.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7873999999999997e-05 2024-04-19T04:25:21.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.770 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:21.770 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699796+0000", 2024-04-19T04:25:21.770 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7699999999999996e-06 2024-04-19T04:25:21.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.770 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.770 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.770 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.699804+0000", 2024-04-19T04:25:21.770 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7389999999999999e-06 2024-04-19T04:25:21.770 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.770 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:21.770 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.770 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.770 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:78078 5.f e40/20)", 2024-04-19T04:25:21.771 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:21.701120+0000", 2024-04-19T04:25:21.771 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0022203850000000001, 2024-04-19T04:25:21.771 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003421056, 2024-04-19T04:25:21.771 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:21.771 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:21.771 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:21.771 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.771 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:21.771 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.701120+0000", 2024-04-19T04:25:21.771 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.771 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.771 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:21.771 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.701120+0000", 2024-04-19T04:25:21.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:21.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.772 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:21.772 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.701119+0000", 2024-04-19T04:25:21.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:21.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.772 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:21.772 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.701126+0000", 2024-04-19T04:25:21.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2890000000000003e-06 2024-04-19T04:25:21.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.772 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:21.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.701138+0000", 2024-04-19T04:25:21.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2466999999999999e-05 2024-04-19T04:25:21.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:21.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:21.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:21.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:21.701147+0000", 2024-04-19T04:25:21.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3639999999999999e-06 2024-04-19T04:25:21.773 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.773 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:21.773 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.773 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:21.773 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:21.773 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 17 2024-04-19T04:25:21.773 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:21.774 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 37 16 78210 78194 132.069 127.062 0.016454 0.00756556 2024-04-19T04:25:21.775 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:21.776 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:21.770+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:21.876 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:21.870+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:21.902 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:25:21.907 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:21.907 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:21.907 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:21.908 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:21.908 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:21.921 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:21.977 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:21.974+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:21.987 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2024-04-19T04:25:22.052 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:22.052 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:22.052 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:22.053 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:22.053 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.053 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:22.053 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:22.053 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.517074852, 2024-04-19T04:25:22.053 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:25:22.053 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.053 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:22.053 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.053 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.053 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.053 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:22.053 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.054 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.054 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:22.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.054 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.054 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:25:22.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:22.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.054 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.054 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:25:22.055 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:25:22.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.055 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.055 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:25:22.055 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:25:22.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.055 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.055 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:25:22.055 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:25:22.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.055 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.056 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:25:22.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:25:22.056 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.056 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:22.056 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:25:22.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:25:22.056 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.056 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.056 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:25:22.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:25:22.056 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:22.057 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:25:22.057 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:25:22.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.057 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:22.057 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:25:22.057 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:25:22.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.057 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:22.057 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:25:22.057 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:25:22.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.058 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:22.058 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:25:22.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:25:22.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.058 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:22.058 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:25:22.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:25:22.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.058 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.058 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:25:22.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:25:22.059 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.059 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.059 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.059 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.059 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.059 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:22.059 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:22.059 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.517020307000003, 2024-04-19T04:25:22.059 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:25:22.059 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.059 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:22.059 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.059 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.060 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.060 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:22.060 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.060 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.060 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.060 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.060 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:22.061 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.061 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:25:22.061 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:22.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.061 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:25:22.061 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:25:22.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:25:22.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:25:22.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:25:22.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:25:22.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:25:22.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:25:22.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:22.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:25:22.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:25:22.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:25:22.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:25:22.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:22.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:25:22.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:25:22.064 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.064 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.064 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:22.064 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:25:22.064 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:25:22.064 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.064 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.064 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:22.064 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:25:22.064 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:25:22.064 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.064 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.064 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:22.064 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:25:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:25:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:25:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:25:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:25:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:25:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.066 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:22.066 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:22.066 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.819705720999998, 2024-04-19T04:25:22.066 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:22.066 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.066 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:22.066 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:22.066 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:22.066 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:22.066 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:22.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.066 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:22.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:22.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:22.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:22.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.068 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.068 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:22.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:22.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.068 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.068 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:22.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:22.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.068 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.068 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:22.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:22.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:22.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:22.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:22.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:22.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:22.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:22.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:22.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:22.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.070 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:22.070 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:22.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:22.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.070 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:22.070 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:22.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:22.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.070 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:22.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:22.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:22.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:22.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:22.071 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.071 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.071 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.071 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:22.071 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:22.071 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.816524565000002, 2024-04-19T04:25:22.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:22.072 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.072 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:22.072 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:22.072 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:22.072 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:22.072 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:22.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.072 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:22.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:22.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:22.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:22.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:22.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:22.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:22.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:22.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:22.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:22.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:22.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:22.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:22.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:22.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:22.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:22.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:22.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:22.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:22.076 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:22.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:22.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.076 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:22.076 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:22.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:22.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.076 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:22.076 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:22.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:22.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.076 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:22.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:22.077 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.077 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.077 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.077 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:22.077 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:22.077 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.815956460999999, 2024-04-19T04:25:22.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:22.077 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.077 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:22.077 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:22.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:22.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:22.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:22.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:22.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:22.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:22.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:22.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:22.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:22.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:22.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:22.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:22.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:22.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:22.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.081 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:22.081 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:22.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:22.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.081 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.081 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.081 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:22.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:22.081 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.081 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.081 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.081 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.081 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:22.082 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:22.082 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.815610800000002, 2024-04-19T04:25:22.082 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:22.082 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.082 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:22.082 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:22.082 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:22.082 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:22.082 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:22.082 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.082 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.082 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:22.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:22.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:22.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:22.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:22.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:22.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:22.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:22.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:22.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:22.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:22.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:22.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:22.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:22.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:22.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:22.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:22.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:22.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.086 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:22.086 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:22.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:22.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.086 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:22.086 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:22.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:22.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:22.087 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:22.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:22.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.087 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:22.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:22.087 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.087 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.087 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.088 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:22.088 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:22.088 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.814886361999999, 2024-04-19T04:25:22.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:22.088 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.088 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:22.088 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:22.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:22.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:22.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:22.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:22.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:22.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:22.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:22.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.090 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:22.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:22.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.090 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:22.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:22.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:22.091 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:22.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:22.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:22.091 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:22.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:22.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.092 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:22.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:22.092 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.092 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.092 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.092 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:22.092 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:22.092 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.814878966999999, 2024-04-19T04:25:22.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:22.092 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.092 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:22.093 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:22.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:22.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:22.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:22.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:22.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:22.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:22.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:22.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:22.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:22.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:22.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:22.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:22.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:22.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:22.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:22.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:22.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:22.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:22.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:22.097 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.097 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.097 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.097 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:22.097 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:22.097 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.81305382, 2024-04-19T04:25:22.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:22.097 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.097 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:22.098 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:22.098 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:22.098 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:22.098 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:22.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.098 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:22.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:22.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:22.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:22.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:22.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:22.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:22.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:22.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:22.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:22.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:22.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:22.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:22.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:22.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:22.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:22.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:22.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:22.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:22.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:22.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:22.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:22.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:22.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:22.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:22.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:22.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:22.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:22.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:22.102 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.103 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.103 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.103 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26148 5.9 e27/20 ondisk, result = 0)", 2024-04-19T04:25:22.103 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:22.103 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.812953494999999, 2024-04-19T04:25:22.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.042005175999999998, 2024-04-19T04:25:22.103 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.103 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:22.103 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:22.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:22.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238276+0000", 2024-04-19T04:25:22.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:22.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238280+0000", 2024-04-19T04:25:22.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6399999999999999e-06 2024-04-19T04:25:22.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238286+0000", 2024-04-19T04:25:22.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2099999999999998e-06 2024-04-19T04:25:22.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238290+0000", 2024-04-19T04:25:22.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2470000000000002e-06 2024-04-19T04:25:22.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239526+0000", 2024-04-19T04:25:22.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012362619999999999 2024-04-19T04:25:22.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:22.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239538+0000", 2024-04-19T04:25:22.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1620999999999999e-05 2024-04-19T04:25:22.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280282+0000", 2024-04-19T04:25:22.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040743691999999998 2024-04-19T04:25:22.106 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.106 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.107 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.107 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:22.107 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:22.107 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.812319615, 2024-04-19T04:25:22.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:22.107 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.107 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:22.107 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:22.108 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:22.108 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:22.108 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:22.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.108 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:22.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:22.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:22.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:22.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:22.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:22.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:22.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:22.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:22.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:22.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:22.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:22.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:22.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:22.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:22.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:22.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:22.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:22.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:22.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:22.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:22.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.112 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:22.112 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:22.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:22.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.112 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:22.112 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:22.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:22.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.112 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:22.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:22.113 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.113 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.113 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.113 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.113 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:22.113 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:22.113 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.811785339, 2024-04-19T04:25:22.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:22.113 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.113 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:22.113 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:22.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:22.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:22.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:22.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:22.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:22.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:22.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:22.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:22.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:22.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.116 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:22.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:22.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.116 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:22.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:22.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:22.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.117 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:22.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:22.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:22.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.117 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:22.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:22.117 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.117 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.117 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.117 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26160 5.f e27/20 ondisk, result = 0)", 2024-04-19T04:25:22.117 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:22.118 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.810669963999999, 2024-04-19T04:25:22.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039752357000000002, 2024-04-19T04:25:22.118 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.118 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:22.118 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:22.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:22.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240559+0000", 2024-04-19T04:25:22.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:22.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240569+0000", 2024-04-19T04:25:22.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7720000000000006e-06 2024-04-19T04:25:22.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280164+0000", 2024-04-19T04:25:22.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039595324000000001 2024-04-19T04:25:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280190+0000", 2024-04-19T04:25:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5692000000000001e-05 2024-04-19T04:25:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280287+0000", 2024-04-19T04:25:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7536999999999998e-05 2024-04-19T04:25:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280299+0000", 2024-04-19T04:25:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2057e-05 2024-04-19T04:25:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3244999999999999e-05 2024-04-19T04:25:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26179 5.3 e27/20 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head v 27'1624, mlcod=27'1621)", 2024-04-19T04:25:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.807516211999999, 2024-04-19T04:25:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039964081999999998, 2024-04-19T04:25:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243713+0000", 2024-04-19T04:25:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243750+0000", 2024-04-19T04:25:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6704e-05 2024-04-19T04:25:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280162+0000", 2024-04-19T04:25:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036412117000000001 2024-04-19T04:25:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280186+0000", 2024-04-19T04:25:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4825999999999999e-05 2024-04-19T04:25:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012540000000000001 2024-04-19T04:25:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280347+0000", 2024-04-19T04:25:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4894000000000002e-05 2024-04-19T04:25:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283654+0000", 2024-04-19T04:25:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00330716 2024-04-19T04:25:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283678+0000", 2024-04-19T04:25:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3992e-05 2024-04-19T04:25:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 6.0949301499999997, 2024-04-19T04:25:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 6.0746997010000001, 2024-04-19T04:25:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:22.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:22.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:22.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:22.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 6.0745918440000004, 2024-04-19T04:25:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 6.0726251549999999, 2024-04-19T04:25:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 6.0692609600000003, 2024-04-19T04:25:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 6.0654499819999996, 2024-04-19T04:25:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:22.160 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:22.161 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:22.162 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:22.163 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:22.163 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:22.158+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:22.163 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:22.163 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:22.164 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:22.262 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:22.258+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:22.289 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:22.289 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:22.302 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:22.363 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:22.362+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:22.422 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:22.422 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:22.435 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:22.464 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:22.462+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:22.565 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:22.565 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:22.565 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:22.562+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:22.578 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:22.666 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:22.666+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:22.712 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:22.713 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:22.725 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:22.754 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 38 16 80300 80284 132.03 130.625 0.0050957 0.00756818 2024-04-19T04:25:22.766 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2024-04-19T04:25:22.767 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:22.766+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:22.854 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:22.854 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:22.867 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:22.869 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:22.866+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:22.970 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:22.970+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:22.999 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:22.999 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:23.012 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:23.070 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:23.065+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:23.141 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:23.141 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:23.152 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:23.172 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:23.169+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:23.274 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:23.270+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:23.279 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:23.279 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:23.292 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:23.374 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:23.369+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:23.415 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:23.415 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:23.427 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:23.475 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:23.469+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:23.565 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:23.565 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:23.575 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:23.574+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:23.577 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:23.676 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:23.674+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:23.711 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:23.711 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:23.724 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:23.754 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 39 16 82393 82377 131.999 130.812 0.00579527 0.00756937 2024-04-19T04:25:23.777 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:23.774+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:23.860 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:23.860 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:23.874 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:23.878 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:23.873+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:23.979 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:23.978+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:24.001 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T04:25:24.008 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:24.008 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:24.020 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:24.080 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:24.073+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:24.144 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:24.145 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:24.158 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:24.165 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:25:24.180 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:24.177+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:24.281 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:24.278+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:24.286 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:24.287 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:24.299 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:24.311 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:24.332 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:24.332 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:24.332 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:24.332 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:24.336 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:24.336 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:24.382 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:24.377+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:24.430 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:24.430 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:24.430 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.430 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:83765 5.9 5:9d5f5cc8:::benchmark_data_smithi007_19526_object83764:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T04:25:24.430 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:24.422703+0000", 2024-04-19T04:25:24.430 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0072411189999999999, 2024-04-19T04:25:24.430 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0072696849999999997, 2024-04-19T04:25:24.430 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.430 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:24.431 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.431 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.431 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.431 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 83765 2024-04-19T04:25:24.431 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.431 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.431 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.431 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.431 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.422703+0000", 2024-04-19T04:25:24.431 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.431 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.431 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.431 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.431 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.422703+0000", 2024-04-19T04:25:24.432 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.432 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.432 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.432 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.432 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.422702+0000", 2024-04-19T04:25:24.432 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.432 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.432 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.432 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.432 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.422767+0000", 2024-04-19T04:25:24.432 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5458999999999998e-05 2024-04-19T04:25:24.432 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.432 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.432 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.432 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.422784+0000", 2024-04-19T04:25:24.433 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7036000000000001e-05 2024-04-19T04:25:24.433 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.433 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.433 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.433 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.422793+0000", 2024-04-19T04:25:24.433 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6349999999999995e-06 2024-04-19T04:25:24.433 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.433 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.433 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.433 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.425751+0000", 2024-04-19T04:25:24.433 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0029584469999999999 2024-04-19T04:25:24.433 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.433 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.433 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.433 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.425848+0000", 2024-04-19T04:25:24.434 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.6553999999999997e-05 2024-04-19T04:25:24.434 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.434 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.434 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:24.434 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.425942+0000", 2024-04-19T04:25:24.434 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.4450000000000005e-05 2024-04-19T04:25:24.434 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.434 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.434 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.434 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.434 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.434 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:83769 5.d 5:b4060be5:::benchmark_data_smithi007_19526_object83768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T04:25:24.434 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:24.426815+0000", 2024-04-19T04:25:24.435 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.003129059, 2024-04-19T04:25:24.435 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032441380000000001, 2024-04-19T04:25:24.435 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.435 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:24.435 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.435 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.435 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.435 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 83769 2024-04-19T04:25:24.435 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.435 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.435 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.435 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.435 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.426815+0000", 2024-04-19T04:25:24.435 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.436 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.436 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.436 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.436 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.426815+0000", 2024-04-19T04:25:24.436 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.436 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.436 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.436 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.436 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.426814+0000", 2024-04-19T04:25:24.436 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.436 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.436 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.436 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.436 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.426864+0000", 2024-04-19T04:25:24.437 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0036e-05 2024-04-19T04:25:24.437 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.437 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.437 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.437 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.426879+0000", 2024-04-19T04:25:24.437 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5098e-05 2024-04-19T04:25:24.437 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.437 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.437 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.437 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.426901+0000", 2024-04-19T04:25:24.437 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1614999999999999e-05 2024-04-19T04:25:24.437 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.437 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.437 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.437 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.427021+0000", 2024-04-19T04:25:24.438 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012026199999999999 2024-04-19T04:25:24.438 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.438 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.438 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.438 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.427149+0000", 2024-04-19T04:25:24.438 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012757299999999999 2024-04-19T04:25:24.438 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.438 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.438 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:24.438 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.427234+0000", 2024-04-19T04:25:24.438 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5830999999999999e-05 2024-04-19T04:25:24.438 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.438 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.439 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.439 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.439 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.439 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:83771 5.3 5:c3697bd5:::benchmark_data_smithi007_19526_object83770:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T04:25:24.439 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:24.426951+0000", 2024-04-19T04:25:24.439 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.002993211, 2024-04-19T04:25:24.439 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031861609999999999, 2024-04-19T04:25:24.439 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.439 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:24.439 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.439 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.439 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.439 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 83771 2024-04-19T04:25:24.439 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.439 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.440 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.440 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.440 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.426951+0000", 2024-04-19T04:25:24.440 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.440 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.440 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.440 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.440 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.426951+0000", 2024-04-19T04:25:24.440 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.440 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.440 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.440 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.440 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.426950+0000", 2024-04-19T04:25:24.440 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.441 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.441 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.441 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.441 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.427030+0000", 2024-04-19T04:25:24.441 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0403999999999998e-05 2024-04-19T04:25:24.441 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.441 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.441 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.441 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.427049+0000", 2024-04-19T04:25:24.441 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8726999999999999e-05 2024-04-19T04:25:24.441 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.441 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.441 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.441 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.427057+0000", 2024-04-19T04:25:24.441 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.678e-06 2024-04-19T04:25:24.442 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.442 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.442 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.442 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.427128+0000", 2024-04-19T04:25:24.442 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1045999999999997e-05 2024-04-19T04:25:24.442 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.442 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.442 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.442 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.427282+0000", 2024-04-19T04:25:24.442 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0001538 2024-04-19T04:25:24.442 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.442 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.442 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.442 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.443 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.443 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:83772 5.3 5:cc198102:::benchmark_data_smithi007_19526_object83771:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T04:25:24.443 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:24.427075+0000", 2024-04-19T04:25:24.443 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0028689990000000001, 2024-04-19T04:25:24.443 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031314429999999998, 2024-04-19T04:25:24.443 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.443 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:24.443 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.443 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.443 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.443 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 83772 2024-04-19T04:25:24.443 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.443 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.443 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.444 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.444 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.427075+0000", 2024-04-19T04:25:24.444 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.444 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.444 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.444 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.444 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.427075+0000", 2024-04-19T04:25:24.444 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.444 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.444 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.444 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.444 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.427074+0000", 2024-04-19T04:25:24.444 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:24.444 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.444 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.445 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.445 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.427116+0000", 2024-04-19T04:25:24.445 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1956000000000003e-05 2024-04-19T04:25:24.445 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.445 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.445 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.445 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.427126+0000", 2024-04-19T04:25:24.445 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.6369999999999994e-06 2024-04-19T04:25:24.445 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.445 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.445 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.445 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.427133+0000", 2024-04-19T04:25:24.445 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.832e-06 2024-04-19T04:25:24.446 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.446 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.446 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.446 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429981+0000", 2024-04-19T04:25:24.446 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028481980000000001 2024-04-19T04:25:24.446 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.446 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.446 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.446 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.430060+0000", 2024-04-19T04:25:24.446 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.873e-05 2024-04-19T04:25:24.446 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.446 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.446 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.446 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.447 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.447 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:83774 5.6 5:6694e1b1:::benchmark_data_smithi007_19526_object83773:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T04:25:24.447 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:24.428449+0000", 2024-04-19T04:25:24.447 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0014954569999999999, 2024-04-19T04:25:24.447 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001828896, 2024-04-19T04:25:24.447 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.447 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:24.447 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.447 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.447 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.447 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 83774 2024-04-19T04:25:24.447 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.447 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.447 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.448 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.448 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.428449+0000", 2024-04-19T04:25:24.448 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.448 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.448 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.448 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.448 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.428449+0000", 2024-04-19T04:25:24.448 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.448 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.448 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.448 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.448 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.428448+0000", 2024-04-19T04:25:24.448 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.448 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.449 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.449 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.449 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.428533+0000", 2024-04-19T04:25:24.449 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5288000000000001e-05 2024-04-19T04:25:24.449 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.449 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.449 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.449 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.428550+0000", 2024-04-19T04:25:24.449 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7405e-05 2024-04-19T04:25:24.449 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.449 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.449 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.449 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.428564+0000", 2024-04-19T04:25:24.449 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3536000000000001e-05 2024-04-19T04:25:24.450 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.450 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.450 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.450 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.428624+0000", 2024-04-19T04:25:24.450 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9802000000000001e-05 2024-04-19T04:25:24.450 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.450 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.450 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.450 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.428816+0000", 2024-04-19T04:25:24.450 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019208800000000001 2024-04-19T04:25:24.450 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.450 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.450 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.450 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.451 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.451 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:83775 5.5 5:a852f9bd:::benchmark_data_smithi007_19526_object83774:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T04:25:24.451 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:24.429266+0000", 2024-04-19T04:25:24.451 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00067847199999999995, 2024-04-19T04:25:24.451 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00108044, 2024-04-19T04:25:24.451 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.451 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:24.451 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.451 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.451 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.451 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 83775 2024-04-19T04:25:24.451 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.451 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.451 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.451 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.452 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429266+0000", 2024-04-19T04:25:24.452 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.452 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.452 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.452 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.452 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429266+0000", 2024-04-19T04:25:24.452 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.452 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.452 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.452 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.452 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429264+0000", 2024-04-19T04:25:24.452 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:24.452 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.452 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.453 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.453 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429319+0000", 2024-04-19T04:25:24.453 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5346999999999997e-05 2024-04-19T04:25:24.453 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.453 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.453 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.453 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429333+0000", 2024-04-19T04:25:24.453 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3912e-05 2024-04-19T04:25:24.453 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.453 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.453 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.453 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429340+0000", 2024-04-19T04:25:24.453 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5690000000000001e-06 2024-04-19T04:25:24.453 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.453 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.454 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.454 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429403+0000", 2024-04-19T04:25:24.454 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2661000000000002e-05 2024-04-19T04:25:24.454 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.454 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.454 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.454 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429636+0000", 2024-04-19T04:25:24.454 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000233451 2024-04-19T04:25:24.454 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.454 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.454 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.454 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.454 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.454 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:83776 5.5 5.2849df15 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T04:25:24.454 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:24.429357+0000", 2024-04-19T04:25:24.455 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00058666800000000004, 2024-04-19T04:25:24.455 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0010524099999999999, 2024-04-19T04:25:24.455 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.455 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:24.455 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.455 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.455 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.455 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 83776 2024-04-19T04:25:24.455 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.455 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.455 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.455 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.455 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429357+0000", 2024-04-19T04:25:24.455 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.455 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.456 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.456 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.456 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429357+0000", 2024-04-19T04:25:24.456 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.456 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.456 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.456 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.456 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429356+0000", 2024-04-19T04:25:24.456 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.456 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.456 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.456 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.456 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429461+0000", 2024-04-19T04:25:24.456 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010425999999999999 2024-04-19T04:25:24.457 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.457 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.457 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.457 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429472+0000", 2024-04-19T04:25:24.457 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1654000000000001e-05 2024-04-19T04:25:24.457 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.457 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.457 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.457 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429489+0000", 2024-04-19T04:25:24.457 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6629e-05 2024-04-19T04:25:24.457 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.457 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.457 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.457 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.457 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.458 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:83778 5.c 5:3dd1f528:::benchmark_data_smithi007_19526_object83777:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T04:25:24.458 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:24.429531+0000", 2024-04-19T04:25:24.458 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00041271599999999998, 2024-04-19T04:25:24.458 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00093964000000000005, 2024-04-19T04:25:24.458 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.458 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:24.458 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.458 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.458 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.458 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 83778 2024-04-19T04:25:24.458 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.458 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.458 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.458 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.459 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429531+0000", 2024-04-19T04:25:24.459 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.459 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.459 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.459 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429531+0000", 2024-04-19T04:25:24.459 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.459 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.459 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.459 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429530+0000", 2024-04-19T04:25:24.459 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.459 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.460 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.460 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429610+0000", 2024-04-19T04:25:24.460 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0032999999999998e-05 2024-04-19T04:25:24.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.460 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.460 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429622+0000", 2024-04-19T04:25:24.460 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1878999999999999e-05 2024-04-19T04:25:24.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.460 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.460 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429641+0000", 2024-04-19T04:25:24.460 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8530999999999999e-05 2024-04-19T04:25:24.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.461 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.461 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429714+0000", 2024-04-19T04:25:24.461 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3792000000000001e-05 2024-04-19T04:25:24.461 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.461 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.461 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.461 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:24.429955+0000", 2024-04-19T04:25:24.461 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00024062199999999999 2024-04-19T04:25:24.461 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.461 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.461 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.461 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.461 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:24.461 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 8 2024-04-19T04:25:24.461 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:24.463 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:24.508 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:24.505+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:24.583 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:24.577+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:24.599 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:24.599 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:24.600 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:24.600 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:24.600 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:24.613 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:24.684 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:24.681+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:24.746 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 64.210149477000002, 2024-04-19T04:25:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:25:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:25:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:25:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:25:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:25:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:25:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:25:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:25:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:25:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:25:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:25:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:25:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:25:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:25:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:25:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:25:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:25:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:25:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:25:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:25:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:25:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:25:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:25:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:25:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:25:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:25:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 64.210094932000004, 2024-04-19T04:25:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:25:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:25:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:25:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:25:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:25:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:25:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:25:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:25:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:25:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:25:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:25:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:25:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:25:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:25:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:25:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:25:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:25:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:25:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:25:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:25:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:25:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:25:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:25:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:25:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:25:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:25:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.512780346, 2024-04-19T04:25:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.509599189999999, 2024-04-19T04:25:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.509031086, 2024-04-19T04:25:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.508685424999999, 2024-04-19T04:25:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.507960987000001, 2024-04-19T04:25:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.507953592, 2024-04-19T04:25:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.506128445000002, 2024-04-19T04:25:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26148 5.9 e27/20 ondisk, result = 0)", 2024-04-19T04:25:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.50602812, 2024-04-19T04:25:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.042005175999999998, 2024-04-19T04:25:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238276+0000", 2024-04-19T04:25:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238280+0000", 2024-04-19T04:25:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6399999999999999e-06 2024-04-19T04:25:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238286+0000", 2024-04-19T04:25:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2099999999999998e-06 2024-04-19T04:25:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238290+0000", 2024-04-19T04:25:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2470000000000002e-06 2024-04-19T04:25:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239526+0000", 2024-04-19T04:25:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012362619999999999 2024-04-19T04:25:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239538+0000", 2024-04-19T04:25:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1620999999999999e-05 2024-04-19T04:25:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280282+0000", 2024-04-19T04:25:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040743691999999998 2024-04-19T04:25:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.505394240000001, 2024-04-19T04:25:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.504859964000001, 2024-04-19T04:25:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26160 5.f e27/20 ondisk, result = 0)", 2024-04-19T04:25:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.503744589, 2024-04-19T04:25:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039752357000000002, 2024-04-19T04:25:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240559+0000", 2024-04-19T04:25:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240569+0000", 2024-04-19T04:25:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7720000000000006e-06 2024-04-19T04:25:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280164+0000", 2024-04-19T04:25:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039595324000000001 2024-04-19T04:25:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280190+0000", 2024-04-19T04:25:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5692000000000001e-05 2024-04-19T04:25:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280287+0000", 2024-04-19T04:25:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7536999999999998e-05 2024-04-19T04:25:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280299+0000", 2024-04-19T04:25:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2057e-05 2024-04-19T04:25:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3244999999999999e-05 2024-04-19T04:25:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26179 5.3 e27/20 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head v 27'1624, mlcod=27'1621)", 2024-04-19T04:25:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.500590837000001, 2024-04-19T04:25:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039964081999999998, 2024-04-19T04:25:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243713+0000", 2024-04-19T04:25:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243750+0000", 2024-04-19T04:25:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6704e-05 2024-04-19T04:25:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280162+0000", 2024-04-19T04:25:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036412117000000001 2024-04-19T04:25:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280186+0000", 2024-04-19T04:25:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4825999999999999e-05 2024-04-19T04:25:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012540000000000001 2024-04-19T04:25:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280347+0000", 2024-04-19T04:25:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4894000000000002e-05 2024-04-19T04:25:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283654+0000", 2024-04-19T04:25:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00330716 2024-04-19T04:25:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283678+0000", 2024-04-19T04:25:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3992e-05 2024-04-19T04:25:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.7880047749999992, 2024-04-19T04:25:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.7677743259999996, 2024-04-19T04:25:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.7676664689999999, 2024-04-19T04:25:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.7656997800000003, 2024-04-19T04:25:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.7623355850000006, 2024-04-19T04:25:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.758524607, 2024-04-19T04:25:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:24.859 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:24.860 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:2024-04-19T04:25:24.755040+0000 min lat: 0.00185991 max lat: 1.03693 avg lat: 0.00757478 2024-04-19T04:25:24.860 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-19T04:25:24.860 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 40 16 84449 84433 131.911 128.5 0.00387179 0.00757478 2024-04-19T04:25:24.861 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:24.858+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:24.861 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:24.962 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:24.962+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:24.990 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:24.990 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:24.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.990 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:84923 5.0 5:042c3bf2:::benchmark_data_smithi007_19526_object84922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T04:25:24.990 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:24.987393+0000", 2024-04-19T04:25:24.991 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.003135283, 2024-04-19T04:25:24.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031619510000000001, 2024-04-19T04:25:24.991 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:24.991 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:24.991 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:24.991 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:24.991 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.991 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 84923 2024-04-19T04:25:24.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.991 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:24.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:24.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.987393+0000", 2024-04-19T04:25:24.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:24.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:24.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.987393+0000", 2024-04-19T04:25:24.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:24.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:24.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.987391+0000", 2024-04-19T04:25:24.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:24.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.987492+0000", 2024-04-19T04:25:24.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100225 2024-04-19T04:25:24.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:24.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.987502+0000", 2024-04-19T04:25:24.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0781000000000001e-05 2024-04-19T04:25:24.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.987511+0000", 2024-04-19T04:25:24.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0790000000000001e-06 2024-04-19T04:25:24.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:24.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.987563+0000", 2024-04-19T04:25:24.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.219e-05 2024-04-19T04:25:24.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.994 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:24.994 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.987691+0000", 2024-04-19T04:25:24.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128114 2024-04-19T04:25:24.994 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:24.994 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:24.994 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:24.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.994 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:84924 5.f e41/20 5:f4d8d757:::benchmark_data_smithi007_19526_object84923:head v 41'5162, mlcod=41'5159)", 2024-04-19T04:25:24.994 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:24.987891+0000", 2024-04-19T04:25:24.995 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002637332, 2024-04-19T04:25:24.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00274063, 2024-04-19T04:25:24.995 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:24.995 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:24.995 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:24.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:24.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.987891+0000", 2024-04-19T04:25:24.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:24.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:24.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.987891+0000", 2024-04-19T04:25:24.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:24.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:24.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.987889+0000", 2024-04-19T04:25:24.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:24.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:24.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.987953+0000", 2024-04-19T04:25:24.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4046000000000003e-05 2024-04-19T04:25:24.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:24.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.987964+0000", 2024-04-19T04:25:24.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1001e-05 2024-04-19T04:25:24.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:24.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.987972+0000", 2024-04-19T04:25:24.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6769999999999995e-06 2024-04-19T04:25:24.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:24.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.988013+0000", 2024-04-19T04:25:24.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0639000000000002e-05 2024-04-19T04:25:24.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:24.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.988034+0000", 2024-04-19T04:25:24.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1483000000000001e-05 2024-04-19T04:25:24.998 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:24.998 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:24.998 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:24.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.998 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:84929 5.4 5:2b877913:::benchmark_data_smithi007_19526_object84928:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T04:25:24.998 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:24.988167+0000", 2024-04-19T04:25:24.998 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0023604189999999999, 2024-04-19T04:25:24.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025376629999999999, 2024-04-19T04:25:24.998 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:24.998 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:24.998 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:24.998 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:24.998 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:24.999 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 84929 2024-04-19T04:25:24.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.999 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:24.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:24.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.988167+0000", 2024-04-19T04:25:24.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:24.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:24.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:24.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.988167+0000", 2024-04-19T04:25:24.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:24.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:24.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.988166+0000", 2024-04-19T04:25:25.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.988274+0000", 2024-04-19T04:25:25.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107481 2024-04-19T04:25:25.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.988283+0000", 2024-04-19T04:25:25.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4660000000000005e-06 2024-04-19T04:25:25.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.988290+0000", 2024-04-19T04:25:25.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2009999999999996e-06 2024-04-19T04:25:25.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.988323+0000", 2024-04-19T04:25:25.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3751999999999998e-05 2024-04-19T04:25:25.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.988541+0000", 2024-04-19T04:25:25.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000217622 2024-04-19T04:25:25.002 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.002 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.002 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.002 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:84930 5.0 5:051c9e4d:::benchmark_data_smithi007_19526_object84929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T04:25:25.003 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:24.988683+0000", 2024-04-19T04:25:25.003 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001844921, 2024-04-19T04:25:25.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020852150000000001, 2024-04-19T04:25:25.003 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.003 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:25.003 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.003 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.003 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.003 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 84930 2024-04-19T04:25:25.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.003 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.988683+0000", 2024-04-19T04:25:25.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.988683+0000", 2024-04-19T04:25:25.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.988682+0000", 2024-04-19T04:25:25.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.988752+0000", 2024-04-19T04:25:25.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0083e-05 2024-04-19T04:25:25.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.988762+0000", 2024-04-19T04:25:25.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6900000000000004e-06 2024-04-19T04:25:25.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.988769+0000", 2024-04-19T04:25:25.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2099999999999996e-06 2024-04-19T04:25:25.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.990522+0000", 2024-04-19T04:25:25.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0017528310000000001 2024-04-19T04:25:25.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.990618+0000", 2024-04-19T04:25:25.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6315000000000002e-05 2024-04-19T04:25:25.006 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.006 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.006 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.006 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:84925 5.d e41/29 5:b7eff332:::benchmark_data_smithi007_19526_object84924:head v 41'5078, mlcod=41'5075)", 2024-04-19T04:25:25.006 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:24.989955+0000", 2024-04-19T04:25:25.006 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00057300500000000002, 2024-04-19T04:25:25.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00085030299999999995, 2024-04-19T04:25:25.007 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.007 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:25.007 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.989955+0000", 2024-04-19T04:25:25.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.989955+0000", 2024-04-19T04:25:25.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.989954+0000", 2024-04-19T04:25:25.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:25.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.990001+0000", 2024-04-19T04:25:25.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6745000000000001e-05 2024-04-19T04:25:25.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.990018+0000", 2024-04-19T04:25:25.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6784999999999999e-05 2024-04-19T04:25:25.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.990024+0000", 2024-04-19T04:25:25.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5980000000000002e-06 2024-04-19T04:25:25.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.990079+0000", 2024-04-19T04:25:25.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4598000000000001e-05 2024-04-19T04:25:25.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.990126+0000", 2024-04-19T04:25:25.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7286000000000001e-05 2024-04-19T04:25:25.009 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.010 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.010 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.010 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:84926 5.f e41/20)", 2024-04-19T04:25:25.010 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:24.990110+0000", 2024-04-19T04:25:25.010 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.000417737, 2024-04-19T04:25:25.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00072501399999999995, 2024-04-19T04:25:25.010 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.010 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:25.010 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.990110+0000", 2024-04-19T04:25:25.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.990110+0000", 2024-04-19T04:25:25.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.990110+0000", 2024-04-19T04:25:25.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:25.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.990189+0000", 2024-04-19T04:25:25.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9035000000000005e-05 2024-04-19T04:25:25.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.990197+0000", 2024-04-19T04:25:25.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5550000000000003e-06 2024-04-19T04:25:25.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.990203+0000", 2024-04-19T04:25:25.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9440000000000002e-06 2024-04-19T04:25:25.012 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.012 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.012 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.013 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:84916 5.e 5:7f23c52f:::benchmark_data_smithi007_19526_object84915:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T04:25:25.013 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:24.983947+0000", 2024-04-19T04:25:25.013 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0065804310000000003, 2024-04-19T04:25:25.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006917177, 2024-04-19T04:25:25.013 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.013 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:25.013 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.013 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.013 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.013 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 84916 2024-04-19T04:25:25.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.013 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.983947+0000", 2024-04-19T04:25:25.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.983947+0000", 2024-04-19T04:25:25.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.983946+0000", 2024-04-19T04:25:25.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.984010+0000", 2024-04-19T04:25:25.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3287999999999994e-05 2024-04-19T04:25:25.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.984021+0000", 2024-04-19T04:25:25.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0913999999999999e-05 2024-04-19T04:25:25.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.984030+0000", 2024-04-19T04:25:25.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7620000000000007e-06 2024-04-19T04:25:25.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.985623+0000", 2024-04-19T04:25:25.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001592881 2024-04-19T04:25:25.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.985784+0000", 2024-04-19T04:25:25.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016113100000000001 2024-04-19T04:25:25.016 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.016 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.016 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.016 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:84922 5.b 5:d1c2cd23:::benchmark_data_smithi007_19526_object84921:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T04:25:25.016 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:24.985446+0000", 2024-04-19T04:25:25.017 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0050815349999999999, 2024-04-19T04:25:25.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054556830000000002, 2024-04-19T04:25:25.017 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.017 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:25.017 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.017 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.017 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.017 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 84922 2024-04-19T04:25:25.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.017 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.985446+0000", 2024-04-19T04:25:25.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.018 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.985446+0000", 2024-04-19T04:25:25.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.018 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.985445+0000", 2024-04-19T04:25:25.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.018 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.985521+0000", 2024-04-19T04:25:25.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5506999999999994e-05 2024-04-19T04:25:25.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.985532+0000", 2024-04-19T04:25:25.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0857e-05 2024-04-19T04:25:25.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.985539+0000", 2024-04-19T04:25:25.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5039999999999996e-06 2024-04-19T04:25:25.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.985590+0000", 2024-04-19T04:25:25.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0433999999999999e-05 2024-04-19T04:25:25.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:24.985745+0000", 2024-04-19T04:25:25.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015543999999999999 2024-04-19T04:25:25.020 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.020 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.020 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.020 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.020 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:25.020 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 8 2024-04-19T04:25:25.020 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:25.022 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-04-19T04:25:25.022 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:25.063 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:25.057+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:25.164 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:25.162+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:25.189 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:25.189 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:25.189 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:25.189 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:25.189 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:25.202 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:25.265 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:25.261+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:25.321 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:25.322 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:25.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:25.322 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:25.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.322 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:25.322 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:25.322 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.084360695000001, 2024-04-19T04:25:25.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:25.322 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.322 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.322 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.322 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.323 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.323 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:25.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.323 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:25.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:25.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:25.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:25.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:25.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:25.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:25.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:25.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:25.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:25.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:25.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:25.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:25.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:25.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:25.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:25.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:25.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:25.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:25.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:25.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:25.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:25.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:25.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:25.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:25.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:25.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:25.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:25.328 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.328 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.328 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.328 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:25.328 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:25.328 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.079911779, 2024-04-19T04:25:25.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:25.329 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.329 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.329 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.329 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.329 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.329 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:25.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.329 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:25.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:25.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:25.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:25.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:25.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:25.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:25.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:25.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:25.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:25.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:25.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:25.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:25.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:25.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:25.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:25.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:25.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:25.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:25.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:25.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:25.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:25.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:25.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:25.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:25.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:25.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:25.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:25.334 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.334 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.334 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.334 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:25.334 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:25.334 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.251979536, 2024-04-19T04:25:25.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:25.334 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.335 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.335 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.335 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.335 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.335 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:25.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.335 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:25.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:25.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:25.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:25.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:25.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:25.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:25.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:25.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:25.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:25.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:25.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:25.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:25.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:25.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:25.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:25.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:25.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:25.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:25.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:25.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:25.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:25.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:25.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:25.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:25.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:25.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:25.339 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.339 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.340 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.340 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:25.340 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:25.340 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.816125499, 2024-04-19T04:25:25.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:25.340 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.340 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.340 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.340 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.340 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.340 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:25.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.341 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:25.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:25.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:25.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:25.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:25.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:25.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:25.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:25.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:25.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:25.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:25.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:25.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:25.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:25.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:25.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:25.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:25.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:25.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:25.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:25.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:25.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:25.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:25.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:25.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:25.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:25.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:25.346 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.346 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.346 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.346 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:25.346 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:25.346 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.8156950789999993, 2024-04-19T04:25:25.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:25.346 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.347 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.347 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.347 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.347 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.347 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:25.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.347 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:25.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:25.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:25.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:25.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:25.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:25.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:25.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:25.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:25.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:25.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:25.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:25.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:25.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:25.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:25.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:25.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:25.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:25.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:25.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:25.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:25.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:25.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:25.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:25.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:25.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:25.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:25.355 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.355 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.355 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.355 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:25.355 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:25.355 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.8134638150000004, 2024-04-19T04:25:25.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:25.355 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.355 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.355 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.355 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.355 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.355 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:25.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.356 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:25.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:25.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:25.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:25.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:25.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:25.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:25.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:25.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:25.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:25.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:25.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:25.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:25.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:25.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:25.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:25.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:25.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:25.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:25.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:25.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:25.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:25.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:25.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:25.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:25.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:25.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:25.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:25.360 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.360 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.360 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.360 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:25.360 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:25.361 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.8100667769999994, 2024-04-19T04:25:25.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:25.361 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.361 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.361 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.361 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.361 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.361 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:25.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.361 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:25.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:25.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:25.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:25.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:25.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:25.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:25.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:25.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:25.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:25.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:25.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:25.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:25.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:25.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:25.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:25.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:25.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:25.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:25.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:25.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:25.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:25.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:25.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:25.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:25.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:25.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:25.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:25.366 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.366 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.366 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.366 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:25.366 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:25.367 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.8049385789999999, 2024-04-19T04:25:25.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:25.367 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.367 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.367 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.367 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.367 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.367 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:25.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.367 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:25.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:25.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:25.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:25.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:25.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:25.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:25.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:25.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:25.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:25.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:25.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:25.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:25.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:25.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:25.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:25.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:25.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:25.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:25.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:25.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:25.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:25.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:25.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:25.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:25.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:25.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:25.373 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.373 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.373 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.373 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:25.373 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:25.373 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.4909100740000003, 2024-04-19T04:25:25.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:25.373 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.374 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.374 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.374 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.374 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.374 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:25.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.374 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:25.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:25.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:25.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:25.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:25.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:25.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:25.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:25.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:25.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:25.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:25.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:25.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:25.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:25.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:25.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:25.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:25.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:25.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:25.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:25.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:25.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:25.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:25.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:25.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:25.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:25.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:25.378 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.378 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.378 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.379 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67949 5.b 5:d725bcef:::benchmark_data_smithi007_19526_object67948:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:25.379 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:25.379 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.4877917959999998, 2024-04-19T04:25:25.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022537248999999999, 2024-04-19T04:25:25.379 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.379 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.379 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.379 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.379 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.379 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67949 2024-04-19T04:25:25.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.379 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:25.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:25.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832099+0000", 2024-04-19T04:25:25.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832148+0000", 2024-04-19T04:25:25.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9517e-05 2024-04-19T04:25:25.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832154+0000", 2024-04-19T04:25:25.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5319999999999997e-06 2024-04-19T04:25:25.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832158+0000", 2024-04-19T04:25:25.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9099999999999998e-06 2024-04-19T04:25:25.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.833836+0000", 2024-04-19T04:25:25.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001678817 2024-04-19T04:25:25.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834007+0000", 2024-04-19T04:25:25.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000170151 2024-04-19T04:25:25.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:25.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834238+0000", 2024-04-19T04:25:25.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023146700000000001 2024-04-19T04:25:25.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:25.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.839447+0000", 2024-04-19T04:25:25.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005209272 2024-04-19T04:25:25.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:25.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854573+0000", 2024-04-19T04:25:25.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015125945 2024-04-19T04:25:25.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:25.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854607+0000", 2024-04-19T04:25:25.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3782000000000003e-05 2024-04-19T04:25:25.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854637+0000", 2024-04-19T04:25:25.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9827000000000001e-05 2024-04-19T04:25:25.384 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.384 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.385 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.385 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:25.385 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:25.385 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.3685506640000007, 2024-04-19T04:25:25.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:25:25.385 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.385 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:25.385 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.385 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.385 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.385 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:25.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.386 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:25.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:25.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:25.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:25.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:25.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:25.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:25.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:25.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:25.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:25.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:25.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:25.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:25.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:25.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:25.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:25.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:25.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:25.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:25.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:25.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:25.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:25.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:25.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:25.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:25.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:25:25.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:25:25.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:25:25.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:25:25.391 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.391 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.391 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.392 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:25.392 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:25.392 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.3634890179999992, 2024-04-19T04:25:25.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:25:25.392 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.392 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:25.392 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.392 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.392 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.392 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:25.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.392 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:25.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:25.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:25.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:25.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:25.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:25.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:25.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:25.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:25.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:25.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:25.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:25.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:25.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:25.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:25.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:25.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:25.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:25.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:25.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:25.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:25.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:25.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:25:25.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:25:25.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:25:25.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:25:25.397 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.397 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.398 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.398 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:25.398 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:25.398 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.3633891059999996, 2024-04-19T04:25:25.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:25:25.398 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.398 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:25.398 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.398 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.399 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.399 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:25.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.399 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:25.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:25.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:25.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:25.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:25.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:25.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:25.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:25.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:25.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:25.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:25.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:25.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:25.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:25.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:25.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:25.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:25.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:25.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:25.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:25.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:25.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:25.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:25:25.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:25:25.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:25:25.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:25:25.404 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.404 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.404 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.404 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:25.405 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:25.405 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.3632633530000007, 2024-04-19T04:25:25.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:25:25.405 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.405 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:25.405 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.405 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.405 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.405 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:25.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.405 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:25.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:25.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:25.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:25.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:25.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:25.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:25.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:25.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:25.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:25.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:25.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:25.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:25.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:25.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:25.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:25.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:25.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:25.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:25.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:25.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:25.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:25:25.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:25:25.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:25:25.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:25:25.410 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.410 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.410 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.411 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:25.411 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:25.411 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.3594194080000008, 2024-04-19T04:25:25.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:25:25.411 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.411 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.411 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.411 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.411 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.411 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:25.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.411 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:25.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:25.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:25.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:25.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:25.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:25.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:25.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:25.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:25.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:25.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:25:25.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:25:25.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:25:25.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:25:25.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:25.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:25:25.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:25:25.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:25.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:25:25.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:25:25.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:25:25.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:25:25.416 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.416 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.416 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.416 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:25.416 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:25.416 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.352248307, 2024-04-19T04:25:25.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:25:25.416 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.417 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:25.417 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.417 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.417 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.417 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:25.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.417 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:25.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:25.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:25.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:25.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:25.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:25.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:25.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:25.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:25.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:25.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:25.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:25.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:25.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:25.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:25.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:25:25.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:25:25.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:25:25.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:25:25.420 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.420 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.420 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.421 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:25.421 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:25.421 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.3520762029999993, 2024-04-19T04:25:25.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:25:25.421 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.421 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:25.421 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.421 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.421 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.421 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:25.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.421 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:25.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:25.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:25.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:25.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:25.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:25.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:25.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:25.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:25.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:25.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:25.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:25.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:25.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:25.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:25.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:25:25.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:25:25.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:25:25.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:25:25.425 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.425 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.425 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.425 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:25.425 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:25.425 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.3520130780000006, 2024-04-19T04:25:25.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:25:25.425 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.425 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.426 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.426 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.426 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.426 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:25.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.426 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:25.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:25.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:25.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:25.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:25.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:25.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:25.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:25.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:25.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:25.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:25.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:25.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:25.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:25.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:25.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:25:25.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:25:25.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:25:25.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:25:25.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:25.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:25:25.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:25:25.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:25.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:25:25.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:25:25.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:25:25.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:25:25.430 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.430 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.430 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.431 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:25.431 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:25.431 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.3518844810000008, 2024-04-19T04:25:25.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:25:25.431 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.431 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.431 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.431 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.431 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.431 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:25.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.431 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:25.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:25.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:25.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:25.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:25.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:25.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:25.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:25.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:25.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:25.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:25.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:25.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:25.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:25.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:25.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:25:25.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:25:25.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:25:25.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:25:25.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:25.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:25:25.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:25:25.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:25.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:25:25.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:25:25.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:25:25.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:25:25.436 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.436 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.436 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.436 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:25.436 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:25.436 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.3518165100000008, 2024-04-19T04:25:25.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:25:25.437 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:25.438 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.438 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:25.438 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:25.438 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.438 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:25.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.438 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:25.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:25.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:25.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:25.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:25.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:25.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:25.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:25.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:25.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:25.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:25.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:25.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:25.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:25.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:25.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:25.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:25.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:25.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:25.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:25.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:25.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:25.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:25.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:25:25.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:25:25.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:25.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:25:25.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:25:25.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:25.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:25:25.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:25:25.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:25.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:25:25.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:25:25.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:25.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:25.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:25.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:25:25.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:25:25.443 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.443 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.443 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.443 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:25.443 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:25.443 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:25.445 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:25.441+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:25.445 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:25.545 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:25.546+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:25.576 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:86127 5.7 5:e9fdb4c9:::benchmark_data_smithi007_19526_object86126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T04:25:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:25.566789+0000", 2024-04-19T04:25:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0099742059999999994, 2024-04-19T04:25:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010006640000000001, 2024-04-19T04:25:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 86127 2024-04-19T04:25:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.566789+0000", 2024-04-19T04:25:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.566789+0000", 2024-04-19T04:25:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.566788+0000", 2024-04-19T04:25:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.566859+0000", 2024-04-19T04:25:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1248999999999995e-05 2024-04-19T04:25:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.566869+0000", 2024-04-19T04:25:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0042e-05 2024-04-19T04:25:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.566876+0000", 2024-04-19T04:25:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1799999999999999e-06 2024-04-19T04:25:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.570697+0000", 2024-04-19T04:25:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038209239999999998 2024-04-19T04:25:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.570873+0000", 2024-04-19T04:25:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017606300000000001 2024-04-19T04:25:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:86129 5.f 5:fe31631f:::benchmark_data_smithi007_19526_object86128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T04:25:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:25.566949+0000", 2024-04-19T04:25:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0098137559999999999, 2024-04-19T04:25:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0099489039999999997, 2024-04-19T04:25:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 86129 2024-04-19T04:25:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.566949+0000", 2024-04-19T04:25:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.566949+0000", 2024-04-19T04:25:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.566948+0000", 2024-04-19T04:25:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.566991+0000", 2024-04-19T04:25:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2449e-05 2024-04-19T04:25:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.566999+0000", 2024-04-19T04:25:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0760000000000003e-06 2024-04-19T04:25:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.567005+0000", 2024-04-19T04:25:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7620000000000001e-06 2024-04-19T04:25:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.570889+0000", 2024-04-19T04:25:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038842999999999998 2024-04-19T04:25:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.571036+0000", 2024-04-19T04:25:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014685300000000001 2024-04-19T04:25:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.571178+0000", 2024-04-19T04:25:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014211900000000001 2024-04-19T04:25:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.573743+0000", 2024-04-19T04:25:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0025647679999999998 2024-04-19T04:25:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.586 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:86130 5.f 5:f5b2de60:::benchmark_data_smithi007_19526_object86129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T04:25:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:25.568199+0000", 2024-04-19T04:25:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0085639889999999993, 2024-04-19T04:25:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0087522009999999994, 2024-04-19T04:25:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 86130 2024-04-19T04:25:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.568199+0000", 2024-04-19T04:25:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.568199+0000", 2024-04-19T04:25:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.568198+0000", 2024-04-19T04:25:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.568278+0000", 2024-04-19T04:25:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9827999999999995e-05 2024-04-19T04:25:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.568290+0000", 2024-04-19T04:25:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1952e-05 2024-04-19T04:25:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.568298+0000", 2024-04-19T04:25:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9880000000000004e-06 2024-04-19T04:25:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.573763+0000", 2024-04-19T04:25:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0054653519999999997 2024-04-19T04:25:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.573885+0000", 2024-04-19T04:25:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012150399999999999 2024-04-19T04:25:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.574018+0000", 2024-04-19T04:25:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000133781 2024-04-19T04:25:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:86136 5.5 5:a06af925:::benchmark_data_smithi007_19526_object86135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T04:25:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:25.571006+0000", 2024-04-19T04:25:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0057565339999999998, 2024-04-19T04:25:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0059886499999999999, 2024-04-19T04:25:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 86136 2024-04-19T04:25:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.571006+0000", 2024-04-19T04:25:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.571006+0000", 2024-04-19T04:25:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.571005+0000", 2024-04-19T04:25:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.571068+0000", 2024-04-19T04:25:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2655000000000002e-05 2024-04-19T04:25:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.571078+0000", 2024-04-19T04:25:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0445000000000001e-05 2024-04-19T04:25:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.571086+0000", 2024-04-19T04:25:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6599999999999995e-06 2024-04-19T04:25:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.571136+0000", 2024-04-19T04:25:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0207999999999998e-05 2024-04-19T04:25:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.571280+0000", 2024-04-19T04:25:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014391799999999999 2024-04-19T04:25:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:86138 5.1 5:82c2c02c:::benchmark_data_smithi007_19526_object86137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T04:25:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:25.574088+0000", 2024-04-19T04:25:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.002674853, 2024-04-19T04:25:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0029448069999999998, 2024-04-19T04:25:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 86138 2024-04-19T04:25:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.574088+0000", 2024-04-19T04:25:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.574088+0000", 2024-04-19T04:25:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.574085+0000", 2024-04-19T04:25:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999967 2024-04-19T04:25:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.574133+0000", 2024-04-19T04:25:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7880000000000002e-05 2024-04-19T04:25:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.574149+0000", 2024-04-19T04:25:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6291e-05 2024-04-19T04:25:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.574160+0000", 2024-04-19T04:25:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1438e-05 2024-04-19T04:25:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.574220+0000", 2024-04-19T04:25:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9613e-05 2024-04-19T04:25:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.574385+0000", 2024-04-19T04:25:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000165031 2024-04-19T04:25:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:86140 5.9 5:94526d06:::benchmark_data_smithi007_19526_object86139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T04:25:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:25.574346+0000", 2024-04-19T04:25:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.002416418, 2024-04-19T04:25:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027267429999999998, 2024-04-19T04:25:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 86140 2024-04-19T04:25:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.574346+0000", 2024-04-19T04:25:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.574346+0000", 2024-04-19T04:25:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.574345+0000", 2024-04-19T04:25:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.574401+0000", 2024-04-19T04:25:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5118000000000003e-05 2024-04-19T04:25:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.574413+0000", 2024-04-19T04:25:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.288e-05 2024-04-19T04:25:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.574421+0000", 2024-04-19T04:25:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.435e-06 2024-04-19T04:25:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.574460+0000", 2024-04-19T04:25:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.8779000000000003e-05 2024-04-19T04:25:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.574547+0000", 2024-04-19T04:25:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7844999999999997e-05 2024-04-19T04:25:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.574626+0000", 2024-04-19T04:25:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8789999999999996e-05 2024-04-19T04:25:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:86142 5.5 5:a7308053:::benchmark_data_smithi007_19526_object86141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T04:25:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:25.575914+0000", 2024-04-19T04:25:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00084832500000000003, 2024-04-19T04:25:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012582120000000001, 2024-04-19T04:25:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 86142 2024-04-19T04:25:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.575914+0000", 2024-04-19T04:25:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.575914+0000", 2024-04-19T04:25:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.575913+0000", 2024-04-19T04:25:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.575999+0000", 2024-04-19T04:25:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5582999999999997e-05 2024-04-19T04:25:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576011+0000", 2024-04-19T04:25:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1579e-05 2024-04-19T04:25:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576018+0000", 2024-04-19T04:25:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5440000000000001e-06 2024-04-19T04:25:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576059+0000", 2024-04-19T04:25:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0723000000000003e-05 2024-04-19T04:25:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576191+0000", 2024-04-19T04:25:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013266499999999999 2024-04-19T04:25:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:86143 5.7 5:e954c842:::benchmark_data_smithi007_19526_object86142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T04:25:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:25.576033+0000", 2024-04-19T04:25:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.000729472, 2024-04-19T04:25:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012192920000000001, 2024-04-19T04:25:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 86143 2024-04-19T04:25:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576033+0000", 2024-04-19T04:25:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576033+0000", 2024-04-19T04:25:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576033+0000", 2024-04-19T04:25:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576083+0000", 2024-04-19T04:25:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0386999999999997e-05 2024-04-19T04:25:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576101+0000", 2024-04-19T04:25:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8147000000000001e-05 2024-04-19T04:25:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576115+0000", 2024-04-19T04:25:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4137e-05 2024-04-19T04:25:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576165+0000", 2024-04-19T04:25:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9515000000000003e-05 2024-04-19T04:25:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576255+0000", 2024-04-19T04:25:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9948e-05 2024-04-19T04:25:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:86145 5.7 5.c1f6de87 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T04:25:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:25.576213+0000", 2024-04-19T04:25:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00054953800000000002, 2024-04-19T04:25:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001074995, 2024-04-19T04:25:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 86145 2024-04-19T04:25:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576213+0000", 2024-04-19T04:25:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576213+0000", 2024-04-19T04:25:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576212+0000", 2024-04-19T04:25:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576326+0000", 2024-04-19T04:25:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113853 2024-04-19T04:25:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576337+0000", 2024-04-19T04:25:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1368e-05 2024-04-19T04:25:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576345+0000", 2024-04-19T04:25:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1999999999999997e-06 2024-04-19T04:25:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:86130 5.f e42/20)", 2024-04-19T04:25:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:25.576872+0000", 2024-04-19T04:25:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9998903, 2024-04-19T04:25:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00044468900000000001, 2024-04-19T04:25:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576872+0000", 2024-04-19T04:25:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576872+0000", 2024-04-19T04:25:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576872+0000", 2024-04-19T04:25:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576876+0000", 2024-04-19T04:25:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1559999999999997e-06 2024-04-19T04:25:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576883+0000", 2024-04-19T04:25:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9179999999999997e-06 2024-04-19T04:25:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.576887+0000", 2024-04-19T04:25:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7679999999999999e-06 2024-04-19T04:25:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:86147 5.9 5:92235165:::benchmark_data_smithi007_19526_object86146:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T04:25:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:25.577103+0000", 2024-04-19T04:25:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.99966, 2024-04-19T04:25:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00024372799999999999, 2024-04-19T04:25:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 86147 2024-04-19T04:25:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.577103+0000", 2024-04-19T04:25:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.577103+0000", 2024-04-19T04:25:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.577102+0000", 2024-04-19T04:25:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.577177+0000", 2024-04-19T04:25:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4747999999999997e-05 2024-04-19T04:25:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.577183+0000", 2024-04-19T04:25:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7240000000000003e-06 2024-04-19T04:25:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.577188+0000", 2024-04-19T04:25:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.374e-06 2024-04-19T04:25:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.577226+0000", 2024-04-19T04:25:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.8228000000000001e-05 2024-04-19T04:25:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.577333+0000", 2024-04-19T04:25:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000106871 2024-04-19T04:25:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:86148 5.7 5.43387187 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T04:25:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:25.577196+0000", 2024-04-19T04:25:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9995666, 2024-04-19T04:25:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000186703, 2024-04-19T04:25:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 86148 2024-04-19T04:25:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.577196+0000", 2024-04-19T04:25:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.577196+0000", 2024-04-19T04:25:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.577196+0000", 2024-04-19T04:25:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.577227+0000", 2024-04-19T04:25:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1062999999999997e-05 2024-04-19T04:25:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.577232+0000", 2024-04-19T04:25:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7389999999999999e-06 2024-04-19T04:25:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:25.577235+0000", 2024-04-19T04:25:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2720000000000002e-06 2024-04-19T04:25:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 12 2024-04-19T04:25:25.625 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:25.626 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:25.647 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:25.646+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:25.656 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-19T04:25:25.656 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T04:25:25.657 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-04-19T04:25:25.657 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi066.front.sepia.ceph.com 2024-04-19T04:25:25.657 INFO:teuthology.orchestra.console.smithi066:Power on 2024-04-19T04:25:25.657 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-19T04:25:25.680 DEBUG:teuthology.orchestra.console.smithi066:power on output: Chassis Power Control: Up/On 2024-04-19T04:25:25.681 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T04:25:25.704 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-04-19T04:25:25.748 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:25.746+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:25.755 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 41 16 86513 86497 131.839 129 0.00471201 0.00757936 2024-04-19T04:25:25.759 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:25.759 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:25.772 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:25.850 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:25.850+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:25.910 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:25.910 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:25.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 65.374208483999993, 2024-04-19T04:25:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:25:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:25:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:25:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:25:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:25:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:25:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:25:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:25:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:25:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:25:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:25:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:25:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:25:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:25:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:25:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:25:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:25:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:25:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:25:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:25:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:25:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:25:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:25:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:25:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:25:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:25:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 65.374153938999996, 2024-04-19T04:25:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:25:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:25:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:25:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:25:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:25:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:25:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:25:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:25:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:25:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:25:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:25:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:25:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:25:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:25:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:25:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:25:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:25:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:25:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:25:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:25:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:25:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:25:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:25:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:25:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:25:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:25:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.676839352999998, 2024-04-19T04:25:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.673658197000002, 2024-04-19T04:25:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.673090092999999, 2024-04-19T04:25:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.672744432000002, 2024-04-19T04:25:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.672019993999999, 2024-04-19T04:25:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.672012598999999, 2024-04-19T04:25:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.670187452, 2024-04-19T04:25:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26148 5.9 e27/20 ondisk, result = 0)", 2024-04-19T04:25:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.670087126999999, 2024-04-19T04:25:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.042005175999999998, 2024-04-19T04:25:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238276+0000", 2024-04-19T04:25:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238280+0000", 2024-04-19T04:25:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6399999999999999e-06 2024-04-19T04:25:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238286+0000", 2024-04-19T04:25:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2099999999999998e-06 2024-04-19T04:25:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238290+0000", 2024-04-19T04:25:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2470000000000002e-06 2024-04-19T04:25:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239526+0000", 2024-04-19T04:25:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012362619999999999 2024-04-19T04:25:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239538+0000", 2024-04-19T04:25:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1620999999999999e-05 2024-04-19T04:25:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280282+0000", 2024-04-19T04:25:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040743691999999998 2024-04-19T04:25:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.669453247, 2024-04-19T04:25:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.668918971, 2024-04-19T04:25:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26160 5.f e27/20 ondisk, result = 0)", 2024-04-19T04:25:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.667803595999999, 2024-04-19T04:25:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039752357000000002, 2024-04-19T04:25:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240559+0000", 2024-04-19T04:25:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240569+0000", 2024-04-19T04:25:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7720000000000006e-06 2024-04-19T04:25:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280164+0000", 2024-04-19T04:25:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039595324000000001 2024-04-19T04:25:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280190+0000", 2024-04-19T04:25:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5692000000000001e-05 2024-04-19T04:25:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280287+0000", 2024-04-19T04:25:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7536999999999998e-05 2024-04-19T04:25:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280299+0000", 2024-04-19T04:25:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2057e-05 2024-04-19T04:25:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3244999999999999e-05 2024-04-19T04:25:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26179 5.3 e27/20 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head v 27'1624, mlcod=27'1621)", 2024-04-19T04:25:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.664649843999999, 2024-04-19T04:25:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039964081999999998, 2024-04-19T04:25:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243713+0000", 2024-04-19T04:25:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243750+0000", 2024-04-19T04:25:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6704e-05 2024-04-19T04:25:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280162+0000", 2024-04-19T04:25:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036412117000000001 2024-04-19T04:25:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280186+0000", 2024-04-19T04:25:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4825999999999999e-05 2024-04-19T04:25:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012540000000000001 2024-04-19T04:25:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280347+0000", 2024-04-19T04:25:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4894000000000002e-05 2024-04-19T04:25:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283654+0000", 2024-04-19T04:25:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00330716 2024-04-19T04:25:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283678+0000", 2024-04-19T04:25:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3992e-05 2024-04-19T04:25:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.9520637819999997, 2024-04-19T04:25:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.9318333330000002, 2024-04-19T04:25:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.9317254760000004, 2024-04-19T04:25:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.9297587870000008, 2024-04-19T04:25:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.9263945919999994, 2024-04-19T04:25:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.9225836140000006, 2024-04-19T04:25:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:26.036 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:26.036 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:26.036 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:26.037 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:26.038 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:26.034+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:26.138 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:26.138+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:26.171 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:26.171 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:26.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.171 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:87348 5.8 5:1e749cf1:::benchmark_data_smithi007_19526_object87347:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T04:25:26.171 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:26.160062+0000", 2024-04-19T04:25:26.171 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.010639025999999999, 2024-04-19T04:25:26.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.01067132, 2024-04-19T04:25:26.172 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.172 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:26.172 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.172 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.172 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.172 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 87348 2024-04-19T04:25:26.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.172 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.160062+0000", 2024-04-19T04:25:26.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.160062+0000", 2024-04-19T04:25:26.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.160061+0000", 2024-04-19T04:25:26.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:26.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.160165+0000", 2024-04-19T04:25:26.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103482 2024-04-19T04:25:26.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.160176+0000", 2024-04-19T04:25:26.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1114000000000001e-05 2024-04-19T04:25:26.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.160182+0000", 2024-04-19T04:25:26.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8239999999999996e-06 2024-04-19T04:25:26.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.160233+0000", 2024-04-19T04:25:26.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1035999999999997e-05 2024-04-19T04:25:26.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.160374+0000", 2024-04-19T04:25:26.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014104499999999999 2024-04-19T04:25:26.175 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.175 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.175 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.175 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:87349 5.8 5:15c05d55:::benchmark_data_smithi007_19526_object87348:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T04:25:26.175 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:26.161531+0000", 2024-04-19T04:25:26.175 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0091704000000000004, 2024-04-19T04:25:26.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092920590000000001, 2024-04-19T04:25:26.176 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.176 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:26.176 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.176 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.176 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.176 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 87349 2024-04-19T04:25:26.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.176 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.161531+0000", 2024-04-19T04:25:26.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.161531+0000", 2024-04-19T04:25:26.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.161530+0000", 2024-04-19T04:25:26.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:26.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.161627+0000", 2024-04-19T04:25:26.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6879000000000005e-05 2024-04-19T04:25:26.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.161641+0000", 2024-04-19T04:25:26.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3586e-05 2024-04-19T04:25:26.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.161648+0000", 2024-04-19T04:25:26.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4510000000000003e-06 2024-04-19T04:25:26.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.162900+0000", 2024-04-19T04:25:26.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001252158 2024-04-19T04:25:26.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163087+0000", 2024-04-19T04:25:26.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018689299999999999 2024-04-19T04:25:26.179 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.179 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.179 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.179 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:87351 5.4 5:29e89798:::benchmark_data_smithi007_19526_object87350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T04:25:26.179 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:26.163313+0000", 2024-04-19T04:25:26.179 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0073888060000000004, 2024-04-19T04:25:26.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075854049999999999, 2024-04-19T04:25:26.179 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.179 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:26.180 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.180 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.180 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.180 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 87351 2024-04-19T04:25:26.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.180 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163313+0000", 2024-04-19T04:25:26.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163313+0000", 2024-04-19T04:25:26.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163312+0000", 2024-04-19T04:25:26.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:26.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163376+0000", 2024-04-19T04:25:26.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4064000000000002e-05 2024-04-19T04:25:26.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163383+0000", 2024-04-19T04:25:26.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0990000000000001e-06 2024-04-19T04:25:26.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163390+0000", 2024-04-19T04:25:26.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6869999999999997e-06 2024-04-19T04:25:26.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163445+0000", 2024-04-19T04:25:26.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5648e-05 2024-04-19T04:25:26.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163610+0000", 2024-04-19T04:25:26.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016443799999999999 2024-04-19T04:25:26.183 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.183 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.183 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.183 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:87352 5.8 5:13f9d16a:::benchmark_data_smithi007_19526_object87351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T04:25:26.183 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:26.163404+0000", 2024-04-19T04:25:26.183 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0072979660000000003, 2024-04-19T04:25:26.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075838190000000003, 2024-04-19T04:25:26.183 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.183 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:26.183 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.183 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.183 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.183 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 87352 2024-04-19T04:25:26.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.184 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163404+0000", 2024-04-19T04:25:26.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163404+0000", 2024-04-19T04:25:26.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163403+0000", 2024-04-19T04:25:26.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:26.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163468+0000", 2024-04-19T04:25:26.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5109000000000003e-05 2024-04-19T04:25:26.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163477+0000", 2024-04-19T04:25:26.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5299999999999996e-06 2024-04-19T04:25:26.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163483+0000", 2024-04-19T04:25:26.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0939999999999996e-06 2024-04-19T04:25:26.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.167801+0000", 2024-04-19T04:25:26.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0043180620000000001 2024-04-19T04:25:26.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.167959+0000", 2024-04-19T04:25:26.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015847999999999999 2024-04-19T04:25:26.186 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.186 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.186 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.187 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:87355 5.e 5:7d5faabd:::benchmark_data_smithi007_19526_object87354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T04:25:26.187 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:26.163584+0000", 2024-04-19T04:25:26.187 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.007117974, 2024-04-19T04:25:26.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074832020000000004, 2024-04-19T04:25:26.187 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.187 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:26.187 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.187 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.187 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.187 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 87355 2024-04-19T04:25:26.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.187 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163584+0000", 2024-04-19T04:25:26.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163584+0000", 2024-04-19T04:25:26.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163583+0000", 2024-04-19T04:25:26.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:26.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163699+0000", 2024-04-19T04:25:26.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000115969 2024-04-19T04:25:26.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163708+0000", 2024-04-19T04:25:26.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9979999999999992e-06 2024-04-19T04:25:26.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163717+0000", 2024-04-19T04:25:26.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4350000000000003e-06 2024-04-19T04:25:26.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163765+0000", 2024-04-19T04:25:26.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7945999999999998e-05 2024-04-19T04:25:26.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163916+0000", 2024-04-19T04:25:26.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000150853 2024-04-19T04:25:26.190 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.190 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.190 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:87353 5.d e42/29 5:bb496ce5:::benchmark_data_smithi007_19526_object87352:head v 42'5245, mlcod=42'5242)", 2024-04-19T04:25:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:26.163807+0000", 2024-04-19T04:25:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.006894117, 2024-04-19T04:25:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0073401109999999999, 2024-04-19T04:25:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163807+0000", 2024-04-19T04:25:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163807+0000", 2024-04-19T04:25:26.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163807+0000", 2024-04-19T04:25:26.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:26.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163848+0000", 2024-04-19T04:25:26.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1402000000000001e-05 2024-04-19T04:25:26.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163856+0000", 2024-04-19T04:25:26.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9019999999999999e-06 2024-04-19T04:25:26.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163861+0000", 2024-04-19T04:25:26.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2650000000000004e-06 2024-04-19T04:25:26.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163905+0000", 2024-04-19T04:25:26.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4066999999999997e-05 2024-04-19T04:25:26.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.163925+0000", 2024-04-19T04:25:26.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9672000000000001e-05 2024-04-19T04:25:26.194 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.194 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.194 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.194 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:87356 5.f e42/20 5:f68dffd0:::benchmark_data_smithi007_19526_object87355:head v 42'5310, mlcod=42'5308)", 2024-04-19T04:25:26.194 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:26.164005+0000", 2024-04-19T04:25:26.194 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0066963659999999996, 2024-04-19T04:25:26.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072044120000000003, 2024-04-19T04:25:26.194 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.194 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:26.194 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.164005+0000", 2024-04-19T04:25:26.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.164005+0000", 2024-04-19T04:25:26.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.164005+0000", 2024-04-19T04:25:26.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:26.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.164059+0000", 2024-04-19T04:25:26.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4564000000000001e-05 2024-04-19T04:25:26.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.164065+0000", 2024-04-19T04:25:26.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4960000000000004e-06 2024-04-19T04:25:26.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.164069+0000", 2024-04-19T04:25:26.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9820000000000002e-06 2024-04-19T04:25:26.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.164109+0000", 2024-04-19T04:25:26.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9870000000000003e-05 2024-04-19T04:25:26.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.164125+0000", 2024-04-19T04:25:26.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6313000000000001e-05 2024-04-19T04:25:26.197 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.197 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.197 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.197 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:87359 5.8 5:1462172f:::benchmark_data_smithi007_19526_object87358:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T04:25:26.197 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:26.166397+0000", 2024-04-19T04:25:26.198 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0043041690000000001, 2024-04-19T04:25:26.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048860429999999996, 2024-04-19T04:25:26.198 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.198 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:26.198 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.198 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.198 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.198 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 87359 2024-04-19T04:25:26.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.198 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.166397+0000", 2024-04-19T04:25:26.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.166397+0000", 2024-04-19T04:25:26.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.166396+0000", 2024-04-19T04:25:26.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:26.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.166489+0000", 2024-04-19T04:25:26.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3079999999999997e-05 2024-04-19T04:25:26.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.166506+0000", 2024-04-19T04:25:26.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7027000000000001e-05 2024-04-19T04:25:26.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.166515+0000", 2024-04-19T04:25:26.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7930000000000003e-06 2024-04-19T04:25:26.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.170418+0000", 2024-04-19T04:25:26.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039033589999999999 2024-04-19T04:25:26.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.170557+0000", 2024-04-19T04:25:26.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013881899999999999 2024-04-19T04:25:26.201 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.201 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.201 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.201 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:87363 5.4 5:2878e089:::benchmark_data_smithi007_19526_object87362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T04:25:26.201 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:26.166924+0000", 2024-04-19T04:25:26.202 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0037773059999999998, 2024-04-19T04:25:26.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044321279999999996, 2024-04-19T04:25:26.202 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.202 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:26.202 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.202 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.202 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.202 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 87363 2024-04-19T04:25:26.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.202 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.166924+0000", 2024-04-19T04:25:26.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.166924+0000", 2024-04-19T04:25:26.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.166924+0000", 2024-04-19T04:25:26.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:26.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.167022+0000", 2024-04-19T04:25:26.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8775000000000002e-05 2024-04-19T04:25:26.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.167030+0000", 2024-04-19T04:25:26.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7449999999999995e-06 2024-04-19T04:25:26.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.167036+0000", 2024-04-19T04:25:26.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2330000000000003e-06 2024-04-19T04:25:26.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.167091+0000", 2024-04-19T04:25:26.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5183999999999999e-05 2024-04-19T04:25:26.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.167270+0000", 2024-04-19T04:25:26.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017851299999999999 2024-04-19T04:25:26.205 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.205 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.205 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.205 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:87358 5.f e42/20 5:fa8aff0a:::benchmark_data_smithi007_19526_object87357:head v 42'5311, mlcod=42'5308)", 2024-04-19T04:25:26.205 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:26.167140+0000", 2024-04-19T04:25:26.205 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0035619919999999999, 2024-04-19T04:25:26.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0042874699999999998, 2024-04-19T04:25:26.205 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.206 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:26.206 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.167140+0000", 2024-04-19T04:25:26.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.167140+0000", 2024-04-19T04:25:26.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.167139+0000", 2024-04-19T04:25:26.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:26.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.167174+0000", 2024-04-19T04:25:26.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5737e-05 2024-04-19T04:25:26.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.167182+0000", 2024-04-19T04:25:26.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9820000000000008e-06 2024-04-19T04:25:26.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.167191+0000", 2024-04-19T04:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5220000000000007e-06 2024-04-19T04:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.167232+0000", 2024-04-19T04:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1281e-05 2024-04-19T04:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.167251+0000", 2024-04-19T04:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8950999999999999e-05 2024-04-19T04:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.209 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:87364 5.d e42/29 5:bf1a7b6a:::benchmark_data_smithi007_19526_object87363:head v 42'5246, mlcod=42'5243)", 2024-04-19T04:25:26.209 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:26.168081+0000", 2024-04-19T04:25:26.209 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0026200920000000001, 2024-04-19T04:25:26.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034122779999999999, 2024-04-19T04:25:26.209 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.209 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:26.209 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.209 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.209 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.168081+0000", 2024-04-19T04:25:26.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.168081+0000", 2024-04-19T04:25:26.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.168081+0000", 2024-04-19T04:25:26.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:26.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.168146+0000", 2024-04-19T04:25:26.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5165000000000004e-05 2024-04-19T04:25:26.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.168152+0000", 2024-04-19T04:25:26.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0310000000000004e-06 2024-04-19T04:25:26.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.168156+0000", 2024-04-19T04:25:26.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.912e-06 2024-04-19T04:25:26.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.168195+0000", 2024-04-19T04:25:26.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9038999999999997e-05 2024-04-19T04:25:26.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.168208+0000", 2024-04-19T04:25:26.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3141e-05 2024-04-19T04:25:26.212 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.212 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.212 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.212 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:87362 5.9 e42/20 5:96fcbc3b:::benchmark_data_smithi007_19526_object87361:head v 42'5677, mlcod=42'5675)", 2024-04-19T04:25:26.212 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:26.168937+0000", 2024-04-19T04:25:26.212 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0017647380000000001, 2024-04-19T04:25:26.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026194069999999998, 2024-04-19T04:25:26.212 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.212 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:26.213 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.168937+0000", 2024-04-19T04:25:26.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.168937+0000", 2024-04-19T04:25:26.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.168936+0000", 2024-04-19T04:25:26.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:26.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.169026+0000", 2024-04-19T04:25:26.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9724999999999999e-05 2024-04-19T04:25:26.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.169042+0000", 2024-04-19T04:25:26.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5688999999999998e-05 2024-04-19T04:25:26.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.169048+0000", 2024-04-19T04:25:26.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6499999999999999e-06 2024-04-19T04:25:26.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.169104+0000", 2024-04-19T04:25:26.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5787e-05 2024-04-19T04:25:26.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.169174+0000", 2024-04-19T04:25:26.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0162999999999999e-05 2024-04-19T04:25:26.215 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.215 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.215 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.216 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:87361 5.f e42/20 5:fd650c43:::benchmark_data_smithi007_19526_object87360:head v 42'5312, mlcod=42'5308)", 2024-04-19T04:25:26.216 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:26.169063+0000", 2024-04-19T04:25:26.216 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0016385950000000001, 2024-04-19T04:25:26.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002557195, 2024-04-19T04:25:26.216 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.216 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:26.216 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.169063+0000", 2024-04-19T04:25:26.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.169063+0000", 2024-04-19T04:25:26.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.169063+0000", 2024-04-19T04:25:26.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:26.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.169100+0000", 2024-04-19T04:25:26.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7493999999999997e-05 2024-04-19T04:25:26.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.169109+0000", 2024-04-19T04:25:26.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0119999999999994e-06 2024-04-19T04:25:26.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.169114+0000", 2024-04-19T04:25:26.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2900000000000002e-06 2024-04-19T04:25:26.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.169430+0000", 2024-04-19T04:25:26.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00031568500000000001 2024-04-19T04:25:26.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:26.169442+0000", 2024-04-19T04:25:26.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.201e-05 2024-04-19T04:25:26.219 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.219 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.219 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.219 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.219 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:26.219 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 13 2024-04-19T04:25:26.219 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:26.220 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:26.238 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:26.233+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:26.337 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:25:26.339 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:26.333+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:26.340 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:26.340 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:26.340 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:26.341 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:26.341 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:26.353 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:26.440 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:26.438+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:26.484 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:26.484 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:26.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:26.484 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:26.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.484 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:26.485 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:26.485 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 32.246757637000002, 2024-04-19T04:25:26.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:26.485 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.485 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:26.485 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.485 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.485 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.485 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:26.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.485 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:26.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:26.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:26.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:26.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:26.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:26.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:26.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:26.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:26.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:26.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:26.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:26.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:26.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:26.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:26.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:26.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:26.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:26.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:26.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:26.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:26.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:26.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:26.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:26.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:26.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:26.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:26.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:26.491 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.491 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.491 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.491 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:26.491 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:26.491 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 32.242308721000001, 2024-04-19T04:25:26.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:26.491 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.491 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:26.491 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.492 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.492 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.492 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:26.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.492 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:26.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:26.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:26.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:26.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:26.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:26.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:26.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:26.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:26.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:26.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:26.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:26.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:26.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:26.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:26.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:26.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:26.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:26.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:26.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:26.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:26.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:26.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:26.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:26.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:26.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:26.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:26.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:26.496 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.496 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.496 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.497 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:26.497 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:26.497 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.414376477999999, 2024-04-19T04:25:26.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:26.497 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.497 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:26.497 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.497 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.497 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.497 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:26.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.497 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:26.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:26.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:26.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:26.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:26.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:26.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:26.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:26.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:26.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:26.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:26.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:26.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:26.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:26.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:26.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:26.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:26.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:26.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:26.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:26.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:26.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:26.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:26.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:26.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:26.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:26.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:26.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:26.502 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.502 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.502 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.503 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:26.503 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:26.503 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.978522440999999, 2024-04-19T04:25:26.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:26.503 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.503 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:26.503 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.503 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.503 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.503 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:26.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.503 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:26.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:26.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:26.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:26.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:26.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:26.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:26.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:26.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:26.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:26.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:26.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:26.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:26.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:26.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:26.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.978092021, 2024-04-19T04:25:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.975860757, 2024-04-19T04:25:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.972463719, 2024-04-19T04:25:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:26.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:26.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.967335521000001, 2024-04-19T04:25:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.653307015999999, 2024-04-19T04:25:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67949 5.b 5:d725bcef:::benchmark_data_smithi007_19526_object67948:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.650188738000001, 2024-04-19T04:25:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022537248999999999, 2024-04-19T04:25:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67949 2024-04-19T04:25:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832099+0000", 2024-04-19T04:25:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832148+0000", 2024-04-19T04:25:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9517e-05 2024-04-19T04:25:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832154+0000", 2024-04-19T04:25:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5319999999999997e-06 2024-04-19T04:25:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832158+0000", 2024-04-19T04:25:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9099999999999998e-06 2024-04-19T04:25:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.833836+0000", 2024-04-19T04:25:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001678817 2024-04-19T04:25:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834007+0000", 2024-04-19T04:25:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000170151 2024-04-19T04:25:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834238+0000", 2024-04-19T04:25:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023146700000000001 2024-04-19T04:25:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.839447+0000", 2024-04-19T04:25:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005209272 2024-04-19T04:25:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854573+0000", 2024-04-19T04:25:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015125945 2024-04-19T04:25:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854607+0000", 2024-04-19T04:25:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3782000000000003e-05 2024-04-19T04:25:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854637+0000", 2024-04-19T04:25:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9827000000000001e-05 2024-04-19T04:25:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.530947606, 2024-04-19T04:25:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:25:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:26.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:26.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:26.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:26.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:26.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:26.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:26.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:26.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:26.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:25:26.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:25:26.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:25:26.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:25:26.552 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.552 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.553 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.553 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:26.553 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:26.553 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.52588596, 2024-04-19T04:25:26.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:25:26.553 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.553 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:26.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.553 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:26.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.554 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:26.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:26.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:26.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:25:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:25:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:25:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:25:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.525786048000001, 2024-04-19T04:25:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:25:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:25:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:25:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:25:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:25:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.525660295, 2024-04-19T04:25:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:25:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:26.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:26.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:25:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:25:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:25:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:25:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.52181635, 2024-04-19T04:25:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:25:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:26.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:25:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:25:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:25:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:25:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:25:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:25:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:25:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:25:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:25:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:25:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.514645249000001, 2024-04-19T04:25:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:25:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:25:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:25:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:25:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:25:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.514473145, 2024-04-19T04:25:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:25:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:25:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:25:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:25:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:25:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.51441002, 2024-04-19T04:25:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:25:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:25:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:25:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:25:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:25:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:25:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:25:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:25:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:25:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:25:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:25:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.514281423, 2024-04-19T04:25:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:25:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:25:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:25:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:25:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:25:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:25:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:25:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:25:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:25:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:25:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:25:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.514213452, 2024-04-19T04:25:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:25:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:25:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:25:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:25:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:25:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:25:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:25:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:25:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:25:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:25:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:25:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:26.609 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:26.611 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:26.611 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:26.612 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:26.610+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:26.612 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:26.612 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:26.613 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:26.613 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:26.613 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:26.613 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:26.712 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:26.710+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:26.749 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:26.750 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:26.755 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 42 16 88624 88608 131.841 131.938 0.00880049 0.00757921 2024-04-19T04:25:26.762 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:26.813 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:26.810+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:26.896 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:26.896 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:26.909 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:26.915 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:26.909+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:27.015 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:27.014+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:27.024 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T04:25:27.032 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:27.032 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:27.044 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:27.116 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:27.113+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:27.174 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:27.174 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:27.186 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:27.216 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:27.213+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:27.307 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:27.307 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:27.318 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:27.318 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:27.313+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:27.418 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:27.413+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:27.439 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:27.439 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:27.452 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:27.520 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:27.513+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:27.585 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:27.585 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:27.599 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:27.621 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:27.617+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:27.723 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:27.722+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:27.733 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:27.733 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:27.747 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:27.755 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 43 16 90725 90709 131.829 131.312 0.00885971 0.00758005 2024-04-19T04:25:27.823 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:27.817+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:27.881 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:27.881 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:27.894 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:27.924 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:27.921+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:28.020 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:28.020 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:28.025 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-04-19T04:25:28.025 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:28.022+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:28.032 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:28.127 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:28.126+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:28.157 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:28.158 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:28.170 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:28.228 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:28.225+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:28.328 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:28.326+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:28.335 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:28.335 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:28.348 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:28.431 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:28.425+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:28.485 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:28.485 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:28.498 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:28.530 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:28.525+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:28.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~12s 2024-04-19T04:25:28.614 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:25:28.627 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:28.627 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:28.631 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:28.625+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:28.640 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:28.732 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:28.730+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:28.755 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 44 16 92756 92740 131.717 126.938 0.00828701 0.00758599 2024-04-19T04:25:28.774 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:28.797 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:28.797 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:28.797 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:28.797 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:28.801 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:28.802 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:28.817 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:28.818 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:28.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:28.818 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:28.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.818 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:28.818 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:28.818 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 68.282398569999998, 2024-04-19T04:25:28.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029920499999999999, 2024-04-19T04:25:28.818 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.819 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:28.819 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:28.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534155+0000", 2024-04-19T04:25:28.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534154+0000", 2024-04-19T04:25:28.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:28.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534163+0000", 2024-04-19T04:25:28.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4800000000000001e-06 2024-04-19T04:25:28.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534180+0000", 2024-04-19T04:25:28.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6949e-05 2024-04-19T04:25:28.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534193+0000", 2024-04-19T04:25:28.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3726e-05 2024-04-19T04:25:28.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534308+0000", 2024-04-19T04:25:28.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114682 2024-04-19T04:25:28.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:28.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534312+0000", 2024-04-19T04:25:28.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.732e-06 2024-04-19T04:25:28.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.558941+0000", 2024-04-19T04:25:28.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024629542000000001 2024-04-19T04:25:28.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:28.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559008+0000", 2024-04-19T04:25:28.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6288e-05 2024-04-19T04:25:28.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:28.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559106+0000", 2024-04-19T04:25:28.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8533e-05 2024-04-19T04:25:28.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:28.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561344+0000", 2024-04-19T04:25:28.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002237452 2024-04-19T04:25:28.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:28.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564034+0000", 2024-04-19T04:25:28.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026899979999999999 2024-04-19T04:25:28.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:28.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564057+0000", 2024-04-19T04:25:28.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3714e-05 2024-04-19T04:25:28.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564076+0000", 2024-04-19T04:25:28.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8383999999999999e-05 2024-04-19T04:25:28.826 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.826 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.826 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.826 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T04:25:28.826 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:28.827 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 68.282344025, 2024-04-19T04:25:28.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.029948626999999998, 2024-04-19T04:25:28.827 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.827 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:28.827 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:28.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534210+0000", 2024-04-19T04:25:28.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534209+0000", 2024-04-19T04:25:28.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:28.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534216+0000", 2024-04-19T04:25:28.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8359999999999992e-06 2024-04-19T04:25:28.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534233+0000", 2024-04-19T04:25:28.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6616000000000002e-05 2024-04-19T04:25:28.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534246+0000", 2024-04-19T04:25:28.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3098999999999999e-05 2024-04-19T04:25:28.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534357+0000", 2024-04-19T04:25:28.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000111326 2024-04-19T04:25:28.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting_for_map not empty", 2024-04-19T04:25:28.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.534365+0000", 2024-04-19T04:25:28.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2180000000000002e-06 2024-04-19T04:25:28.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559355+0000", 2024-04-19T04:25:28.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.024990708 2024-04-19T04:25:28.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:28.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559426+0000", 2024-04-19T04:25:28.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0270000000000003e-05 2024-04-19T04:25:28.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:28.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.559540+0000", 2024-04-19T04:25:28.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114646 2024-04-19T04:25:28.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:28.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.561611+0000", 2024-04-19T04:25:28.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020707389999999998 2024-04-19T04:25:28.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:28.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564087+0000", 2024-04-19T04:25:28.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024759819999999998 2024-04-19T04:25:28.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:28.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564136+0000", 2024-04-19T04:25:28.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8751000000000001e-05 2024-04-19T04:25:28.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:20.564158+0000", 2024-04-19T04:25:28.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2575999999999999e-05 2024-04-19T04:25:28.834 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.834 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.834 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.834 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:28.834 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:28.834 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.585029439000003, 2024-04-19T04:25:28.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:28.834 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.835 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:28.835 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:28.835 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:28.835 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:28.835 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:28.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.835 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:28.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:28.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:28.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:28.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:28.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:28.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:28.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:28.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:28.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:28.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:28.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:28.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:28.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:28.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:28.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:28.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:28.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:28.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:28.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:28.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:28.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:28.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:28.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:28.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:28.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:28.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:28.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:28.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:28.841 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.841 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.841 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.841 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:28.841 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:28.841 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.581848282999999, 2024-04-19T04:25:28.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:28.841 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.842 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:28.842 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:28.842 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:28.842 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:28.842 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:28.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.842 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:28.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:28.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:28.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:28.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:28.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:28.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:28.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:28.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:28.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:28.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:28.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:28.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:28.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:28.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:28.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:28.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:28.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:28.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:28.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:28.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:28.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:28.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:28.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:28.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:28.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:28.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:28.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:28.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:28.847 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.847 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.847 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.847 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:28.847 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:28.848 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.581280178999997, 2024-04-19T04:25:28.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:28.848 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.848 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:28.848 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:28.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:28.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:28.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:28.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:28.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:28.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:28.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:28.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:28.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:28.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:28.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:28.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:28.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:28.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:28.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:28.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:28.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:28.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:28.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:28.851 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.851 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.851 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.852 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:28.852 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:28.852 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.580934517999999, 2024-04-19T04:25:28.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:28.852 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.852 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:28.852 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:28.852 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:28.852 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:28.852 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:28.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.853 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:28.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:28.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:28.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:28.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:28.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:28.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:28.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:28.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:28.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:28.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:28.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:28.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:28.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:28.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:28.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:28.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:28.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:28.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:28.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:28.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:28.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:28.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:28.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:28.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:28.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:28.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:28.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:28.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:28.857 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.857 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.857 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.858 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:28.858 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:28.858 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.580210080000001, 2024-04-19T04:25:28.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:28.858 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.858 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:28.858 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:28.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:28.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:28.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:28.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:28.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:28.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:28.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:28.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:28.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:28.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:28.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:28.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:28.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:28.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:28.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:28.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:28.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:28.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:28.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:28.862 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.862 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.862 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.862 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:28.862 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:28.862 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.580202685000003, 2024-04-19T04:25:28.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:28.863 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.863 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:28.863 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:28.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:28.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:28.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:28.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:28.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:28.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:28.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:28.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:28.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:28.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:28.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:28.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:28.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:28.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:28.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:28.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:28.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:28.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:28.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:28.866 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.866 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.866 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.867 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:28.867 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:28.867 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.578377537999998, 2024-04-19T04:25:28.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:28.867 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.867 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:28.867 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:28.867 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:28.867 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:28.867 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:28.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.868 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:28.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:28.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:28.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:28.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:28.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:28.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:28.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:28.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:28.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:28.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:28.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:28.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:28.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:28.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:28.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:28.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:28.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:28.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:28.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:28.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:28.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:28.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:28.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:28.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:28.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:28.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:28.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:28.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:28.872 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.872 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.872 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.873 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26148 5.9 e27/20 ondisk, result = 0)", 2024-04-19T04:25:28.873 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:28.873 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.578277213, 2024-04-19T04:25:28.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.042005175999999998, 2024-04-19T04:25:28.873 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.873 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:28.873 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:28.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238277+0000", 2024-04-19T04:25:28.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238276+0000", 2024-04-19T04:25:28.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:28.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238280+0000", 2024-04-19T04:25:28.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6399999999999999e-06 2024-04-19T04:25:28.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238286+0000", 2024-04-19T04:25:28.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2099999999999998e-06 2024-04-19T04:25:28.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238290+0000", 2024-04-19T04:25:28.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2470000000000002e-06 2024-04-19T04:25:28.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239526+0000", 2024-04-19T04:25:28.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012362619999999999 2024-04-19T04:25:28.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:28.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239538+0000", 2024-04-19T04:25:28.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1620999999999999e-05 2024-04-19T04:25:28.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280282+0000", 2024-04-19T04:25:28.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040743691999999998 2024-04-19T04:25:28.876 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.876 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.876 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.877 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:28.877 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:28.877 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.577643332999997, 2024-04-19T04:25:28.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:28.877 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.877 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:28.877 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:28.877 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:28.877 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:28.877 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:28.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.877 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:28.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:28.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:28.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:28.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:28.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:28.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:28.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:28.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:28.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:28.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:28.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:28.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:28.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:28.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:28.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:28.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:28.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:28.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:28.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:28.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:28.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:28.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:28.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:28.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:28.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:28.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:28.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:28.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:28.883 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.883 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.883 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.883 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:28.883 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:28.884 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.577109057000001, 2024-04-19T04:25:28.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:28.884 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.884 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:28.884 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:28.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:28.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:28.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:28.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:28.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:28.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:28.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:28.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.886 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.886 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:28.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:28.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.886 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.886 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:28.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:28.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.886 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:28.886 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:28.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:28.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:28.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:28.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:28.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:28.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:28.887 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.887 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.887 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.888 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:26160 5.f e27/20 ondisk, result = 0)", 2024-04-19T04:25:28.888 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:28.888 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.575993682000004, 2024-04-19T04:25:28.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039752357000000002, 2024-04-19T04:25:28.888 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.888 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:28.888 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:28.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240560+0000", 2024-04-19T04:25:28.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240559+0000", 2024-04-19T04:25:28.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:28.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.240569+0000", 2024-04-19T04:25:28.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7720000000000006e-06 2024-04-19T04:25:28.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280164+0000", 2024-04-19T04:25:28.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039595324000000001 2024-04-19T04:25:28.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280190+0000", 2024-04-19T04:25:28.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5692000000000001e-05 2024-04-19T04:25:28.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280287+0000", 2024-04-19T04:25:28.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7536999999999998e-05 2024-04-19T04:25:28.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:28.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280299+0000", 2024-04-19T04:25:28.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2057e-05 2024-04-19T04:25:28.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:28.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3244999999999999e-05 2024-04-19T04:25:28.891 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.891 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.891 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.892 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26179 5.3 e27/20 5:c71f0acc:::benchmark_data_smithi007_19526_object26178:head v 27'1624, mlcod=27'1621)", 2024-04-19T04:25:28.892 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:28.892 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.572839930000001, 2024-04-19T04:25:28.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.039964081999999998, 2024-04-19T04:25:28.892 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.892 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:28.892 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:28.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243714+0000", 2024-04-19T04:25:28.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.893 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.893 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243713+0000", 2024-04-19T04:25:28.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:28.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.893 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.893 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.243750+0000", 2024-04-19T04:25:28.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6704e-05 2024-04-19T04:25:28.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280162+0000", 2024-04-19T04:25:28.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036412117000000001 2024-04-19T04:25:28.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280186+0000", 2024-04-19T04:25:28.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4825999999999999e-05 2024-04-19T04:25:28.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280312+0000", 2024-04-19T04:25:28.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012540000000000001 2024-04-19T04:25:28.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:28.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280347+0000", 2024-04-19T04:25:28.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4894000000000002e-05 2024-04-19T04:25:28.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:28.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283654+0000", 2024-04-19T04:25:28.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00330716 2024-04-19T04:25:28.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283678+0000", 2024-04-19T04:25:28.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3992e-05 2024-04-19T04:25:28.896 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.896 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.896 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.896 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:28.896 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:28.896 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.860253868000001, 2024-04-19T04:25:28.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:28.896 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.896 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:28.896 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:28.897 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:28.897 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:28.897 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:28.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.897 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:28.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.898 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:28.898 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.898 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.898 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:28.898 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:28.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.898 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.898 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:28.898 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:28.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:28.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:28.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:28.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:28.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:28.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:28.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:28.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:28.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:28.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:28.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:28.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:28.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:28.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:28.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:28.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:28.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:28.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:28.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:28.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:28.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:28.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.840023419, 2024-04-19T04:25:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.839915562, 2024-04-19T04:25:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.837948873, 2024-04-19T04:25:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:28.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:28.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:28.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:28.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:28.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.834584678000001, 2024-04-19T04:25:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.8307737, 2024-04-19T04:25:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.932 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:28.932 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:28.932 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:28.933 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:28.934 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:28.930+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:29.034 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:29.029+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:29.058 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:29.058 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:29.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.058 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:93357 5.4 5:23fa8087:::benchmark_data_smithi007_19526_object93356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:29.058 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:29.047337+0000", 2024-04-19T04:25:29.058 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.010565659999999999, 2024-04-19T04:25:29.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010593384000000001, 2024-04-19T04:25:29.058 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.058 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:29.058 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.059 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.059 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.059 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 93357 2024-04-19T04:25:29.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.059 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.047337+0000", 2024-04-19T04:25:29.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.047337+0000", 2024-04-19T04:25:29.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.047336+0000", 2024-04-19T04:25:29.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.047442+0000", 2024-04-19T04:25:29.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105949 2024-04-19T04:25:29.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.047455+0000", 2024-04-19T04:25:29.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.305e-05 2024-04-19T04:25:29.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.047471+0000", 2024-04-19T04:25:29.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5375000000000001e-05 2024-04-19T04:25:29.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.051848+0000", 2024-04-19T04:25:29.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0043777349999999998 2024-04-19T04:25:29.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.051985+0000", 2024-04-19T04:25:29.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013690600000000001 2024-04-19T04:25:29.062 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.062 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.062 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.063 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:93360 5.a 5:518d1246:::benchmark_data_smithi007_19526_object93359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:29.063 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:29.048791+0000", 2024-04-19T04:25:29.063 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00911147, 2024-04-19T04:25:29.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092136719999999991, 2024-04-19T04:25:29.063 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.063 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:29.063 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.063 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.063 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.063 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 93360 2024-04-19T04:25:29.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.063 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.048791+0000", 2024-04-19T04:25:29.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.048791+0000", 2024-04-19T04:25:29.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.048791+0000", 2024-04-19T04:25:29.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.048848+0000", 2024-04-19T04:25:29.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6944000000000002e-05 2024-04-19T04:25:29.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.048867+0000", 2024-04-19T04:25:29.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9551e-05 2024-04-19T04:25:29.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.048874+0000", 2024-04-19T04:25:29.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2189999999999998e-06 2024-04-19T04:25:29.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.051691+0000", 2024-04-19T04:25:29.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028165820000000002 2024-04-19T04:25:29.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.051819+0000", 2024-04-19T04:25:29.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012793 2024-04-19T04:25:29.066 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.066 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.066 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.067 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:93365 5.4 5:258d909f:::benchmark_data_smithi007_19526_object93364:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:29.067 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:29.052128+0000", 2024-04-19T04:25:29.067 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0057747079999999999, 2024-04-19T04:25:29.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059442560000000002, 2024-04-19T04:25:29.067 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.067 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:29.067 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.067 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.067 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.067 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 93365 2024-04-19T04:25:29.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.067 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.052128+0000", 2024-04-19T04:25:29.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.052128+0000", 2024-04-19T04:25:29.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.052127+0000", 2024-04-19T04:25:29.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.052198+0000", 2024-04-19T04:25:29.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0901000000000004e-05 2024-04-19T04:25:29.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.052209+0000", 2024-04-19T04:25:29.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1083e-05 2024-04-19T04:25:29.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.052217+0000", 2024-04-19T04:25:29.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2400000000000007e-06 2024-04-19T04:25:29.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.054796+0000", 2024-04-19T04:25:29.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025784800000000002 2024-04-19T04:25:29.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.054898+0000", 2024-04-19T04:25:29.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102532 2024-04-19T04:25:29.070 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.070 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.070 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.071 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:93366 5.b 5:ded55ba7:::benchmark_data_smithi007_19526_object93365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:29.071 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:29.052231+0000", 2024-04-19T04:25:29.071 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0056719550000000002, 2024-04-19T04:25:29.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059253409999999998, 2024-04-19T04:25:29.071 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.071 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:29.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.071 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 93366 2024-04-19T04:25:29.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.071 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.052231+0000", 2024-04-19T04:25:29.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.052231+0000", 2024-04-19T04:25:29.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.052230+0000", 2024-04-19T04:25:29.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:29.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.052267+0000", 2024-04-19T04:25:29.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6279999999999998e-05 2024-04-19T04:25:29.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.052276+0000", 2024-04-19T04:25:29.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8780000000000004e-06 2024-04-19T04:25:29.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.052282+0000", 2024-04-19T04:25:29.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2740000000000004e-06 2024-04-19T04:25:29.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.052333+0000", 2024-04-19T04:25:29.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1476e-05 2024-04-19T04:25:29.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.052436+0000", 2024-04-19T04:25:29.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102839 2024-04-19T04:25:29.074 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.074 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.074 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.075 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:93371 5.4 5:2fec5aa6:::benchmark_data_smithi007_19526_object93370:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:29.075 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:29.054940+0000", 2024-04-19T04:25:29.075 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0029628929999999999, 2024-04-19T04:25:29.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033280649999999998, 2024-04-19T04:25:29.075 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.075 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:29.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.075 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 93371 2024-04-19T04:25:29.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.075 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.054940+0000", 2024-04-19T04:25:29.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.054940+0000", 2024-04-19T04:25:29.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.054939+0000", 2024-04-19T04:25:29.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.055001+0000", 2024-04-19T04:25:29.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1871000000000004e-05 2024-04-19T04:25:29.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.055010+0000", 2024-04-19T04:25:29.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3980000000000005e-06 2024-04-19T04:25:29.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.055016+0000", 2024-04-19T04:25:29.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1199999999999999e-06 2024-04-19T04:25:29.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.056434+0000", 2024-04-19T04:25:29.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001417595 2024-04-19T04:25:29.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.056560+0000", 2024-04-19T04:25:29.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012552700000000001 2024-04-19T04:25:29.079 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.079 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.079 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.079 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:93373 5.8 5:16beec6b:::benchmark_data_smithi007_19526_object93372:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:29.079 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:29.057006+0000", 2024-04-19T04:25:29.079 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00089716600000000002, 2024-04-19T04:25:29.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013292709999999999, 2024-04-19T04:25:29.079 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.079 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:29.079 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.080 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.080 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.080 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 93373 2024-04-19T04:25:29.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.080 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.057006+0000", 2024-04-19T04:25:29.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.057006+0000", 2024-04-19T04:25:29.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.057005+0000", 2024-04-19T04:25:29.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.057084+0000", 2024-04-19T04:25:29.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9035000000000005e-05 2024-04-19T04:25:29.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.057096+0000", 2024-04-19T04:25:29.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1922e-05 2024-04-19T04:25:29.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.057102+0000", 2024-04-19T04:25:29.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9719999999999997e-06 2024-04-19T04:25:29.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.057137+0000", 2024-04-19T04:25:29.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5496e-05 2024-04-19T04:25:29.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.057229+0000", 2024-04-19T04:25:29.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2158999999999996e-05 2024-04-19T04:25:29.083 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.083 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.083 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.083 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:93374 5.a 5:5e5ae17f:::benchmark_data_smithi007_19526_object93373:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:29.083 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:29.057428+0000", 2024-04-19T04:25:29.083 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00047470800000000001, 2024-04-19T04:25:29.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00097272600000000004, 2024-04-19T04:25:29.083 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.083 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:29.084 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.084 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.084 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.084 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 93374 2024-04-19T04:25:29.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.084 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.057428+0000", 2024-04-19T04:25:29.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.057428+0000", 2024-04-19T04:25:29.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.057428+0000", 2024-04-19T04:25:29.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:29.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.057480+0000", 2024-04-19T04:25:29.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2454999999999998e-05 2024-04-19T04:25:29.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.057488+0000", 2024-04-19T04:25:29.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1450000000000008e-06 2024-04-19T04:25:29.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.057493+0000", 2024-04-19T04:25:29.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4569999999999998e-06 2024-04-19T04:25:29.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.057540+0000", 2024-04-19T04:25:29.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7314000000000001e-05 2024-04-19T04:25:29.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.057657+0000", 2024-04-19T04:25:29.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117619 2024-04-19T04:25:29.087 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.087 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.087 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.087 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:93377 5.4 5:2a380874:::benchmark_data_smithi007_19526_object93376:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:29.087 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:29.058169+0000", 2024-04-19T04:25:29.087 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9997334, 2024-04-19T04:25:29.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00030008699999999999, 2024-04-19T04:25:29.087 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.087 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:29.088 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.088 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.088 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.088 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 93377 2024-04-19T04:25:29.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.088 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.058169+0000", 2024-04-19T04:25:29.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.058169+0000", 2024-04-19T04:25:29.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.058168+0000", 2024-04-19T04:25:29.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.058275+0000", 2024-04-19T04:25:29.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010642200000000001 2024-04-19T04:25:29.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.058289+0000", 2024-04-19T04:25:29.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4635e-05 2024-04-19T04:25:29.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.058300+0000", 2024-04-19T04:25:29.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0409e-05 2024-04-19T04:25:29.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.058366+0000", 2024-04-19T04:25:29.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6722000000000003e-05 2024-04-19T04:25:29.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:29.058473+0000", 2024-04-19T04:25:29.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106449 2024-04-19T04:25:29.091 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.091 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.091 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.091 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.091 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:29.091 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 8 2024-04-19T04:25:29.091 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:29.092 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:29.134 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:29.134+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:29.226 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:29.226 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:29.226 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:29.226 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:29.226 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:29.235 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:29.234+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:29.237 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:29.336 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:29.333+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:29.408 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:29.408 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:29.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:29.408 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:29.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.409 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:29.409 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:29.409 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.170471263000003, 2024-04-19T04:25:29.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:29.409 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.409 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.409 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.409 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.409 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.409 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:29.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.409 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:29.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:29.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:29.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:29.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:29.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:29.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:29.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:29.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:29.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:29.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:29.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:29.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:29.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:29.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:29.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:29.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:29.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:29.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:29.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:29.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:29.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:29.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:29.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:29.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:29.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:29.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:29.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:29.415 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.415 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.415 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.416 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:29.416 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:29.416 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.166022347000002, 2024-04-19T04:25:29.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:29.416 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.416 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.416 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.416 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.416 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.416 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:29.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.416 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:29.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:29.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:29.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:29.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:29.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:29.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:29.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:29.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:29.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:29.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:29.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:29.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:29.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:29.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:29.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:29.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:29.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:29.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:29.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:29.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:29.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:29.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:29.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:29.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:29.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:29.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:29.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:29.421 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.422 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.422 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.422 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:29.422 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:29.422 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.338090103999999, 2024-04-19T04:25:29.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:29.422 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.422 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.422 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.422 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.422 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.422 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:29.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.423 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:29.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:29.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:29.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:29.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:29.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:29.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:29.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:29.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:29.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:29.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:29.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:29.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:29.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:29.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:29.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:29.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:29.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:29.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:29.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:29.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:29.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:29.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:29.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:29.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:29.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:29.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:29.429 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.429 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.429 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.429 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:29.429 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:29.429 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.902236067, 2024-04-19T04:25:29.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:29.430 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.430 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.430 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.430 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.430 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.430 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:29.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.430 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:29.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:29.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:29.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:29.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:29.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:29.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:29.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:29.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:29.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:29.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:29.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:29.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:29.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:29.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:29.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:29.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:29.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:29.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:29.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:29.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:29.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:29.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:29.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:29.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:29.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:29.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:29.435 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.435 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.435 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.435 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:29.435 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:29.435 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.901805647, 2024-04-19T04:25:29.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:29.436 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.436 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.436 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.436 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.436 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.436 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:29.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.436 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:29.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:29.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:29.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:29.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:29.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:29.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:29.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:29.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:29.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:29.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:29.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:29.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:29.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:29.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:29.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:29.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:29.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:29.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:29.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:29.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:29.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:29.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:29.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:29.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:29.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:29.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:29.441 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.441 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.441 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.442 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:29.442 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:29.442 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.899574383000001, 2024-04-19T04:25:29.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:29.442 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.442 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.442 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.442 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.442 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.442 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:29.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.442 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:29.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:29.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:29.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:29.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:29.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:29.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:29.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:29.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:29.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:29.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:29.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:29.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:29.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:29.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:29.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:29.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:29.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:29.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:29.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:29.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:29.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:29.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:29.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:29.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:29.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:29.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:29.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:29.447 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.447 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.447 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.447 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:29.447 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:29.447 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.896177345, 2024-04-19T04:25:29.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:29.448 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.448 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.448 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.448 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.448 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.448 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:29.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.448 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:29.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:29.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:29.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:29.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:29.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:29.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:29.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:29.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:29.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:29.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:29.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:29.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:29.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:29.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:29.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:29.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:29.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:29.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:29.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:29.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:29.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:29.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:29.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:29.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:29.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:29.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:29.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:29.453 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.453 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.453 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.453 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:29.453 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:29.453 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.891049147, 2024-04-19T04:25:29.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:29.454 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.454 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.454 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.454 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.454 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.454 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:29.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.454 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:29.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:29.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:29.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:29.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:29.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:29.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:29.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:29.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:29.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:29.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:29.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:29.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:29.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:29.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:29.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:29.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:29.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:29.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:29.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:29.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:29.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:29.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:29.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:29.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:29.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:29.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:29.459 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.459 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.459 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.459 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:29.459 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:29.459 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.577020642000001, 2024-04-19T04:25:29.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:29.459 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.459 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.459 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.460 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.460 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.460 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:29.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.460 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:29.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:29.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:29.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:29.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:29.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:29.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:29.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:29.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:29.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:29.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:29.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:29.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:29.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:29.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:29.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:29.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:29.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:29.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:29.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:29.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:29.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:29.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:29.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:29.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:29.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:29.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:29.465 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.465 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.465 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.465 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67949 5.b 5:d725bcef:::benchmark_data_smithi007_19526_object67948:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:29.465 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:29.465 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.573902364, 2024-04-19T04:25:29.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022537248999999999, 2024-04-19T04:25:29.465 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.465 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.465 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.466 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.466 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.466 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67949 2024-04-19T04:25:29.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.466 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:29.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:29.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832099+0000", 2024-04-19T04:25:29.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832148+0000", 2024-04-19T04:25:29.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9517e-05 2024-04-19T04:25:29.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832154+0000", 2024-04-19T04:25:29.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5319999999999997e-06 2024-04-19T04:25:29.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832158+0000", 2024-04-19T04:25:29.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9099999999999998e-06 2024-04-19T04:25:29.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.833836+0000", 2024-04-19T04:25:29.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001678817 2024-04-19T04:25:29.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834007+0000", 2024-04-19T04:25:29.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000170151 2024-04-19T04:25:29.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:29.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834238+0000", 2024-04-19T04:25:29.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023146700000000001 2024-04-19T04:25:29.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:29.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.839447+0000", 2024-04-19T04:25:29.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005209272 2024-04-19T04:25:29.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:29.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854573+0000", 2024-04-19T04:25:29.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015125945 2024-04-19T04:25:29.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:29.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854607+0000", 2024-04-19T04:25:29.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3782000000000003e-05 2024-04-19T04:25:29.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854637+0000", 2024-04-19T04:25:29.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9827000000000001e-05 2024-04-19T04:25:29.471 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.471 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.471 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.471 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:29.471 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:29.471 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.454661231999999, 2024-04-19T04:25:29.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:25:29.471 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.472 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:29.472 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.472 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.472 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.472 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:29.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.472 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:29.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:29.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:29.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:29.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:29.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:29.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:29.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:29.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:29.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:29.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:29.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:29.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:29.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:29.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:29.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:29.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:29.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:29.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:29.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:29.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:29.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:29.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:29.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:29.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:29.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:25:29.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:25:29.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:25:29.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:25:29.477 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.477 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.477 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.477 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:29.477 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:29.477 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.449599586, 2024-04-19T04:25:29.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:25:29.478 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.478 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:29.478 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.478 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.478 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.478 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:29.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.478 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:29.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:29.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:29.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:29.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:29.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:29.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:29.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:29.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:29.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:29.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:29.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:29.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:29.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:29.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:29.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:29.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:29.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:29.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:29.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:29.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:29.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:29.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:25:29.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:25:29.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:25:29.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:25:29.483 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.483 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.483 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.484 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:29.484 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:29.484 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.449499674, 2024-04-19T04:25:29.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:25:29.484 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.484 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:29.484 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.484 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.484 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.484 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:29.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.485 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:29.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:29.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:29.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:29.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:29.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:29.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:29.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:29.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:29.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:29.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:29.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:29.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:29.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:29.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:29.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:29.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:29.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:29.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:29.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:29.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:29.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:29.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:25:29.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:25:29.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:25:29.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:25:29.493 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.493 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.493 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.494 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:29.494 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:29.494 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.449373920999999, 2024-04-19T04:25:29.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:25:29.494 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.494 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:29.494 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.494 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.494 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.494 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:29.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.494 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:29.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:29.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:29.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:29.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:29.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:29.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:29.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:29.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:29.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:29.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:29.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:29.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:29.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:29.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:29.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:29.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:29.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:29.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:29.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:29.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:29.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:25:29.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:25:29.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:25:29.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:25:29.500 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.500 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.500 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.501 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:29.501 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:29.501 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.445529976, 2024-04-19T04:25:29.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:25:29.501 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.501 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.501 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.501 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.501 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.501 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:29.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.501 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:29.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:29.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:29.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:29.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:29.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:29.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:29.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:29.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:29.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:29.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:29.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:29.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:29.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:29.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:29.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:25:29.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:25:29.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:25:29.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:25:29.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:29.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:25:29.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:25:29.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:29.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:25:29.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:25:29.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:25:29.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:25:29.506 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.506 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.506 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.507 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:29.507 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:29.507 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.438358875, 2024-04-19T04:25:29.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:25:29.507 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.507 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:29.507 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.507 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.507 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.507 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:29.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.507 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:29.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:29.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:29.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:29.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:29.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:29.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:29.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:29.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:29.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:29.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:29.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:29.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:29.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:29.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:29.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:25:29.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:25:29.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:25:29.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:25:29.511 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.512 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.512 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.512 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:29.512 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:29.512 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.438186771, 2024-04-19T04:25:29.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:25:29.512 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.512 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:29.512 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.512 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.512 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.513 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:29.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.513 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:29.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:29.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:29.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:29.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:29.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:29.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:29.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:29.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:29.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:29.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:29.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:29.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:29.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:29.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:29.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:25:29.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:25:29.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:25:29.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:25:29.516 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.516 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.516 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.517 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:29.517 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:29.517 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.438123645999999, 2024-04-19T04:25:29.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:25:29.517 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.517 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.517 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.517 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.517 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.517 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:29.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.517 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:29.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:29.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:29.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:29.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:29.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:29.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:29.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:29.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:29.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:29.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:29.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:29.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:29.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:29.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:29.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:25:29.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:25:29.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:25:29.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:25:29.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:29.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:25:29.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:25:29.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:29.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:25:29.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:25:29.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:25:29.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:25:29.523 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.523 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.523 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.523 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:29.523 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:29.523 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.437995049, 2024-04-19T04:25:29.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:25:29.523 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.524 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.524 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.524 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.524 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.524 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:29.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.524 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:29.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:29.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:29.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:29.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:29.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:29.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:29.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:29.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:29.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:29.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:29.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:29.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:29.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:29.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:29.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:25:29.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:25:29.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:25:29.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:25:29.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:29.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:25:29.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:25:29.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:29.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:25:29.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:25:29.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:25:29.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:25:29.529 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.529 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.529 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.529 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:29.529 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:29.529 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.437927078, 2024-04-19T04:25:29.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:25:29.530 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:29.530 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.530 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:29.530 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:29.530 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.530 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:29.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.530 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:29.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:29.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:29.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:29.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:29.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:29.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:29.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:29.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:29.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:29.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:29.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:29.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:29.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:29.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:29.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:29.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:29.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:29.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:29.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:29.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:29.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:29.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:29.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:25:29.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:25:29.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:29.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:25:29.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:25:29.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:29.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:25:29.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:25:29.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:29.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:25:29.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:25:29.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:29.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:29.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:29.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:25:29.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:25:29.535 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.535 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.535 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.535 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:29.535 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:29.535 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:29.537 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:29.534+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:29.537 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:29.638 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:29.633+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:29.674 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:29.674 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:29.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.674 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:94610 5.5 5:a1b7d34a:::benchmark_data_smithi007_19526_object94609:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:29.674 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.670302+0000", 2024-04-19T04:25:29.674 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0045017369999999996, 2024-04-19T04:25:29.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0045286789999999999, 2024-04-19T04:25:29.675 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:29.675 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:29.675 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:29.675 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:29.675 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.675 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 94610 2024-04-19T04:25:29.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.675 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:29.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:29.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.670302+0000", 2024-04-19T04:25:29.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:29.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:29.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.670302+0000", 2024-04-19T04:25:29.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:29.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:29.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.670301+0000", 2024-04-19T04:25:29.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:29.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.670393+0000", 2024-04-19T04:25:29.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1595999999999995e-05 2024-04-19T04:25:29.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:29.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.670402+0000", 2024-04-19T04:25:29.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2939999999999994e-06 2024-04-19T04:25:29.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.670409+0000", 2024-04-19T04:25:29.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9530000000000002e-06 2024-04-19T04:25:29.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:29.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.672527+0000", 2024-04-19T04:25:29.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0021183489999999998 2024-04-19T04:25:29.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:29.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.672702+0000", 2024-04-19T04:25:29.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017510099999999999 2024-04-19T04:25:29.678 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:29.678 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:29.678 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:29.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.678 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:94612 5.d 5:bc4cd9ed:::benchmark_data_smithi007_19526_object94611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:29.678 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.673765+0000", 2024-04-19T04:25:29.678 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0010386810000000001, 2024-04-19T04:25:29.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0011482560000000001, 2024-04-19T04:25:29.679 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:29.679 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:29.679 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:29.679 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:29.679 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.679 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 94612 2024-04-19T04:25:29.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.679 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:29.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:29.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.673765+0000", 2024-04-19T04:25:29.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:29.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:29.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.673765+0000", 2024-04-19T04:25:29.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:29.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:29.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.673764+0000", 2024-04-19T04:25:29.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:29.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.673841+0000", 2024-04-19T04:25:29.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6969000000000001e-05 2024-04-19T04:25:29.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:29.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.673866+0000", 2024-04-19T04:25:29.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4754000000000001e-05 2024-04-19T04:25:29.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.673872+0000", 2024-04-19T04:25:29.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5370000000000003e-06 2024-04-19T04:25:29.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:29.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674191+0000", 2024-04-19T04:25:29.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031848100000000002 2024-04-19T04:25:29.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:29.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674310+0000", 2024-04-19T04:25:29.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000119493 2024-04-19T04:25:29.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:29.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674710+0000", 2024-04-19T04:25:29.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00039993299999999999 2024-04-19T04:25:29.682 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:29.682 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:29.682 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:29.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.683 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:94615 5.6 5:608776b0:::benchmark_data_smithi007_19526_object94614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:29.683 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.674613+0000", 2024-04-19T04:25:29.683 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.000190509, 2024-04-19T04:25:29.683 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00037702299999999998, 2024-04-19T04:25:29.683 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:29.683 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:29.683 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:29.683 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:29.683 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.683 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 94615 2024-04-19T04:25:29.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.683 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:29.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.684 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:29.684 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674613+0000", 2024-04-19T04:25:29.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:29.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.684 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:29.684 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674613+0000", 2024-04-19T04:25:29.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:29.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.684 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:29.684 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674612+0000", 2024-04-19T04:25:29.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:29.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:29.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674678+0000", 2024-04-19T04:25:29.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5599000000000007e-05 2024-04-19T04:25:29.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:29.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674688+0000", 2024-04-19T04:25:29.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8830000000000001e-06 2024-04-19T04:25:29.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674697+0000", 2024-04-19T04:25:29.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.4339999999999998e-06 2024-04-19T04:25:29.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.686 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:29.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674743+0000", 2024-04-19T04:25:29.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5547000000000003e-05 2024-04-19T04:25:29.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.686 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:29.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674841+0000", 2024-04-19T04:25:29.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7790999999999999e-05 2024-04-19T04:25:29.686 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:29.686 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:29.686 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:29.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.686 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:94616 5.7 5:e4cc33f2:::benchmark_data_smithi007_19526_object94615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:29.687 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.674713+0000", 2024-04-19T04:25:29.687 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.0192999999999995e-05, 2024-04-19T04:25:29.687 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034459300000000003, 2024-04-19T04:25:29.687 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:29.687 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:29.687 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:29.687 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:29.687 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.687 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 94616 2024-04-19T04:25:29.687 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.687 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:29.687 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.687 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:29.687 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674713+0000", 2024-04-19T04:25:29.687 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:29.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:29.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674713+0000", 2024-04-19T04:25:29.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:29.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:29.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674713+0000", 2024-04-19T04:25:29.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:29.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:29.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674751+0000", 2024-04-19T04:25:29.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.8494000000000001e-05 2024-04-19T04:25:29.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:29.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674760+0000", 2024-04-19T04:25:29.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.585e-06 2024-04-19T04:25:29.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674766+0000", 2024-04-19T04:25:29.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1940000000000003e-06 2024-04-19T04:25:29.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:29.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674818+0000", 2024-04-19T04:25:29.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1796999999999999e-05 2024-04-19T04:25:29.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.690 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:29.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.674972+0000", 2024-04-19T04:25:29.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153838 2024-04-19T04:25:29.690 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:29.690 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:29.690 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:29.690 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:29.690 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:29.690 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 4 2024-04-19T04:25:29.690 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:29.691 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:29.705 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T04:25:29.739 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:29.738+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:29.755 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 45 16 94777 94761 131.597 126.312 0.00698862 0.00759317 2024-04-19T04:25:29.816 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-04-19T04:25:29.818 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:29.818 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:29.818 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:29.818 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:29.819 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:29.832 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:29.877 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:29.877+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:29.940 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:29.941+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:29.967 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:29.967 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:29.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:29.967 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:29.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.967 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:29.967 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:29.967 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.733920617999999, 2024-04-19T04:25:29.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:29.968 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:29.968 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.968 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:29.968 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:29.968 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.968 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:29.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.968 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:29.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:29.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:29.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:29.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:29.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:29.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:29.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:29.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:29.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:29.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:29.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:29.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:29.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:29.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:29.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:29.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:29.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:29.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:29.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:29.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.971 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:29.971 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:29.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:29.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.971 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:29.971 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:29.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:29.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:29.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:29.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:29.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:29.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:29.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:29.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:29.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:29.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:29.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:29.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:29.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:29.973 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:29.973 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:29.973 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:29.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.973 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:29.973 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:29.973 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.730739462000003, 2024-04-19T04:25:29.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:29.974 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:29.974 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.974 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:29.974 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:29.974 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.974 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:29.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.976 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:29.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:29.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:29.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:29.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:29.978 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:29.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:29.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:29.980 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:29.980 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.980 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:29.981 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:29.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:29.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.981 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:29.981 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:29.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:29.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.981 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.981 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:29.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:29.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.982 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:29.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:29.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:29.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.982 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:29.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:29.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:29.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.982 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:29.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:29.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:29.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:29.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:29.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:29.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:29.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:29.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:29.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:29.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:29.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:29.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:29.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:29.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:29.984 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:29.984 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:29.984 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:29.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.984 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:29.984 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:29.984 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.730171358, 2024-04-19T04:25:29.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:29.984 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:29.985 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.985 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:29.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:29.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:29.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:29.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:29.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:29.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:29.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:29.986 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:29.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:29.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:29.986 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:29.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:29.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:29.986 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:29.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:29.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.987 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.987 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.987 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:29.987 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:29.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.987 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:29.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:29.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:29.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:29.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:29.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:29.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:29.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:29.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:29.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.989 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:29.989 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:29.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:29.989 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:29.989 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:29.989 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:29.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.989 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:29.989 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:29.989 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.729825697000003, 2024-04-19T04:25:29.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:29.990 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:29.990 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.990 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:29.990 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:29.990 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:29.990 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:29.990 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.990 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:29.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:29.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:29.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:29.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:29.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:29.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:29.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:29.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:29.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:29.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:29.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:29.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:29.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:29.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:29.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:29.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:29.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:29.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:29.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:29.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:29.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:29.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:29.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:29.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:29.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:29.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:29.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:29.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:29.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:29.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:29.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:29.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:29.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:29.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:29.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.995 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:29.995 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:29.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:29.995 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:29.995 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:29.995 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:29.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.995 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:29.995 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:29.995 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.729101258999997, 2024-04-19T04:25:29.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:29.995 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:29.996 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:29.996 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:29.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:29.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:29.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:29.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:29.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:29.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:29.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:29.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:29.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:29.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:29.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:29.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:29.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:29.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:29.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:29.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:29.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:29.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:29.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:29.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:29.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:29.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.999 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:29.999 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:29.999 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:29.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.999 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:29.999 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:29.999 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:29.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:29.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:29.999 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:30.000 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:30.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:30.000 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.000 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.000 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.000 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.000 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:30.000 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:30.000 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.729093863999999, 2024-04-19T04:25:30.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:30.000 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.000 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.000 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:30.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:30.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:30.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:30.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.002 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:30.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:30.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.002 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:30.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:30.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.002 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:30.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:30.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.003 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.003 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:30.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:30.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.003 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.003 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:30.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:30.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.003 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:30.004 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:30.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:30.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.004 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:30.004 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:30.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:30.004 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.004 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.004 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.004 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:30.004 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:30.004 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.727268717000001, 2024-04-19T04:25:30.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:30.005 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.005 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.005 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.005 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.005 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.005 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:30.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.005 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:30.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:30.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:30.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:30.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:30.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.007 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.007 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:30.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:30.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.007 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.007 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:30.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:30.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.007 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.007 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:30.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:30.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:30.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:30.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:30.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:30.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:30.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:30.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:30.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:30.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:30.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:30.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:30.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:30.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:30.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:30.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:30.010 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:30.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:30.010 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.010 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.010 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.010 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.010 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.010 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:30.010 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:30.010 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.726534512000001, 2024-04-19T04:25:30.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:30.010 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.010 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.010 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.011 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.011 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.011 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:30.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.011 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.011 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.011 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.011 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:30.011 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.011 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.011 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.011 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:30.011 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.012 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.012 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.012 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.012 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:30.012 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.012 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.012 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.012 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.012 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:30.012 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:30.012 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.012 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.012 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.012 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:30.013 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:30.013 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.013 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.013 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.013 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:30.013 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:30.013 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.013 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.013 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.013 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:30.013 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:30.013 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.013 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.013 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.014 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:30.014 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:30.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.014 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:30.014 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:30.014 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:30.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.014 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:30.014 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:30.014 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:30.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:30.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:30.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:30.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.015 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:30.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:30.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:30.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.015 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:30.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:30.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:30.016 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.016 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.016 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.016 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:30.016 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:30.016 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.726000235999997, 2024-04-19T04:25:30.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:30.016 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.016 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.016 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:30.017 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.017 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.017 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.017 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:30.017 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.017 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.017 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.017 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:30.017 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.017 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.017 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.017 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:30.018 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:30.018 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.018 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.018 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.018 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:30.018 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:30.018 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.018 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.018 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.018 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:30.018 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:30.018 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.018 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.019 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.019 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:30.019 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:30.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.019 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.019 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.019 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:30.019 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:30.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.019 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.019 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:30.019 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:30.019 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:30.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.020 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.020 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:30.020 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:30.020 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:30.020 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.020 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.020 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.020 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.020 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:30.020 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:30.020 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.009145047000001, 2024-04-19T04:25:30.020 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:30.020 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.021 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:30.021 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.021 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.021 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.021 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:30.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.021 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.021 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.021 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:30.021 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.021 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.022 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:30.022 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.022 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.022 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:30.022 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:30.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.022 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.022 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:30.022 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:30.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.022 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.023 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:30.023 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:30.023 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.023 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.023 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.023 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:30.023 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:30.023 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.023 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.023 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.023 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:30.023 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:30.023 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.023 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.024 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.024 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:30.024 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:30.024 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.024 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.024 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:30.024 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:30.024 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:30.024 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.024 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.024 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:30.024 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:30.024 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:30.024 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:30.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:30.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:30.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:30.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:30.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:30.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:30.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.026 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.026 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:30.026 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:30.026 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:30.026 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.026 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.026 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.026 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.026 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:30.026 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:30.026 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 13.988914598000001, 2024-04-19T04:25:30.026 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:30.026 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.027 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:30.027 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.027 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.027 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.027 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:30.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.027 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.027 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.027 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.027 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:30.027 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.027 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.027 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.027 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:30.028 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.028 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.028 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.028 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.028 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:30.028 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:30.028 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.028 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.028 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.028 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:30.028 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:30.028 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.029 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.029 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.029 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:30.029 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:30.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.029 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.029 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.029 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:30.029 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:30.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.029 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.030 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.030 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:30.030 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:30.030 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.030 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.030 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:30.030 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:30.030 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:30.030 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.030 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.030 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.030 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:30.030 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:30.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.031 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.031 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:30.031 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:30.031 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:30.031 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.031 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.031 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.031 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.031 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:30.031 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:30.031 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 13.988806740999999, 2024-04-19T04:25:30.031 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:30.032 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.032 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:30.032 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.032 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.032 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.032 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:30.032 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.032 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.032 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.032 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.032 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:30.032 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.032 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.032 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.032 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.033 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:30.033 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.033 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.033 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.033 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:30.033 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:30.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.033 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.033 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.033 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:30.033 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:30.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.033 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.034 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.034 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:30.034 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:30.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.034 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.034 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.034 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:30.034 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:30.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.034 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.034 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.034 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:30.034 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:30.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.035 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.035 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:30.035 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:30.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:30.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.035 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.035 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.035 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:30.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:30.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.035 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.035 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:30.035 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:30.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:30.035 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.036 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.036 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.036 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.036 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:30.036 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:30.036 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 13.986840052, 2024-04-19T04:25:30.036 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:30.036 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.036 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.036 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.036 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.036 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.036 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:30.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.037 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.037 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.037 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.037 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:30.037 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.037 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.037 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.037 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.037 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:30.037 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.037 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.037 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.037 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.037 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:30.038 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:30.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.038 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.038 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.038 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:30.038 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:30.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.038 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.038 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.038 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:30.038 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:30.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.038 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.038 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.039 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:30.039 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:30.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.039 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.039 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.039 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:30.039 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:30.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.039 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.039 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:30.039 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:30.039 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:30.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.040 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.040 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.040 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:30.040 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:30.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.040 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.040 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.040 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:30.040 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:30.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.040 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.040 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:30.040 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:30.040 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:30.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.041 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:30.041 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:30.041 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:30.041 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.041 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:30.041 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:30.041 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:30.041 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.041 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.041 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.041 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.042 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:30.042 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:30.042 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 13.983475857, 2024-04-19T04:25:30.042 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:30.042 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.042 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.042 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.042 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.042 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.042 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:30.042 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.042 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.042 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.043 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.043 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:30.043 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.043 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.043 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.043 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:30.043 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.043 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.043 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.043 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:30.043 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.043 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.044 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.044 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:30.044 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:30.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.044 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.044 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.044 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:30.044 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:30.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.044 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.044 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.044 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:30.044 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:30.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.045 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.045 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.045 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:30.045 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:30.045 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.045 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.045 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:30.045 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:30.045 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:30.045 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.045 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.045 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.045 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:30.045 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:30.045 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.046 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.046 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.046 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:30.046 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:30.046 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.046 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.046 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:30.046 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:30.046 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:30.046 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.046 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.046 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:30.046 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:30.046 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:30.047 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.047 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.047 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:30.047 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:30.047 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:30.047 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.047 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.047 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.047 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.047 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.047 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:30.047 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:30.047 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 13.979664879, 2024-04-19T04:25:30.047 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:30.047 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.048 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.048 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.048 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.048 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.048 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:30.048 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.048 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.048 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.048 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.048 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:30.048 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.048 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.048 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.048 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.049 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:30.049 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.049 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.049 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.049 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.049 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:30.049 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.050 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.050 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.050 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.051 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:30.051 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:30.051 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.051 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.051 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.051 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:30.051 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:30.051 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.052 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.052 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.052 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:30.052 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:30.052 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.052 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.052 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.052 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:30.052 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:30.052 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.052 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.052 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:30.052 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:30.052 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:30.053 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.053 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.053 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.053 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:30.053 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:30.053 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.053 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.053 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.053 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:30.053 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:30.053 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.053 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.053 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:30.053 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:30.053 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:30.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.054 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.054 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:30.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:30.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:30.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.054 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.054 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:30.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:30.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:30.054 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.054 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.054 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.055 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93735 5.1 5:8e609d1b:::benchmark_data_smithi007_19526_object93734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.055 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:30.055 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.73796423499999997, 2024-04-19T04:25:30.055 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048424842000000003, 2024-04-19T04:25:30.055 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.055 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.055 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.055 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.055 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.055 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93735 2024-04-19T04:25:30.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.055 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.056 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.056 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:30.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.056 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.056 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.056 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:30.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.056 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.056 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.056 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227480+0000", 2024-04-19T04:25:30.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.056 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.057 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.057 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227533+0000", 2024-04-19T04:25:30.057 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2964999999999999e-05 2024-04-19T04:25:30.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.057 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.057 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227542+0000", 2024-04-19T04:25:30.057 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1449999999999997e-06 2024-04-19T04:25:30.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.057 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.058 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227561+0000", 2024-04-19T04:25:30.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9116000000000001e-05 2024-04-19T04:25:30.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.058 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.058 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227610+0000", 2024-04-19T04:25:30.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9234000000000003e-05 2024-04-19T04:25:30.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.058 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.058 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227697+0000", 2024-04-19T04:25:30.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6682999999999997e-05 2024-04-19T04:25:30.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.059 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:30.059 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275809+0000", 2024-04-19T04:25:30.059 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048112265000000001 2024-04-19T04:25:30.059 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.059 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.059 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:30.059 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275845+0000", 2024-04-19T04:25:30.059 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5275999999999999e-05 2024-04-19T04:25:30.059 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.059 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.059 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:30.059 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275906+0000", 2024-04-19T04:25:30.059 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1002999999999999e-05 2024-04-19T04:25:30.059 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.060 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.060 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.060 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.060 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.060 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93736 5.1 5:852229ec:::benchmark_data_smithi007_19526_object93735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.060 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:30.060 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.73786020500000005, 2024-04-19T04:25:30.060 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048414497000000001, 2024-04-19T04:25:30.060 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.060 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.060 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.060 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.060 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.060 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93736 2024-04-19T04:25:30.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.061 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.061 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:30.061 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.061 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:30.061 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.061 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227584+0000", 2024-04-19T04:25:30.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:30.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227624+0000", 2024-04-19T04:25:30.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9833000000000003e-05 2024-04-19T04:25:30.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227630+0000", 2024-04-19T04:25:30.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0759999999999999e-06 2024-04-19T04:25:30.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227634+0000", 2024-04-19T04:25:30.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1570000000000002e-06 2024-04-19T04:25:30.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229531+0000", 2024-04-19T04:25:30.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018962339999999999 2024-04-19T04:25:30.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229662+0000", 2024-04-19T04:25:30.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013192999999999999 2024-04-19T04:25:30.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.064 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:30.064 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275915+0000", 2024-04-19T04:25:30.064 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046252140999999997 2024-04-19T04:25:30.064 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.064 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.064 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:30.064 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275944+0000", 2024-04-19T04:25:30.064 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9539999999999998e-05 2024-04-19T04:25:30.064 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.064 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.064 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:30.064 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275999+0000", 2024-04-19T04:25:30.064 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5062999999999998e-05 2024-04-19T04:25:30.064 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.065 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.065 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.065 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.065 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.065 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.065 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:30.065 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.73780252199999996, 2024-04-19T04:25:30.065 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:25:30.065 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.065 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.065 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.065 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.065 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.065 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:25:30.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.066 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.066 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.066 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:30.066 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.066 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.066 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:30.066 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.066 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:30.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:30.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:25:30.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:25:30.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:25:30.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:25:30.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.068 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:25:30.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:25:30.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.068 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.068 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:25:30.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:25:30.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.068 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.068 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:25:30.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:25:30.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.068 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:30.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:25:30.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:25:30.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:30.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:25:30.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:25:30.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:30.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:25:30.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:25:30.069 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.069 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.069 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.070 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.070 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:30.070 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.73720824200000001, 2024-04-19T04:25:30.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:25:30.070 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.070 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.070 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.070 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.070 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.070 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:25:30.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.070 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:30.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:30.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:25:30.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:25:30.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:25:30.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:25:30.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:25:30.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:25:30.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:25:30.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:25:30.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:25:30.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:25:30.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:25:30.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:30.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:25:30.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:25:30.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:30.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:25:30.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:25:30.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:30.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:25:30.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:25:30.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:30.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:25:30.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:25:30.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:30.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:25:30.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:25:30.075 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.075 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.075 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.075 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93744 5.1 5:87b91c25:::benchmark_data_smithi007_19526_object93743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.075 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:30.076 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.73353869100000002, 2024-04-19T04:25:30.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044295022000000003, 2024-04-19T04:25:30.076 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.076 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.076 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.076 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.076 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.076 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93744 2024-04-19T04:25:30.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.076 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.076 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.076 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:30.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:30.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231905+0000", 2024-04-19T04:25:30.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231935+0000", 2024-04-19T04:25:30.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9442e-05 2024-04-19T04:25:30.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264224+0000", 2024-04-19T04:25:30.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.032288836000000001 2024-04-19T04:25:30.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264238+0000", 2024-04-19T04:25:30.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4494999999999999e-05 2024-04-19T04:25:30.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268311+0000", 2024-04-19T04:25:30.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040726629999999998 2024-04-19T04:25:30.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268587+0000", 2024-04-19T04:25:30.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00027623200000000001 2024-04-19T04:25:30.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:30.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276099+0000", 2024-04-19T04:25:30.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075116180000000003 2024-04-19T04:25:30.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:30.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276123+0000", 2024-04-19T04:25:30.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4675e-05 2024-04-19T04:25:30.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:30.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276201+0000", 2024-04-19T04:25:30.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7836000000000005e-05 2024-04-19T04:25:30.080 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.080 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.080 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.080 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.080 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.080 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:30.081 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T04:25:30.083 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:30.083 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:30.082+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:30.183 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:30.182+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:30.211 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:30.211 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:30.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.211 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:95742 5.0 5:0f285d1e:::benchmark_data_smithi007_19526_object95741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.211 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:30.203557+0000", 2024-04-19T04:25:30.211 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0084812440000000006, 2024-04-19T04:25:30.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084942669999999998, 2024-04-19T04:25:30.212 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.212 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.212 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.212 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.212 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.212 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 95742 2024-04-19T04:25:30.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.212 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.203557+0000", 2024-04-19T04:25:30.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.203557+0000", 2024-04-19T04:25:30.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.203555+0000", 2024-04-19T04:25:30.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:30.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.203646+0000", 2024-04-19T04:25:30.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0688999999999999e-05 2024-04-19T04:25:30.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.203661+0000", 2024-04-19T04:25:30.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4959e-05 2024-04-19T04:25:30.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.203667+0000", 2024-04-19T04:25:30.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4729999999999997e-06 2024-04-19T04:25:30.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.208494+0000", 2024-04-19T04:25:30.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048269699999999999 2024-04-19T04:25:30.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.208588+0000", 2024-04-19T04:25:30.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3999999999999994e-05 2024-04-19T04:25:30.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:30.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.211947+0000", 2024-04-19T04:25:30.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033589480000000001 2024-04-19T04:25:30.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:30.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.211997+0000", 2024-04-19T04:25:30.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9724e-05 2024-04-19T04:25:30.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.212051+0000", 2024-04-19T04:25:30.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4033999999999998e-05 2024-04-19T04:25:30.216 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.216 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.216 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.216 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:95746 5.0 5:03b3eff0:::benchmark_data_smithi007_19526_object95745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.216 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:30.206001+0000", 2024-04-19T04:25:30.216 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0060372339999999998, 2024-04-19T04:25:30.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006128021, 2024-04-19T04:25:30.216 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.217 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:30.217 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.217 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.217 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.217 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 95746 2024-04-19T04:25:30.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.217 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.206001+0000", 2024-04-19T04:25:30.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.206001+0000", 2024-04-19T04:25:30.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.206000+0000", 2024-04-19T04:25:30.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.206039+0000", 2024-04-19T04:25:30.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9249999999999999e-05 2024-04-19T04:25:30.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.206047+0000", 2024-04-19T04:25:30.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1510000000000004e-06 2024-04-19T04:25:30.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.206053+0000", 2024-04-19T04:25:30.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9359999999999996e-06 2024-04-19T04:25:30.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.210021+0000", 2024-04-19T04:25:30.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039674829999999999 2024-04-19T04:25:30.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.210196+0000", 2024-04-19T04:25:30.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000175396 2024-04-19T04:25:30.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:30.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.212129+0000", 2024-04-19T04:25:30.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019324769999999999 2024-04-19T04:25:30.220 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.220 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.220 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.220 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:95756 5.e 5:7dc68d5e:::benchmark_data_smithi007_19526_object95755:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.220 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:30.210888+0000", 2024-04-19T04:25:30.221 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001149457, 2024-04-19T04:25:30.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001315515, 2024-04-19T04:25:30.221 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.221 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:30.221 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.221 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.221 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.221 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 95756 2024-04-19T04:25:30.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.221 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.210888+0000", 2024-04-19T04:25:30.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.222 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.222 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.210888+0000", 2024-04-19T04:25:30.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.222 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.222 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.210887+0000", 2024-04-19T04:25:30.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:30.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.222 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.222 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.210918+0000", 2024-04-19T04:25:30.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0545e-05 2024-04-19T04:25:30.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.210934+0000", 2024-04-19T04:25:30.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6555e-05 2024-04-19T04:25:30.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.210944+0000", 2024-04-19T04:25:30.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4769999999999992e-06 2024-04-19T04:25:30.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.210999+0000", 2024-04-19T04:25:30.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4954000000000003e-05 2024-04-19T04:25:30.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:30.211127+0000", 2024-04-19T04:25:30.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012891899999999999 2024-04-19T04:25:30.224 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.224 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.224 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.224 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.224 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:30.224 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 3 2024-04-19T04:25:30.224 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:30.225 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:30.285 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:30.285+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:30.353 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:30.354 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:30.354 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:30.354 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:30.354 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:30.367 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:30.386 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:30.385+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:30.486 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:30.486+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:30.494 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:30.494 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:30.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:30.495 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:30.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.495 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:30.495 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:30.495 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.256209863000002, 2024-04-19T04:25:30.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:30.495 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.495 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.495 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.496 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.496 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.496 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:30.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.496 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:30.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:30.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:30.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:30.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:30.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:30.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:30.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:30.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:30.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:30.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:30.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:30.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:30.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:30.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:30.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:30.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:30.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:30.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:30.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:30.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:30.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:30.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:30.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:30.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:30.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:30.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:30.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:30.506 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.506 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.507 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.507 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:30.507 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:30.507 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.251760947000001, 2024-04-19T04:25:30.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:30.508 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.508 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.508 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.508 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.508 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.509 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:30.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.510 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:30.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:30.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:30.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:30.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:30.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:30.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:30.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:30.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:30.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:30.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:30.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:30.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:30.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:30.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:30.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:30.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:30.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:30.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:30.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:30.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:30.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:30.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:30.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:30.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:30.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:30.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:30.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:30.521 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.521 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.521 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.522 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:30.522 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:30.522 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.423828704000002, 2024-04-19T04:25:30.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:30.522 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.522 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.523 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.523 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.523 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.523 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:30.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.523 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.987974667, 2024-04-19T04:25:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.987544247000001, 2024-04-19T04:25:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:30.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:30.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.551 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.551 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.552 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:30.552 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.985312983, 2024-04-19T04:25:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:30.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:30.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:30.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.981915945000001, 2024-04-19T04:25:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.976787746999999, 2024-04-19T04:25:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.662759242, 2024-04-19T04:25:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67949 5.b 5:d725bcef:::benchmark_data_smithi007_19526_object67948:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.659640963999999, 2024-04-19T04:25:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022537248999999999, 2024-04-19T04:25:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67949 2024-04-19T04:25:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832099+0000", 2024-04-19T04:25:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832148+0000", 2024-04-19T04:25:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9517e-05 2024-04-19T04:25:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832154+0000", 2024-04-19T04:25:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5319999999999997e-06 2024-04-19T04:25:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832158+0000", 2024-04-19T04:25:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9099999999999998e-06 2024-04-19T04:25:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.833836+0000", 2024-04-19T04:25:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001678817 2024-04-19T04:25:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834007+0000", 2024-04-19T04:25:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000170151 2024-04-19T04:25:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834238+0000", 2024-04-19T04:25:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023146700000000001 2024-04-19T04:25:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.839447+0000", 2024-04-19T04:25:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005209272 2024-04-19T04:25:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854573+0000", 2024-04-19T04:25:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015125945 2024-04-19T04:25:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854607+0000", 2024-04-19T04:25:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3782000000000003e-05 2024-04-19T04:25:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854637+0000", 2024-04-19T04:25:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9827000000000001e-05 2024-04-19T04:25:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.540399832, 2024-04-19T04:25:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:25:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:25:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:25:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:25:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:25:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.535338186000001, 2024-04-19T04:25:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:25:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:25:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:25:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:25:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:25:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.535238273999999, 2024-04-19T04:25:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:25:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:25:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:25:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:25:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:25:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.535112521, 2024-04-19T04:25:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:25:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:25:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:25:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:25:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:25:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.531268576, 2024-04-19T04:25:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:25:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:25:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:25:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:25:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:25:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:25:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:25:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:25:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:25:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:25:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:25:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.524097475, 2024-04-19T04:25:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:25:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:25:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:25:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:25:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:25:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.523925371000001, 2024-04-19T04:25:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:25:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:25:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:25:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:25:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:25:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.523862246, 2024-04-19T04:25:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:25:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:25:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:25:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:25:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:25:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:25:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:25:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:25:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:25:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:25:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:25:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.523733649, 2024-04-19T04:25:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:25:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:25:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:25:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:25:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:25:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:25:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:25:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:25:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:25:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:25:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:25:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.523665678, 2024-04-19T04:25:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:25:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:25:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:25:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:25:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:25:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:25:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:25:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:25:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:25:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:25:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:25:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.676 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:30.676 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:30.676 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:30.677 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:30.678 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:30.677+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:30.759 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 46 16 96908 96892 131.631 133.188 0.0103782 0.00759084 2024-04-19T04:25:30.778 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:30.777+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:30.803 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:25:30.813 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:30.813 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:30.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.813 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:97026 5.c 5:38badd32:::benchmark_data_smithi007_19526_object97025:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.813 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:30.812099+0000", 2024-04-19T04:25:30.813 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00028001700000000003, 2024-04-19T04:25:30.813 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00030616299999999998, 2024-04-19T04:25:30.813 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.813 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:30.814 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.814 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.814 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.814 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 97026 2024-04-19T04:25:30.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.814 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812099+0000", 2024-04-19T04:25:30.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812099+0000", 2024-04-19T04:25:30.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812099+0000", 2024-04-19T04:25:30.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812136+0000", 2024-04-19T04:25:30.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7190999999999997e-05 2024-04-19T04:25:30.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812162+0000", 2024-04-19T04:25:30.816 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6265e-05 2024-04-19T04:25:30.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.816 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812170+0000", 2024-04-19T04:25:30.816 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8429999999999993e-06 2024-04-19T04:25:30.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.816 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812244+0000", 2024-04-19T04:25:30.816 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4196000000000006e-05 2024-04-19T04:25:30.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.817 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.817 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812361+0000", 2024-04-19T04:25:30.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000117287 2024-04-19T04:25:30.817 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.817 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.817 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.817 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:97028 5.7 5:e14b884f:::benchmark_data_smithi007_19526_object97027:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.817 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:30.812214+0000", 2024-04-19T04:25:30.817 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.000165234, 2024-04-19T04:25:30.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000263455, 2024-04-19T04:25:30.817 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.817 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:30.817 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.818 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.818 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.818 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 97028 2024-04-19T04:25:30.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.818 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.818 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.818 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812214+0000", 2024-04-19T04:25:30.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.818 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.818 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812214+0000", 2024-04-19T04:25:30.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812214+0000", 2024-04-19T04:25:30.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:30.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812264+0000", 2024-04-19T04:25:30.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0693999999999999e-05 2024-04-19T04:25:30.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812277+0000", 2024-04-19T04:25:30.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2914999999999999e-05 2024-04-19T04:25:30.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812284+0000", 2024-04-19T04:25:30.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1949999999999997e-06 2024-04-19T04:25:30.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812329+0000", 2024-04-19T04:25:30.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4759000000000003e-05 2024-04-19T04:25:30.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812473+0000", 2024-04-19T04:25:30.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000144048 2024-04-19T04:25:30.821 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.821 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.821 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.821 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:97020 5.f e43/20)", 2024-04-19T04:25:30.821 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:30.812360+0000", 2024-04-19T04:25:30.821 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.9239e-05, 2024-04-19T04:25:30.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017727800000000001, 2024-04-19T04:25:30.821 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.822 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:30.822 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812360+0000", 2024-04-19T04:25:30.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812360+0000", 2024-04-19T04:25:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812360+0000", 2024-04-19T04:25:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812364+0000", 2024-04-19T04:25:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3089999999999997e-06 2024-04-19T04:25:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812397+0000", 2024-04-19T04:25:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.3154000000000001e-05 2024-04-19T04:25:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812403+0000", 2024-04-19T04:25:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2280000000000003e-06 2024-04-19T04:25:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:97029 5.6 5.11c2d106 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:30.812435+0000", 2024-04-19T04:25:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9999442, 2024-04-19T04:25:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015181, 2024-04-19T04:25:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 97029 2024-04-19T04:25:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812435+0000", 2024-04-19T04:25:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812435+0000", 2024-04-19T04:25:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812434+0000", 2024-04-19T04:25:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812462+0000", 2024-04-19T04:25:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.7837000000000001e-05 2024-04-19T04:25:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812486+0000", 2024-04-19T04:25:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3764000000000002e-05 2024-04-19T04:25:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812493+0000", 2024-04-19T04:25:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5080000000000002e-06 2024-04-19T04:25:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:97010 5.6 5:6a3c6001:::benchmark_data_smithi007_19526_object97009:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:30.804515+0000", 2024-04-19T04:25:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0078641200000000005, 2024-04-19T04:25:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0081280599999999995, 2024-04-19T04:25:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 97010 2024-04-19T04:25:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.804515+0000", 2024-04-19T04:25:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.804515+0000", 2024-04-19T04:25:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.804515+0000", 2024-04-19T04:25:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.804598+0000", 2024-04-19T04:25:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3049999999999999e-05 2024-04-19T04:25:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.804604+0000", 2024-04-19T04:25:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6280000000000002e-06 2024-04-19T04:25:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.804607+0000", 2024-04-19T04:25:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6349999999999999e-06 2024-04-19T04:25:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.804661+0000", 2024-04-19T04:25:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3896e-05 2024-04-19T04:25:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.804804+0000", 2024-04-19T04:25:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014258399999999999 2024-04-19T04:25:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:97012 5.6 5:6292f8e0:::benchmark_data_smithi007_19526_object97011:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:30.804708+0000", 2024-04-19T04:25:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0076713440000000001, 2024-04-19T04:25:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0079971299999999999, 2024-04-19T04:25:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 97012 2024-04-19T04:25:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.804708+0000", 2024-04-19T04:25:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.804708+0000", 2024-04-19T04:25:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.804708+0000", 2024-04-19T04:25:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.804751+0000", 2024-04-19T04:25:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3584000000000001e-05 2024-04-19T04:25:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.804759+0000", 2024-04-19T04:25:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2800000000000003e-06 2024-04-19T04:25:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.804766+0000", 2024-04-19T04:25:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3369999999999996e-06 2024-04-19T04:25:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.806970+0000", 2024-04-19T04:25:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0022043480000000001 2024-04-19T04:25:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.807110+0000", 2024-04-19T04:25:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014033399999999999 2024-04-19T04:25:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:97017 5.d 5:ba59d426:::benchmark_data_smithi007_19526_object97016:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:30.807385+0000", 2024-04-19T04:25:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0049949520000000004, 2024-04-19T04:25:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0053849019999999996, 2024-04-19T04:25:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 97017 2024-04-19T04:25:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.807385+0000", 2024-04-19T04:25:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.807385+0000", 2024-04-19T04:25:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.807383+0000", 2024-04-19T04:25:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.807484+0000", 2024-04-19T04:25:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000100109 2024-04-19T04:25:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.807502+0000", 2024-04-19T04:25:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7957000000000001e-05 2024-04-19T04:25:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.807512+0000", 2024-04-19T04:25:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0953e-05 2024-04-19T04:25:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.807547+0000", 2024-04-19T04:25:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4671000000000001e-05 2024-04-19T04:25:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.807647+0000", 2024-04-19T04:25:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9831e-05 2024-04-19T04:25:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.807743+0000", 2024-04-19T04:25:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.6055000000000001e-05 2024-04-19T04:25:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.811644+0000", 2024-04-19T04:25:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0039004970000000002 2024-04-19T04:25:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:97018 5.6 5:693aea4f:::benchmark_data_smithi007_19526_object97017:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:30.808195+0000", 2024-04-19T04:25:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0041843089999999998, 2024-04-19T04:25:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0046488399999999996, 2024-04-19T04:25:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 97018 2024-04-19T04:25:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808195+0000", 2024-04-19T04:25:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808195+0000", 2024-04-19T04:25:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808186+0000", 2024-04-19T04:25:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999909 2024-04-19T04:25:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808249+0000", 2024-04-19T04:25:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2700999999999995e-05 2024-04-19T04:25:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808268+0000", 2024-04-19T04:25:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9102000000000001e-05 2024-04-19T04:25:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808276+0000", 2024-04-19T04:25:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0739999999999993e-06 2024-04-19T04:25:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.809358+0000", 2024-04-19T04:25:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001081928 2024-04-19T04:25:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.809498+0000", 2024-04-19T04:25:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013966 2024-04-19T04:25:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:97019 5.3 5:c626eba3:::benchmark_data_smithi007_19526_object97018:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:30.808300+0000", 2024-04-19T04:25:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0040796540000000003, 2024-04-19T04:25:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0046056910000000003, 2024-04-19T04:25:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 97019 2024-04-19T04:25:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808300+0000", 2024-04-19T04:25:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808300+0000", 2024-04-19T04:25:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808299+0000", 2024-04-19T04:25:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808356+0000", 2024-04-19T04:25:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7126999999999997e-05 2024-04-19T04:25:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808366+0000", 2024-04-19T04:25:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.6870000000000006e-06 2024-04-19T04:25:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808370+0000", 2024-04-19T04:25:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4129999999999999e-06 2024-04-19T04:25:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808423+0000", 2024-04-19T04:25:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2389999999999998e-05 2024-04-19T04:25:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808525+0000", 2024-04-19T04:25:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000101718 2024-04-19T04:25:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:97020 5.f 5:fabe78b8:::benchmark_data_smithi007_19526_object97019:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:30.808383+0000", 2024-04-19T04:25:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0039967739999999998, 2024-04-19T04:25:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0045832310000000001, 2024-04-19T04:25:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 97020 2024-04-19T04:25:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808383+0000", 2024-04-19T04:25:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808383+0000", 2024-04-19T04:25:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808382+0000", 2024-04-19T04:25:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808421+0000", 2024-04-19T04:25:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9351000000000003e-05 2024-04-19T04:25:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808429+0000", 2024-04-19T04:25:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9640000000000003e-06 2024-04-19T04:25:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808435+0000", 2024-04-19T04:25:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8560000000000003e-06 2024-04-19T04:25:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808479+0000", 2024-04-19T04:25:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3439999999999997e-05 2024-04-19T04:25:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808580+0000", 2024-04-19T04:25:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010092800000000001 2024-04-19T04:25:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808668+0000", 2024-04-19T04:25:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.8486999999999995e-05 2024-04-19T04:25:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812599+0000", 2024-04-19T04:25:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0039314679999999996 2024-04-19T04:25:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:97021 5.6 5:6bac09d3:::benchmark_data_smithi007_19526_object97020:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:30.808638+0000", 2024-04-19T04:25:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0037414729999999999, 2024-04-19T04:25:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0043993249999999999, 2024-04-19T04:25:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 97021 2024-04-19T04:25:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808638+0000", 2024-04-19T04:25:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808638+0000", 2024-04-19T04:25:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808637+0000", 2024-04-19T04:25:30.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808702+0000", 2024-04-19T04:25:30.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4807000000000005e-05 2024-04-19T04:25:30.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808712+0000", 2024-04-19T04:25:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0249e-05 2024-04-19T04:25:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.808719+0000", 2024-04-19T04:25:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9110000000000004e-06 2024-04-19T04:25:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.811904+0000", 2024-04-19T04:25:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031850889999999999 2024-04-19T04:25:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812040+0000", 2024-04-19T04:25:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013565300000000001 2024-04-19T04:25:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:97022 5.7 5:eb495482:::benchmark_data_smithi007_19526_object97021:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:30.809169+0000", 2024-04-19T04:25:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0032107110000000002, 2024-04-19T04:25:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003929727, 2024-04-19T04:25:30.862 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.862 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:30.862 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.862 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.862 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.862 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 97022 2024-04-19T04:25:30.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.862 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.809169+0000", 2024-04-19T04:25:30.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.809169+0000", 2024-04-19T04:25:30.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.809168+0000", 2024-04-19T04:25:30.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:30.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.809200+0000", 2024-04-19T04:25:30.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1574e-05 2024-04-19T04:25:30.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.809210+0000", 2024-04-19T04:25:30.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0414999999999999e-05 2024-04-19T04:25:30.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.809217+0000", 2024-04-19T04:25:30.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4619999999999999e-06 2024-04-19T04:25:30.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.809279+0000", 2024-04-19T04:25:30.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1339000000000003e-05 2024-04-19T04:25:30.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.809417+0000", 2024-04-19T04:25:30.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013845799999999999 2024-04-19T04:25:30.865 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.865 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.865 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.866 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:97023 5.1 5:891b66c2:::benchmark_data_smithi007_19526_object97022:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.866 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:30.809230+0000", 2024-04-19T04:25:30.866 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0031491990000000001, 2024-04-19T04:25:30.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0039297250000000002, 2024-04-19T04:25:30.866 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.866 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:30.866 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.866 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.866 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.866 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 97023 2024-04-19T04:25:30.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.866 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.809230+0000", 2024-04-19T04:25:30.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.809230+0000", 2024-04-19T04:25:30.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.809230+0000", 2024-04-19T04:25:30.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:30.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.809257+0000", 2024-04-19T04:25:30.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.7597e-05 2024-04-19T04:25:30.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.809266+0000", 2024-04-19T04:25:30.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0819999999999999e-06 2024-04-19T04:25:30.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.809272+0000", 2024-04-19T04:25:30.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9639999999999997e-06 2024-04-19T04:25:30.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.809320+0000", 2024-04-19T04:25:30.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7821999999999997e-05 2024-04-19T04:25:30.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.809451+0000", 2024-04-19T04:25:30.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013066 2024-04-19T04:25:30.870 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.870 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.870 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.870 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:97024 5.d 5:ba04f3bb:::benchmark_data_smithi007_19526_object97023:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.870 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:30.811783+0000", 2024-04-19T04:25:30.870 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00059688000000000005, 2024-04-19T04:25:30.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014381750000000001, 2024-04-19T04:25:30.870 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.870 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:30.870 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.871 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.871 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.871 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 97024 2024-04-19T04:25:30.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.871 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.811783+0000", 2024-04-19T04:25:30.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.811783+0000", 2024-04-19T04:25:30.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.811775+0000", 2024-04-19T04:25:30.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999924 2024-04-19T04:25:30.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.811826+0000", 2024-04-19T04:25:30.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0853999999999998e-05 2024-04-19T04:25:30.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.811855+0000", 2024-04-19T04:25:30.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8901e-05 2024-04-19T04:25:30.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.811861+0000", 2024-04-19T04:25:30.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1129999999999997e-06 2024-04-19T04:25:30.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.811912+0000", 2024-04-19T04:25:30.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0785000000000003e-05 2024-04-19T04:25:30.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812050+0000", 2024-04-19T04:25:30.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013773299999999999 2024-04-19T04:25:30.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:30.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812199+0000", 2024-04-19T04:25:30.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014911199999999999 2024-04-19T04:25:30.874 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.874 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.874 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.875 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:97025 5.2 5:4ab04bb9:::benchmark_data_smithi007_19526_object97024:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:30.875 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:30.811886+0000", 2024-04-19T04:25:30.875 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00049397500000000001, 2024-04-19T04:25:30.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001406841, 2024-04-19T04:25:30.875 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:30.875 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:30.875 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:30.875 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:30.875 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:30.875 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 97025 2024-04-19T04:25:30.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.875 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:30.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:30.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.811886+0000", 2024-04-19T04:25:30.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:30.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.811886+0000", 2024-04-19T04:25:30.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:30.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:30.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.811885+0000", 2024-04-19T04:25:30.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:30.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:30.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.811925+0000", 2024-04-19T04:25:30.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0232999999999999e-05 2024-04-19T04:25:30.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:30.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.811935+0000", 2024-04-19T04:25:30.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.4830000000000005e-06 2024-04-19T04:25:30.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:30.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.811942+0000", 2024-04-19T04:25:30.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8099999999999998e-06 2024-04-19T04:25:30.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:30.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812012+0000", 2024-04-19T04:25:30.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9208000000000006e-05 2024-04-19T04:25:30.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:30.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:30.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:30.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:30.812165+0000", 2024-04-19T04:25:30.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153368 2024-04-19T04:25:30.878 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.878 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:30.879 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.879 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:30.879 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:30.879 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 15 2024-04-19T04:25:30.879 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:30.881 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:30.881 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:30.881+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:30.964 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:30.982 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:30.982+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:30.986 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:30.991 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:30.992 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:31.006 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:31.006 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:31.019 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:31.039 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-04-19T04:25:31.083 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:31.081+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:31.146 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:31.146 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:31.160 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:31.184 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:31.181+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:31.285 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:31.285 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:31.285 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:31.282+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:31.296 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:31.386 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:31.386+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:31.412 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:31.412 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:31.423 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:31.487 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:31.485+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:31.588 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:31.586+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:31.596 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:31.596 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:31.607 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:31.689 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:31.689+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:31.742 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:31.742 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:31.755 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 47 16 98921 98905 131.507 125.812 0.00602179 0.00759841 2024-04-19T04:25:31.756 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:31.790 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:31.789+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:31.893 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:31.893 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:31.894 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:31.889+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:31.906 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:31.993 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:31.993+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:32.084 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:32.084 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:32.094 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:32.094+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:32.096 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:32.195 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:32.193+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:32.223 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:32.223 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:32.235 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:32.296 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:32.294+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:32.359 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:32.359 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:32.371 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:32.397 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:32.398+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:32.496 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:32.497 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:32.499 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:32.497+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:32.511 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:32.600 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:32.598+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:32.647 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:32.647 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:32.659 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:32.701 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:32.701+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:32.756 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 48 15 100978 100963 131.446 128.625 0.0104581 0.00760188 2024-04-19T04:25:32.792 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:32.792 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:32.802 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:32.801+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:32.804 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:32.903 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:32.901+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:32.984 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:32.985 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:32.993 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:25:32.995 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:33.042 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:33.042+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:33.052 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T04:25:33.106 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:33.105+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:33.116 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:33.116 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:33.128 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:33.149 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:33.176 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:33.176 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:33.177 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:33.177 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:33.179 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:33.180 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:33.207 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:33.206+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:33.255 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:33.256 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:33.256 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:33.256 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:33.256 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:33.267 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:33.308 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:33.306+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:33.399 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:33.399 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:33.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:33.399 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:33.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.399 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:33.399 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:33.399 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.162145621000001, 2024-04-19T04:25:33.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:33.399 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.400 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:33.400 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.400 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.400 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.400 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:33.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.400 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:33.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:33.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:33.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:33.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:33.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:33.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:33.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:33.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:33.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:33.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:33.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:33.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:33.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:33.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:33.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:33.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:33.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:33.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:33.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:33.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:33.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:33.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:33.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:33.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:33.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:33.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:33.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:33.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:33.407 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.407 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.407 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.407 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:33.408 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:33.408 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.157696704999999, 2024-04-19T04:25:33.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:33.408 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.408 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:33.408 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.408 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.408 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.408 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:33.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.408 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:33.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:33.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:33.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:33.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:33.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:33.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:33.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:33.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:33.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:33.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:33.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:33.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:33.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:33.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:33.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:33.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:33.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:33.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:33.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:33.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:33.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:33.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:33.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:33.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:33.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:33.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:33.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:33.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:33.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.413 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.413 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:33.414 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:33.414 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.329764462, 2024-04-19T04:25:33.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:33.414 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.414 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:33.414 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.414 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.414 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.414 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:33.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.414 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:33.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:33.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:33.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:33.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:33.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:33.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:33.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:33.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:33.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:33.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:33.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:33.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:33.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:33.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:33.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:33.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:33.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:33.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:33.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:33.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:33.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:33.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:33.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:33.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.420 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:33.420 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:33.420 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.893910425000001, 2024-04-19T04:25:33.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:33.420 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.420 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:33.420 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.420 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.420 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.420 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:33.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.420 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:33.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:33.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:33.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:33.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:33.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:33.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:33.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:33.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:33.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:33.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:33.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:33.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:33.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:33.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:33.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:33.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:33.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:33.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:33.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:33.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:33.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:33.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:33.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:33.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:33.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:33.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:33.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:33.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:33.425 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.425 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.425 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.425 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:33.425 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:33.426 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.893480005000001, 2024-04-19T04:25:33.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:33.426 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.426 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:33.426 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.426 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.426 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.426 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:33.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.426 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:33.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:33.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:33.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:33.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:33.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:33.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:33.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:33.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:33.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:33.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:33.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:33.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:33.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:33.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:33.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:33.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:33.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:33.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:33.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:33.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:33.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:33.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:33.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:33.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:33.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:33.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:33.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:33.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:33.431 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.431 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.431 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.431 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:33.431 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:33.431 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.891248740999998, 2024-04-19T04:25:33.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:33.431 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.431 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:33.432 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.432 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.432 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.432 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:33.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.432 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:33.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:33.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:33.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:33.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:33.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:33.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:33.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:33.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:33.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:33.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:33.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:33.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:33.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:33.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:33.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:33.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:33.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:33.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:33.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:33.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:33.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:33.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:33.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:33.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:33.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:33.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:33.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:33.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:33.436 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.437 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.437 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.437 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:33.437 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:33.437 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.887851702999999, 2024-04-19T04:25:33.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:33.437 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.437 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:33.437 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.437 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.437 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.438 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:33.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.438 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:33.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:33.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:33.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:33.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:33.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:33.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:33.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:33.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:33.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:33.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:33.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:33.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:33.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:33.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:33.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:33.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:33.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:33.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:33.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:33.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:33.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:33.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:33.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:33.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:33.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:33.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:33.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:33.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:33.442 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.442 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.443 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.443 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:33.443 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:33.443 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.882723505000001, 2024-04-19T04:25:33.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:33.443 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.443 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:33.443 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.443 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.443 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.443 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:33.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.444 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:33.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:33.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:33.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:33.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:33.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:33.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:33.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:33.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:33.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:33.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:33.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:33.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:33.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:33.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:33.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:33.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:33.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:33.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:33.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:33.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:33.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:33.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:33.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:33.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:33.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:33.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:33.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:33.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:33.449 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.449 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.449 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.449 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:33.449 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:33.449 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.568694999999998, 2024-04-19T04:25:33.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:33.449 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.449 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:33.449 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.450 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.450 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.450 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:33.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.450 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:33.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:33.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:33.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:33.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:33.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:33.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:33.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:33.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:33.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:33.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:33.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:33.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:33.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:33.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:33.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:33.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:33.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:33.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:33.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:33.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:33.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:33.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:33.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:33.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:33.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:33.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:33.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:33.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:33.455 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.455 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.455 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.455 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67949 5.b 5:d725bcef:::benchmark_data_smithi007_19526_object67948:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:33.455 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:33.455 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.565576721999999, 2024-04-19T04:25:33.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022537248999999999, 2024-04-19T04:25:33.455 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.455 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:33.455 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.456 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.456 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.456 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67949 2024-04-19T04:25:33.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.456 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:33.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:33.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832099+0000", 2024-04-19T04:25:33.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:33.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832148+0000", 2024-04-19T04:25:33.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9517e-05 2024-04-19T04:25:33.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832154+0000", 2024-04-19T04:25:33.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5319999999999997e-06 2024-04-19T04:25:33.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832158+0000", 2024-04-19T04:25:33.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9099999999999998e-06 2024-04-19T04:25:33.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.833836+0000", 2024-04-19T04:25:33.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001678817 2024-04-19T04:25:33.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:33.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834007+0000", 2024-04-19T04:25:33.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000170151 2024-04-19T04:25:33.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:33.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834238+0000", 2024-04-19T04:25:33.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023146700000000001 2024-04-19T04:25:33.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:33.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.839447+0000", 2024-04-19T04:25:33.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005209272 2024-04-19T04:25:33.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:33.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854573+0000", 2024-04-19T04:25:33.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015125945 2024-04-19T04:25:33.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:33.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854607+0000", 2024-04-19T04:25:33.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3782000000000003e-05 2024-04-19T04:25:33.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854637+0000", 2024-04-19T04:25:33.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9827000000000001e-05 2024-04-19T04:25:33.461 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.461 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.461 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.462 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:33.462 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:33.462 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.44633559, 2024-04-19T04:25:33.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:25:33.462 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.462 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:33.462 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.462 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.462 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.462 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:33.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.463 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:33.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:33.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:33.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:33.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:33.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:33.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:33.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:33.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:33.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:33.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:33.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:33.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:33.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:33.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:33.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:33.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:33.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:33.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:33.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:33.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:33.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:33.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:33.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:33.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:33.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:33.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:25:33.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:25:33.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:25:33.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:25:33.468 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.468 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.468 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.469 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:33.469 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:33.469 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.441273943999999, 2024-04-19T04:25:33.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:25:33.469 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.469 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:33.469 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.469 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.469 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.469 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:33.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.469 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:33.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:33.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:33.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:33.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:33.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:33.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:33.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:33.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:33.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:33.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:33.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:33.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:33.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:33.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:33.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:33.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:33.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:33.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:33.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:33.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:33.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:33.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:33.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:25:33.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:25:33.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:25:33.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:25:33.474 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.474 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.475 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.475 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:33.475 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:33.475 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.441174031999999, 2024-04-19T04:25:33.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:25:33.475 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.475 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:33.475 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.475 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.475 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.475 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:33.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.476 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:33.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:33.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:33.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:33.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:33.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:33.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:33.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:33.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:33.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:33.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:33.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:33.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:33.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:33.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:33.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:33.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:33.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:33.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:33.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:33.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:33.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:33.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:33.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:25:33.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:25:33.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:25:33.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:25:33.481 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.481 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.481 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.481 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:33.481 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:33.481 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.441048279, 2024-04-19T04:25:33.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:25:33.481 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.481 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:33.481 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.481 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.482 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.482 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:33.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.482 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:33.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:33.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:33.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:33.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:33.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:33.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:33.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:33.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:33.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:33.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:33.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:33.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:33.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:33.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:33.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:33.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:33.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:33.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:33.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:33.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:33.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:33.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:33.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:25:33.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:25:33.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:25:33.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:25:33.486 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.486 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.487 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.487 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:33.487 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:33.487 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.437204334, 2024-04-19T04:25:33.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:25:33.487 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.487 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:33.487 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.487 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.487 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.487 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:33.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.488 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:33.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:33.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:33.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:33.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:33.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:33.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:33.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:33.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:33.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:33.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:33.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:33.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:33.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:33.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:33.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:25:33.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:25:33.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:33.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:25:33.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:25:33.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:33.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:25:33.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:25:33.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:33.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:25:33.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:25:33.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:25:33.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:25:33.492 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.492 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.492 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.493 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:33.493 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:33.493 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.430033233, 2024-04-19T04:25:33.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:25:33.493 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.493 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:33.493 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.493 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.493 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.493 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:33.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.493 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:33.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:33.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:33.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:33.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:33.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:33.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:33.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:33.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:33.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:33.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:33.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:33.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:33.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:33.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:33.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:25:33.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:25:33.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:25:33.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:25:33.497 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.497 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.497 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.497 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:33.497 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:33.497 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.429861128999999, 2024-04-19T04:25:33.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:25:33.497 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.498 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:33.498 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.498 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.498 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.498 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:33.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.498 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:33.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:33.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:33.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:33.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:33.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:33.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:33.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:33.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:33.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:33.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:33.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:33.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:33.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:33.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:33.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:25:33.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:25:33.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:25:33.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:25:33.502 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.502 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.502 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.502 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:33.502 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:33.502 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.429798003999998, 2024-04-19T04:25:33.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:25:33.502 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.502 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:33.502 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.502 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.503 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.503 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:33.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.503 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:33.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:33.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:33.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:33.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:33.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:33.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:33.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:33.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:33.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:33.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:33.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:33.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:33.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:33.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:33.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:25:33.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:25:33.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:33.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:25:33.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:25:33.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:33.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:25:33.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:25:33.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:33.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:25:33.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:25:33.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:25:33.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:25:33.507 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.507 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.507 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.508 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:33.508 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:33.508 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.429669406999999, 2024-04-19T04:25:33.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:25:33.508 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.508 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:33.508 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.508 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.508 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.508 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:33.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.508 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:33.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:33.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:33.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:33.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:33.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:33.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:33.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:33.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:33.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:33.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:33.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:33.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:33.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:33.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:33.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:25:33.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:25:33.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:33.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:25:33.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:25:33.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:33.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:25:33.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:25:33.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:33.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:25:33.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:25:33.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:25:33.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:25:33.513 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.513 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.513 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.514 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:33.514 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:33.514 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.429601435999999, 2024-04-19T04:25:33.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:25:33.514 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:33.514 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:33.514 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:33.514 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:33.514 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.514 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:33.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.515 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:33.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:33.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:33.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:33.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:33.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:33.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:33.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:33.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:33.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:33.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:33.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:33.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:33.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:33.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:33.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:33.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:33.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:33.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:33.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:33.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:33.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:33.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:33.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:25:33.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:25:33.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:33.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:25:33.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:25:33.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:33.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:25:33.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:25:33.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:33.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:25:33.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:25:33.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:33.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:33.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:33.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:25:33.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:25:33.521 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.521 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.521 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.521 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:33.521 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:33.521 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:33.523 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:33.522+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:33.524 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:33.624 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:33.622+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:33.659 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:33.659 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:33.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.659 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:102821 5.9 5:9cdbd255:::benchmark_data_smithi007_19526_object102820:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T04:25:33.659 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:33.654443+0000", 2024-04-19T04:25:33.659 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0040668320000000003, 2024-04-19T04:25:33.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040964790000000001, 2024-04-19T04:25:33.659 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:33.660 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:33.660 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:33.660 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:33.660 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.660 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 102821 2024-04-19T04:25:33.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.660 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:33.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:33.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654443+0000", 2024-04-19T04:25:33.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:33.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654443+0000", 2024-04-19T04:25:33.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:33.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654442+0000", 2024-04-19T04:25:33.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:33.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:33.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654512+0000", 2024-04-19T04:25:33.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0012999999999995e-05 2024-04-19T04:25:33.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.662 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:33.662 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654542+0000", 2024-04-19T04:25:33.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.0700000000000001e-05 2024-04-19T04:25:33.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.662 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.662 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654551+0000", 2024-04-19T04:25:33.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.8440000000000004e-06 2024-04-19T04:25:33.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:33.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654603+0000", 2024-04-19T04:25:33.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2203000000000001e-05 2024-04-19T04:25:33.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:33.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654700+0000", 2024-04-19T04:25:33.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.6890000000000002e-05 2024-04-19T04:25:33.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:33.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654783+0000", 2024-04-19T04:25:33.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2566999999999997e-05 2024-04-19T04:25:33.664 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.664 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:33.664 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.664 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:102822 5.7 5:e8fa748c:::benchmark_data_smithi007_19526_object102821:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T04:25:33.664 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:33.654567+0000", 2024-04-19T04:25:33.664 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.003942676, 2024-04-19T04:25:33.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040625940000000001, 2024-04-19T04:25:33.664 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:33.664 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:33.665 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:33.665 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:33.665 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.665 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 102822 2024-04-19T04:25:33.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.665 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:33.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:33.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654567+0000", 2024-04-19T04:25:33.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:33.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654567+0000", 2024-04-19T04:25:33.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:33.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654566+0000", 2024-04-19T04:25:33.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:33.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:33.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654615+0000", 2024-04-19T04:25:33.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8624000000000001e-05 2024-04-19T04:25:33.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:33.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654625+0000", 2024-04-19T04:25:33.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7310000000000005e-06 2024-04-19T04:25:33.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654632+0000", 2024-04-19T04:25:33.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8809999999999998e-06 2024-04-19T04:25:33.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:33.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654686+0000", 2024-04-19T04:25:33.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4073999999999998e-05 2024-04-19T04:25:33.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:33.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654825+0000", 2024-04-19T04:25:33.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013965200000000001 2024-04-19T04:25:33.668 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.668 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:33.668 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.669 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:102824 5.5 5:a4865cd8:::benchmark_data_smithi007_19526_object102823:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T04:25:33.669 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:33.654780+0000", 2024-04-19T04:25:33.669 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0037300380000000002, 2024-04-19T04:25:33.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0039265690000000004, 2024-04-19T04:25:33.669 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:33.669 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:33.669 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:33.669 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:33.669 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.669 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 102824 2024-04-19T04:25:33.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.669 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:33.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:33.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654780+0000", 2024-04-19T04:25:33.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:33.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654780+0000", 2024-04-19T04:25:33.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:33.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654779+0000", 2024-04-19T04:25:33.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:33.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:33.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654876+0000", 2024-04-19T04:25:33.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.6991999999999996e-05 2024-04-19T04:25:33.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:33.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654886+0000", 2024-04-19T04:25:33.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.6989999999999998e-06 2024-04-19T04:25:33.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654892+0000", 2024-04-19T04:25:33.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8460000000000002e-06 2024-04-19T04:25:33.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:33.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.656486+0000", 2024-04-19T04:25:33.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015938219999999999 2024-04-19T04:25:33.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:33.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.656638+0000", 2024-04-19T04:25:33.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015198100000000001 2024-04-19T04:25:33.672 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.672 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:33.672 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.672 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:102826 5.7 5:e8611942:::benchmark_data_smithi007_19526_object102825:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T04:25:33.673 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:33.654904+0000", 2024-04-19T04:25:33.673 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.003605554, 2024-04-19T04:25:33.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038790830000000002, 2024-04-19T04:25:33.673 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:33.673 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:33.673 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:33.673 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:33.673 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.673 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 102826 2024-04-19T04:25:33.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.674 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:33.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.674 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:33.674 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654904+0000", 2024-04-19T04:25:33.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.674 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:33.674 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654904+0000", 2024-04-19T04:25:33.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.674 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:33.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654904+0000", 2024-04-19T04:25:33.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:33.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:33.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654953+0000", 2024-04-19T04:25:33.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9030000000000003e-05 2024-04-19T04:25:33.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:33.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654961+0000", 2024-04-19T04:25:33.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0760000000000003e-06 2024-04-19T04:25:33.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.654966+0000", 2024-04-19T04:25:33.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6450000000000002e-06 2024-04-19T04:25:33.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:33.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657562+0000", 2024-04-19T04:25:33.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0025958840000000001 2024-04-19T04:25:33.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:33.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657716+0000", 2024-04-19T04:25:33.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015364 2024-04-19T04:25:33.677 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.677 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:33.677 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.677 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:102828 5.f 5:f2aba90f:::benchmark_data_smithi007_19526_object102827:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T04:25:33.678 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:33.655971+0000", 2024-04-19T04:25:33.678 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0025386129999999999, 2024-04-19T04:25:33.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002893956, 2024-04-19T04:25:33.678 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:33.678 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:33.678 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:33.678 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:33.678 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.678 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 102828 2024-04-19T04:25:33.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.678 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:33.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:33.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.655971+0000", 2024-04-19T04:25:33.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:33.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.655971+0000", 2024-04-19T04:25:33.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:33.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.655970+0000", 2024-04-19T04:25:33.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:33.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:33.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.656068+0000", 2024-04-19T04:25:33.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8170000000000004e-05 2024-04-19T04:25:33.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:33.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.656083+0000", 2024-04-19T04:25:33.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4416999999999999e-05 2024-04-19T04:25:33.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.656090+0000", 2024-04-19T04:25:33.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3019999999999997e-06 2024-04-19T04:25:33.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:33.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657339+0000", 2024-04-19T04:25:33.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001248636 2024-04-19T04:25:33.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:33.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657465+0000", 2024-04-19T04:25:33.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126107 2024-04-19T04:25:33.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:33.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657635+0000", 2024-04-19T04:25:33.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017067499999999999 2024-04-19T04:25:33.682 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.682 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:33.682 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.682 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:102829 5.d 5:b461812f:::benchmark_data_smithi007_19526_object102828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T04:25:33.682 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:33.656098+0000", 2024-04-19T04:25:33.682 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0024121889999999999, 2024-04-19T04:25:33.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028527259999999999, 2024-04-19T04:25:33.682 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:33.682 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:33.683 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:33.683 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:33.683 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.683 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 102829 2024-04-19T04:25:33.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.683 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:33.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:33.683 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.656098+0000", 2024-04-19T04:25:33.683 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:33.683 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.656098+0000", 2024-04-19T04:25:33.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.684 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:33.684 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.656097+0000", 2024-04-19T04:25:33.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:33.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.684 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:33.684 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.656139+0000", 2024-04-19T04:25:33.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2407999999999998e-05 2024-04-19T04:25:33.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.684 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:33.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.656151+0000", 2024-04-19T04:25:33.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1867e-05 2024-04-19T04:25:33.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.656157+0000", 2024-04-19T04:25:33.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1190000000000002e-06 2024-04-19T04:25:33.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:33.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.656462+0000", 2024-04-19T04:25:33.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00030434100000000002 2024-04-19T04:25:33.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.686 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:33.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.656548+0000", 2024-04-19T04:25:33.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6122e-05 2024-04-19T04:25:33.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.686 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:33.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.656638+0000", 2024-04-19T04:25:33.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9691999999999994e-05 2024-04-19T04:25:33.686 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.686 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:33.686 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.686 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:102830 5.c 5:3eb36305:::benchmark_data_smithi007_19526_object102829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T04:25:33.687 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:33.657049+0000", 2024-04-19T04:25:33.687 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001460956, 2024-04-19T04:25:33.687 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0019856639999999998, 2024-04-19T04:25:33.687 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:33.687 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:33.687 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:33.687 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:33.687 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.687 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 102830 2024-04-19T04:25:33.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.688 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:33.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:33.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657049+0000", 2024-04-19T04:25:33.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:33.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657049+0000", 2024-04-19T04:25:33.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:33.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657048+0000", 2024-04-19T04:25:33.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:33.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:33.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657139+0000", 2024-04-19T04:25:33.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1501000000000004e-05 2024-04-19T04:25:33.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:33.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657148+0000", 2024-04-19T04:25:33.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1929999999999993e-06 2024-04-19T04:25:33.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.690 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657153+0000", 2024-04-19T04:25:33.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2229999999999998e-06 2024-04-19T04:25:33.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.690 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:33.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657195+0000", 2024-04-19T04:25:33.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1823999999999998e-05 2024-04-19T04:25:33.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.691 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.691 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:33.691 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657307+0000", 2024-04-19T04:25:33.691 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112627 2024-04-19T04:25:33.691 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.691 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:33.691 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.691 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.691 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:102814 5.f e44/20)", 2024-04-19T04:25:33.691 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:33.657337+0000", 2024-04-19T04:25:33.691 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0011731319999999999, 2024-04-19T04:25:33.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00176425, 2024-04-19T04:25:33.692 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:33.692 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:33.692 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:33.692 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.692 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:33.692 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657337+0000", 2024-04-19T04:25:33.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.692 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.692 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:33.692 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657337+0000", 2024-04-19T04:25:33.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.693 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:33.693 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657336+0000", 2024-04-19T04:25:33.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:33.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.693 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:33.693 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657341+0000", 2024-04-19T04:25:33.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7409999999999998e-06 2024-04-19T04:25:33.694 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.694 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.694 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:33.694 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657351+0000", 2024-04-19T04:25:33.694 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:33.694 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.694 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.694 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.694 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.657357+0000", 2024-04-19T04:25:33.694 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5429999999999999e-06 2024-04-19T04:25:33.694 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.694 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:33.695 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.695 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:102832 5.d 5.8c0ad93d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T04:25:33.695 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:33.659014+0000", 2024-04-19T04:25:33.695 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9994955, 2024-04-19T04:25:33.695 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000140273, 2024-04-19T04:25:33.695 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:33.695 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:33.695 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:33.696 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:33.696 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.696 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 102832 2024-04-19T04:25:33.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.696 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:33.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:33.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.659014+0000", 2024-04-19T04:25:33.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:33.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.659014+0000", 2024-04-19T04:25:33.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:33.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.659013+0000", 2024-04-19T04:25:33.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:33.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:33.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.659087+0000", 2024-04-19T04:25:33.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4574999999999997e-05 2024-04-19T04:25:33.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.698 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.698 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:33.698 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.659098+0000", 2024-04-19T04:25:33.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1038e-05 2024-04-19T04:25:33.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.698 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.698 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.698 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.659107+0000", 2024-04-19T04:25:33.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5709999999999998e-06 2024-04-19T04:25:33.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.699 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:33.699 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.659152+0000", 2024-04-19T04:25:33.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5167000000000003e-05 2024-04-19T04:25:33.699 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.699 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:33.699 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.699 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:102814 5.f 5:fc3f3734:::benchmark_data_smithi007_19526_object102813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T04:25:33.699 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:33.650029+0000", 2024-04-19T04:25:33.699 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0084806340000000008, 2024-04-19T04:25:33.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0091985820000000003, 2024-04-19T04:25:33.699 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:33.699 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:33.700 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:33.700 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:33.700 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.700 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 102814 2024-04-19T04:25:33.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.700 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:33.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.700 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:33.700 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.650029+0000", 2024-04-19T04:25:33.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.700 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:33.700 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.650029+0000", 2024-04-19T04:25:33.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:33.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.650028+0000", 2024-04-19T04:25:33.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:33.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:33.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.650072+0000", 2024-04-19T04:25:33.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3133999999999997e-05 2024-04-19T04:25:33.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:33.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.650080+0000", 2024-04-19T04:25:33.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4149999999999999e-06 2024-04-19T04:25:33.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.650086+0000", 2024-04-19T04:25:33.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2210000000000002e-06 2024-04-19T04:25:33.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:33.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.651722+0000", 2024-04-19T04:25:33.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016353419999999999 2024-04-19T04:25:33.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:33.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.651843+0000", 2024-04-19T04:25:33.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121011 2024-04-19T04:25:33.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:33.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.652007+0000", 2024-04-19T04:25:33.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016492899999999999 2024-04-19T04:25:33.703 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.703 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:33.703 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.703 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:102816 5.c 5:36c683fc:::benchmark_data_smithi007_19526_object102815:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T04:25:33.703 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:33.651766+0000", 2024-04-19T04:25:33.704 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0067433659999999998, 2024-04-19T04:25:33.704 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075469589999999998, 2024-04-19T04:25:33.704 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:33.704 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:33.704 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:33.704 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:33.704 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.704 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 102816 2024-04-19T04:25:33.704 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.704 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:33.704 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.704 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:33.704 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.651766+0000", 2024-04-19T04:25:33.704 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.705 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:33.705 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.651766+0000", 2024-04-19T04:25:33.705 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:33.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.705 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:33.705 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.651766+0000", 2024-04-19T04:25:33.705 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:33.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:33.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.651800+0000", 2024-04-19T04:25:33.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.3801999999999999e-05 2024-04-19T04:25:33.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:33.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.651807+0000", 2024-04-19T04:25:33.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7540000000000006e-06 2024-04-19T04:25:33.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:33.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.651813+0000", 2024-04-19T04:25:33.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0000000000000002e-06 2024-04-19T04:25:33.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.707 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:33.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.651882+0000", 2024-04-19T04:25:33.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8670999999999994e-05 2024-04-19T04:25:33.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.707 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:33.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:33.652032+0000", 2024-04-19T04:25:33.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015040299999999999 2024-04-19T04:25:33.707 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.707 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:33.708 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.708 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:33.708 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:33.708 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 11 2024-04-19T04:25:33.708 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:33.709 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:33.725 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:33.722+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:33.756 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 49 16 103042 103026 131.395 128.938 0.00583588 0.00760484 2024-04-19T04:25:33.817 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T04:25:33.828 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:33.825+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:33.846 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:33.846 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:33.846 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:33.847 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:33.847 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:33.862 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:33.928 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:33.926+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:33.996 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:33.997 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:33.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:33.997 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:33.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:33.997 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:33.998 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:33.998 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.763306655999997, 2024-04-19T04:25:33.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:33.998 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:33.998 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:33.998 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:33.999 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:33.999 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:33.999 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:33.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:33.999 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:33.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.000 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:34.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.000 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:34.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:34.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.002 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:34.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:34.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.003 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.003 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:34.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:34.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.004 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.004 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:34.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:34.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:34.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:34.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:34.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:34.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:34.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:34.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:34.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.007 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:34.007 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:34.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:34.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:34.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:34.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:34.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:34.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:34.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:34.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:34.009 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.009 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.009 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.010 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.010 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.010 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:34.010 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:34.010 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.760125500000001, 2024-04-19T04:25:34.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:34.011 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.011 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.011 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.011 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.011 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.011 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:34.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.011 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.011 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.011 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.012 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:34.012 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.012 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.012 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.012 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.012 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:34.012 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.013 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.013 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.013 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.013 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:34.013 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.013 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.013 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.013 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.013 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:34.013 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:34.013 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.013 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.013 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.013 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:34.013 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:34.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.014 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.014 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:34.014 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:34.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.014 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.014 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:34.014 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:34.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.014 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:34.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:34.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.015 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:34.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:34.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:34.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.015 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:34.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:34.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:34.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:34.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:34.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:34.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:34.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:34.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.017 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:34.017 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:34.017 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.017 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.017 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.017 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.017 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:34.017 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:34.017 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.759557395999998, 2024-04-19T04:25:34.017 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:34.017 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.017 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.017 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.018 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.018 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.018 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:34.018 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.018 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.018 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.018 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.018 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:34.018 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.018 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.018 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.018 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.018 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:34.019 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.019 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.019 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.019 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:34.019 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:34.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.019 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.019 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.019 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:34.019 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:34.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.019 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.020 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.020 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:34.020 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:34.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.020 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.020 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.020 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:34.020 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:34.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.020 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.020 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.020 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:34.020 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:34.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.021 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:34.021 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:34.021 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:34.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.021 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.021 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:34.021 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:34.021 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.021 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.021 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.022 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:34.022 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:34.022 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.759211735000001, 2024-04-19T04:25:34.022 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:34.022 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.022 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.022 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.022 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.022 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.022 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:34.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.022 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.023 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.023 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:34.023 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.023 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.023 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.023 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.023 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:34.023 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.023 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.023 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.023 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.023 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:34.023 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.023 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.024 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.024 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.024 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:34.024 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:34.024 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.024 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.024 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.024 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:34.024 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:34.024 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.024 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.024 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.024 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:34.024 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:34.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:34.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:34.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:34.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:34.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:34.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:34.026 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:34.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.026 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.026 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.026 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:34.026 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:34.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.026 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.026 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:34.026 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:34.026 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:34.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.026 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.027 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:34.027 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:34.027 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:34.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.027 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.027 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.027 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:34.027 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:34.027 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.027 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.027 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.027 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.027 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:34.028 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:34.028 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.758487297000002, 2024-04-19T04:25:34.028 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:34.028 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.028 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.028 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.028 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.028 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.028 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:34.028 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.028 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.028 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.028 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.028 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:34.028 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.029 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.029 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.029 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:34.029 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.029 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.029 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.029 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:34.029 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:34.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.029 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.029 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.029 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:34.029 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:34.030 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.030 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.030 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.030 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:34.030 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:34.030 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.030 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.030 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.030 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:34.030 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:34.030 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.030 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.031 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.031 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:34.031 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:34.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.031 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.031 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:34.031 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:34.031 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:34.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.031 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.031 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.031 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:34.031 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:34.031 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.031 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.032 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.032 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.032 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.032 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:34.032 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:34.032 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.758479901999998, 2024-04-19T04:25:34.032 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:34.032 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.032 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.032 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.032 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.032 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.032 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:34.032 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.033 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.033 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.033 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:34.033 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.033 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.033 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.033 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:34.033 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.033 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.033 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.033 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:34.034 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:34.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.034 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.034 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.034 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:34.034 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:34.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.034 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.034 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.034 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:34.034 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:34.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.034 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.035 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.035 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:34.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:34.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.035 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.035 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.035 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:34.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:34.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.035 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.035 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:34.035 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:34.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:34.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.036 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.036 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.036 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:34.036 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:34.036 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.036 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.036 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.036 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.036 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:34.036 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:34.036 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.756654755, 2024-04-19T04:25:34.036 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:34.036 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.036 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.037 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.037 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.037 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.037 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:34.037 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.037 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.037 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.037 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.037 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:34.037 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.037 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.037 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.037 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.037 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:34.038 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.038 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.038 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.038 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:34.038 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.038 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.038 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.038 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:34.038 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:34.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.038 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.038 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.039 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:34.039 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:34.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.039 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.039 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.039 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:34.039 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:34.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.039 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.039 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.039 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:34.039 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:34.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.040 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.040 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.040 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:34.040 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:34.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.040 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.040 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:34.040 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:34.040 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:34.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.041 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.041 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:34.041 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:34.041 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.042 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:34.042 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:34.042 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:34.042 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.042 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.042 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:34.042 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:34.043 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:34.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.043 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.043 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.043 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:34.043 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:34.044 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.044 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.044 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.044 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.044 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:34.044 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:34.045 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.755920549999999, 2024-04-19T04:25:34.045 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:34.045 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.045 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.045 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.045 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.046 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.046 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:34.046 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.046 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.046 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.046 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.047 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:34.047 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.047 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.047 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.047 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.047 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:34.047 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.048 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.048 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.048 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.048 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:34.049 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.049 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.049 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.049 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.049 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:34.049 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:34.050 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.050 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.050 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.050 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:34.050 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:34.050 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.051 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.051 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.051 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:34.051 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:34.051 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.051 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.052 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.052 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:34.052 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:34.052 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.052 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.052 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.053 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:34.053 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:34.053 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.053 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.053 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:34.053 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:34.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:34.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.054 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.054 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:34.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:34.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.055 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:34.055 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:34.055 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:34.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.056 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:34.056 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:34.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:34.056 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.057 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:34.057 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:34.057 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.057 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.057 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.058 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:34.058 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:34.058 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.755386274000003, 2024-04-19T04:25:34.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:34.059 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.059 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.059 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.059 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.059 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.059 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:34.060 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.060 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.060 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.060 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.060 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:34.060 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.061 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:34.061 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:34.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:34.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:34.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:34.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.064 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:34.064 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:34.064 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.064 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.064 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.064 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:34.065 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:34.065 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.065 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.065 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.065 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:34.066 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:34.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.066 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:34.066 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:34.066 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:34.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:34.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:34.068 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.068 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.068 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.068 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:34.069 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:34.069 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.038531084999999, 2024-04-19T04:25:34.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:34.069 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.069 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:34.070 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.070 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.070 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.070 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:34.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.070 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:34.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:34.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:34.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:34.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:34.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:34.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:34.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:34.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:34.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:34.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:34.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:34.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:34.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:34.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:34.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:34.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.076 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:34.076 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:34.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:34.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.076 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.076 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:34.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:34.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:34.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:34.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:34.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:34.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:34.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:34.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:34.078 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.078 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.079 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.079 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:34.079 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:34.079 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.018300635999999, 2024-04-19T04:25:34.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:34.079 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.079 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:34.079 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.080 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.080 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.080 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:34.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.080 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:34.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.081 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.081 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.081 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:34.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.081 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.081 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.081 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:34.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:34.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.082 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.082 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.082 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:34.082 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:34.082 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.082 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.082 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.082 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:34.082 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:34.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:34.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:34.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:34.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:34.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:34.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:34.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:34.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:34.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:34.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.086 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.086 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:34.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:34.086 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.087 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.087 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.087 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:34.087 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:34.088 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.018192779, 2024-04-19T04:25:34.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:34.088 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.088 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:34.088 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.088 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.089 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.089 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:34.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.089 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:34.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.090 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:34.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.091 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:34.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.092 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.092 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:34.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:34.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:34.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:34.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:34.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:34.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:34.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:34.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:34.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:34.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:34.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:34.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:34.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:34.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:34.097 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.098 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.098 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.098 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:34.098 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:34.099 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.01622609, 2024-04-19T04:25:34.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:34.099 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.100 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.100 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.100 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.101 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.101 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:34.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.101 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:34.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:34.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:34.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:34.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:34.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:34.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:34.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:34.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:34.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:34.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.107 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:34.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:34.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.107 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:34.107 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:34.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:34.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:34.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:34.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:34.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:34.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:34.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:34.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:34.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:34.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:34.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:34.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:34.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:34.110 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.110 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.110 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.110 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:34.110 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:34.110 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.012861895, 2024-04-19T04:25:34.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:34.111 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.111 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.111 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.111 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.111 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.111 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:34.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.111 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:34.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.112 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.112 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:34.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.112 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.112 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:34.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.112 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.112 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:34.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:34.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.113 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:34.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:34.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.113 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.113 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:34.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:34.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.113 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.113 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:34.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:34.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:34.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:34.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:34.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:34.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:34.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:34.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:34.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:34.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:34.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:34.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:34.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:34.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:34.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:34.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:34.116 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.116 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.116 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.116 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:34.116 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:34.116 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.009050917, 2024-04-19T04:25:34.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:34.116 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.116 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.116 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.116 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.116 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.117 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:34.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.117 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.117 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:34.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.117 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:34.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:34.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:34.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:34.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:34.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:34.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:34.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:34.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:34.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:34.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:34.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:34.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:34.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.120 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:34.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:34.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.120 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:34.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:34.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:34.120 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:34.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:34.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:34.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:34.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:34.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:34.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:34.121 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.121 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.121 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.122 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93735 5.1 5:8e609d1b:::benchmark_data_smithi007_19526_object93734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:34.122 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:34.122 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.7673502729999999, 2024-04-19T04:25:34.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048424842000000003, 2024-04-19T04:25:34.122 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.122 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.122 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.122 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.122 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.122 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93735 2024-04-19T04:25:34.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.122 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:34.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:34.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227480+0000", 2024-04-19T04:25:34.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227533+0000", 2024-04-19T04:25:34.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2964999999999999e-05 2024-04-19T04:25:34.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227542+0000", 2024-04-19T04:25:34.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1449999999999997e-06 2024-04-19T04:25:34.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227561+0000", 2024-04-19T04:25:34.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9116000000000001e-05 2024-04-19T04:25:34.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.125 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.125 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227610+0000", 2024-04-19T04:25:34.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9234000000000003e-05 2024-04-19T04:25:34.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.125 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.125 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227697+0000", 2024-04-19T04:25:34.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6682999999999997e-05 2024-04-19T04:25:34.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.125 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:34.125 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275809+0000", 2024-04-19T04:25:34.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048112265000000001 2024-04-19T04:25:34.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:34.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275845+0000", 2024-04-19T04:25:34.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5275999999999999e-05 2024-04-19T04:25:34.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275906+0000", 2024-04-19T04:25:34.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1002999999999999e-05 2024-04-19T04:25:34.126 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.126 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.126 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.126 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93736 5.1 5:852229ec:::benchmark_data_smithi007_19526_object93735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:34.127 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:34.127 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.7672462429999998, 2024-04-19T04:25:34.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048414497000000001, 2024-04-19T04:25:34.127 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.127 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.129 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.129 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.130 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.130 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93736 2024-04-19T04:25:34.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.130 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:34.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:34.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227584+0000", 2024-04-19T04:25:34.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227624+0000", 2024-04-19T04:25:34.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9833000000000003e-05 2024-04-19T04:25:34.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227630+0000", 2024-04-19T04:25:34.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0759999999999999e-06 2024-04-19T04:25:34.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227634+0000", 2024-04-19T04:25:34.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1570000000000002e-06 2024-04-19T04:25:34.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229531+0000", 2024-04-19T04:25:34.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018962339999999999 2024-04-19T04:25:34.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229662+0000", 2024-04-19T04:25:34.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013192999999999999 2024-04-19T04:25:34.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:34.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275915+0000", 2024-04-19T04:25:34.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046252140999999997 2024-04-19T04:25:34.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:34.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275944+0000", 2024-04-19T04:25:34.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9539999999999998e-05 2024-04-19T04:25:34.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275999+0000", 2024-04-19T04:25:34.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5062999999999998e-05 2024-04-19T04:25:34.134 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.134 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.134 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.134 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:34.134 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:34.134 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.7671885600000001, 2024-04-19T04:25:34.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:25:34.134 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.134 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.134 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.134 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.134 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.135 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:25:34.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.135 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:34.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:34.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:34.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:25:34.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:25:34.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:25:34.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:25:34.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.137 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:25:34.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:25:34.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.137 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:25:34.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:25:34.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.137 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:25:34.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:25:34.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:34.138 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:25:34.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:25:34.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:34.138 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:25:34.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:25:34.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.138 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:25:34.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:25:34.138 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.138 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.139 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.139 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:34.139 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:34.139 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.7665942799999996, 2024-04-19T04:25:34.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:25:34.139 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.139 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.139 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.139 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.139 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.139 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:25:34.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.140 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:34.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:34.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:25:34.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:25:34.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:25:34.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:25:34.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:25:34.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:25:34.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:25:34.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.142 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.142 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:25:34.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:25:34.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.142 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.142 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:25:34.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:25:34.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.142 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:34.142 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:25:34.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:25:34.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.143 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.143 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:25:34.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:25:34.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.143 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:34.143 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:25:34.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:25:34.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.143 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:34.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:25:34.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:25:34.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:25:34.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:25:34.144 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.144 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.144 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.144 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93744 5.1 5:87b91c25:::benchmark_data_smithi007_19526_object93743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:34.144 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:34.144 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.7629247289999999, 2024-04-19T04:25:34.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044295022000000003, 2024-04-19T04:25:34.145 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.145 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.145 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.145 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.145 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.145 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93744 2024-04-19T04:25:34.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.145 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:34.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:34.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231905+0000", 2024-04-19T04:25:34.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231935+0000", 2024-04-19T04:25:34.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9442e-05 2024-04-19T04:25:34.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.147 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.147 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264224+0000", 2024-04-19T04:25:34.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.032288836000000001 2024-04-19T04:25:34.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.147 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.147 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264238+0000", 2024-04-19T04:25:34.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4494999999999999e-05 2024-04-19T04:25:34.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.147 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.147 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268311+0000", 2024-04-19T04:25:34.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040726629999999998 2024-04-19T04:25:34.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.148 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268587+0000", 2024-04-19T04:25:34.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00027623200000000001 2024-04-19T04:25:34.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:34.148 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276099+0000", 2024-04-19T04:25:34.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075116180000000003 2024-04-19T04:25:34.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:34.148 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276123+0000", 2024-04-19T04:25:34.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4675e-05 2024-04-19T04:25:34.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:34.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276201+0000", 2024-04-19T04:25:34.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7836000000000005e-05 2024-04-19T04:25:34.149 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.149 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.149 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.149 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.149 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.149 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:34.151 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:34.150+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:34.152 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2024-04-19T04:25:34.152 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:34.152 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-04-19T04:25:34.251 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:34.250+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:34.253 INFO:teuthology.orchestra.console.smithi066:Power on completed 2024-04-19T04:25:34.277 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:34.277 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:34.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.277 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:104104 5.8 5:1a28b535:::benchmark_data_smithi007_19526_object104103:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.277 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:34.272362+0000", 2024-04-19T04:25:34.277 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.004939344, 2024-04-19T04:25:34.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049618580000000004, 2024-04-19T04:25:34.277 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.277 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:34.277 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.277 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.278 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.278 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 104104 2024-04-19T04:25:34.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.278 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.272362+0000", 2024-04-19T04:25:34.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.272362+0000", 2024-04-19T04:25:34.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.272361+0000", 2024-04-19T04:25:34.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.272447+0000", 2024-04-19T04:25:34.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6856999999999999e-05 2024-04-19T04:25:34.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.272460+0000", 2024-04-19T04:25:34.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2177999999999999e-05 2024-04-19T04:25:34.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.272466+0000", 2024-04-19T04:25:34.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-19T04:25:34.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.272544+0000", 2024-04-19T04:25:34.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7521000000000005e-05 2024-04-19T04:25:34.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.272731+0000", 2024-04-19T04:25:34.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018688799999999999 2024-04-19T04:25:34.280 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.281 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.281 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.281 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:104107 5.a 5:5d1a9889:::benchmark_data_smithi007_19526_object104106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.281 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:34.272956+0000", 2024-04-19T04:25:34.281 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0043450290000000003, 2024-04-19T04:25:34.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044218060000000003, 2024-04-19T04:25:34.281 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.281 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:34.281 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.281 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.281 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.281 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 104107 2024-04-19T04:25:34.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.282 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.272956+0000", 2024-04-19T04:25:34.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.272956+0000", 2024-04-19T04:25:34.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.272955+0000", 2024-04-19T04:25:34.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.273052+0000", 2024-04-19T04:25:34.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7646000000000007e-05 2024-04-19T04:25:34.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.273064+0000", 2024-04-19T04:25:34.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2078e-05 2024-04-19T04:25:34.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.273072+0000", 2024-04-19T04:25:34.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8900000000000007e-06 2024-04-19T04:25:34.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.273118+0000", 2024-04-19T04:25:34.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5133999999999999e-05 2024-04-19T04:25:34.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.273219+0000", 2024-04-19T04:25:34.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101396 2024-04-19T04:25:34.284 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.284 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.285 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.285 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:104109 5.e 5:78c658d9:::benchmark_data_smithi007_19526_object104108:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.285 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:34.273098+0000", 2024-04-19T04:25:34.285 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00420317, 2024-04-19T04:25:34.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0043278580000000004, 2024-04-19T04:25:34.285 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.285 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:34.285 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.285 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.285 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.285 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 104109 2024-04-19T04:25:34.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.285 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.273098+0000", 2024-04-19T04:25:34.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.273098+0000", 2024-04-19T04:25:34.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.273097+0000", 2024-04-19T04:25:34.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.273165+0000", 2024-04-19T04:25:34.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7966000000000006e-05 2024-04-19T04:25:34.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.273177+0000", 2024-04-19T04:25:34.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1882000000000001e-05 2024-04-19T04:25:34.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.273183+0000", 2024-04-19T04:25:34.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5429999999999999e-06 2024-04-19T04:25:34.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.273227+0000", 2024-04-19T04:25:34.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3956999999999999e-05 2024-04-19T04:25:34.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.273326+0000", 2024-04-19T04:25:34.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9100999999999999e-05 2024-04-19T04:25:34.288 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.288 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.288 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.288 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:104110 5.d e45/29 5:bcd43824:::benchmark_data_smithi007_19526_object104109:head v 45'6294, mlcod=45'6292)", 2024-04-19T04:25:34.289 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:34.274347+0000", 2024-04-19T04:25:34.289 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0029534610000000001, 2024-04-19T04:25:34.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031212879999999998, 2024-04-19T04:25:34.289 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.289 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:34.289 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.274347+0000", 2024-04-19T04:25:34.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.274347+0000", 2024-04-19T04:25:34.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.274342+0000", 2024-04-19T04:25:34.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999948 2024-04-19T04:25:34.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.274398+0000", 2024-04-19T04:25:34.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5804999999999998e-05 2024-04-19T04:25:34.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.274413+0000", 2024-04-19T04:25:34.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5313000000000001e-05 2024-04-19T04:25:34.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.274421+0000", 2024-04-19T04:25:34.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4800000000000004e-06 2024-04-19T04:25:34.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.274470+0000", 2024-04-19T04:25:34.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9663000000000002e-05 2024-04-19T04:25:34.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.274495+0000", 2024-04-19T04:25:34.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4247999999999999e-05 2024-04-19T04:25:34.292 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.292 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.292 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.292 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:104112 5.8 5:1173d3bf:::benchmark_data_smithi007_19526_object104111:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.292 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:34.275803+0000", 2024-04-19T04:25:34.292 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001498306, 2024-04-19T04:25:34.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0017078499999999999, 2024-04-19T04:25:34.292 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.292 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:34.292 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.292 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.292 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.293 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 104112 2024-04-19T04:25:34.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.293 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.275803+0000", 2024-04-19T04:25:34.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.275803+0000", 2024-04-19T04:25:34.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.275802+0000", 2024-04-19T04:25:34.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.275858+0000", 2024-04-19T04:25:34.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6607999999999997e-05 2024-04-19T04:25:34.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.275871+0000", 2024-04-19T04:25:34.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2685e-05 2024-04-19T04:25:34.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.275877+0000", 2024-04-19T04:25:34.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4860000000000002e-06 2024-04-19T04:25:34.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.275919+0000", 2024-04-19T04:25:34.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1934000000000002e-05 2024-04-19T04:25:34.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.276084+0000", 2024-04-19T04:25:34.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016430899999999999 2024-04-19T04:25:34.295 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.296 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.296 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.296 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:104114 5.8 5.9627b0a8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.296 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:34.275889+0000", 2024-04-19T04:25:34.296 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001411491, 2024-04-19T04:25:34.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00166259, 2024-04-19T04:25:34.296 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.296 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:34.296 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.296 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.296 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.296 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 104114 2024-04-19T04:25:34.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.297 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.275889+0000", 2024-04-19T04:25:34.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.275889+0000", 2024-04-19T04:25:34.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.275889+0000", 2024-04-19T04:25:34.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.276001+0000", 2024-04-19T04:25:34.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111826 2024-04-19T04:25:34.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.276009+0000", 2024-04-19T04:25:34.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2770000000000005e-06 2024-04-19T04:25:34.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.276013+0000", 2024-04-19T04:25:34.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4530000000000004e-06 2024-04-19T04:25:34.299 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.299 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.299 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.299 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:104111 5.9 e45/20 5:9921fe81:::benchmark_data_smithi007_19526_object104110:head v 45'6679, mlcod=45'6676)", 2024-04-19T04:25:34.299 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:34.276261+0000", 2024-04-19T04:25:34.299 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0010395879999999999, 2024-04-19T04:25:34.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001358188, 2024-04-19T04:25:34.299 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.299 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:34.299 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.276261+0000", 2024-04-19T04:25:34.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.276261+0000", 2024-04-19T04:25:34.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.276261+0000", 2024-04-19T04:25:34.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.276308+0000", 2024-04-19T04:25:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7052000000000003e-05 2024-04-19T04:25:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.276316+0000", 2024-04-19T04:25:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8499999999999994e-06 2024-04-19T04:25:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.276321+0000", 2024-04-19T04:25:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.276363+0000", 2024-04-19T04:25:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2249000000000002e-05 2024-04-19T04:25:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.276381+0000", 2024-04-19T04:25:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8026e-05 2024-04-19T04:25:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:104117 5.8 5.9424aed8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:34.276401+0000", 2024-04-19T04:25:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00089962500000000003, 2024-04-19T04:25:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012721239999999999, 2024-04-19T04:25:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 104117 2024-04-19T04:25:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.276401+0000", 2024-04-19T04:25:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.276401+0000", 2024-04-19T04:25:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.276400+0000", 2024-04-19T04:25:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.276511+0000", 2024-04-19T04:25:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011010699999999999 2024-04-19T04:25:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.276521+0000", 2024-04-19T04:25:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0186999999999999e-05 2024-04-19T04:25:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:34.276529+0000", 2024-04-19T04:25:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1510000000000004e-06 2024-04-19T04:25:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.306 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:34.306 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 8 2024-04-19T04:25:34.306 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:34.307 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:34.352 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:34.350+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:34.353 DEBUG:teuthology.orchestra.console.smithi066:Waiting for login prompt 2024-04-19T04:25:34.354 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi066 2024-04-19T04:25:34.436 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:34.436 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:34.436 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:34.436 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:34.436 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:34.447 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:34.490 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:34.490+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:34.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~18s 2024-04-19T04:25:34.553 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:34.553+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:34.618 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:34.618 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:34.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:34.618 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:34.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.619 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:34.619 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:34.619 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.380719042000003, 2024-04-19T04:25:34.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:34.619 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.619 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.619 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.619 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.619 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.619 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:34.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.619 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:34.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:34.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:34.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:34.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:34.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:34.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:34.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:34.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:34.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:34.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:34.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:34.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:34.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:34.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:34.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:34.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:34.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:34.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:34.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:34.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:34.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:34.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:34.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:34.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:34.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:34.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:34.624 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.624 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.624 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.625 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:34.625 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:34.625 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.376270126000001, 2024-04-19T04:25:34.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:34.625 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.625 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.625 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.625 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.625 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.625 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:34.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.626 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:34.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:34.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:34.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:34.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:34.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:34.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:34.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:34.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:34.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:34.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:34.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:34.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:34.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:34.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:34.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:34.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:34.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:34.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:34.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:34.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:34.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:34.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:34.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:34.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:34.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:34.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:34.630 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.630 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.630 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.631 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:34.631 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:34.631 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.548337882999999, 2024-04-19T04:25:34.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:34.631 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.631 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.631 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.631 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.631 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.631 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:34.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.631 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:34.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:34.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:34.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:34.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:34.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:34.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:34.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:34.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:34.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:34.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:34.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:34.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:34.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:34.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:34.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:34.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:34.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:34.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:34.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:34.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:34.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:34.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:34.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:34.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:34.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:34.637 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.637 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.637 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.637 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:34.637 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:34.637 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.112483846, 2024-04-19T04:25:34.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:34.637 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.637 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.638 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.638 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.638 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.638 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:34.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.638 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:34.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:34.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:34.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:34.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:34.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:34.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:34.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:34.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:34.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:34.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:34.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:34.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:34.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:34.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:34.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:34.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:34.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:34.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:34.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:34.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:34.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:34.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:34.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:34.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:34.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:34.643 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.643 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.643 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.643 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:34.643 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:34.643 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.112053425999999, 2024-04-19T04:25:34.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:34.643 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.644 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.644 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.644 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.644 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.644 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:34.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.644 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:34.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:34.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:34.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:34.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:34.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:34.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:34.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:34.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:34.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:34.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:34.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:34.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:34.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:34.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:34.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:34.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:34.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:34.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:34.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:34.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:34.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:34.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:34.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:34.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:34.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:34.649 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.649 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.649 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.649 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:34.649 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:34.649 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.109822162, 2024-04-19T04:25:34.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:34.649 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.650 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.650 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:34.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.650 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:34.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:34.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:34.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:34.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:34.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:34.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:34.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:34.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:34.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:34.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:34.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:34.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:34.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:34.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:34.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:34.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:34.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:34.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:34.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:34.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:34.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:34.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:34.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:34.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:34.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:34.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:34.655 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.655 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.655 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.655 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:34.655 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:34.655 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.106425124000001, 2024-04-19T04:25:34.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:34.655 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.655 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.656 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.656 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.656 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.656 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:34.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.656 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:34.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:34.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:34.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:34.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:34.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:34.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:34.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:34.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:34.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:34.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:34.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:34.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:34.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:34.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:34.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:34.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:34.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:34.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:34.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:34.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:34.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:34.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:34.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:34.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:34.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:34.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:34.662 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.662 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.662 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.662 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:34.662 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:34.662 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.101296926, 2024-04-19T04:25:34.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:34.663 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.663 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.663 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.663 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.663 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.663 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:34.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.663 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:34.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:34.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:34.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:34.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:34.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:34.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:34.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:34.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:34.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:34.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:34.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:34.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:34.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:34.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:34.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:34.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:34.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:34.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:34.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:34.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:34.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:34.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:34.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:34.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:34.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:34.669 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.669 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.669 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.670 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:34.670 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:34.670 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.787268421, 2024-04-19T04:25:34.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:34.671 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.671 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.671 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.671 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.671 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.672 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:34.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.672 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:34.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:34.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:34.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:34.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:34.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:34.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:34.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:34.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:34.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:34.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:34.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:34.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:34.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:34.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:34.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:34.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:34.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:34.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:34.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:34.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:34.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:34.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:34.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:34.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:34.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:34.681 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.681 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.681 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.681 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67949 5.b 5:d725bcef:::benchmark_data_smithi007_19526_object67948:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:34.681 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:34.681 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.784150143000002, 2024-04-19T04:25:34.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022537248999999999, 2024-04-19T04:25:34.681 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.681 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.681 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.681 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.681 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.681 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67949 2024-04-19T04:25:34.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.682 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:34.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832100+0000", 2024-04-19T04:25:34.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832099+0000", 2024-04-19T04:25:34.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832148+0000", 2024-04-19T04:25:34.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9517e-05 2024-04-19T04:25:34.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832154+0000", 2024-04-19T04:25:34.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5319999999999997e-06 2024-04-19T04:25:34.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.832158+0000", 2024-04-19T04:25:34.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9099999999999998e-06 2024-04-19T04:25:34.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.833836+0000", 2024-04-19T04:25:34.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001678817 2024-04-19T04:25:34.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834007+0000", 2024-04-19T04:25:34.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000170151 2024-04-19T04:25:34.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:34.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.834238+0000", 2024-04-19T04:25:34.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023146700000000001 2024-04-19T04:25:34.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:34.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.839447+0000", 2024-04-19T04:25:34.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005209272 2024-04-19T04:25:34.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854573+0000", 2024-04-19T04:25:34.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015125945 2024-04-19T04:25:34.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:34.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854607+0000", 2024-04-19T04:25:34.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3782000000000003e-05 2024-04-19T04:25:34.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854637+0000", 2024-04-19T04:25:34.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9827000000000001e-05 2024-04-19T04:25:34.687 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.687 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.687 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.687 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:34.687 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:34.687 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.664909010999999, 2024-04-19T04:25:34.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:25:34.687 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.687 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:34.687 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.687 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.688 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.688 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:34.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.688 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:34.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:34.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:34.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:34.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:34.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:34.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:34.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:34.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:34.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:34.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:34.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:34.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:34.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:34.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:34.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:34.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:34.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:34.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:34.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:34.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:34.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:34.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:34.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:34.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:34.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:25:34.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:25:34.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:25:34.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:25:34.693 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.693 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.693 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.693 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:34.693 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:34.693 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.659847365000001, 2024-04-19T04:25:34.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:25:34.693 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.693 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:34.693 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.694 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.694 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.694 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:34.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.694 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:34.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:34.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:34.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:34.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:34.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:34.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:34.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:34.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:34.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:34.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:34.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:34.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:34.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:34.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:34.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:34.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:34.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:34.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:34.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:34.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:34.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:34.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:25:34.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:25:34.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:25:34.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:25:34.698 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.699 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.699 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.699 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:34.699 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:34.699 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.659747453000001, 2024-04-19T04:25:34.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:25:34.699 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.699 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:34.699 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.699 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.699 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.699 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:34.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.700 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:34.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:34.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:34.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:34.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:34.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:34.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:34.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:34.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:34.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:34.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:34.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:34.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:34.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:34.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:34.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:34.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:34.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:34.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:34.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:34.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:34.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:25:34.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:25:34.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:25:34.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:25:34.704 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.704 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.704 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.704 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:34.705 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:34.705 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.659621699999999, 2024-04-19T04:25:34.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:25:34.705 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.705 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:34.705 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.705 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.705 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.705 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:34.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.705 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:34.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:34.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:34.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:34.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:34.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:34.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:34.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:34.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:34.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:34.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:34.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:34.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:34.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:34.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:34.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:34.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:34.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:34.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:34.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:34.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:34.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:25:34.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:25:34.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:25:34.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:25:34.710 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.710 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.710 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.710 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:34.710 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:34.710 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.655777754999999, 2024-04-19T04:25:34.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:25:34.710 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.710 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.711 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.711 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.711 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.711 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:34.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.711 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:34.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:34.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:34.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:34.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:34.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:34.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:34.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:34.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:34.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:34.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:34.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:34.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:34.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:34.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:34.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:25:34.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:25:34.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:25:34.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:25:34.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:34.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:25:34.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:25:34.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:34.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:25:34.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:25:34.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:25:34.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:25:34.715 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.715 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.715 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.716 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:34.716 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:34.716 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.648606653999998, 2024-04-19T04:25:34.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:25:34.716 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.716 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:34.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.716 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:34.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.716 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:34.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:34.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:34.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:34.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:34.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:34.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:34.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:34.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:34.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:34.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:34.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:34.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:34.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:34.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:34.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:25:34.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:25:34.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:25:34.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:25:34.720 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.720 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.720 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.720 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:34.720 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:34.720 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.648434550000001, 2024-04-19T04:25:34.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:25:34.720 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.720 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:34.721 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.721 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.721 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.721 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:34.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.721 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:34.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:34.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:34.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:34.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:34.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:34.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:34.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:34.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:34.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:34.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:34.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:34.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:34.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:34.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:25:34.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:25:34.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:25:34.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:25:34.724 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.724 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.725 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.725 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:34.725 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:34.725 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.648371425000001, 2024-04-19T04:25:34.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:25:34.725 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.725 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.725 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.725 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.725 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.725 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:34.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.726 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:34.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:34.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:34.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:34.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:34.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:34.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:34.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:34.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:34.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:34.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:34.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:34.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:34.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:34.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:25:34.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:25:34.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:25:34.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:25:34.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:34.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:25:34.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:25:34.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:34.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:25:34.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:25:34.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:25:34.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:25:34.730 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.730 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.730 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.730 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:34.731 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:34.731 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.648242828000001, 2024-04-19T04:25:34.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:25:34.731 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.731 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.731 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.731 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.731 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.731 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:34.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.731 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:34.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:34.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:34.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:34.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:34.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:34.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:34.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:34.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:34.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:34.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:34.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:34.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:34.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:34.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:25:34.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:25:34.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:25:34.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:25:34.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:34.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:25:34.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:25:34.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:34.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:25:34.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:25:34.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:25:34.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:25:34.736 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.736 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.736 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.736 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:34.736 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:34.736 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.648174857000001, 2024-04-19T04:25:34.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:25:34.736 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:34.736 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.737 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:34.737 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:34.737 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.737 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:34.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.737 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:34.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:34.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:34.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:34.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:34.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:34.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:34.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:34.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:34.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:34.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:34.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:34.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:34.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:34.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:34.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:34.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:34.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:34.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:34.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:34.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:34.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:34.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:25:34.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:25:34.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:34.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:25:34.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:25:34.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:34.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:25:34.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:25:34.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:34.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:25:34.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:25:34.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:34.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:34.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:34.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:25:34.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:25:34.743 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.743 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.743 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.743 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:34.744 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:34.744 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:34.745 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:34.742+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:34.745 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:34.756 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 50 16 105144 105128 131.394 131.375 0.00782865 0.00760492 2024-04-19T04:25:34.846 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:34.845+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:34.872 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:34.872 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:34.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.873 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:105366 5.7 5:ebbf5924:::benchmark_data_smithi007_19526_object105365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.873 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:34.868610+0000", 2024-04-19T04:25:34.873 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0035279869999999998, 2024-04-19T04:25:34.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0035573089999999998, 2024-04-19T04:25:34.873 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.873 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:34.873 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.873 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.873 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.873 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 105366 2024-04-19T04:25:34.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.873 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.868610+0000", 2024-04-19T04:25:34.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.868610+0000", 2024-04-19T04:25:34.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.868609+0000", 2024-04-19T04:25:34.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:34.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.868694+0000", 2024-04-19T04:25:34.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5123999999999993e-05 2024-04-19T04:25:34.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.868704+0000", 2024-04-19T04:25:34.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0693000000000001e-05 2024-04-19T04:25:34.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.868712+0000", 2024-04-19T04:25:34.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.418e-06 2024-04-19T04:25:34.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.870409+0000", 2024-04-19T04:25:34.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016972790000000001 2024-04-19T04:25:34.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.870539+0000", 2024-04-19T04:25:34.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012969899999999999 2024-04-19T04:25:34.877 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.877 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.877 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.877 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:105367 5.2 5:47bd6f2c:::benchmark_data_smithi007_19526_object105366:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.878 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:34.869206+0000", 2024-04-19T04:25:34.878 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0029321769999999998, 2024-04-19T04:25:34.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00302163, 2024-04-19T04:25:34.878 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.878 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:34.878 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.879 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.879 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.879 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 105367 2024-04-19T04:25:34.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.879 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.869206+0000", 2024-04-19T04:25:34.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.869206+0000", 2024-04-19T04:25:34.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.869205+0000", 2024-04-19T04:25:34.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.869315+0000", 2024-04-19T04:25:34.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109929 2024-04-19T04:25:34.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.869326+0000", 2024-04-19T04:25:34.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0859999999999999e-05 2024-04-19T04:25:34.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.869347+0000", 2024-04-19T04:25:34.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0970000000000001e-05 2024-04-19T04:25:34.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.869420+0000", 2024-04-19T04:25:34.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3399000000000007e-05 2024-04-19T04:25:34.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.869594+0000", 2024-04-19T04:25:34.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000174205 2024-04-19T04:25:34.882 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.882 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.882 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.882 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:105369 5.c 5:38c20300:::benchmark_data_smithi007_19526_object105368:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.882 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:34.871411+0000", 2024-04-19T04:25:34.882 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00072683299999999997, 2024-04-19T04:25:34.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00085957799999999995, 2024-04-19T04:25:34.883 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.883 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:34.883 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.883 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.883 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.883 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 105369 2024-04-19T04:25:34.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.883 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.871411+0000", 2024-04-19T04:25:34.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.871411+0000", 2024-04-19T04:25:34.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.871410+0000", 2024-04-19T04:25:34.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:34.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.871435+0000", 2024-04-19T04:25:34.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5559999999999999e-05 2024-04-19T04:25:34.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.871446+0000", 2024-04-19T04:25:34.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0923e-05 2024-04-19T04:25:34.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.871451+0000", 2024-04-19T04:25:34.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1909999999999999e-06 2024-04-19T04:25:34.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.886 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.871503+0000", 2024-04-19T04:25:34.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2014e-05 2024-04-19T04:25:34.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.886 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.886 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.871634+0000", 2024-04-19T04:25:34.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013062499999999999 2024-04-19T04:25:34.886 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.886 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.886 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.886 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:105370 5.c 5.632047fc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.886 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:34.871908+0000", 2024-04-19T04:25:34.887 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00022939499999999999, 2024-04-19T04:25:34.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00040015100000000001, 2024-04-19T04:25:34.887 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.887 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:34.887 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.887 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.887 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.887 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 105370 2024-04-19T04:25:34.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.887 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.871908+0000", 2024-04-19T04:25:34.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.871908+0000", 2024-04-19T04:25:34.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.871908+0000", 2024-04-19T04:25:34.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.872006+0000", 2024-04-19T04:25:34.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8776000000000004e-05 2024-04-19T04:25:34.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.872016+0000", 2024-04-19T04:25:34.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.3000000000000007e-06 2024-04-19T04:25:34.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.872020+0000", 2024-04-19T04:25:34.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2710000000000003e-06 2024-04-19T04:25:34.889 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.889 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.890 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.890 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:105349 5.7 5:e6eeb01d:::benchmark_data_smithi007_19526_object105348:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.890 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:34.861373+0000", 2024-04-19T04:25:34.890 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.010765078000000001, 2024-04-19T04:25:34.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011008842, 2024-04-19T04:25:34.890 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.890 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:34.890 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.890 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.890 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.890 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 105349 2024-04-19T04:25:34.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.891 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.861373+0000", 2024-04-19T04:25:34.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.861373+0000", 2024-04-19T04:25:34.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.861371+0000", 2024-04-19T04:25:34.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:34.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.861443+0000", 2024-04-19T04:25:34.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1490999999999997e-05 2024-04-19T04:25:34.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.861455+0000", 2024-04-19T04:25:34.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1994000000000001e-05 2024-04-19T04:25:34.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.893 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.861463+0000", 2024-04-19T04:25:34.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.123e-06 2024-04-19T04:25:34.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.893 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.893 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.861510+0000", 2024-04-19T04:25:34.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6776000000000001e-05 2024-04-19T04:25:34.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.893 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.893 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.861610+0000", 2024-04-19T04:25:34.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9949000000000001e-05 2024-04-19T04:25:34.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:34.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.872313+0000", 2024-04-19T04:25:34.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.01070346 2024-04-19T04:25:34.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:34.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.872360+0000", 2024-04-19T04:25:34.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6349e-05 2024-04-19T04:25:34.894 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.894 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.894 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.895 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:105353 5.1 5:8f2fc751:::benchmark_data_smithi007_19526_object105352:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.895 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:34.862302+0000", 2024-04-19T04:25:34.895 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0098354549999999999, 2024-04-19T04:25:34.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010175058000000001, 2024-04-19T04:25:34.895 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.895 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:34.895 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.895 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.895 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.895 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 105353 2024-04-19T04:25:34.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.895 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.862302+0000", 2024-04-19T04:25:34.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.862302+0000", 2024-04-19T04:25:34.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.862302+0000", 2024-04-19T04:25:34.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.862370+0000", 2024-04-19T04:25:34.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8632000000000003e-05 2024-04-19T04:25:34.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.862379+0000", 2024-04-19T04:25:34.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9400000000000008e-06 2024-04-19T04:25:34.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.862386+0000", 2024-04-19T04:25:34.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7989999999999996e-06 2024-04-19T04:25:34.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.898 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.898 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864757+0000", 2024-04-19T04:25:34.898 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023704720000000002 2024-04-19T04:25:34.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.898 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.898 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864914+0000", 2024-04-19T04:25:34.898 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015715799999999999 2024-04-19T04:25:34.898 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.898 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.898 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.898 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:105355 5.d 5:bb0fa3aa:::benchmark_data_smithi007_19526_object105354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.899 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:34.864706+0000", 2024-04-19T04:25:34.899 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0074315709999999997, 2024-04-19T04:25:34.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0078509760000000008, 2024-04-19T04:25:34.899 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.899 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:34.899 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.899 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.899 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.899 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 105355 2024-04-19T04:25:34.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.899 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864706+0000", 2024-04-19T04:25:34.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864706+0000", 2024-04-19T04:25:34.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864705+0000", 2024-04-19T04:25:34.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:34.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864787+0000", 2024-04-19T04:25:34.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1802e-05 2024-04-19T04:25:34.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864803+0000", 2024-04-19T04:25:34.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5517999999999999e-05 2024-04-19T04:25:34.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864811+0000", 2024-04-19T04:25:34.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9680000000000006e-06 2024-04-19T04:25:34.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864850+0000", 2024-04-19T04:25:34.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9205000000000002e-05 2024-04-19T04:25:34.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864954+0000", 2024-04-19T04:25:34.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010407399999999999 2024-04-19T04:25:34.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:34.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865108+0000", 2024-04-19T04:25:34.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153671 2024-04-19T04:25:34.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.903 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.903 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.871542+0000", 2024-04-19T04:25:34.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0064342790000000002 2024-04-19T04:25:34.903 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.903 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.903 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.903 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:105356 5.d 5:b7b5ddb7:::benchmark_data_smithi007_19526_object105355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.903 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:34.864825+0000", 2024-04-19T04:25:34.903 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0073127569999999996, 2024-04-19T04:25:34.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0078149059999999999, 2024-04-19T04:25:34.903 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.904 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:34.904 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.904 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.904 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.904 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 105356 2024-04-19T04:25:34.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.904 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.904 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864825+0000", 2024-04-19T04:25:34.904 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864825+0000", 2024-04-19T04:25:34.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864824+0000", 2024-04-19T04:25:34.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864865+0000", 2024-04-19T04:25:34.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0166999999999997e-05 2024-04-19T04:25:34.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864882+0000", 2024-04-19T04:25:34.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.721e-05 2024-04-19T04:25:34.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864888+0000", 2024-04-19T04:25:34.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5220000000000004e-06 2024-04-19T04:25:34.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.867778+0000", 2024-04-19T04:25:34.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002889909 2024-04-19T04:25:34.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.867903+0000", 2024-04-19T04:25:34.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012520000000000001 2024-04-19T04:25:34.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:34.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.868030+0000", 2024-04-19T04:25:34.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012701800000000001 2024-04-19T04:25:34.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.871573+0000", 2024-04-19T04:25:34.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0035424269999999999 2024-04-19T04:25:34.908 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.908 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.908 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.908 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:105357 5.7 5:e4305d03:::benchmark_data_smithi007_19526_object105356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.908 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:34.864899+0000", 2024-04-19T04:25:34.908 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0072389910000000002, 2024-04-19T04:25:34.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0077908700000000001, 2024-04-19T04:25:34.908 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.909 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:34.909 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.909 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.909 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.909 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 105357 2024-04-19T04:25:34.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.909 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.909 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.909 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864899+0000", 2024-04-19T04:25:34.909 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.909 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864899+0000", 2024-04-19T04:25:34.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864898+0000", 2024-04-19T04:25:34.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864969+0000", 2024-04-19T04:25:34.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1255999999999997e-05 2024-04-19T04:25:34.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864985+0000", 2024-04-19T04:25:34.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5427999999999999e-05 2024-04-19T04:25:34.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.864992+0000", 2024-04-19T04:25:34.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6320000000000008e-06 2024-04-19T04:25:34.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865048+0000", 2024-04-19T04:25:34.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5229999999999998e-05 2024-04-19T04:25:34.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865186+0000", 2024-04-19T04:25:34.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000138097 2024-04-19T04:25:34.912 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.912 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.912 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.912 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:105358 5.c 5:3898f364:::benchmark_data_smithi007_19526_object105357:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.912 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:34.865008+0000", 2024-04-19T04:25:34.912 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0071294009999999996, 2024-04-19T04:25:34.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0077217520000000001, 2024-04-19T04:25:34.913 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.913 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:34.913 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.913 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.913 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.913 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 105358 2024-04-19T04:25:34.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.913 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865008+0000", 2024-04-19T04:25:34.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865008+0000", 2024-04-19T04:25:34.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865008+0000", 2024-04-19T04:25:34.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865086+0000", 2024-04-19T04:25:34.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8719000000000003e-05 2024-04-19T04:25:34.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865096+0000", 2024-04-19T04:25:34.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:34.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865102+0000", 2024-04-19T04:25:34.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3960000000000003e-06 2024-04-19T04:25:34.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865157+0000", 2024-04-19T04:25:34.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5041999999999999e-05 2024-04-19T04:25:34.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865369+0000", 2024-04-19T04:25:34.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00021117999999999999 2024-04-19T04:25:34.916 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.916 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.917 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.917 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:105361 5.3 5:c315d16b:::benchmark_data_smithi007_19526_object105360:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.917 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:34.865118+0000", 2024-04-19T04:25:34.917 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0070195090000000002, 2024-04-19T04:25:34.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0076528250000000003, 2024-04-19T04:25:34.917 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.917 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:34.917 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.917 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.918 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.918 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 105361 2024-04-19T04:25:34.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.918 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865118+0000", 2024-04-19T04:25:34.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865118+0000", 2024-04-19T04:25:34.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865118+0000", 2024-04-19T04:25:34.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865162+0000", 2024-04-19T04:25:34.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4709000000000002e-05 2024-04-19T04:25:34.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865178+0000", 2024-04-19T04:25:34.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6138e-05 2024-04-19T04:25:34.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.920 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865187+0000", 2024-04-19T04:25:34.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6449999999999994e-06 2024-04-19T04:25:34.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.920 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865227+0000", 2024-04-19T04:25:34.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9413999999999999e-05 2024-04-19T04:25:34.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865355+0000", 2024-04-19T04:25:34.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012883999999999999 2024-04-19T04:25:34.921 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.921 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.921 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.921 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:105362 5.5 5:ab7e22e3:::benchmark_data_smithi007_19526_object105361:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.921 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:34.865202+0000", 2024-04-19T04:25:34.921 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0069355579999999997, 2024-04-19T04:25:34.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0076164409999999998, 2024-04-19T04:25:34.921 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.922 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:34.922 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.922 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.922 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.922 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 105362 2024-04-19T04:25:34.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.922 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865202+0000", 2024-04-19T04:25:34.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865202+0000", 2024-04-19T04:25:34.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865202+0000", 2024-04-19T04:25:34.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865244+0000", 2024-04-19T04:25:34.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2098999999999998e-05 2024-04-19T04:25:34.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865252+0000", 2024-04-19T04:25:34.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7260000000000008e-06 2024-04-19T04:25:34.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865258+0000", 2024-04-19T04:25:34.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.032e-06 2024-04-19T04:25:34.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.867539+0000", 2024-04-19T04:25:34.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002280804 2024-04-19T04:25:34.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.867678+0000", 2024-04-19T04:25:34.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013892399999999999 2024-04-19T04:25:34.925 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.925 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.925 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.927 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:105363 5.7 5:ed7289db:::benchmark_data_smithi007_19526_object105362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.927 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:34.865267+0000", 2024-04-19T04:25:34.927 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.006870396, 2024-04-19T04:25:34.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075919209999999997, 2024-04-19T04:25:34.927 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.927 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:34.927 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.927 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.927 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.927 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 105363 2024-04-19T04:25:34.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.928 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865267+0000", 2024-04-19T04:25:34.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865267+0000", 2024-04-19T04:25:34.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865267+0000", 2024-04-19T04:25:34.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865311+0000", 2024-04-19T04:25:34.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4589000000000003e-05 2024-04-19T04:25:34.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865320+0000", 2024-04-19T04:25:34.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.149e-06 2024-04-19T04:25:34.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.930 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865327+0000", 2024-04-19T04:25:34.930 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1330000000000004e-06 2024-04-19T04:25:34.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.930 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.930 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.867682+0000", 2024-04-19T04:25:34.930 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002355251 2024-04-19T04:25:34.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.930 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.930 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.867807+0000", 2024-04-19T04:25:34.930 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000125141 2024-04-19T04:25:34.930 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.930 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.930 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.931 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:105364 5.9 5:91b14423:::benchmark_data_smithi007_19526_object105363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T04:25:34.931 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:34.865339+0000", 2024-04-19T04:25:34.931 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0067983499999999999, 2024-04-19T04:25:34.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075639519999999997, 2024-04-19T04:25:34.931 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:34.931 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:34.931 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:34.931 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:34.931 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:34.931 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 105364 2024-04-19T04:25:34.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.931 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:34.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.932 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:34.932 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865339+0000", 2024-04-19T04:25:34.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.932 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:34.932 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865339+0000", 2024-04-19T04:25:34.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:34.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.932 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:34.932 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865339+0000", 2024-04-19T04:25:34.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:34.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:34.933 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865385+0000", 2024-04-19T04:25:34.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6007999999999997e-05 2024-04-19T04:25:34.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:34.933 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865394+0000", 2024-04-19T04:25:34.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9169999999999995e-06 2024-04-19T04:25:34.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:34.933 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.865400+0000", 2024-04-19T04:25:34.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1789999999999996e-06 2024-04-19T04:25:34.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.934 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:34.934 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.867237+0000", 2024-04-19T04:25:34.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001837195 2024-04-19T04:25:34.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.934 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:34.934 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.867452+0000", 2024-04-19T04:25:34.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00021463400000000001 2024-04-19T04:25:34.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.935 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:34.935 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.867590+0000", 2024-04-19T04:25:34.935 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013790800000000001 2024-04-19T04:25:34.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:34.935 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:34.935 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:34.935 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:34.871563+0000", 2024-04-19T04:25:34.935 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003973819 2024-04-19T04:25:34.935 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.935 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:34.935 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.935 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:34.935 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:34.935 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 14 2024-04-19T04:25:34.935 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:34.937 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:34.947 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:34.946+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:35.048 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:35.046+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:35.117 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:35.117 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:35.117 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:35.117 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:35.117 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:35.129 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:35.149 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:35.146+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:35.181 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:25:35.250 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:35.249+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:35.262 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:35.262 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:35.262 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:35.262 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:35.263 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.263 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:35.263 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:35.263 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.029776446, 2024-04-19T04:25:35.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:35.263 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.263 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:35.263 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:35.263 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:35.263 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:35.263 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:35.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.263 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.264 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.264 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:35.264 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.264 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.264 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:35.264 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.264 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.264 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:35.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:35.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:35.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:35.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:35.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:35.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:35.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:35.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.266 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:35.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:35.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.266 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:35.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:35.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:35.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.267 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.267 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:35.267 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:35.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:35.267 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.267 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.267 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:35.267 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:35.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:35.267 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.267 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.267 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:35.267 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:35.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:35.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.268 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:35.268 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:35.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:35.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.268 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.268 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:35.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:35.268 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.268 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.268 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.269 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:35.269 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:35.269 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.026595290000003, 2024-04-19T04:25:35.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:35.269 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.269 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:35.269 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:35.269 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:35.269 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:35.269 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:35.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.269 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:35.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:35.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:35.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:35.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:35.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:35.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:35.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:35.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:35.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:35.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.272 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.272 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.272 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:35.272 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:35.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.272 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.272 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:35.272 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:35.272 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:35.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.272 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.272 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:35.272 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:35.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:35.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:35.273 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:35.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:35.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:35.273 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:35.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:35.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:35.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:35.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:35.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.274 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:35.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:35.274 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.274 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.274 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.274 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:35.274 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:35.275 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.026027186, 2024-04-19T04:25:35.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:35.275 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.275 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:35.275 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:35.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:35.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:35.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:35.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:35.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:35.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:35.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:35.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:35.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:35.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:35.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:35.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:35.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:35.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:35.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:35.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:35.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:35.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:35.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:35.278 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.278 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.278 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.279 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:35.279 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:35.279 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.025681525000003, 2024-04-19T04:25:35.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:35.279 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.279 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:35.279 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:35.279 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:35.279 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:35.279 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:35.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.279 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:35.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:35.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:35.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:35.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:35.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:35.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:35.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:35.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:35.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:35.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:35.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:35.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:35.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:35.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:35.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:35.283 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:35.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:35.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.283 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:35.283 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:35.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:35.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.283 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:35.283 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:35.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:35.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:35.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:35.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:35.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:35.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:35.284 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.284 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.284 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.284 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:35.284 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:35.285 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.024957086999997, 2024-04-19T04:25:35.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:35.285 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.285 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:35.285 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.285 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.285 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:35.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.285 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.285 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:35.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:35.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:35.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:35.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:35.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:35.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:35.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:35.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:35.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:35.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:35.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:35.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:35.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:35.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:35.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:35.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:35.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:35.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:35.288 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.288 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.289 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.289 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:35.289 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:35.289 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.024949692, 2024-04-19T04:25:35.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:35.289 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.289 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:35.289 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:35.290 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.290 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.290 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:35.290 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.290 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.290 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:35.290 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:35.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:35.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:35.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:35.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:35.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:35.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:35.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.292 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.292 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:35.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:35.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.292 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.292 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:35.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:35.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:35.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.292 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.292 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:35.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:35.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:35.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.293 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.293 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:35.293 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:35.293 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.293 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.293 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.293 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:35.293 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:35.293 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.023124545000002, 2024-04-19T04:25:35.293 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:35.293 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.294 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:35.294 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:35.294 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:35.294 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:35.294 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:35.294 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.294 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.294 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.294 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.294 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:35.294 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.294 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.294 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.294 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.295 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:35.295 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.295 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.295 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:35.295 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:35.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.295 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.295 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:35.295 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:35.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:35.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:35.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:35.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:35.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:35.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:35.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.297 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:35.297 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:35.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:35.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.297 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:35.297 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:35.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:35.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.297 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:35.297 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:35.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:35.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:35.298 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:35.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:35.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:35.298 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:35.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:35.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.298 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:35.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:35.299 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.299 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.299 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.299 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:35.299 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:35.299 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.022390340000001, 2024-04-19T04:25:35.299 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:35.299 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.299 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:35.299 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:35.299 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:35.299 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:35.300 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:35.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.300 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:35.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:35.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:35.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:35.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:35.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:35.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:35.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:35.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.302 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:35.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:35.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.302 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:35.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:35.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:35.302 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:35.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:35.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:35.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:35.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:35.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:35.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:35.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:35.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:35.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:35.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:35.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.304 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.304 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:35.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:35.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:35.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.304 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.304 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:35.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:35.304 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.304 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.304 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.305 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:35.305 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:35.305 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.021856063999998, 2024-04-19T04:25:35.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:35.305 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.305 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:35.305 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:35.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:35.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:35.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:35.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:35.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:35.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:35.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:35.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:35.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:35.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:35.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:35.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:35.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:35.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:35.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:35.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:35.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:35.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:35.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:35.309 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.309 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.309 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.309 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:35.309 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:35.309 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 19.305000875000001, 2024-04-19T04:25:35.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:35.309 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.309 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:35.309 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:35.309 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:35.309 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:35.310 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:35.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.310 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:35.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:35.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:35.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:35.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:35.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:35.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:35.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:35.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:35.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:35.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:35.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:35.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:35.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:35.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:35.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:35.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:35.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:35.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:35.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:35.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:35.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:35.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:35.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:35.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:35.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:35.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:35.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:35.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:35.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:35.314 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.315 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.315 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.315 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:35.315 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:35.315 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 19.284770426000001, 2024-04-19T04:25:35.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:35.315 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.315 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:35.315 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:35.315 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:35.315 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:35.315 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:35.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.316 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.316 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.316 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:35.316 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.316 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.316 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:35.316 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.316 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.316 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:35.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:35.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.317 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.317 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:35.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:35.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.317 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.317 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:35.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:35.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.317 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:35.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:35.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:35.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:35.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:35.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:35.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:35.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.319 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.319 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:35.319 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:35.319 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.319 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.319 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.319 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:35.319 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:35.319 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.319 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.319 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.319 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.319 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.319 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:35.319 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:35.320 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 19.284662568999998, 2024-04-19T04:25:35.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:35.320 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.320 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:35.320 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:35.320 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:35.320 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:35.320 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:35.320 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.320 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.320 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.320 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.320 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:35.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.321 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.321 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.321 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.321 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:35.321 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.321 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.321 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.321 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.321 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:35.321 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:35.321 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.321 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.321 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.321 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:35.322 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:35.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.322 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.322 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.322 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:35.322 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:35.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.322 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.322 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.322 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:35.322 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:35.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.323 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.323 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.323 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:35.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:35.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.323 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.323 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:35.323 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:35.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:35.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.323 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.323 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.323 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:35.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:35.324 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.324 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.324 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.324 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:35.324 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:35.324 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.324 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.324 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.324 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.324 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.324 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:35.324 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:35.324 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 19.282695879999999, 2024-04-19T04:25:35.324 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:35.324 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.325 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:35.325 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:35.325 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:35.325 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:35.325 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:35.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.325 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.325 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.325 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:35.325 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.325 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.326 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:35.326 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.326 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.326 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.326 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.326 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:35.326 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:35.326 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.326 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.326 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.326 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:35.326 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:35.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.327 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.327 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:35.327 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:35.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.327 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.327 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:35.327 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:35.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.327 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.327 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:35.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:35.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:35.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:35.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:35.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:35.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:35.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.329 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:35.329 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:35.329 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:35.329 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.329 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:35.329 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:35.329 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:35.329 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.329 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:35.329 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:35.329 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:35.329 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.330 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:35.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:35.330 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.330 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.330 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.330 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:35.330 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:35.330 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 19.279331684999999, 2024-04-19T04:25:35.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:35.330 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.331 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:35.331 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:35.331 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:35.331 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:35.331 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:35.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.331 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:35.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:35.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.332 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.332 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:35.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:35.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.332 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.332 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:35.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:35.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.332 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.333 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:35.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:35.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.333 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:35.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:35.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.333 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:35.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:35.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:35.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:35.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:35.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:35.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:35.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:35.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:35.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:35.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:35.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:35.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:35.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:35.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:35.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:35.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:35.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:35.336 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.336 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.336 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.336 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:35.336 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:35.336 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 19.275520706999998, 2024-04-19T04:25:35.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:35.336 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.336 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:35.336 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:35.337 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:35.337 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:35.337 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:35.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.337 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.337 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.337 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:35.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.337 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.337 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:35.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.338 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.338 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:35.338 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:35.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.338 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.338 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:35.338 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:35.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.338 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:35.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:35.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:35.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:35.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:35.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:35.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:35.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:35.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:35.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:35.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:35.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:35.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:35.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:35.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:35.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:35.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:35.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:35.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:35.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:35.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:35.342 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:35.342 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.342 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.342 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.342 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.342 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.342 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93735 5.1 5:8e609d1b:::benchmark_data_smithi007_19526_object93734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:35.342 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:35.342 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 6.0338200630000003, 2024-04-19T04:25:35.342 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048424842000000003, 2024-04-19T04:25:35.342 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.342 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:35.342 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:35.342 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:35.343 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:35.343 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93735 2024-04-19T04:25:35.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.343 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.343 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.343 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:35.343 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.343 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.343 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:35.343 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.344 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.344 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227480+0000", 2024-04-19T04:25:35.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:35.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.344 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.344 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227533+0000", 2024-04-19T04:25:35.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2964999999999999e-05 2024-04-19T04:25:35.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.344 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.344 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227542+0000", 2024-04-19T04:25:35.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1449999999999997e-06 2024-04-19T04:25:35.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.345 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.345 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227561+0000", 2024-04-19T04:25:35.345 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9116000000000001e-05 2024-04-19T04:25:35.345 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.345 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.345 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227610+0000", 2024-04-19T04:25:35.345 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9234000000000003e-05 2024-04-19T04:25:35.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.346 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:35.346 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227697+0000", 2024-04-19T04:25:35.346 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6682999999999997e-05 2024-04-19T04:25:35.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:35.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275809+0000", 2024-04-19T04:25:35.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048112265000000001 2024-04-19T04:25:35.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:35.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275845+0000", 2024-04-19T04:25:35.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5275999999999999e-05 2024-04-19T04:25:35.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275906+0000", 2024-04-19T04:25:35.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1002999999999999e-05 2024-04-19T04:25:35.348 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.348 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.348 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.348 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.348 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93736 5.1 5:852229ec:::benchmark_data_smithi007_19526_object93735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:35.348 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:35.348 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 6.0337160330000001, 2024-04-19T04:25:35.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048414497000000001, 2024-04-19T04:25:35.348 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.348 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:35.348 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:35.348 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:35.349 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:35.349 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93736 2024-04-19T04:25:35.349 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.349 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.349 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.349 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:35.349 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.350 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.354 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.354 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:35.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.354 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.354 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227584+0000", 2024-04-19T04:25:35.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:35.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.354 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.354 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227624+0000", 2024-04-19T04:25:35.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9833000000000003e-05 2024-04-19T04:25:35.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227630+0000", 2024-04-19T04:25:35.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0759999999999999e-06 2024-04-19T04:25:35.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227634+0000", 2024-04-19T04:25:35.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1570000000000002e-06 2024-04-19T04:25:35.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229531+0000", 2024-04-19T04:25:35.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018962339999999999 2024-04-19T04:25:35.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:35.356 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229662+0000", 2024-04-19T04:25:35.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013192999999999999 2024-04-19T04:25:35.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:35.356 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275915+0000", 2024-04-19T04:25:35.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046252140999999997 2024-04-19T04:25:35.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:35.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275944+0000", 2024-04-19T04:25:35.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9539999999999998e-05 2024-04-19T04:25:35.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.357 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275999+0000", 2024-04-19T04:25:35.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5062999999999998e-05 2024-04-19T04:25:35.357 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.357 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.357 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.358 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:35.358 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:35.358 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 6.0336583499999996, 2024-04-19T04:25:35.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:25:35.358 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.358 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:35.358 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:35.358 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:35.358 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:35.358 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:25:35.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.358 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.359 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.359 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.359 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:35.359 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.359 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.359 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.359 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:35.359 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.359 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.359 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.359 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:35.359 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:35.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.360 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:25:35.360 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:25:35.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.360 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:25:35.360 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:25:35.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:25:35.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:25:35.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:25:35.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:25:35.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:35.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:25:35.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:25:35.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:35.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:25:35.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:25:35.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.362 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:35.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:25:35.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:25:35.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.362 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:25:35.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:25:35.362 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.362 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.363 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.363 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.363 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.363 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:35.363 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:35.363 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 6.03306407, 2024-04-19T04:25:35.363 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:25:35.363 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.363 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:35.363 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:35.364 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:35.364 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:35.364 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:25:35.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.364 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.364 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.364 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.364 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:35.364 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:35.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:25:35.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:35.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:25:35.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:25:35.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:25:35.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:25:35.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:25:35.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:25:35.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.367 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:25:35.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:25:35.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:35.367 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:25:35.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:25:35.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:35.367 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:25:35.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:25:35.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:35.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:25:35.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:25:35.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:35.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:25:35.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:25:35.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:35.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:25:35.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:25:35.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:25:35.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:25:35.369 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.369 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.369 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.370 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93744 5.1 5:87b91c25:::benchmark_data_smithi007_19526_object93743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:35.370 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:35.370 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 6.0293945190000002, 2024-04-19T04:25:35.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044295022000000003, 2024-04-19T04:25:35.370 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:35.370 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:35.370 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:35.370 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:35.370 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:35.370 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93744 2024-04-19T04:25:35.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.371 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:35.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:35.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:35.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:35.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:35.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:35.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:35.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231905+0000", 2024-04-19T04:25:35.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:35.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:35.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231935+0000", 2024-04-19T04:25:35.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9442e-05 2024-04-19T04:25:35.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:35.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264224+0000", 2024-04-19T04:25:35.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.032288836000000001 2024-04-19T04:25:35.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:35.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264238+0000", 2024-04-19T04:25:35.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4494999999999999e-05 2024-04-19T04:25:35.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:35.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268311+0000", 2024-04-19T04:25:35.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040726629999999998 2024-04-19T04:25:35.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:35.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268587+0000", 2024-04-19T04:25:35.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00027623200000000001 2024-04-19T04:25:35.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:35.374 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276099+0000", 2024-04-19T04:25:35.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075116180000000003 2024-04-19T04:25:35.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:35.374 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276123+0000", 2024-04-19T04:25:35.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4675e-05 2024-04-19T04:25:35.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:35.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:35.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:35.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276201+0000", 2024-04-19T04:25:35.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7836000000000005e-05 2024-04-19T04:25:35.375 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.375 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.375 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.375 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:35.375 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:35.375 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:35.377 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:35.377 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:35.378 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:35.378 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:35.377+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:35.378 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:35.379 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:35.379 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:35.379 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:35.380 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:35.477 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:35.477+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:35.505 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:35.505 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:35.519 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:35.578 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:35.578+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:35.640 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:35.640 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:35.652 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:35.679 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:35.677+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:35.756 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 51 16 107217 107201 131.358 129.562 0.00585587 0.00760707 2024-04-19T04:25:35.777 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:35.777 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:35.780 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:35.778+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:35.789 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:35.881 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:35.881+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:35.927 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:35.927 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:35.940 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:35.982 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:35.982+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:36.069 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:36.070 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:36.083 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:36.084 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:36.082+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:36.153 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T04:25:36.185 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:36.182+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:36.219 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:36.219 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:36.231 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:36.286 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:36.285+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:36.354 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:36.354 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:36.367 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:36.387 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:36.385+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:36.488 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:36.488 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:36.488 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:36.485+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:36.499 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:36.588 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:36.585+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:36.628 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:36.628 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:36.640 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:36.689 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:36.685+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:36.756 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 52 16 109264 109248 131.292 127.938 0.0109258 0.0076109 2024-04-19T04:25:36.771 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:36.771 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:36.786 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:36.789 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:36.789+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:36.890 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:36.889+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:36.923 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:36.923 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:36.937 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:36.991 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:36.989+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:37.065 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-04-19T04:25:37.066 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:37.066 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:37.079 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:37.126 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:37.125+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:37.194 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:37.193+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:37.203 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:37.203 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:37.217 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:37.295 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:37.293+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:37.339 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:37.339 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:37.352 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:37.381 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:25:37.399 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:37.397+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:37.500 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:37.497+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:37.523 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:37.523 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:37.535 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:37.539 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:37.562 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:37.562 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:37.562 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:37.562 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:37.566 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:37.567 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:37.603 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:37.601+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:37.662 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:37.662 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:37.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.662 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:111143 5.d 5:b660ca8b:::benchmark_data_smithi007_19526_object111142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:37.663 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:37.657422+0000", 2024-04-19T04:25:37.663 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.005287005, 2024-04-19T04:25:37.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0053060290000000003, 2024-04-19T04:25:37.663 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:37.663 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:37.663 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:37.663 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:37.663 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:37.663 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 111143 2024-04-19T04:25:37.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.663 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:37.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:37.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.657422+0000", 2024-04-19T04:25:37.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:37.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.657422+0000", 2024-04-19T04:25:37.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:37.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.657421+0000", 2024-04-19T04:25:37.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:37.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:37.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.657472+0000", 2024-04-19T04:25:37.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0933999999999997e-05 2024-04-19T04:25:37.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:37.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.657483+0000", 2024-04-19T04:25:37.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1036000000000001e-05 2024-04-19T04:25:37.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:37.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.657488+0000", 2024-04-19T04:25:37.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1610000000000002e-06 2024-04-19T04:25:37.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:37.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658504+0000", 2024-04-19T04:25:37.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0010158190000000001 2024-04-19T04:25:37.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:37.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658591+0000", 2024-04-19T04:25:37.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7001000000000003e-05 2024-04-19T04:25:37.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:37.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658674+0000", 2024-04-19T04:25:37.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2915000000000002e-05 2024-04-19T04:25:37.667 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.667 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:37.667 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.667 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:111144 5.d 5:b95504af:::benchmark_data_smithi007_19526_object111143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:37.667 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:37.657921+0000", 2024-04-19T04:25:37.667 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0047878490000000003, 2024-04-19T04:25:37.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0048569040000000004, 2024-04-19T04:25:37.667 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:37.667 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:37.667 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:37.667 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:37.667 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:37.667 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 111144 2024-04-19T04:25:37.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.668 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:37.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:37.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.657921+0000", 2024-04-19T04:25:37.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:37.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.657921+0000", 2024-04-19T04:25:37.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:37.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.657920+0000", 2024-04-19T04:25:37.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:37.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:37.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.657981+0000", 2024-04-19T04:25:37.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0538999999999998e-05 2024-04-19T04:25:37.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:37.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.657995+0000", 2024-04-19T04:25:37.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3784999999999999e-05 2024-04-19T04:25:37.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:37.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658001+0000", 2024-04-19T04:25:37.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0240000000000003e-06 2024-04-19T04:25:37.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:37.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.659968+0000", 2024-04-19T04:25:37.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0019674900000000001 2024-04-19T04:25:37.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:37.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.660056+0000", 2024-04-19T04:25:37.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7696999999999997e-05 2024-04-19T04:25:37.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:37.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.660132+0000", 2024-04-19T04:25:37.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6551999999999995e-05 2024-04-19T04:25:37.671 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.671 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:37.671 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.671 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:111146 5.d 5:b0e32239:::benchmark_data_smithi007_19526_object111145:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:37.671 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:37.658283+0000", 2024-04-19T04:25:37.671 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0044263829999999999, 2024-04-19T04:25:37.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0045373599999999998, 2024-04-19T04:25:37.672 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:37.672 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:37.672 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:37.672 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:37.672 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:37.672 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 111146 2024-04-19T04:25:37.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.672 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:37.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:37.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658283+0000", 2024-04-19T04:25:37.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:37.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658283+0000", 2024-04-19T04:25:37.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:37.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658282+0000", 2024-04-19T04:25:37.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:37.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:37.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658400+0000", 2024-04-19T04:25:37.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011790699999999999 2024-04-19T04:25:37.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.674 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:37.674 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658409+0000", 2024-04-19T04:25:37.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.8540000000000003e-06 2024-04-19T04:25:37.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.674 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:37.674 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658416+0000", 2024-04-19T04:25:37.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9269999999999999e-06 2024-04-19T04:25:37.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.674 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:37.674 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.661527+0000", 2024-04-19T04:25:37.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031111419999999999 2024-04-19T04:25:37.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:37.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.661606+0000", 2024-04-19T04:25:37.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9307999999999994e-05 2024-04-19T04:25:37.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:37.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.661698+0000", 2024-04-19T04:25:37.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1681999999999994e-05 2024-04-19T04:25:37.675 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.675 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:37.675 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.676 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:111148 5.d 5.c02f1efd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:37.676 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:37.658563+0000", 2024-04-19T04:25:37.676 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.004145826, 2024-04-19T04:25:37.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042993399999999996, 2024-04-19T04:25:37.676 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:37.676 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:37.676 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:37.676 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:37.676 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:37.676 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 111148 2024-04-19T04:25:37.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.676 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:37.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:37.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658563+0000", 2024-04-19T04:25:37.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:37.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658563+0000", 2024-04-19T04:25:37.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:37.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658562+0000", 2024-04-19T04:25:37.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:37.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:37.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658649+0000", 2024-04-19T04:25:37.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7151000000000006e-05 2024-04-19T04:25:37.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:37.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658663+0000", 2024-04-19T04:25:37.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3224000000000001e-05 2024-04-19T04:25:37.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:37.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658667+0000", 2024-04-19T04:25:37.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5240000000000002e-06 2024-04-19T04:25:37.679 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.679 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:37.679 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.679 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:111149 5.3 5:ce60d7c7:::benchmark_data_smithi007_19526_object111148:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:37.679 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:37.658812+0000", 2024-04-19T04:25:37.679 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0038972759999999999, 2024-04-19T04:25:37.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040828829999999998, 2024-04-19T04:25:37.679 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:37.679 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:37.679 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:37.679 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:37.680 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:37.680 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 111149 2024-04-19T04:25:37.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.680 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:37.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:37.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658812+0000", 2024-04-19T04:25:37.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:37.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658812+0000", 2024-04-19T04:25:37.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:37.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658811+0000", 2024-04-19T04:25:37.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:37.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:37.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658845+0000", 2024-04-19T04:25:37.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4093e-05 2024-04-19T04:25:37.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:37.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658856+0000", 2024-04-19T04:25:37.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0766e-05 2024-04-19T04:25:37.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:37.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658862+0000", 2024-04-19T04:25:37.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.815e-06 2024-04-19T04:25:37.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:37.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.658928+0000", 2024-04-19T04:25:37.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6073000000000002e-05 2024-04-19T04:25:37.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:37.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.659039+0000", 2024-04-19T04:25:37.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000110126 2024-04-19T04:25:37.683 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.683 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:37.683 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.683 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:111150 5.5 5:a298a01e:::benchmark_data_smithi007_19526_object111149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:37.683 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:37.659142+0000", 2024-04-19T04:25:37.683 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0035668620000000001, 2024-04-19T04:25:37.683 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0037901279999999998, 2024-04-19T04:25:37.683 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:37.683 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:37.683 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:37.683 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:37.683 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:37.684 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 111150 2024-04-19T04:25:37.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.684 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:37.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.684 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:37.684 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.659142+0000", 2024-04-19T04:25:37.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.684 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:37.684 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.659142+0000", 2024-04-19T04:25:37.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:37.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.659141+0000", 2024-04-19T04:25:37.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:37.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:37.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.659242+0000", 2024-04-19T04:25:37.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000100506 2024-04-19T04:25:37.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:37.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.659250+0000", 2024-04-19T04:25:37.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0139999999999998e-06 2024-04-19T04:25:37.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.686 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:37.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.659256+0000", 2024-04-19T04:25:37.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.993e-06 2024-04-19T04:25:37.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.686 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:37.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.662897+0000", 2024-04-19T04:25:37.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0036411220000000001 2024-04-19T04:25:37.686 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.686 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:37.686 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.687 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:111151 5.6 5:637a0232:::benchmark_data_smithi007_19526_object111150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:37.687 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:37.659404+0000", 2024-04-19T04:25:37.687 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0033053560000000002, 2024-04-19T04:25:37.687 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0035642769999999998, 2024-04-19T04:25:37.687 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:37.687 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:37.687 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:37.687 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:37.687 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:37.687 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 111151 2024-04-19T04:25:37.687 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.687 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:37.687 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.687 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:37.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.659404+0000", 2024-04-19T04:25:37.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:37.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.659404+0000", 2024-04-19T04:25:37.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:37.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.659403+0000", 2024-04-19T04:25:37.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:37.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:37.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.659502+0000", 2024-04-19T04:25:37.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8781000000000002e-05 2024-04-19T04:25:37.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:37.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.659510+0000", 2024-04-19T04:25:37.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8010000000000004e-06 2024-04-19T04:25:37.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:37.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.659513+0000", 2024-04-19T04:25:37.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7560000000000001e-06 2024-04-19T04:25:37.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.690 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:37.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.659563+0000", 2024-04-19T04:25:37.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9193999999999997e-05 2024-04-19T04:25:37.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.690 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:37.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.659702+0000", 2024-04-19T04:25:37.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013930799999999999 2024-04-19T04:25:37.690 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.690 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:37.690 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.691 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.691 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:111154 5.d 5.52d0095d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:37.691 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:37.662231+0000", 2024-04-19T04:25:37.691 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00047836599999999998, 2024-04-19T04:25:37.691 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00077375600000000001, 2024-04-19T04:25:37.691 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:37.691 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:37.691 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:37.691 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:37.691 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:37.691 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 111154 2024-04-19T04:25:37.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.691 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:37.691 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.691 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:37.692 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.662231+0000", 2024-04-19T04:25:37.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.692 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.692 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:37.692 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.662231+0000", 2024-04-19T04:25:37.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.692 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.692 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:37.692 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.662230+0000", 2024-04-19T04:25:37.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:37.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.692 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.693 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:37.693 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.662367+0000", 2024-04-19T04:25:37.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000136976 2024-04-19T04:25:37.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.693 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:37.693 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.662378+0000", 2024-04-19T04:25:37.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0913e-05 2024-04-19T04:25:37.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.693 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:37.693 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.662383+0000", 2024-04-19T04:25:37.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3329999999999996e-06 2024-04-19T04:25:37.693 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.694 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:37.694 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.694 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.694 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.694 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:111135 5.d 5:b7a494da:::benchmark_data_smithi007_19526_object111134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:37.694 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:37.653264+0000", 2024-04-19T04:25:37.694 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0094447379999999994, 2024-04-19T04:25:37.694 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0097727170000000002, 2024-04-19T04:25:37.694 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:37.694 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:37.694 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:37.694 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:37.694 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:37.694 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 111135 2024-04-19T04:25:37.694 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.695 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:37.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.695 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:37.695 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.653264+0000", 2024-04-19T04:25:37.695 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.695 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:37.695 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.653264+0000", 2024-04-19T04:25:37.695 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.695 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:37.695 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.653263+0000", 2024-04-19T04:25:37.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:37.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:37.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.653384+0000", 2024-04-19T04:25:37.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000120908 2024-04-19T04:25:37.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:37.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.653397+0000", 2024-04-19T04:25:37.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.313e-05 2024-04-19T04:25:37.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:37.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.653406+0000", 2024-04-19T04:25:37.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9760000000000001e-06 2024-04-19T04:25:37.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:37.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.653449+0000", 2024-04-19T04:25:37.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2892000000000002e-05 2024-04-19T04:25:37.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:37.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.653582+0000", 2024-04-19T04:25:37.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000132939 2024-04-19T04:25:37.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:37.698 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.653723+0000", 2024-04-19T04:25:37.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000140968 2024-04-19T04:25:37.698 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.698 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:37.698 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.698 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.698 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:111142 5.d 5:bbaccad9:::benchmark_data_smithi007_19526_object111141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:37.698 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:37.656387+0000", 2024-04-19T04:25:37.698 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0063219280000000001, 2024-04-19T04:25:37.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0066905020000000001, 2024-04-19T04:25:37.698 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:37.698 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:37.698 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:37.699 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:37.699 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:37.699 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 111142 2024-04-19T04:25:37.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.699 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:37.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.699 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:37.699 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.656387+0000", 2024-04-19T04:25:37.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.699 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:37.699 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.656387+0000", 2024-04-19T04:25:37.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.700 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:37.700 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.656386+0000", 2024-04-19T04:25:37.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:37.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.700 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:37.700 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.656473+0000", 2024-04-19T04:25:37.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7396000000000001e-05 2024-04-19T04:25:37.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.700 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:37.700 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.656482+0000", 2024-04-19T04:25:37.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6500000000000002e-06 2024-04-19T04:25:37.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:37.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.656488+0000", 2024-04-19T04:25:37.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8590000000000001e-06 2024-04-19T04:25:37.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:37.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.656519+0000", 2024-04-19T04:25:37.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1316999999999998e-05 2024-04-19T04:25:37.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:37.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.656639+0000", 2024-04-19T04:25:37.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000119758 2024-04-19T04:25:37.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:37.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:37.656714+0000", 2024-04-19T04:25:37.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5279999999999998e-05 2024-04-19T04:25:37.702 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.702 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:37.702 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.702 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:37.702 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:37.702 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 10 2024-04-19T04:25:37.702 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:37.704 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:37.704 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:37.701+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:37.756 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 53 16 111341 111325 131.264 129.812 0.0113029 0.00761259 2024-04-19T04:25:37.807 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:37.805+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:37.837 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:37.837 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:37.837 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:37.837 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:37.838 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:37.851 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:37.908 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:37.905+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:37.994 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:37.995 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:37.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:37.995 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:37.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.995 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:37.995 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:37.995 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.761285344999997, 2024-04-19T04:25:37.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:37.995 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:37.995 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:37.995 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:37.995 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:37.995 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:37.996 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:37.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.996 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:37.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:37.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:37.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:37.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:37.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:37.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.999 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:37.999 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:37.999 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:37.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:37.999 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:37.999 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:37.999 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:37.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:37.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.000 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:38.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:38.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.000 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.000 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:38.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:38.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.000 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:38.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:38.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:38.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:38.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:38.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:38.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:38.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:38.002 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:38.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:38.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:38.002 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:38.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:38.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:38.003 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:38.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:38.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.003 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.003 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:38.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:38.003 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.003 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.003 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.003 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:38.003 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:38.004 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.758104189000001, 2024-04-19T04:25:38.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:38.004 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.004 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.004 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.004 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.004 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.004 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:38.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.004 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:38.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:38.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:38.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.007 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.007 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:38.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:38.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.007 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.007 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:38.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:38.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.007 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.007 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:38.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:38.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:38.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:38.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:38.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:38.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:38.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:38.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:38.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:38.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:38.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:38.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:38.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:38.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:38.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:38.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:38.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:38.010 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.010 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.010 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.010 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:38.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:38.010 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.010 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.010 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.010 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.010 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.010 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:38.010 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:38.010 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.757536084999998, 2024-04-19T04:25:38.011 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:38.011 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.011 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.011 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.011 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.011 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.011 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:38.014 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.014 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.014 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:38.014 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:38.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.015 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:38.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:38.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.015 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:38.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:38.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:38.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:38.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:38.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:38.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:38.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:38.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.017 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.017 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:38.017 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:38.017 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:38.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.017 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.017 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.017 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:38.017 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:38.017 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.017 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.017 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.018 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.018 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:38.018 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:38.018 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.757190424000001, 2024-04-19T04:25:38.018 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:38.018 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.018 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.018 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.018 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.018 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.018 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:38.018 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.018 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.018 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.019 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.019 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:38.019 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.019 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.019 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.019 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:38.019 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.019 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.019 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.019 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:38.019 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.020 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.020 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.020 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:38.020 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:38.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.020 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.020 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.020 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:38.020 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:38.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.020 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.020 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.020 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:38.020 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:38.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.021 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.021 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:38.021 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:38.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.021 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.021 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:38.021 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:38.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.021 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:38.021 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:38.022 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:38.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.022 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:38.022 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:38.022 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:38.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.022 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:38.022 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:38.022 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:38.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.023 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:38.023 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:38.023 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:38.023 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.023 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.023 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.023 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:38.023 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:38.023 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.023 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.023 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.023 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.023 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.023 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:38.023 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:38.024 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.756465986000002, 2024-04-19T04:25:38.024 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:38.024 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.024 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.024 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.024 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.024 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.024 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:38.024 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.024 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.024 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.024 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.024 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:38.024 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:38.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:38.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:38.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:38.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:38.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.026 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.026 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.026 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:38.026 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:38.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.026 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.026 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.026 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:38.026 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:38.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.026 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.026 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.026 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:38.027 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:38.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.027 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.027 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:38.027 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:38.027 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:38.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.027 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.027 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.027 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:38.027 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:38.027 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.027 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.028 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.028 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.028 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.028 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:38.028 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:38.028 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.756458590999998, 2024-04-19T04:25:38.028 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:38.028 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.028 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.028 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.028 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.028 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.028 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:38.028 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.029 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.029 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.029 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:38.029 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.029 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.029 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.029 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:38.029 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.029 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.029 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.029 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:38.030 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:38.030 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.030 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.030 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.030 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:38.030 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:38.030 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.030 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.031 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.031 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:38.031 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:38.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.031 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.031 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.031 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:38.031 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:38.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.031 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.031 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.031 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:38.031 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:38.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.032 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.032 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:38.032 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:38.032 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:38.032 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.032 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.032 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.032 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:38.032 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:38.032 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.032 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.032 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.033 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.033 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:38.033 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:38.033 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.754633444, 2024-04-19T04:25:38.033 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:38.033 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.033 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.033 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.033 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.033 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.033 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:38.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.033 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.033 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.034 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.034 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:38.034 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.034 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.034 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.034 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:38.034 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.034 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.034 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.034 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:38.034 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.035 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.035 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.035 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:38.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:38.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.035 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.035 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.035 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:38.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:38.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.035 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.035 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.035 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:38.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:38.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.036 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.036 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.036 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:38.036 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:38.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.036 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.036 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.036 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:38.036 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:38.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.036 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.036 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:38.036 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:38.036 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:38.037 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.037 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.038 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:38.038 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:38.038 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:38.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.038 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.038 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:38.038 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:38.038 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:38.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.038 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.038 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:38.038 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:38.038 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:38.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.039 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.039 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.039 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:38.039 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:38.039 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.039 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.039 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.039 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.039 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:38.039 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:38.039 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.753899238999999, 2024-04-19T04:25:38.039 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:38.039 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.039 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.040 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.040 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.040 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.040 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:38.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.040 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.040 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.040 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.040 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:38.040 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.040 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.040 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.041 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:38.041 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.041 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.041 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.041 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:38.041 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.041 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.041 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.041 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:38.041 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:38.041 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.041 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.042 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:38.042 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:38.042 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.042 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.042 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.042 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:38.042 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:38.042 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.042 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.042 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.042 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:38.043 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:38.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.043 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.043 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.043 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:38.043 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:38.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.043 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.043 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:38.043 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:38.043 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:38.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.044 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.044 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:38.044 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:38.044 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:38.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.044 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.044 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:38.044 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:38.044 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:38.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.044 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.044 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:38.044 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:38.045 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:38.045 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.045 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.045 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.045 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:38.045 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:38.045 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.045 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.045 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.045 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.045 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.045 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:38.045 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:38.046 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.753364963000003, 2024-04-19T04:25:38.046 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:38.046 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.046 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.046 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.046 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.046 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.046 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:38.046 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.046 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.046 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.046 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.046 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:38.046 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.047 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.047 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.047 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.047 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:38.047 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.047 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.047 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.047 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.047 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:38.047 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:38.047 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.047 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.047 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.047 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:38.047 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:38.048 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.048 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.048 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.048 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:38.048 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:38.048 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.048 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.048 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.048 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:38.048 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:38.048 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.048 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.048 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.048 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:38.049 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:38.049 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.049 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.049 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:38.049 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:38.049 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:38.049 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.049 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.049 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.049 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:38.049 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:38.049 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.049 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.049 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.049 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.050 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.050 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:38.050 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:38.050 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.036509773999999, 2024-04-19T04:25:38.050 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:38.050 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.050 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:38.050 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.050 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.050 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.050 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:38.050 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.050 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.050 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.051 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.051 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:38.051 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.051 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.051 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.051 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.051 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:38.051 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.051 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.051 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.051 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.051 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:38.051 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.051 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.051 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.052 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.052 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:38.052 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:38.052 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.052 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.052 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.052 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:38.052 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:38.052 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.052 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.052 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.052 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:38.052 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:38.052 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.052 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.053 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.053 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:38.053 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:38.053 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.053 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.053 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.053 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:38.053 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:38.053 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.053 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.053 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:38.053 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:38.053 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:38.053 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.053 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.054 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:38.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:38.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:38.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.054 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.054 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:38.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:38.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.054 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.054 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:38.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:38.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:38.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:38.056 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:38.056 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.016279324999999, 2024-04-19T04:25:38.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:38.056 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.056 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:38.056 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.056 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.056 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.056 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:38.056 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.056 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.056 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.056 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:38.057 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.057 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.057 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:38.057 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.057 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.057 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:38.057 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:38.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.057 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.058 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:38.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:38.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.058 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.058 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:38.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:38.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.058 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.058 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:38.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:38.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.058 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.059 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:38.059 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:38.059 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.059 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.059 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:38.059 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:38.059 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:38.059 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.059 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.059 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.059 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:38.059 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:38.059 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.059 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.060 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.060 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:38.060 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:38.060 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.060 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.060 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.060 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.060 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.060 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:38.060 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:38.060 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.016171468, 2024-04-19T04:25:38.060 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:38.060 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.060 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:38.061 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.061 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.061 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.061 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:38.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.061 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.061 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:38.061 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:38.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:38.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:38.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:38.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:38.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:38.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:38.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:38.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:38.064 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:38.064 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.064 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.064 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:38.064 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:38.064 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:38.064 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.064 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.064 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.064 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:38.064 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:38.064 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.064 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.064 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.064 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:38.065 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:38.065 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.065 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.065 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.065 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.065 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.065 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:38.065 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:38.065 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.014204779, 2024-04-19T04:25:38.065 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:38.065 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.065 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.065 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.065 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.065 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.066 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:38.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.066 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.066 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.066 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:38.066 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.066 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.066 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:38.066 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:38.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:38.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:38.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:38.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:38.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:38.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.068 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.068 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:38.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:38.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.068 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.068 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:38.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:38.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.068 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:38.068 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:38.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:38.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:38.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:38.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:38.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:38.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:38.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:38.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:38.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.070 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:38.070 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:38.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:38.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.070 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.070 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:38.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:38.070 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.070 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.070 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.071 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:38.071 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:38.071 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.010840584, 2024-04-19T04:25:38.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:38.071 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.071 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.071 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.071 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.071 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.071 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:38.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.071 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:38.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:38.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:38.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:38.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:38.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:38.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:38.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:38.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:38.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:38.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:38.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:38.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:38.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:38.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:38.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:38.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:38.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:38.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:38.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:38.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:38.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.076 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:38.076 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:38.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:38.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.076 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.076 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:38.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:38.076 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.076 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.076 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.076 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:38.076 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:38.077 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.007029606, 2024-04-19T04:25:38.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:38.077 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.077 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.077 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.077 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.077 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.077 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:38.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.077 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:38.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:38.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:38.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:38.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:38.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:38.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:38.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:38.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:38.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:38.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:38.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:38.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:38.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:38.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:38.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:38.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:38.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:38.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.081 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.081 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:38.081 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:38.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:38.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.081 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.081 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:38.081 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:38.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:38.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.081 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.081 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.081 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:38.082 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:38.082 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.082 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.082 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.082 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.082 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.082 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93735 5.1 5:8e609d1b:::benchmark_data_smithi007_19526_object93734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:38.082 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:38.082 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.7653289619999999, 2024-04-19T04:25:38.082 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048424842000000003, 2024-04-19T04:25:38.082 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.082 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.082 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.082 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.082 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.083 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93735 2024-04-19T04:25:38.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.083 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:38.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:38.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227480+0000", 2024-04-19T04:25:38.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227533+0000", 2024-04-19T04:25:38.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2964999999999999e-05 2024-04-19T04:25:38.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227542+0000", 2024-04-19T04:25:38.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1449999999999997e-06 2024-04-19T04:25:38.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227561+0000", 2024-04-19T04:25:38.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9116000000000001e-05 2024-04-19T04:25:38.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227610+0000", 2024-04-19T04:25:38.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9234000000000003e-05 2024-04-19T04:25:38.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227697+0000", 2024-04-19T04:25:38.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6682999999999997e-05 2024-04-19T04:25:38.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.086 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:38.086 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275809+0000", 2024-04-19T04:25:38.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048112265000000001 2024-04-19T04:25:38.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.086 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:38.086 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275845+0000", 2024-04-19T04:25:38.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5275999999999999e-05 2024-04-19T04:25:38.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.086 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.086 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275906+0000", 2024-04-19T04:25:38.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1002999999999999e-05 2024-04-19T04:25:38.087 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.087 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.087 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.087 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93736 5.1 5:852229ec:::benchmark_data_smithi007_19526_object93735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:38.087 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:38.087 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.7652249320000006, 2024-04-19T04:25:38.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048414497000000001, 2024-04-19T04:25:38.087 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.087 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.087 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.087 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.087 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.087 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93736 2024-04-19T04:25:38.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.088 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:38.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:38.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227584+0000", 2024-04-19T04:25:38.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227624+0000", 2024-04-19T04:25:38.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9833000000000003e-05 2024-04-19T04:25:38.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227630+0000", 2024-04-19T04:25:38.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0759999999999999e-06 2024-04-19T04:25:38.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.090 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227634+0000", 2024-04-19T04:25:38.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1570000000000002e-06 2024-04-19T04:25:38.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.090 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229531+0000", 2024-04-19T04:25:38.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018962339999999999 2024-04-19T04:25:38.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.090 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229662+0000", 2024-04-19T04:25:38.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013192999999999999 2024-04-19T04:25:38.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:38.091 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275915+0000", 2024-04-19T04:25:38.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046252140999999997 2024-04-19T04:25:38.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:38.091 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275944+0000", 2024-04-19T04:25:38.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9539999999999998e-05 2024-04-19T04:25:38.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.092 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275999+0000", 2024-04-19T04:25:38.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5062999999999998e-05 2024-04-19T04:25:38.092 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.092 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.092 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.092 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:38.092 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:38.092 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.7651672489999992, 2024-04-19T04:25:38.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:25:38.093 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.093 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.093 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.093 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.093 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.093 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:25:38.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.093 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:38.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:38.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:38.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:25:38.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:25:38.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:25:38.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:25:38.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:25:38.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:25:38.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:25:38.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:25:38.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:25:38.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:25:38.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:38.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:25:38.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:25:38.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:38.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:25:38.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:25:38.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:25:38.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:25:38.097 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.097 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.097 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.097 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:38.097 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:38.097 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.7645729689999996, 2024-04-19T04:25:38.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:25:38.098 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.098 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.098 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.098 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.098 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.098 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:25:38.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.098 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:38.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:38.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:25:38.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:25:38.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:25:38.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:25:38.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:25:38.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:25:38.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:25:38.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:25:38.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:25:38.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:25:38.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:25:38.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:38.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:25:38.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:25:38.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:38.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:25:38.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:25:38.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:38.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:25:38.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:25:38.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:38.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:25:38.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:25:38.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:25:38.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:25:38.103 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.103 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.103 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.103 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93744 5.1 5:87b91c25:::benchmark_data_smithi007_19526_object93743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:38.103 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:38.103 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.7609034179999998, 2024-04-19T04:25:38.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044295022000000003, 2024-04-19T04:25:38.103 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.103 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.103 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.103 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.103 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.104 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93744 2024-04-19T04:25:38.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.104 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:38.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:38.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231905+0000", 2024-04-19T04:25:38.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231935+0000", 2024-04-19T04:25:38.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9442e-05 2024-04-19T04:25:38.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264224+0000", 2024-04-19T04:25:38.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.032288836000000001 2024-04-19T04:25:38.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264238+0000", 2024-04-19T04:25:38.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4494999999999999e-05 2024-04-19T04:25:38.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268311+0000", 2024-04-19T04:25:38.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040726629999999998 2024-04-19T04:25:38.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268587+0000", 2024-04-19T04:25:38.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00027623200000000001 2024-04-19T04:25:38.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:38.107 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276099+0000", 2024-04-19T04:25:38.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075116180000000003 2024-04-19T04:25:38.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.107 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:38.107 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276123+0000", 2024-04-19T04:25:38.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4675e-05 2024-04-19T04:25:38.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.107 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:38.107 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276201+0000", 2024-04-19T04:25:38.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7836000000000005e-05 2024-04-19T04:25:38.108 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.108 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.108 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.108 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.108 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.108 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:38.110 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:38.110 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:38.109+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:38.214 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:38.209+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:38.237 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:38.237 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:38.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.237 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:112285 5.4 5:28e2e6a7:::benchmark_data_smithi007_19526_object112284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.237 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:38.232678+0000", 2024-04-19T04:25:38.237 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0049326730000000003, 2024-04-19T04:25:38.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004960842, 2024-04-19T04:25:38.238 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.238 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:38.238 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.238 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.238 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.238 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 112285 2024-04-19T04:25:38.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.238 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.232678+0000", 2024-04-19T04:25:38.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.232678+0000", 2024-04-19T04:25:38.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.232677+0000", 2024-04-19T04:25:38.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.232741+0000", 2024-04-19T04:25:38.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4098999999999997e-05 2024-04-19T04:25:38.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.232755+0000", 2024-04-19T04:25:38.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3946e-05 2024-04-19T04:25:38.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.232763+0000", 2024-04-19T04:25:38.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2859999999999999e-06 2024-04-19T04:25:38.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.232809+0000", 2024-04-19T04:25:38.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5974999999999999e-05 2024-04-19T04:25:38.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.232981+0000", 2024-04-19T04:25:38.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017207999999999999 2024-04-19T04:25:38.241 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.241 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.241 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.241 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:112286 5.e 5:7af5d9e6:::benchmark_data_smithi007_19526_object112285:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.241 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:38.232821+0000", 2024-04-19T04:25:38.241 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0047896739999999998, 2024-04-19T04:25:38.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048971570000000001, 2024-04-19T04:25:38.241 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.242 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:38.242 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.242 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.242 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.242 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 112286 2024-04-19T04:25:38.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.242 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.232821+0000", 2024-04-19T04:25:38.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.232821+0000", 2024-04-19T04:25:38.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.232820+0000", 2024-04-19T04:25:38.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.232897+0000", 2024-04-19T04:25:38.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7317999999999994e-05 2024-04-19T04:25:38.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.232941+0000", 2024-04-19T04:25:38.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3936000000000001e-05 2024-04-19T04:25:38.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.232947+0000", 2024-04-19T04:25:38.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2060000000000004e-06 2024-04-19T04:25:38.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.233068+0000", 2024-04-19T04:25:38.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012063200000000001 2024-04-19T04:25:38.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.233197+0000", 2024-04-19T04:25:38.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012923599999999999 2024-04-19T04:25:38.245 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.245 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.245 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.245 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:112287 5.a 5:547489a0:::benchmark_data_smithi007_19526_object112286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.245 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:38.232963+0000", 2024-04-19T04:25:38.245 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.004647717, 2024-04-19T04:25:38.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048243929999999997, 2024-04-19T04:25:38.245 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.245 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:38.246 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.246 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.246 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.246 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 112287 2024-04-19T04:25:38.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.246 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.232963+0000", 2024-04-19T04:25:38.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.232963+0000", 2024-04-19T04:25:38.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.232962+0000", 2024-04-19T04:25:38.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.232997+0000", 2024-04-19T04:25:38.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4817000000000002e-05 2024-04-19T04:25:38.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.233007+0000", 2024-04-19T04:25:38.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0192e-05 2024-04-19T04:25:38.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.233014+0000", 2024-04-19T04:25:38.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3300000000000001e-06 2024-04-19T04:25:38.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235084+0000", 2024-04-19T04:25:38.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002069736 2024-04-19T04:25:38.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235255+0000", 2024-04-19T04:25:38.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017129499999999999 2024-04-19T04:25:38.249 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.249 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.249 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.249 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:112288 5.f e46/20 5:f71dd3e8:::benchmark_data_smithi007_19526_object112287:head v 46'6863, mlcod=46'6859)", 2024-04-19T04:25:38.249 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:38.234615+0000", 2024-04-19T04:25:38.249 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0029949629999999998, 2024-04-19T04:25:38.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032345609999999999, 2024-04-19T04:25:38.249 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.249 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:38.249 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.234615+0000", 2024-04-19T04:25:38.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.234615+0000", 2024-04-19T04:25:38.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.234615+0000", 2024-04-19T04:25:38.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.234670+0000", 2024-04-19T04:25:38.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4936999999999999e-05 2024-04-19T04:25:38.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.234690+0000", 2024-04-19T04:25:38.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0055999999999999e-05 2024-04-19T04:25:38.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.234697+0000", 2024-04-19T04:25:38.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4889999999999998e-06 2024-04-19T04:25:38.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.234904+0000", 2024-04-19T04:25:38.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000206758 2024-04-19T04:25:38.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.234923+0000", 2024-04-19T04:25:38.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9621000000000001e-05 2024-04-19T04:25:38.252 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.252 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.252 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.253 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:112289 5.0 5:0ca8772c:::benchmark_data_smithi007_19526_object112288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.253 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:38.235094+0000", 2024-04-19T04:25:38.253 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002516281, 2024-04-19T04:25:38.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002818428, 2024-04-19T04:25:38.253 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.253 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:38.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.253 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 112289 2024-04-19T04:25:38.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.253 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235094+0000", 2024-04-19T04:25:38.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235094+0000", 2024-04-19T04:25:38.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235093+0000", 2024-04-19T04:25:38.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235142+0000", 2024-04-19T04:25:38.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9208e-05 2024-04-19T04:25:38.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235201+0000", 2024-04-19T04:25:38.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8384000000000002e-05 2024-04-19T04:25:38.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235209+0000", 2024-04-19T04:25:38.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.276e-06 2024-04-19T04:25:38.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235366+0000", 2024-04-19T04:25:38.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015767299999999999 2024-04-19T04:25:38.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235449+0000", 2024-04-19T04:25:38.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2095000000000006e-05 2024-04-19T04:25:38.256 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.256 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.256 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.256 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:112290 5.0 5:0f245b3a:::benchmark_data_smithi007_19526_object112289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.257 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:38.235223+0000", 2024-04-19T04:25:38.257 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0023878179999999999, 2024-04-19T04:25:38.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027567329999999999, 2024-04-19T04:25:38.257 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.257 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:38.257 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.257 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.257 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.257 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 112290 2024-04-19T04:25:38.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.257 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235223+0000", 2024-04-19T04:25:38.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235223+0000", 2024-04-19T04:25:38.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235222+0000", 2024-04-19T04:25:38.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235252+0000", 2024-04-19T04:25:38.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0389999999999999e-05 2024-04-19T04:25:38.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235258+0000", 2024-04-19T04:25:38.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9329999999999998e-06 2024-04-19T04:25:38.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235262+0000", 2024-04-19T04:25:38.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7060000000000002e-06 2024-04-19T04:25:38.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.237373+0000", 2024-04-19T04:25:38.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021108379999999999 2024-04-19T04:25:38.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.237469+0000", 2024-04-19T04:25:38.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6513000000000002e-05 2024-04-19T04:25:38.260 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.260 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.260 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.260 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:112295 5.0 5.71aa6a40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.260 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:38.235662+0000", 2024-04-19T04:25:38.260 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001948233, 2024-04-19T04:25:38.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023791889999999999, 2024-04-19T04:25:38.261 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.261 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:38.261 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.261 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.261 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.261 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 112295 2024-04-19T04:25:38.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.261 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235662+0000", 2024-04-19T04:25:38.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235662+0000", 2024-04-19T04:25:38.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235661+0000", 2024-04-19T04:25:38.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235765+0000", 2024-04-19T04:25:38.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010340699999999999 2024-04-19T04:25:38.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235776+0000", 2024-04-19T04:25:38.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1473e-05 2024-04-19T04:25:38.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235782+0000", 2024-04-19T04:25:38.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1299999999999998e-06 2024-04-19T04:25:38.263 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.263 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.263 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.263 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:112297 5.8 5.f4fab1b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.264 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:38.235813+0000", 2024-04-19T04:25:38.264 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001796925, 2024-04-19T04:25:38.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002282208, 2024-04-19T04:25:38.264 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.264 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:38.264 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.264 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.264 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.264 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 112297 2024-04-19T04:25:38.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.264 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235813+0000", 2024-04-19T04:25:38.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235813+0000", 2024-04-19T04:25:38.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235813+0000", 2024-04-19T04:25:38.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235899+0000", 2024-04-19T04:25:38.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5875e-05 2024-04-19T04:25:38.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235907+0000", 2024-04-19T04:25:38.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6410000000000008e-06 2024-04-19T04:25:38.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:38.235911+0000", 2024-04-19T04:25:38.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0860000000000004e-06 2024-04-19T04:25:38.266 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.266 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.266 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.266 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.267 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:38.267 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 8 2024-04-19T04:25:38.267 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:38.268 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:38.312 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:38.309+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:38.392 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:38.392 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:38.392 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:38.393 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:38.393 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:38.404 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:38.446 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:38.445+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:38.514 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:38.513+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:38.574 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:38.574 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:38.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:38.575 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:38.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.575 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:38.575 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:38.575 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 44.337076433, 2024-04-19T04:25:38.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:38.575 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.575 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.575 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.575 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.575 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.575 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:38.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.576 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:38.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:38.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:38.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:38.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:38.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:38.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:38.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:38.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:38.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:38.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:38.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:38.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:38.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:38.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:38.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:38.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:38.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:38.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:38.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:38.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:38.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:38.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:38.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:38.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:38.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:38.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:38.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:38.580 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.580 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.580 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.580 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:38.580 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:38.580 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 44.332627516999999, 2024-04-19T04:25:38.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:38.581 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.581 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.581 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.581 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.581 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.581 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:38.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.581 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:38.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:38.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:38.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:38.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:38.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:38.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:38.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:38.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:38.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:38.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:38.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:38.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:38.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:38.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:38.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:38.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:38.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:38.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:38.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:38.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:38.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:38.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:38.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:38.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:38.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:38.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:38.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:38.585 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.586 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.586 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.586 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:38.586 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:38.586 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.504695273999999, 2024-04-19T04:25:38.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:38.586 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.586 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.586 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.586 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.586 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.586 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:38.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.587 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:38.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:38.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:38.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:38.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:38.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:38.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:38.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:38.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:38.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:38.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:38.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:38.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:38.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:38.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:38.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:38.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:38.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:38.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:38.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:38.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:38.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:38.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:38.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:38.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:38.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:38.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:38.591 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.591 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.591 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.591 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:38.591 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:38.591 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.068841237000001, 2024-04-19T04:25:38.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:38.592 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.592 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.592 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.592 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.592 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.592 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:38.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.592 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:38.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:38.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:38.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:38.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:38.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:38.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:38.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:38.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:38.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:38.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:38.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:38.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:38.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:38.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:38.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:38.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:38.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:38.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:38.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:38.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:38.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:38.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:38.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:38.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:38.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:38.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:38.596 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.596 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.596 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.597 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:38.597 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:38.597 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.068410817, 2024-04-19T04:25:38.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:38.597 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.597 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.597 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.597 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.597 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.597 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:38.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.597 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:38.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:38.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:38.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:38.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:38.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:38.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:38.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:38.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:38.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:38.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:38.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:38.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:38.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:38.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:38.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:38.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:38.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:38.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:38.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:38.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:38.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:38.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:38.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:38.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:38.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:38.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:38.602 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.602 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.602 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.602 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:38.602 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:38.602 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.066179553000001, 2024-04-19T04:25:38.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:38.602 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.602 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.602 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.603 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.603 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.603 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:38.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.603 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:38.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:38.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:38.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:38.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:38.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:38.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:38.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:38.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:38.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:38.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:38.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:38.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:38.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:38.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:38.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:38.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:38.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:38.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:38.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:38.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:38.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:38.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:38.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:38.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:38.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:38.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:38.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:38.608 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.608 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.608 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.608 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:38.608 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:38.608 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.062782514999999, 2024-04-19T04:25:38.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:38.608 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.608 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.608 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.608 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.609 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.609 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:38.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.609 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:38.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:38.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:38.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:38.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:38.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:38.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:38.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:38.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:38.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:38.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:38.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:38.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:38.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:38.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:38.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:38.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:38.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:38.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:38.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:38.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:38.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:38.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:38.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:38.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:38.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:38.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:38.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:38.613 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.613 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.613 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.614 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:38.614 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:38.614 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.057654317000001, 2024-04-19T04:25:38.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:38.614 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.614 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.614 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.614 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.614 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.614 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:38.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.614 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:38.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:38.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:38.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:38.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:38.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:38.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:38.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:38.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:38.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:38.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:38.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:38.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:38.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:38.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:38.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:38.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:38.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:38.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:38.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:38.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:38.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:38.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:38.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:38.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:38.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:38.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:38.619 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.619 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.619 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.619 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:38.619 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:38.619 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.743625812000001, 2024-04-19T04:25:38.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:38.619 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.619 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.620 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.620 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.620 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.620 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:38.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.620 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:38.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:38.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:38.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:38.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:38.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:38.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:38.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:38.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:38.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:38.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:38.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:38.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:38.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:38.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:38.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:38.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:38.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:38.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:38.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:38.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:38.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:38.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:38.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:38.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:38.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:38.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:38.624 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.624 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.624 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.625 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:38.625 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:38.625 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.621266402, 2024-04-19T04:25:38.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:25:38.625 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.625 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:38.625 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.625 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.625 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.625 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:38.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.625 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:38.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:38.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:38.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:38.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:38.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:38.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:38.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:38.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:38.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:38.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:38.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:38.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:38.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:38.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:38.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:38.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:38.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:38.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:38.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:38.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:38.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:38.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:38.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:38.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:38.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:25:38.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:25:38.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:25:38.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:25:38.630 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.630 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.630 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.630 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:38.631 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:38.631 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.616204755999998, 2024-04-19T04:25:38.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:25:38.631 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.631 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:38.631 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.631 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.631 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.631 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:38.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.631 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:38.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:38.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:38.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:38.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:38.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:38.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:38.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:38.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:38.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:38.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:38.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:38.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:38.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:38.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:38.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:38.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:38.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:38.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:38.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:38.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:38.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:38.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:25:38.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:25:38.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:25:38.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:25:38.636 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.636 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.636 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.636 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:38.636 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:38.636 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.616104843999999, 2024-04-19T04:25:38.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:25:38.636 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.637 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:38.637 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.637 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.637 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.637 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:38.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.637 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:38.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:38.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:38.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:38.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:38.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:38.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:38.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:38.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:38.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:38.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:38.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:38.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:38.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:38.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:38.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:38.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:38.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:38.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:38.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:38.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:38.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:25:38.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:25:38.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:25:38.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:25:38.641 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.642 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.642 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.642 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:38.642 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:38.642 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.615979091, 2024-04-19T04:25:38.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:25:38.642 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.642 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:38.642 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.642 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.642 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.642 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:38.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.643 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:38.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:38.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:38.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:38.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:38.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:38.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:38.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:38.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:38.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:38.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:38.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:38.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:38.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:38.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:38.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:38.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:38.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:38.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:38.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:38.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:38.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:25:38.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:25:38.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:25:38.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:25:38.647 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.647 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.647 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.648 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:38.648 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:38.648 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.612135146, 2024-04-19T04:25:38.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:25:38.648 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.648 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.648 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.648 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.648 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.648 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:38.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.648 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:38.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:38.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:38.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:38.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:38.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:38.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:38.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:38.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:38.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:38.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:38.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:38.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:38.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:38.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:38.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:25:38.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:25:38.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:25:38.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:25:38.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:38.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:25:38.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:25:38.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:38.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:25:38.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:25:38.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:25:38.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:25:38.653 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.653 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.653 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.653 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:38.653 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:38.653 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.604964044999999, 2024-04-19T04:25:38.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:25:38.653 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.653 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:38.653 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.653 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.654 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.654 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:38.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.654 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:38.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:38.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:38.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:38.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:38.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:38.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:38.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:38.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:38.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:38.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:38.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:38.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:38.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:38.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:38.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:25:38.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:25:38.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:25:38.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:25:38.657 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.657 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.657 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.657 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:38.657 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:38.658 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.604791940999998, 2024-04-19T04:25:38.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:25:38.658 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.658 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:38.658 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.658 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.658 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.658 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:38.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.658 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:38.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:38.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:38.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:38.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:38.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:38.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:38.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:38.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:38.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:38.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:38.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:38.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:38.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:38.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:25:38.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:25:38.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:25:38.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:25:38.662 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.662 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.662 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.662 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:38.662 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:38.662 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.604728816000002, 2024-04-19T04:25:38.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:25:38.662 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.662 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.662 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.662 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.663 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.663 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:38.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.663 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:38.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:38.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:38.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:38.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:38.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:38.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:38.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:38.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:38.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:38.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:38.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:38.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:38.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:38.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:25:38.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:25:38.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:25:38.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:25:38.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:38.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:25:38.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:25:38.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:38.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:25:38.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:25:38.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:25:38.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:25:38.667 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.667 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.667 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.668 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:38.668 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:38.668 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.604600219000002, 2024-04-19T04:25:38.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:25:38.668 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.668 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.668 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.668 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.668 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.668 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:38.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.668 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:38.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:38.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:38.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:38.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:38.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:38.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:38.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:38.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:38.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:38.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:38.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:38.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:38.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:38.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:25:38.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:25:38.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:25:38.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:25:38.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:38.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:25:38.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:25:38.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:38.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:25:38.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:25:38.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:25:38.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:25:38.673 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.673 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.673 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.673 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:38.673 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:38.673 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.604532248000002, 2024-04-19T04:25:38.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:25:38.673 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.673 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.673 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.673 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.673 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.674 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:38.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.674 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:38.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:38.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:38.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:38.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:38.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:38.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:38.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:38.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:38.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:38.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:38.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:38.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:38.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:38.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:25:38.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:25:38.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:25:38.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:25:38.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:38.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:25:38.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:25:38.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:38.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:25:38.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:25:38.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:25:38.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:25:38.678 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.678 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.678 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.679 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:111654 5.0 5:0b6b473d:::benchmark_data_smithi007_19526_object111653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.679 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:38.679 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.656741142, 2024-04-19T04:25:38.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023122753999999999, 2024-04-19T04:25:38.679 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:38.679 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:38.679 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:38.679 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:38.679 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.679 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 111654 2024-04-19T04:25:38.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.679 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:38.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:38.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:38.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:38.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:38.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:38.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:38.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915865+0000", 2024-04-19T04:25:38.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:38.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915897+0000", 2024-04-19T04:25:38.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1708999999999997e-05 2024-04-19T04:25:38.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:38.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915905+0000", 2024-04-19T04:25:38.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.481e-06 2024-04-19T04:25:38.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915911+0000", 2024-04-19T04:25:38.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6880000000000002e-06 2024-04-19T04:25:38.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:38.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925564+0000", 2024-04-19T04:25:38.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096527039999999998 2024-04-19T04:25:38.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:38.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925771+0000", 2024-04-19T04:25:38.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020717199999999999 2024-04-19T04:25:38.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:38.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938888+0000", 2024-04-19T04:25:38.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013117105 2024-04-19T04:25:38.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:38.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938931+0000", 2024-04-19T04:25:38.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2447000000000002e-05 2024-04-19T04:25:38.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:38.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:38.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:38.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938989+0000", 2024-04-19T04:25:38.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7997000000000001e-05 2024-04-19T04:25:38.683 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.683 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.683 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.683 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:38.683 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:38.683 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:38.685 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:38.685+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:38.685 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:38.758 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 54 16 113391 113375 131.205 128.125 0.00403608 0.00761595 2024-04-19T04:25:38.786 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:38.785+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:38.819 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:38.819 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:38.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.819 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:113495 5.1 5:805db119:::benchmark_data_smithi007_19526_object113494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.819 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:38.808827+0000", 2024-04-19T04:25:38.819 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0096545680000000005, 2024-04-19T04:25:38.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0096836930000000002, 2024-04-19T04:25:38.820 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.820 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:38.820 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.820 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.820 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.820 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 113495 2024-04-19T04:25:38.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.820 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.808827+0000", 2024-04-19T04:25:38.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.808827+0000", 2024-04-19T04:25:38.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.808826+0000", 2024-04-19T04:25:38.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.808930+0000", 2024-04-19T04:25:38.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000103908 2024-04-19T04:25:38.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.808937+0000", 2024-04-19T04:25:38.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2409999999999998e-06 2024-04-19T04:25:38.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.808941+0000", 2024-04-19T04:25:38.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.8940000000000003e-06 2024-04-19T04:25:38.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.808987+0000", 2024-04-19T04:25:38.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6452000000000002e-05 2024-04-19T04:25:38.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.809077+0000", 2024-04-19T04:25:38.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0068000000000006e-05 2024-04-19T04:25:38.823 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.823 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.823 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.823 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:113497 5.9 5:95712197:::benchmark_data_smithi007_19526_object113496:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.823 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:38.810186+0000", 2024-04-19T04:25:38.823 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0082955089999999995, 2024-04-19T04:25:38.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0083991069999999994, 2024-04-19T04:25:38.823 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.823 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:38.824 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.824 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.824 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.824 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 113497 2024-04-19T04:25:38.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.826 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.810186+0000", 2024-04-19T04:25:38.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.810186+0000", 2024-04-19T04:25:38.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.810185+0000", 2024-04-19T04:25:38.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.810282+0000", 2024-04-19T04:25:38.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7769999999999994e-05 2024-04-19T04:25:38.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.810307+0000", 2024-04-19T04:25:38.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4593e-05 2024-04-19T04:25:38.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.810315+0000", 2024-04-19T04:25:38.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3019999999999995e-06 2024-04-19T04:25:38.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.810597+0000", 2024-04-19T04:25:38.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00028154500000000002 2024-04-19T04:25:38.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.810728+0000", 2024-04-19T04:25:38.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000130825 2024-04-19T04:25:38.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:38.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.810876+0000", 2024-04-19T04:25:38.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014838199999999999 2024-04-19T04:25:38.830 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.830 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.830 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.830 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:113500 5.1 5:8cf01de6:::benchmark_data_smithi007_19526_object113499:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.830 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:38.811117+0000", 2024-04-19T04:25:38.830 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0073639500000000002, 2024-04-19T04:25:38.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075395699999999998, 2024-04-19T04:25:38.830 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.830 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:38.830 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.831 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.831 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.831 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 113500 2024-04-19T04:25:38.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.831 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.811117+0000", 2024-04-19T04:25:38.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.811117+0000", 2024-04-19T04:25:38.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.811116+0000", 2024-04-19T04:25:38.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.811226+0000", 2024-04-19T04:25:38.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109663 2024-04-19T04:25:38.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.811243+0000", 2024-04-19T04:25:38.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6796999999999999e-05 2024-04-19T04:25:38.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.811260+0000", 2024-04-19T04:25:38.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7918e-05 2024-04-19T04:25:38.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.811304+0000", 2024-04-19T04:25:38.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3501000000000002e-05 2024-04-19T04:25:38.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.811432+0000", 2024-04-19T04:25:38.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000127577 2024-04-19T04:25:38.834 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.834 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.834 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.834 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:113502 5.f 5:f904348f:::benchmark_data_smithi007_19526_object113501:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.834 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:38.812581+0000", 2024-04-19T04:25:38.834 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0059001540000000003, 2024-04-19T04:25:38.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0061387300000000002, 2024-04-19T04:25:38.834 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.834 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:38.834 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.834 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.834 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.835 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 113502 2024-04-19T04:25:38.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.835 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.812581+0000", 2024-04-19T04:25:38.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.812581+0000", 2024-04-19T04:25:38.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.812580+0000", 2024-04-19T04:25:38.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.812683+0000", 2024-04-19T04:25:38.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000102947 2024-04-19T04:25:38.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.812701+0000", 2024-04-19T04:25:38.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8284999999999999e-05 2024-04-19T04:25:38.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.812709+0000", 2024-04-19T04:25:38.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1620000000000008e-06 2024-04-19T04:25:38.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.812787+0000", 2024-04-19T04:25:38.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7587000000000001e-05 2024-04-19T04:25:38.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.812888+0000", 2024-04-19T04:25:38.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010134800000000001 2024-04-19T04:25:38.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:38.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.812969+0000", 2024-04-19T04:25:38.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0630999999999994e-05 2024-04-19T04:25:38.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:38.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.818322+0000", 2024-04-19T04:25:38.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0053528259999999998 2024-04-19T04:25:38.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:38.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.818721+0000", 2024-04-19T04:25:38.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00039900599999999998 2024-04-19T04:25:38.838 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.839 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.839 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.839 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:113504 5.1 5:845764f9:::benchmark_data_smithi007_19526_object113503:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.839 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:38.813814+0000", 2024-04-19T04:25:38.839 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0046669399999999996, 2024-04-19T04:25:38.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0049932930000000002, 2024-04-19T04:25:38.839 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.839 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:38.839 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.839 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.839 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.839 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 113504 2024-04-19T04:25:38.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.840 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.813814+0000", 2024-04-19T04:25:38.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.813814+0000", 2024-04-19T04:25:38.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.813813+0000", 2024-04-19T04:25:38.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.813895+0000", 2024-04-19T04:25:38.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1730999999999994e-05 2024-04-19T04:25:38.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.813912+0000", 2024-04-19T04:25:38.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6804999999999999e-05 2024-04-19T04:25:38.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.813922+0000", 2024-04-19T04:25:38.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0192e-05 2024-04-19T04:25:38.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.813961+0000", 2024-04-19T04:25:38.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9137999999999997e-05 2024-04-19T04:25:38.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814086+0000", 2024-04-19T04:25:38.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012469 2024-04-19T04:25:38.842 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.842 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.842 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.843 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:113505 5.6 5:62b94dfd:::benchmark_data_smithi007_19526_object113504:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.843 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:38.813936+0000", 2024-04-19T04:25:38.843 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0045453350000000002, 2024-04-19T04:25:38.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.004936055, 2024-04-19T04:25:38.843 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.843 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:38.843 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.843 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.843 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.843 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 113505 2024-04-19T04:25:38.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.843 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.813936+0000", 2024-04-19T04:25:38.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.813936+0000", 2024-04-19T04:25:38.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.813935+0000", 2024-04-19T04:25:38.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.813980+0000", 2024-04-19T04:25:38.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5126999999999997e-05 2024-04-19T04:25:38.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.813989+0000", 2024-04-19T04:25:38.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2709999999999998e-06 2024-04-19T04:25:38.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.813996+0000", 2024-04-19T04:25:38.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7449999999999998e-06 2024-04-19T04:25:38.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814062+0000", 2024-04-19T04:25:38.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5755999999999999e-05 2024-04-19T04:25:38.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814189+0000", 2024-04-19T04:25:38.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012733800000000001 2024-04-19T04:25:38.846 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.846 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.846 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.846 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:113506 5.9 5:9a3afa00:::benchmark_data_smithi007_19526_object113505:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.846 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:38.814013+0000", 2024-04-19T04:25:38.847 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0044684310000000001, 2024-04-19T04:25:38.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0049224120000000001, 2024-04-19T04:25:38.847 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.847 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:38.847 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.847 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.847 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.847 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 113506 2024-04-19T04:25:38.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.847 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814013+0000", 2024-04-19T04:25:38.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814013+0000", 2024-04-19T04:25:38.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814012+0000", 2024-04-19T04:25:38.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814053+0000", 2024-04-19T04:25:38.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1111e-05 2024-04-19T04:25:38.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814063+0000", 2024-04-19T04:25:38.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8910000000000007e-06 2024-04-19T04:25:38.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814069+0000", 2024-04-19T04:25:38.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2179999999999996e-06 2024-04-19T04:25:38.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814108+0000", 2024-04-19T04:25:38.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.8560999999999999e-05 2024-04-19T04:25:38.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814239+0000", 2024-04-19T04:25:38.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013101000000000001 2024-04-19T04:25:38.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:38.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814380+0000", 2024-04-19T04:25:38.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014087999999999999 2024-04-19T04:25:38.850 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.850 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.850 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.851 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:113507 5.f 5:f3d81acd:::benchmark_data_smithi007_19526_object113506:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.851 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:38.814081+0000", 2024-04-19T04:25:38.851 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0044003699999999998, 2024-04-19T04:25:38.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0049265790000000004, 2024-04-19T04:25:38.851 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.851 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:38.851 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.851 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.851 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.851 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 113507 2024-04-19T04:25:38.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.851 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814081+0000", 2024-04-19T04:25:38.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814081+0000", 2024-04-19T04:25:38.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814080+0000", 2024-04-19T04:25:38.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814117+0000", 2024-04-19T04:25:38.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6878999999999997e-05 2024-04-19T04:25:38.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814125+0000", 2024-04-19T04:25:38.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3340000000000002e-06 2024-04-19T04:25:38.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814131+0000", 2024-04-19T04:25:38.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7239999999999997e-06 2024-04-19T04:25:38.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814862+0000", 2024-04-19T04:25:38.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00073090399999999999 2024-04-19T04:25:38.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.815013+0000", 2024-04-19T04:25:38.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000151321 2024-04-19T04:25:38.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:38.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.815171+0000", 2024-04-19T04:25:38.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000157625 2024-04-19T04:25:38.854 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.854 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.855 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.855 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:113491 5.9 e46/20 ondisk, result = 0)", 2024-04-19T04:25:38.855 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:38.814815+0000", 2024-04-19T04:25:38.855 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.003665593, 2024-04-19T04:25:38.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042543659999999999, 2024-04-19T04:25:38.855 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.855 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:38.855 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814815+0000", 2024-04-19T04:25:38.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814815+0000", 2024-04-19T04:25:38.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814815+0000", 2024-04-19T04:25:38.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814818+0000", 2024-04-19T04:25:38.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.0359999999999998e-06 2024-04-19T04:25:38.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814826+0000", 2024-04-19T04:25:38.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4599999999999997e-06 2024-04-19T04:25:38.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.814831+0000", 2024-04-19T04:25:38.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0640000000000001e-06 2024-04-19T04:25:38.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.816589+0000", 2024-04-19T04:25:38.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001758143 2024-04-19T04:25:38.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.816593+0000", 2024-04-19T04:25:38.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2250000000000002e-06 2024-04-19T04:25:38.858 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.858 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.858 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.858 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:113508 5.1 5:80a01ca8:::benchmark_data_smithi007_19526_object113507:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.858 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:38.815702+0000", 2024-04-19T04:25:38.858 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0027790879999999999, 2024-04-19T04:25:38.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003425431, 2024-04-19T04:25:38.859 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.859 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:38.859 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.859 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.859 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.859 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 113508 2024-04-19T04:25:38.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.859 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.815702+0000", 2024-04-19T04:25:38.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.815702+0000", 2024-04-19T04:25:38.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.815701+0000", 2024-04-19T04:25:38.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.815782+0000", 2024-04-19T04:25:38.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0875000000000001e-05 2024-04-19T04:25:38.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.815793+0000", 2024-04-19T04:25:38.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1486e-05 2024-04-19T04:25:38.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.815802+0000", 2024-04-19T04:25:38.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2949999999999994e-06 2024-04-19T04:25:38.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.816586+0000", 2024-04-19T04:25:38.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00078474299999999996 2024-04-19T04:25:38.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.816750+0000", 2024-04-19T04:25:38.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016402499999999999 2024-04-19T04:25:38.865 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.865 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.865 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.866 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:113509 5.9 5.cc744349 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.866 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:38.815809+0000", 2024-04-19T04:25:38.866 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0026716890000000001, 2024-04-19T04:25:38.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0033768560000000001, 2024-04-19T04:25:38.867 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.867 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:38.867 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.867 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.867 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.867 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 113509 2024-04-19T04:25:38.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.867 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.815809+0000", 2024-04-19T04:25:38.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.815809+0000", 2024-04-19T04:25:38.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.815809+0000", 2024-04-19T04:25:38.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.815848+0000", 2024-04-19T04:25:38.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9096e-05 2024-04-19T04:25:38.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.815856+0000", 2024-04-19T04:25:38.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4230000000000005e-06 2024-04-19T04:25:38.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.815863+0000", 2024-04-19T04:25:38.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.348e-06 2024-04-19T04:25:38.872 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.872 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.872 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.872 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:113512 5.d 5:bac4ea4e:::benchmark_data_smithi007_19526_object113511:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.872 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:38.816886+0000", 2024-04-19T04:25:38.872 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001595405, 2024-04-19T04:25:38.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023595930000000001, 2024-04-19T04:25:38.872 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.872 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:38.872 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.873 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.873 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.873 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 113512 2024-04-19T04:25:38.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.873 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.816886+0000", 2024-04-19T04:25:38.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.816886+0000", 2024-04-19T04:25:38.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.816885+0000", 2024-04-19T04:25:38.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.816958+0000", 2024-04-19T04:25:38.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3288999999999996e-05 2024-04-19T04:25:38.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.816964+0000", 2024-04-19T04:25:38.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1489999999999999e-06 2024-04-19T04:25:38.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.816969+0000", 2024-04-19T04:25:38.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9629999999999997e-06 2024-04-19T04:25:38.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817014+0000", 2024-04-19T04:25:38.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4953999999999997e-05 2024-04-19T04:25:38.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817096+0000", 2024-04-19T04:25:38.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1576999999999995e-05 2024-04-19T04:25:38.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:38.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817177+0000", 2024-04-19T04:25:38.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1557000000000005e-05 2024-04-19T04:25:38.876 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.876 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.876 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.876 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:113513 5.3 5:c424f701:::benchmark_data_smithi007_19526_object113512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.876 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:38.817112+0000", 2024-04-19T04:25:38.877 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001369297, 2024-04-19T04:25:38.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0022041280000000001, 2024-04-19T04:25:38.877 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.877 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:38.877 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.877 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.877 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.877 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 113513 2024-04-19T04:25:38.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.877 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817112+0000", 2024-04-19T04:25:38.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817112+0000", 2024-04-19T04:25:38.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817111+0000", 2024-04-19T04:25:38.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:38.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817165+0000", 2024-04-19T04:25:38.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4289999999999997e-05 2024-04-19T04:25:38.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817171+0000", 2024-04-19T04:25:38.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3720000000000004e-06 2024-04-19T04:25:38.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817174+0000", 2024-04-19T04:25:38.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6619999999999998e-06 2024-04-19T04:25:38.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817248+0000", 2024-04-19T04:25:38.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3574999999999999e-05 2024-04-19T04:25:38.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817399+0000", 2024-04-19T04:25:38.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000151285 2024-04-19T04:25:38.880 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.880 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.880 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.881 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:113514 5.5 5:a7bcd89b:::benchmark_data_smithi007_19526_object113513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.881 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:38.817810+0000", 2024-04-19T04:25:38.881 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00067061300000000003, 2024-04-19T04:25:38.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001572616, 2024-04-19T04:25:38.881 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.881 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:38.881 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.881 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.881 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.881 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 113514 2024-04-19T04:25:38.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.882 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817810+0000", 2024-04-19T04:25:38.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817810+0000", 2024-04-19T04:25:38.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817810+0000", 2024-04-19T04:25:38.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817875+0000", 2024-04-19T04:25:38.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5803999999999995e-05 2024-04-19T04:25:38.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817885+0000", 2024-04-19T04:25:38.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.4099999999999997e-06 2024-04-19T04:25:38.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817889+0000", 2024-04-19T04:25:38.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5090000000000004e-06 2024-04-19T04:25:38.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817931+0000", 2024-04-19T04:25:38.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1273999999999998e-05 2024-04-19T04:25:38.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.818034+0000", 2024-04-19T04:25:38.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000103188 2024-04-19T04:25:38.885 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.885 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.885 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.885 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:113515 5.9 5.8dfa2429 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.885 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:38.817897+0000", 2024-04-19T04:25:38.885 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00058420599999999998, 2024-04-19T04:25:38.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015465399999999999, 2024-04-19T04:25:38.885 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.885 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:38.886 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.886 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.886 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.886 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 113515 2024-04-19T04:25:38.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.886 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.886 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.886 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817897+0000", 2024-04-19T04:25:38.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.886 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817897+0000", 2024-04-19T04:25:38.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817896+0000", 2024-04-19T04:25:38.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817939+0000", 2024-04-19T04:25:38.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3176999999999997e-05 2024-04-19T04:25:38.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817948+0000", 2024-04-19T04:25:38.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1050000000000001e-06 2024-04-19T04:25:38.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.817954+0000", 2024-04-19T04:25:38.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7769999999999999e-06 2024-04-19T04:25:38.888 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.888 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.888 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.889 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:113516 5.c 5:3728f417:::benchmark_data_smithi007_19526_object113515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:38.889 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:38.819089+0000", 2024-04-19T04:25:38.889 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.999392, 2024-04-19T04:25:38.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00041038199999999999, 2024-04-19T04:25:38.889 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:38.889 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:38.889 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:38.889 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:38.889 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:38.889 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 113516 2024-04-19T04:25:38.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.889 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:38.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:38.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.819089+0000", 2024-04-19T04:25:38.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:38.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.819089+0000", 2024-04-19T04:25:38.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:38.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:38.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.819088+0000", 2024-04-19T04:25:38.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:38.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:38.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.819173+0000", 2024-04-19T04:25:38.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4515e-05 2024-04-19T04:25:38.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:38.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.819181+0000", 2024-04-19T04:25:38.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9410000000000007e-06 2024-04-19T04:25:38.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:38.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.819186+0000", 2024-04-19T04:25:38.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1850000000000003e-06 2024-04-19T04:25:38.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:38.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.819237+0000", 2024-04-19T04:25:38.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1301000000000002e-05 2024-04-19T04:25:38.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:38.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:38.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:38.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:38.819330+0000", 2024-04-19T04:25:38.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2984000000000003e-05 2024-04-19T04:25:38.893 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.893 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:38.893 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.893 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:38.893 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:38.893 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 16 2024-04-19T04:25:38.893 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:38.894 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:38.893+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:38.895 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:38.996 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:38.993+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:39.068 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:39.068 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:39.068 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:39.068 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:39.068 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:39.079 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T04:25:39.081 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:39.124 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:39.125+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:39.197 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:39.197+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:39.215 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:39.216 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:39.216 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:39.216 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:39.216 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.216 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:39.216 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:39.216 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 44.982613583999999, 2024-04-19T04:25:39.216 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:39.216 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.216 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:39.216 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:39.216 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:39.216 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.217 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:39.217 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.217 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.217 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.217 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.217 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:39.217 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.217 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.217 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.217 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.217 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:39.217 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.217 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.217 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.218 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.218 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:39.218 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:39.218 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.218 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.218 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.218 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:39.218 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:39.218 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.218 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.218 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.218 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:39.218 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:39.218 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.219 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.219 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.219 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:39.219 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:39.219 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.219 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.219 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.219 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:39.219 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:39.219 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.219 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.219 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:39.219 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:39.219 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:39.220 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.220 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.220 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:39.220 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:39.220 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:39.220 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.220 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.220 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:39.220 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:39.220 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:39.220 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.220 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.220 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:39.221 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:39.221 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:39.221 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.221 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.221 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:39.221 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:39.221 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:39.221 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.221 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.221 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.221 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:39.221 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:39.221 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.221 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.222 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.222 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.222 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.222 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:39.222 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:39.222 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 44.979432428000003, 2024-04-19T04:25:39.222 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:39.222 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.222 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:39.222 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:39.222 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:39.222 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.222 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:39.222 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.223 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.223 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.223 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.223 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:39.223 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.223 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.223 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.223 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.223 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:39.223 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.223 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.223 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.223 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.223 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:39.223 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:39.224 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.224 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.224 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.224 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:39.224 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:39.224 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.224 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.224 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.224 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:39.224 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:39.224 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.224 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.224 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.224 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:39.224 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:39.225 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.225 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.225 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.225 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:39.225 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:39.225 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.225 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.225 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:39.225 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:39.225 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:39.225 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.225 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.225 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:39.225 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:39.225 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:39.226 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.226 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.226 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:39.226 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:39.226 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:39.226 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.226 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.226 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:39.226 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:39.226 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:39.226 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.226 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.226 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:39.226 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:39.227 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:39.227 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.227 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.227 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.227 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:39.227 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:39.227 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.227 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.227 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.227 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.227 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.227 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:39.227 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:39.227 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 44.978864324, 2024-04-19T04:25:39.227 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:39.228 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.228 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:39.228 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.228 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.228 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.228 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:39.228 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.228 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.228 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.228 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.228 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:39.228 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.228 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.228 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.228 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.229 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:39.229 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:39.229 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.229 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.229 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.229 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:39.229 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:39.229 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.229 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.229 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.229 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:39.229 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:39.229 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.229 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.230 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.230 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:39.230 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:39.230 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.230 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.230 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.230 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:39.230 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:39.230 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.230 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.230 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:39.230 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:39.230 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:39.230 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.231 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.231 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:39.231 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:39.231 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:39.231 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.231 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.231 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.231 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:39.231 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:39.231 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.231 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.231 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.231 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.231 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.231 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:39.232 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:39.232 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 44.978518663000003, 2024-04-19T04:25:39.232 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:39.232 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.232 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:39.232 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:39.232 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:39.232 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.232 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:39.232 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.232 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.232 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.232 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.232 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:39.232 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.233 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.233 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.233 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.233 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:39.233 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.233 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.233 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.233 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.233 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:39.233 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:39.234 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.234 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.234 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.234 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:39.234 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:39.234 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.234 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.234 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.234 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:39.234 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:39.235 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.235 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.235 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.235 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:39.235 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:39.235 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.235 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.235 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.235 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:39.235 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:39.235 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.235 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.235 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:39.235 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:39.236 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:39.236 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.236 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.236 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:39.236 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:39.236 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:39.236 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.236 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.236 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:39.236 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:39.236 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:39.236 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.236 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.236 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:39.236 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:39.237 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:39.237 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.237 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.237 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:39.237 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:39.237 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:39.237 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.237 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.237 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.237 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:39.237 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:39.237 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.237 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.237 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.237 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.238 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.238 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:39.238 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:39.238 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 44.977794224999997, 2024-04-19T04:25:39.238 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:39.238 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.238 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:39.238 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.238 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.238 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.238 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:39.238 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.238 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.238 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.239 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.239 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:39.239 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.239 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.239 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.239 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.239 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:39.239 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:39.239 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.239 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.239 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.239 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:39.239 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:39.239 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.239 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.240 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.240 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:39.240 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:39.240 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.240 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.240 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.240 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:39.240 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:39.240 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.240 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.240 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.240 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:39.240 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:39.240 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.240 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.241 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:39.241 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:39.241 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:39.241 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.241 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.241 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:39.241 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:39.241 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:39.241 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.241 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.241 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.241 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:39.241 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:39.241 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.242 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.242 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.242 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.242 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.242 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:39.242 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:39.242 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 44.977786829999999, 2024-04-19T04:25:39.242 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:39.242 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.242 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:39.242 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.242 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.242 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.242 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:39.242 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.243 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.243 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.243 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.243 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:39.243 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.243 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.243 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.243 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.243 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:39.243 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:39.243 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.243 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.243 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.243 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:39.244 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:39.244 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.244 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.244 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.244 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:39.244 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:39.244 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.244 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.244 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.244 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:39.244 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:39.244 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.244 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.244 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.244 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:39.245 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:39.245 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.245 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.245 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:39.245 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:39.245 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:39.245 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.245 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.245 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:39.245 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:39.245 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:39.245 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.246 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.246 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.246 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:39.246 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:39.246 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.246 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.246 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.246 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.246 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.246 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:39.246 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:39.246 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 44.975961683000001, 2024-04-19T04:25:39.246 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:39.247 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.247 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:39.247 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:39.247 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:39.247 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.247 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:39.247 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.247 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.247 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.247 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.247 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:39.247 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.247 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.247 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.247 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.248 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:39.248 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.248 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.248 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.248 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.248 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:39.248 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:39.248 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.248 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.248 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.248 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:39.248 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:39.248 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.248 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.249 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.249 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:39.249 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:39.249 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.249 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.249 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.249 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:39.249 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:39.249 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.249 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.249 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.249 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:39.249 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:39.249 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.249 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.250 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:39.250 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:39.250 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:39.250 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.250 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.250 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:39.250 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:39.250 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:39.250 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.250 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.250 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:39.251 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:39.251 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:39.251 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.251 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.251 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:39.251 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:39.251 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:39.251 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.251 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.251 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:39.251 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:39.251 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:39.251 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.251 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.251 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.252 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:39.252 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:39.252 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.252 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.252 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.252 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.252 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.252 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:39.252 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:39.252 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 44.975227478000001, 2024-04-19T04:25:39.252 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:39.252 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.252 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:39.252 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:39.253 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:39.253 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.253 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:39.253 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.253 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.253 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.253 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.253 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:39.253 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.253 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.253 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.253 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.253 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:39.253 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.254 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.254 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.254 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.254 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:39.254 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:39.254 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.254 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.254 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.254 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:39.254 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:39.254 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.254 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.254 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.254 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:39.255 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:39.255 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.255 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.255 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.255 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:39.255 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:39.255 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.255 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.255 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.255 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:39.255 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:39.255 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.255 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.255 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:39.255 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:39.256 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:39.256 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.256 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.256 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:39.256 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:39.256 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:39.256 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.256 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.256 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:39.256 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:39.256 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:39.256 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.256 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.256 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:39.257 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:39.257 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:39.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.257 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.257 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:39.257 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:39.257 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:39.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.257 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.257 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.257 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:39.257 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:39.257 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.257 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.257 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.258 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.258 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.258 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:39.258 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:39.258 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 44.974693201999997, 2024-04-19T04:25:39.258 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:39.258 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.258 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:39.258 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.258 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.258 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.258 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:39.258 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.258 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.259 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.259 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.259 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:39.259 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.259 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.259 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.259 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.259 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:39.259 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:39.259 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.259 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.259 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.259 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:39.259 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:39.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.260 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.260 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.260 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:39.260 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:39.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.260 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.260 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.260 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:39.260 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:39.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.260 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.260 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.260 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:39.260 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:39.261 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.261 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.261 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:39.261 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:39.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:39.261 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.261 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.261 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:39.261 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:39.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:39.261 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.261 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.261 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.261 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:39.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:39.262 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.262 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.262 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.262 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.262 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.262 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:39.262 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:39.262 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 23.257838013000001, 2024-04-19T04:25:39.262 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:39.262 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.262 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:39.262 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:39.262 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:39.262 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.263 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:39.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.263 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.263 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.263 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.263 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:39.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.263 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.263 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.263 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:39.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.263 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.263 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.264 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:39.264 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:39.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.264 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.264 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:39.264 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:39.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.264 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.264 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:39.264 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:39.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.264 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:39.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:39.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:39.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:39.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:39.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:39.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:39.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:39.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:39.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:39.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.266 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:39.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:39.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:39.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.266 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:39.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:39.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.267 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:39.267 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:39.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:39.267 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.267 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.267 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.267 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:39.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:39.267 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.267 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.267 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.267 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:39.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:39.267 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.267 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.268 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.268 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:39.268 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:39.268 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 23.237607564000001, 2024-04-19T04:25:39.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:39.268 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.268 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:39.268 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:39.268 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:39.268 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.268 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:39.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.268 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.269 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.269 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:39.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.269 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.269 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:39.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.269 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.269 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:39.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:39.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:39.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:39.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:39.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:39.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:39.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:39.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:39.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:39.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:39.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:39.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:39.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.272 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.272 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.272 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:39.272 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:39.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.272 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.272 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.272 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:39.272 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:39.272 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.272 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.272 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.272 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.273 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:39.273 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:39.273 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 23.237499707000001, 2024-04-19T04:25:39.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:39.273 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.273 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:39.273 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:39.273 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:39.273 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.273 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:39.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.273 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:39.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.274 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:39.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.274 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:39.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:39.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:39.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:39.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:39.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:39.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:39.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:39.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:39.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:39.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:39.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:39.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:39.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:39.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:39.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:39.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:39.277 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.277 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.277 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.277 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:39.277 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:39.277 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 23.235533018000002, 2024-04-19T04:25:39.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:39.277 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.277 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:39.278 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:39.278 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:39.278 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.278 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:39.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.278 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:39.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:39.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.279 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.279 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:39.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:39.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.279 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.279 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:39.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:39.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.279 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.279 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:39.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:39.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:39.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:39.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:39.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:39.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:39.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:39.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:39.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:39.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:39.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:39.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:39.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:39.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:39.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:39.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:39.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:39.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:39.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:39.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:39.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:39.282 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.282 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.282 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.283 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:39.283 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:39.283 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 23.232168822999999, 2024-04-19T04:25:39.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:39.283 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.283 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:39.283 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:39.283 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:39.283 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.283 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:39.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.283 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:39.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:39.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:39.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:39.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.285 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.285 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:39.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:39.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.285 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.285 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:39.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:39.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.285 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.285 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:39.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:39.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:39.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:39.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:39.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:39.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:39.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:39.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:39.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:39.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:39.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:39.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:39.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:39.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:39.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:39.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:39.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:39.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:39.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:39.288 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.288 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.288 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.288 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:39.288 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:39.288 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 23.228357845000001, 2024-04-19T04:25:39.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:39.288 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.288 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:39.289 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:39.289 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:39.289 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.289 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:39.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.289 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:39.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:39.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.290 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.290 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:39.290 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:39.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.290 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.290 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:39.290 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:39.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.290 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.290 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:39.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:39.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:39.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:39.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:39.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:39.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:39.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:39.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:39.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.292 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.292 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:39.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:39.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.292 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.292 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:39.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:39.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:39.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.292 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.292 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:39.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:39.293 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:39.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.293 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:39.293 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:39.293 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:39.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.293 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.293 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:39.293 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:39.293 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.293 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.293 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.294 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.294 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93735 5.1 5:8e609d1b:::benchmark_data_smithi007_19526_object93734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:39.294 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:39.294 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.9866572009999999, 2024-04-19T04:25:39.294 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048424842000000003, 2024-04-19T04:25:39.294 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.294 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:39.294 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:39.294 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:39.294 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.294 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93735 2024-04-19T04:25:39.294 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.294 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.294 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.295 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.295 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:39.295 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.295 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.295 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:39.295 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.295 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.295 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227480+0000", 2024-04-19T04:25:39.295 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:39.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227533+0000", 2024-04-19T04:25:39.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2964999999999999e-05 2024-04-19T04:25:39.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227542+0000", 2024-04-19T04:25:39.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1449999999999997e-06 2024-04-19T04:25:39.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227561+0000", 2024-04-19T04:25:39.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9116000000000001e-05 2024-04-19T04:25:39.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.297 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.297 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227610+0000", 2024-04-19T04:25:39.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9234000000000003e-05 2024-04-19T04:25:39.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.297 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:39.297 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227697+0000", 2024-04-19T04:25:39.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6682999999999997e-05 2024-04-19T04:25:39.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.297 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:39.297 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275809+0000", 2024-04-19T04:25:39.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048112265000000001 2024-04-19T04:25:39.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:39.298 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275845+0000", 2024-04-19T04:25:39.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5275999999999999e-05 2024-04-19T04:25:39.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.298 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275906+0000", 2024-04-19T04:25:39.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1002999999999999e-05 2024-04-19T04:25:39.298 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.298 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.298 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.299 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93736 5.1 5:852229ec:::benchmark_data_smithi007_19526_object93735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:39.299 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:39.299 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.9865531710000006, 2024-04-19T04:25:39.299 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048414497000000001, 2024-04-19T04:25:39.299 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.299 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:39.299 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:39.299 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:39.299 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.299 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93736 2024-04-19T04:25:39.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.299 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:39.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:39.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227584+0000", 2024-04-19T04:25:39.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:39.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227624+0000", 2024-04-19T04:25:39.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9833000000000003e-05 2024-04-19T04:25:39.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227630+0000", 2024-04-19T04:25:39.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0759999999999999e-06 2024-04-19T04:25:39.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227634+0000", 2024-04-19T04:25:39.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1570000000000002e-06 2024-04-19T04:25:39.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.302 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229531+0000", 2024-04-19T04:25:39.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018962339999999999 2024-04-19T04:25:39.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:39.302 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229662+0000", 2024-04-19T04:25:39.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013192999999999999 2024-04-19T04:25:39.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:39.302 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275915+0000", 2024-04-19T04:25:39.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046252140999999997 2024-04-19T04:25:39.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:39.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275944+0000", 2024-04-19T04:25:39.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9539999999999998e-05 2024-04-19T04:25:39.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275999+0000", 2024-04-19T04:25:39.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5062999999999998e-05 2024-04-19T04:25:39.303 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.303 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.303 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.304 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:39.304 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:39.304 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.9864954879999992, 2024-04-19T04:25:39.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:25:39.304 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.304 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:39.304 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:39.304 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:39.304 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.304 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:25:39.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.305 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:39.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:39.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:39.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:39.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:25:39.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:25:39.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:25:39.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:25:39.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:25:39.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:25:39.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:25:39.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:25:39.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:39.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:25:39.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:25:39.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:39.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:25:39.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:25:39.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:39.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:25:39.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:25:39.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:25:39.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:25:39.308 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.308 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.308 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.309 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:39.309 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:39.309 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.9859012079999996, 2024-04-19T04:25:39.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:25:39.309 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.309 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:39.309 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:39.309 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:39.309 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.309 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:25:39.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.309 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:39.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:39.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:25:39.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:39.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:25:39.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:25:39.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:25:39.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:25:39.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:25:39.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:25:39.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:25:39.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:25:39.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:39.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:25:39.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:25:39.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:39.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:25:39.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:25:39.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:39.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:25:39.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:25:39.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:39.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:25:39.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:25:39.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:39.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:25:39.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:25:39.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:25:39.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:25:39.314 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.314 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.314 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.314 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93744 5.1 5:87b91c25:::benchmark_data_smithi007_19526_object93743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:39.314 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:39.314 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.9822316569999998, 2024-04-19T04:25:39.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044295022000000003, 2024-04-19T04:25:39.314 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:39.315 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:39.315 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:39.315 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:39.315 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.315 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93744 2024-04-19T04:25:39.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.315 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:39.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:39.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:39.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:39.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:39.316 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:39.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.316 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:39.316 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231905+0000", 2024-04-19T04:25:39.316 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:39.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.316 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:39.316 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231935+0000", 2024-04-19T04:25:39.316 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9442e-05 2024-04-19T04:25:39.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.317 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:39.317 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264224+0000", 2024-04-19T04:25:39.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.032288836000000001 2024-04-19T04:25:39.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.317 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.317 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264238+0000", 2024-04-19T04:25:39.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4494999999999999e-05 2024-04-19T04:25:39.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.317 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:39.317 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268311+0000", 2024-04-19T04:25:39.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040726629999999998 2024-04-19T04:25:39.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:39.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268587+0000", 2024-04-19T04:25:39.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00027623200000000001 2024-04-19T04:25:39.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:39.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276099+0000", 2024-04-19T04:25:39.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075116180000000003 2024-04-19T04:25:39.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:39.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276123+0000", 2024-04-19T04:25:39.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4675e-05 2024-04-19T04:25:39.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:39.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:39.319 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:39.319 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276201+0000", 2024-04-19T04:25:39.319 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7836000000000005e-05 2024-04-19T04:25:39.319 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.319 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.319 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.319 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:39.319 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:39.319 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:39.321 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:39.321 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:39.321+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:39.421 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:39.417+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:39.451 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:39.451 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:39.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.451 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:114798 5.8 5:1f5542b5:::benchmark_data_smithi007_19526_object114797:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:39.451 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:39.445834+0000", 2024-04-19T04:25:39.451 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.004867634, 2024-04-19T04:25:39.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004896091, 2024-04-19T04:25:39.451 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:39.451 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:39.451 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:39.451 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:39.452 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.452 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 114798 2024-04-19T04:25:39.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.452 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:39.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:39.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445834+0000", 2024-04-19T04:25:39.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:39.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:39.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445834+0000", 2024-04-19T04:25:39.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:39.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:39.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445834+0000", 2024-04-19T04:25:39.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:39.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:39.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445867+0000", 2024-04-19T04:25:39.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.383e-05 2024-04-19T04:25:39.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:39.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445881+0000", 2024-04-19T04:25:39.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3158e-05 2024-04-19T04:25:39.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445886+0000", 2024-04-19T04:25:39.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3650000000000003e-06 2024-04-19T04:25:39.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:39.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445944+0000", 2024-04-19T04:25:39.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8263000000000001e-05 2024-04-19T04:25:39.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:39.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.446120+0000", 2024-04-19T04:25:39.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017596300000000001 2024-04-19T04:25:39.456 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:39.456 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:39.456 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:39.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.456 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:114800 5.0 5:05a75fb8:::benchmark_data_smithi007_19526_object114799:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:39.457 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:39.445897+0000", 2024-04-19T04:25:39.457 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0048048689999999998, 2024-04-19T04:25:39.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049610219999999998, 2024-04-19T04:25:39.457 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:39.457 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:39.457 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:39.457 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:39.457 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.457 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 114800 2024-04-19T04:25:39.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.458 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:39.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:39.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445897+0000", 2024-04-19T04:25:39.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:39.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:39.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445897+0000", 2024-04-19T04:25:39.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:39.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:39.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445897+0000", 2024-04-19T04:25:39.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:39.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:39.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445931+0000", 2024-04-19T04:25:39.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3983000000000003e-05 2024-04-19T04:25:39.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:39.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445940+0000", 2024-04-19T04:25:39.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2050000000000008e-06 2024-04-19T04:25:39.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445944+0000", 2024-04-19T04:25:39.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.844e-06 2024-04-19T04:25:39.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:39.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.446353+0000", 2024-04-19T04:25:39.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00040890700000000002 2024-04-19T04:25:39.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:39.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.446485+0000", 2024-04-19T04:25:39.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000132084 2024-04-19T04:25:39.461 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:39.461 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:39.461 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:39.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.461 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:114801 5.0 5:0f33baca:::benchmark_data_smithi007_19526_object114800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:39.461 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:39.445948+0000", 2024-04-19T04:25:39.461 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.004754131, 2024-04-19T04:25:39.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049815220000000004, 2024-04-19T04:25:39.462 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:39.462 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:39.462 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:39.462 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:39.463 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.463 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 114801 2024-04-19T04:25:39.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.463 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:39.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:39.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445948+0000", 2024-04-19T04:25:39.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:39.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:39.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445948+0000", 2024-04-19T04:25:39.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:39.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:39.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445948+0000", 2024-04-19T04:25:39.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:39.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:39.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445969+0000", 2024-04-19T04:25:39.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1658000000000002e-05 2024-04-19T04:25:39.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:39.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445980+0000", 2024-04-19T04:25:39.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0464e-05 2024-04-19T04:25:39.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.445983+0000", 2024-04-19T04:25:39.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3419999999999999e-06 2024-04-19T04:25:39.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:39.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.449077+0000", 2024-04-19T04:25:39.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003094032 2024-04-19T04:25:39.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:39.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.449196+0000", 2024-04-19T04:25:39.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011899 2024-04-19T04:25:39.465 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:39.465 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:39.466 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:39.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.466 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:114804 5.a 5:5bcb905d:::benchmark_data_smithi007_19526_object114803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:39.466 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:39.446459+0000", 2024-04-19T04:25:39.466 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0042432709999999998, 2024-04-19T04:25:39.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045398219999999998, 2024-04-19T04:25:39.466 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:39.466 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:39.466 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:39.466 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:39.466 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.466 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 114804 2024-04-19T04:25:39.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.467 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:39.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:39.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.446459+0000", 2024-04-19T04:25:39.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:39.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:39.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.446459+0000", 2024-04-19T04:25:39.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:39.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:39.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.446458+0000", 2024-04-19T04:25:39.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:39.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:39.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.446512+0000", 2024-04-19T04:25:39.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3931999999999998e-05 2024-04-19T04:25:39.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:39.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.446536+0000", 2024-04-19T04:25:39.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4300000000000001e-05 2024-04-19T04:25:39.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.446557+0000", 2024-04-19T04:25:39.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0744e-05 2024-04-19T04:25:39.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:39.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.446608+0000", 2024-04-19T04:25:39.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1638000000000003e-05 2024-04-19T04:25:39.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:39.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.446764+0000", 2024-04-19T04:25:39.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015536 2024-04-19T04:25:39.469 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:39.469 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:39.469 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:39.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.470 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:114807 5.a 5:5638d957:::benchmark_data_smithi007_19526_object114806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:39.470 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:39.447083+0000", 2024-04-19T04:25:39.470 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.003619377, 2024-04-19T04:25:39.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039857829999999997, 2024-04-19T04:25:39.470 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:39.470 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:39.470 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:39.470 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:39.470 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.470 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 114807 2024-04-19T04:25:39.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.471 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:39.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:39.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.447083+0000", 2024-04-19T04:25:39.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:39.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:39.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.447083+0000", 2024-04-19T04:25:39.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:39.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:39.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.447082+0000", 2024-04-19T04:25:39.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:39.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:39.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.447192+0000", 2024-04-19T04:25:39.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110268 2024-04-19T04:25:39.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:39.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.447206+0000", 2024-04-19T04:25:39.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4207e-05 2024-04-19T04:25:39.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.447214+0000", 2024-04-19T04:25:39.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3599999999999998e-06 2024-04-19T04:25:39.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:39.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.449394+0000", 2024-04-19T04:25:39.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021806619999999999 2024-04-19T04:25:39.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:39.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.449580+0000", 2024-04-19T04:25:39.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018589400000000001 2024-04-19T04:25:39.473 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:39.473 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:39.473 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:39.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.474 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:114809 5.8 5:11053db3:::benchmark_data_smithi007_19526_object114808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:39.474 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:39.447578+0000", 2024-04-19T04:25:39.474 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0031243439999999998, 2024-04-19T04:25:39.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035683870000000001, 2024-04-19T04:25:39.474 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:39.474 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:39.474 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:39.474 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:39.474 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.474 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 114809 2024-04-19T04:25:39.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.474 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:39.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:39.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.447578+0000", 2024-04-19T04:25:39.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:39.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:39.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.447578+0000", 2024-04-19T04:25:39.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:39.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:39.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.447577+0000", 2024-04-19T04:25:39.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:39.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:39.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.447649+0000", 2024-04-19T04:25:39.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1648000000000002e-05 2024-04-19T04:25:39.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:39.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.447661+0000", 2024-04-19T04:25:39.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2026e-05 2024-04-19T04:25:39.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.447667+0000", 2024-04-19T04:25:39.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1129999999999997e-06 2024-04-19T04:25:39.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:39.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.448940+0000", 2024-04-19T04:25:39.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012728959999999999 2024-04-19T04:25:39.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:39.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.449107+0000", 2024-04-19T04:25:39.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016724400000000001 2024-04-19T04:25:39.477 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:39.477 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:39.477 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:39.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.478 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:114803 5.d e46/29 5:befa9c84:::benchmark_data_smithi007_19526_object114802:head v 46'6963, mlcod=46'6959)", 2024-04-19T04:25:39.478 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:39.450542+0000", 2024-04-19T04:25:39.478 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00015981099999999999, 2024-04-19T04:25:39.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00066912600000000003, 2024-04-19T04:25:39.478 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:39.478 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:39.478 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:39.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:39.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.450542+0000", 2024-04-19T04:25:39.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:39.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:39.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.450542+0000", 2024-04-19T04:25:39.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:39.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:39.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.450541+0000", 2024-04-19T04:25:39.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:39.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:39.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.450611+0000", 2024-04-19T04:25:39.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9233999999999995e-05 2024-04-19T04:25:39.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:39.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.450620+0000", 2024-04-19T04:25:39.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3330000000000003e-06 2024-04-19T04:25:39.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.450626+0000", 2024-04-19T04:25:39.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.404e-06 2024-04-19T04:25:39.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:39.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.450748+0000", 2024-04-19T04:25:39.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012205399999999999 2024-04-19T04:25:39.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:39.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.450765+0000", 2024-04-19T04:25:39.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6123000000000001e-05 2024-04-19T04:25:39.481 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:39.481 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:39.481 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:39.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.481 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:114811 5.e 5.41814fee (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:39.481 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:39.451158+0000", 2024-04-19T04:25:39.481 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9995441, 2024-04-19T04:25:39.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011491499999999999, 2024-04-19T04:25:39.481 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:39.481 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:39.482 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:39.482 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:39.482 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:39.482 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 114811 2024-04-19T04:25:39.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.482 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:39.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:39.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.451158+0000", 2024-04-19T04:25:39.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:39.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:39.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.451158+0000", 2024-04-19T04:25:39.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:39.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:39.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.451157+0000", 2024-04-19T04:25:39.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:39.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:39.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.451190+0000", 2024-04-19T04:25:39.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3008e-05 2024-04-19T04:25:39.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:39.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.451202+0000", 2024-04-19T04:25:39.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2379e-05 2024-04-19T04:25:39.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:39.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.451210+0000", 2024-04-19T04:25:39.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6129999999999998e-06 2024-04-19T04:25:39.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:39.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:39.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:39.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:39.451258+0000", 2024-04-19T04:25:39.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8559e-05 2024-04-19T04:25:39.484 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:39.484 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:39.484 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:39.484 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:39.485 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:39.485 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 8 2024-04-19T04:25:39.485 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:39.486 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:39.522 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:39.521+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:39.568 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:25:39.610 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:39.610 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:39.611 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:39.611 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:39.611 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:39.621 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:39.666 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:39.665+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:39.725 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:39.721+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:39.726 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:39.751 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:39.751 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:39.751 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:39.751 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:39.754 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:39.755 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:39.756 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 55 16 115465 115449 131.176 129.625 0.014572 0.00761726 2024-04-19T04:25:39.793 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:39.793 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:39.806 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:39.824 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:39.821+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:39.925 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:39.925+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:39.947 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:39.947 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:39.960 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:40.026 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:40.025+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:40.080 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-04-19T04:25:40.096 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:40.096 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:40.109 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:40.127 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:40.125+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:40.228 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:40.229+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:40.240 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:40.240 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:40.254 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:40.329 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:40.325+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:40.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~24s 2024-04-19T04:25:40.385 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:40.385 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:40.399 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:40.431 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:40.429+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:40.526 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:40.526 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:40.531 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:40.529+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:40.540 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:40.633 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:40.633+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:40.667 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:40.667 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:40.680 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:40.733 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:40.733+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:40.757 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 56 16 117505 117489 131.11 127.5 0.011126 0.00762129 2024-04-19T04:25:40.819 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:40.819 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:40.830 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:40.834 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:40.833+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:40.935 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:40.933+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:40.962 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:40.962 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:40.977 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:41.036 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:41.037+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:41.109 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:41.109 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:41.123 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:41.137 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:41.137+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:41.240 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:41.237+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:41.252 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:41.252 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:41.264 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:41.340 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:41.337+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:41.427 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:41.427 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:41.441 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:41.442 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:41.437+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:41.541 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:41.541+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:41.617 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:41.617 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:41.628 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:41.674 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:41.673+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:41.744 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:41.741+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:41.756 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:25:41.757 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 57 16 119553 119537 131.055 128 0.00600625 0.00762428 2024-04-19T04:25:41.757 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:41.758 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:41.770 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:41.845 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:41.845+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:41.901 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:41.901 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:41.911 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:41.915 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:41.931 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:41.932 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:41.932 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:41.932 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:41.936 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:41.937 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:41.946 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:41.945+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:42.047 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:42.045+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:42.092 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:42.092 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:42.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:42.092 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:42.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.092 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:42.092 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:42.092 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 47.859061859999997, 2024-04-19T04:25:42.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:42.092 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.093 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.093 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.093 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.093 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.093 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:42.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.093 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:42.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:42.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:42.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:42.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:42.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:42.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:42.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:42.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:42.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:42.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:42.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:42.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:42.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:42.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:42.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:42.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:42.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:42.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:42.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:42.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:42.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:42.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:42.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:42.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:42.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:42.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:42.098 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.098 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.098 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.098 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:42.098 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:42.098 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 47.855880704, 2024-04-19T04:25:42.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:42.099 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.099 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.099 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.099 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.099 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.099 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:42.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.099 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:42.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:42.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:42.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:42.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:42.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:42.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:42.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:42.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:42.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:42.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:42.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:42.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:42.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:42.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:42.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:42.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:42.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:42.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:42.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:42.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:42.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:42.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:42.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:42.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:42.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:42.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:42.104 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.104 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.104 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.104 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:42.105 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:42.105 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 47.855312599999998, 2024-04-19T04:25:42.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:42.105 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.105 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.105 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:42.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:42.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:42.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:42.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:42.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:42.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.107 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:42.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:42.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.107 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.107 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:42.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:42.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:42.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:42.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:42.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:42.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:42.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:42.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:42.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:42.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:42.109 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.109 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.109 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.109 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:42.109 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:42.110 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 47.854966939000001, 2024-04-19T04:25:42.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:42.110 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.110 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.110 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.110 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.110 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.110 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:42.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.110 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:42.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:42.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:42.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.112 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.112 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:42.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:42.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.112 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.112 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:42.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:42.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.112 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.112 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:42.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:42.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.113 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.113 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:42.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:42.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.113 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.113 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:42.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:42.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.113 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.113 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:42.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:42.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:42.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:42.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:42.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:42.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:42.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:42.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:42.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:42.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:42.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:42.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:42.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:42.115 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.115 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.115 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.116 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:42.116 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:42.116 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 47.854242501000002, 2024-04-19T04:25:42.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:42.116 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.116 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.116 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.116 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:42.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.117 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:42.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.117 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:42.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.117 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:42.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:42.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:42.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:42.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:42.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:42.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:42.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:42.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:42.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:42.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:42.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:42.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:42.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:42.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:42.119 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.120 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.120 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.120 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:42.120 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:42.120 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 47.854235105999997, 2024-04-19T04:25:42.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:42.120 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.120 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.120 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.120 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:42.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:42.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:42.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:42.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:42.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:42.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:42.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:42.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:42.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:42.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:42.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:42.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:42.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:42.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:42.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:42.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:42.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:42.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:42.124 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.124 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.124 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.125 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:42.125 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:42.125 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 47.852409958999999, 2024-04-19T04:25:42.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:42.125 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.125 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.125 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.125 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.125 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.125 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:42.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.125 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:42.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:42.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:42.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:42.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:42.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:42.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:42.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.129 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:42.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:42.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.129 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:42.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:42.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:42.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:42.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:42.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:42.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:42.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:42.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:42.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:42.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:42.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:42.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:42.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:42.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:42.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:42.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:42.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:42.132 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.132 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.132 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.132 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:42.133 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:42.133 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 47.851675753999999, 2024-04-19T04:25:42.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:42.133 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.133 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.133 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.133 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.133 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.133 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:42.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.133 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:42.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:42.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:42.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:42.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:42.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:42.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:42.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:42.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:42.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:42.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:42.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:42.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:42.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:42.137 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:42.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:42.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:42.138 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:42.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:42.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:42.138 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:42.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:42.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:42.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:42.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:42.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.139 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:42.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:42.139 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.139 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.139 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.139 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:42.140 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:42.140 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 47.851141478000002, 2024-04-19T04:25:42.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:42.140 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.140 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.140 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:42.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:42.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:42.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:42.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:42.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.142 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.142 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:42.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:42.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.142 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.142 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:42.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:42.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.143 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.143 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:42.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:42.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.143 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.143 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:42.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:42.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.143 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:42.143 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:42.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:42.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:42.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:42.144 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.144 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.144 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.145 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:42.145 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:42.145 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.134286288999999, 2024-04-19T04:25:42.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:42.145 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.145 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:42.145 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.145 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.145 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.145 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:42.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.146 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:42.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:42.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.147 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.147 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:42.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:42.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.147 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.147 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:42.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:42.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.147 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.147 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:42.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:42.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.148 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:42.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:42.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.148 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:42.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:42.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:42.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:42.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:42.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:42.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:42.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:42.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:42.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:42.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:42.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:42.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:42.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:42.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:42.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.151 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.151 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:42.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:42.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.151 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.151 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.151 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:42.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:42.151 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.151 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.151 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.152 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:42.152 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:42.152 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.114055839999999, 2024-04-19T04:25:42.152 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:42.152 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.152 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:42.152 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.152 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.152 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.152 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:42.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.152 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:42.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:42.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:42.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:42.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.154 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.154 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.154 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:42.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:42.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.154 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.154 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.154 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:42.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:42.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.155 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.155 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.155 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:42.155 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:42.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.155 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.155 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.155 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:42.155 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:42.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.155 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.155 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:42.156 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:42.156 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:42.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.156 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.156 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.156 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:42.156 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:42.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.156 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.156 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.156 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:42.156 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:42.156 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.157 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.157 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.157 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.157 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.157 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:42.157 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:42.157 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.113947982999999, 2024-04-19T04:25:42.157 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:42.157 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.157 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:42.157 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.157 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.158 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.158 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:42.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.158 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:42.158 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:42.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.159 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.159 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:42.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:42.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.159 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.159 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:42.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:42.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.160 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.160 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:42.160 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:42.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.160 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.160 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.160 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:42.160 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:42.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.160 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.160 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.160 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:42.161 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:42.161 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.161 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.161 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:42.161 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:42.161 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:42.161 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.161 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.161 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.161 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:42.161 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:42.161 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.162 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.162 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.162 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:42.162 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:42.162 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.162 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.162 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.162 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.162 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.162 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:42.162 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:42.162 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.111981294, 2024-04-19T04:25:42.163 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:42.163 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.163 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.163 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.163 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.163 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.163 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:42.163 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.163 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.163 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.163 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.163 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:42.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.164 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.164 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.164 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:42.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.164 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.164 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.164 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:42.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:42.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:42.165 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:42.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:42.165 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:42.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.166 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:42.166 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:42.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.166 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.166 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.166 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:42.166 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:42.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.166 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.166 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:42.166 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:42.166 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:42.167 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.167 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.167 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.167 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:42.167 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:42.167 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.167 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.167 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.167 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:42.167 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:42.167 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.167 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.167 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:42.168 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:42.168 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:42.168 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.168 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.168 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:42.168 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:42.168 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:42.168 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.168 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.168 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.169 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:42.169 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:42.169 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.169 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.170 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.170 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.170 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.170 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:42.170 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:42.170 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.108617099, 2024-04-19T04:25:42.170 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:42.170 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.170 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.170 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.170 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.171 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.171 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:42.171 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.171 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.171 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.171 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.171 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:42.171 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.171 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.171 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.171 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.171 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:42.172 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.172 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.172 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.172 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:42.172 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.172 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.172 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.172 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:42.172 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:42.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.173 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.173 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.173 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:42.173 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:42.173 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.173 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.173 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.173 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:42.173 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:42.173 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.173 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.173 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.174 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:42.174 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:42.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.174 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.174 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:42.174 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:42.174 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:42.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.174 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.174 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.174 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:42.174 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:42.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.175 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.175 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.175 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:42.175 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:42.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.175 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.175 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:42.175 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:42.175 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:42.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.176 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.176 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:42.176 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:42.176 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:42.176 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.176 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.176 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.176 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:42.176 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:42.176 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.176 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.176 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.177 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.177 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:42.177 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:42.177 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.104806120999999, 2024-04-19T04:25:42.177 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:42.177 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.177 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.177 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.177 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.177 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.177 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:42.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.178 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:42.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:42.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:42.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:42.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:42.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.180 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:42.180 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:42.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.180 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.180 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.180 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:42.180 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:42.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.180 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.180 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.180 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:42.181 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:42.181 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.181 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.181 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:42.181 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:42.181 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:42.181 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.181 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.181 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.181 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:42.181 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:42.181 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.181 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.182 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.182 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:42.182 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:42.182 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.182 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.182 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:42.182 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:42.182 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:42.182 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.182 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.182 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:42.183 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:42.183 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:42.183 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.183 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.183 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.183 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:42.183 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:42.183 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.183 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.183 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.183 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.183 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.183 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93735 5.1 5:8e609d1b:::benchmark_data_smithi007_19526_object93734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:42.184 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:42.184 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.863105477, 2024-04-19T04:25:42.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048424842000000003, 2024-04-19T04:25:42.184 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.184 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.184 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.184 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.184 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.184 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93735 2024-04-19T04:25:42.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.184 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:42.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:42.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227480+0000", 2024-04-19T04:25:42.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.186 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.186 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227533+0000", 2024-04-19T04:25:42.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2964999999999999e-05 2024-04-19T04:25:42.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.186 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.186 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227542+0000", 2024-04-19T04:25:42.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1449999999999997e-06 2024-04-19T04:25:42.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.187 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.187 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227561+0000", 2024-04-19T04:25:42.187 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9116000000000001e-05 2024-04-19T04:25:42.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.187 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.187 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227610+0000", 2024-04-19T04:25:42.187 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9234000000000003e-05 2024-04-19T04:25:42.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.187 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.187 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227697+0000", 2024-04-19T04:25:42.187 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6682999999999997e-05 2024-04-19T04:25:42.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.188 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.188 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:42.188 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275809+0000", 2024-04-19T04:25:42.188 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048112265000000001 2024-04-19T04:25:42.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.188 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.188 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:42.188 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275845+0000", 2024-04-19T04:25:42.188 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5275999999999999e-05 2024-04-19T04:25:42.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.188 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.189 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.189 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275906+0000", 2024-04-19T04:25:42.189 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1002999999999999e-05 2024-04-19T04:25:42.189 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.189 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.189 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.189 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.189 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93736 5.1 5:852229ec:::benchmark_data_smithi007_19526_object93735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:42.189 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:42.189 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.863001447, 2024-04-19T04:25:42.190 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048414497000000001, 2024-04-19T04:25:42.190 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.190 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.190 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.190 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.190 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.190 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93736 2024-04-19T04:25:42.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.190 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.190 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.191 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:42.191 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.191 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.191 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.191 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.191 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:42.191 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.191 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.191 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.191 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.191 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227584+0000", 2024-04-19T04:25:42.191 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:42.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.192 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.192 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.192 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227624+0000", 2024-04-19T04:25:42.192 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9833000000000003e-05 2024-04-19T04:25:42.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.192 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.192 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.192 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227630+0000", 2024-04-19T04:25:42.192 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0759999999999999e-06 2024-04-19T04:25:42.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.192 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.193 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.193 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227634+0000", 2024-04-19T04:25:42.193 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1570000000000002e-06 2024-04-19T04:25:42.193 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.193 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.193 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.193 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229531+0000", 2024-04-19T04:25:42.193 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018962339999999999 2024-04-19T04:25:42.193 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.193 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.193 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.193 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229662+0000", 2024-04-19T04:25:42.194 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013192999999999999 2024-04-19T04:25:42.194 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.194 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.194 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:42.194 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275915+0000", 2024-04-19T04:25:42.194 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046252140999999997 2024-04-19T04:25:42.194 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.194 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.194 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:42.194 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275944+0000", 2024-04-19T04:25:42.194 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9539999999999998e-05 2024-04-19T04:25:42.194 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.195 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.195 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.195 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275999+0000", 2024-04-19T04:25:42.195 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5062999999999998e-05 2024-04-19T04:25:42.195 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.195 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.195 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.195 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.195 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.195 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:42.195 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:42.195 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.862943764000001, 2024-04-19T04:25:42.195 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:25:42.196 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.196 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.196 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.196 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.196 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.196 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:25:42.196 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.196 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.196 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.196 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.196 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:42.196 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.197 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.197 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.197 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:42.197 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.197 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.197 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.197 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:42.197 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:42.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.197 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.197 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.198 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:25:42.198 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:25:42.198 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.198 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.198 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.198 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:25:42.198 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:25:42.198 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.198 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.198 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.198 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:25:42.198 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:25:42.199 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.199 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.199 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.199 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:25:42.199 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:25:42.199 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.199 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.199 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.199 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:25:42.199 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:25:42.199 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.199 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.199 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:42.200 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:25:42.200 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:25:42.200 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.200 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.200 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:42.200 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:25:42.200 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:25:42.200 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.200 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.200 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.200 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:25:42.200 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:25:42.200 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.201 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.201 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.201 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.201 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.201 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:42.201 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:42.201 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.862349483999999, 2024-04-19T04:25:42.201 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:25:42.201 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.201 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.201 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.201 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.202 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.202 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:25:42.202 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.202 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.202 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.202 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.202 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:42.202 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.202 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.202 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.202 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.202 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:42.203 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.203 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.203 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.203 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:25:42.203 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.203 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.203 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.203 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:25:42.203 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:25:42.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.204 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.204 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.204 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:25:42.204 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:25:42.204 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.204 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.204 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.204 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:25:42.204 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:25:42.204 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.204 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.204 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.204 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:25:42.205 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:25:42.205 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.205 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.205 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.205 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:25:42.205 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:25:42.205 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.205 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.205 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:42.205 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:25:42.205 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:25:42.205 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.205 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.206 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:42.206 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:25:42.206 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:25:42.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.206 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.206 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:42.206 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:25:42.206 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:25:42.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.206 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.206 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:42.207 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:25:42.207 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:25:42.207 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.207 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.207 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.207 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:25:42.207 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:25:42.207 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.207 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.207 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.207 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.207 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.207 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93744 5.1 5:87b91c25:::benchmark_data_smithi007_19526_object93743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:42.208 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:42.208 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.858679932999999, 2024-04-19T04:25:42.208 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044295022000000003, 2024-04-19T04:25:42.208 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.208 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.208 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.208 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.208 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.208 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93744 2024-04-19T04:25:42.208 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.208 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.208 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.208 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.209 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:42.209 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.209 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.209 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.209 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.209 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:42.209 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.209 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.209 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.209 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.209 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231905+0000", 2024-04-19T04:25:42.209 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.210 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.210 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.210 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.210 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231935+0000", 2024-04-19T04:25:42.210 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9442e-05 2024-04-19T04:25:42.210 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.210 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.210 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.210 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264224+0000", 2024-04-19T04:25:42.210 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.032288836000000001 2024-04-19T04:25:42.210 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.210 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.211 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.211 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264238+0000", 2024-04-19T04:25:42.211 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4494999999999999e-05 2024-04-19T04:25:42.211 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.211 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.211 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.211 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268311+0000", 2024-04-19T04:25:42.211 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040726629999999998 2024-04-19T04:25:42.211 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.211 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.211 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.211 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268587+0000", 2024-04-19T04:25:42.211 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00027623200000000001 2024-04-19T04:25:42.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.212 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.212 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:42.212 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276099+0000", 2024-04-19T04:25:42.212 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075116180000000003 2024-04-19T04:25:42.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.212 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.212 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:42.212 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276123+0000", 2024-04-19T04:25:42.212 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4675e-05 2024-04-19T04:25:42.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.212 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.212 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:42.213 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276201+0000", 2024-04-19T04:25:42.213 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7836000000000005e-05 2024-04-19T04:25:42.213 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.213 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.213 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.213 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.213 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.213 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:42.213 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T04:25:42.215 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:42.213+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:42.216 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:42.315 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:42.313+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:42.349 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:42.349 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:42.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.349 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:120728 5.f e47/20 5:f7de4360:::benchmark_data_smithi007_19526_object120727:head v 47'7442, mlcod=47'7440)", 2024-04-19T04:25:42.349 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:42.339267+0000", 2024-04-19T04:25:42.349 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0097862709999999992, 2024-04-19T04:25:42.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0098073299999999995, 2024-04-19T04:25:42.349 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.349 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:42.349 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.339267+0000", 2024-04-19T04:25:42.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.339267+0000", 2024-04-19T04:25:42.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.339266+0000", 2024-04-19T04:25:42.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:42.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.339363+0000", 2024-04-19T04:25:42.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7112000000000001e-05 2024-04-19T04:25:42.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.339372+0000", 2024-04-19T04:25:42.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1379999999999996e-06 2024-04-19T04:25:42.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.339378+0000", 2024-04-19T04:25:42.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3049999999999998e-06 2024-04-19T04:25:42.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.341418+0000", 2024-04-19T04:25:42.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020391540000000001 2024-04-19T04:25:42.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.341438+0000", 2024-04-19T04:25:42.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0426999999999999e-05 2024-04-19T04:25:42.352 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.352 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.352 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.353 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:120735 5.b 5:d741c088:::benchmark_data_smithi007_19526_object120734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:42.353 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:42.340579+0000", 2024-04-19T04:25:42.353 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0084742610000000003, 2024-04-19T04:25:42.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085470389999999993, 2024-04-19T04:25:42.353 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.353 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:42.354 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.354 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.354 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.354 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 120735 2024-04-19T04:25:42.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.355 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.340579+0000", 2024-04-19T04:25:42.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.340579+0000", 2024-04-19T04:25:42.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.340578+0000", 2024-04-19T04:25:42.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.340637+0000", 2024-04-19T04:25:42.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9491999999999999e-05 2024-04-19T04:25:42.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.340648+0000", 2024-04-19T04:25:42.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0907000000000001e-05 2024-04-19T04:25:42.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.340655+0000", 2024-04-19T04:25:42.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2470000000000002e-06 2024-04-19T04:25:42.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.342616+0000", 2024-04-19T04:25:42.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019607880000000002 2024-04-19T04:25:42.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.342734+0000", 2024-04-19T04:25:42.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118126 2024-04-19T04:25:42.357 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.357 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.358 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.358 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:120736 5.b 5:da57de4b:::benchmark_data_smithi007_19526_object120735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:42.358 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:42.340744+0000", 2024-04-19T04:25:42.358 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0083084779999999993, 2024-04-19T04:25:42.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084323149999999993, 2024-04-19T04:25:42.358 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.358 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:42.358 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.358 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.358 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.358 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 120736 2024-04-19T04:25:42.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.359 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.340744+0000", 2024-04-19T04:25:42.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.340744+0000", 2024-04-19T04:25:42.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.340743+0000", 2024-04-19T04:25:42.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.340794+0000", 2024-04-19T04:25:42.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0259000000000001e-05 2024-04-19T04:25:42.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.340803+0000", 2024-04-19T04:25:42.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8060000000000001e-06 2024-04-19T04:25:42.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.340807+0000", 2024-04-19T04:25:42.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5519999999999998e-06 2024-04-19T04:25:42.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.344655+0000", 2024-04-19T04:25:42.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003848256 2024-04-19T04:25:42.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.344760+0000", 2024-04-19T04:25:42.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000104251 2024-04-19T04:25:42.361 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.361 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.361 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.362 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:120737 5.f e47/20 5:fc824ba5:::benchmark_data_smithi007_19526_object120736:head v 47'7443, mlcod=47'7440)", 2024-04-19T04:25:42.362 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:42.343116+0000", 2024-04-19T04:25:42.362 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0059364489999999999, 2024-04-19T04:25:42.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006104216, 2024-04-19T04:25:42.362 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.362 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:42.362 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343116+0000", 2024-04-19T04:25:42.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343116+0000", 2024-04-19T04:25:42.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343115+0000", 2024-04-19T04:25:42.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343169+0000", 2024-04-19T04:25:42.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3650000000000003e-05 2024-04-19T04:25:42.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343180+0000", 2024-04-19T04:25:42.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0772e-05 2024-04-19T04:25:42.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343185+0000", 2024-04-19T04:25:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5620000000000003e-06 2024-04-19T04:25:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343606+0000", 2024-04-19T04:25:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00042015999999999999 2024-04-19T04:25:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343632+0000", 2024-04-19T04:25:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6517e-05 2024-04-19T04:25:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:120739 5.a 5:5fbbc70a:::benchmark_data_smithi007_19526_object120738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:42.343256+0000", 2024-04-19T04:25:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0057965059999999999, 2024-04-19T04:25:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060079599999999997, 2024-04-19T04:25:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 120739 2024-04-19T04:25:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343256+0000", 2024-04-19T04:25:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343256+0000", 2024-04-19T04:25:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343243+0000", 2024-04-19T04:25:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999871 2024-04-19T04:25:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343354+0000", 2024-04-19T04:25:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110547 2024-04-19T04:25:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343385+0000", 2024-04-19T04:25:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1367e-05 2024-04-19T04:25:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343409+0000", 2024-04-19T04:25:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3189000000000001e-05 2024-04-19T04:25:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343461+0000", 2024-04-19T04:25:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1993999999999997e-05 2024-04-19T04:25:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343578+0000", 2024-04-19T04:25:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011725199999999999 2024-04-19T04:25:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:120740 5.d e47/29 5:bb054fa9:::benchmark_data_smithi007_19526_object120739:head v 47'7352, mlcod=47'7350)", 2024-04-19T04:25:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:42.343769+0000", 2024-04-19T04:25:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0052841249999999998, 2024-04-19T04:25:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055390659999999996, 2024-04-19T04:25:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343769+0000", 2024-04-19T04:25:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343769+0000", 2024-04-19T04:25:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343768+0000", 2024-04-19T04:25:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343838+0000", 2024-04-19T04:25:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9714000000000004e-05 2024-04-19T04:25:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343865+0000", 2024-04-19T04:25:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6872e-05 2024-04-19T04:25:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343871+0000", 2024-04-19T04:25:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7649999999999996e-06 2024-04-19T04:25:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343923+0000", 2024-04-19T04:25:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1495000000000001e-05 2024-04-19T04:25:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.343947+0000", 2024-04-19T04:25:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3896e-05 2024-04-19T04:25:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:120741 5.4 5:23874bb1:::benchmark_data_smithi007_19526_object120740:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:42.345110+0000", 2024-04-19T04:25:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0039424380000000004, 2024-04-19T04:25:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0042406450000000004, 2024-04-19T04:25:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 120741 2024-04-19T04:25:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.345110+0000", 2024-04-19T04:25:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.345110+0000", 2024-04-19T04:25:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.345109+0000", 2024-04-19T04:25:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.345166+0000", 2024-04-19T04:25:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6301000000000002e-05 2024-04-19T04:25:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.345176+0000", 2024-04-19T04:25:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0467e-05 2024-04-19T04:25:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.345184+0000", 2024-04-19T04:25:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6149999999999999e-06 2024-04-19T04:25:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.345233+0000", 2024-04-19T04:25:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9555999999999998e-05 2024-04-19T04:25:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.345443+0000", 2024-04-19T04:25:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021004800000000001 2024-04-19T04:25:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.378 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:120742 5.f e47/20 5:f5c25b91:::benchmark_data_smithi007_19526_object120741:head v 47'7444, mlcod=47'7440)", 2024-04-19T04:25:42.378 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:42.345647+0000", 2024-04-19T04:25:42.378 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.003405445, 2024-04-19T04:25:42.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037486429999999999, 2024-04-19T04:25:42.378 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.378 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:42.378 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.345647+0000", 2024-04-19T04:25:42.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.345647+0000", 2024-04-19T04:25:42.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.345647+0000", 2024-04-19T04:25:42.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:42.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.345698+0000", 2024-04-19T04:25:42.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0822999999999998e-05 2024-04-19T04:25:42.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.345713+0000", 2024-04-19T04:25:42.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4868999999999999e-05 2024-04-19T04:25:42.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.345719+0000", 2024-04-19T04:25:42.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4799999999999998e-06 2024-04-19T04:25:42.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.345753+0000", 2024-04-19T04:25:42.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4072000000000002e-05 2024-04-19T04:25:42.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.345772+0000", 2024-04-19T04:25:42.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8876999999999999e-05 2024-04-19T04:25:42.381 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.381 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.381 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.381 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:120747 5.0 5:096b7c26:::benchmark_data_smithi007_19526_object120746:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:42.381 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:42.347125+0000", 2024-04-19T04:25:42.381 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001927853, 2024-04-19T04:25:42.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00231262, 2024-04-19T04:25:42.381 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.382 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:42.382 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.382 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.382 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.382 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 120747 2024-04-19T04:25:42.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.382 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347125+0000", 2024-04-19T04:25:42.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347125+0000", 2024-04-19T04:25:42.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347124+0000", 2024-04-19T04:25:42.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347213+0000", 2024-04-19T04:25:42.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9225e-05 2024-04-19T04:25:42.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347223+0000", 2024-04-19T04:25:42.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0059e-05 2024-04-19T04:25:42.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347230+0000", 2024-04-19T04:25:42.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0680000000000002e-06 2024-04-19T04:25:42.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347270+0000", 2024-04-19T04:25:42.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0717999999999999e-05 2024-04-19T04:25:42.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347441+0000", 2024-04-19T04:25:42.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017091 2024-04-19T04:25:42.385 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.385 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.385 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.385 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:120748 5.d e47/29 5:be9dd036:::benchmark_data_smithi007_19526_object120747:head v 47'7353, mlcod=47'7350)", 2024-04-19T04:25:42.385 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:42.347615+0000", 2024-04-19T04:25:42.385 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0014382349999999999, 2024-04-19T04:25:42.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0018655869999999999, 2024-04-19T04:25:42.385 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.385 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:42.385 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347615+0000", 2024-04-19T04:25:42.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347615+0000", 2024-04-19T04:25:42.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347614+0000", 2024-04-19T04:25:42.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:42.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347665+0000", 2024-04-19T04:25:42.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0878999999999999e-05 2024-04-19T04:25:42.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347671+0000", 2024-04-19T04:25:42.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.857e-06 2024-04-19T04:25:42.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347675+0000", 2024-04-19T04:25:42.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8500000000000004e-06 2024-04-19T04:25:42.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347711+0000", 2024-04-19T04:25:42.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6050000000000002e-05 2024-04-19T04:25:42.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347722+0000", 2024-04-19T04:25:42.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1590000000000001e-05 2024-04-19T04:25:42.388 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.388 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.388 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.389 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:120743 5.f e47/20 5:fc85fe61:::benchmark_data_smithi007_19526_object120742:head v 47'7445, mlcod=47'7440)", 2024-04-19T04:25:42.389 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:42.347872+0000", 2024-04-19T04:25:42.389 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001180632, 2024-04-19T04:25:42.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016472629999999999, 2024-04-19T04:25:42.389 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.389 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:42.389 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347872+0000", 2024-04-19T04:25:42.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347872+0000", 2024-04-19T04:25:42.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347871+0000", 2024-04-19T04:25:42.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:42.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347934+0000", 2024-04-19T04:25:42.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2683999999999998e-05 2024-04-19T04:25:42.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347944+0000", 2024-04-19T04:25:42.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5480000000000007e-06 2024-04-19T04:25:42.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347950+0000", 2024-04-19T04:25:42.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0499999999999997e-06 2024-04-19T04:25:42.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.347991+0000", 2024-04-19T04:25:42.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0861000000000001e-05 2024-04-19T04:25:42.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:42.348010+0000", 2024-04-19T04:25:42.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9488999999999999e-05 2024-04-19T04:25:42.393 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.393 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.393 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.393 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.393 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:42.393 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 11 2024-04-19T04:25:42.394 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:42.395 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:42.416 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:42.417+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:42.519 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:42.517+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:42.520 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:42.520 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:42.520 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:42.520 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:42.520 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:42.533 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:42.618 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:42.617+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:42.699 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:42.699 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:42.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:42.699 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:42.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.699 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:42.699 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:42.699 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.461622124999998, 2024-04-19T04:25:42.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:42.699 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.700 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.700 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.700 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.700 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.700 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:42.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.700 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:42.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:42.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:42.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:42.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:42.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:42.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:42.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:42.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:42.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:42.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:42.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:42.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:42.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:42.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:42.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:42.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:42.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:42.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:42.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:42.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:42.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:42.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:42.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:42.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:42.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:42.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:42.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:42.705 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.705 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.706 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.706 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:42.706 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:42.706 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.457173208999997, 2024-04-19T04:25:42.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:42.706 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.706 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.706 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.706 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.707 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.707 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:42.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.707 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:42.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:42.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:42.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:42.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:42.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:42.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:42.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:42.714 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.714 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.714 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.714 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:42.714 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:42.714 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.629240966000001, 2024-04-19T04:25:42.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:42.714 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.714 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.714 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.715 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.715 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.715 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:42.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.715 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:42.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:42.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:42.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:42.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:42.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:42.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:42.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:42.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:42.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:42.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:42.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:42.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:42.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:42.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:42.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:42.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:42.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:42.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:42.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:42.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:42.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:42.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:42.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:42.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:42.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:42.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:42.720 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.720 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.720 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.720 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:42.720 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:42.720 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.193386928999999, 2024-04-19T04:25:42.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:42.720 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.720 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.720 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.721 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.721 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.721 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:42.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.721 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:42.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:42.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:42.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:42.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:42.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:42.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:42.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:42.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:42.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:42.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:42.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:42.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:42.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:42.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:42.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:42.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:42.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:42.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:42.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:42.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:42.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:42.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:42.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:42.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:42.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:42.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:42.725 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.725 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.726 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.726 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:42.726 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:42.726 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.192956508999998, 2024-04-19T04:25:42.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:42.726 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.726 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.726 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.726 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.726 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.726 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:42.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.727 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:42.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:42.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:42.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:42.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:42.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:42.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:42.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:42.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:42.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:42.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:42.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:42.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:42.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:42.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:42.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:42.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:42.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:42.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:42.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:42.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:42.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:42.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:42.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:42.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:42.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:42.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:42.732 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.732 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.732 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.732 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:42.732 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:42.732 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.190725244999999, 2024-04-19T04:25:42.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:42.732 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.733 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.733 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.733 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.733 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.733 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:42.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.733 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:42.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:42.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:42.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:42.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:42.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:42.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:42.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:42.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:42.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:42.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:42.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:42.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:42.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:42.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:42.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:42.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:42.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:42.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:42.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:42.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:42.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:42.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:42.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:42.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:42.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:42.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:42.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:42.738 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.738 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.738 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.739 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:42.739 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:42.739 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.187328207, 2024-04-19T04:25:42.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:42.739 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.739 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.739 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.739 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.739 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.739 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:42.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.740 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:42.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:42.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:42.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:42.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:42.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:42.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:42.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:42.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:42.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:42.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:42.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:42.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:42.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:42.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:42.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:42.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:42.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:42.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:42.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:42.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:42.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:42.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:42.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:42.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:42.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:42.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:42.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:42.745 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.745 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.745 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.745 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:42.745 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:42.745 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.182200008999999, 2024-04-19T04:25:42.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:42.746 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.746 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.746 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.746 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.746 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.746 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:42.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.746 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:42.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:42.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:42.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:42.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:42.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:42.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:42.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:42.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:42.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:42.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:42.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:42.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:42.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:42.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:42.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:42.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:42.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:42.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:42.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:42.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:42.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:42.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:42.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:42.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:42.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:42.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:42.751 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.751 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.751 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.751 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:42.751 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:42.751 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.868171503999999, 2024-04-19T04:25:42.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:42.752 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.752 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.752 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.752 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.752 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.752 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:42.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.752 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:42.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:42.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:42.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:42.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:42.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:42.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:42.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:42.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:42.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:42.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:42.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:42.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:42.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:42.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:42.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:42.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:42.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:42.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:42.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:42.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:42.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:42.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:42.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:42.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:42.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:42.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:42.757 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.757 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.757 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.757 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:42.757 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:42.757 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.745812094000001, 2024-04-19T04:25:42.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:25:42.758 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.758 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:42.758 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.758 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.758 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.758 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:42.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.758 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.758 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.758 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:42.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:42.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:42.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:42.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:42.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:42.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:42.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:42.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:42.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:42.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:42.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:42.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:42.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:42.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:42.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:42.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:42.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:42.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:42.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:42.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:42.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:42.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:42.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:42.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:42.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:25:42.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:25:42.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:25:42.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:25:42.763 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.763 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.763 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.764 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:42.764 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:42.764 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.740750448, 2024-04-19T04:25:42.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:25:42.764 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.764 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:42.764 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.764 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.764 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.764 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:42.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.764 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:42.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:42.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:42.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:42.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.766 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:42.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:42.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.766 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:42.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:42.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.766 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:42.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:42.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:42.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:42.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:42.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:42.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:42.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:42.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:42.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:42.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:42.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:42.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:42.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:42.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:25:42.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:25:42.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:25:42.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:25:42.769 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.769 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.769 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.769 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:42.769 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:42.770 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.740650536, 2024-04-19T04:25:42.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:25:42.770 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.770 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:42.770 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.770 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.770 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.770 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:42.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.770 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.771 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:42.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.771 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.771 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:42.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.771 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:42.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:42.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:42.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:42.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:42.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:42.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:42.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:42.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:42.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:42.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:42.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:42.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:42.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:42.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:42.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:42.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:42.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:42.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:42.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:42.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:25:42.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:25:42.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:25:42.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:25:42.775 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.775 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.775 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.776 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:42.776 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:42.776 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.740524783000001, 2024-04-19T04:25:42.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:25:42.777 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.777 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:42.777 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.777 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.778 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.778 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:42.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.778 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.778 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:42.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:42.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:42.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:42.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:42.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:42.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:42.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:42.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:42.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:42.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:42.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:42.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:42.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:42.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:42.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:42.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.782 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:42.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:42.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.782 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:42.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:42.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:42.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.782 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:25:42.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:25:42.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:25:42.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:25:42.783 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.783 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.783 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.783 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:42.783 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:42.783 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.736680838000002, 2024-04-19T04:25:42.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:25:42.783 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.784 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.784 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.784 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.784 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.784 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:42.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.784 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:42.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:42.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:42.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:42.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:42.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:42.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:42.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:42.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:42.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:42.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:42.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:42.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:42.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:42.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:42.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:25:42.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:25:42.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:25:42.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:25:42.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:42.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:25:42.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:25:42.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:42.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:25:42.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:25:42.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:25:42.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:25:42.789 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.789 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.789 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.790 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:42.790 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:42.790 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.729509737000001, 2024-04-19T04:25:42.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:25:42.790 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.790 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:42.790 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.790 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.790 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.790 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:42.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.790 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:42.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:42.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:42.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:42.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:42.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:42.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:42.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:42.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:42.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:42.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:42.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:42.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:42.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:42.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:42.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:25:42.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:25:42.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.794 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.794 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:25:42.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:25:42.794 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.794 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.795 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.795 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:42.795 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:42.795 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.729337633, 2024-04-19T04:25:42.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:25:42.795 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.795 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:42.795 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.795 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.796 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.796 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:42.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.796 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:42.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:42.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:42.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:42.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:42.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:42.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:42.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:42.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:42.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:42.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:42.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:42.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:42.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:42.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:42.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:25:42.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:25:42.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:25:42.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:25:42.799 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.799 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.799 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.800 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:42.800 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:42.800 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.729274508, 2024-04-19T04:25:42.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:25:42.800 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.800 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.800 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:42.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.800 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:42.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:42.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:42.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:42.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:42.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:42.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:42.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:42.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:42.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:42.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:42.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:42.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:42.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:42.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:42.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:25:42.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:25:42.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:25:42.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:25:42.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:42.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:25:42.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:25:42.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:42.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:25:42.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:25:42.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:25:42.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:25:42.805 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.805 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.805 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.806 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:42.806 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:42.806 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.729145911, 2024-04-19T04:25:42.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:25:42.806 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.806 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.806 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.806 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.806 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.806 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:42.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.806 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:42.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:42.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:42.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:42.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:42.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:42.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:42.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:42.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:42.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:42.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:42.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:42.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:42.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:42.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:42.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:25:42.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:25:42.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:25:42.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:25:42.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:42.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:25:42.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:25:42.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:42.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:25:42.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:25:42.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:25:42.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:25:42.811 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.811 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.811 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.812 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:42.812 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:42.812 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.72907794, 2024-04-19T04:25:42.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:25:42.812 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.812 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.812 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.812 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.812 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.812 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:42.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.812 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:42.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:42.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:42.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:42.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:42.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:42.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:42.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:42.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:42.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:42.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:42.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:42.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:42.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:42.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:42.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:25:42.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:25:42.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:25:42.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:25:42.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:42.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:25:42.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:25:42.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:42.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:25:42.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:25:42.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:25:42.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:25:42.817 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.817 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.817 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.817 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:111654 5.0 5:0b6b473d:::benchmark_data_smithi007_19526_object111653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:42.817 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:42.817 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.7812868340000003, 2024-04-19T04:25:42.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023122753999999999, 2024-04-19T04:25:42.818 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:42.818 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:42.818 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:42.818 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:42.818 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.818 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 111654 2024-04-19T04:25:42.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.818 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:42.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:42.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:42.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:42.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:42.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:42.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:42.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915865+0000", 2024-04-19T04:25:42.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:42.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:42.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915897+0000", 2024-04-19T04:25:42.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1708999999999997e-05 2024-04-19T04:25:42.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:42.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915905+0000", 2024-04-19T04:25:42.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.481e-06 2024-04-19T04:25:42.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915911+0000", 2024-04-19T04:25:42.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6880000000000002e-06 2024-04-19T04:25:42.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:42.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925564+0000", 2024-04-19T04:25:42.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096527039999999998 2024-04-19T04:25:42.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:42.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925771+0000", 2024-04-19T04:25:42.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020717199999999999 2024-04-19T04:25:42.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:42.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938888+0000", 2024-04-19T04:25:42.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013117105 2024-04-19T04:25:42.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:42.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938931+0000", 2024-04-19T04:25:42.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2447000000000002e-05 2024-04-19T04:25:42.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:42.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:42.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:42.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938989+0000", 2024-04-19T04:25:42.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7997000000000001e-05 2024-04-19T04:25:42.822 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.822 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.822 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.822 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:42.822 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:42.822 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:42.823 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 58 16 121597 121581 130.998 127.75 0.0088293 0.00762768 2024-04-19T04:25:42.824 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:42.821+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:42.824 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:42.924 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:42.921+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:42.959 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:42.959 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:42.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.960 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:122000 5.2 5:4409b9f2:::benchmark_data_smithi007_19526_object121999:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:42.960 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:42.951331+0000", 2024-04-19T04:25:42.960 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0075137529999999998, 2024-04-19T04:25:42.960 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075484059999999997, 2024-04-19T04:25:42.960 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.960 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:42.960 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.960 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.960 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.960 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 122000 2024-04-19T04:25:42.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.960 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.951331+0000", 2024-04-19T04:25:42.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.951331+0000", 2024-04-19T04:25:42.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.951330+0000", 2024-04-19T04:25:42.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:42.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.951367+0000", 2024-04-19T04:25:42.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.748e-05 2024-04-19T04:25:42.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.951381+0000", 2024-04-19T04:25:42.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3067999999999999e-05 2024-04-19T04:25:42.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.951387+0000", 2024-04-19T04:25:42.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6969999999999996e-06 2024-04-19T04:25:42.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.953596+0000", 2024-04-19T04:25:42.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002208902 2024-04-19T04:25:42.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.953722+0000", 2024-04-19T04:25:42.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012602800000000001 2024-04-19T04:25:42.963 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.963 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.964 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.964 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:122003 5.d 5:b76810c4:::benchmark_data_smithi007_19526_object122002:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:42.964 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:42.952404+0000", 2024-04-19T04:25:42.964 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0064399870000000003, 2024-04-19T04:25:42.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0065656009999999999, 2024-04-19T04:25:42.964 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.964 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:42.964 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.964 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.964 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.964 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 122003 2024-04-19T04:25:42.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.965 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.965 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.965 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.952404+0000", 2024-04-19T04:25:42.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.965 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.965 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.952404+0000", 2024-04-19T04:25:42.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.965 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.966 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.952403+0000", 2024-04-19T04:25:42.966 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.966 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.966 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.952437+0000", 2024-04-19T04:25:42.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.3518e-05 2024-04-19T04:25:42.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.952447+0000", 2024-04-19T04:25:42.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.713e-06 2024-04-19T04:25:42.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.952453+0000", 2024-04-19T04:25:42.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6680000000000004e-06 2024-04-19T04:25:42.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.957905+0000", 2024-04-19T04:25:42.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0054512249999999996 2024-04-19T04:25:42.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958052+0000", 2024-04-19T04:25:42.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014737300000000001 2024-04-19T04:25:42.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:42.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958203+0000", 2024-04-19T04:25:42.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000151447 2024-04-19T04:25:42.968 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.969 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.969 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.969 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:122006 5.5 5.876e2155 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:42.969 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:42.952729+0000", 2024-04-19T04:25:42.969 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0061152649999999999, 2024-04-19T04:25:42.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0063232330000000002, 2024-04-19T04:25:42.969 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.969 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:42.969 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.969 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.969 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.969 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 122006 2024-04-19T04:25:42.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.970 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.952729+0000", 2024-04-19T04:25:42.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.952729+0000", 2024-04-19T04:25:42.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.971 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.971 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.952728+0000", 2024-04-19T04:25:42.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.971 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.971 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.952815+0000", 2024-04-19T04:25:42.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7435999999999994e-05 2024-04-19T04:25:42.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.971 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.971 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.952828+0000", 2024-04-19T04:25:42.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2106000000000001e-05 2024-04-19T04:25:42.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.952836+0000", 2024-04-19T04:25:42.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9179999999999994e-06 2024-04-19T04:25:42.972 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.972 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.972 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.972 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:122007 5.2 5:4875e94e:::benchmark_data_smithi007_19526_object122006:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:42.972 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:42.954174+0000", 2024-04-19T04:25:42.972 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0046700140000000001, 2024-04-19T04:25:42.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0049446330000000004, 2024-04-19T04:25:42.972 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.972 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:42.973 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.973 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.973 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.973 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 122007 2024-04-19T04:25:42.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.973 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.954174+0000", 2024-04-19T04:25:42.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.954174+0000", 2024-04-19T04:25:42.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.974 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.974 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.954173+0000", 2024-04-19T04:25:42.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.974 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.974 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.954247+0000", 2024-04-19T04:25:42.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3690999999999996e-05 2024-04-19T04:25:42.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.974 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.975 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.954274+0000", 2024-04-19T04:25:42.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.7149999999999999e-05 2024-04-19T04:25:42.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.975 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.975 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.954313+0000", 2024-04-19T04:25:42.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.8646000000000002e-05 2024-04-19T04:25:42.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.975 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.975 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.956281+0000", 2024-04-19T04:25:42.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0019682879999999999 2024-04-19T04:25:42.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.956414+0000", 2024-04-19T04:25:42.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013243200000000001 2024-04-19T04:25:42.976 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.976 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.976 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.976 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:122010 5.1 5:8efc9933:::benchmark_data_smithi007_19526_object122009:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:42.976 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:42.955727+0000", 2024-04-19T04:25:42.976 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0031178249999999998, 2024-04-19T04:25:42.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034724589999999998, 2024-04-19T04:25:42.976 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.976 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:42.977 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.977 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.977 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.977 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 122010 2024-04-19T04:25:42.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.977 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.955727+0000", 2024-04-19T04:25:42.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.955727+0000", 2024-04-19T04:25:42.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.978 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.978 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.978 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.955725+0000", 2024-04-19T04:25:42.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:42.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.978 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.978 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.978 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.955809+0000", 2024-04-19T04:25:42.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3299000000000003e-05 2024-04-19T04:25:42.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.978 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.979 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.955823+0000", 2024-04-19T04:25:42.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4791e-05 2024-04-19T04:25:42.979 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.979 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.955833+0000", 2024-04-19T04:25:42.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2070000000000001e-06 2024-04-19T04:25:42.979 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.979 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.955997+0000", 2024-04-19T04:25:42.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016467399999999999 2024-04-19T04:25:42.979 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.980 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.980 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.956203+0000", 2024-04-19T04:25:42.980 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000206128 2024-04-19T04:25:42.980 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.980 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.980 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.980 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:121997 5.d e47/29)", 2024-04-19T04:25:42.980 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:42.956503+0000", 2024-04-19T04:25:42.980 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.002341063, 2024-04-19T04:25:42.980 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027494440000000002, 2024-04-19T04:25:42.980 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.981 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:42.981 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.981 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.981 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.956503+0000", 2024-04-19T04:25:42.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.981 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.981 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.956503+0000", 2024-04-19T04:25:42.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.981 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.956502+0000", 2024-04-19T04:25:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.956508+0000", 2024-04-19T04:25:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4090000000000002e-06 2024-04-19T04:25:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.956526+0000", 2024-04-19T04:25:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7768e-05 2024-04-19T04:25:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.956532+0000", 2024-04-19T04:25:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7939999999999997e-06 2024-04-19T04:25:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:122012 5.1 5:85bef700:::benchmark_data_smithi007_19526_object122011:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:42.957348+0000", 2024-04-19T04:25:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0014966389999999999, 2024-04-19T04:25:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0019356449999999999, 2024-04-19T04:25:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 122012 2024-04-19T04:25:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.957348+0000", 2024-04-19T04:25:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.957348+0000", 2024-04-19T04:25:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.957347+0000", 2024-04-19T04:25:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.957402+0000", 2024-04-19T04:25:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5472e-05 2024-04-19T04:25:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.957413+0000", 2024-04-19T04:25:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0828e-05 2024-04-19T04:25:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.957421+0000", 2024-04-19T04:25:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5140000000000004e-06 2024-04-19T04:25:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.959114+0000", 2024-04-19T04:25:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016931050000000001 2024-04-19T04:25:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.959233+0000", 2024-04-19T04:25:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000119145 2024-04-19T04:25:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:122013 5.c 5:303fdaab:::benchmark_data_smithi007_19526_object122012:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:42.957701+0000", 2024-04-19T04:25:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001142992, 2024-04-19T04:25:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016214179999999999, 2024-04-19T04:25:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 122013 2024-04-19T04:25:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.957701+0000", 2024-04-19T04:25:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.957701+0000", 2024-04-19T04:25:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.957700+0000", 2024-04-19T04:25:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.957787+0000", 2024-04-19T04:25:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6236999999999994e-05 2024-04-19T04:25:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.957807+0000", 2024-04-19T04:25:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.031e-05 2024-04-19T04:25:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.957815+0000", 2024-04-19T04:25:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1699999999999997e-06 2024-04-19T04:25:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.957916+0000", 2024-04-19T04:25:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000101061 2024-04-19T04:25:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958060+0000", 2024-04-19T04:25:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143437 2024-04-19T04:25:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:122015 5.f 5:f2d1257c:::benchmark_data_smithi007_19526_object122014:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:42.958397+0000", 2024-04-19T04:25:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.000447818, 2024-04-19T04:25:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00096789100000000002, 2024-04-19T04:25:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 122015 2024-04-19T04:25:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958397+0000", 2024-04-19T04:25:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958397+0000", 2024-04-19T04:25:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958396+0000", 2024-04-19T04:25:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958469+0000", 2024-04-19T04:25:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3629999999999998e-05 2024-04-19T04:25:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958480+0000", 2024-04-19T04:25:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1134999999999999e-05 2024-04-19T04:25:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958486+0000", 2024-04-19T04:25:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2970000000000003e-06 2024-04-19T04:25:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958541+0000", 2024-04-19T04:25:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5525000000000001e-05 2024-04-19T04:25:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958682+0000", 2024-04-19T04:25:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014058899999999999 2024-04-19T04:25:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958845+0000", 2024-04-19T04:25:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000163039 2024-04-19T04:25:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:122016 5.f 5.5524ee3f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:42.958498+0000", 2024-04-19T04:25:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00034630499999999999, 2024-04-19T04:25:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00091929000000000002, 2024-04-19T04:25:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 122016 2024-04-19T04:25:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.997 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:42.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:42.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958498+0000", 2024-04-19T04:25:42.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:42.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958498+0000", 2024-04-19T04:25:42.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:42.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:42.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958497+0000", 2024-04-19T04:25:42.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:42.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:42.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958543+0000", 2024-04-19T04:25:42.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6087000000000001e-05 2024-04-19T04:25:42.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:42.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958557+0000", 2024-04-19T04:25:42.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:42.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.999 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:42.999 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958564+0000", 2024-04-19T04:25:42.999 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1860000000000003e-06 2024-04-19T04:25:42.999 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.999 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:42.999 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:42.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:42.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:42.999 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:122017 5.f 5.7330685f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:42.999 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:42.958654+0000", 2024-04-19T04:25:42.999 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00019056100000000001, 2024-04-19T04:25:42.999 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00080902000000000003, 2024-04-19T04:25:42.999 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:42.999 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:43.000 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.000 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.000 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.000 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 122017 2024-04-19T04:25:43.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.000 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.000 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.000 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958654+0000", 2024-04-19T04:25:43.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.000 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958654+0000", 2024-04-19T04:25:43.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958653+0000", 2024-04-19T04:25:43.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958729+0000", 2024-04-19T04:25:43.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6186999999999994e-05 2024-04-19T04:25:43.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.002 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958741+0000", 2024-04-19T04:25:43.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2145e-05 2024-04-19T04:25:43.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.002 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958749+0000", 2024-04-19T04:25:43.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4769999999999997e-06 2024-04-19T04:25:43.002 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.002 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.002 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.002 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:122018 5.6 5:60d65654:::benchmark_data_smithi007_19526_object122017:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:43.003 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:42.958756+0000", 2024-04-19T04:25:43.003 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.8288000000000006e-05, 2024-04-19T04:25:43.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000744249, 2024-04-19T04:25:43.003 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.003 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:43.003 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.003 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.003 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.003 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 122018 2024-04-19T04:25:43.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.003 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.003 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.003 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958756+0000", 2024-04-19T04:25:43.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.004 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.004 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958756+0000", 2024-04-19T04:25:43.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.004 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.004 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958755+0000", 2024-04-19T04:25:43.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:43.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.004 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.004 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958796+0000", 2024-04-19T04:25:43.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0649999999999999e-05 2024-04-19T04:25:43.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958805+0000", 2024-04-19T04:25:43.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6009999999999995e-06 2024-04-19T04:25:43.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958813+0000", 2024-04-19T04:25:43.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5860000000000005e-06 2024-04-19T04:25:43.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958865+0000", 2024-04-19T04:25:43.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2080999999999998e-05 2024-04-19T04:25:43.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.958991+0000", 2024-04-19T04:25:43.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012611299999999999 2024-04-19T04:25:43.006 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.006 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.006 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.006 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:122019 5.9 5.dcbdf599 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:43.007 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:42.959424+0000", 2024-04-19T04:25:43.007 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9994202, 2024-04-19T04:25:43.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012567000000000001, 2024-04-19T04:25:43.007 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.007 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:43.007 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.007 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.007 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.007 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 122019 2024-04-19T04:25:43.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.007 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.007 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.007 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.959424+0000", 2024-04-19T04:25:43.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.959424+0000", 2024-04-19T04:25:43.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.959423+0000", 2024-04-19T04:25:43.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.959496+0000", 2024-04-19T04:25:43.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2939000000000001e-05 2024-04-19T04:25:43.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.959507+0000", 2024-04-19T04:25:43.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1107999999999999e-05 2024-04-19T04:25:43.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.959514+0000", 2024-04-19T04:25:43.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.742e-06 2024-04-19T04:25:43.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.959558+0000", 2024-04-19T04:25:43.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4042000000000003e-05 2024-04-19T04:25:43.010 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.010 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.010 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.010 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.010 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.010 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:121993 5.2 5:4a8fd560:::benchmark_data_smithi007_19526_object121992:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:43.010 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:42.948963+0000", 2024-04-19T04:25:43.010 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0098814279999999994, 2024-04-19T04:25:43.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010658041, 2024-04-19T04:25:43.010 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.010 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:43.010 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.010 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.011 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.011 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 121993 2024-04-19T04:25:43.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.011 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.011 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.011 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.011 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.948963+0000", 2024-04-19T04:25:43.011 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.011 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.011 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.011 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.948963+0000", 2024-04-19T04:25:43.011 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.011 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.012 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.012 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.948962+0000", 2024-04-19T04:25:43.012 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:43.012 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.012 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.012 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.012 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949036+0000", 2024-04-19T04:25:43.012 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3576000000000002e-05 2024-04-19T04:25:43.012 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.012 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.012 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.012 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949047+0000", 2024-04-19T04:25:43.012 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1527e-05 2024-04-19T04:25:43.012 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.013 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.013 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.013 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949051+0000", 2024-04-19T04:25:43.013 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.8190000000000002e-06 2024-04-19T04:25:43.013 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.013 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.013 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.013 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949105+0000", 2024-04-19T04:25:43.013 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3486000000000003e-05 2024-04-19T04:25:43.013 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.013 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.013 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.013 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949302+0000", 2024-04-19T04:25:43.013 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000197028 2024-04-19T04:25:43.013 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.014 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.014 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.014 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:121995 5.d 5:bb978edf:::benchmark_data_smithi007_19526_object121994:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:43.014 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:42.949256+0000", 2024-04-19T04:25:43.014 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0095881100000000004, 2024-04-19T04:25:43.014 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010442442999999999, 2024-04-19T04:25:43.014 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.014 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:43.014 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.014 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.014 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.014 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 121995 2024-04-19T04:25:43.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.015 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.015 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949256+0000", 2024-04-19T04:25:43.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.015 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949256+0000", 2024-04-19T04:25:43.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.015 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949255+0000", 2024-04-19T04:25:43.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949291+0000", 2024-04-19T04:25:43.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6063999999999999e-05 2024-04-19T04:25:43.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949301+0000", 2024-04-19T04:25:43.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7729999999999994e-06 2024-04-19T04:25:43.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.017 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949308+0000", 2024-04-19T04:25:43.017 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8530000000000003e-06 2024-04-19T04:25:43.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.017 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.017 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.017 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949357+0000", 2024-04-19T04:25:43.017 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8795999999999998e-05 2024-04-19T04:25:43.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.017 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.017 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.017 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949478+0000", 2024-04-19T04:25:43.017 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121409 2024-04-19T04:25:43.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.017 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.018 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:43.018 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949699+0000", 2024-04-19T04:25:43.018 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000220609 2024-04-19T04:25:43.018 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.018 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.018 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:43.018 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.953702+0000", 2024-04-19T04:25:43.018 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040030700000000001 2024-04-19T04:25:43.018 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.018 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.018 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.018 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.018 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.018 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:121997 5.d 5:b419d90c:::benchmark_data_smithi007_19526_object121996:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T04:25:43.018 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:42.949743+0000", 2024-04-19T04:25:43.019 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0091017100000000007, 2024-04-19T04:25:43.019 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010054705000000001, 2024-04-19T04:25:43.019 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.019 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:43.019 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.019 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.019 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.019 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 121997 2024-04-19T04:25:43.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.019 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.019 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.019 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.019 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949743+0000", 2024-04-19T04:25:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949743+0000", 2024-04-19T04:25:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949742+0000", 2024-04-19T04:25:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949770+0000", 2024-04-19T04:25:43.021 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8123000000000002e-05 2024-04-19T04:25:43.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.021 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.021 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949782+0000", 2024-04-19T04:25:43.021 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2092e-05 2024-04-19T04:25:43.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.021 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.021 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.949793+0000", 2024-04-19T04:25:43.021 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0068000000000001e-05 2024-04-19T04:25:43.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.021 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.021 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.953724+0000", 2024-04-19T04:25:43.022 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0039319389999999997 2024-04-19T04:25:43.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.022 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.022 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.953866+0000", 2024-04-19T04:25:43.022 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014157500000000001 2024-04-19T04:25:43.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.022 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:43.022 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:42.954014+0000", 2024-04-19T04:25:43.022 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000147737 2024-04-19T04:25:43.022 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.022 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.022 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.023 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.023 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:43.023 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 16 2024-04-19T04:25:43.023 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:43.024 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:43.025 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:43.025+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:43.093 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-04-19T04:25:43.126 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:43.125+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:43.158 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:43.158 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:43.158 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:43.158 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:43.159 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:43.172 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:43.227 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:43.225+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:43.307 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:43.307 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:43.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:43.307 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:43.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.307 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:43.307 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:43.307 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 49.074533778000003, 2024-04-19T04:25:43.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:43.307 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.308 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.308 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.308 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.308 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.308 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:43.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.308 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:43.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:43.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.309 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:43.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.309 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:43.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:43.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:43.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:43.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:43.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:43.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:43.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:43.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:43.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:43.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:43.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:43.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:43.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:43.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:43.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:43.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:43.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:43.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:43.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:43.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:43.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:43.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:43.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:43.313 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.313 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.313 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.313 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:43.313 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:43.313 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 49.071352621999999, 2024-04-19T04:25:43.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:43.314 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.314 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.314 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.314 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.314 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.314 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:43.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.314 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:43.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:43.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:43.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.316 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.316 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:43.316 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:43.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.316 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.316 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:43.316 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:43.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.316 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.316 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:43.316 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:43.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 49.070784518000004, 2024-04-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:43.321 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.321 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.321 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.321 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:43.321 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:43.321 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.321 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.321 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.321 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:43.321 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:43.321 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.321 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.321 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.321 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:43.322 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:43.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.322 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.322 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.322 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:43.322 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:43.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.322 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.322 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.322 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:43.322 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:43.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.322 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.322 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:43.322 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:43.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:43.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.323 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.323 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.323 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:43.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:43.323 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.323 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.323 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.323 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.323 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:43.323 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:43.323 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 49.070438856999999, 2024-04-19T04:25:43.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:43.324 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.324 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.324 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.324 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.324 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.324 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:43.324 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.324 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.324 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.324 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.324 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:43.324 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.324 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.324 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.324 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.325 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:43.325 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.325 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.325 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:43.325 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.325 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.325 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:43.325 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:43.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.325 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.326 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:43.326 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:43.326 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.326 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.326 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.326 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:43.326 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:43.326 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.326 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.326 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.326 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:43.326 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:43.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.327 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.327 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:43.327 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:43.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.327 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:43.327 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:43.327 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:43.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.327 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:43.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:43.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:43.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:43.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:43.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:43.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:43.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:43.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:43.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.329 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:43.329 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:43.329 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.329 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.329 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.329 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.329 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:43.329 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:43.329 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 49.069714419, 2024-04-19T04:25:43.329 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:43.329 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.329 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.329 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.330 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:43.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.330 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:43.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.330 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:43.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:43.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:43.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:43.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:43.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:43.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:43.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.332 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.332 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:43.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:43.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.332 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.332 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:43.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:43.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.332 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:43.332 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:43.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:43.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.333 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:43.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:43.333 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.333 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.333 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.333 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:43.333 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:43.333 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 49.069707024000003, 2024-04-19T04:25:43.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:43.333 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.333 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.334 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:43.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:43.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:43.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:43.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:43.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:43.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:43.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:43.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:43.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:43.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:43.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:43.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:43.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:43.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:43.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:43.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:43.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.337 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.337 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:43.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:43.337 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.337 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.337 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.337 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:43.337 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:43.337 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 49.067881876999998, 2024-04-19T04:25:43.338 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:43.338 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.338 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.338 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.338 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.338 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.338 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:43.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.338 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.338 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.338 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:43.338 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:43.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:43.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:43.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:43.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:43.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:43.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:43.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:43.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:43.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:43.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.342 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:43.342 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:43.342 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:43.342 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.342 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.342 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:43.342 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:43.342 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:43.342 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.342 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.342 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.342 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:43.342 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:43.342 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.343 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.343 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.343 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:43.343 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:43.343 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 49.067147671999997, 2024-04-19T04:25:43.343 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:43.343 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.343 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.343 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.343 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.343 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.343 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:43.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.343 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.344 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.344 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:43.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.344 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.344 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:43.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.344 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.344 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:43.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.345 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.345 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.345 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:43.345 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:43.345 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.345 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.345 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:43.345 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:43.345 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.345 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.345 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:43.345 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:43.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.346 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.346 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:43.346 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:43.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.346 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.346 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:43.346 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:43.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.346 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:43.346 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:43.346 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:43.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:43.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:43.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:43.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:43.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:43.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:43.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:43.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:43.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:43.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.348 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.348 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.348 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:43.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:43.348 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.348 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.348 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.348 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.348 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:43.348 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:43.348 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 49.066613396000001, 2024-04-19T04:25:43.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:43.348 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.349 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.349 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.349 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.349 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:43.349 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.349 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.349 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.350 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:43.350 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.350 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.350 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.350 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.350 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:43.350 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.350 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.350 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.350 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.350 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:43.350 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:43.350 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.350 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.351 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.351 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:43.351 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:43.351 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.351 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.351 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.351 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:43.351 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:43.351 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.351 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.351 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.351 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:43.351 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:43.351 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.352 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.352 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.352 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:43.352 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:43.352 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.352 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.352 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:43.352 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:43.352 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:43.352 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.352 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.352 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.352 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:43.352 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:43.352 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.353 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.353 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.353 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:43.353 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:43.353 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.349758207000001, 2024-04-19T04:25:43.353 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:43.353 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.353 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:43.353 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.353 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.353 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.353 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:43.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.354 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.354 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.354 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:43.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.354 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.354 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:43.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.354 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.354 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:43.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:43.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:43.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:43.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:43.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:43.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.356 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:43.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:43.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.356 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:43.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:43.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.356 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:43.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:43.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:43.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:43.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:43.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.357 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:43.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:43.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:43.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.357 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:43.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:43.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:43.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:43.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:43.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:43.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:43.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:43.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:43.358 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.359 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.359 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.359 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.359 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:43.359 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:43.359 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.329527758000001, 2024-04-19T04:25:43.359 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:43.359 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.359 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:43.359 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.359 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.359 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.359 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:43.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.360 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.360 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:43.360 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.360 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:43.360 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:43.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:43.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:43.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:43.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:43.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:43.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:43.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:43.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.362 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:43.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:43.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.362 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:43.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:43.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:43.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.363 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.363 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.363 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:43.363 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:43.363 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.363 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.363 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.363 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:43.363 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:43.363 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.363 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.363 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.363 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.363 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.363 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:43.364 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:43.364 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.329419901000001, 2024-04-19T04:25:43.364 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:43.364 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.364 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:43.364 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.364 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.364 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.364 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:43.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.364 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.364 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.364 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.364 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:43.364 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:43.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:43.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:43.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:43.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:43.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:43.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:43.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:43.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:43.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:43.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:43.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:43.367 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:43.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:43.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.367 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:43.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:43.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:43.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:43.368 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.368 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.368 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.368 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:43.368 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:43.368 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.327453212000002, 2024-04-19T04:25:43.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:43.368 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.368 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.368 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.368 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.369 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.369 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:43.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.369 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:43.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:43.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:43.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:43.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:43.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:43.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:43.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:43.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:43.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:43.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:43.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:43.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:43.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:43.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:43.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:43.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:43.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:43.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:43.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:43.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:43.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:43.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:43.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:43.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:43.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:43.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:43.373 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.373 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.373 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.373 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:43.374 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:43.374 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.324089016999999, 2024-04-19T04:25:43.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:43.374 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.374 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.374 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.374 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.374 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.374 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:43.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.374 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.374 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:43.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:43.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:43.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:43.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:43.376 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.376 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.376 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:43.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:43.376 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.376 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.376 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:43.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:43.376 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.376 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.376 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:43.377 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:43.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:43.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:43.377 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:43.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:43.377 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:43.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:43.378 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:43.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.378 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:43.378 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:43.378 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:43.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.378 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:43.378 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:43.378 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:43.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.378 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.378 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:43.379 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:43.379 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.379 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.379 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.379 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.379 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.379 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:43.379 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:43.379 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.320278039000002, 2024-04-19T04:25:43.379 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:43.379 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.379 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.379 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.379 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.379 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.380 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:43.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.380 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.380 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.380 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.380 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:43.380 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.380 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.380 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.380 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:43.380 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.380 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.380 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:43.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.381 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:43.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:43.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.381 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:43.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:43.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.381 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.382 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:43.382 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:43.382 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.382 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.382 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.382 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:43.382 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:43.382 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.382 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.382 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:43.382 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:43.382 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:43.382 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.382 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.382 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:43.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:43.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:43.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:43.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:43.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:43.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:43.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:43.384 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:43.384 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:43.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.384 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.384 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.384 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:43.384 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:43.384 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.384 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.384 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.384 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.384 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93735 5.1 5:8e609d1b:::benchmark_data_smithi007_19526_object93734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:43.384 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:43.384 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.078577395, 2024-04-19T04:25:43.385 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048424842000000003, 2024-04-19T04:25:43.385 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.385 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.385 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.385 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.385 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.385 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93735 2024-04-19T04:25:43.385 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.385 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.385 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.385 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.385 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:43.385 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.385 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.385 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.386 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.386 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:43.386 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.386 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.386 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.386 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.386 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227480+0000", 2024-04-19T04:25:43.386 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.386 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.386 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.386 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.386 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227533+0000", 2024-04-19T04:25:43.386 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2964999999999999e-05 2024-04-19T04:25:43.386 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.387 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.387 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227542+0000", 2024-04-19T04:25:43.387 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1449999999999997e-06 2024-04-19T04:25:43.387 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.387 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.387 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227561+0000", 2024-04-19T04:25:43.387 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9116000000000001e-05 2024-04-19T04:25:43.387 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.387 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.387 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227610+0000", 2024-04-19T04:25:43.387 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9234000000000003e-05 2024-04-19T04:25:43.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227697+0000", 2024-04-19T04:25:43.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6682999999999997e-05 2024-04-19T04:25:43.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:43.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275809+0000", 2024-04-19T04:25:43.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048112265000000001 2024-04-19T04:25:43.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:43.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275845+0000", 2024-04-19T04:25:43.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5275999999999999e-05 2024-04-19T04:25:43.389 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.389 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.389 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.389 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275906+0000", 2024-04-19T04:25:43.389 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1002999999999999e-05 2024-04-19T04:25:43.389 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.389 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.389 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.389 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.389 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.389 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93736 5.1 5:852229ec:::benchmark_data_smithi007_19526_object93735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:43.389 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:43.389 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.078473365000001, 2024-04-19T04:25:43.389 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048414497000000001, 2024-04-19T04:25:43.389 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.390 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.390 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.390 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.390 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.390 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93736 2024-04-19T04:25:43.390 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.390 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.390 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.390 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.390 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:43.390 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.390 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.390 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.390 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.391 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:43.391 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.391 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.391 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.391 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.391 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227584+0000", 2024-04-19T04:25:43.391 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:43.391 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.391 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.391 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.391 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227624+0000", 2024-04-19T04:25:43.391 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9833000000000003e-05 2024-04-19T04:25:43.391 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.391 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.391 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.392 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227630+0000", 2024-04-19T04:25:43.392 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0759999999999999e-06 2024-04-19T04:25:43.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.392 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.392 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.392 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227634+0000", 2024-04-19T04:25:43.392 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1570000000000002e-06 2024-04-19T04:25:43.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.392 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.392 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.392 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229531+0000", 2024-04-19T04:25:43.392 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018962339999999999 2024-04-19T04:25:43.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.392 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.393 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.393 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229662+0000", 2024-04-19T04:25:43.393 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013192999999999999 2024-04-19T04:25:43.393 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.393 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.393 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:43.393 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275915+0000", 2024-04-19T04:25:43.393 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046252140999999997 2024-04-19T04:25:43.393 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.393 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.393 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:43.393 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275944+0000", 2024-04-19T04:25:43.393 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9539999999999998e-05 2024-04-19T04:25:43.393 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.393 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.394 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.394 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275999+0000", 2024-04-19T04:25:43.394 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5062999999999998e-05 2024-04-19T04:25:43.394 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.394 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.394 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.394 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.394 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.394 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:43.394 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:43.394 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.078415681999999, 2024-04-19T04:25:43.394 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:25:43.394 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.394 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.395 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.395 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.395 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.395 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:25:43.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.395 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.395 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.395 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.395 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:43.395 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.395 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.395 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.395 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:43.395 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.396 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:43.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:43.396 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:25:43.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:25:43.396 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:25:43.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:25:43.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.397 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.397 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:25:43.397 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:25:43.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.397 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.397 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:25:43.397 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:25:43.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.397 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.397 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:25:43.397 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:25:43.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.398 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.398 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:43.398 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:25:43.398 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:25:43.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.398 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.398 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:43.398 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:25:43.398 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:25:43.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.398 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.398 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.398 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:25:43.399 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:25:43.399 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.399 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.399 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.399 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.399 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.399 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:43.399 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:43.399 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.077821402, 2024-04-19T04:25:43.399 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:25:43.399 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.399 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.399 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.399 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.399 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.400 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:25:43.400 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.400 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.400 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.400 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.400 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:43.400 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.400 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.400 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.400 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.400 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:43.400 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.400 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.400 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.401 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.401 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:25:43.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.401 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.401 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:25:43.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:25:43.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.401 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.401 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:25:43.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:25:43.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.402 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.402 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:25:43.402 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:25:43.402 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.402 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.402 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.402 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:25:43.402 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:25:43.402 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.402 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.402 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.402 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:25:43.402 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:25:43.402 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.402 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.403 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:43.403 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:25:43.403 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:25:43.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.403 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:43.403 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:25:43.403 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:25:43.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.403 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:43.403 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:25:43.403 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:25:43.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.404 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:43.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:25:43.404 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:25:43.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.404 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:25:43.404 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:25:43.404 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.404 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.404 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.404 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93744 5.1 5:87b91c25:::benchmark_data_smithi007_19526_object93743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:43.405 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:43.405 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.074151851, 2024-04-19T04:25:43.405 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044295022000000003, 2024-04-19T04:25:43.405 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:43.405 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.405 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:43.405 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:43.405 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.405 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93744 2024-04-19T04:25:43.405 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.405 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:43.405 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.405 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:43.405 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:43.405 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.406 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.406 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.406 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:43.406 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:43.406 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:43.406 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.406 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.406 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:43.406 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231905+0000", 2024-04-19T04:25:43.406 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.406 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.406 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.406 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:43.406 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231935+0000", 2024-04-19T04:25:43.407 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9442e-05 2024-04-19T04:25:43.407 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.407 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.407 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:43.407 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264224+0000", 2024-04-19T04:25:43.407 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.032288836000000001 2024-04-19T04:25:43.407 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.407 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.407 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.407 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264238+0000", 2024-04-19T04:25:43.407 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4494999999999999e-05 2024-04-19T04:25:43.407 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.407 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.407 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:43.407 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268311+0000", 2024-04-19T04:25:43.408 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040726629999999998 2024-04-19T04:25:43.408 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.408 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.408 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:43.408 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268587+0000", 2024-04-19T04:25:43.408 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00027623200000000001 2024-04-19T04:25:43.408 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.408 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.408 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:43.408 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276099+0000", 2024-04-19T04:25:43.408 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075116180000000003 2024-04-19T04:25:43.408 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.408 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.408 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:43.408 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276123+0000", 2024-04-19T04:25:43.408 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4675e-05 2024-04-19T04:25:43.409 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:43.409 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:43.409 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:43.409 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276201+0000", 2024-04-19T04:25:43.409 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7836000000000005e-05 2024-04-19T04:25:43.409 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.409 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.409 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.409 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:43.409 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:43.409 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:43.411 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:43.411 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:43.409+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:43.511 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:43.509+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:43.536 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:43.536 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:43.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.537 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:123197 5.9 e48/20 5:996cd2b1:::benchmark_data_smithi007_19526_object123196:head v 48'7846, mlcod=48'7842)", 2024-04-19T04:25:43.537 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:43.535373+0000", 2024-04-19T04:25:43.537 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0013817670000000001, 2024-04-19T04:25:43.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0014073709999999999, 2024-04-19T04:25:43.537 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.537 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:43.537 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535373+0000", 2024-04-19T04:25:43.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535373+0000", 2024-04-19T04:25:43.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535372+0000", 2024-04-19T04:25:43.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535417+0000", 2024-04-19T04:25:43.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4922000000000001e-05 2024-04-19T04:25:43.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535431+0000", 2024-04-19T04:25:43.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4132e-05 2024-04-19T04:25:43.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535438+0000", 2024-04-19T04:25:43.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8340000000000001e-06 2024-04-19T04:25:43.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535480+0000", 2024-04-19T04:25:43.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1323999999999999e-05 2024-04-19T04:25:43.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535502+0000", 2024-04-19T04:25:43.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2887999999999998e-05 2024-04-19T04:25:43.540 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.540 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.540 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.540 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:123201 5.8 5:1bd4cc7e:::benchmark_data_smithi007_19526_object123200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T04:25:43.540 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:43.535574+0000", 2024-04-19T04:25:43.540 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0011809069999999999, 2024-04-19T04:25:43.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012847030000000001, 2024-04-19T04:25:43.541 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.541 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:43.541 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.541 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.541 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.541 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 123201 2024-04-19T04:25:43.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.541 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535574+0000", 2024-04-19T04:25:43.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535574+0000", 2024-04-19T04:25:43.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535573+0000", 2024-04-19T04:25:43.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535708+0000", 2024-04-19T04:25:43.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013444499999999999 2024-04-19T04:25:43.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535720+0000", 2024-04-19T04:25:43.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1980999999999999e-05 2024-04-19T04:25:43.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535728+0000", 2024-04-19T04:25:43.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7320000000000004e-06 2024-04-19T04:25:43.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535775+0000", 2024-04-19T04:25:43.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6672000000000003e-05 2024-04-19T04:25:43.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535926+0000", 2024-04-19T04:25:43.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015100899999999999 2024-04-19T04:25:43.544 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.544 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.544 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.544 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:123203 5.e 5:70925b2d:::benchmark_data_smithi007_19526_object123202:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T04:25:43.545 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:43.535740+0000", 2024-04-19T04:25:43.545 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001015387, 2024-04-19T04:25:43.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0011991700000000001, 2024-04-19T04:25:43.545 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.545 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:43.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.545 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 123203 2024-04-19T04:25:43.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.545 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535740+0000", 2024-04-19T04:25:43.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535740+0000", 2024-04-19T04:25:43.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535739+0000", 2024-04-19T04:25:43.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:43.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535793+0000", 2024-04-19T04:25:43.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4475999999999998e-05 2024-04-19T04:25:43.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535802+0000", 2024-04-19T04:25:43.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7450000000000001e-06 2024-04-19T04:25:43.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535809+0000", 2024-04-19T04:25:43.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3119999999999996e-06 2024-04-19T04:25:43.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.535892+0000", 2024-04-19T04:25:43.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2063000000000004e-05 2024-04-19T04:25:43.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.536064+0000", 2024-04-19T04:25:43.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017221900000000001 2024-04-19T04:25:43.548 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.548 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.548 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.549 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:123194 5.b 5:d3214957:::benchmark_data_smithi007_19526_object123193:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T04:25:43.549 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:43.532275+0000", 2024-04-19T04:25:43.549 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0044804579999999997, 2024-04-19T04:25:43.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047420359999999998, 2024-04-19T04:25:43.549 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.549 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:43.549 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.549 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.549 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.549 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 123194 2024-04-19T04:25:43.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.549 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.532275+0000", 2024-04-19T04:25:43.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.532275+0000", 2024-04-19T04:25:43.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.532273+0000", 2024-04-19T04:25:43.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.532334+0000", 2024-04-19T04:25:43.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0912999999999998e-05 2024-04-19T04:25:43.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.532348+0000", 2024-04-19T04:25:43.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3186e-05 2024-04-19T04:25:43.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.532357+0000", 2024-04-19T04:25:43.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7510000000000003e-06 2024-04-19T04:25:43.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.532404+0000", 2024-04-19T04:25:43.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6557000000000002e-05 2024-04-19T04:25:43.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.532495+0000", 2024-04-19T04:25:43.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0783000000000001e-05 2024-04-19T04:25:43.552 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.552 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.552 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.553 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:123195 5.b 5:d2d133df:::benchmark_data_smithi007_19526_object123194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T04:25:43.553 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:43.532915+0000", 2024-04-19T04:25:43.553 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0038403349999999998, 2024-04-19T04:25:43.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004179416, 2024-04-19T04:25:43.553 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.553 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:43.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.553 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 123195 2024-04-19T04:25:43.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.553 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.532915+0000", 2024-04-19T04:25:43.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.532915+0000", 2024-04-19T04:25:43.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.532914+0000", 2024-04-19T04:25:43.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:43.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.532957+0000", 2024-04-19T04:25:43.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2979000000000003e-05 2024-04-19T04:25:43.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.532967+0000", 2024-04-19T04:25:43.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9590000000000007e-06 2024-04-19T04:25:43.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.532975+0000", 2024-04-19T04:25:43.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7270000000000007e-06 2024-04-19T04:25:43.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.534333+0000", 2024-04-19T04:25:43.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013583289999999999 2024-04-19T04:25:43.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.534436+0000", 2024-04-19T04:25:43.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010334 2024-04-19T04:25:43.556 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.556 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.556 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.556 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:123196 5.0 5:05a34d81:::benchmark_data_smithi007_19526_object123195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T04:25:43.556 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:43.534085+0000", 2024-04-19T04:25:43.557 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002670431, 2024-04-19T04:25:43.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030849190000000002, 2024-04-19T04:25:43.557 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.557 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:43.557 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.557 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.557 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.557 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 123196 2024-04-19T04:25:43.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.557 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.534085+0000", 2024-04-19T04:25:43.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.534085+0000", 2024-04-19T04:25:43.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.534084+0000", 2024-04-19T04:25:43.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.534174+0000", 2024-04-19T04:25:43.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9994999999999995e-05 2024-04-19T04:25:43.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.534189+0000", 2024-04-19T04:25:43.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5105e-05 2024-04-19T04:25:43.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.534197+0000", 2024-04-19T04:25:43.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1089999999999998e-06 2024-04-19T04:25:43.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.534244+0000", 2024-04-19T04:25:43.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6847000000000001e-05 2024-04-19T04:25:43.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.534356+0000", 2024-04-19T04:25:43.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112044 2024-04-19T04:25:43.561 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.561 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.561 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.561 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:123198 5.b 5:d53a8e64:::benchmark_data_smithi007_19526_object123197:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T04:25:43.561 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:43.534212+0000", 2024-04-19T04:25:43.561 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0025429129999999999, 2024-04-19T04:25:43.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030323559999999999, 2024-04-19T04:25:43.562 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.562 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:43.562 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.562 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.562 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.562 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 123198 2024-04-19T04:25:43.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.562 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.534212+0000", 2024-04-19T04:25:43.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.534212+0000", 2024-04-19T04:25:43.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.534211+0000", 2024-04-19T04:25:43.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:43.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.534256+0000", 2024-04-19T04:25:43.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4397999999999997e-05 2024-04-19T04:25:43.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.534265+0000", 2024-04-19T04:25:43.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.918e-06 2024-04-19T04:25:43.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.534272+0000", 2024-04-19T04:25:43.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9589999999999998e-06 2024-04-19T04:25:43.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.536270+0000", 2024-04-19T04:25:43.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001997862 2024-04-19T04:25:43.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:43.536364+0000", 2024-04-19T04:25:43.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3947e-05 2024-04-19T04:25:43.565 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.565 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.565 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.565 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.565 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:43.565 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 7 2024-04-19T04:25:43.565 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:43.567 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:43.612 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:43.609+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:43.686 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:43.686 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:43.686 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:43.686 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:43.686 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:43.698 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:43.713 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:43.713+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:43.757 INFO:tasks.radosbench.radosbench.0.smithi007.stdout: 59 16 123682 123666 130.986 130.312 0.00762447 0.00762882 2024-04-19T04:25:43.815 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:43.813+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:43.821 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:43.821 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:43.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:43.821 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:43.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.821 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:43.821 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:43.821 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 49.584003611999997, 2024-04-19T04:25:43.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:43.821 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.821 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.821 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.822 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.822 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.822 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:43.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.822 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:43.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:43.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:43.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:43.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:43.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:43.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:43.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:43.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:43.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:43.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:43.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:43.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:43.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:43.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:43.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:43.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:43.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:43.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:43.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:43.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:43.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:43.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:43.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.827 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:43.827 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:43.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:43.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.827 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:43.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:43.828 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.828 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.828 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.828 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:43.828 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:43.828 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 49.579554696000002, 2024-04-19T04:25:43.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:43.828 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.828 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.828 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.829 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.829 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.829 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:43.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.829 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:43.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:43.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:43.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:43.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:43.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:43.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.831 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:43.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:43.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.831 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:43.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:43.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.831 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:43.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:43.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:43.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:43.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:43.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:43.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:43.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:43.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:43.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:43.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:43.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:43.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:43.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:43.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:43.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:43.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:43.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:43.834 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.834 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.834 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.834 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:43.834 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:43.835 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.751622453, 2024-04-19T04:25:43.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:43.835 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.835 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.835 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.835 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.835 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.835 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:43.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.835 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.836 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.836 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:43.836 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.836 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.836 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.836 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:43.836 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:43.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:43.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:43.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:43.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:43.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:43.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:43.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:43.839 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:43.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.839 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.839 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.839 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:43.839 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:43.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.839 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.839 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:43.839 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:43.839 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:43.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.839 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.839 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:43.840 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:43.840 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:43.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.840 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.840 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:43.840 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:43.840 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:43.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.840 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.840 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:43.840 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:43.840 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:43.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.315768416000001, 2024-04-19T04:25:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:43.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:43.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:43.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.846 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.846 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:43.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:43.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:43.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.846 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.846 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:43.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:43.846 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.315337996, 2024-04-19T04:25:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.313106732000001, 2024-04-19T04:25:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.309709693999999, 2024-04-19T04:25:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.304581496000001, 2024-04-19T04:25:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.990552991000001, 2024-04-19T04:25:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.868193581, 2024-04-19T04:25:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:25:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:25:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:25:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:25:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:25:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.863131934999998, 2024-04-19T04:25:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:25:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:25:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:25:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:25:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:25:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.863032022999999, 2024-04-19T04:25:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:25:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:25:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:25:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:25:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:25:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.86290627, 2024-04-19T04:25:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:25:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:25:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:25:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:25:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:25:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.859062325, 2024-04-19T04:25:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:25:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:25:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:25:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:25:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:25:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:25:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:25:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:25:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:25:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:25:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:25:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.851891223999999, 2024-04-19T04:25:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:25:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:25:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:25:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:25:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:25:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.851719119999998, 2024-04-19T04:25:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:25:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:25:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:25:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:25:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:25:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.851655995000002, 2024-04-19T04:25:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:25:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:25:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:25:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:25:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:25:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:25:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:25:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:25:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:25:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:25:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:25:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.851527398000002, 2024-04-19T04:25:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:25:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:25:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:25:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:25:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:25:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:25:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:25:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:25:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:25:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:25:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:25:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.851459427000002, 2024-04-19T04:25:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:25:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:25:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:25:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:25:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:25:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:25:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:25:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:25:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:25:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:25:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:25:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:111654 5.0 5:0b6b473d:::benchmark_data_smithi007_19526_object111653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.9036683209999996, 2024-04-19T04:25:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023122753999999999, 2024-04-19T04:25:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 111654 2024-04-19T04:25:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915865+0000", 2024-04-19T04:25:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915897+0000", 2024-04-19T04:25:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1708999999999997e-05 2024-04-19T04:25:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915905+0000", 2024-04-19T04:25:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.481e-06 2024-04-19T04:25:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915911+0000", 2024-04-19T04:25:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6880000000000002e-06 2024-04-19T04:25:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925564+0000", 2024-04-19T04:25:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096527039999999998 2024-04-19T04:25:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925771+0000", 2024-04-19T04:25:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020717199999999999 2024-04-19T04:25:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938888+0000", 2024-04-19T04:25:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013117105 2024-04-19T04:25:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938931+0000", 2024-04-19T04:25:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2447000000000002e-05 2024-04-19T04:25:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938989+0000", 2024-04-19T04:25:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7997000000000001e-05 2024-04-19T04:25:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:43.934 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:43.938 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:43.933+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:43.938 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:43.939 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:25:44.035 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:44.033+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:44.076 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:44.076 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:44.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.076 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:124316 5.d 5:bc0fbb22:::benchmark_data_smithi007_19526_object124315:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T04:25:44.076 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:44.065565+0000", 2024-04-19T04:25:44.076 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.010290049000000001, 2024-04-19T04:25:44.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010319455999999999, 2024-04-19T04:25:44.076 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:44.076 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:44.076 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:44.077 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:44.077 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:44.077 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 124316 2024-04-19T04:25:44.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.077 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:44.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:44.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.065565+0000", 2024-04-19T04:25:44.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:44.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.065565+0000", 2024-04-19T04:25:44.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:44.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.065564+0000", 2024-04-19T04:25:44.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:44.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:44.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.065630+0000", 2024-04-19T04:25:44.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5956000000000003e-05 2024-04-19T04:25:44.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:44.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.065651+0000", 2024-04-19T04:25:44.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1038000000000001e-05 2024-04-19T04:25:44.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:44.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.065658+0000", 2024-04-19T04:25:44.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8889999999999996e-06 2024-04-19T04:25:44.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:44.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.065707+0000", 2024-04-19T04:25:44.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8634999999999998e-05 2024-04-19T04:25:44.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:44.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.065819+0000", 2024-04-19T04:25:44.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011199799999999999 2024-04-19T04:25:44.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:44.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.065969+0000", 2024-04-19T04:25:44.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015004499999999999 2024-04-19T04:25:44.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:44.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.069330+0000", 2024-04-19T04:25:44.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0033607239999999998 2024-04-19T04:25:44.080 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.080 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:44.081 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.081 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.081 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:124323 5.f 5:fc7ac9a2:::benchmark_data_smithi007_19526_object124322:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T04:25:44.081 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:44.067910+0000", 2024-04-19T04:25:44.081 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0079457699999999996, 2024-04-19T04:25:44.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0080833569999999993, 2024-04-19T04:25:44.081 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:44.081 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:44.081 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:44.081 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:44.081 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:44.081 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 124323 2024-04-19T04:25:44.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.081 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:44.082 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.082 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:44.082 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.067910+0000", 2024-04-19T04:25:44.082 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.082 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.082 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.082 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:44.082 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.067910+0000", 2024-04-19T04:25:44.082 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.082 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.082 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.082 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:44.082 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.067909+0000", 2024-04-19T04:25:44.082 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:44.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:44.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.067999+0000", 2024-04-19T04:25:44.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0255999999999998e-05 2024-04-19T04:25:44.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:44.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.068010+0000", 2024-04-19T04:25:44.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0737000000000001e-05 2024-04-19T04:25:44.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:44.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.068019+0000", 2024-04-19T04:25:44.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7220000000000005e-06 2024-04-19T04:25:44.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:44.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.068699+0000", 2024-04-19T04:25:44.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00067999399999999995 2024-04-19T04:25:44.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:44.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.068818+0000", 2024-04-19T04:25:44.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000119382 2024-04-19T04:25:44.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:44.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.068940+0000", 2024-04-19T04:25:44.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012180699999999999 2024-04-19T04:25:44.085 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.085 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:44.085 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.085 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:124326 5.d 5:b804a928:::benchmark_data_smithi007_19526_object124325:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T04:25:44.085 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:44.070719+0000", 2024-04-19T04:25:44.086 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00513687, 2024-04-19T04:25:44.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0053652309999999998, 2024-04-19T04:25:44.086 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:44.086 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:44.086 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:44.086 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:44.086 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:44.086 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 124326 2024-04-19T04:25:44.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.087 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:44.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:44.087 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.070719+0000", 2024-04-19T04:25:44.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:44.087 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.070719+0000", 2024-04-19T04:25:44.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:44.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.070718+0000", 2024-04-19T04:25:44.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:44.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:44.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.070754+0000", 2024-04-19T04:25:44.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6502999999999999e-05 2024-04-19T04:25:44.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:44.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.070770+0000", 2024-04-19T04:25:44.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5622000000000001e-05 2024-04-19T04:25:44.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:44.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.070778+0000", 2024-04-19T04:25:44.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2139999999999996e-06 2024-04-19T04:25:44.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:44.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.070826+0000", 2024-04-19T04:25:44.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8149999999999998e-05 2024-04-19T04:25:44.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.090 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:44.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.070973+0000", 2024-04-19T04:25:44.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000146737 2024-04-19T04:25:44.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.090 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:44.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071102+0000", 2024-04-19T04:25:44.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000129481 2024-04-19T04:25:44.090 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.090 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:44.090 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.091 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:124327 5.f 5:f0d3b1d3:::benchmark_data_smithi007_19526_object124326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T04:25:44.091 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:44.070917+0000", 2024-04-19T04:25:44.091 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0049384390000000002, 2024-04-19T04:25:44.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005251894, 2024-04-19T04:25:44.091 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:44.091 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:44.091 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:44.091 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:44.091 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:44.091 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 124327 2024-04-19T04:25:44.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.091 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:44.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:44.092 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.070917+0000", 2024-04-19T04:25:44.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.092 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:44.092 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.070917+0000", 2024-04-19T04:25:44.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.092 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:44.092 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.070916+0000", 2024-04-19T04:25:44.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:44.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.092 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:44.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.070982+0000", 2024-04-19T04:25:44.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6649000000000005e-05 2024-04-19T04:25:44.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:44.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.070992+0000", 2024-04-19T04:25:44.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0569999999999999e-06 2024-04-19T04:25:44.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:44.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.070998+0000", 2024-04-19T04:25:44.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8430000000000004e-06 2024-04-19T04:25:44.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:44.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071074+0000", 2024-04-19T04:25:44.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5939000000000006e-05 2024-04-19T04:25:44.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:44.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071159+0000", 2024-04-19T04:25:44.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4623999999999995e-05 2024-04-19T04:25:44.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:44.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071255+0000", 2024-04-19T04:25:44.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5764e-05 2024-04-19T04:25:44.095 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.095 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:44.095 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.095 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:124329 5.9 5:9a5c9000:::benchmark_data_smithi007_19526_object124328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T04:25:44.095 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:44.071360+0000", 2024-04-19T04:25:44.095 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0044957210000000003, 2024-04-19T04:25:44.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0048880080000000001, 2024-04-19T04:25:44.095 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:44.095 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:44.095 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:44.096 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:44.096 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:44.096 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 124329 2024-04-19T04:25:44.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.096 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:44.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:44.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071360+0000", 2024-04-19T04:25:44.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:44.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071360+0000", 2024-04-19T04:25:44.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:44.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071359+0000", 2024-04-19T04:25:44.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:44.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:44.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071401+0000", 2024-04-19T04:25:44.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1746999999999999e-05 2024-04-19T04:25:44.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:44.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071416+0000", 2024-04-19T04:25:44.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5184999999999999e-05 2024-04-19T04:25:44.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:44.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071424+0000", 2024-04-19T04:25:44.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1529999999999997e-06 2024-04-19T04:25:44.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:44.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071467+0000", 2024-04-19T04:25:44.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3167999999999997e-05 2024-04-19T04:25:44.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:44.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071591+0000", 2024-04-19T04:25:44.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012368399999999999 2024-04-19T04:25:44.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:44.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071728+0000", 2024-04-19T04:25:44.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013709900000000001 2024-04-19T04:25:44.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:44.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.074218+0000", 2024-04-19T04:25:44.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024899969999999999 2024-04-19T04:25:44.099 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.099 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:44.100 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.100 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:124330 5.7 5:e3c093f5:::benchmark_data_smithi007_19526_object124329:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T04:25:44.100 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:44.071437+0000", 2024-04-19T04:25:44.100 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0044181769999999997, 2024-04-19T04:25:44.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0048955279999999997, 2024-04-19T04:25:44.100 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:44.100 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:44.100 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:44.100 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:44.100 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:44.100 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 124330 2024-04-19T04:25:44.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.100 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:44.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:44.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071437+0000", 2024-04-19T04:25:44.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:44.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071437+0000", 2024-04-19T04:25:44.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:44.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071437+0000", 2024-04-19T04:25:44.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:44.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:44.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071482+0000", 2024-04-19T04:25:44.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4906e-05 2024-04-19T04:25:44.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:44.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071495+0000", 2024-04-19T04:25:44.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3563999999999999e-05 2024-04-19T04:25:44.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:44.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071506+0000", 2024-04-19T04:25:44.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0548e-05 2024-04-19T04:25:44.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:44.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.072018+0000", 2024-04-19T04:25:44.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00051228600000000003 2024-04-19T04:25:44.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:44.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.072170+0000", 2024-04-19T04:25:44.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000151834 2024-04-19T04:25:44.103 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.103 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:44.103 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.104 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:124331 5.3 5:c5d5fc30:::benchmark_data_smithi007_19526_object124330:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T04:25:44.104 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:44.071532+0000", 2024-04-19T04:25:44.104 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0043235000000000001, 2024-04-19T04:25:44.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0048489689999999998, 2024-04-19T04:25:44.104 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:44.104 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:44.104 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:44.104 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:44.104 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:44.104 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 124331 2024-04-19T04:25:44.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.104 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:44.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:44.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071532+0000", 2024-04-19T04:25:44.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:44.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071532+0000", 2024-04-19T04:25:44.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:44.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071531+0000", 2024-04-19T04:25:44.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:44.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:44.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071573+0000", 2024-04-19T04:25:44.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1242000000000003e-05 2024-04-19T04:25:44.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:44.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071581+0000", 2024-04-19T04:25:44.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.8769999999999999e-06 2024-04-19T04:25:44.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:44.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071589+0000", 2024-04-19T04:25:44.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1269999999999997e-06 2024-04-19T04:25:44.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.107 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:44.107 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.072315+0000", 2024-04-19T04:25:44.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00072602699999999997 2024-04-19T04:25:44.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.107 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:44.107 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.072438+0000", 2024-04-19T04:25:44.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012327099999999999 2024-04-19T04:25:44.107 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.107 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:44.107 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.107 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:124333 5.5 5:a2bb09e0:::benchmark_data_smithi007_19526_object124332:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T04:25:44.108 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:44.071816+0000", 2024-04-19T04:25:44.108 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0040399019999999997, 2024-04-19T04:25:44.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0045994629999999998, 2024-04-19T04:25:44.108 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:44.108 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:44.108 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:44.108 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:44.108 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:44.108 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 124333 2024-04-19T04:25:44.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.108 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:44.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:44.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071816+0000", 2024-04-19T04:25:44.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:44.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071816+0000", 2024-04-19T04:25:44.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:44.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071815+0000", 2024-04-19T04:25:44.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:44.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:44.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071862+0000", 2024-04-19T04:25:44.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7565999999999998e-05 2024-04-19T04:25:44.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:44.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071885+0000", 2024-04-19T04:25:44.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2412000000000002e-05 2024-04-19T04:25:44.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:44.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.071893+0000", 2024-04-19T04:25:44.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2009999999999999e-06 2024-04-19T04:25:44.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:44.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075854+0000", 2024-04-19T04:25:44.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003961142 2024-04-19T04:25:44.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:44.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.076101+0000", 2024-04-19T04:25:44.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00024732299999999998 2024-04-19T04:25:44.111 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.111 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:44.111 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.111 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:124335 5.f 5:f5849d18:::benchmark_data_smithi007_19526_object124334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T04:25:44.111 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:44.074009+0000", 2024-04-19T04:25:44.112 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00184603, 2024-04-19T04:25:44.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002439676, 2024-04-19T04:25:44.112 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:44.112 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:44.112 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:44.112 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:44.112 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:44.112 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 124335 2024-04-19T04:25:44.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.112 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:44.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.112 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:44.112 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.074009+0000", 2024-04-19T04:25:44.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.113 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.113 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:44.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.074009+0000", 2024-04-19T04:25:44.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.113 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.113 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:44.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.074008+0000", 2024-04-19T04:25:44.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:44.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.113 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.113 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:44.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.074069+0000", 2024-04-19T04:25:44.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0438e-05 2024-04-19T04:25:44.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:44.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.074080+0000", 2024-04-19T04:25:44.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0876000000000001e-05 2024-04-19T04:25:44.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:44.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.074087+0000", 2024-04-19T04:25:44.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.075e-06 2024-04-19T04:25:44.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:44.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075201+0000", 2024-04-19T04:25:44.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001114178 2024-04-19T04:25:44.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:44.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075290+0000", 2024-04-19T04:25:44.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9260999999999998e-05 2024-04-19T04:25:44.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:44.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075381+0000", 2024-04-19T04:25:44.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0661999999999994e-05 2024-04-19T04:25:44.115 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.115 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:44.116 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.116 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:124337 5.3 5:c7dde976:::benchmark_data_smithi007_19526_object124336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T04:25:44.116 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:44.074971+0000", 2024-04-19T04:25:44.116 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00088491000000000004, 2024-04-19T04:25:44.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015158610000000001, 2024-04-19T04:25:44.116 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:44.116 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:44.116 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:44.116 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:44.116 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:44.116 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 124337 2024-04-19T04:25:44.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.116 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:44.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.117 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:44.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.074971+0000", 2024-04-19T04:25:44.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.117 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:44.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.074971+0000", 2024-04-19T04:25:44.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.117 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:44.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.074970+0000", 2024-04-19T04:25:44.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:44.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:44.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075021+0000", 2024-04-19T04:25:44.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0625999999999999e-05 2024-04-19T04:25:44.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:44.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075028+0000", 2024-04-19T04:25:44.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3529999999999997e-06 2024-04-19T04:25:44.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:44.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075034+0000", 2024-04-19T04:25:44.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8669999999999999e-06 2024-04-19T04:25:44.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:44.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075086+0000", 2024-04-19T04:25:44.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2391e-05 2024-04-19T04:25:44.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:44.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075189+0000", 2024-04-19T04:25:44.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010329 2024-04-19T04:25:44.119 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.119 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:44.120 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.120 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:124338 5.7 5:e629d1bc:::benchmark_data_smithi007_19526_object124337:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T04:25:44.120 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:44.075231+0000", 2024-04-19T04:25:44.120 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.000624042, 2024-04-19T04:25:44.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001288708, 2024-04-19T04:25:44.120 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:44.120 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:44.120 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:44.120 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:44.120 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:44.120 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 124338 2024-04-19T04:25:44.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.121 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:44.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:44.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075231+0000", 2024-04-19T04:25:44.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:44.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075231+0000", 2024-04-19T04:25:44.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:44.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075231+0000", 2024-04-19T04:25:44.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:44.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:44.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075317+0000", 2024-04-19T04:25:44.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6246000000000001e-05 2024-04-19T04:25:44.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:44.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075328+0000", 2024-04-19T04:25:44.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0753e-05 2024-04-19T04:25:44.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:44.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075334+0000", 2024-04-19T04:25:44.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9800000000000001e-06 2024-04-19T04:25:44.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:44.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075371+0000", 2024-04-19T04:25:44.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6217000000000002e-05 2024-04-19T04:25:44.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:44.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075497+0000", 2024-04-19T04:25:44.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126465 2024-04-19T04:25:44.124 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.124 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:44.124 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.125 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:124341 5.9 5:959bd1ee:::benchmark_data_smithi007_19526_object124340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T04:25:44.125 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:44.075390+0000", 2024-04-19T04:25:44.125 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00046510799999999999, 2024-04-19T04:25:44.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0011629699999999999, 2024-04-19T04:25:44.125 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:44.125 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:44.125 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:44.125 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:44.125 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:44.125 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 124341 2024-04-19T04:25:44.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.125 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:44.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.125 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:44.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075390+0000", 2024-04-19T04:25:44.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:44.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075390+0000", 2024-04-19T04:25:44.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:44.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075390+0000", 2024-04-19T04:25:44.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:44.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:44.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075475+0000", 2024-04-19T04:25:44.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5483999999999997e-05 2024-04-19T04:25:44.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:44.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075484+0000", 2024-04-19T04:25:44.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.3640000000000005e-06 2024-04-19T04:25:44.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:44.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075491+0000", 2024-04-19T04:25:44.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4649999999999999e-06 2024-04-19T04:25:44.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:44.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075539+0000", 2024-04-19T04:25:44.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7982000000000002e-05 2024-04-19T04:25:44.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:44.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075692+0000", 2024-04-19T04:25:44.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152876 2024-04-19T04:25:44.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:44.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075862+0000", 2024-04-19T04:25:44.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017021699999999999 2024-04-19T04:25:44.129 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.129 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:44.129 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.129 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:124323 5.f e48/20)", 2024-04-19T04:25:44.129 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:44.075885+0000", 2024-04-19T04:25:44.129 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9999704, 2024-04-19T04:25:44.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00070185600000000005, 2024-04-19T04:25:44.129 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:44.129 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:44.129 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:44.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:44.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075885+0000", 2024-04-19T04:25:44.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:44.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075885+0000", 2024-04-19T04:25:44.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:44.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:44.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075885+0000", 2024-04-19T04:25:44.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:44.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:44.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075889+0000", 2024-04-19T04:25:44.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9450000000000001e-06 2024-04-19T04:25:44.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:44.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075898+0000", 2024-04-19T04:25:44.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5669999999999995e-06 2024-04-19T04:25:44.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:44.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:44.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:44.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:44.075906+0000", 2024-04-19T04:25:44.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8010000000000004e-06 2024-04-19T04:25:44.131 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.132 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:44.132 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.132 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:44.132 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:44.132 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 13 2024-04-19T04:25:44.132 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:44.133 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:44.133 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:44.134 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:44.135 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:44.135 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:44.136 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:44.137+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:44.237 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:44.233+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:44.266 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:44.266 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:44.281 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:44.338 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:44.337+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:44.412 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:44.412 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:44.425 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:44.439 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:44.437+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:44.539 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:44.537+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:44.549 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:44.550 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:44.559 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:44.641 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:44.637+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:44.682 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:44.682 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:44.695 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:44.741 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:44.741+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:44.759 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Total time run: 60.0061 2024-04-19T04:25:44.759 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Total writes made: 125731 2024-04-19T04:25:44.759 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Write size: 65536 2024-04-19T04:25:44.760 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Object size: 65536 2024-04-19T04:25:44.760 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Bandwidth (MB/sec): 130.957 2024-04-19T04:25:44.760 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Stddev Bandwidth: 29.6538 2024-04-19T04:25:44.760 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Max bandwidth (MB/sec): 192.875 2024-04-19T04:25:44.760 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Min bandwidth (MB/sec): 2.8125 2024-04-19T04:25:44.760 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Average IOPS: 2095 2024-04-19T04:25:44.760 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Stddev IOPS: 474.461 2024-04-19T04:25:44.760 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Max IOPS: 3086 2024-04-19T04:25:44.760 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Min IOPS: 45 2024-04-19T04:25:44.760 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Average Latency(s): 0.00763053 2024-04-19T04:25:44.760 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Stddev Latency(s): 0.0162617 2024-04-19T04:25:44.760 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Max latency(s): 1.03693 2024-04-19T04:25:44.760 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Min latency(s): 0.00185991 2024-04-19T04:25:44.762 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Cleaning up (deleting benchmark objects) 2024-04-19T04:25:44.814 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:44.814 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:44.827 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:44.842 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:44.841+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:44.943 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:44.941+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:44.964 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:44.964 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:44.977 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:45.044 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:45.045+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:45.106 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T04:25:45.109 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:45.109 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:45.123 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:45.168 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:45.169+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:45.246 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:45.245+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:45.248 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:45.248 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:45.263 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:45.347 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:45.345+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:45.388 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:45.388 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:45.400 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:45.448 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:45.449+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:45.521 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:45.579 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:45.582 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:45.582 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:45.581+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:45.682 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:45.681+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:45.711 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:45.711 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:45.724 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:45.784 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:45.781+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:45.862 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:45.862 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:45.875 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:45.885 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:45.881+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:45.986 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:45.985+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:45.997 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:45.997 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:46.011 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:46.087 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:46.085+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2024-04-19T04:25:46.136 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:25:46.139 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:46.139 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:46.152 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:46.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~29s 2024-04-19T04:25:46.190 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:46.189+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:46.279 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:46.279 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:46.290 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:46.291 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:46.291 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:46.289+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:46.319 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:46.319 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:46.319 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:46.319 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:46.323 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:46.324 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:46.393 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:46.393+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:46.415 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:46.415 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:46.415 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:46.415 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:46.415 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:46.427 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:46.495 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:46.493+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:46.556 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:46.556 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:46.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:46.556 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:46.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.556 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:46.556 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:46.557 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 52.319624634999997, 2024-04-19T04:25:46.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:46.557 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.557 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:46.557 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.557 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.557 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.557 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:46.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.557 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:46.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:46.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:46.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:46.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:46.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:46.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:46.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:46.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:46.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:46.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:46.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:46.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:46.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:46.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:46.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:46.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:46.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:46.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:46.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:46.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:46.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:46.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:46.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:46.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:46.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:46.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:46.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:46.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:46.562 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.562 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.562 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.562 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:46.562 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:46.562 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 52.315175719000003, 2024-04-19T04:25:46.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:46.562 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.562 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:46.562 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.563 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.563 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.563 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:46.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.563 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:46.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:46.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:46.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:46.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:46.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:46.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:46.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:46.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:46.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:46.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:46.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:46.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:46.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:46.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:46.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:46.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:46.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:46.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:46.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:46.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:46.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:46.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:46.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:46.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:46.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:46.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:46.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:46.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:46.569 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.569 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.569 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.569 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:46.570 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:46.570 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.487243476000003, 2024-04-19T04:25:46.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:46.570 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.570 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:46.570 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.570 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.570 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.570 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:46.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.570 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:46.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:46.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:46.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:46.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:46.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:46.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:46.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:46.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:46.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:46.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:46.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:46.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:46.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:46.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:46.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:46.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:46.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:46.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:46.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:46.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:46.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:46.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:46.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:46.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:46.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:46.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:46.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:46.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:46.575 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.575 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.575 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.576 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:46.576 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:46.576 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.051389439000001, 2024-04-19T04:25:46.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:46.576 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.576 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:46.576 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.576 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.576 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.576 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:46.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.576 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:46.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:46.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:46.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:46.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:46.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:46.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:46.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:46.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:46.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:46.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:46.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:46.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:46.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:46.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:46.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:46.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:46.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:46.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:46.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:46.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:46.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:46.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:46.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:46.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:46.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:46.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:46.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:46.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:46.581 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.581 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.581 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.581 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:46.581 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:46.581 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.050959019, 2024-04-19T04:25:46.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:46.581 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.581 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:46.582 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.582 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.582 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.582 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:46.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.582 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:46.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:46.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:46.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:46.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:46.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:46.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:46.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:46.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:46.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:46.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:46.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:46.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:46.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:46.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:46.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:46.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:46.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:46.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:46.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:46.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:46.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:46.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:46.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:46.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:46.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:46.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:46.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:46.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:46.587 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.587 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.587 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.587 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:46.587 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:46.587 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.048727755000002, 2024-04-19T04:25:46.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:46.587 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.588 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:46.588 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.588 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.588 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.588 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:46.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.588 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:46.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:46.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:46.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:46.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:46.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:46.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:46.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:46.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:46.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:46.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:46.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:46.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:46.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:46.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:46.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:46.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:46.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:46.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:46.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:46.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:46.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:46.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:46.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:46.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:46.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:46.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:46.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:46.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:46.592 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.592 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.593 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.593 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:46.593 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:46.593 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.045330716999999, 2024-04-19T04:25:46.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:46.593 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.593 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:46.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.593 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:46.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.593 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:46.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:46.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:46.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:46.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:46.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:46.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:46.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:46.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:46.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:46.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:46.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:46.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:46.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:46.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:46.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:46.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:46.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:46.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:46.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:46.598 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.598 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.598 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.598 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:46.599 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:46.599 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.040202519000001, 2024-04-19T04:25:46.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:46.599 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.599 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:46.599 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.599 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.599 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.599 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:46.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.599 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:46.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:46.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:46.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:46.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:46.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:46.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:46.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:46.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:46.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:46.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:46.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:46.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:46.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:46.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:46.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:46.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:46.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:46.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:46.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:46.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:46.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:46.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:46.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:46.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:46.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:46.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:46.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:46.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:46.605 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.605 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.605 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.605 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:46.605 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:46.605 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.726174014000001, 2024-04-19T04:25:46.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:46.605 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.605 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:46.605 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.605 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.606 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.606 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:46.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.606 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:46.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:46.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:46.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:46.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:46.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:46.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:46.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:46.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:46.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:46.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:46.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:46.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:46.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:46.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:46.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:46.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:46.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:46.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:46.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:46.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:46.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:46.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:46.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:46.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:46.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:46.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:46.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:46.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:46.611 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.611 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.611 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.612 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:46.612 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:46.612 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.603814604, 2024-04-19T04:25:46.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:25:46.612 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.612 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:46.612 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.612 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.612 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.612 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:46.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.612 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:46.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:46.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:46.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:46.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:46.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:46.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:46.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:46.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:46.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:46.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:46.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:46.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:46.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:46.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:46.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:46.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:46.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:46.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:46.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:46.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:46.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:46.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:46.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:46.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:46.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:46.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:25:46.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:25:46.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:25:46.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:25:46.618 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.618 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.618 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.618 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:46.618 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:46.618 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.598752957999999, 2024-04-19T04:25:46.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:25:46.618 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.618 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:46.618 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.619 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.619 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.619 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:46.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.619 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:46.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:46.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:46.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:46.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:46.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:46.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:46.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:46.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:46.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:46.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:46.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:46.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:46.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:46.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:46.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:46.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:46.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:46.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:46.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:46.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:46.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:46.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:46.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:25:46.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:25:46.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:25:46.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:25:46.624 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.624 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.624 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.624 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:46.624 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:46.625 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.598653045999999, 2024-04-19T04:25:46.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:25:46.625 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.625 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:46.625 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.625 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.625 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.625 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:46.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.625 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:46.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:46.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:46.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:46.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:46.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:46.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:46.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:46.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:46.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:46.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:46.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:46.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:46.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:46.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:46.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:46.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:46.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:46.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:46.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:46.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:46.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:46.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:46.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:25:46.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:25:46.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:25:46.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:25:46.630 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.630 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.631 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.631 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:46.631 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:46.631 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.598527293, 2024-04-19T04:25:46.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:25:46.631 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.631 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:46.631 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.631 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.631 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.631 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:46.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.632 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:46.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:46.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:46.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:46.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:46.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:46.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:46.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:46.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:46.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:46.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:46.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:46.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:46.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:46.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:46.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:46.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:46.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:46.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:46.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:46.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:46.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:46.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:46.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:25:46.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:25:46.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:25:46.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:25:46.636 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.636 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.636 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.636 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:46.636 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:46.636 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.594683348, 2024-04-19T04:25:46.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:25:46.637 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.637 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:46.637 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.637 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.637 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.637 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:46.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.637 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:46.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:46.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:46.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:46.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:46.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:46.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:46.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:46.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:46.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:46.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:46.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:46.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:46.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:46.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:46.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:25:46.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:25:46.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:46.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:25:46.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:25:46.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:46.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:25:46.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:25:46.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:46.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:25:46.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:25:46.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:25:46.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:25:46.642 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.642 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.642 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.643 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:46.643 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:46.643 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.587512246999999, 2024-04-19T04:25:46.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:25:46.643 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.643 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:46.643 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.643 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.643 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.643 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:46.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.643 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:46.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:46.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:46.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:46.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:46.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:46.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:46.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:46.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:46.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:46.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:46.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:46.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:46.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:46.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:46.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:25:46.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:25:46.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:25:46.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:25:46.647 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.647 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.647 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.647 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:46.647 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:46.648 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.587340142999999, 2024-04-19T04:25:46.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:25:46.648 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.648 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:46.648 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.648 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.648 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.648 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:46.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.648 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:46.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:46.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:46.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:46.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:46.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:46.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:46.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:46.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:46.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:46.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:46.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:46.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:46.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:46.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:46.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:25:46.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:25:46.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:25:46.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:25:46.652 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.652 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.652 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.652 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:46.652 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:46.652 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.587277018000002, 2024-04-19T04:25:46.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:25:46.652 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.653 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:46.653 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.653 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.653 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.653 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:46.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.653 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:46.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:46.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:46.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:46.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:46.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:46.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:46.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:46.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:46.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:46.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:46.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:46.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:46.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:46.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:46.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:25:46.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:25:46.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:46.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:25:46.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:25:46.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:46.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:25:46.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:25:46.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:46.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:25:46.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:25:46.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:25:46.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:25:46.658 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.658 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.658 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.658 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:46.658 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:46.658 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.587148420999998, 2024-04-19T04:25:46.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:25:46.658 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.658 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:46.658 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.659 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.659 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.659 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:46.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.659 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:46.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:46.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:46.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:46.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:46.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:46.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:25:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:25:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:25:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:25:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:46.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:25:46.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:25:46.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:46.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:25:46.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:25:46.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:25:46.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:25:46.663 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.663 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.664 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.664 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:46.664 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:46.664 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.587080449999998, 2024-04-19T04:25:46.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:25:46.664 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.664 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:46.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.664 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:46.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.664 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:46.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:46.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:46.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:46.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:46.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:46.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:46.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:46.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:46.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:46.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:46.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:46.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:46.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:46.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:46.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:25:46.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:25:46.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:46.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:25:46.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:25:46.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:46.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:25:46.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:25:46.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:46.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:25:46.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:25:46.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:25:46.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:25:46.669 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.669 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.670 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.670 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:111654 5.0 5:0b6b473d:::benchmark_data_smithi007_19526_object111653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:46.670 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:46.670 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.6392893439999998, 2024-04-19T04:25:46.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023122753999999999, 2024-04-19T04:25:46.670 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:46.670 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:46.670 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:46.670 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:46.670 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.671 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 111654 2024-04-19T04:25:46.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.671 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:46.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:46.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:46.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:46.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:46.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:46.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:46.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915865+0000", 2024-04-19T04:25:46.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:46.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:46.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915897+0000", 2024-04-19T04:25:46.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1708999999999997e-05 2024-04-19T04:25:46.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:46.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915905+0000", 2024-04-19T04:25:46.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.481e-06 2024-04-19T04:25:46.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915911+0000", 2024-04-19T04:25:46.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6880000000000002e-06 2024-04-19T04:25:46.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:46.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925564+0000", 2024-04-19T04:25:46.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096527039999999998 2024-04-19T04:25:46.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:46.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925771+0000", 2024-04-19T04:25:46.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020717199999999999 2024-04-19T04:25:46.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:46.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938888+0000", 2024-04-19T04:25:46.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013117105 2024-04-19T04:25:46.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:46.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938931+0000", 2024-04-19T04:25:46.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2447000000000002e-05 2024-04-19T04:25:46.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:46.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:46.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:46.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938989+0000", 2024-04-19T04:25:46.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7997000000000001e-05 2024-04-19T04:25:46.675 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.675 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.675 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.675 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:46.675 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:46.675 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:46.676 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:46.677 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:46.677+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:46.777 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:46.773+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:46.812 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:46.813 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:46.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.813 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:130542 5.1 5:89622ce6:::benchmark_data_smithi007_19526_object4808:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:46.813 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:46.807358+0000", 2024-04-19T04:25:46.813 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0052146909999999996, 2024-04-19T04:25:46.813 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0052431099999999996, 2024-04-19T04:25:46.813 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:46.813 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:46.813 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:46.813 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:46.813 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.813 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 130542 2024-04-19T04:25:46.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.814 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:46.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:46.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.807358+0000", 2024-04-19T04:25:46.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:46.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:46.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.807358+0000", 2024-04-19T04:25:46.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:46.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:46.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.807357+0000", 2024-04-19T04:25:46.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:46.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:46.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.807363+0000", 2024-04-19T04:25:46.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5369999999999997e-06 2024-04-19T04:25:46.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:46.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.807371+0000", 2024-04-19T04:25:46.816 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.089e-06 2024-04-19T04:25:46.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.816 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.807377+0000", 2024-04-19T04:25:46.816 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5079999999999996e-06 2024-04-19T04:25:46.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.817 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:46.817 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.807416+0000", 2024-04-19T04:25:46.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9415999999999997e-05 2024-04-19T04:25:46.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.817 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:46.817 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.807536+0000", 2024-04-19T04:25:46.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012021800000000001 2024-04-19T04:25:46.817 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:46.817 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:46.818 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:46.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.818 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:130543 5.1 5:863c252e:::benchmark_data_smithi007_19526_object4809:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:46.818 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:46.807447+0000", 2024-04-19T04:25:46.818 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0051262260000000002, 2024-04-19T04:25:46.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0052465630000000001, 2024-04-19T04:25:46.818 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:46.818 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:46.818 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:46.818 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:46.818 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.819 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 130543 2024-04-19T04:25:46.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.819 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:46.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:46.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.807447+0000", 2024-04-19T04:25:46.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:46.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:46.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.807447+0000", 2024-04-19T04:25:46.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:46.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:46.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.807446+0000", 2024-04-19T04:25:46.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:46.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:46.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.807451+0000", 2024-04-19T04:25:46.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3419999999999998e-06 2024-04-19T04:25:46.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:46.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.807461+0000", 2024-04-19T04:25:46.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8519999999999999e-06 2024-04-19T04:25:46.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.807471+0000", 2024-04-19T04:25:46.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9860000000000006e-06 2024-04-19T04:25:46.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:46.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.809675+0000", 2024-04-19T04:25:46.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0022036650000000001 2024-04-19T04:25:46.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:46.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.809867+0000", 2024-04-19T04:25:46.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000192685 2024-04-19T04:25:46.822 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:46.822 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:46.822 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:46.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.822 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:130550 5.1 5:8cb54195:::benchmark_data_smithi007_19526_object4816:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:46.822 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:46.809621+0000", 2024-04-19T04:25:46.822 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0029521130000000001, 2024-04-19T04:25:46.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031552189999999999, 2024-04-19T04:25:46.822 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:46.822 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:46.823 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:46.823 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:46.823 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.823 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 130550 2024-04-19T04:25:46.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.823 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:46.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:46.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.809621+0000", 2024-04-19T04:25:46.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:46.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:46.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.809621+0000", 2024-04-19T04:25:46.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:46.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:46.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.809620+0000", 2024-04-19T04:25:46.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:46.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:46.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.809627+0000", 2024-04-19T04:25:46.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8379999999999996e-06 2024-04-19T04:25:46.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:46.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.809639+0000", 2024-04-19T04:25:46.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2683e-05 2024-04-19T04:25:46.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.809648+0000", 2024-04-19T04:25:46.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6850000000000007e-06 2024-04-19T04:25:46.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:46.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.811997+0000", 2024-04-19T04:25:46.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023487669999999999 2024-04-19T04:25:46.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:46.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812114+0000", 2024-04-19T04:25:46.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000117829 2024-04-19T04:25:46.826 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:46.826 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:46.826 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:46.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.826 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:130553 5.d 5:bad01cd3:::benchmark_data_smithi007_19526_object4819:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:46.826 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:46.811250+0000", 2024-04-19T04:25:46.826 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0013227029999999999, 2024-04-19T04:25:46.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016031960000000001, 2024-04-19T04:25:46.826 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:46.827 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:46.827 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:46.827 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:46.827 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.827 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 130553 2024-04-19T04:25:46.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.827 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:46.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:46.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.811250+0000", 2024-04-19T04:25:46.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:46.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:46.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.811250+0000", 2024-04-19T04:25:46.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:46.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:46.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.811249+0000", 2024-04-19T04:25:46.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:46.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:46.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.811256+0000", 2024-04-19T04:25:46.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3180000000000003e-06 2024-04-19T04:25:46.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:46.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.811269+0000", 2024-04-19T04:25:46.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3668e-05 2024-04-19T04:25:46.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.811276+0000", 2024-04-19T04:25:46.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1659999999999997e-06 2024-04-19T04:25:46.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:46.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.811330+0000", 2024-04-19T04:25:46.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3149000000000002e-05 2024-04-19T04:25:46.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:46.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.811560+0000", 2024-04-19T04:25:46.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000230738 2024-04-19T04:25:46.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:46.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.811735+0000", 2024-04-19T04:25:46.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017507300000000001 2024-04-19T04:25:46.830 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:46.830 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:46.830 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:46.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.831 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:130555 5.2 5:4245a8ac:::benchmark_data_smithi007_19526_object4821:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:46.831 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:46.812367+0000", 2024-04-19T04:25:46.831 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00020630299999999999, 2024-04-19T04:25:46.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00056924099999999995, 2024-04-19T04:25:46.831 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:46.831 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:46.831 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:46.831 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:46.831 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.831 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 130555 2024-04-19T04:25:46.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.831 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:46.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:46.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812367+0000", 2024-04-19T04:25:46.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:46.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:46.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812367+0000", 2024-04-19T04:25:46.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:46.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:46.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812366+0000", 2024-04-19T04:25:46.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:46.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:46.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812373+0000", 2024-04-19T04:25:46.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1130000000000003e-06 2024-04-19T04:25:46.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:46.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812390+0000", 2024-04-19T04:25:46.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7399000000000001e-05 2024-04-19T04:25:46.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812400+0000", 2024-04-19T04:25:46.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0108999999999999e-05 2024-04-19T04:25:46.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:46.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812449+0000", 2024-04-19T04:25:46.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8568e-05 2024-04-19T04:25:46.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:46.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812592+0000", 2024-04-19T04:25:46.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014350499999999999 2024-04-19T04:25:46.834 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:46.834 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:46.834 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:46.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.834 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:130556 5.d 5.a319e8fd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:46.835 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:46.812430+0000", 2024-04-19T04:25:46.835 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00014333600000000001, 2024-04-19T04:25:46.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00057536800000000004, 2024-04-19T04:25:46.835 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:46.835 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:46.835 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:46.835 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:46.835 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.835 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 130556 2024-04-19T04:25:46.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.835 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:46.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:46.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812430+0000", 2024-04-19T04:25:46.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:46.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:46.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812430+0000", 2024-04-19T04:25:46.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:46.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:46.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812429+0000", 2024-04-19T04:25:46.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:46.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:46.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812434+0000", 2024-04-19T04:25:46.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6659999999999999e-06 2024-04-19T04:25:46.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:46.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812443+0000", 2024-04-19T04:25:46.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.3910000000000004e-06 2024-04-19T04:25:46.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812450+0000", 2024-04-19T04:25:46.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.401e-06 2024-04-19T04:25:46.837 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:46.837 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:46.838 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:46.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.838 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:130557 5.d 5.72db9c2d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:46.838 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:46.812464+0000", 2024-04-19T04:25:46.838 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00010864700000000001, 2024-04-19T04:25:46.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00060700100000000002, 2024-04-19T04:25:46.838 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:46.838 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:46.838 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:46.838 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:46.838 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.838 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 130557 2024-04-19T04:25:46.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.839 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:46.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:46.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812464+0000", 2024-04-19T04:25:46.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:46.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:46.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812464+0000", 2024-04-19T04:25:46.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:46.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:46.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812464+0000", 2024-04-19T04:25:46.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:46.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:46.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812467+0000", 2024-04-19T04:25:46.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4759999999999998e-06 2024-04-19T04:25:46.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:46.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812475+0000", 2024-04-19T04:25:46.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7819999999999994e-06 2024-04-19T04:25:46.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812481+0000", 2024-04-19T04:25:46.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3509999999999998e-06 2024-04-19T04:25:46.841 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:46.841 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:46.841 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:46.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.841 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:130558 5.c 5:3b1c43d9:::benchmark_data_smithi007_19526_object4824:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:46.841 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:46.812487+0000", 2024-04-19T04:25:46.841 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.5703000000000003e-05, 2024-04-19T04:25:46.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00064494900000000002, 2024-04-19T04:25:46.841 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:46.842 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:46.842 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:46.842 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:46.842 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:46.842 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 130558 2024-04-19T04:25:46.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.842 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:46.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:46.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812487+0000", 2024-04-19T04:25:46.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:46.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:46.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812487+0000", 2024-04-19T04:25:46.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:46.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:46.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812487+0000", 2024-04-19T04:25:46.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:46.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:46.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812490+0000", 2024-04-19T04:25:46.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.0079999999999998e-06 2024-04-19T04:25:46.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:46.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812497+0000", 2024-04-19T04:25:46.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3039999999999999e-06 2024-04-19T04:25:46.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:46.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812503+0000", 2024-04-19T04:25:46.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2129999999999996e-06 2024-04-19T04:25:46.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:46.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812563+0000", 2024-04-19T04:25:46.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9886999999999998e-05 2024-04-19T04:25:46.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:46.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:46.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:46.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:46.812637+0000", 2024-04-19T04:25:46.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3765999999999998e-05 2024-04-19T04:25:46.846 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:46.847 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:46.847 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:46.847 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:46.847 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:46.847 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 8 2024-04-19T04:25:46.847 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:46.848 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:46.879 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:46.877+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:46.979 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:46.977+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:46.981 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:46.981 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:46.982 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:46.982 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:46.982 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:46.995 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:47.081 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:47.077+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:47.127 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:47.127 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:47.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:47.128 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:47.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.128 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:47.128 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:47.128 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.893468071999997, 2024-04-19T04:25:47.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:47.128 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.128 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.128 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.128 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.129 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.129 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:47.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.129 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.129 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:47.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:47.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:47.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:47.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:47.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:47.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:47.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:47.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:47.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:47.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:47.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:47.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:47.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:47.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:47.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:47.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:47.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:47.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:47.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:47.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:47.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:47.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:47.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:47.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:47.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:47.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:47.135 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.135 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.135 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.135 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:47.135 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:47.135 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.890286916000001, 2024-04-19T04:25:47.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:47.135 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.136 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.136 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.136 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.136 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.136 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:47.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.136 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:47.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.137 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:47.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.137 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:47.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.138 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:47.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:47.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.138 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:47.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:47.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:47.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:47.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.139 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:47.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:47.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.139 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:47.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:47.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:47.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:47.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:47.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:47.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:47.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:47.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:47.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:47.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:47.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:47.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:47.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:47.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.142 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:47.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:47.142 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.142 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.142 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.142 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:47.142 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:47.142 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.889718811999998, 2024-04-19T04:25:47.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:47.142 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.143 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.143 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.143 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.143 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:47.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:47.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:47.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:47.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:47.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:47.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:47.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.147 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:47.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:47.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.147 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.147 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:47.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:47.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.147 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.148 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:47.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:47.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:47.148 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:47.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:47.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:47.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:47.149 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.149 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.149 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.149 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:47.149 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:47.149 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.889373151000001, 2024-04-19T04:25:47.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:47.150 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.150 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.150 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.150 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.150 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.150 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:47.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.150 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.151 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:47.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.151 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.151 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.151 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:47.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.151 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.151 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.151 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:47.152 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.152 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.152 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:47.152 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:47.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.152 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.152 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:47.152 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:47.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:47.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:47.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:47.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:47.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.154 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.154 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:47.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:47.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.154 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.154 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:47.154 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:47.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:47.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.154 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.155 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:47.155 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:47.155 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:47.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.155 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.155 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:47.155 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:47.155 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:47.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.155 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.155 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:47.156 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:47.156 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:47.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.156 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.156 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.156 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:47.156 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:47.156 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.156 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.156 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.157 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.157 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:47.157 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:47.157 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.888648713000002, 2024-04-19T04:25:47.157 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:47.157 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.157 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.157 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.157 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.157 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.157 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:47.157 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:47.158 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:47.158 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.159 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.159 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:47.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:47.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.159 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.159 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:47.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:47.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.159 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.159 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:47.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:47.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.160 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.160 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.160 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:47.160 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:47.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.160 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.160 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.160 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:47.160 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:47.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.161 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.161 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:47.161 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:47.161 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:47.161 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.161 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.161 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.162 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:47.162 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:47.162 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.162 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.162 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.162 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.162 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.162 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:47.163 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:47.163 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.888641317999998, 2024-04-19T04:25:47.163 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:47.163 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.163 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.163 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.163 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.163 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.163 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:47.163 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.163 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.164 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.164 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.164 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:47.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.164 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.164 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.164 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:47.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:47.165 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:47.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:47.165 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:47.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.166 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.166 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:47.166 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:47.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.166 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.166 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.166 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:47.166 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:47.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.166 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.166 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.166 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:47.167 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:47.167 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.167 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.167 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:47.167 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:47.167 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:47.167 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.167 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.167 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.167 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:47.167 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:47.167 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.167 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.168 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.168 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.168 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.168 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:47.169 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:47.169 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.886816171, 2024-04-19T04:25:47.169 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:47.169 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.169 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.169 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.169 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.169 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.169 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:47.169 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.170 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.170 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.170 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.170 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:47.170 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.170 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.170 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.170 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.170 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:47.170 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.171 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.171 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.172 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.172 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:47.172 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.172 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.172 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.172 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:47.172 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:47.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.172 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.173 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.173 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:47.174 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:47.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.174 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.174 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.174 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:47.174 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:47.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.174 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.174 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.174 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:47.174 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:47.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.174 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.174 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.175 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:47.175 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:47.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.175 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.175 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:47.175 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:47.175 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:47.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.175 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.175 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:47.175 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:47.175 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:47.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.175 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.175 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:47.176 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:47.176 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:47.176 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.176 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.176 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:47.176 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:47.176 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:47.176 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.176 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.176 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.176 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:47.176 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:47.176 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.176 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.176 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.177 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.177 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:47.177 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:47.177 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.886081965999999, 2024-04-19T04:25:47.177 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:47.177 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.177 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.177 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.177 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.177 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.177 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:47.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.177 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:47.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:47.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:47.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:47.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:47.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:47.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:47.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:47.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:47.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.180 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.180 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.180 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:47.180 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:47.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.180 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.180 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.180 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:47.180 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:47.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.180 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.180 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:47.180 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:47.180 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:47.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.181 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.181 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:47.181 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:47.181 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:47.181 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.181 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.181 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:47.181 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:47.182 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:47.182 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.182 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.182 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:47.182 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:47.182 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:47.182 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.182 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.182 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.182 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:47.182 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:47.182 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.182 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.182 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.183 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.183 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.183 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:47.183 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:47.183 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.885547690000003, 2024-04-19T04:25:47.183 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:47.183 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.183 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.183 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.183 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.183 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.183 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:47.183 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.183 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.183 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:47.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:47.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:47.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:47.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:47.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:47.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:47.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:47.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:47.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:47.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.186 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.186 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:47.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:47.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.186 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:47.186 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:47.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:47.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.186 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.186 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:47.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:47.187 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.187 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.187 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.187 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:47.187 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:47.187 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.168692500999999, 2024-04-19T04:25:47.187 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:47.187 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.187 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:47.187 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.187 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.188 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.188 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:47.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.188 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.188 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.188 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.188 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:47.188 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.188 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.188 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.188 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:47.188 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.188 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.189 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.189 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:47.189 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.189 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.189 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.189 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:47.189 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:47.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.189 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.189 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.189 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:47.189 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:47.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.189 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.190 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.190 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:47.190 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:47.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.190 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.190 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:47.190 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:47.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.190 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.190 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:47.190 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:47.191 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.191 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.191 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:47.191 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:47.191 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:47.191 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.191 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.191 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:47.191 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:47.192 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:47.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.192 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.192 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.192 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:47.192 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:47.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.192 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.192 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:47.192 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:47.192 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:47.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.192 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.192 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.192 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:47.193 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:47.193 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.193 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.193 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.193 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:47.193 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:47.193 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.193 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.193 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.193 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.194 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.194 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:47.194 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:47.194 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.148462051999999, 2024-04-19T04:25:47.194 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:47.194 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.194 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:47.194 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.194 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.194 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.195 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:47.195 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.195 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.195 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.195 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.195 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:47.195 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.195 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.195 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.195 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.195 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:47.195 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.196 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.196 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.196 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.196 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:47.196 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:47.196 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.196 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.196 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.196 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:47.196 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:47.196 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.196 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.196 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.196 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:47.197 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:47.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.197 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.197 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.197 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:47.197 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:47.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.197 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.197 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.197 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:47.197 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:47.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.197 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.197 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:47.198 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:47.198 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:47.198 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.198 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.198 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.198 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:47.198 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:47.198 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.198 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.198 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.199 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:47.199 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:47.199 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.199 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.199 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.199 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.199 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.199 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:47.199 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:47.199 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.148354195, 2024-04-19T04:25:47.199 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:47.199 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.199 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:47.199 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.200 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.200 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.200 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:47.200 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.200 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.200 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.200 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.200 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:47.200 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.200 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.200 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.200 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.200 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:47.200 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.200 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.200 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.201 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.201 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:47.201 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.201 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.201 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.201 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.201 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:47.201 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:47.201 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.201 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.201 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.202 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:47.202 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:47.202 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.202 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.202 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.202 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:47.202 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:47.202 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.202 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.202 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.202 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:47.203 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:47.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.203 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.203 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:47.203 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:47.203 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:47.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.203 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.203 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.203 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:47.203 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:47.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.203 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.203 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.203 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:47.203 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:47.204 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.204 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.204 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.204 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.204 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.204 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:47.204 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:47.204 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.146387506, 2024-04-19T04:25:47.204 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:47.204 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.204 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.204 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.204 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.204 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.204 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:47.205 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.205 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.205 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.205 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.205 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:47.205 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.205 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.205 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.205 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.205 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:47.205 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.205 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.205 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.205 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.205 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:47.206 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:47.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.206 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.206 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.206 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:47.206 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:47.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.206 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.206 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.206 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:47.206 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:47.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.206 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.206 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.206 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:47.207 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:47.207 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.207 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.207 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.207 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:47.207 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:47.207 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.207 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.207 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:47.207 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:47.207 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:47.207 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.207 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.207 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.207 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:47.208 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:47.208 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.208 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.208 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.208 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:47.208 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:47.208 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.208 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.208 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:47.208 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:47.208 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:47.208 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.208 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.208 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:47.208 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:47.208 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:47.209 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.209 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.213 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.214 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:47.214 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:47.214 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.214 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.214 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.214 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.215 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.215 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:47.215 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:47.215 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.143023311, 2024-04-19T04:25:47.215 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:47.216 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.216 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.216 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.216 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.216 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.217 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:47.217 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.217 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.217 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.217 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.217 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:47.217 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.218 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.218 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.218 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.218 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:47.218 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.218 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.218 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.219 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.219 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:47.219 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.219 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.219 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.219 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.219 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:47.220 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:47.220 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.220 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.220 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.220 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:47.220 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:47.220 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.221 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.221 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.221 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:47.221 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:47.221 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.221 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.222 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.222 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:47.222 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:47.222 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.222 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.222 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:47.223 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:47.223 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:47.223 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.223 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.223 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.223 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:47.224 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:47.224 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.224 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.224 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.224 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:47.224 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:47.224 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.225 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.225 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:47.225 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:47.225 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:47.225 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.225 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.225 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:47.225 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:47.225 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:47.226 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.226 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.226 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.226 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:47.226 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:47.226 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.226 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.226 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.226 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.227 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.227 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:47.227 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:47.227 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.139212333, 2024-04-19T04:25:47.227 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:47.227 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.227 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.227 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.227 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.228 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.228 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:47.228 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.228 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.228 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.228 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.228 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:47.228 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.229 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.229 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.229 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.229 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:47.230 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.230 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.230 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.230 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.230 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:47.230 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.231 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.231 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.231 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.231 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:47.231 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:47.231 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.231 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.232 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.232 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:47.232 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:47.232 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.232 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.232 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.233 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:47.233 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:47.233 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.233 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.233 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.233 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:47.234 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:47.234 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.234 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.234 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:47.234 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:47.234 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:47.235 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.235 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.235 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.235 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:47.235 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:47.235 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.236 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.236 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.236 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:47.236 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:47.236 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.236 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.236 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:47.237 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:47.237 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:47.237 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.237 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.237 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:47.237 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:47.238 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:47.238 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.238 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.238 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.238 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:47.238 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:47.239 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.239 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.239 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.239 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.239 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.239 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93735 5.1 5:8e609d1b:::benchmark_data_smithi007_19526_object93734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:47.240 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:47.240 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 17.897511689000002, 2024-04-19T04:25:47.240 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048424842000000003, 2024-04-19T04:25:47.241 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.241 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.241 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.241 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.241 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.241 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93735 2024-04-19T04:25:47.242 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.242 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.242 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.242 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.242 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:47.242 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.242 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.242 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.242 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.242 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:47.243 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.243 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.243 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.243 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.243 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227480+0000", 2024-04-19T04:25:47.243 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.243 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.243 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.243 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.243 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227533+0000", 2024-04-19T04:25:47.243 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2964999999999999e-05 2024-04-19T04:25:47.244 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.244 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.244 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.244 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227542+0000", 2024-04-19T04:25:47.244 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1449999999999997e-06 2024-04-19T04:25:47.244 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.244 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.244 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.245 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227561+0000", 2024-04-19T04:25:47.245 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9116000000000001e-05 2024-04-19T04:25:47.245 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.245 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.245 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.245 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227610+0000", 2024-04-19T04:25:47.245 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9234000000000003e-05 2024-04-19T04:25:47.246 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.246 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.246 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.246 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227697+0000", 2024-04-19T04:25:47.246 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6682999999999997e-05 2024-04-19T04:25:47.246 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.247 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.247 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:47.247 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275809+0000", 2024-04-19T04:25:47.247 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048112265000000001 2024-04-19T04:25:47.247 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.247 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.247 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:47.247 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275845+0000", 2024-04-19T04:25:47.247 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5275999999999999e-05 2024-04-19T04:25:47.247 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.247 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.247 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.247 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275906+0000", 2024-04-19T04:25:47.247 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1002999999999999e-05 2024-04-19T04:25:47.248 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.248 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.248 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.248 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.248 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.248 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93736 5.1 5:852229ec:::benchmark_data_smithi007_19526_object93735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:47.248 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:47.248 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 17.897407658999999, 2024-04-19T04:25:47.248 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048414497000000001, 2024-04-19T04:25:47.248 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.248 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.248 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.248 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.248 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.248 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93736 2024-04-19T04:25:47.249 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.249 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.249 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.249 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.249 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:47.249 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.249 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.249 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.249 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.249 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:47.249 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.249 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.249 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.249 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.250 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227584+0000", 2024-04-19T04:25:47.250 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.250 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.250 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.250 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.250 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227624+0000", 2024-04-19T04:25:47.250 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9833000000000003e-05 2024-04-19T04:25:47.250 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.250 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.250 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.250 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227630+0000", 2024-04-19T04:25:47.250 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0759999999999999e-06 2024-04-19T04:25:47.250 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.250 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.251 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.251 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227634+0000", 2024-04-19T04:25:47.251 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1570000000000002e-06 2024-04-19T04:25:47.251 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.251 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.251 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.251 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229531+0000", 2024-04-19T04:25:47.251 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018962339999999999 2024-04-19T04:25:47.251 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.251 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.251 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.251 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229662+0000", 2024-04-19T04:25:47.252 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013192999999999999 2024-04-19T04:25:47.252 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.252 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.252 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:47.252 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275915+0000", 2024-04-19T04:25:47.252 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046252140999999997 2024-04-19T04:25:47.252 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.252 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.252 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:47.252 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275944+0000", 2024-04-19T04:25:47.252 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9539999999999998e-05 2024-04-19T04:25:47.252 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.252 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.252 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.253 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275999+0000", 2024-04-19T04:25:47.253 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5062999999999998e-05 2024-04-19T04:25:47.253 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.253 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.253 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.253 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.253 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.253 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:47.253 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:47.253 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 17.897349976000001, 2024-04-19T04:25:47.253 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:25:47.254 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.254 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.254 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.254 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.254 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.254 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:25:47.254 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.254 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.254 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.254 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.254 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:47.255 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.255 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.255 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.255 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.255 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:47.255 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.255 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.255 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.255 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.255 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:47.255 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.256 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.256 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.256 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.256 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:25:47.256 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:25:47.256 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.256 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.256 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.256 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:25:47.256 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:25:47.256 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.256 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.256 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.256 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:25:47.256 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:25:47.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.257 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.257 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.257 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:25:47.257 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:25:47.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.257 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.257 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.257 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:25:47.257 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:25:47.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.257 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.257 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:47.257 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:25:47.258 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:25:47.258 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.258 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.258 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:47.258 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:25:47.258 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:25:47.258 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.258 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.258 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.258 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:25:47.258 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:25:47.258 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.258 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.258 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.259 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.259 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.259 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:47.259 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:47.259 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 17.896755696, 2024-04-19T04:25:47.259 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:25:47.259 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.259 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.259 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.259 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.259 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.259 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:25:47.259 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.259 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.260 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.260 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.260 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:47.260 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.260 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.260 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.260 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:47.260 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.260 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.260 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.260 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:25:47.260 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.261 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.261 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.261 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:25:47.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:25:47.261 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.261 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.261 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.261 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:25:47.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:25:47.261 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.261 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.261 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.261 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:25:47.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:25:47.261 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.262 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.262 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.262 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:25:47.262 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:25:47.262 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.262 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.262 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.262 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:25:47.262 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:25:47.262 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.262 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.262 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:47.262 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:25:47.262 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:25:47.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.263 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.263 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:47.263 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:25:47.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:25:47.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.263 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.263 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:47.263 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:25:47.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:25:47.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.263 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.263 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:47.263 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:25:47.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:25:47.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.264 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.264 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:25:47.264 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:25:47.264 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.264 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.264 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.264 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93744 5.1 5:87b91c25:::benchmark_data_smithi007_19526_object93743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:47.264 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:47.264 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 17.893086145000002, 2024-04-19T04:25:47.264 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044295022000000003, 2024-04-19T04:25:47.265 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.265 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.265 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.265 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.265 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.265 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93744 2024-04-19T04:25:47.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.265 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:47.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.266 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:47.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.266 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231905+0000", 2024-04-19T04:25:47.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.266 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231935+0000", 2024-04-19T04:25:47.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9442e-05 2024-04-19T04:25:47.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.267 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.267 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264224+0000", 2024-04-19T04:25:47.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.032288836000000001 2024-04-19T04:25:47.267 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.267 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.267 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.267 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264238+0000", 2024-04-19T04:25:47.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4494999999999999e-05 2024-04-19T04:25:47.267 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.267 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.267 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.267 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268311+0000", 2024-04-19T04:25:47.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040726629999999998 2024-04-19T04:25:47.267 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.268 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.268 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268587+0000", 2024-04-19T04:25:47.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00027623200000000001 2024-04-19T04:25:47.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.268 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:47.268 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276099+0000", 2024-04-19T04:25:47.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075116180000000003 2024-04-19T04:25:47.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.268 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:47.268 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276123+0000", 2024-04-19T04:25:47.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4675e-05 2024-04-19T04:25:47.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.269 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:47.269 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276201+0000", 2024-04-19T04:25:47.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7836000000000005e-05 2024-04-19T04:25:47.269 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.269 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.269 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.269 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.269 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.269 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:47.271 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:47.271 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:47.269+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:47.375 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:47.369+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:47.392 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:47.393 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:47.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.393 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:131918 5.a 5:5c9d9fa2:::benchmark_data_smithi007_19526_object6184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:47.393 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:47.387573+0000", 2024-04-19T04:25:47.393 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0055301830000000001, 2024-04-19T04:25:47.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055612209999999999, 2024-04-19T04:25:47.393 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.393 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:47.393 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.393 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.393 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.393 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131918 2024-04-19T04:25:47.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.393 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.387573+0000", 2024-04-19T04:25:47.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.387573+0000", 2024-04-19T04:25:47.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.387572+0000", 2024-04-19T04:25:47.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.387577+0000", 2024-04-19T04:25:47.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5029999999999999e-06 2024-04-19T04:25:47.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.387586+0000", 2024-04-19T04:25:47.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9379999999999998e-06 2024-04-19T04:25:47.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.387592+0000", 2024-04-19T04:25:47.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1600000000000003e-06 2024-04-19T04:25:47.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.389823+0000", 2024-04-19T04:25:47.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022313839999999999 2024-04-19T04:25:47.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.389974+0000", 2024-04-19T04:25:47.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015067100000000001 2024-04-19T04:25:47.396 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.396 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.396 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.397 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:131920 5.a 5:5a715c12:::benchmark_data_smithi007_19526_object6186:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:47.397 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:47.389160+0000", 2024-04-19T04:25:47.397 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0039435779999999997, 2024-04-19T04:25:47.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040703170000000004, 2024-04-19T04:25:47.397 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.397 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:47.397 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.397 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.397 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.397 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131920 2024-04-19T04:25:47.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.397 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.389160+0000", 2024-04-19T04:25:47.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.389160+0000", 2024-04-19T04:25:47.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.389159+0000", 2024-04-19T04:25:47.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.389163+0000", 2024-04-19T04:25:47.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8809999999999998e-06 2024-04-19T04:25:47.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.389173+0000", 2024-04-19T04:25:47.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0434e-05 2024-04-19T04:25:47.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.389178+0000", 2024-04-19T04:25:47.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9490000000000004e-06 2024-04-19T04:25:47.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391921+0000", 2024-04-19T04:25:47.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027433549999999998 2024-04-19T04:25:47.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.392025+0000", 2024-04-19T04:25:47.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103977 2024-04-19T04:25:47.401 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.401 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.401 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.401 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:131929 5.b 5:d02f434e:::benchmark_data_smithi007_19526_object6195:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:47.401 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:47.391160+0000", 2024-04-19T04:25:47.402 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0019433409999999999, 2024-04-19T04:25:47.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021440280000000001, 2024-04-19T04:25:47.402 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.402 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:47.402 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.402 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.402 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.402 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131929 2024-04-19T04:25:47.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.402 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391160+0000", 2024-04-19T04:25:47.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391160+0000", 2024-04-19T04:25:47.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391159+0000", 2024-04-19T04:25:47.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391165+0000", 2024-04-19T04:25:47.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9750000000000004e-06 2024-04-19T04:25:47.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391181+0000", 2024-04-19T04:25:47.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5838999999999999e-05 2024-04-19T04:25:47.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391189+0000", 2024-04-19T04:25:47.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4959999999999996e-06 2024-04-19T04:25:47.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391244+0000", 2024-04-19T04:25:47.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5031999999999998e-05 2024-04-19T04:25:47.405 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.405 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.405 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.405 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:131922 5.f e49/20 5:fadbad36:::benchmark_data_smithi007_19526_object6188:head v 49'8104, mlcod=49'8101)", 2024-04-19T04:25:47.405 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:47.391177+0000", 2024-04-19T04:25:47.405 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0019265020000000001, 2024-04-19T04:25:47.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021957270000000002, 2024-04-19T04:25:47.406 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.406 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:47.406 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391177+0000", 2024-04-19T04:25:47.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391177+0000", 2024-04-19T04:25:47.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391176+0000", 2024-04-19T04:25:47.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391185+0000", 2024-04-19T04:25:47.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1929999999999999e-06 2024-04-19T04:25:47.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391194+0000", 2024-04-19T04:25:47.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4329999999999993e-06 2024-04-19T04:25:47.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391200+0000", 2024-04-19T04:25:47.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.925e-06 2024-04-19T04:25:47.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391240+0000", 2024-04-19T04:25:47.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9999000000000001e-05 2024-04-19T04:25:47.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391279+0000", 2024-04-19T04:25:47.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8346999999999997e-05 2024-04-19T04:25:47.408 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.409 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.409 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.409 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:131930 5.8 5:16c7cc02:::benchmark_data_smithi007_19526_object6196:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:47.409 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:47.391287+0000", 2024-04-19T04:25:47.409 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001816233, 2024-04-19T04:25:47.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021313959999999998, 2024-04-19T04:25:47.409 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.409 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:47.409 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.409 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.409 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.409 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131930 2024-04-19T04:25:47.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.410 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391287+0000", 2024-04-19T04:25:47.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391287+0000", 2024-04-19T04:25:47.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391286+0000", 2024-04-19T04:25:47.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391292+0000", 2024-04-19T04:25:47.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2770000000000002e-06 2024-04-19T04:25:47.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391302+0000", 2024-04-19T04:25:47.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9040000000000004e-06 2024-04-19T04:25:47.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391310+0000", 2024-04-19T04:25:47.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7090000000000002e-06 2024-04-19T04:25:47.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391357+0000", 2024-04-19T04:25:47.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7632000000000001e-05 2024-04-19T04:25:47.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.391473+0000", 2024-04-19T04:25:47.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000116019 2024-04-19T04:25:47.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.413 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.413 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:131931 5.8 5.cd5f8e48 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:47.413 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:47.392042+0000", 2024-04-19T04:25:47.413 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0010607030000000001, 2024-04-19T04:25:47.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0014201979999999999, 2024-04-19T04:25:47.413 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.413 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:47.413 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.414 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.414 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.414 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131931 2024-04-19T04:25:47.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.414 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.392042+0000", 2024-04-19T04:25:47.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.392042+0000", 2024-04-19T04:25:47.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.392042+0000", 2024-04-19T04:25:47.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.392047+0000", 2024-04-19T04:25:47.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9020000000000004e-06 2024-04-19T04:25:47.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.392059+0000", 2024-04-19T04:25:47.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1260999999999999e-05 2024-04-19T04:25:47.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:47.392067+0000", 2024-04-19T04:25:47.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2360000000000004e-06 2024-04-19T04:25:47.418 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.418 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.418 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.418 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.418 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:47.419 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 6 2024-04-19T04:25:47.419 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:47.420 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:47.474 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:47.473+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:47.546 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:47.546 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:47.546 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:47.546 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:47.546 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:47.558 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:47.574 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:47.573+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:47.675 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:47.673+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:47.682 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 53.445479984999999, 2024-04-19T04:25:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 53.441031068999997, 2024-04-19T04:25:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:47.696 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:47.696 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 34.613098825999998, 2024-04-19T04:25:47.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:47.696 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.696 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.696 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.696 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.696 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.696 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:47.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.696 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:47.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:47.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:47.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:47.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:47.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:47.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:47.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:47.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:47.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:47.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:47.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:47.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:47.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:47.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:47.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:47.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:47.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:47.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:47.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:47.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:47.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:47.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:47.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:47.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:47.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:47.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:47.702 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.702 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.702 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.702 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:47.702 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:47.702 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 32.177244789, 2024-04-19T04:25:47.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:47.703 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.703 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.703 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.703 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.703 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.703 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:47.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.703 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:47.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:47.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:47.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:47.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:47.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:47.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:47.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:47.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:47.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:47.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:47.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:47.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:47.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:47.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:47.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:47.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:47.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:47.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:47.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:47.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:47.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:47.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:47.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:47.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:47.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:47.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:47.708 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.708 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.708 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.708 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:47.708 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:47.708 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 32.176814368999999, 2024-04-19T04:25:47.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:47.708 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.709 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.709 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.709 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.709 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.709 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:47.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.710 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:47.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:47.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:47.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:47.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:47.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:47.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:47.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:47.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:47.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:47.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:47.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:47.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:47.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:47.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:47.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:47.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:47.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:47.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:47.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:47.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:47.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:47.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:47.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:47.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:47.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:47.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:47.715 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.715 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.715 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.715 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:47.715 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:47.715 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 32.174583105000004, 2024-04-19T04:25:47.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:47.715 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.715 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.715 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.715 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.715 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.715 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:47.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.716 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:47.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:47.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:47.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:47.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:47.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:47.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:47.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:47.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:47.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:47.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:47.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:47.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:47.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:47.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:47.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:47.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:47.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:47.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:47.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:47.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:47.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:47.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:47.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:47.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:47.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:47.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:47.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:47.720 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.721 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.721 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.721 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:47.721 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:47.721 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 32.171186067000001, 2024-04-19T04:25:47.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:47.721 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.721 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.721 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.721 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.721 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.721 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:47.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.722 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:47.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:47.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:47.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:47.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:47.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:47.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:47.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:47.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:47.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:47.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:47.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:47.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:47.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:47.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:47.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:47.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:47.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:47.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:47.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:47.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:47.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:47.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:47.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:47.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:47.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:47.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:47.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:47.726 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.726 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.726 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.727 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:47.727 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:47.727 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 32.166057868999999, 2024-04-19T04:25:47.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:47.727 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.727 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.727 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.727 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.727 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.727 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:47.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.727 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:47.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:47.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:47.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:47.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:47.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:47.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:47.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:47.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:47.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:47.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:47.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:47.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:47.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:47.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:47.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:47.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:47.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:47.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:47.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:47.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:47.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:47.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:47.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:47.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:47.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:47.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:47.732 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.733 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.733 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.733 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:47.733 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:47.733 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.852029364, 2024-04-19T04:25:47.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:47.733 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.733 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.733 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.733 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.733 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.733 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:47.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.733 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:47.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:47.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:47.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:47.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:47.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:47.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:47.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:47.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:47.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:47.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:47.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:47.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:47.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:47.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:47.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:47.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:47.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:47.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:47.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:47.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:47.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:47.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:47.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:47.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:47.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:47.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:47.738 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.738 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.738 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.738 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:47.738 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:47.738 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.729669953999998, 2024-04-19T04:25:47.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:25:47.739 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.739 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:47.739 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.739 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.739 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.739 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:47.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.739 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:47.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:47.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:47.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:47.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:47.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:47.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:47.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:47.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:47.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:47.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:47.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:47.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:47.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:47.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:47.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:47.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:47.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:47.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:47.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:47.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:47.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:47.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:47.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:47.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:47.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:25:47.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:25:47.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:25:47.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:25:47.745 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.745 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.745 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.745 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:47.745 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:47.745 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.724608308000001, 2024-04-19T04:25:47.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:25:47.745 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.745 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:47.745 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.745 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.746 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.746 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:47.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.746 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:47.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:47.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:47.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:47.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:47.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:47.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:47.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:47.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:47.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:47.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:47.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:47.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:47.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:47.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:47.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:47.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:47.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:47.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:47.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:47.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:47.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:47.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:25:47.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:25:47.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:25:47.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:25:47.751 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.751 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.751 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.751 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:47.752 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:47.752 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.724508396000001, 2024-04-19T04:25:47.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:25:47.752 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.752 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:47.752 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.752 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.752 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.752 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:47.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.752 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:47.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:47.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:47.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:47.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:47.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:47.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:47.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:47.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:47.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:47.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:47.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:47.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:47.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:47.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:47.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:47.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:47.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:47.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:47.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:47.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:47.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:25:47.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:25:47.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:25:47.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:25:47.757 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.757 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.757 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.757 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:47.757 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:47.757 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.724382642999998, 2024-04-19T04:25:47.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:25:47.758 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.758 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:47.758 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.758 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.758 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.758 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:47.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.758 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.758 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.758 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:47.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:47.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:47.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:47.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:47.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:47.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:47.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:47.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:47.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:47.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:47.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:47.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:47.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:47.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:47.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:47.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:47.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:47.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:47.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:47.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:47.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:25:47.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:25:47.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:25:47.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:25:47.765 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.766 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.766 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.766 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:47.766 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:47.766 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.720538697999999, 2024-04-19T04:25:47.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:25:47.766 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.766 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.767 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.767 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.767 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.767 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:47.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.767 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:47.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:47.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:47.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:47.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:47.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:47.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:47.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:47.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:47.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:47.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:47.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:47.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:47.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:47.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:47.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:25:47.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:25:47.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:25:47.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:25:47.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.771 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:47.771 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:25:47.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:25:47.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.771 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:47.771 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:25:47.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:25:47.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.771 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.771 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:25:47.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:25:47.772 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.772 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.772 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.772 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:47.772 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:47.772 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.713367597000001, 2024-04-19T04:25:47.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:25:47.772 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.772 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:47.773 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.773 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.773 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.773 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:47.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.773 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:47.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:47.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:47.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:47.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:47.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:47.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:47.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:47.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:47.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:47.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:47.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:47.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:47.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:47.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:47.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:25:47.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:25:47.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:25:47.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:25:47.777 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.777 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.777 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.778 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:47.778 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:47.778 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.713195493000001, 2024-04-19T04:25:47.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:25:47.778 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.778 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:47.778 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.778 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.778 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.778 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:47.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.779 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:47.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:47.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:47.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:47.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:47.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:47.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:47.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:47.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:47.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:47.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:47.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:47.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:47.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:47.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.782 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:25:47.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:25:47.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.782 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:25:47.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:25:47.782 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.782 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.783 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.783 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:47.783 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:47.783 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.713132368, 2024-04-19T04:25:47.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:25:47.783 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.783 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.783 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.783 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.783 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.783 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:47.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.784 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:47.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:47.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:47.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:47.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:47.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:47.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:47.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:47.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:47.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:47.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:47.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:47.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:47.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:47.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:25:47.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:25:47.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:25:47.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:25:47.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:47.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:25:47.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:25:47.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:47.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:25:47.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:25:47.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:25:47.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:25:47.789 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.789 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.789 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.789 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:47.789 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:47.789 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.713003771, 2024-04-19T04:25:47.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:25:47.789 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.789 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.790 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.790 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.790 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.790 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:47.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.790 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.790 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:47.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:47.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:47.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:47.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:47.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:47.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:47.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:47.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:47.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:47.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:47.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:47.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:47.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:47.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:25:47.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:25:47.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.794 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:25:47.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:25:47.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.794 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:47.794 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:25:47.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:25:47.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.794 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:47.794 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:25:47.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:25:47.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:25:47.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:25:47.795 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.795 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.795 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.795 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:47.795 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:47.796 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.7129358, 2024-04-19T04:25:47.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:25:47.796 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.796 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.796 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.796 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.796 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.796 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:47.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.796 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:47.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:47.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:47.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:47.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:47.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:47.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:47.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:47.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:47.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:47.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:47.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:47.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:47.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:47.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:25:47.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:25:47.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:25:47.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:25:47.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:47.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:25:47.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:25:47.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:47.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:25:47.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:25:47.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:25:47.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:25:47.801 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.801 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.801 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.801 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:111654 5.0 5:0b6b473d:::benchmark_data_smithi007_19526_object111653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:47.801 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:47.801 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.765144694, 2024-04-19T04:25:47.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023122753999999999, 2024-04-19T04:25:47.802 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:47.802 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:47.802 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:47.802 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:47.802 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.802 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 111654 2024-04-19T04:25:47.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.802 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:47.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:47.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:47.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:47.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:47.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:47.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:47.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915865+0000", 2024-04-19T04:25:47.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:47.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915897+0000", 2024-04-19T04:25:47.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1708999999999997e-05 2024-04-19T04:25:47.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:47.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915905+0000", 2024-04-19T04:25:47.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.481e-06 2024-04-19T04:25:47.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915911+0000", 2024-04-19T04:25:47.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6880000000000002e-06 2024-04-19T04:25:47.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:47.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925564+0000", 2024-04-19T04:25:47.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096527039999999998 2024-04-19T04:25:47.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:47.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925771+0000", 2024-04-19T04:25:47.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020717199999999999 2024-04-19T04:25:47.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:47.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938888+0000", 2024-04-19T04:25:47.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013117105 2024-04-19T04:25:47.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:47.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938931+0000", 2024-04-19T04:25:47.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2447000000000002e-05 2024-04-19T04:25:47.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:47.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:47.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:47.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938989+0000", 2024-04-19T04:25:47.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7997000000000001e-05 2024-04-19T04:25:47.806 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.806 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.806 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.806 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:47.808 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:47.808 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:47.810 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:47.809+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:47.810 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:47.910 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:47.909+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:47.945 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:47.945 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:47.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.945 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:133256 5.5 5:a9ef1cd2:::benchmark_data_smithi007_19526_object7522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:47.945 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:47.941144+0000", 2024-04-19T04:25:47.945 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0035110459999999999, 2024-04-19T04:25:47.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0035348110000000001, 2024-04-19T04:25:47.945 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.945 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:47.946 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.946 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.946 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.946 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 133256 2024-04-19T04:25:47.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.946 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941144+0000", 2024-04-19T04:25:47.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.947 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.947 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.947 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941144+0000", 2024-04-19T04:25:47.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941143+0000", 2024-04-19T04:25:47.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941146+0000", 2024-04-19T04:25:47.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.7599999999999998e-06 2024-04-19T04:25:47.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941152+0000", 2024-04-19T04:25:47.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7209999999999999e-06 2024-04-19T04:25:47.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941157+0000", 2024-04-19T04:25:47.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.938e-06 2024-04-19T04:25:47.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.943449+0000", 2024-04-19T04:25:47.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0022922490000000001 2024-04-19T04:25:47.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.943605+0000", 2024-04-19T04:25:47.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015588399999999999 2024-04-19T04:25:47.950 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.951 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.951 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.951 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:133257 5.d 5:bd75a539:::benchmark_data_smithi007_19526_object7523:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:47.951 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:47.941385+0000", 2024-04-19T04:25:47.952 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0032703229999999999, 2024-04-19T04:25:47.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0033610799999999998, 2024-04-19T04:25:47.952 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.952 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:47.953 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.953 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.953 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.953 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 133257 2024-04-19T04:25:47.953 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.953 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.953 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.953 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.953 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941385+0000", 2024-04-19T04:25:47.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.954 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.954 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.954 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941385+0000", 2024-04-19T04:25:47.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.954 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.955 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.955 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941384+0000", 2024-04-19T04:25:47.955 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.955 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.955 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941388+0000", 2024-04-19T04:25:47.955 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7850000000000002e-06 2024-04-19T04:25:47.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941406+0000", 2024-04-19T04:25:47.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8646000000000001e-05 2024-04-19T04:25:47.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941413+0000", 2024-04-19T04:25:47.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6220000000000003e-06 2024-04-19T04:25:47.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.943771+0000", 2024-04-19T04:25:47.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023576399999999998 2024-04-19T04:25:47.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.943900+0000", 2024-04-19T04:25:47.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012893 2024-04-19T04:25:47.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:47.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944050+0000", 2024-04-19T04:25:47.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014994300000000001 2024-04-19T04:25:47.958 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.959 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.959 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.959 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.959 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:133258 5.2 5:4b5e7f0a:::benchmark_data_smithi007_19526_object7524:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:47.959 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:47.941478+0000", 2024-04-19T04:25:47.959 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0031772509999999999, 2024-04-19T04:25:47.959 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0033318190000000002, 2024-04-19T04:25:47.960 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.960 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:47.960 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.960 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.960 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.960 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 133258 2024-04-19T04:25:47.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.960 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941478+0000", 2024-04-19T04:25:47.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941478+0000", 2024-04-19T04:25:47.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941477+0000", 2024-04-19T04:25:47.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941483+0000", 2024-04-19T04:25:47.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3400000000000003e-06 2024-04-19T04:25:47.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941494+0000", 2024-04-19T04:25:47.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0515e-05 2024-04-19T04:25:47.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941500+0000", 2024-04-19T04:25:47.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1020000000000002e-06 2024-04-19T04:25:47.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941562+0000", 2024-04-19T04:25:47.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2544000000000003e-05 2024-04-19T04:25:47.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.965 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.965 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941719+0000", 2024-04-19T04:25:47.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015676199999999999 2024-04-19T04:25:47.965 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.965 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.965 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.965 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:133259 5.f 5:fbebc33c:::benchmark_data_smithi007_19526_object7525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:47.965 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:47.941552+0000", 2024-04-19T04:25:47.966 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0031032400000000002, 2024-04-19T04:25:47.966 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0033157429999999999, 2024-04-19T04:25:47.966 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.966 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:47.966 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.966 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.966 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.966 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 133259 2024-04-19T04:25:47.966 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.966 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.966 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.966 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941552+0000", 2024-04-19T04:25:47.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941552+0000", 2024-04-19T04:25:47.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941551+0000", 2024-04-19T04:25:47.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941556+0000", 2024-04-19T04:25:47.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8790000000000002e-06 2024-04-19T04:25:47.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941566+0000", 2024-04-19T04:25:47.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.662e-06 2024-04-19T04:25:47.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941572+0000", 2024-04-19T04:25:47.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8929999999999999e-06 2024-04-19T04:25:47.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941637+0000", 2024-04-19T04:25:47.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5000999999999996e-05 2024-04-19T04:25:47.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941776+0000", 2024-04-19T04:25:47.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013899299999999999 2024-04-19T04:25:47.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:47.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941897+0000", 2024-04-19T04:25:47.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000120835 2024-04-19T04:25:47.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:47.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944548+0000", 2024-04-19T04:25:47.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026504929999999999 2024-04-19T04:25:47.970 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.970 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.970 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.970 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:133263 5.7 5:e744d6f3:::benchmark_data_smithi007_19526_object7529:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:47.970 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:47.943678+0000", 2024-04-19T04:25:47.970 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0009767650000000001, 2024-04-19T04:25:47.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012570400000000001, 2024-04-19T04:25:47.971 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.971 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:47.971 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.971 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.971 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.971 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 133263 2024-04-19T04:25:47.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.971 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.971 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.971 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.943678+0000", 2024-04-19T04:25:47.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.943678+0000", 2024-04-19T04:25:47.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.943677+0000", 2024-04-19T04:25:47.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.943683+0000", 2024-04-19T04:25:47.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0619999999999997e-06 2024-04-19T04:25:47.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.943712+0000", 2024-04-19T04:25:47.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8428e-05 2024-04-19T04:25:47.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.943721+0000", 2024-04-19T04:25:47.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.969e-06 2024-04-19T04:25:47.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.974 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.974 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.943822+0000", 2024-04-19T04:25:47.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010134200000000001 2024-04-19T04:25:47.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.974 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.974 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.943963+0000", 2024-04-19T04:25:47.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014092600000000001 2024-04-19T04:25:47.974 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.974 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.974 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.975 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:133248 5.d e49/29)", 2024-04-19T04:25:47.975 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:47.943980+0000", 2024-04-19T04:25:47.975 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00067523099999999999, 2024-04-19T04:25:47.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001007612, 2024-04-19T04:25:47.975 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.975 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:47.975 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.975 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.975 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.943980+0000", 2024-04-19T04:25:47.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.943980+0000", 2024-04-19T04:25:47.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.943979+0000", 2024-04-19T04:25:47.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.943999+0000", 2024-04-19T04:25:47.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9482000000000001e-05 2024-04-19T04:25:47.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944008+0000", 2024-04-19T04:25:47.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1060000000000006e-06 2024-04-19T04:25:47.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944015+0000", 2024-04-19T04:25:47.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8390000000000001e-06 2024-04-19T04:25:47.977 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.977 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.977 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.977 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:133264 5.2 5:4ee8d9d5:::benchmark_data_smithi007_19526_object7530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:47.978 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:47.944250+0000", 2024-04-19T04:25:47.978 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00040535899999999999, 2024-04-19T04:25:47.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00077957700000000005, 2024-04-19T04:25:47.978 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.978 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:47.978 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.978 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.978 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.978 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 133264 2024-04-19T04:25:47.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.978 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.978 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.978 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.978 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944250+0000", 2024-04-19T04:25:47.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.979 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.979 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944250+0000", 2024-04-19T04:25:47.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.979 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.979 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944249+0000", 2024-04-19T04:25:47.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:47.979 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.979 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944254+0000", 2024-04-19T04:25:47.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7280000000000003e-06 2024-04-19T04:25:47.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.980 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.980 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944275+0000", 2024-04-19T04:25:47.980 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1698000000000001e-05 2024-04-19T04:25:47.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.980 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.980 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944296+0000", 2024-04-19T04:25:47.980 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0750999999999998e-05 2024-04-19T04:25:47.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.980 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.980 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944351+0000", 2024-04-19T04:25:47.980 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4796999999999997e-05 2024-04-19T04:25:47.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.981 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.981 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944547+0000", 2024-04-19T04:25:47.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019627100000000001 2024-04-19T04:25:47.981 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.981 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.981 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.981 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:133259 5.f e49/20 ondisk, result = 0)", 2024-04-19T04:25:47.981 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:47.944418+0000", 2024-04-19T04:25:47.981 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00023714299999999999, 2024-04-19T04:25:47.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00066664199999999995, 2024-04-19T04:25:47.981 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.982 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:47.982 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.982 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944418+0000", 2024-04-19T04:25:47.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.982 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944418+0000", 2024-04-19T04:25:47.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944417+0000", 2024-04-19T04:25:47.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944423+0000", 2024-04-19T04:25:47.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8130000000000001e-06 2024-04-19T04:25:47.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944448+0000", 2024-04-19T04:25:47.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5537999999999998e-05 2024-04-19T04:25:47.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944455+0000", 2024-04-19T04:25:47.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5749999999999997e-06 2024-04-19T04:25:47.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944536+0000", 2024-04-19T04:25:47.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1193999999999995e-05 2024-04-19T04:25:47.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.944543+0000", 2024-04-19T04:25:47.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5409999999999997e-06 2024-04-19T04:25:47.984 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.985 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.985 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.985 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:133243 5.7 5:e7509406:::benchmark_data_smithi007_19526_object7509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:47.985 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:47.935683+0000", 2024-04-19T04:25:47.985 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0089716050000000006, 2024-04-19T04:25:47.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0094533929999999992, 2024-04-19T04:25:47.985 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.985 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:47.985 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.985 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.985 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.985 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 133243 2024-04-19T04:25:47.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.986 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.986 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.935683+0000", 2024-04-19T04:25:47.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.986 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.935683+0000", 2024-04-19T04:25:47.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.987 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.935683+0000", 2024-04-19T04:25:47.987 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.987 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.987 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.987 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.935687+0000", 2024-04-19T04:25:47.987 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6330000000000004e-06 2024-04-19T04:25:47.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.987 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.987 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.987 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.935696+0000", 2024-04-19T04:25:47.987 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5210000000000002e-06 2024-04-19T04:25:47.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.987 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.987 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.935702+0000", 2024-04-19T04:25:47.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3330000000000002e-06 2024-04-19T04:25:47.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.938183+0000", 2024-04-19T04:25:47.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024809210000000001 2024-04-19T04:25:47.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.938312+0000", 2024-04-19T04:25:47.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012896000000000001 2024-04-19T04:25:47.988 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.988 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.989 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.989 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:133245 5.d 5:bacb16a2:::benchmark_data_smithi007_19526_object7511:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:47.989 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:47.935745+0000", 2024-04-19T04:25:47.989 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0089101479999999997, 2024-04-19T04:25:47.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0094491149999999993, 2024-04-19T04:25:47.989 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.989 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:47.989 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.989 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.989 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.989 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 133245 2024-04-19T04:25:47.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.989 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.935745+0000", 2024-04-19T04:25:47.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.990 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.935745+0000", 2024-04-19T04:25:47.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.990 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.935744+0000", 2024-04-19T04:25:47.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.935747+0000", 2024-04-19T04:25:47.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.915e-06 2024-04-19T04:25:47.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.935755+0000", 2024-04-19T04:25:47.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0730000000000005e-06 2024-04-19T04:25:47.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.935762+0000", 2024-04-19T04:25:47.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6089999999999997e-06 2024-04-19T04:25:47.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.936224+0000", 2024-04-19T04:25:47.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00046237900000000001 2024-04-19T04:25:47.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.936350+0000", 2024-04-19T04:25:47.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012522999999999999 2024-04-19T04:25:47.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:47.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.936417+0000", 2024-04-19T04:25:47.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7544000000000002e-05 2024-04-19T04:25:47.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:47.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.943742+0000", 2024-04-19T04:25:47.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0073250959999999997 2024-04-19T04:25:47.994 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.994 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.994 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.994 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:133248 5.d 5:ba1edc74:::benchmark_data_smithi007_19526_object7514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:47.994 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:47.936699+0000", 2024-04-19T04:25:47.994 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0079561170000000004, 2024-04-19T04:25:47.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0085610089999999996, 2024-04-19T04:25:47.994 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.994 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:47.994 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.994 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.995 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.995 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 133248 2024-04-19T04:25:47.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.995 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.995 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:47.995 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.936699+0000", 2024-04-19T04:25:47.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.995 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:47.995 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.936699+0000", 2024-04-19T04:25:47.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:47.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:47.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.936698+0000", 2024-04-19T04:25:47.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:47.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:47.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.936702+0000", 2024-04-19T04:25:47.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.613e-06 2024-04-19T04:25:47.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:47.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.936708+0000", 2024-04-19T04:25:47.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4779999999999996e-06 2024-04-19T04:25:47.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:47.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.936714+0000", 2024-04-19T04:25:47.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7230000000000001e-06 2024-04-19T04:25:47.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:47.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.940920+0000", 2024-04-19T04:25:47.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042059380000000002 2024-04-19T04:25:47.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:47.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941051+0000", 2024-04-19T04:25:47.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013134999999999999 2024-04-19T04:25:47.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:47.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.941168+0000", 2024-04-19T04:25:47.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000116511 2024-04-19T04:25:47.998 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.998 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:47.998 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:47.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:47.999 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:133250 5.7 5:e02a3097:::benchmark_data_smithi007_19526_object7516:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:47.999 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:47.938339+0000", 2024-04-19T04:25:47.999 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0063162319999999997, 2024-04-19T04:25:47.999 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.006983553, 2024-04-19T04:25:47.999 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:47.999 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:47.999 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:47.999 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:47.999 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:47.999 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 133250 2024-04-19T04:25:47.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:47.999 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:47.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.000 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.938339+0000", 2024-04-19T04:25:48.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.000 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.938339+0000", 2024-04-19T04:25:48.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.938338+0000", 2024-04-19T04:25:48.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.938345+0000", 2024-04-19T04:25:48.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1459999999999999e-06 2024-04-19T04:25:48.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.002 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.938357+0000", 2024-04-19T04:25:48.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1755e-05 2024-04-19T04:25:48.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.002 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.938365+0000", 2024-04-19T04:25:48.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9509999999999995e-06 2024-04-19T04:25:48.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.002 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.940791+0000", 2024-04-19T04:25:48.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024253909999999998 2024-04-19T04:25:48.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.003 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.003 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.940962+0000", 2024-04-19T04:25:48.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017144999999999999 2024-04-19T04:25:48.003 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.003 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.003 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.003 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:133252 5.2 5:4cf5f3b1:::benchmark_data_smithi007_19526_object7518:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:48.003 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:47.939013+0000", 2024-04-19T04:25:48.003 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0056417790000000004, 2024-04-19T04:25:48.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0063689300000000001, 2024-04-19T04:25:48.004 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.004 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:48.004 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:48.004 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:48.004 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.004 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 133252 2024-04-19T04:25:48.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.004 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.004 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.004 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.939013+0000", 2024-04-19T04:25:48.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.939013+0000", 2024-04-19T04:25:48.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.939012+0000", 2024-04-19T04:25:48.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.939019+0000", 2024-04-19T04:25:48.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3690000000000003e-06 2024-04-19T04:25:48.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.939029+0000", 2024-04-19T04:25:48.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.006e-05 2024-04-19T04:25:48.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.007 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.007 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.939036+0000", 2024-04-19T04:25:48.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1500000000000002e-06 2024-04-19T04:25:48.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.007 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.007 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.939085+0000", 2024-04-19T04:25:48.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9311000000000003e-05 2024-04-19T04:25:48.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.007 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.007 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:47.939246+0000", 2024-04-19T04:25:48.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016102099999999999 2024-04-19T04:25:48.007 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.007 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.008 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.008 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.008 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:48.008 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 13 2024-04-19T04:25:48.008 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:48.009 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:48.011 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:48.009+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:48.112 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T04:25:48.113 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:48.113+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:48.142 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:48.142 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:48.142 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:48.142 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:48.143 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:48.154 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:48.213 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:48.213+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:48.281 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:48.281 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:48.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:48.281 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:48.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.281 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:48.281 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:48.281 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 54.047745192000001, 2024-04-19T04:25:48.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:48.281 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.281 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:48.282 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:48.282 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:48.282 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.282 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:48.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.282 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:48.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:48.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.283 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.283 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:48.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.283 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.283 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:48.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:48.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.283 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:48.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:48.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:48.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:48.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:48.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:48.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.285 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.285 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:48.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:48.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.285 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:48.285 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:48.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:48.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.285 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:48.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:48.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:48.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:48.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:48.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:48.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:48.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:48.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:48.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:48.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:48.287 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.287 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.287 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.287 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:48.287 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:48.287 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 54.044564035999997, 2024-04-19T04:25:48.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:48.287 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.287 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:48.288 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:48.288 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:48.288 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.288 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:48.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.288 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:48.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:48.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:48.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:48.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:48.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:48.290 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:48.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.290 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.290 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:48.290 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:48.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.290 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.290 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:48.290 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:48.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.290 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:48.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:48.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:48.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:48.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:48.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:48.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:48.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:48.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:48.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:48.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:48.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.292 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.292 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:48.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:48.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:48.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.292 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.292 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:48.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:48.292 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.292 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.292 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.293 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:48.293 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:48.293 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 54.043995932000001, 2024-04-19T04:25:48.293 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:48.293 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.293 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:48.293 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.293 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.293 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:48.293 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.294 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.294 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:48.294 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.294 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.294 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.294 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.294 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:48.294 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:48.294 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.294 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.294 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.294 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:48.294 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:48.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.295 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.295 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:48.295 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:48.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.295 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.295 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:48.295 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:48.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.295 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.295 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:48.295 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:48.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:48.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:48.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:48.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:48.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:48.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:48.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:48.297 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.297 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.297 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.297 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:48.297 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:48.297 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 54.043650270999997, 2024-04-19T04:25:48.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:48.297 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.297 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:48.297 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:48.297 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:48.297 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.297 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:48.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.298 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.298 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:48.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.299 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:48.299 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.299 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.299 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:48.299 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.299 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.299 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:48.299 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:48.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:48.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:48.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:48.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:48.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:48.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:48.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:48.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:48.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:48.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:48.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:48.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:48.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:48.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:48.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:48.302 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:48.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:48.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:48.302 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:48.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:48.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.302 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:48.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:48.303 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.303 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.303 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.303 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:48.303 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:48.303 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 54.042925832999998, 2024-04-19T04:25:48.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:48.303 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.303 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:48.303 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:48.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.304 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.304 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:48.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.304 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.304 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:48.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.304 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.304 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:48.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:48.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:48.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:48.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:48.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:48.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:48.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:48.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:48.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:48.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:48.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:48.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:48.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:48.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:48.307 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.307 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.307 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.307 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:48.307 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:48.307 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 54.042918438000001, 2024-04-19T04:25:48.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:48.307 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.307 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:48.307 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:48.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:48.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:48.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:48.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.309 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:48.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:48.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.309 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:48.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:48.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.309 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:48.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:48.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:48.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:48.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:48.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:48.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:48.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:48.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:48.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:48.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:48.311 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.311 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.311 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.311 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:48.311 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:48.312 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 54.041093291000003, 2024-04-19T04:25:48.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:48.312 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.312 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:48.312 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:48.312 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:48.312 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.312 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:48.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.312 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:48.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:48.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:48.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:48.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:48.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:48.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:48.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:48.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:48.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:48.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:48.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:48.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:48.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:48.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:48.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:48.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:48.316 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:48.316 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:48.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.316 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:48.316 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:48.316 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:48.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.316 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:48.317 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:48.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:48.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.317 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.317 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:48.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:48.317 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.317 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.317 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.317 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:48.317 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:48.317 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 54.040359086000002, 2024-04-19T04:25:48.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:48.318 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.318 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:48.318 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:48.318 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:48.318 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.318 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:48.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.318 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:48.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.319 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.319 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.319 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.319 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:48.319 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.319 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.319 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.319 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.320 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:48.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.320 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.320 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.320 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.320 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:48.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:48.320 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.320 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.320 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.320 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:48.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:48.320 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.320 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.320 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.321 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:48.321 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:48.321 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.321 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.321 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.321 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:48.321 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:48.321 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.321 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.321 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.321 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:48.321 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:48.321 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.321 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.321 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:48.321 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:48.322 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:48.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.322 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.322 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:48.322 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:48.322 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:48.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.322 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.322 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:48.322 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:48.322 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:48.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.322 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.322 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:48.323 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:48.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:48.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.323 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.323 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.323 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:48.324 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:48.324 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.324 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.324 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.324 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.325 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:48.325 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:48.325 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 54.039824809999999, 2024-04-19T04:25:48.325 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:48.325 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.325 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:48.325 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.325 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.325 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:48.325 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.326 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.326 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:48.326 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.326 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.326 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.326 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.326 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:48.326 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.326 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.326 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.326 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.326 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:48.326 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:48.326 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.327 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.327 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:48.327 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:48.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.327 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.327 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:48.327 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:48.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.327 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.327 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:48.327 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:48.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:48.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:48.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:48.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:48.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:48.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:48.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:48.328 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.329 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.329 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.329 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.329 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:48.329 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:48.329 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 32.322969620999999, 2024-04-19T04:25:48.329 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:48.329 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.329 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:48.329 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:48.329 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:48.329 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.329 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:48.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.330 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.330 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:48.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.330 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:48.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.330 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:48.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:48.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:48.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:48.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:48.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:48.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.332 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:48.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:48.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.332 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.332 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:48.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:48.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.332 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.332 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:48.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:48.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.332 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:48.333 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:48.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:48.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:48.333 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:48.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:48.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.333 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:48.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:48.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:48.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:48.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:48.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:48.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:48.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:48.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:48.334 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.334 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.335 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.335 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:48.335 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:48.335 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 32.302739172000003, 2024-04-19T04:25:48.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:48.335 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.335 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:48.335 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:48.335 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:48.335 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.335 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:48.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.335 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:48.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:48.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:48.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:48.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.337 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.337 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:48.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:48.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.337 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.337 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:48.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:48.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.338 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.338 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:48.338 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:48.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.338 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.338 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:48.338 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:48.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.338 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:48.338 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:48.338 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:48.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:48.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:48.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:48.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:48.339 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.339 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.339 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.339 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:48.340 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:48.340 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 32.302631314999999, 2024-04-19T04:25:48.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:48.340 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.340 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:48.340 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:48.340 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:48.340 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.340 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:48.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.340 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:48.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:48.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:48.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:48.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:48.342 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:48.342 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.342 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.342 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.342 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:48.342 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:48.342 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.342 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.342 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.342 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:48.343 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:48.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.343 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.343 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:48.343 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:48.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.343 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:48.343 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:48.343 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:48.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.343 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.343 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:48.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:48.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.344 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.344 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:48.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:48.344 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.344 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.344 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.344 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:48.344 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:48.344 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 32.300664626, 2024-04-19T04:25:48.345 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:48.345 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.345 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:48.345 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:48.345 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:48.345 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.345 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:48.345 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.345 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.345 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.345 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:48.345 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.345 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.346 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.346 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:48.346 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.346 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.346 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:48.346 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:48.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.346 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.346 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:48.346 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:48.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:48.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:48.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:48.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:48.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:48.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:48.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.348 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:48.348 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:48.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:48.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.348 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.348 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.348 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:48.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:48.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.348 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.348 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.348 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:48.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:48.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.349 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:48.349 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:48.349 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:48.349 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.349 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:48.349 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:48.349 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:48.349 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.349 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.349 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:48.349 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:48.349 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.350 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.350 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.350 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.350 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.350 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:48.350 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:48.350 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 32.297300430999996, 2024-04-19T04:25:48.350 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:48.350 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.351 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:48.351 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:48.351 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:48.351 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.351 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:48.351 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.351 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.351 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.351 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.351 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:48.351 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.351 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.351 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.351 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.351 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:48.352 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.352 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.352 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.352 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.352 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:48.352 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.352 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.352 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.352 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.352 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:48.352 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:48.352 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.352 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.352 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.353 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:48.353 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:48.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.353 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.353 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:48.353 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:48.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.353 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.353 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:48.353 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:48.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.353 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:48.354 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:48.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:48.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.354 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.354 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:48.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:48.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.354 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.354 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:48.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:48.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:48.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:48.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:48.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:48.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:48.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:48.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:48.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:48.355 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.355 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.356 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.356 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:48.356 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:48.356 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 32.293489452999999, 2024-04-19T04:25:48.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:48.356 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.356 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:48.356 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:48.356 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:48.356 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.356 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:48.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.356 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.357 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:48.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.357 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:48.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.357 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:48.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:48.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:48.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:48.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:48.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:48.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:48.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.359 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.359 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.359 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:48.359 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:48.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.359 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.359 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:48.359 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:48.359 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:48.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.359 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.359 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.360 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:48.360 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:48.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.360 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:48.360 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:48.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:48.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:48.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:48.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:48.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:48.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:48.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:48.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:48.361 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.361 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.362 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.362 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93735 5.1 5:8e609d1b:::benchmark_data_smithi007_19526_object93734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:48.362 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:48.362 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 19.051788809000001, 2024-04-19T04:25:48.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048424842000000003, 2024-04-19T04:25:48.362 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.362 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:48.362 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:48.362 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:48.362 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.362 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93735 2024-04-19T04:25:48.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.362 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.363 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.363 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.363 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:48.363 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.363 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.363 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.363 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.363 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:48.363 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.363 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.363 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.363 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.363 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227480+0000", 2024-04-19T04:25:48.363 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.364 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.364 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.364 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227533+0000", 2024-04-19T04:25:48.364 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2964999999999999e-05 2024-04-19T04:25:48.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.364 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.364 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.364 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227542+0000", 2024-04-19T04:25:48.364 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1449999999999997e-06 2024-04-19T04:25:48.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.364 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.364 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.364 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227561+0000", 2024-04-19T04:25:48.364 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9116000000000001e-05 2024-04-19T04:25:48.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227610+0000", 2024-04-19T04:25:48.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9234000000000003e-05 2024-04-19T04:25:48.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227697+0000", 2024-04-19T04:25:48.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6682999999999997e-05 2024-04-19T04:25:48.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:48.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275809+0000", 2024-04-19T04:25:48.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048112265000000001 2024-04-19T04:25:48.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:48.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275845+0000", 2024-04-19T04:25:48.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5275999999999999e-05 2024-04-19T04:25:48.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275906+0000", 2024-04-19T04:25:48.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1002999999999999e-05 2024-04-19T04:25:48.366 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.366 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.366 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.367 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93736 5.1 5:852229ec:::benchmark_data_smithi007_19526_object93735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:48.367 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:48.367 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 19.051684778999999, 2024-04-19T04:25:48.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048414497000000001, 2024-04-19T04:25:48.367 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.367 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:48.367 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:48.367 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:48.367 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.367 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93736 2024-04-19T04:25:48.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.367 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:48.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:48.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227584+0000", 2024-04-19T04:25:48.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:48.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227624+0000", 2024-04-19T04:25:48.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9833000000000003e-05 2024-04-19T04:25:48.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227630+0000", 2024-04-19T04:25:48.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0759999999999999e-06 2024-04-19T04:25:48.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227634+0000", 2024-04-19T04:25:48.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1570000000000002e-06 2024-04-19T04:25:48.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229531+0000", 2024-04-19T04:25:48.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018962339999999999 2024-04-19T04:25:48.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229662+0000", 2024-04-19T04:25:48.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013192999999999999 2024-04-19T04:25:48.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:48.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275915+0000", 2024-04-19T04:25:48.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046252140999999997 2024-04-19T04:25:48.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:48.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275944+0000", 2024-04-19T04:25:48.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9539999999999998e-05 2024-04-19T04:25:48.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275999+0000", 2024-04-19T04:25:48.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5062999999999998e-05 2024-04-19T04:25:48.371 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.371 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.371 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.371 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:48.372 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:48.372 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 19.051627096000001, 2024-04-19T04:25:48.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:25:48.372 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.372 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:48.372 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:48.372 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:48.372 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.372 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:25:48.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.372 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:48.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:48.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:48.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:48.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:25:48.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:25:48.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.374 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:25:48.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:25:48.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.374 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:25:48.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:25:48.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.374 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:25:48.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:25:48.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:25:48.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:25:48.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:48.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:25:48.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:25:48.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:48.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:25:48.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:25:48.376 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.376 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.376 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:25:48.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:25:48.376 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.376 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.376 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.376 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.376 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:48.376 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:48.376 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 19.051032815999999, 2024-04-19T04:25:48.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:25:48.377 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.377 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:48.377 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:48.377 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:48.377 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.377 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:25:48.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.377 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:48.377 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.378 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:48.378 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.378 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.378 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:25:48.378 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.378 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.378 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:25:48.378 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:25:48.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.379 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.379 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:25:48.379 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:25:48.379 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.379 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.379 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.379 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:25:48.379 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:25:48.379 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.379 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.379 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.379 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:25:48.379 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:25:48.379 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.380 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.380 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.380 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:25:48.380 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:25:48.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.380 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.380 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:48.380 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:25:48.380 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:25:48.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.380 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.380 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:48.380 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:25:48.380 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:25:48.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.381 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:48.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:25:48.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:25:48.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.381 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:48.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:25:48.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:25:48.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.381 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:25:48.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:25:48.382 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.382 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.382 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.382 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.382 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.382 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93744 5.1 5:87b91c25:::benchmark_data_smithi007_19526_object93743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:48.382 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:48.382 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 19.047363265000001, 2024-04-19T04:25:48.382 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044295022000000003, 2024-04-19T04:25:48.382 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:48.382 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:48.382 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:48.382 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:48.382 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.382 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93744 2024-04-19T04:25:48.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.383 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:48.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:48.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:48.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:48.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:48.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:48.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:48.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231905+0000", 2024-04-19T04:25:48.384 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.384 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.384 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:48.384 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231935+0000", 2024-04-19T04:25:48.384 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9442e-05 2024-04-19T04:25:48.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.384 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.384 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:48.384 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264224+0000", 2024-04-19T04:25:48.384 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.032288836000000001 2024-04-19T04:25:48.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.384 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.385 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.385 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264238+0000", 2024-04-19T04:25:48.385 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4494999999999999e-05 2024-04-19T04:25:48.385 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.385 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.385 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:48.385 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268311+0000", 2024-04-19T04:25:48.385 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040726629999999998 2024-04-19T04:25:48.385 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.385 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.385 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:48.385 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268587+0000", 2024-04-19T04:25:48.385 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00027623200000000001 2024-04-19T04:25:48.385 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.385 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.386 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:48.386 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276099+0000", 2024-04-19T04:25:48.386 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075116180000000003 2024-04-19T04:25:48.386 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.386 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.386 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:48.386 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276123+0000", 2024-04-19T04:25:48.386 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4675e-05 2024-04-19T04:25:48.386 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:48.386 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:48.386 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:48.386 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276201+0000", 2024-04-19T04:25:48.386 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7836000000000005e-05 2024-04-19T04:25:48.386 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.386 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.387 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.387 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:48.387 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:48.387 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:48.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:25:48.389 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:48.385+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:48.389 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:48.489 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:48.485+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:48.515 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:48.515 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:48.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.515 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:134625 5.e 5:71300e2f:::benchmark_data_smithi007_19526_object8891:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:48.515 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:48.511985+0000", 2024-04-19T04:25:48.515 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0034608220000000001, 2024-04-19T04:25:48.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034864399999999999, 2024-04-19T04:25:48.516 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:48.516 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:48.516 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:48.516 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:48.516 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.516 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 134625 2024-04-19T04:25:48.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.516 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:48.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:48.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.511985+0000", 2024-04-19T04:25:48.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:48.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:48.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.511985+0000", 2024-04-19T04:25:48.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:48.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:48.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.511984+0000", 2024-04-19T04:25:48.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:48.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.511991+0000", 2024-04-19T04:25:48.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9190000000000002e-06 2024-04-19T04:25:48.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:48.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512004+0000", 2024-04-19T04:25:48.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2531000000000001e-05 2024-04-19T04:25:48.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512013+0000", 2024-04-19T04:25:48.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9949999999999994e-06 2024-04-19T04:25:48.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:48.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512171+0000", 2024-04-19T04:25:48.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015793400000000001 2024-04-19T04:25:48.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:48.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512338+0000", 2024-04-19T04:25:48.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016702899999999999 2024-04-19T04:25:48.519 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:48.519 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:48.519 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:48.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.520 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:134626 5.a 5:56c07932:::benchmark_data_smithi007_19526_object8892:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:48.520 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:48.512195+0000", 2024-04-19T04:25:48.520 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0032510249999999998, 2024-04-19T04:25:48.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033526369999999999, 2024-04-19T04:25:48.520 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:48.520 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:48.520 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:48.520 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:48.520 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.520 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 134626 2024-04-19T04:25:48.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.521 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:48.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:48.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512195+0000", 2024-04-19T04:25:48.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:48.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:48.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512195+0000", 2024-04-19T04:25:48.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:48.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:48.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512194+0000", 2024-04-19T04:25:48.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:48.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512199+0000", 2024-04-19T04:25:48.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.417e-06 2024-04-19T04:25:48.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:48.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512210+0000", 2024-04-19T04:25:48.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0125e-05 2024-04-19T04:25:48.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512217+0000", 2024-04-19T04:25:48.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4120000000000004e-06 2024-04-19T04:25:48.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:48.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512293+0000", 2024-04-19T04:25:48.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6431000000000001e-05 2024-04-19T04:25:48.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:48.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512440+0000", 2024-04-19T04:25:48.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014646 2024-04-19T04:25:48.524 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:48.524 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:48.524 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:48.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.524 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:134627 5.4 5:2de2ac7a:::benchmark_data_smithi007_19526_object8893:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:48.524 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:48.512806+0000", 2024-04-19T04:25:48.524 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002640435, 2024-04-19T04:25:48.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028085160000000001, 2024-04-19T04:25:48.525 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:48.525 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:48.525 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:48.525 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:48.525 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.525 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 134627 2024-04-19T04:25:48.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.525 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:48.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:48.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512806+0000", 2024-04-19T04:25:48.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:48.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:48.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512806+0000", 2024-04-19T04:25:48.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:48.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:48.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512805+0000", 2024-04-19T04:25:48.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:48.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512810+0000", 2024-04-19T04:25:48.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6540000000000004e-06 2024-04-19T04:25:48.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:48.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512824+0000", 2024-04-19T04:25:48.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3822000000000001e-05 2024-04-19T04:25:48.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512834+0000", 2024-04-19T04:25:48.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0210999999999999e-05 2024-04-19T04:25:48.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:48.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.512880+0000", 2024-04-19T04:25:48.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6152000000000001e-05 2024-04-19T04:25:48.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:48.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.513052+0000", 2024-04-19T04:25:48.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017147899999999999 2024-04-19T04:25:48.528 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:48.528 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:48.528 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:48.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.528 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:134621 5.9 e49/20 5:9900e579:::benchmark_data_smithi007_19526_object8887:head v 49'8584, mlcod=49'8580)", 2024-04-19T04:25:48.528 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:48.513310+0000", 2024-04-19T04:25:48.528 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002135666, 2024-04-19T04:25:48.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023671730000000002, 2024-04-19T04:25:48.529 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:48.529 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:48.529 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:48.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:48.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.513310+0000", 2024-04-19T04:25:48.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:48.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:48.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.513310+0000", 2024-04-19T04:25:48.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:48.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:48.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.513310+0000", 2024-04-19T04:25:48.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:48.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:48.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.513324+0000", 2024-04-19T04:25:48.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4107000000000001e-05 2024-04-19T04:25:48.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:48.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.513336+0000", 2024-04-19T04:25:48.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1982e-05 2024-04-19T04:25:48.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.513342+0000", 2024-04-19T04:25:48.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1650000000000003e-06 2024-04-19T04:25:48.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:48.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.513379+0000", 2024-04-19T04:25:48.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6780999999999999e-05 2024-04-19T04:25:48.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:48.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.513392+0000", 2024-04-19T04:25:48.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2977e-05 2024-04-19T04:25:48.532 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:48.532 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:48.532 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:48.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.532 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:134629 5.b 5:da1c86c4:::benchmark_data_smithi007_19526_object8895:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:48.533 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:48.514195+0000", 2024-04-19T04:25:48.533 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001251484, 2024-04-19T04:25:48.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015511749999999999, 2024-04-19T04:25:48.533 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:48.533 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:48.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:48.534 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:48.534 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.534 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 134629 2024-04-19T04:25:48.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.534 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:48.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:48.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.514195+0000", 2024-04-19T04:25:48.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:48.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:48.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.514195+0000", 2024-04-19T04:25:48.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:48.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:48.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.514193+0000", 2024-04-19T04:25:48.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:48.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.514198+0000", 2024-04-19T04:25:48.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8319999999999996e-06 2024-04-19T04:25:48.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:48.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.514209+0000", 2024-04-19T04:25:48.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0971999999999999e-05 2024-04-19T04:25:48.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.514215+0000", 2024-04-19T04:25:48.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5600000000000001e-06 2024-04-19T04:25:48.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:48.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.514254+0000", 2024-04-19T04:25:48.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8682e-05 2024-04-19T04:25:48.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:48.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.514344+0000", 2024-04-19T04:25:48.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0544999999999995e-05 2024-04-19T04:25:48.537 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:48.537 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:48.537 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:48.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.537 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:134631 5.0 5:0b5b77e9:::benchmark_data_smithi007_19526_object8897:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:48.537 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:48.514954+0000", 2024-04-19T04:25:48.537 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00049214099999999998, 2024-04-19T04:25:48.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00085635099999999999, 2024-04-19T04:25:48.538 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:48.538 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:48.538 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:48.538 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:48.538 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.538 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 134631 2024-04-19T04:25:48.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.538 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:48.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:48.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.514954+0000", 2024-04-19T04:25:48.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:48.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:48.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.514954+0000", 2024-04-19T04:25:48.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:48.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:48.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.514953+0000", 2024-04-19T04:25:48.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:48.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:48.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.514958+0000", 2024-04-19T04:25:48.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4450000000000004e-06 2024-04-19T04:25:48.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:48.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.514972+0000", 2024-04-19T04:25:48.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3721e-05 2024-04-19T04:25:48.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.514979+0000", 2024-04-19T04:25:48.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2300000000000002e-06 2024-04-19T04:25:48.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:48.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.515036+0000", 2024-04-19T04:25:48.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6863000000000001e-05 2024-04-19T04:25:48.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:48.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.515159+0000", 2024-04-19T04:25:48.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000122841 2024-04-19T04:25:48.541 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:48.542 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:48.542 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:48.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.542 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:134632 5.4 5:2b71915b:::benchmark_data_smithi007_19526_object8898:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T04:25:48.542 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:48.514992+0000", 2024-04-19T04:25:48.542 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00045437, 2024-04-19T04:25:48.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00088290799999999996, 2024-04-19T04:25:48.542 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:48.542 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:48.542 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:48.542 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:48.542 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:48.542 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 134632 2024-04-19T04:25:48.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.543 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:48.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:48.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.514992+0000", 2024-04-19T04:25:48.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:48.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:48.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.514992+0000", 2024-04-19T04:25:48.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:48.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:48.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.514991+0000", 2024-04-19T04:25:48.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:48.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:48.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.514994+0000", 2024-04-19T04:25:48.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8959999999999999e-06 2024-04-19T04:25:48.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:48.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.515003+0000", 2024-04-19T04:25:48.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5290000000000008e-06 2024-04-19T04:25:48.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.515008+0000", 2024-04-19T04:25:48.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4040000000000003e-06 2024-04-19T04:25:48.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:48.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.515204+0000", 2024-04-19T04:25:48.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019620799999999999 2024-04-19T04:25:48.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:48.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.515337+0000", 2024-04-19T04:25:48.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013283899999999999 2024-04-19T04:25:48.545 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:48.545 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:48.545 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:48.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.546 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:134628 5.9 e49/20 5:9944c208:::benchmark_data_smithi007_19526_object8894:head v 49'8585, mlcod=49'8581)", 2024-04-19T04:25:48.546 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:48.515163+0000", 2024-04-19T04:25:48.546 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.000283004, 2024-04-19T04:25:48.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00077672099999999997, 2024-04-19T04:25:48.546 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:48.546 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:48.546 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:48.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:48.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.515163+0000", 2024-04-19T04:25:48.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:48.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:48.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.515163+0000", 2024-04-19T04:25:48.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:48.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:48.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.515162+0000", 2024-04-19T04:25:48.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:48.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:48.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.515168+0000", 2024-04-19T04:25:48.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9750000000000004e-06 2024-04-19T04:25:48.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:48.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.515176+0000", 2024-04-19T04:25:48.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6040000000000004e-06 2024-04-19T04:25:48.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:48.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.515182+0000", 2024-04-19T04:25:48.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3840000000000002e-06 2024-04-19T04:25:48.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:48.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.515219+0000", 2024-04-19T04:25:48.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6483000000000003e-05 2024-04-19T04:25:48.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:48.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:48.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:48.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:48.515238+0000", 2024-04-19T04:25:48.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9352e-05 2024-04-19T04:25:48.549 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:48.549 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:48.549 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:48.549 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:48.549 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:48.550 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 8 2024-04-19T04:25:48.550 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:48.550 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:48.552 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:48.554 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:48.554 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:48.554 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:48.554 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:48.558 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:48.559 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:48.590 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:48.589+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:48.675 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:48.676 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:48.688 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:48.691 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:48.689+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:48.792 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:48.789+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:48.799 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:48.799 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:48.814 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:48.892 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:48.889+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:48.939 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:48.939 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:48.953 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:48.994 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:48.993+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:49.080 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:49.080 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:49.094 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:49.094 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:49.093+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:49.120 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-04-19T04:25:49.195 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:49.193+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:49.222 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:49.222 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:49.233 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:49.295 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:49.293+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:49.355 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:49.356 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:49.369 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:49.397 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:49.393+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:49.488 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:49.488 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:49.497 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:49.497+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:49.503 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:49.598 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:49.597+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:49.676 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:49.676 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:49.688 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:49.700 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:49.697+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:49.801 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:49.801+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:49.820 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:49.820 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:49.835 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:49.901 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:49.901+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:49.965 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:49.965 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:49.978 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:50.002 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:50.001+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:50.103 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:50.101+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:50.110 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:50.110 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:50.122 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:50.205 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:50.201+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:50.249 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:50.249 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:50.261 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:50.305 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:50.305+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:50.381 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:50.381 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:50.392 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:50.406 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:50.405+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:50.507 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:50.505+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:50.510 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:50.510 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:50.523 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:50.560 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:25:50.609 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:50.609+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:50.655 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:50.656 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:50.669 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:50.710 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:50.709+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:50.716 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:50.743 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:50.743 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:50.743 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:50.743 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:50.747 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:50.748 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:50.796 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:50.797 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:50.797 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:50.797 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:50.797 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:50.809 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:50.811 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:50.809+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:50.911 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:50.909+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:50.940 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:50.940 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:50.940 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:50.940 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:50.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.940 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:50.940 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:50.941 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 56.706969159000003, 2024-04-19T04:25:50.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:50.941 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:50.941 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:50.941 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:50.941 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:50.941 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:50.941 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:50.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.941 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:50.941 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.941 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:50.941 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:50.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.942 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.942 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:50.942 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:50.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.942 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.942 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:50.942 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:50.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:50.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.942 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.942 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:50.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:50.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:50.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:50.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:50.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:50.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:50.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:50.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:50.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:50.944 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:50.944 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:50.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:50.944 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:50.944 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:50.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:50.944 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:50.944 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:50.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.945 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:50.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:50.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:50.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.945 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:50.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:50.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:50.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.945 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:50.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:50.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:50.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:50.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:50.946 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:50.946 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.946 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:50.946 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.946 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:50.946 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:50.946 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 56.703788003, 2024-04-19T04:25:50.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:50.947 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:50.947 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:50.947 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:50.947 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:50.947 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:50.947 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:50.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.947 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:50.947 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.947 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:50.947 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:50.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.947 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:50.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:50.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:50.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:50.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:50.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:50.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:50.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:50.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:50.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:50.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:50.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:50.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:50.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:50.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:50.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:50.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:50.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:50.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:50.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:50.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:50.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:50.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:50.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:50.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:50.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:50.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:50.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:50.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:50.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:50.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:50.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:50.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:50.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:50.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:50.951 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.951 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:50.952 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.952 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.952 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.952 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:50.952 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:50.952 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 56.703219898999997, 2024-04-19T04:25:50.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:50.952 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:50.952 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:50.952 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:50.952 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.952 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:50.952 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:50.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.952 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.953 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.953 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:50.953 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:50.953 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.953 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.953 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.953 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:50.953 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:50.953 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:50.953 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.953 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.954 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:50.954 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:50.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:50.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.954 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.954 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:50.954 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:50.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:50.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.954 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.954 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:50.954 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:50.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:50.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.955 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:50.955 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:50.955 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:50.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:50.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:50.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:50.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:50.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:50.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:50.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:50.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:50.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:50.957 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.957 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:50.957 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.957 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:50.957 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:50.957 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 56.702874238, 2024-04-19T04:25:50.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:50.957 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:50.957 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:50.957 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:50.957 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:50.957 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:50.958 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:50.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.958 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:50.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:50.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:50.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:50.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:50.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.959 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.959 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:50.959 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:50.959 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:50.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.959 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.959 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:50.959 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:50.959 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:50.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.959 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.960 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:50.960 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:50.960 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:50.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.960 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:50.960 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:50.960 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:50.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.960 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:50.960 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:50.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:50.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:50.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:50.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:50.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:50.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:50.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:50.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:50.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:50.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:50.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:50.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:50.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:50.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:50.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:50.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:50.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:50.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:50.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:50.964 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.964 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:50.965 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.965 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:50.965 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:50.965 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 56.702149800000001, 2024-04-19T04:25:50.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:50.965 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:50.965 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:50.965 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:50.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.965 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:50.965 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:50.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.966 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:50.966 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:50.966 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.966 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.966 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:50.966 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:50.966 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:50.966 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.966 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:50.966 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:50.966 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:50.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:50.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:50.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:50.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:50.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:50.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:50.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:50.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:50.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:50.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:50.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:50.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:50.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:50.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:50.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:50.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:50.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:50.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:50.969 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.969 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:50.969 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.969 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:50.969 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:50.969 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 56.702142405000004, 2024-04-19T04:25:50.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:50.969 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:50.970 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:50.970 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:50.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:50.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:50.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:50.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:50.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:50.971 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:50.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:50.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.971 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:50.971 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:50.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:50.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.971 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:50.971 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:50.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:50.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.971 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:50.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:50.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:50.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:50.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:50.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:50.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:50.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:50.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:50.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:50.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:50.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:50.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:50.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:50.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:50.973 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.973 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:50.973 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.973 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:50.974 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:50.974 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 56.700317257999998, 2024-04-19T04:25:50.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:50.974 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:50.974 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:50.974 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:50.974 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:50.974 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:50.974 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:50.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.974 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:50.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.974 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:50.974 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:50.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.975 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:50.975 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:50.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.975 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:50.975 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:50.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:50.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.975 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:50.975 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:50.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:50.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:50.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:50.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:50.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:50.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:50.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:50.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:50.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:50.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:50.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:50.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:50.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:50.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:50.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:50.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:50.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:50.978 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:50.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:50.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.978 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.978 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:50.978 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:50.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:50.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.978 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.978 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:50.978 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:50.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:50.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:50.979 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:50.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:50.979 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.979 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:50.979 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.979 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.979 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:50.979 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:50.979 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 56.699583052999998, 2024-04-19T04:25:50.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:50.979 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:50.980 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:50.980 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:50.980 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:50.980 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:50.980 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:50.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.980 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:50.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.980 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:50.980 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:50.980 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.980 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:50.981 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:50.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.981 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:50.981 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:50.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:50.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.981 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:50.981 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:50.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:50.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.981 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:50.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:50.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:50.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.982 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:50.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:50.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:50.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.982 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:50.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:50.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:50.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:50.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:50.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:50.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:50.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:50.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:50.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:50.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:50.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:50.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:50.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:50.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:50.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:50.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:50.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:50.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:50.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:50.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:50.984 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.985 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:50.985 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.985 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:50.985 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:50.985 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 56.699048777000002, 2024-04-19T04:25:50.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:50.985 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:50.985 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:50.985 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:50.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:50.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:50.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:50.986 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:50.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:50.986 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:50.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:50.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:50.986 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:50.987 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:50.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.987 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.987 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:50.987 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:50.987 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:50.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.987 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.987 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:50.987 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:50.987 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:50.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.987 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.987 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:50.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:50.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:50.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:50.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:50.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:50.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:50.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:50.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:50.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:50.989 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:50.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:50.989 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.989 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:50.989 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.989 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:50.989 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:50.989 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.982193588000001, 2024-04-19T04:25:50.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:50.989 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:50.989 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:50.989 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:50.989 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:50.990 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:50.990 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:50.990 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.990 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:50.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:50.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:50.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.990 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:50.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:50.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.990 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:50.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:50.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:50.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:50.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:50.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:50.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:50.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:50.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:50.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:50.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:50.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:50.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:50.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:50.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:50.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:50.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:50.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:50.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:50.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:50.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:50.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:50.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:50.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:50.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:50.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:50.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:50.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:50.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:50.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:50.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:50.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:50.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:50.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:50.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:50.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:50.994 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.994 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:50.995 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.995 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:50.995 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:50.995 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.961963138999998, 2024-04-19T04:25:50.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:50.995 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:50.995 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:50.995 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:50.995 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:50.995 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:50.995 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:50.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.995 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:50.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:50.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:50.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:50.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:50.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:50.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:50.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:50.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:50.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:50.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:50.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:50.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:50.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:50.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:50.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:50.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:50.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:50.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:50.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:50.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:50.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:50.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:50.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:50.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:50.999 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:50.999 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:50.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:50.999 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:50.999 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:50.999 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:50.999 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.999 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:50.999 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:50.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:50.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.000 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:51.000 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:51.000 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.961855282000002, 2024-04-19T04:25:51.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:51.000 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.000 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:51.000 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.000 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.000 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.000 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:51.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.001 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:51.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:51.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:51.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:51.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.002 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:51.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:51.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.002 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:51.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:51.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.003 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:51.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:51.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.003 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.003 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:51.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:51.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.003 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:51.003 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:51.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:51.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.004 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.004 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:51.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:51.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.004 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:51.004 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:51.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:51.004 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.004 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.004 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.004 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:51.005 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:51.005 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.959888593000002, 2024-04-19T04:25:51.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:51.005 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.005 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.005 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.005 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.005 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.005 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:51.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.005 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:51.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:51.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:51.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:51.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.007 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.007 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:51.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:51.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.007 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.007 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:51.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:51.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:51.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:51.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:51.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:51.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:51.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:51.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:51.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:51.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:51.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:51.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:51.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:51.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:51.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:51.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:51.010 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.010 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.010 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:51.010 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:51.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:51.010 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.010 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.010 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:51.010 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:51.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:51.010 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.010 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.010 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.011 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.011 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:51.011 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:51.011 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.956524397999999, 2024-04-19T04:25:51.011 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:51.011 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.011 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.011 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.011 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.011 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.011 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:51.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.011 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.012 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.012 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.012 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:51.012 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.012 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.012 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.012 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.012 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:51.012 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.012 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.012 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.012 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.012 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:51.012 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.013 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.013 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.013 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.013 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:51.013 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:51.013 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.013 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.013 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.013 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:51.013 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:51.013 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.013 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.013 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.013 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:51.014 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:51.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.014 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.014 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:51.014 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:51.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.014 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:51.014 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:51.014 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:51.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.014 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:51.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:51.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.015 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:51.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:51.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:51.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.015 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:51.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:51.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:51.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.015 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.952713420000002, 2024-04-19T04:25:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.019 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.019 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:51.019 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:51.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.019 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.019 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.019 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:51.019 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:51.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.019 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.019 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.020 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:51.020 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:51.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.020 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.020 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.021 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:51.021 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:51.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.021 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:51.021 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:51.021 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:51.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.021 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.021 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:51.021 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:51.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.022 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:51.022 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:51.022 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:51.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.022 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:51.022 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:51.022 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:51.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.022 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:51.022 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:51.022 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:51.023 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.023 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.023 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:51.023 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:51.023 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:51.023 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.023 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.023 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.023 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.023 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.023 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93735 5.1 5:8e609d1b:::benchmark_data_smithi007_19526_object93734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:51.023 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:51.023 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.711012776, 2024-04-19T04:25:51.023 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048424842000000003, 2024-04-19T04:25:51.024 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.024 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.024 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.024 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.024 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.024 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93735 2024-04-19T04:25:51.024 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.024 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.024 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.024 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.024 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:51.024 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.024 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.024 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.024 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:51.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227480+0000", 2024-04-19T04:25:51.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227533+0000", 2024-04-19T04:25:51.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2964999999999999e-05 2024-04-19T04:25:51.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227542+0000", 2024-04-19T04:25:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1449999999999997e-06 2024-04-19T04:25:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227561+0000", 2024-04-19T04:25:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9116000000000001e-05 2024-04-19T04:25:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227610+0000", 2024-04-19T04:25:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9234000000000003e-05 2024-04-19T04:25:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227697+0000", 2024-04-19T04:25:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6682999999999997e-05 2024-04-19T04:25:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275809+0000", 2024-04-19T04:25:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048112265000000001 2024-04-19T04:25:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275845+0000", 2024-04-19T04:25:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5275999999999999e-05 2024-04-19T04:25:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275906+0000", 2024-04-19T04:25:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1002999999999999e-05 2024-04-19T04:25:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93736 5.1 5:852229ec:::benchmark_data_smithi007_19526_object93735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.710908746000001, 2024-04-19T04:25:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048414497000000001, 2024-04-19T04:25:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93736 2024-04-19T04:25:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227584+0000", 2024-04-19T04:25:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227624+0000", 2024-04-19T04:25:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9833000000000003e-05 2024-04-19T04:25:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227630+0000", 2024-04-19T04:25:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0759999999999999e-06 2024-04-19T04:25:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227634+0000", 2024-04-19T04:25:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1570000000000002e-06 2024-04-19T04:25:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229531+0000", 2024-04-19T04:25:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018962339999999999 2024-04-19T04:25:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229662+0000", 2024-04-19T04:25:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013192999999999999 2024-04-19T04:25:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275915+0000", 2024-04-19T04:25:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046252140999999997 2024-04-19T04:25:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275944+0000", 2024-04-19T04:25:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9539999999999998e-05 2024-04-19T04:25:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275999+0000", 2024-04-19T04:25:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5062999999999998e-05 2024-04-19T04:25:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.710851063, 2024-04-19T04:25:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:25:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:25:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:25:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:25:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:25:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:25:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:25:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:25:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:25:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:25:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:25:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:25:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:25:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:25:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:25:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:25:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:25:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:25:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.710256782999998, 2024-04-19T04:25:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:25:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:25:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:51.040 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.040 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.040 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.040 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:25:51.040 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.040 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.040 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.040 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:25:51.040 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:25:51.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.040 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.040 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.041 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:25:51.041 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:25:51.041 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.041 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.041 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:25:51.041 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:25:51.041 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.041 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.041 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:25:51.041 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:25:51.041 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.042 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:51.042 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:25:51.042 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:25:51.042 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.042 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.042 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:51.042 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:25:51.042 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:25:51.042 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.042 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.042 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:51.042 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:25:51.042 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:25:51.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.043 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.043 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:51.043 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:25:51.043 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:25:51.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.043 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.043 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:51.043 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:25:51.043 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:25:51.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.044 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.044 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:51.044 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:25:51.044 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:25:51.044 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.044 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.044 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.044 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.044 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93744 5.1 5:87b91c25:::benchmark_data_smithi007_19526_object93743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:51.044 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:51.044 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.706587232, 2024-04-19T04:25:51.044 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044295022000000003, 2024-04-19T04:25:51.044 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.045 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.045 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.045 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.045 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.045 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93744 2024-04-19T04:25:51.045 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.045 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.045 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.045 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.045 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:51.045 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.046 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.046 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.046 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.046 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:51.046 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.046 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.046 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.046 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.046 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231905+0000", 2024-04-19T04:25:51.046 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.046 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.046 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.046 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.047 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231935+0000", 2024-04-19T04:25:51.047 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9442e-05 2024-04-19T04:25:51.047 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.047 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.047 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.047 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264224+0000", 2024-04-19T04:25:51.047 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.032288836000000001 2024-04-19T04:25:51.047 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.047 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.047 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.047 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264238+0000", 2024-04-19T04:25:51.047 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4494999999999999e-05 2024-04-19T04:25:51.047 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.047 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.048 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.048 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268311+0000", 2024-04-19T04:25:51.048 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040726629999999998 2024-04-19T04:25:51.048 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.048 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.048 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:51.048 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268587+0000", 2024-04-19T04:25:51.048 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00027623200000000001 2024-04-19T04:25:51.048 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.048 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.048 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:51.048 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276099+0000", 2024-04-19T04:25:51.048 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075116180000000003 2024-04-19T04:25:51.048 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.048 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.049 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:51.049 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276123+0000", 2024-04-19T04:25:51.049 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4675e-05 2024-04-19T04:25:51.049 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.049 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.049 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:51.049 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276201+0000", 2024-04-19T04:25:51.049 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7836000000000005e-05 2024-04-19T04:25:51.049 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.049 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.049 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.049 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.049 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.049 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:51.051 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:51.051 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:51.049+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:51.135 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T04:25:51.151 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:51.149+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:51.180 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:51.181 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:51.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.181 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:141012 5.9 e50/20 5:97230ad7:::benchmark_data_smithi007_19526_object15278:head v 50'9004, mlcod=50'9001)", 2024-04-19T04:25:51.181 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:51.171837+0000", 2024-04-19T04:25:51.181 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.009274526, 2024-04-19T04:25:51.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092901230000000008, 2024-04-19T04:25:51.181 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.181 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:51.181 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.171837+0000", 2024-04-19T04:25:51.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.171837+0000", 2024-04-19T04:25:51.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.171837+0000", 2024-04-19T04:25:51.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:51.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.171842+0000", 2024-04-19T04:25:51.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.592e-06 2024-04-19T04:25:51.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.171851+0000", 2024-04-19T04:25:51.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9700000000000005e-06 2024-04-19T04:25:51.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.171856+0000", 2024-04-19T04:25:51.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2410000000000003e-06 2024-04-19T04:25:51.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.171899+0000", 2024-04-19T04:25:51.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2746e-05 2024-04-19T04:25:51.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.171924+0000", 2024-04-19T04:25:51.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4978999999999999e-05 2024-04-19T04:25:51.184 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.184 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.184 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.184 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:141020 5.0 5:0ce98fd4:::benchmark_data_smithi007_19526_object15286:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T04:25:51.185 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:51.174424+0000", 2024-04-19T04:25:51.185 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0066881079999999999, 2024-04-19T04:25:51.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0067419280000000003, 2024-04-19T04:25:51.185 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.185 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:51.185 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.185 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.185 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.185 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 141020 2024-04-19T04:25:51.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.185 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.174424+0000", 2024-04-19T04:25:51.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.174424+0000", 2024-04-19T04:25:51.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.174423+0000", 2024-04-19T04:25:51.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:51.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.174427+0000", 2024-04-19T04:25:51.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4529999999999998e-06 2024-04-19T04:25:51.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.174436+0000", 2024-04-19T04:25:51.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9570000000000008e-06 2024-04-19T04:25:51.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.174443+0000", 2024-04-19T04:25:51.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1189999999999999e-06 2024-04-19T04:25:51.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.176343+0000", 2024-04-19T04:25:51.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001900655 2024-04-19T04:25:51.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.176505+0000", 2024-04-19T04:25:51.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016116200000000001 2024-04-19T04:25:51.188 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.188 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.188 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.188 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:141021 5.b 5:df8b50a9:::benchmark_data_smithi007_19526_object15287:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T04:25:51.188 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:51.174962+0000", 2024-04-19T04:25:51.188 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0061494970000000003, 2024-04-19T04:25:51.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0062402489999999998, 2024-04-19T04:25:51.189 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.189 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:51.189 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.189 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.189 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.189 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 141021 2024-04-19T04:25:51.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.189 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.174962+0000", 2024-04-19T04:25:51.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.174962+0000", 2024-04-19T04:25:51.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.174962+0000", 2024-04-19T04:25:51.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.174966+0000", 2024-04-19T04:25:51.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1930000000000003e-06 2024-04-19T04:25:51.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.174975+0000", 2024-04-19T04:25:51.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7609999999999996e-06 2024-04-19T04:25:51.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.174982+0000", 2024-04-19T04:25:51.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1269999999999997e-06 2024-04-19T04:25:51.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.175963+0000", 2024-04-19T04:25:51.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00098143699999999993 2024-04-19T04:25:51.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.176048+0000", 2024-04-19T04:25:51.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4980000000000003e-05 2024-04-19T04:25:51.192 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.192 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.192 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.192 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:141022 5.d e50/29 5:b9122999:::benchmark_data_smithi007_19526_object15288:head v 50'8574, mlcod=50'8572)", 2024-04-19T04:25:51.192 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:51.175262+0000", 2024-04-19T04:25:51.192 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0058503019999999999, 2024-04-19T04:25:51.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059738409999999997, 2024-04-19T04:25:51.192 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.193 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:51.193 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.175262+0000", 2024-04-19T04:25:51.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.175262+0000", 2024-04-19T04:25:51.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.175261+0000", 2024-04-19T04:25:51.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.175268+0000", 2024-04-19T04:25:51.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1110000000000002e-06 2024-04-19T04:25:51.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.175282+0000", 2024-04-19T04:25:51.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3895e-05 2024-04-19T04:25:51.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.175289+0000", 2024-04-19T04:25:51.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.99e-06 2024-04-19T04:25:51.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.175339+0000", 2024-04-19T04:25:51.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0661999999999997e-05 2024-04-19T04:25:51.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.175362+0000", 2024-04-19T04:25:51.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2707000000000001e-05 2024-04-19T04:25:51.195 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.195 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.196 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.196 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:141024 5.b 5:d8ab4f30:::benchmark_data_smithi007_19526_object15290:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T04:25:51.196 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:51.176204+0000", 2024-04-19T04:25:51.196 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0049077510000000001, 2024-04-19T04:25:51.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050638590000000004, 2024-04-19T04:25:51.196 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.196 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:51.196 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.196 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.196 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.196 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 141024 2024-04-19T04:25:51.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.196 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.176204+0000", 2024-04-19T04:25:51.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.176204+0000", 2024-04-19T04:25:51.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.176203+0000", 2024-04-19T04:25:51.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:51.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.176208+0000", 2024-04-19T04:25:51.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:25:51.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.176225+0000", 2024-04-19T04:25:51.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7527e-05 2024-04-19T04:25:51.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.176231+0000", 2024-04-19T04:25:51.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.711e-06 2024-04-19T04:25:51.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.177574+0000", 2024-04-19T04:25:51.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001343318 2024-04-19T04:25:51.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.177690+0000", 2024-04-19T04:25:51.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011527900000000001 2024-04-19T04:25:51.199 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.199 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.199 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.200 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:141026 5.9 e50/20 5:94c2e159:::benchmark_data_smithi007_19526_object15292:head v 50'9005, mlcod=50'9002)", 2024-04-19T04:25:51.200 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:51.177964+0000", 2024-04-19T04:25:51.200 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0031480620000000001, 2024-04-19T04:25:51.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033363820000000001, 2024-04-19T04:25:51.200 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.200 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:51.200 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.177964+0000", 2024-04-19T04:25:51.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.177964+0000", 2024-04-19T04:25:51.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.177963+0000", 2024-04-19T04:25:51.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:51.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.177969+0000", 2024-04-19T04:25:51.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1410000000000002e-06 2024-04-19T04:25:51.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.177979+0000", 2024-04-19T04:25:51.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5969999999999998e-06 2024-04-19T04:25:51.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.177986+0000", 2024-04-19T04:25:51.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.652e-06 2024-04-19T04:25:51.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.178034+0000", 2024-04-19T04:25:51.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8721999999999999e-05 2024-04-19T04:25:51.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.178058+0000", 2024-04-19T04:25:51.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.419e-05 2024-04-19T04:25:51.203 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.203 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.203 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.203 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:141030 5.d e50/29 5:b3d96ef9:::benchmark_data_smithi007_19526_object15296:head v 50'8575, mlcod=50'8572)", 2024-04-19T04:25:51.203 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:51.179828+0000", 2024-04-19T04:25:51.203 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001283314, 2024-04-19T04:25:51.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015005039999999999, 2024-04-19T04:25:51.204 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.204 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:51.204 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.179828+0000", 2024-04-19T04:25:51.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.179828+0000", 2024-04-19T04:25:51.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.179828+0000", 2024-04-19T04:25:51.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.179835+0000", 2024-04-19T04:25:51.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4329999999999998e-06 2024-04-19T04:25:51.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.179850+0000", 2024-04-19T04:25:51.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4834000000000001e-05 2024-04-19T04:25:51.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.179860+0000", 2024-04-19T04:25:51.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0027000000000001e-05 2024-04-19T04:25:51.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.179900+0000", 2024-04-19T04:25:51.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0077000000000003e-05 2024-04-19T04:25:51.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.179916+0000", 2024-04-19T04:25:51.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5971e-05 2024-04-19T04:25:51.206 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.207 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.207 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.207 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:141032 5.9 e50/20 5:9f22b826:::benchmark_data_smithi007_19526_object15298:head v 50'9006, mlcod=50'9002)", 2024-04-19T04:25:51.207 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:51.180007+0000", 2024-04-19T04:25:51.207 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001104584, 2024-04-19T04:25:51.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013510359999999999, 2024-04-19T04:25:51.207 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.207 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:51.207 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.180007+0000", 2024-04-19T04:25:51.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.180007+0000", 2024-04-19T04:25:51.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.180007+0000", 2024-04-19T04:25:51.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.180014+0000", 2024-04-19T04:25:51.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7910000000000005e-06 2024-04-19T04:25:51.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.209 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.209 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.180025+0000", 2024-04-19T04:25:51.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0487e-05 2024-04-19T04:25:51.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.209 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.209 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.180033+0000", 2024-04-19T04:25:51.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9759999999999995e-06 2024-04-19T04:25:51.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.209 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.180097+0000", 2024-04-19T04:25:51.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4517000000000006e-05 2024-04-19T04:25:51.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.180121+0000", 2024-04-19T04:25:51.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4193999999999999e-05 2024-04-19T04:25:51.210 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.210 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.210 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.210 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:141033 5.8 5.dc1b27e8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T04:25:51.210 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:51.180520+0000", 2024-04-19T04:25:51.210 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00059201499999999999, 2024-04-19T04:25:51.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00088171199999999999, 2024-04-19T04:25:51.211 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.211 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:51.211 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.211 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.211 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.211 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 141033 2024-04-19T04:25:51.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.211 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.180520+0000", 2024-04-19T04:25:51.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.180520+0000", 2024-04-19T04:25:51.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.180519+0000", 2024-04-19T04:25:51.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:51.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.180525+0000", 2024-04-19T04:25:51.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8530000000000003e-06 2024-04-19T04:25:51.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.180542+0000", 2024-04-19T04:25:51.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7025999999999999e-05 2024-04-19T04:25:51.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:51.180555+0000", 2024-04-19T04:25:51.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2724e-05 2024-04-19T04:25:51.213 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.213 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.213 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.213 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.213 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:51.213 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 9 2024-04-19T04:25:51.213 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:51.215 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:51.254 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:51.249+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:51.341 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:51.342 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:51.342 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:51.342 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:51.342 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:51.353 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:51.349+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:51.354 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:51.453 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:51.453+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:51.521 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:51.521 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:51.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:51.521 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:51.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.521 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:51.521 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:51.521 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 57.284490617000003, 2024-04-19T04:25:51.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:51.521 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.522 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.522 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.522 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.522 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.522 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:51.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.522 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:51.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:51.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:51.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:51.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:51.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:51.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:51.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:51.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:51.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:51.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:51.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:51.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:51.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:51.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:51.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:51.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:51.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:51.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:51.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:51.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:51.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:51.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:51.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:51.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:51.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:51.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:51.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:51.527 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.527 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.527 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.527 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:51.527 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:51.527 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 57.280041701000002, 2024-04-19T04:25:51.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:51.527 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.527 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.527 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.527 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.528 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.528 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:51.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.528 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:51.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:51.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:51.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:51.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:51.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:51.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:51.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:51.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:51.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:51.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:51.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:51.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:51.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:51.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:51.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:51.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:51.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:51.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:51.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:51.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:51.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:51.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:51.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:51.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:51.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:51.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:51.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:51.532 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.533 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.533 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.533 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:51.533 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:51.533 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.452109458000002, 2024-04-19T04:25:51.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:51.533 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.533 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.533 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:51.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.534 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:51.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:51.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:51.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:51.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:51.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:51.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:51.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:51.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:51.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:51.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:51.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:51.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:51.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:51.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:51.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:51.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:51.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:51.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:51.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:51.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:51.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:51.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:51.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:51.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:51.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:51.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:51.538 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.538 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.538 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.539 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:51.539 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:51.539 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.016255420999997, 2024-04-19T04:25:51.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:51.539 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.539 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.539 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.539 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.539 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.539 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:51.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.539 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:51.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:51.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:51.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:51.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:51.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:51.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:51.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:51.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:51.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:51.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:51.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:51.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:51.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:51.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:51.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:51.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:51.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:51.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:51.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:51.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:51.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:51.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:51.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:51.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:51.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:51.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:51.544 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.544 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.544 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.544 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:51.544 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:51.544 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.015825001000003, 2024-04-19T04:25:51.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:51.545 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.545 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.545 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:51.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.545 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:51.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:51.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:51.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:51.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:51.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:51.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:51.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:51.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:51.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:51.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:51.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:51.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:51.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:51.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:51.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:51.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:51.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:51.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:51.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:51.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:51.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:51.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:51.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:51.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:51.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:51.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:51.549 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.550 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.550 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.550 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:51.550 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:51.550 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.013593737000001, 2024-04-19T04:25:51.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:51.550 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.550 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.550 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.550 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.550 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.550 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:51.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.551 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:51.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:51.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:51.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:51.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:51.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:51.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:51.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:51.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:51.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:51.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:51.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:51.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:51.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:51.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:51.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:51.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:51.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:51.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:51.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:51.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:51.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:51.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:51.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:51.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:51.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:51.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:51.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:51.555 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.555 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.555 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.556 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:51.556 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:51.556 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.010196698999998, 2024-04-19T04:25:51.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:51.556 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.556 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.556 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.556 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.556 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.556 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:51.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.556 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:51.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:51.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:51.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:51.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:51.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:51.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:51.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:51.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:51.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:51.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:51.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:51.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:51.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:51.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:51.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:51.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:51.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:51.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:51.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:51.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:51.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:51.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:51.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:51.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:51.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:51.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:51.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:51.561 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.561 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.561 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.561 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:51.561 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:51.561 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.005068500999997, 2024-04-19T04:25:51.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:51.561 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.562 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.562 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.562 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.562 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.562 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:51.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.562 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:51.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:51.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:51.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:51.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:51.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:51.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:51.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:51.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:51.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:51.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:51.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:51.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:51.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:51.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:51.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:51.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:51.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:51.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:51.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:51.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:51.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:51.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:51.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:51.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:51.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:51.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:51.566 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.567 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.567 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.567 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:51.567 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:51.567 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.691039996000001, 2024-04-19T04:25:51.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:51.567 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.567 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.567 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.567 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.567 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.567 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:51.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.568 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:51.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:51.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:51.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:51.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:51.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:51.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:51.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:51.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:51.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:51.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:51.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:51.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:51.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:51.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:51.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:51.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:51.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:51.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:51.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:51.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:51.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:51.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:51.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:51.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:51.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:51.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:51.572 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.572 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.572 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.572 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:51.572 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:51.573 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.568680585999999, 2024-04-19T04:25:51.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:25:51.573 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.573 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:51.573 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.573 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.573 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.573 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:51.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.573 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:51.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:51.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:51.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:51.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:51.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:51.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:51.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:51.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:51.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:51.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:51.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:51.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:51.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:51.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:51.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:51.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:51.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:51.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:51.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:51.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:51.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:51.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:51.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:51.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:51.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:25:51.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:25:51.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:25:51.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:25:51.578 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.578 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.578 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.578 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:51.578 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:51.579 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.563618939999998, 2024-04-19T04:25:51.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:25:51.579 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.579 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:51.579 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.579 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.579 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.579 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:51.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.579 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:51.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:51.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:51.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:51.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:51.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:51.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:51.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:51.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:51.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:51.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:51.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:51.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:51.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:51.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:51.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:51.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:51.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:51.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:51.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:51.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:51.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:51.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:25:51.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:25:51.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:25:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:25:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.563519028000002, 2024-04-19T04:25:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:25:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:25:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:25:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:25:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:25:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.563393275000003, 2024-04-19T04:25:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:25:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:51.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:51.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:51.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:51.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:51.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:51.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:25:51.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:25:51.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:25:51.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:25:51.595 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.595 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.595 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.595 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:51.595 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:51.595 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.559549330000003, 2024-04-19T04:25:51.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:25:51.596 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.596 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.596 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.596 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.596 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.596 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:51.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.596 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:51.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:51.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:51.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:51.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:51.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:51.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:51.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:51.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:51.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:51.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:51.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:51.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:51.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:51.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:51.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:25:51.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:25:51.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:25:51.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:25:51.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:51.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:25:51.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:25:51.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:51.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:25:51.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:25:51.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:25:51.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:25:51.601 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.601 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.601 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.601 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:51.601 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:51.601 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.552378228999999, 2024-04-19T04:25:51.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:25:51.601 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.601 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:51.601 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.601 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.601 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.602 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:51.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.602 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:51.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:51.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:51.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:51.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:51.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:51.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:51.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:51.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:51.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:51.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:51.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:51.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:51.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:51.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:51.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:25:51.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:25:51.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:25:51.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:25:51.605 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.606 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.606 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.606 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:51.606 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:51.606 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.552206124999998, 2024-04-19T04:25:51.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:25:51.606 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.606 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:51.606 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.606 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.606 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.607 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:51.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.607 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:51.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:51.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:51.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:51.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:51.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:51.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:51.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:51.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:51.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:51.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:51.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:51.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:51.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:51.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:51.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:25:51.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:25:51.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:25:51.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:25:51.610 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.610 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.610 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.611 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:51.611 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:51.611 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.552143000000001, 2024-04-19T04:25:51.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:25:51.611 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.611 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.611 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.611 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.611 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.611 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:51.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.611 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:51.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:51.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:51.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:51.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:51.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:51.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:51.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:51.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:51.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:51.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:51.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:51.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:51.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:51.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:51.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:25:51.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:25:51.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:25:51.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:25:51.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:51.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:25:51.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:25:51.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:51.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:25:51.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:25:51.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:25:51.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:25:51.616 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.616 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.616 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.616 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:51.616 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:51.617 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.552014403000001, 2024-04-19T04:25:51.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:25:51.617 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.617 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.617 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.617 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.617 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.617 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:51.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.617 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:51.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:51.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:51.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:51.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:51.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:51.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:51.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:51.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:51.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:51.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:51.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:51.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:51.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:51.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:51.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:25:51.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:25:51.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:25:51.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:25:51.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:51.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:25:51.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:25:51.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:51.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:25:51.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:25:51.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:25:51.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:25:51.622 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.622 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.622 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.622 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:51.622 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:51.622 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.551946432000001, 2024-04-19T04:25:51.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:25:51.622 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.622 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.622 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.623 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.623 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.623 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:51.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.623 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:51.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:51.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:51.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:51.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:51.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:51.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:51.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:51.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:51.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:51.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:51.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:51.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:51.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:51.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:51.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:25:51.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:25:51.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:25:51.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:25:51.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:51.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:25:51.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:25:51.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:51.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:25:51.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:25:51.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:25:51.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:25:51.627 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.627 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.627 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.628 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:111654 5.0 5:0b6b473d:::benchmark_data_smithi007_19526_object111653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:51.628 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:51.628 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.604155326000001, 2024-04-19T04:25:51.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023122753999999999, 2024-04-19T04:25:51.628 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:51.628 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:51.628 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:51.628 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:51.628 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.628 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 111654 2024-04-19T04:25:51.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.628 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:51.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:51.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:51.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:51.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:51.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:51.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:51.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915865+0000", 2024-04-19T04:25:51.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:51.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:51.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915897+0000", 2024-04-19T04:25:51.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1708999999999997e-05 2024-04-19T04:25:51.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:51.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915905+0000", 2024-04-19T04:25:51.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.481e-06 2024-04-19T04:25:51.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915911+0000", 2024-04-19T04:25:51.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6880000000000002e-06 2024-04-19T04:25:51.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:51.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925564+0000", 2024-04-19T04:25:51.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096527039999999998 2024-04-19T04:25:51.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:51.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925771+0000", 2024-04-19T04:25:51.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020717199999999999 2024-04-19T04:25:51.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:51.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938888+0000", 2024-04-19T04:25:51.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013117105 2024-04-19T04:25:51.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:51.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938931+0000", 2024-04-19T04:25:51.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2447000000000002e-05 2024-04-19T04:25:51.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:51.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:51.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:51.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938989+0000", 2024-04-19T04:25:51.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7997000000000001e-05 2024-04-19T04:25:51.632 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.632 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.632 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.632 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:51.632 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:51.632 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:51.634 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:51.633+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:51.634 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:51.734 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:51.733+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:51.761 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:51.761 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:51.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.761 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:142439 5.7 5:e5982904:::benchmark_data_smithi007_19526_object16705:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T04:25:51.762 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:51.756267+0000", 2024-04-19T04:25:51.762 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0055380960000000002, 2024-04-19T04:25:51.762 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055644680000000004, 2024-04-19T04:25:51.762 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.762 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:51.762 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.762 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.762 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.762 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 142439 2024-04-19T04:25:51.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.762 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.762 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.762 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.763 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.756267+0000", 2024-04-19T04:25:51.763 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.763 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.763 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.763 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.756267+0000", 2024-04-19T04:25:51.763 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.763 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.763 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.763 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.756266+0000", 2024-04-19T04:25:51.763 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.764 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.764 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.764 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.756271+0000", 2024-04-19T04:25:51.764 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5029999999999997e-06 2024-04-19T04:25:51.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.764 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.764 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.764 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.756283+0000", 2024-04-19T04:25:51.764 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1823e-05 2024-04-19T04:25:51.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.764 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.764 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.764 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.756302+0000", 2024-04-19T04:25:51.764 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9154e-05 2024-04-19T04:25:51.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.765 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.765 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.765 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.756358+0000", 2024-04-19T04:25:51.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6131999999999997e-05 2024-04-19T04:25:51.765 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.765 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.765 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:51.765 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.756476+0000", 2024-04-19T04:25:51.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011723200000000001 2024-04-19T04:25:51.765 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.765 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.765 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.765 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.765 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.766 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:142443 5.5 5:ad8afcc0:::benchmark_data_smithi007_19526_object16709:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T04:25:51.766 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:51.758605+0000", 2024-04-19T04:25:51.766 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0032002369999999999, 2024-04-19T04:25:51.766 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0033183890000000001, 2024-04-19T04:25:51.766 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.766 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:51.766 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.766 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.766 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.766 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 142443 2024-04-19T04:25:51.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.767 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.767 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.767 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.767 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.758605+0000", 2024-04-19T04:25:51.767 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.767 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.767 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.767 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.758605+0000", 2024-04-19T04:25:51.767 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.767 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.767 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.768 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.758603+0000", 2024-04-19T04:25:51.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:51.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.768 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.768 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.758610+0000", 2024-04-19T04:25:51.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5980000000000002e-06 2024-04-19T04:25:51.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.768 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.768 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.758621+0000", 2024-04-19T04:25:51.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1447000000000001e-05 2024-04-19T04:25:51.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.769 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.758630+0000", 2024-04-19T04:25:51.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3839999999999997e-06 2024-04-19T04:25:51.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.769 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.758698+0000", 2024-04-19T04:25:51.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8353000000000001e-05 2024-04-19T04:25:51.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.769 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:51.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.758823+0000", 2024-04-19T04:25:51.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000124876 2024-04-19T04:25:51.769 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.770 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.770 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.770 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.770 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:142445 5.f 5:f64d1989:::benchmark_data_smithi007_19526_object16711:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T04:25:51.770 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:51.759316+0000", 2024-04-19T04:25:51.770 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0024887109999999998, 2024-04-19T04:25:51.770 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026821560000000002, 2024-04-19T04:25:51.770 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.770 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:51.770 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.770 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.770 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.770 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 142445 2024-04-19T04:25:51.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.771 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.771 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.771 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.771 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759316+0000", 2024-04-19T04:25:51.771 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.771 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.771 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.771 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759316+0000", 2024-04-19T04:25:51.771 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.771 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.771 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.772 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759315+0000", 2024-04-19T04:25:51.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.772 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.772 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759320+0000", 2024-04-19T04:25:51.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.566e-06 2024-04-19T04:25:51.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.772 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.772 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759330+0000", 2024-04-19T04:25:51.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8719999999999997e-06 2024-04-19T04:25:51.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759338+0000", 2024-04-19T04:25:51.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.687e-06 2024-04-19T04:25:51.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759410+0000", 2024-04-19T04:25:51.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1520000000000006e-05 2024-04-19T04:25:51.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:51.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759560+0000", 2024-04-19T04:25:51.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015028400000000001 2024-04-19T04:25:51.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.774 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:51.774 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759680+0000", 2024-04-19T04:25:51.774 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000120118 2024-04-19T04:25:51.774 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.774 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.774 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.774 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.774 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:142446 5.1 5:868f69f2:::benchmark_data_smithi007_19526_object16712:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T04:25:51.774 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:51.759501+0000", 2024-04-19T04:25:51.774 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0023037740000000002, 2024-04-19T04:25:51.774 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002534751, 2024-04-19T04:25:51.774 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.774 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:51.775 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.775 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.775 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.775 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 142446 2024-04-19T04:25:51.775 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.775 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.775 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.775 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759501+0000", 2024-04-19T04:25:51.775 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.775 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.775 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.775 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759501+0000", 2024-04-19T04:25:51.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.776 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.776 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.776 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759500+0000", 2024-04-19T04:25:51.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.776 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.776 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.776 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759506+0000", 2024-04-19T04:25:51.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5600000000000001e-06 2024-04-19T04:25:51.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.776 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.776 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.777 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759516+0000", 2024-04-19T04:25:51.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0118999999999999e-05 2024-04-19T04:25:51.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.777 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759524+0000", 2024-04-19T04:25:51.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9640000000000003e-06 2024-04-19T04:25:51.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.777 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759564+0000", 2024-04-19T04:25:51.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0317e-05 2024-04-19T04:25:51.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:51.778 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759691+0000", 2024-04-19T04:25:51.778 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000127231 2024-04-19T04:25:51.778 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.778 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.778 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.778 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.778 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:142447 5.d 5:bae88d6b:::benchmark_data_smithi007_19526_object16713:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T04:25:51.778 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:51.759850+0000", 2024-04-19T04:25:51.778 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001954379, 2024-04-19T04:25:51.778 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002219576, 2024-04-19T04:25:51.778 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.778 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:51.779 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.779 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.779 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.779 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 142447 2024-04-19T04:25:51.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.779 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.779 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.779 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.779 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759850+0000", 2024-04-19T04:25:51.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.779 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.779 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.779 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759850+0000", 2024-04-19T04:25:51.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759850+0000", 2024-04-19T04:25:51.780 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:51.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759854+0000", 2024-04-19T04:25:51.780 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6090000000000003e-06 2024-04-19T04:25:51.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759864+0000", 2024-04-19T04:25:51.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5589999999999994e-06 2024-04-19T04:25:51.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.781 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759870+0000", 2024-04-19T04:25:51.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4409999999999998e-06 2024-04-19T04:25:51.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.781 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.759916+0000", 2024-04-19T04:25:51.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5713000000000001e-05 2024-04-19T04:25:51.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:51.781 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.760083+0000", 2024-04-19T04:25:51.782 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016728199999999999 2024-04-19T04:25:51.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.782 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.782 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:51.782 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.760205+0000", 2024-04-19T04:25:51.782 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121983 2024-04-19T04:25:51.782 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.782 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.782 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.782 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.782 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:142448 5.9 5:922878ac:::benchmark_data_smithi007_19526_object16714:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T04:25:51.782 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:51.760059+0000", 2024-04-19T04:25:51.783 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001745698, 2024-04-19T04:25:51.783 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020497309999999999, 2024-04-19T04:25:51.783 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.783 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:51.783 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.783 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.783 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.783 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 142448 2024-04-19T04:25:51.783 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.783 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.783 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.783 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.783 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.760059+0000", 2024-04-19T04:25:51.783 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.784 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.784 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.784 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.784 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.760059+0000", 2024-04-19T04:25:51.784 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.784 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.784 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.784 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.784 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.760058+0000", 2024-04-19T04:25:51.784 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.784 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.784 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.784 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.784 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.760063+0000", 2024-04-19T04:25:51.785 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1850000000000003e-06 2024-04-19T04:25:51.785 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.785 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.785 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.785 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.760072+0000", 2024-04-19T04:25:51.785 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4339999999999992e-06 2024-04-19T04:25:51.785 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.785 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.785 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.785 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.760079+0000", 2024-04-19T04:25:51.785 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8020000000000003e-06 2024-04-19T04:25:51.785 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.785 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.785 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.785 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.760154+0000", 2024-04-19T04:25:51.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5313000000000002e-05 2024-04-19T04:25:51.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.786 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:51.786 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.760251+0000", 2024-04-19T04:25:51.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7256000000000005e-05 2024-04-19T04:25:51.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.786 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:51.786 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.760310+0000", 2024-04-19T04:25:51.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9234000000000002e-05 2024-04-19T04:25:51.786 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.786 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.787 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.787 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.787 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.787 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:142449 5.1 5:883f266f:::benchmark_data_smithi007_19526_object16715:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T04:25:51.787 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:51.760101+0000", 2024-04-19T04:25:51.787 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0017041269999999999, 2024-04-19T04:25:51.787 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020440660000000002, 2024-04-19T04:25:51.787 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.787 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:51.787 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.787 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.787 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.787 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 142449 2024-04-19T04:25:51.787 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.788 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.788 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.788 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.788 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.760101+0000", 2024-04-19T04:25:51.788 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.788 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.788 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.788 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.788 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.760101+0000", 2024-04-19T04:25:51.788 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.788 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.788 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.788 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.788 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.760100+0000", 2024-04-19T04:25:51.789 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.789 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.789 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.789 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.760104+0000", 2024-04-19T04:25:51.789 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0749999999999999e-06 2024-04-19T04:25:51.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.789 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.789 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.789 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.760112+0000", 2024-04-19T04:25:51.789 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6009999999999997e-06 2024-04-19T04:25:51.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.789 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.789 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.790 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.760117+0000", 2024-04-19T04:25:51.790 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7270000000000004e-06 2024-04-19T04:25:51.790 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.790 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.790 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.790 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.762044+0000", 2024-04-19T04:25:51.790 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001926931 2024-04-19T04:25:51.790 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.790 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.790 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.790 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.790 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.790 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:142450 5.6 5:68701400:::benchmark_data_smithi007_19526_object16716:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T04:25:51.790 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:51.761779+0000", 2024-04-19T04:25:51.791 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 2.5321e-05, 2024-04-19T04:25:51.791 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00039770799999999998, 2024-04-19T04:25:51.791 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.791 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:51.791 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.791 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.791 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.791 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 142450 2024-04-19T04:25:51.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.791 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.791 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.791 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.791 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.761779+0000", 2024-04-19T04:25:51.791 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.792 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.792 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.792 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.761779+0000", 2024-04-19T04:25:51.792 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.792 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.792 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.792 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.761779+0000", 2024-04-19T04:25:51.792 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.792 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.792 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.792 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.761784+0000", 2024-04-19T04:25:51.792 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8760000000000002e-06 2024-04-19T04:25:51.793 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.793 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.793 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.793 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.761805+0000", 2024-04-19T04:25:51.793 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0760000000000001e-05 2024-04-19T04:25:51.793 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.793 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.793 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.793 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.761812+0000", 2024-04-19T04:25:51.793 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2490000000000004e-06 2024-04-19T04:25:51.793 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.793 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.793 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.793 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.761893+0000", 2024-04-19T04:25:51.794 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0191999999999994e-05 2024-04-19T04:25:51.794 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.794 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.794 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:51.794 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.762039+0000", 2024-04-19T04:25:51.794 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014683099999999999 2024-04-19T04:25:51.794 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.794 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.794 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.794 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.794 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.794 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:142432 5.6 5:69206a32:::benchmark_data_smithi007_19526_object16698:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T04:25:51.794 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:51.755058+0000", 2024-04-19T04:25:51.794 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0067471969999999999, 2024-04-19T04:25:51.795 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0071532139999999998, 2024-04-19T04:25:51.795 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.795 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:51.795 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.795 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.795 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.795 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 142432 2024-04-19T04:25:51.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.795 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.795 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.795 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.795 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.755058+0000", 2024-04-19T04:25:51.795 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.795 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.796 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.796 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.755058+0000", 2024-04-19T04:25:51.796 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.796 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.796 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.755056+0000", 2024-04-19T04:25:51.796 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.796 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.796 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.755062+0000", 2024-04-19T04:25:51.796 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0020000000000003e-06 2024-04-19T04:25:51.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.797 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.797 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.755075+0000", 2024-04-19T04:25:51.797 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2673e-05 2024-04-19T04:25:51.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.797 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.797 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.797 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.755084+0000", 2024-04-19T04:25:51.797 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7909999999999993e-06 2024-04-19T04:25:51.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.797 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.797 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.797 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.757929+0000", 2024-04-19T04:25:51.797 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002845307 2024-04-19T04:25:51.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.798 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.798 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:51.798 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.758012+0000", 2024-04-19T04:25:51.798 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3164999999999994e-05 2024-04-19T04:25:51.798 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.798 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.798 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.798 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.798 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.798 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:142438 5.c 5:334011f6:::benchmark_data_smithi007_19526_object16704:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T04:25:51.798 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:51.756074+0000", 2024-04-19T04:25:51.798 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0057305419999999999, 2024-04-19T04:25:51.798 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0061701059999999999, 2024-04-19T04:25:51.798 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:51.798 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:51.799 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:51.799 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:51.799 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:51.799 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 142438 2024-04-19T04:25:51.799 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.799 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:51.799 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.799 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:51.799 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.756074+0000", 2024-04-19T04:25:51.799 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.799 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.799 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.799 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:51.799 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.756074+0000", 2024-04-19T04:25:51.800 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:51.800 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.800 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.800 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:51.800 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.756073+0000", 2024-04-19T04:25:51.800 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:51.800 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.800 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.800 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:51.800 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.756078+0000", 2024-04-19T04:25:51.800 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8099999999999997e-06 2024-04-19T04:25:51.800 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.800 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.800 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:51.800 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.756087+0000", 2024-04-19T04:25:51.801 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9919999999999996e-06 2024-04-19T04:25:51.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.801 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.801 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:51.801 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.756094+0000", 2024-04-19T04:25:51.801 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8809999999999998e-06 2024-04-19T04:25:51.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.801 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.801 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:51.801 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.758550+0000", 2024-04-19T04:25:51.801 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024563760000000001 2024-04-19T04:25:51.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:51.801 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:51.802 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:51.802 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:51.758709+0000", 2024-04-19T04:25:51.802 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015857999999999999 2024-04-19T04:25:51.802 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.802 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:51.802 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.802 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:51.802 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:51.802 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 10 2024-04-19T04:25:51.802 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:51.803 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:51.836 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:51.833+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:51.934 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:51.934 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:51.934 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:51.934 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:51.934 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:51.936 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:51.933+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:51.944 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:52.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2024-04-19T04:25:52.039 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:52.037+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:52.082 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:52.082 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:52.082 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:52.082 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:52.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.083 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:52.083 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:52.083 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 57.8498041, 2024-04-19T04:25:52.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:52.083 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.083 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.083 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.083 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.083 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.083 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:52.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.083 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:52.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:52.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:52.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:52.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:52.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:52.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:52.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.086 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.086 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:52.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:52.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:52.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:52.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:52.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:52.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:52.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:52.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:52.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:52.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:52.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:52.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:52.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:52.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:52.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:52.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:52.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:52.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.090 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.090 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:52.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:52.090 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.090 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.090 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.091 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:52.091 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:52.091 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 57.846622944000003, 2024-04-19T04:25:52.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:52.091 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.091 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.091 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.091 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.091 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.091 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:52.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.091 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.092 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.092 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:52.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.092 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:52.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:52.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:52.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:52.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:52.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:52.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:52.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:52.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:52.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:52.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:52.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:52.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:52.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:52.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:52.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:52.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:52.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:52.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:52.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:52.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:52.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:52.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:52.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:52.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:52.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:52.097 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.097 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.097 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.097 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:52.097 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:52.097 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 57.846054840000001, 2024-04-19T04:25:52.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:52.097 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.097 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.097 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:52.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:52.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:52.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:52.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:52.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:52.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:52.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:52.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:52.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:52.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:52.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:52.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:52.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:52.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:52.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:52.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:52.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:52.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:52.101 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.101 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.101 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.101 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:52.101 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:52.101 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 57.845709178999996, 2024-04-19T04:25:52.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:52.102 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.102 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.102 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.102 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.102 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.102 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:52.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.102 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:52.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:52.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:52.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:52.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:52.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:52.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:52.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:52.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:52.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:52.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:52.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:52.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:52.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:52.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:52.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:52.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:52.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:52.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:52.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:52.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:52.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:52.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:52.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:52.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:52.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.107 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.107 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:52.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:52.107 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.107 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.108 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.108 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:52.108 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:52.108 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 57.844984740999998, 2024-04-19T04:25:52.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:52.108 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.108 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.108 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:52.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:52.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:52.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:52.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:52.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:52.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:52.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:52.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:52.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:52.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:52.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:52.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:52.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:52.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:52.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:52.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:52.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:52.111 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.112 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.112 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.112 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:52.112 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:52.112 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 57.844977346, 2024-04-19T04:25:52.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:52.113 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.113 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.113 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.113 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.113 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:52.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:52.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:52.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:52.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:52.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:52.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:52.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:52.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:52.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:52.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:52.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:52.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.116 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:52.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:52.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.116 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:52.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:52.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:52.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.116 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:52.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:52.117 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.117 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.117 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.117 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:52.117 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:52.117 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 57.843152199000002, 2024-04-19T04:25:52.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:52.117 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.117 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.117 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.117 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.118 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.118 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:52.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.118 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:52.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:52.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:52.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:52.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:52.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:52.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:52.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.120 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:52.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:52.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.120 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:52.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:52.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.120 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:52.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:52.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:52.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:52.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:52.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:52.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:52.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:52.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:52.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:52.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:52.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:52.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:52.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:52.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:52.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:52.122 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.122 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.123 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.123 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:52.126 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:52.126 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 57.842417994000002, 2024-04-19T04:25:52.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:52.126 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.126 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.126 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.126 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.126 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.127 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:52.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.127 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:52.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:52.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:52.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:52.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:52.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:52.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:52.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:52.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:52.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.129 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:52.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:52.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.129 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:52.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:52.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:52.129 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:52.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:52.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:52.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:52.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:52.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:52.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:52.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:52.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:52.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:52.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:52.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:52.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:52.131 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.131 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.131 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.131 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:52.131 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:52.131 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 57.841883717999998, 2024-04-19T04:25:52.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:52.132 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.132 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.132 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:52.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:52.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:52.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:52.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:52.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:52.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:52.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:52.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:52.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:52.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:52.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:52.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:52.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:52.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:52.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:52.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:52.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:52.136 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.136 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.136 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.136 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:52.136 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:52.137 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 36.125028528999998, 2024-04-19T04:25:52.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:52.137 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.137 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:52.137 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.137 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.137 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.137 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:52.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.137 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.137 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:52.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.138 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:52.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.138 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:52.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:52.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.138 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:52.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:52.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.139 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:52.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:52.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.139 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:52.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:52.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.139 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.139 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:52.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:52.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:52.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:52.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:52.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:52.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:52.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:52.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:52.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:52.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:52.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:52.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:52.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:52.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:52.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:52.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:52.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.142 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.142 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:52.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:52.142 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.142 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.142 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.142 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:52.142 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:52.142 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 36.104798080000002, 2024-04-19T04:25:52.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:52.142 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.142 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:52.143 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.143 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.143 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.143 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:52.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.143 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.143 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.143 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:52.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.143 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.143 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:52.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:52.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:52.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:52.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:52.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:52.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:52.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:52.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:52.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:52.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:52.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:52.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:52.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:52.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:52.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:52.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:52.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:52.146 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.146 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.146 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.147 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:52.147 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:52.147 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 36.104690222999999, 2024-04-19T04:25:52.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:52.147 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.147 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:52.147 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.147 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.147 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.147 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:52.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.147 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.147 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.148 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:52.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.148 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:52.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.148 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:52.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:52.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:52.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:52.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:52.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:52.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:52.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:52.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:52.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:52.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:52.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:52.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:52.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:52.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:52.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.151 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:52.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:52.151 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.151 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.151 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.151 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.151 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:52.151 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:52.151 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 36.102723533999999, 2024-04-19T04:25:52.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:52.151 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.151 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.151 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.151 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.152 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.152 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:52.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.152 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.152 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.152 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:52.152 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.152 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.152 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:52.152 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:52.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:52.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:52.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:52.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:52.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:52.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.154 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:52.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:52.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.154 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.154 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.154 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:52.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:52.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.154 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.154 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:52.154 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:52.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:52.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.154 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.154 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.155 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:52.155 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:52.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.155 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.155 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.155 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:52.155 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:52.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.155 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.155 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:52.155 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:52.155 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:52.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.155 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.155 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:52.156 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:52.156 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:52.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.156 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.156 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.156 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:52.156 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:52.156 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.156 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.156 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.156 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.156 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:52.156 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:52.156 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 36.099359339000003, 2024-04-19T04:25:52.157 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:52.157 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.157 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.157 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.157 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.157 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.157 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:52.157 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.157 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.157 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.157 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.157 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:52.157 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.157 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.157 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:52.158 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:52.158 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:52.158 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:52.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.159 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.159 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:52.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:52.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.159 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.159 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:52.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:52.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.159 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.159 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:52.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:52.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.160 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:52.160 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:52.160 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:52.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.160 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.160 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.160 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:52.160 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:52.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.160 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.160 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.160 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:52.160 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:52.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.160 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.161 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:52.161 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:52.161 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:52.161 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.161 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.161 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:52.161 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:52.161 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:52.161 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.161 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.161 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.161 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:52.161 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:52.161 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.161 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.162 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.162 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.162 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.162 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:52.162 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:52.162 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 36.095548360999999, 2024-04-19T04:25:52.162 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:52.162 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.162 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.162 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.162 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.162 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.162 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:52.162 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.163 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.163 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.163 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.163 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:52.163 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.163 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.163 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.163 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.163 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:52.163 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.163 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.163 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.163 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.163 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:52.163 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.164 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.164 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.164 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:52.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:52.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.164 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.164 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.164 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:52.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:52.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.164 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.164 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.164 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:52.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:52.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:52.165 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:52.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:52.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:52.165 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:52.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:52.165 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:52.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.166 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.166 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.166 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:52.166 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:52.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.166 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.166 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:52.166 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:52.166 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:52.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.166 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.166 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:52.166 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:52.166 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:52.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.167 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.167 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.167 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:52.167 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:52.167 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.167 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.167 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.167 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.167 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.167 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93735 5.1 5:8e609d1b:::benchmark_data_smithi007_19526_object93734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:52.167 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:52.167 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.853847717000001, 2024-04-19T04:25:52.167 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048424842000000003, 2024-04-19T04:25:52.167 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.167 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.167 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.168 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.168 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.168 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93735 2024-04-19T04:25:52.168 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.168 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.168 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.168 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.168 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:52.168 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.168 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.168 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.168 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.168 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:52.168 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.168 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.169 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.169 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.169 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227480+0000", 2024-04-19T04:25:52.169 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.169 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.169 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.169 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.169 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227533+0000", 2024-04-19T04:25:52.169 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2964999999999999e-05 2024-04-19T04:25:52.169 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.169 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.169 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.169 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227542+0000", 2024-04-19T04:25:52.169 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1449999999999997e-06 2024-04-19T04:25:52.170 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.170 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.170 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.170 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227561+0000", 2024-04-19T04:25:52.170 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9116000000000001e-05 2024-04-19T04:25:52.170 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.170 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.170 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.170 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227610+0000", 2024-04-19T04:25:52.170 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9234000000000003e-05 2024-04-19T04:25:52.170 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.170 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.170 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.170 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227697+0000", 2024-04-19T04:25:52.170 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6682999999999997e-05 2024-04-19T04:25:52.171 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.171 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.171 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:52.171 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275809+0000", 2024-04-19T04:25:52.171 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048112265000000001 2024-04-19T04:25:52.171 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.171 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.171 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:52.171 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275845+0000", 2024-04-19T04:25:52.171 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5275999999999999e-05 2024-04-19T04:25:52.171 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.171 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.171 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.171 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275906+0000", 2024-04-19T04:25:52.171 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1002999999999999e-05 2024-04-19T04:25:52.172 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.172 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.172 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.172 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.172 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93736 5.1 5:852229ec:::benchmark_data_smithi007_19526_object93735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:52.172 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:52.172 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.853743687000001, 2024-04-19T04:25:52.172 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048414497000000001, 2024-04-19T04:25:52.172 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.172 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.172 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.172 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.172 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.172 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93736 2024-04-19T04:25:52.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.173 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.173 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.173 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.173 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:52.173 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.173 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.173 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.173 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.173 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:52.173 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.173 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.173 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.173 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.173 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227584+0000", 2024-04-19T04:25:52.173 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:52.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.174 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.174 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.174 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227624+0000", 2024-04-19T04:25:52.174 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9833000000000003e-05 2024-04-19T04:25:52.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.174 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.174 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.174 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227630+0000", 2024-04-19T04:25:52.174 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0759999999999999e-06 2024-04-19T04:25:52.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.174 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.174 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.174 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227634+0000", 2024-04-19T04:25:52.174 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1570000000000002e-06 2024-04-19T04:25:52.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.175 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.175 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.175 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229531+0000", 2024-04-19T04:25:52.175 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018962339999999999 2024-04-19T04:25:52.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.175 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.175 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.175 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229662+0000", 2024-04-19T04:25:52.175 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013192999999999999 2024-04-19T04:25:52.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.175 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.175 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:52.175 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275915+0000", 2024-04-19T04:25:52.175 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046252140999999997 2024-04-19T04:25:52.176 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.176 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.176 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:52.176 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275944+0000", 2024-04-19T04:25:52.176 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9539999999999998e-05 2024-04-19T04:25:52.176 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.176 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.176 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.176 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275999+0000", 2024-04-19T04:25:52.176 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5062999999999998e-05 2024-04-19T04:25:52.176 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.176 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.176 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.176 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.176 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.177 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:52.177 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:52.177 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.853686004, 2024-04-19T04:25:52.177 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:25:52.177 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.177 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.177 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.177 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.177 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.177 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:25:52.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.177 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.177 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.177 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.177 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:52.177 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:52.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:52.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:52.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:25:52.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:25:52.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:25:52.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:25:52.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:25:52.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:25:52.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:25:52.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:25:52.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.180 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.180 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.180 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:25:52.180 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:25:52.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.180 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.180 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:52.180 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:25:52.180 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:25:52.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.180 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.180 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:52.180 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:25:52.180 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:25:52.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.181 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.181 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.181 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:25:52.181 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:25:52.181 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.181 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.181 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.181 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.181 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.181 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:52.181 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:52.181 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.853091723999999, 2024-04-19T04:25:52.181 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:25:52.181 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.181 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.182 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.182 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.182 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.182 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:25:52.182 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.182 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.182 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.182 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.182 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:52.182 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.182 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.182 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.182 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.182 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:52.183 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.183 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.183 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.183 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.183 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:25:52.183 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.183 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.183 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.183 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.183 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:25:52.183 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:25:52.183 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.183 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.183 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.183 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:25:52.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:25:52.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:25:52.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:25:52.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:25:52.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:25:52.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:25:52.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:25:52.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:52.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:25:52.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:25:52.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:52.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:25:52.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:25:52.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:52.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:25:52.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:25:52.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.186 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:52.186 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:25:52.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:25:52.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.186 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.186 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:25:52.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:25:52.186 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.186 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.186 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.187 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93744 5.1 5:87b91c25:::benchmark_data_smithi007_19526_object93743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:52.187 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:52.187 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.849422173000001, 2024-04-19T04:25:52.187 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044295022000000003, 2024-04-19T04:25:52.187 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.187 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.187 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.187 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.187 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.187 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93744 2024-04-19T04:25:52.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.187 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.187 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.188 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:52.188 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.188 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.188 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.188 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:52.188 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.188 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.188 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.188 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231905+0000", 2024-04-19T04:25:52.188 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.188 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.188 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.189 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231935+0000", 2024-04-19T04:25:52.189 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9442e-05 2024-04-19T04:25:52.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.189 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.189 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.189 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264224+0000", 2024-04-19T04:25:52.189 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.032288836000000001 2024-04-19T04:25:52.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.189 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.189 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.189 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264238+0000", 2024-04-19T04:25:52.189 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4494999999999999e-05 2024-04-19T04:25:52.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.189 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.189 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.190 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268311+0000", 2024-04-19T04:25:52.190 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040726629999999998 2024-04-19T04:25:52.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.190 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.190 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268587+0000", 2024-04-19T04:25:52.190 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00027623200000000001 2024-04-19T04:25:52.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.190 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:52.190 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276099+0000", 2024-04-19T04:25:52.190 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075116180000000003 2024-04-19T04:25:52.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.190 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:52.191 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276123+0000", 2024-04-19T04:25:52.191 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4675e-05 2024-04-19T04:25:52.191 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.191 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.191 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:52.191 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276201+0000", 2024-04-19T04:25:52.191 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7836000000000005e-05 2024-04-19T04:25:52.191 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.191 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.191 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.191 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.191 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.191 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:52.193 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-04-19T04:25:52.194 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:52.194 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:52.193+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:52.294 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:52.293+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:52.323 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:52.324 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:52.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.324 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:143830 5.d e51/29 5:b35abc28:::benchmark_data_smithi007_19526_object18096:head v 51'8742, mlcod=51'8739)", 2024-04-19T04:25:52.324 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:52.320071+0000", 2024-04-19T04:25:52.324 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0040393929999999996, 2024-04-19T04:25:52.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040590799999999996, 2024-04-19T04:25:52.324 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.324 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:52.324 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.320071+0000", 2024-04-19T04:25:52.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.320071+0000", 2024-04-19T04:25:52.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.320070+0000", 2024-04-19T04:25:52.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:52.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.320083+0000", 2024-04-19T04:25:52.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2072000000000001e-05 2024-04-19T04:25:52.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.320093+0000", 2024-04-19T04:25:52.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0358e-05 2024-04-19T04:25:52.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.320099+0000", 2024-04-19T04:25:52.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3550000000000001e-06 2024-04-19T04:25:52.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.320145+0000", 2024-04-19T04:25:52.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5327000000000002e-05 2024-04-19T04:25:52.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.320176+0000", 2024-04-19T04:25:52.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1866000000000003e-05 2024-04-19T04:25:52.327 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.327 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.327 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.328 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:143831 5.9 e51/20 5:9dfdac4c:::benchmark_data_smithi007_19526_object18097:head v 51'9207, mlcod=51'9202)", 2024-04-19T04:25:52.328 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:52.320600+0000", 2024-04-19T04:25:52.328 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0035100859999999999, 2024-04-19T04:25:52.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035961949999999999, 2024-04-19T04:25:52.328 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.328 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:52.328 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.320600+0000", 2024-04-19T04:25:52.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.320600+0000", 2024-04-19T04:25:52.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.320600+0000", 2024-04-19T04:25:52.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:52.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.320610+0000", 2024-04-19T04:25:52.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0725e-05 2024-04-19T04:25:52.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.320619+0000", 2024-04-19T04:25:52.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7590000000000003e-06 2024-04-19T04:25:52.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.320625+0000", 2024-04-19T04:25:52.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1290000000000001e-06 2024-04-19T04:25:52.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322422+0000", 2024-04-19T04:25:52.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001796413 2024-04-19T04:25:52.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322452+0000", 2024-04-19T04:25:52.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9886000000000002e-05 2024-04-19T04:25:52.331 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.331 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.331 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.331 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:143836 5.f e51/20 5:f8927599:::benchmark_data_smithi007_19526_object18102:head v 51'8842, mlcod=51'8839)", 2024-04-19T04:25:52.331 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:52.322275+0000", 2024-04-19T04:25:52.331 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0018351470000000001, 2024-04-19T04:25:52.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001977632, 2024-04-19T04:25:52.331 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.331 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:52.332 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322275+0000", 2024-04-19T04:25:52.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322275+0000", 2024-04-19T04:25:52.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322275+0000", 2024-04-19T04:25:52.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:52.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322285+0000", 2024-04-19T04:25:52.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271999999999999e-05 2024-04-19T04:25:52.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322294+0000", 2024-04-19T04:25:52.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4080000000000004e-06 2024-04-19T04:25:52.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322301+0000", 2024-04-19T04:25:52.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5370000000000003e-06 2024-04-19T04:25:52.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322435+0000", 2024-04-19T04:25:52.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000134346 2024-04-19T04:25:52.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322464+0000", 2024-04-19T04:25:52.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8351e-05 2024-04-19T04:25:52.334 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.334 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.335 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.335 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:143838 5.e 5:7efefa5c:::benchmark_data_smithi007_19526_object18104:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T04:25:52.335 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:52.322371+0000", 2024-04-19T04:25:52.335 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001739064, 2024-04-19T04:25:52.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001937699, 2024-04-19T04:25:52.335 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.335 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:52.335 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.335 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.335 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.335 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 143838 2024-04-19T04:25:52.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.335 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322371+0000", 2024-04-19T04:25:52.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322371+0000", 2024-04-19T04:25:52.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322370+0000", 2024-04-19T04:25:52.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322377+0000", 2024-04-19T04:25:52.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7170000000000002e-06 2024-04-19T04:25:52.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322387+0000", 2024-04-19T04:25:52.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0254999999999999e-05 2024-04-19T04:25:52.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322395+0000", 2024-04-19T04:25:52.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7219999999999999e-06 2024-04-19T04:25:52.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322462+0000", 2024-04-19T04:25:52.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6591e-05 2024-04-19T04:25:52.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322631+0000", 2024-04-19T04:25:52.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016901899999999999 2024-04-19T04:25:52.338 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.338 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.338 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.339 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:143839 5.b 5:d2b854f5:::benchmark_data_smithi007_19526_object18105:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T04:25:52.339 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:52.322423+0000", 2024-04-19T04:25:52.339 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001687846, 2024-04-19T04:25:52.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019506930000000001, 2024-04-19T04:25:52.339 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.339 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:52.339 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.339 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.339 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.339 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 143839 2024-04-19T04:25:52.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.339 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322423+0000", 2024-04-19T04:25:52.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322423+0000", 2024-04-19T04:25:52.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322422+0000", 2024-04-19T04:25:52.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:52.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322426+0000", 2024-04-19T04:25:52.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2289999999999997e-06 2024-04-19T04:25:52.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322435+0000", 2024-04-19T04:25:52.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2749999999999995e-06 2024-04-19T04:25:52.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322451+0000", 2024-04-19T04:25:52.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5984000000000001e-05 2024-04-19T04:25:52.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322486+0000", 2024-04-19T04:25:52.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5781999999999997e-05 2024-04-19T04:25:52.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.322605+0000", 2024-04-19T04:25:52.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011825800000000001 2024-04-19T04:25:52.342 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.342 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.342 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.343 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:143842 5.e 5.1f28944e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T04:25:52.343 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:52.323131+0000", 2024-04-19T04:25:52.343 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00097906300000000007, 2024-04-19T04:25:52.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013022299999999999, 2024-04-19T04:25:52.343 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.343 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:52.343 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.343 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.343 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.343 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 143842 2024-04-19T04:25:52.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.343 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.323131+0000", 2024-04-19T04:25:52.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.323131+0000", 2024-04-19T04:25:52.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.323131+0000", 2024-04-19T04:25:52.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.323136+0000", 2024-04-19T04:25:52.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7080000000000002e-06 2024-04-19T04:25:52.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.323146+0000", 2024-04-19T04:25:52.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8009999999999998e-06 2024-04-19T04:25:52.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.323154+0000", 2024-04-19T04:25:52.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0669999999999992e-06 2024-04-19T04:25:52.345 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.345 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.345 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.346 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:143841 5.9 e51/20 5:99e3031f:::benchmark_data_smithi007_19526_object18107:head v 51'9208, mlcod=51'9204)", 2024-04-19T04:25:52.346 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:52.323915+0000", 2024-04-19T04:25:52.346 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00019531, 2024-04-19T04:25:52.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00056788800000000001, 2024-04-19T04:25:52.346 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.346 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:52.346 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.323915+0000", 2024-04-19T04:25:52.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.323915+0000", 2024-04-19T04:25:52.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.323915+0000", 2024-04-19T04:25:52.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:52.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.323920+0000", 2024-04-19T04:25:52.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4009999999999996e-06 2024-04-19T04:25:52.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.323928+0000", 2024-04-19T04:25:52.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3180000000000007e-06 2024-04-19T04:25:52.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.323935+0000", 2024-04-19T04:25:52.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9160000000000004e-06 2024-04-19T04:25:52.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.324101+0000", 2024-04-19T04:25:52.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000165458 2024-04-19T04:25:52.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:52.324127+0000", 2024-04-19T04:25:52.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6468000000000001e-05 2024-04-19T04:25:52.349 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.349 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.349 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.349 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.349 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:52.349 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 7 2024-04-19T04:25:52.349 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:52.350 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:52.395 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:52.393+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:52.479 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:52.479 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:52.480 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:52.480 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:52.480 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:52.493 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:52.495 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:52.493+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:52.596 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:52.593+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:52.620 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:52.620 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:52.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:52.620 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:52.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.620 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:52.620 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:52.620 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 58.382360007000003, 2024-04-19T04:25:52.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:52.621 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.621 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.621 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.621 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.621 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.621 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:52.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.621 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:52.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:52.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:52.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:52.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:52.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:52.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:52.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:52.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:52.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:52.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:52.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:52.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:52.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:52.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:52.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:52.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:52.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:52.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:52.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:52.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:52.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:52.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:52.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:52.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:52.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:52.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:52.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:52.626 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.626 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.626 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.627 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:52.627 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:52.627 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 58.377911091000001, 2024-04-19T04:25:52.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:52.627 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.627 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.627 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.627 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.627 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.627 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:52.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.628 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:52.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:52.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:52.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:52.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:52.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:52.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:52.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:52.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:52.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:52.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:52.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:52.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:52.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:52.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:52.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:52.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:52.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:52.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:52.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:52.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:52.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:52.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:52.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:52.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:52.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:52.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:52.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:52.632 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.632 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.632 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.633 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:52.633 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:52.633 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.549978848000002, 2024-04-19T04:25:52.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:52.633 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.633 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.633 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.633 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.633 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.633 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:52.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.633 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:52.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:52.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:52.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:52.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:52.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:52.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:52.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:52.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:52.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:52.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:52.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:52.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:52.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:52.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:52.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:52.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:52.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:52.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:52.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:52.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:52.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:52.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:52.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:52.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:52.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:52.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:52.638 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.638 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.638 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.638 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:52.638 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:52.639 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 37.114124811000003, 2024-04-19T04:25:52.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:52.639 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.639 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.639 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.639 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.639 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.639 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:52.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.639 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:52.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:52.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:52.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:52.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:52.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:52.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:52.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:52.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:52.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:52.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:52.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:52.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:52.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:52.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:52.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:52.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:52.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:52.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:52.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:52.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:52.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:52.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:52.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:52.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:52.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:52.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:52.644 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.644 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.644 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.644 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:52.644 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:52.644 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 37.113694391000003, 2024-04-19T04:25:52.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:52.644 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.644 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.644 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.644 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.644 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.645 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:52.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.645 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:52.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:52.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:52.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:52.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:52.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:52.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:52.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:52.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:52.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:52.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:52.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:52.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:52.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:52.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:52.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:52.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:52.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:52.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:52.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:52.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:52.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:52.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:52.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:52.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:52.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:52.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:52.649 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.649 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.649 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.650 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:52.650 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:52.650 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 37.111463127, 2024-04-19T04:25:52.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:52.650 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.650 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.650 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:52.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.650 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:52.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:52.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:52.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:52.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:52.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:52.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:52.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:52.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:52.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:52.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:52.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:52.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:52.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:52.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:52.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:52.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:52.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:52.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:52.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:52.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:52.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:52.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:52.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:52.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:52.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:52.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:52.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:52.655 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.655 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.655 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.655 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:52.655 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:52.655 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 37.108066088999998, 2024-04-19T04:25:52.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:52.655 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.656 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.656 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.656 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.656 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.656 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:52.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.656 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:52.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:52.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:52.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:52.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:52.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:52.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:52.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:52.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:52.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:52.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:52.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:52.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:52.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:52.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:52.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:52.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:52.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:52.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:52.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:52.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:52.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:52.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:52.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:52.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:52.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:52.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:52.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:52.660 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.660 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.660 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.661 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:52.661 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:52.661 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 37.102937891000003, 2024-04-19T04:25:52.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:52.661 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.661 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.661 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.661 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.661 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.661 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:52.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.661 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:52.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:52.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:52.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:52.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:52.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:52.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:52.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:52.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:52.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:52.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:52.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:52.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:52.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:52.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:52.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:52.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:52.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:52.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:52.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:52.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:52.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:52.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:52.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:52.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:52.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:52.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:52.666 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.666 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.666 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.666 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:52.667 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:52.667 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.788909386, 2024-04-19T04:25:52.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:52.667 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.667 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.667 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.667 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.667 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.667 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:52.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.667 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:52.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:52.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:52.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:52.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:52.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:52.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:52.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:52.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:52.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:52.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:52.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:52.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:52.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:52.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:52.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:52.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:52.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:52.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:52.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:52.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:52.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:52.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:52.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:52.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:52.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:52.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:52.672 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.672 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.672 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.672 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:52.672 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:52.672 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.666549975999999, 2024-04-19T04:25:52.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:25:52.673 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.673 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:52.673 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.673 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.673 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.673 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:52.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.673 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:52.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:52.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:52.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:52.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:52.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:52.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:52.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:52.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:52.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:52.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:52.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:52.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:52.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:52.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:52.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:52.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:52.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:52.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:52.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:52.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:52.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:52.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:52.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:52.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:52.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:25:52.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:25:52.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:25:52.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:25:52.678 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.678 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.678 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.679 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:52.679 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:52.679 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.661488329999997, 2024-04-19T04:25:52.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:25:52.679 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.679 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:52.679 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.679 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.679 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.679 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:52.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.679 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:52.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:52.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:52.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:52.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:52.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:52.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:52.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:52.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:52.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:52.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:52.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:52.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:52.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:52.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:52.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:52.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:52.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:52.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:52.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:52.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:52.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:52.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:25:52.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:25:52.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:25:52.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:25:52.684 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.684 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.684 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.685 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:52.685 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:52.685 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.661388418000001, 2024-04-19T04:25:52.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:25:52.685 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.685 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:52.685 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.685 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.685 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.685 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:52.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.685 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:52.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:52.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:52.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:52.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:52.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:52.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:52.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:52.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:52.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:52.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:52.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:52.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:52.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:52.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:52.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:52.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:52.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:52.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:52.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:52.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:52.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:52.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:25:52.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:25:52.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:25:52.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:25:52.690 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.690 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.690 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.690 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:52.690 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:52.690 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.661262665000002, 2024-04-19T04:25:52.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:25:52.691 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.691 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:52.691 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.691 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.691 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.691 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:52.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.691 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:52.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:52.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:52.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:52.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:52.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:52.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:52.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:52.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:52.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:52.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:52.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:52.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:52.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:52.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:52.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:52.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:52.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:52.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:52.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:52.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:52.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:25:52.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:25:52.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:25:52.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:25:52.696 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.696 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.696 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.696 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:52.696 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:52.696 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.657418720000003, 2024-04-19T04:25:52.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:25:52.696 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.696 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.696 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.696 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.697 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.697 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:52.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.697 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:52.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:52.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:52.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:52.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:52.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:52.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:52.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:52.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:52.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:52.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:52.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:52.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:52.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:52.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:52.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:25:52.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:25:52.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:25:52.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:25:52.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:52.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:25:52.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:25:52.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:52.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:25:52.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:25:52.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:25:52.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:25:52.701 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.701 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.701 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.702 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:52.702 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:52.702 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.650247618999998, 2024-04-19T04:25:52.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:25:52.702 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.702 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:52.702 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.702 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.703 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.703 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:52.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.703 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:52.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:52.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:52.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:52.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:52.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:52.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:52.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:52.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:52.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:52.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:52.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:52.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:52.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:52.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:52.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:25:52.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:25:52.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:25:52.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:25:52.706 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.706 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.706 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.707 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:52.707 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:52.707 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.650075514999997, 2024-04-19T04:25:52.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:25:52.707 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.707 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:52.707 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.707 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.707 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.707 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:52.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.707 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:52.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:52.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:52.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:52.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:52.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:52.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:52.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:52.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:52.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:52.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:52.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:52.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:52.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:52.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:52.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:25:52.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:25:52.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:25:52.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:25:52.711 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.711 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.711 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.711 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:52.711 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:52.711 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.650012390000001, 2024-04-19T04:25:52.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:25:52.711 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.711 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.712 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.712 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.712 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.712 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:52.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.712 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:52.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:52.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:52.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:52.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:52.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:52.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:52.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:52.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:52.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:52.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:52.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:52.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:52.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:52.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:52.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:25:52.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:25:52.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:25:52.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:25:52.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:52.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:25:52.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:25:52.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:52.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:25:52.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:25:52.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:25:52.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:25:52.716 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.716 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.716 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.717 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:52.717 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:52.717 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.649883793000001, 2024-04-19T04:25:52.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:25:52.717 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.717 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.717 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.717 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.717 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.717 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:52.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.717 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:52.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:52.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:52.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:52.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:52.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:52.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:52.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:52.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:52.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:52.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:52.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:52.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:52.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:52.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:52.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:25:52.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:25:52.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:25:52.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:25:52.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:52.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:25:52.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:25:52.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:52.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:25:52.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:25:52.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:25:52.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:25:52.722 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.722 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.722 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.722 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:52.722 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:52.722 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.649815822000001, 2024-04-19T04:25:52.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:25:52.723 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.723 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.723 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.723 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.723 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.723 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:52.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.723 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:52.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:52.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:52.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:52.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:52.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:52.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:52.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:52.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:52.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:52.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:52.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:52.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:52.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:52.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:52.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:25:52.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:25:52.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:25:52.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:25:52.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:52.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:25:52.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:25:52.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:52.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:25:52.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:25:52.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:25:52.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:25:52.728 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.728 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.728 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.728 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:111654 5.0 5:0b6b473d:::benchmark_data_smithi007_19526_object111653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:52.728 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:52.728 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.702024716, 2024-04-19T04:25:52.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023122753999999999, 2024-04-19T04:25:52.728 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:52.728 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:52.728 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:52.728 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:52.728 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.729 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 111654 2024-04-19T04:25:52.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.729 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:52.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:52.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:52.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:52.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:52.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:52.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:52.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915865+0000", 2024-04-19T04:25:52.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:52.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:52.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915897+0000", 2024-04-19T04:25:52.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1708999999999997e-05 2024-04-19T04:25:52.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:52.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915905+0000", 2024-04-19T04:25:52.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.481e-06 2024-04-19T04:25:52.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915911+0000", 2024-04-19T04:25:52.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6880000000000002e-06 2024-04-19T04:25:52.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:52.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925564+0000", 2024-04-19T04:25:52.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096527039999999998 2024-04-19T04:25:52.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:52.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925771+0000", 2024-04-19T04:25:52.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020717199999999999 2024-04-19T04:25:52.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:52.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938888+0000", 2024-04-19T04:25:52.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013117105 2024-04-19T04:25:52.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:52.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938931+0000", 2024-04-19T04:25:52.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2447000000000002e-05 2024-04-19T04:25:52.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:52.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:52.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:52.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938989+0000", 2024-04-19T04:25:52.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7997000000000001e-05 2024-04-19T04:25:52.733 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.733 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.733 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.733 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:52.733 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:52.733 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:52.734 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:52.733+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:52.735 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:52.749 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:25:52.835 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:52.833+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:52.865 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:52.865 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:52.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.865 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:145154 5.9 5.9bc0d509 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T04:25:52.865 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:52.864927+0000", 2024-04-19T04:25:52.865 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0011383070000000001, 2024-04-19T04:25:52.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0011632459999999999, 2024-04-19T04:25:52.866 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.866 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:52.866 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.866 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.866 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.866 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 145154 2024-04-19T04:25:52.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.866 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.864927+0000", 2024-04-19T04:25:52.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.864927+0000", 2024-04-19T04:25:52.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.864926+0000", 2024-04-19T04:25:52.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.864931+0000", 2024-04-19T04:25:52.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3469999999999998e-06 2024-04-19T04:25:52.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.864941+0000", 2024-04-19T04:25:52.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9760000000000007e-06 2024-04-19T04:25:52.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.864949+0000", 2024-04-19T04:25:52.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4780000000000002e-06 2024-04-19T04:25:52.868 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.868 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.868 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.869 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:145155 5.7 5:ed10dc9c:::benchmark_data_smithi007_19526_object19421:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T04:25:52.869 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:52.865220+0000", 2024-04-19T04:25:52.869 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00084472499999999995, 2024-04-19T04:25:52.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00093320199999999995, 2024-04-19T04:25:52.869 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.869 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:52.869 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.869 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.869 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.869 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 145155 2024-04-19T04:25:52.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.869 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.865220+0000", 2024-04-19T04:25:52.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.865220+0000", 2024-04-19T04:25:52.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.865219+0000", 2024-04-19T04:25:52.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.865225+0000", 2024-04-19T04:25:52.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3240000000000002e-06 2024-04-19T04:25:52.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.865236+0000", 2024-04-19T04:25:52.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1277000000000001e-05 2024-04-19T04:25:52.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.865243+0000", 2024-04-19T04:25:52.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2520000000000002e-06 2024-04-19T04:25:52.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.866028+0000", 2024-04-19T04:25:52.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00078447100000000002 2024-04-19T04:25:52.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.866150+0000", 2024-04-19T04:25:52.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012221399999999999 2024-04-19T04:25:52.872 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.872 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.872 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.873 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:145156 5.9 5.441c3bb9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T04:25:52.873 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:52.865279+0000", 2024-04-19T04:25:52.873 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00078603500000000003, 2024-04-19T04:25:52.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00092656599999999998, 2024-04-19T04:25:52.873 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.873 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:52.873 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.873 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.873 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.873 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 145156 2024-04-19T04:25:52.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.873 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.865279+0000", 2024-04-19T04:25:52.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.865279+0000", 2024-04-19T04:25:52.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.865278+0000", 2024-04-19T04:25:52.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:52.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.865283+0000", 2024-04-19T04:25:52.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3970000000000004e-06 2024-04-19T04:25:52.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.865291+0000", 2024-04-19T04:25:52.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4959999999999996e-06 2024-04-19T04:25:52.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.865298+0000", 2024-04-19T04:25:52.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8040000000000004e-06 2024-04-19T04:25:52.876 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.876 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.876 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.876 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:145159 5.5 5:aa049a2c:::benchmark_data_smithi007_19526_object19425:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T04:25:52.876 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:52.865996+0000", 2024-04-19T04:25:52.876 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 6.8897000000000001e-05, 2024-04-19T04:25:52.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00023879199999999999, 2024-04-19T04:25:52.876 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.877 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:52.877 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.877 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.877 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.877 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 145159 2024-04-19T04:25:52.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.877 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.865996+0000", 2024-04-19T04:25:52.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.865996+0000", 2024-04-19T04:25:52.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.865995+0000", 2024-04-19T04:25:52.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.866000+0000", 2024-04-19T04:25:52.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9849999999999997e-06 2024-04-19T04:25:52.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.866010+0000", 2024-04-19T04:25:52.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.6930000000000002e-06 2024-04-19T04:25:52.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.866016+0000", 2024-04-19T04:25:52.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1070000000000001e-06 2024-04-19T04:25:52.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.866059+0000", 2024-04-19T04:25:52.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3257000000000003e-05 2024-04-19T04:25:52.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.866200+0000", 2024-04-19T04:25:52.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014086 2024-04-19T04:25:52.880 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.880 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.880 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.880 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:145152 5.9 5:94906465:::benchmark_data_smithi007_19526_object19418:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T04:25:52.880 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:52.864124+0000", 2024-04-19T04:25:52.880 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001940797, 2024-04-19T04:25:52.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0021466279999999998, 2024-04-19T04:25:52.880 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:52.880 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:52.880 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:52.880 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:52.881 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:52.881 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 145152 2024-04-19T04:25:52.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.881 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:52.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:52.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.864124+0000", 2024-04-19T04:25:52.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:52.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.864124+0000", 2024-04-19T04:25:52.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:52.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:52.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.864123+0000", 2024-04-19T04:25:52.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:52.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:52.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.864129+0000", 2024-04-19T04:25:52.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4979999999999997e-06 2024-04-19T04:25:52.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:52.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.864142+0000", 2024-04-19T04:25:52.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3603e-05 2024-04-19T04:25:52.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:52.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.864150+0000", 2024-04-19T04:25:52.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3819999999999998e-06 2024-04-19T04:25:52.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:52.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.864200+0000", 2024-04-19T04:25:52.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0368999999999998e-05 2024-04-19T04:25:52.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:52.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.864346+0000", 2024-04-19T04:25:52.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014624399999999999 2024-04-19T04:25:52.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:52.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:52.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:52.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:52.864481+0000", 2024-04-19T04:25:52.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013435000000000001 2024-04-19T04:25:52.884 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.884 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:52.884 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.884 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:52.884 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:52.884 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 5 2024-04-19T04:25:52.884 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:52.885 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:52.905 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:52.929 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:52.930 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:52.930 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:52.930 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:52.934 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:52.934 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:52.937 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:52.937+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:53.018 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:53.018 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:53.031 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:53.037 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:53.033+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:53.138 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:53.137+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:53.201 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:53.201 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:53.214 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:53.258 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:53.257+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:53.336 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:53.337 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:53.340 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:53.337+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:53.350 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:53.441 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:53.441+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:53.480 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:53.480 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:53.492 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:53.542 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:53.541+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:53.612 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:53.612 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:53.625 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:53.643 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:53.641+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:53.744 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:53.741+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:53.757 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:53.757 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:53.770 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:53.844 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:53.845+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:53.896 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:53.896 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:53.908 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:53.946 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:53.945+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:54.041 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:54.041 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:54.046 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:54.045+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:54.053 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:54.147 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:54.145+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:54.185 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:54.185 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:54.196 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T04:25:54.197 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:54.248 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:54.249+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:54.320 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:54.320 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:54.333 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:54.349 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:54.349+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:54.450 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:54.449+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:54.455 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:54.455 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:54.468 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:54.551 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:54.549+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:54.598 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:54.598 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:54.609 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:54.652 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:54.649+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:54.739 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:54.739 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:54.752 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:54.755 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:54.753+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:54.854 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:54.853+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:54.877 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:54.877 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:54.888 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:54.935 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:25:54.954 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:54.953+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:55.006 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:55.006 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:55.018 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:55.056 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:55.053+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:55.086 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:55.109 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:55.109 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:55.109 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:55.109 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:55.111 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:55.112 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:55.144 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:55.144 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:55.144 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:55.144 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:55.145 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:55.153 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-04-19T04:25:55.157 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:55.158 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:55.153+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:55.258 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:55.257+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:55.279 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:55.279 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:55.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:55.279 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 61.041616744000002, 2024-04-19T04:25:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:55.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.281 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:55.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:55.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:55.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:55.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:55.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:55.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:55.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:55.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:55.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:55.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:55.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:55.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:55.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:55.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:55.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:55.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:55.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:55.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:55.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:55.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:55.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:55.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:55.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:55.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:55.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:55.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:55.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:55.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:55.286 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.286 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.286 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.286 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:55.286 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:55.286 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 61.037167828000001, 2024-04-19T04:25:55.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:55.286 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.286 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.286 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.287 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.287 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.287 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:55.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.287 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:55.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:55.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:55.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:55.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:55.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:55.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:55.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:55.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:55.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:55.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:55.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:55.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:55.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:55.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:55.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:55.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:55.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:55.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:55.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:55.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:55.292 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.292 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.292 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.292 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:55.292 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:55.292 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.209235585000002, 2024-04-19T04:25:55.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:55.292 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.292 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.292 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.292 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.293 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.293 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:55.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.293 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:55.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:55.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:55.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:55.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:55.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:55.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:55.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:55.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:55.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:55.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:55.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:55.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:55.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:55.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:55.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:55.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:55.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:55.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:55.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:55.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:55.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:55.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:55.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:55.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:55.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:55.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:55.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:55.297 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.297 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.297 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.298 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:55.298 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:55.298 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.773381548000003, 2024-04-19T04:25:55.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:55.298 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.298 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.298 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.298 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.298 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.298 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:55.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.298 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:55.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:55.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:55.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:55.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:55.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:55.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:55.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:55.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:55.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:55.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:55.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:55.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:55.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:55.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:55.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:55.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:55.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:55.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:55.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:55.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:55.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:55.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:55.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:55.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:55.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:55.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:55.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:55.303 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.303 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.303 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.303 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:55.304 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:55.304 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.772951128000003, 2024-04-19T04:25:55.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:55.304 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.304 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.304 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.304 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.304 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.304 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:55.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.304 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:55.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:55.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:55.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:55.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:55.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:55.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:55.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:55.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:55.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:55.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:55.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:55.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:55.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:55.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:55.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:55.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:55.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:55.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:55.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:55.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:55.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:55.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:55.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:55.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:55.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:55.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:55.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:55.309 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.309 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.309 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.309 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:55.309 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:55.309 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.770719864, 2024-04-19T04:25:55.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:55.309 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.309 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.309 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.309 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.310 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.310 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:55.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.310 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:55.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:55.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:55.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:55.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:55.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:55.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:55.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:55.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:55.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:55.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:55.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:55.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:55.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:55.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:55.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:55.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:55.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:55.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:55.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:55.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:55.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:55.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:55.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:55.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:55.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:55.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:55.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:55.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:55.314 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.314 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.314 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.315 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:55.315 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:55.315 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.767322825999997, 2024-04-19T04:25:55.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:55.315 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.315 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.315 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.315 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.315 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.315 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:55.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.316 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:55.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:55.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:55.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:55.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:55.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:55.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:55.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:55.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:55.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:55.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:55.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:55.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:55.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:55.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:55.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:55.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:55.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:55.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:55.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:55.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:55.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:55.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:55.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:55.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:55.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:55.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:55.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:55.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:55.320 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.320 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.320 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.321 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:55.321 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:55.321 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.762194628000003, 2024-04-19T04:25:55.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:55.321 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.321 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.321 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.321 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.321 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.321 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:55.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.321 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:55.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:55.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:55.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:55.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:55.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:55.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:55.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:55.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:55.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:55.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:55.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:55.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:55.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:55.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:55.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:55.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:55.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:55.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:55.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:55.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:55.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:55.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:55.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:55.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:55.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:55.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:55.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:55.326 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.326 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.326 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.326 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:55.326 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:55.326 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.448166123, 2024-04-19T04:25:55.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:55.327 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.327 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.327 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:55.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.327 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:55.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:55.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:55.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:55.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:55.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:55.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:55.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:55.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:55.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:55.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:55.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:55.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:55.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:55.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:55.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:55.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:55.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:55.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:55.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:55.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:55.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:55.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:55.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:55.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:55.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:55.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:55.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:55.332 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.332 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.332 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.332 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:55.332 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:55.332 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.325806712999999, 2024-04-19T04:25:55.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:25:55.332 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.332 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:55.332 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.333 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.333 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.333 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:55.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.333 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:55.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:55.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:55.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:55.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:55.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:55.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:55.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:55.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:55.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:55.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:55.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:55.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:55.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:55.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:55.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:55.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:55.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:55.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:55.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:55.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:55.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:55.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:55.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:55.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:55.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:55.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:25:55.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:25:55.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:25:55.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:25:55.338 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.338 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.338 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.338 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:55.338 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:55.338 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.320745066999997, 2024-04-19T04:25:55.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:25:55.338 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.338 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:55.338 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.339 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.339 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.339 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:55.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.339 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:55.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:55.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:55.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:55.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:55.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:55.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:55.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:55.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:55.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:55.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:55.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:55.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:55.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:55.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:55.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:55.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:55.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:55.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:55.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:55.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:55.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:55.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:55.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:25:55.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:25:55.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:25:55.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:25:55.343 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.343 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.343 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.344 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:55.344 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:55.344 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.320645155000001, 2024-04-19T04:25:55.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:25:55.344 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.344 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:55.344 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.344 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.344 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.344 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:55.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.344 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:55.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:55.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:55.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:55.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:55.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:55.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:55.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:55.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:55.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:55.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:55.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:55.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:55.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:55.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:55.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:55.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:55.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:55.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:55.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:55.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:55.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:55.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:55.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:25:55.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:25:55.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:25:55.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:25:55.350 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.350 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.350 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.350 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:55.350 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:55.350 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.320519402000002, 2024-04-19T04:25:55.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:25:55.350 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.350 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:55.350 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.351 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.351 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.351 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:55.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.351 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:55.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:55.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:55.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:55.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:55.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:55.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:55.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:55.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:55.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:55.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:55.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:55.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:55.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:55.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:55.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:55.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:55.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:55.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:55.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:55.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:55.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:55.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:25:55.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:25:55.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:25:55.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:25:55.355 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.355 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.356 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.356 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:55.356 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:55.356 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.316675457000002, 2024-04-19T04:25:55.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:25:55.356 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.356 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.356 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.356 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.356 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.356 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:55.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.357 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:55.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:55.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:55.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:55.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:55.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:55.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:55.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:55.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:55.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:55.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:55.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:55.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:55.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:55.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:55.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:25:55.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:25:55.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:55.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:25:55.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:25:55.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:55.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:25:55.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:25:55.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:55.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:25:55.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:25:55.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:25:55.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:25:55.361 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.361 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.361 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.362 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:55.362 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:55.362 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.309504355999998, 2024-04-19T04:25:55.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:25:55.362 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.362 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:55.362 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.362 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.362 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.362 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:55.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.362 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:55.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:55.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:55.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:55.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:55.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:55.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:55.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:55.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:55.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:55.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:55.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:55.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:55.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:55.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:55.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:25:55.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:25:55.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:25:55.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:25:55.366 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.366 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.366 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.366 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:55.366 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:55.366 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.309332251999997, 2024-04-19T04:25:55.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:25:55.366 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.366 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:55.366 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.366 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.367 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.367 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:55.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.367 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:55.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:55.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:55.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:55.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:55.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:55.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:55.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:55.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:55.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:55.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:55.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:55.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:55.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:55.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:55.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:25:55.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:25:55.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:25:55.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:25:55.371 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.371 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.371 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.371 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:55.371 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:55.371 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.309269127, 2024-04-19T04:25:55.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:25:55.371 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.371 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.371 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.371 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.371 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.372 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:55.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.372 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:55.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:55.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:55.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:55.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:55.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:55.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:55.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:55.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:55.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:55.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:55.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:55.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:55.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:55.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:55.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:25:55.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:25:55.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:55.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:25:55.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:25:55.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:55.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:25:55.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:25:55.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:55.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:25:55.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:25:55.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:25:55.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:25:55.376 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.376 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.376 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.376 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:55.376 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:55.377 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.309140530000001, 2024-04-19T04:25:55.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:25:55.377 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.377 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.377 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.377 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.377 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.377 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:55.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.377 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:55.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:55.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:55.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:55.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:55.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:55.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:55.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:55.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:55.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:55.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:55.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:55.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:55.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:55.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:55.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:25:55.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:25:55.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:55.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:25:55.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:25:55.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:55.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:25:55.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:25:55.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:55.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:25:55.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:25:55.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:25:55.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:25:55.382 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.382 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.382 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.382 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:55.383 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:55.383 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.309072559000001, 2024-04-19T04:25:55.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:25:55.383 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.383 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.383 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.383 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.383 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.383 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:55.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.383 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:55.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:55.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:55.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:55.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:55.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:55.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:55.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:55.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:55.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:55.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:55.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:55.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:55.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:55.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:55.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:25:55.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:25:55.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:55.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:25:55.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:25:55.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:55.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:25:55.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:25:55.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:55.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:25:55.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:25:55.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:25:55.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:25:55.388 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.388 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.388 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.388 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:111654 5.0 5:0b6b473d:::benchmark_data_smithi007_19526_object111653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:55.388 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:55.388 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.361281453, 2024-04-19T04:25:55.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023122753999999999, 2024-04-19T04:25:55.389 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:55.389 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.389 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:55.389 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:55.389 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.389 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 111654 2024-04-19T04:25:55.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.389 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:55.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:55.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:55.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:55.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:55.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:55.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:55.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915865+0000", 2024-04-19T04:25:55.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:55.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:55.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915897+0000", 2024-04-19T04:25:55.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1708999999999997e-05 2024-04-19T04:25:55.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:55.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915905+0000", 2024-04-19T04:25:55.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.481e-06 2024-04-19T04:25:55.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915911+0000", 2024-04-19T04:25:55.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6880000000000002e-06 2024-04-19T04:25:55.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:55.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925564+0000", 2024-04-19T04:25:55.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096527039999999998 2024-04-19T04:25:55.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:55.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925771+0000", 2024-04-19T04:25:55.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020717199999999999 2024-04-19T04:25:55.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:55.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938888+0000", 2024-04-19T04:25:55.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013117105 2024-04-19T04:25:55.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:55.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938931+0000", 2024-04-19T04:25:55.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2447000000000002e-05 2024-04-19T04:25:55.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:55.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:55.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:55.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938989+0000", 2024-04-19T04:25:55.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7997000000000001e-05 2024-04-19T04:25:55.393 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.393 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.393 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.393 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:55.393 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:55.393 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:55.395 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:55.393+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:55.395 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:55.495 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:55.493+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:55.528 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:55.528 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:55.528 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.528 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:151601 5.5 5:ad577862:::benchmark_data_smithi007_19526_object25867:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:55.528 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:55.522856+0000", 2024-04-19T04:25:55.528 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0052775119999999998, 2024-04-19T04:25:55.528 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0053036760000000002, 2024-04-19T04:25:55.528 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.529 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:55.529 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.529 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.529 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.529 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 151601 2024-04-19T04:25:55.529 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.529 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.529 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.529 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.529 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.522856+0000", 2024-04-19T04:25:55.529 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.529 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.529 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.529 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.530 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.522856+0000", 2024-04-19T04:25:55.530 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.530 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.530 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.530 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.530 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.522856+0000", 2024-04-19T04:25:55.530 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:55.530 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.530 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.530 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.530 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.522859+0000", 2024-04-19T04:25:55.530 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1980000000000001e-06 2024-04-19T04:25:55.530 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.531 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.531 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.531 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.522876+0000", 2024-04-19T04:25:55.531 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7051999999999999e-05 2024-04-19T04:25:55.531 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.531 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.531 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.531 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.522882+0000", 2024-04-19T04:25:55.531 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4240000000000001e-06 2024-04-19T04:25:55.531 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.531 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.531 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.531 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525128+0000", 2024-04-19T04:25:55.531 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002246573 2024-04-19T04:25:55.532 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.532 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.532 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.532 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525197+0000", 2024-04-19T04:25:55.532 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8980999999999996e-05 2024-04-19T04:25:55.532 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.532 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.532 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.533 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.533 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.533 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:151602 5.f 5:f93415d9:::benchmark_data_smithi007_19526_object25868:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:55.533 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:55.524920+0000", 2024-04-19T04:25:55.533 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.003214167, 2024-04-19T04:25:55.533 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0033139269999999999, 2024-04-19T04:25:55.533 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.533 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:55.533 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.533 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.533 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.533 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 151602 2024-04-19T04:25:55.533 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.533 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.534 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.534 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.534 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.524920+0000", 2024-04-19T04:25:55.534 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.534 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.534 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.534 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.534 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.524920+0000", 2024-04-19T04:25:55.534 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.534 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.534 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.534 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.534 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.524919+0000", 2024-04-19T04:25:55.534 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.535 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.535 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.535 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.535 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.524925+0000", 2024-04-19T04:25:55.535 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1689999999999997e-06 2024-04-19T04:25:55.535 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.535 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.535 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.535 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.524941+0000", 2024-04-19T04:25:55.535 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6191000000000001e-05 2024-04-19T04:25:55.535 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.535 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.535 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.535 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.524950+0000", 2024-04-19T04:25:55.536 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0990000000000005e-06 2024-04-19T04:25:55.536 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.536 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.536 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.536 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525032+0000", 2024-04-19T04:25:55.536 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1763999999999998e-05 2024-04-19T04:25:55.536 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.536 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.536 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.536 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525166+0000", 2024-04-19T04:25:55.536 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000134361 2024-04-19T04:25:55.536 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.536 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.536 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:55.536 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525249+0000", 2024-04-19T04:25:55.537 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2342999999999994e-05 2024-04-19T04:25:55.537 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.537 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.537 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:55.537 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527197+0000", 2024-04-19T04:25:55.537 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0019487129999999999 2024-04-19T04:25:55.537 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.537 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.537 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.537 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.537 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.537 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:151604 5.c 5:3adcea2a:::benchmark_data_smithi007_19526_object25870:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:55.537 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:55.525249+0000", 2024-04-19T04:25:55.537 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.002885135, 2024-04-19T04:25:55.538 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0030591260000000001, 2024-04-19T04:25:55.538 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.538 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:55.538 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.538 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.538 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.538 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 151604 2024-04-19T04:25:55.538 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.538 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.538 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.538 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.538 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525249+0000", 2024-04-19T04:25:55.538 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.538 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.539 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.539 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.539 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525249+0000", 2024-04-19T04:25:55.539 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.539 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.539 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.539 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.539 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525248+0000", 2024-04-19T04:25:55.539 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.539 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.539 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.539 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.539 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525254+0000", 2024-04-19T04:25:55.539 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.066e-06 2024-04-19T04:25:55.539 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.540 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.540 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.540 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525271+0000", 2024-04-19T04:25:55.540 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7654000000000001e-05 2024-04-19T04:25:55.540 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.540 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.540 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.540 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525281+0000", 2024-04-19T04:25:55.540 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.4579999999999999e-06 2024-04-19T04:25:55.540 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.540 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.540 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.540 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525323+0000", 2024-04-19T04:25:55.540 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2469000000000003e-05 2024-04-19T04:25:55.540 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.541 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.541 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.541 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525480+0000", 2024-04-19T04:25:55.541 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000156694 2024-04-19T04:25:55.541 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.541 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.541 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.541 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.541 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.541 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:151607 5.5 5:ae731c53:::benchmark_data_smithi007_19526_object25873:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:55.541 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:55.525306+0000", 2024-04-19T04:25:55.541 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0028273539999999998, 2024-04-19T04:25:55.541 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0030605989999999998, 2024-04-19T04:25:55.541 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.541 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:55.542 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.542 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.542 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.542 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 151607 2024-04-19T04:25:55.542 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.542 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.542 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.542 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.542 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525306+0000", 2024-04-19T04:25:55.542 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.542 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.542 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.542 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.543 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525306+0000", 2024-04-19T04:25:55.543 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.543 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.543 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.543 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.543 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525306+0000", 2024-04-19T04:25:55.543 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:55.543 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.543 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.543 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.543 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525313+0000", 2024-04-19T04:25:55.543 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7100000000000007e-06 2024-04-19T04:25:55.543 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.543 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.543 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.544 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525322+0000", 2024-04-19T04:25:55.544 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7539999999999995e-06 2024-04-19T04:25:55.544 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.544 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.544 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.544 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525329+0000", 2024-04-19T04:25:55.544 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.28e-06 2024-04-19T04:25:55.544 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.544 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.544 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.544 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527452+0000", 2024-04-19T04:25:55.544 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0021235960000000002 2024-04-19T04:25:55.544 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.544 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.545 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.545 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527573+0000", 2024-04-19T04:25:55.545 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012044699999999999 2024-04-19T04:25:55.545 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.545 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.545 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.545 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.545 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.545 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:151610 5.1 5:8ed7dece:::benchmark_data_smithi007_19526_object25876:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:55.545 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:55.527727+0000", 2024-04-19T04:25:55.545 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00040726199999999998, 2024-04-19T04:25:55.545 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00070123799999999997, 2024-04-19T04:25:55.545 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.545 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:55.545 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.546 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.546 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.546 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 151610 2024-04-19T04:25:55.546 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.546 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.546 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.546 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.546 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527727+0000", 2024-04-19T04:25:55.546 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.546 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.546 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.546 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.546 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527727+0000", 2024-04-19T04:25:55.546 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.547 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.547 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.547 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.547 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527726+0000", 2024-04-19T04:25:55.547 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.547 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.547 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.547 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.547 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527731+0000", 2024-04-19T04:25:55.547 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0470000000000001e-06 2024-04-19T04:25:55.547 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.547 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.547 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.547 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527740+0000", 2024-04-19T04:25:55.548 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.8689999999999993e-06 2024-04-19T04:25:55.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.548 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.548 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.548 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527748+0000", 2024-04-19T04:25:55.548 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9070000000000007e-06 2024-04-19T04:25:55.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.548 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.548 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.548 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527837+0000", 2024-04-19T04:25:55.548 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9256000000000001e-05 2024-04-19T04:25:55.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.548 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.548 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.549 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527988+0000", 2024-04-19T04:25:55.549 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015080900000000001 2024-04-19T04:25:55.549 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.549 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.549 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.549 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.549 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.549 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:151612 5.c 5:3495cd01:::benchmark_data_smithi007_19526_object25878:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:55.549 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:55.527791+0000", 2024-04-19T04:25:55.549 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00034265599999999999, 2024-04-19T04:25:55.549 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00069492700000000002, 2024-04-19T04:25:55.549 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.549 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:55.549 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.549 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.550 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.550 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 151612 2024-04-19T04:25:55.550 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.550 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.550 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.550 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.550 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527791+0000", 2024-04-19T04:25:55.550 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.550 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.550 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.550 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.550 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527791+0000", 2024-04-19T04:25:55.550 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.550 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.551 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.551 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.551 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527790+0000", 2024-04-19T04:25:55.551 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.551 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.551 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.551 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.551 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527796+0000", 2024-04-19T04:25:55.551 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1909999999999999e-06 2024-04-19T04:25:55.551 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.551 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.551 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.551 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527814+0000", 2024-04-19T04:25:55.551 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8882e-05 2024-04-19T04:25:55.552 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.552 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.552 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.552 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527821+0000", 2024-04-19T04:25:55.552 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6579999999999996e-06 2024-04-19T04:25:55.552 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.552 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.552 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.552 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527865+0000", 2024-04-19T04:25:55.552 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3791000000000001e-05 2024-04-19T04:25:55.552 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.552 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.552 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.552 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.528001+0000", 2024-04-19T04:25:55.552 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013617999999999999 2024-04-19T04:25:55.553 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.553 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.553 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.553 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.553 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.553 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:151613 5.3 5:c3e5d021:::benchmark_data_smithi007_19526_object25879:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:55.553 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:55.527836+0000", 2024-04-19T04:25:55.553 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00029803000000000002, 2024-04-19T04:25:55.553 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00070835199999999998, 2024-04-19T04:25:55.553 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.553 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:55.553 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.553 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.553 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.553 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 151613 2024-04-19T04:25:55.554 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.554 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.554 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.554 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.554 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527836+0000", 2024-04-19T04:25:55.554 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.554 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.554 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.554 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.554 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527836+0000", 2024-04-19T04:25:55.554 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.554 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.554 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.554 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.555 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527835+0000", 2024-04-19T04:25:55.555 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:55.555 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.555 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.555 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.555 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527839+0000", 2024-04-19T04:25:55.555 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5549999999999998e-06 2024-04-19T04:25:55.555 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.555 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.555 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.555 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527845+0000", 2024-04-19T04:25:55.555 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.421e-06 2024-04-19T04:25:55.555 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.555 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.556 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.556 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527850+0000", 2024-04-19T04:25:55.556 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9980000000000003e-06 2024-04-19T04:25:55.556 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.556 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.556 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.556 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527903+0000", 2024-04-19T04:25:55.556 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3059000000000001e-05 2024-04-19T04:25:55.556 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.556 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.556 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.556 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.528035+0000", 2024-04-19T04:25:55.556 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013155299999999999 2024-04-19T04:25:55.556 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.556 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.557 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.557 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.557 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.557 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:151614 5.6 5:6689406d:::benchmark_data_smithi007_19526_object25880:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:55.557 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:55.527942+0000", 2024-04-19T04:25:55.557 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00019162899999999999, 2024-04-19T04:25:55.557 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00066230599999999998, 2024-04-19T04:25:55.557 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.557 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:55.557 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.557 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.557 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.557 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 151614 2024-04-19T04:25:55.557 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.558 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.558 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.558 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.558 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527942+0000", 2024-04-19T04:25:55.558 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.558 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.558 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.558 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.558 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527942+0000", 2024-04-19T04:25:55.558 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.558 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.558 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.558 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.558 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527942+0000", 2024-04-19T04:25:55.559 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:55.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.559 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.559 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.559 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527946+0000", 2024-04-19T04:25:55.559 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5600000000000004e-06 2024-04-19T04:25:55.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.559 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.559 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.559 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527954+0000", 2024-04-19T04:25:55.559 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2230000000000007e-06 2024-04-19T04:25:55.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.559 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.559 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.560 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527960+0000", 2024-04-19T04:25:55.560 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.857e-06 2024-04-19T04:25:55.560 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.560 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.560 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.560 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527998+0000", 2024-04-19T04:25:55.560 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7653e-05 2024-04-19T04:25:55.560 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.560 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.560 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.560 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.528124+0000", 2024-04-19T04:25:55.560 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012611 2024-04-19T04:25:55.560 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.560 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.560 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.561 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.561 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.561 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:151615 5.3 5.5b1bb0c3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:55.561 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:55.527973+0000", 2024-04-19T04:25:55.561 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00016035499999999999, 2024-04-19T04:25:55.561 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00068705999999999997, 2024-04-19T04:25:55.561 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.561 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:55.561 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.561 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.561 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.561 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 151615 2024-04-19T04:25:55.561 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.561 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.562 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.562 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527973+0000", 2024-04-19T04:25:55.562 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.562 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.562 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.562 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527973+0000", 2024-04-19T04:25:55.562 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.562 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.562 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.562 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527973+0000", 2024-04-19T04:25:55.562 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:55.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527976+0000", 2024-04-19T04:25:55.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.785e-06 2024-04-19T04:25:55.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527981+0000", 2024-04-19T04:25:55.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:55.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.527986+0000", 2024-04-19T04:25:55.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9350000000000002e-06 2024-04-19T04:25:55.564 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.564 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.564 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.564 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.564 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:151594 5.d 5:b73c220e:::benchmark_data_smithi007_19526_object25860:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:55.564 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:55.520761+0000", 2024-04-19T04:25:55.564 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0073732670000000002, 2024-04-19T04:25:55.564 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0079500809999999995, 2024-04-19T04:25:55.564 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.564 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:55.564 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.564 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.564 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.565 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 151594 2024-04-19T04:25:55.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.565 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.565 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.565 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.520761+0000", 2024-04-19T04:25:55.565 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.565 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.565 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.520761+0000", 2024-04-19T04:25:55.565 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.566 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.566 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.520760+0000", 2024-04-19T04:25:55.566 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.566 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.566 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.566 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.520764+0000", 2024-04-19T04:25:55.566 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6380000000000003e-06 2024-04-19T04:25:55.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.566 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.566 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.566 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.520774+0000", 2024-04-19T04:25:55.566 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2639999999999997e-06 2024-04-19T04:25:55.567 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.567 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.567 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.567 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.520780+0000", 2024-04-19T04:25:55.567 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3799999999999999e-06 2024-04-19T04:25:55.567 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.567 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.567 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.567 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.520814+0000", 2024-04-19T04:25:55.567 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4572e-05 2024-04-19T04:25:55.567 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.567 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.567 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.567 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.520931+0000", 2024-04-19T04:25:55.568 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000116056 2024-04-19T04:25:55.568 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.568 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.568 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:55.568 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.521030+0000", 2024-04-19T04:25:55.568 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9071000000000001e-05 2024-04-19T04:25:55.568 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.568 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.568 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:55.568 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:55.525152+0000", 2024-04-19T04:25:55.568 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0041228740000000003 2024-04-19T04:25:55.568 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.568 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.568 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.568 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.569 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:55.569 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 10 2024-04-19T04:25:55.569 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:55.570 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:55.596 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:55.597+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:55.697 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:55.697+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:55.703 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:55.703 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:55.703 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:55.703 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:55.703 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:55.716 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:55.800 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:55.797+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:55.885 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:55.885 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:55.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:55.886 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:55.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.886 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:55.886 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:55.886 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.652195184, 2024-04-19T04:25:55.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:55.886 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.886 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.886 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.886 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.886 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.886 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:55.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.887 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:55.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:55.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:55.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:55.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:55.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:55.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:55.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:55.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:55.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:55.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:55.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:55.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:55.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:55.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:55.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:55.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:55.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:55.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:55.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:55.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:55.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:55.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:55.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:55.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:55.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:55.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:55.892 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.892 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.892 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.892 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:55.892 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:55.893 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.649014028000003, 2024-04-19T04:25:55.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:55.893 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.893 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.893 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.893 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.893 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.893 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:55.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.893 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.893 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.893 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:55.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:55.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:55.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:55.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:55.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:55.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:55.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:55.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:55.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:55.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:55.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:55.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:55.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:55.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:55.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:55.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:55.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:55.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:55.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:55.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:55.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:55.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:55.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:55.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:55.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.898 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.898 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:55.898 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:55.898 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.898 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.898 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.898 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:55.898 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:55.898 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.648445924000001, 2024-04-19T04:25:55.898 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:55.898 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.898 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.899 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:55.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:55.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:55.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:55.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:55.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:55.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:55.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:55.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:55.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:55.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:55.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:55.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:55.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:55.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:55.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:55.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:55.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:55.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:55.902 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.903 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.903 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.903 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:55.903 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:55.903 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.648100263000003, 2024-04-19T04:25:55.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:55.903 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.903 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.903 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.903 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.903 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.903 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:55.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.904 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.904 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:55.904 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.904 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:55.904 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.904 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:55.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:55.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:55.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:55.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:55.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:55.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:55.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:55.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:55.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:55.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:55.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:55.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:55.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:55.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:55.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:55.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:55.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:55.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:55.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:55.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:55.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:55.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:55.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:55.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:55.908 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.908 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.908 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.908 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:55.909 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:55.909 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.647375824999997, 2024-04-19T04:25:55.909 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:55.909 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.909 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.909 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.909 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.909 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:55.909 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.909 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:55.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:55.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:55.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:55.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:55.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:55.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:55.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:55.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:55.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:55.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:55.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:55.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:55.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:55.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:55.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:55.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:55.913 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.913 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.913 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.913 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:55.913 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:55.913 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.64736843, 2024-04-19T04:25:55.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:55.913 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.914 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.914 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:55.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:55.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:55.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:55.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:55.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:55.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:55.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:55.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:55.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:55.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:55.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:55.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:55.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:55.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:55.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:55.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:55.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:55.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:55.917 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.918 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.918 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.918 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:55.918 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:55.918 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.645543283000002, 2024-04-19T04:25:55.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:55.918 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.919 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.919 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.919 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.919 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.919 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:55.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.919 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:55.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.920 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:55.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.920 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:55.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.920 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:55.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:55.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:55.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:55.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:55.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:55.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:55.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:55.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:55.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:55.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:55.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:55.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:55.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:55.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:55.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:55.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:55.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:55.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:55.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:55.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:55.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:55.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:55.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:55.924 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.924 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.924 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.924 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:55.924 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:55.924 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.644809078000002, 2024-04-19T04:25:55.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:55.924 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.924 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.924 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.925 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.925 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.925 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:55.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.925 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:55.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:55.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.926 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.926 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:55.926 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.926 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.926 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:55.926 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:55.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.926 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.926 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:55.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:55.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:55.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:55.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:55.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:55.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:55.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:55.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:55.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:55.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:55.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:55.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:55.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:55.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:55.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:55.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:55.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:55.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:55.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:55.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:55.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:55.930 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.930 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.930 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.930 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:55.930 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:55.930 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.644274801999998, 2024-04-19T04:25:55.930 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:55.930 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.930 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.930 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:55.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:55.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:55.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.932 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.932 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:55.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:55.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.932 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.932 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:55.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:55.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.932 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.932 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:55.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:55.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.933 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:55.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:55.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.933 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:55.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:55.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:55.934 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:55.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:55.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.934 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.934 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:55.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:55.934 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.934 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.934 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.934 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:55.934 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:55.935 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.927419612999998, 2024-04-19T04:25:55.935 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:55.935 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.935 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:55.935 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.935 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.935 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.935 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:55.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.935 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.936 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.936 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.936 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:55.936 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.936 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.936 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.936 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.936 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:55.936 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.936 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.937 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.937 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.937 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:55.937 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:55.937 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.937 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.937 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.937 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:55.937 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:55.937 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.937 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.937 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.937 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:55.938 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:55.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.938 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.938 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.938 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:55.938 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:55.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.938 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.938 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.939 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:55.939 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:55.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.939 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.939 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.939 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:55.940 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:55.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.940 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:55.940 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:55.940 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:55.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.940 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:55.940 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:55.940 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:55.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.941 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.941 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:55.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:55.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.941 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.941 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:55.941 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:55.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:55.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.941 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.941 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.941 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:55.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:55.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.941 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.942 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.942 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:55.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:55.942 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.942 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.942 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.942 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.942 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:55.942 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:55.942 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.907189164000002, 2024-04-19T04:25:55.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:55.942 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.942 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:55.943 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.943 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.943 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.943 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:55.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.943 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:55.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:55.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.944 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:55.944 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:55.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.944 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:55.944 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:55.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.945 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:55.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:55.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.945 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:55.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:55.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.945 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:55.946 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:55.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:55.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:55.946 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:55.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:55.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:55.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.947 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.947 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.947 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:55.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:55.947 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.947 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.947 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.947 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.947 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:55.947 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:55.948 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.907081306999999, 2024-04-19T04:25:55.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:55.948 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.948 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:55.948 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.948 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.948 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.948 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:55.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.948 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:55.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:55.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:55.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:55.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:55.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:55.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:55.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:55.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:55.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:55.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:55.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:55.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:55.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:55.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:55.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.952 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:55.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:55.952 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.952 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.952 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.952 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:55.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:55.952 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.952 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.952 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.952 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.952 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.952 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:55.952 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:55.953 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.905114617999999, 2024-04-19T04:25:55.953 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:55.953 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.953 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.953 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.953 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.953 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.953 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:55.953 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.953 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.953 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.953 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.953 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:55.953 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.954 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.954 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.954 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:55.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.954 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.954 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.954 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:55.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:55.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.954 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.954 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.954 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:55.955 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:55.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.955 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.955 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:55.955 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:55.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.955 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:55.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:55.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:55.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:55.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:55.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:55.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:55.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:55.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:55.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:55.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:55.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:55.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:55.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:55.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:55.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:55.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:55.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:55.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:55.958 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.958 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.959 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.959 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.959 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:55.959 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:55.959 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.901750423000003, 2024-04-19T04:25:55.959 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:55.959 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.959 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.959 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.959 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.959 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.959 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:55.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.960 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.960 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.960 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:55.960 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.960 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.960 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:55.960 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:55.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:55.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:55.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:55.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:55.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:55.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:55.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:55.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:55.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:55.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:55.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:55.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:55.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:55.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:55.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:55.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:55.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:55.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:55.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:55.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:55.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:55.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:55.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:55.964 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.964 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.964 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.965 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:55.965 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:55.965 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.897939444999999, 2024-04-19T04:25:55.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:55.965 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.965 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.965 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.965 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.965 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.965 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:55.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.966 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.966 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.966 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:55.966 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.966 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.966 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.966 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:55.966 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:55.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:55.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:55.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:55.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:55.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:55.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:55.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:55.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:55.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:55.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:55.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:55.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:55.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:55.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:55.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:55.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:55.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:55.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:55.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:55.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:55.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:55.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:55.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:55.970 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.971 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.971 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.971 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93735 5.1 5:8e609d1b:::benchmark_data_smithi007_19526_object93734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:55.971 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:55.971 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.656238801000001, 2024-04-19T04:25:55.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048424842000000003, 2024-04-19T04:25:55.971 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.971 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.971 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.971 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.971 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.971 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93735 2024-04-19T04:25:55.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.972 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:55.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:55.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227480+0000", 2024-04-19T04:25:55.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227533+0000", 2024-04-19T04:25:55.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2964999999999999e-05 2024-04-19T04:25:55.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227542+0000", 2024-04-19T04:25:55.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1449999999999997e-06 2024-04-19T04:25:55.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227561+0000", 2024-04-19T04:25:55.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9116000000000001e-05 2024-04-19T04:25:55.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.974 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.974 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227610+0000", 2024-04-19T04:25:55.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9234000000000003e-05 2024-04-19T04:25:55.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.974 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.974 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227697+0000", 2024-04-19T04:25:55.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6682999999999997e-05 2024-04-19T04:25:55.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.975 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:55.975 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275809+0000", 2024-04-19T04:25:55.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048112265000000001 2024-04-19T04:25:55.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.975 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:55.975 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275845+0000", 2024-04-19T04:25:55.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5275999999999999e-05 2024-04-19T04:25:55.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.975 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.975 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275906+0000", 2024-04-19T04:25:55.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1002999999999999e-05 2024-04-19T04:25:55.976 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.976 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.976 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.976 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93736 5.1 5:852229ec:::benchmark_data_smithi007_19526_object93735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:55.976 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:55.976 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.656134771000001, 2024-04-19T04:25:55.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048414497000000001, 2024-04-19T04:25:55.976 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.976 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.976 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.977 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.977 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.977 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93736 2024-04-19T04:25:55.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.977 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:55.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:55.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.978 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.978 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.978 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227584+0000", 2024-04-19T04:25:55.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:55.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.978 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.978 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.978 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227624+0000", 2024-04-19T04:25:55.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9833000000000003e-05 2024-04-19T04:25:55.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.978 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.978 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.978 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227630+0000", 2024-04-19T04:25:55.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0759999999999999e-06 2024-04-19T04:25:55.979 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.979 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227634+0000", 2024-04-19T04:25:55.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1570000000000002e-06 2024-04-19T04:25:55.979 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.979 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229531+0000", 2024-04-19T04:25:55.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018962339999999999 2024-04-19T04:25:55.979 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.980 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229662+0000", 2024-04-19T04:25:55.980 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013192999999999999 2024-04-19T04:25:55.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.980 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:55.980 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275915+0000", 2024-04-19T04:25:55.980 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046252140999999997 2024-04-19T04:25:55.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.980 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:55.980 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275944+0000", 2024-04-19T04:25:55.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9539999999999998e-05 2024-04-19T04:25:55.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.981 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.981 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275999+0000", 2024-04-19T04:25:55.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5062999999999998e-05 2024-04-19T04:25:55.981 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.981 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.981 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.981 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:55.981 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:55.981 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.656077088, 2024-04-19T04:25:55.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:25:55.982 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.982 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.982 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.982 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.982 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.982 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:25:55.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.982 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.982 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:55.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:55.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:55.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:55.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:25:55.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:25:55.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:25:55.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:25:55.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:25:55.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:25:55.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:25:55.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:25:55.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:25:55.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:25:55.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:55.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:25:55.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:25:55.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:55.986 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:25:55.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:25:55.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.986 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:25:55.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:25:55.986 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.986 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.986 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.986 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:55.986 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:55.987 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.655482807999999, 2024-04-19T04:25:55.987 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:25:55.987 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.987 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.987 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.987 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.987 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.987 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:25:55.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.987 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.987 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.987 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:55.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:55.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:25:55.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.989 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.989 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:25:55.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:25:55.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.989 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.989 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:25:55.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:25:55.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.989 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:25:55.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:25:55.990 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:25:55.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:25:55.990 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:25:55.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:25:55.990 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:55.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:25:55.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:25:55.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:55.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:25:55.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:25:55.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:55.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:25:55.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:25:55.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:55.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:25:55.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:25:55.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.992 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.992 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:25:55.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:25:55.992 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.992 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.992 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.992 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93744 5.1 5:87b91c25:::benchmark_data_smithi007_19526_object93743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.651813257000001, 2024-04-19T04:25:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044295022000000003, 2024-04-19T04:25:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93744 2024-04-19T04:25:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231905+0000", 2024-04-19T04:25:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231935+0000", 2024-04-19T04:25:55.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9442e-05 2024-04-19T04:25:55.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.995 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:55.995 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264224+0000", 2024-04-19T04:25:55.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.032288836000000001 2024-04-19T04:25:55.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.995 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:55.995 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264238+0000", 2024-04-19T04:25:55.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4494999999999999e-05 2024-04-19T04:25:55.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.995 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:55.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268311+0000", 2024-04-19T04:25:55.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040726629999999998 2024-04-19T04:25:55.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:55.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268587+0000", 2024-04-19T04:25:55.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00027623200000000001 2024-04-19T04:25:55.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:55.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276099+0000", 2024-04-19T04:25:55.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075116180000000003 2024-04-19T04:25:55.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:55.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276123+0000", 2024-04-19T04:25:55.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4675e-05 2024-04-19T04:25:55.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:55.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:55.997 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:55.997 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276201+0000", 2024-04-19T04:25:55.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7836000000000005e-05 2024-04-19T04:25:55.997 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.997 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.997 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.998 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:55.998 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:55.998 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:55.999 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:55.997+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:56.000 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:56.100 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:56.097+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:56.122 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:56.122 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:56.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.122 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:153078 5.4 5:2501ead7:::benchmark_data_smithi007_19526_object27344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:56.122 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:56.120620+0000", 2024-04-19T04:25:56.122 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0019225970000000001, 2024-04-19T04:25:56.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001941134, 2024-04-19T04:25:56.122 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.123 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:56.123 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.123 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.123 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.123 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 153078 2024-04-19T04:25:56.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.123 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120620+0000", 2024-04-19T04:25:56.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120620+0000", 2024-04-19T04:25:56.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120619+0000", 2024-04-19T04:25:56.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:56.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120624+0000", 2024-04-19T04:25:56.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5000000000000001e-06 2024-04-19T04:25:56.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120632+0000", 2024-04-19T04:25:56.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8429999999999999e-06 2024-04-19T04:25:56.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120639+0000", 2024-04-19T04:25:56.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5989999999999998e-06 2024-04-19T04:25:56.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.122356+0000", 2024-04-19T04:25:56.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001717115 2024-04-19T04:25:56.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.122474+0000", 2024-04-19T04:25:56.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117909 2024-04-19T04:25:56.126 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.126 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.127 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.127 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:153074 5.9 e52/20 5:9372d881:::benchmark_data_smithi007_19526_object27340:head v 52'9802, mlcod=52'9800)", 2024-04-19T04:25:56.127 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:56.120762+0000", 2024-04-19T04:25:56.127 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001780631, 2024-04-19T04:25:56.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0018474310000000001, 2024-04-19T04:25:56.127 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.127 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:56.127 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120762+0000", 2024-04-19T04:25:56.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120762+0000", 2024-04-19T04:25:56.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120761+0000", 2024-04-19T04:25:56.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:56.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120772+0000", 2024-04-19T04:25:56.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1174e-05 2024-04-19T04:25:56.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120782+0000", 2024-04-19T04:25:56.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6840000000000008e-06 2024-04-19T04:25:56.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120789+0000", 2024-04-19T04:25:56.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9519999999999997e-06 2024-04-19T04:25:56.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120835+0000", 2024-04-19T04:25:56.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6208999999999998e-05 2024-04-19T04:25:56.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120855+0000", 2024-04-19T04:25:56.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9780999999999999e-05 2024-04-19T04:25:56.130 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.130 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.130 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.130 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:153083 5.b 5:d12f54ec:::benchmark_data_smithi007_19526_object27349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:56.131 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:56.121487+0000", 2024-04-19T04:25:56.131 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0010556859999999999, 2024-04-19T04:25:56.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0011609809999999999, 2024-04-19T04:25:56.131 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.131 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:56.131 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.131 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.131 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.131 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 153083 2024-04-19T04:25:56.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.131 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.121487+0000", 2024-04-19T04:25:56.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.121487+0000", 2024-04-19T04:25:56.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.121486+0000", 2024-04-19T04:25:56.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:56.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.121492+0000", 2024-04-19T04:25:56.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.558e-06 2024-04-19T04:25:56.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.121501+0000", 2024-04-19T04:25:56.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8819999999999996e-06 2024-04-19T04:25:56.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.121510+0000", 2024-04-19T04:25:56.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2239999999999995e-06 2024-04-19T04:25:56.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.121559+0000", 2024-04-19T04:25:56.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9218999999999998e-05 2024-04-19T04:25:56.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.121683+0000", 2024-04-19T04:25:56.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012442 2024-04-19T04:25:56.135 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.135 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.135 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.136 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:153084 5.a 5:5924a035:::benchmark_data_smithi007_19526_object27350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:56.136 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:56.121640+0000", 2024-04-19T04:25:56.136 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00090256799999999997, 2024-04-19T04:25:56.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010485469999999999, 2024-04-19T04:25:56.136 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.136 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:56.136 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.136 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.136 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.136 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 153084 2024-04-19T04:25:56.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.136 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.121640+0000", 2024-04-19T04:25:56.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.121640+0000", 2024-04-19T04:25:56.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.121639+0000", 2024-04-19T04:25:56.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:56.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.121643+0000", 2024-04-19T04:25:56.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9700000000000001e-06 2024-04-19T04:25:56.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.121649+0000", 2024-04-19T04:25:56.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4700000000000001e-06 2024-04-19T04:25:56.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.121652+0000", 2024-04-19T04:25:56.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.72e-06 2024-04-19T04:25:56.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.121692+0000", 2024-04-19T04:25:56.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9424000000000001e-05 2024-04-19T04:25:56.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.121803+0000", 2024-04-19T04:25:56.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110901 2024-04-19T04:25:56.139 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.139 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.139 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.140 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:153086 5.0 5:010186ff:::benchmark_data_smithi007_19526_object27352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:56.140 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:56.122485+0000", 2024-04-19T04:25:56.140 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.7935e-05, 2024-04-19T04:25:56.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00024674300000000001, 2024-04-19T04:25:56.140 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.140 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:56.140 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.140 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.140 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.140 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 153086 2024-04-19T04:25:56.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.140 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.122485+0000", 2024-04-19T04:25:56.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.122485+0000", 2024-04-19T04:25:56.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.122483+0000", 2024-04-19T04:25:56.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:56.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.122490+0000", 2024-04-19T04:25:56.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8329999999999996e-06 2024-04-19T04:25:56.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.122500+0000", 2024-04-19T04:25:56.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6930000000000002e-06 2024-04-19T04:25:56.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.122507+0000", 2024-04-19T04:25:56.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.674e-06 2024-04-19T04:25:56.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.122550+0000", 2024-04-19T04:25:56.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3006999999999997e-05 2024-04-19T04:25:56.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.122659+0000", 2024-04-19T04:25:56.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000109851 2024-04-19T04:25:56.143 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.143 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.143 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.143 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:153075 5.4 5:2db17fca:::benchmark_data_smithi007_19526_object27341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:56.143 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:56.120409+0000", 2024-04-19T04:25:56.143 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0021339670000000001, 2024-04-19T04:25:56.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023647, 2024-04-19T04:25:56.144 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.144 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:56.144 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.144 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.144 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.144 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 153075 2024-04-19T04:25:56.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.144 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120409+0000", 2024-04-19T04:25:56.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120409+0000", 2024-04-19T04:25:56.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120408+0000", 2024-04-19T04:25:56.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:56.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120413+0000", 2024-04-19T04:25:56.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5670000000000002e-06 2024-04-19T04:25:56.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120424+0000", 2024-04-19T04:25:56.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0857e-05 2024-04-19T04:25:56.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120430+0000", 2024-04-19T04:25:56.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1600000000000003e-06 2024-04-19T04:25:56.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120475+0000", 2024-04-19T04:25:56.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4647999999999997e-05 2024-04-19T04:25:56.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120613+0000", 2024-04-19T04:25:56.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000137842 2024-04-19T04:25:56.147 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.148 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.148 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.148 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:153076 5.8 5:1b7adedc:::benchmark_data_smithi007_19526_object27342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:56.148 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:56.120494+0000", 2024-04-19T04:25:56.148 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0020481369999999998, 2024-04-19T04:25:56.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023210240000000001, 2024-04-19T04:25:56.148 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.148 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:56.148 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.148 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.148 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.148 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 153076 2024-04-19T04:25:56.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.149 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120494+0000", 2024-04-19T04:25:56.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120494+0000", 2024-04-19T04:25:56.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120493+0000", 2024-04-19T04:25:56.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:56.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120500+0000", 2024-04-19T04:25:56.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3570000000000003e-06 2024-04-19T04:25:56.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120511+0000", 2024-04-19T04:25:56.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1245e-05 2024-04-19T04:25:56.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120519+0000", 2024-04-19T04:25:56.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0989999999999999e-06 2024-04-19T04:25:56.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120577+0000", 2024-04-19T04:25:56.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8575000000000001e-05 2024-04-19T04:25:56.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:56.120654+0000", 2024-04-19T04:25:56.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6620999999999997e-05 2024-04-19T04:25:56.151 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.151 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.151 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.151 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.151 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:56.151 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 7 2024-04-19T04:25:56.152 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:56.153 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:56.201 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:56.197+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:56.281 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:56.281 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:25:56.281 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:25:56.281 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:25:56.281 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:56.294 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:56.302 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:56.301+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:56.403 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:56.401+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:56.420 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:56.420 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:25:56.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:25:56.420 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:56.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.421 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:56.421 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:56.421 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 62.183429621000002, 2024-04-19T04:25:56.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:25:56.421 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.421 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:56.421 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.421 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.421 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.421 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:25:56.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.421 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:56.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:25:56.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:25:56.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:56.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:25:56.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:25:56.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:25:56.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:25:56.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:25:56.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:25:56.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:25:56.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:25:56.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:25:56.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:25:56.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:56.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:25:56.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:25:56.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:56.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:25:56.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:25:56.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:56.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:25:56.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:25:56.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:56.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:25:56.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:25:56.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:25:56.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:25:56.430 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.430 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.430 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.430 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:56.430 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:56.431 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 62.178980705000001, 2024-04-19T04:25:56.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:25:56.431 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.431 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:56.431 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.431 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.431 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.431 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:25:56.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.431 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:56.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:25:56.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:25:56.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:56.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:25:56.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:25:56.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:25:56.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:25:56.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:25:56.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:25:56.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:25:56.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:25:56.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:25:56.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:25:56.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:25:56.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:25:56.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:25:56.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:56.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:25:56.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:25:56.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:56.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:25:56.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:25:56.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:56.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:25:56.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:25:56.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:25:56.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:25:56.436 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.436 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.436 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.436 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:56.437 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:56.437 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 43.351048462000001, 2024-04-19T04:25:56.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:25:56.437 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.437 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:56.438 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.438 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.438 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.438 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:25:56.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.438 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:56.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:25:56.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:25:56.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:56.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:25:56.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:25:56.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:25:56.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:25:56.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:25:56.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:25:56.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:25:56.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:25:56.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:25:56.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:25:56.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:56.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:25:56.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:25:56.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:56.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:25:56.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:25:56.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:56.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:25:56.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:25:56.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:56.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:25:56.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:25:56.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:25:56.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:25:56.444 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.444 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.444 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.444 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:56.444 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:56.444 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.915194425000003, 2024-04-19T04:25:56.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:25:56.445 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.445 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:56.445 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.445 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.445 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.445 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:25:56.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.445 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:25:56.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:25:56.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:25:56.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:25:56.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:25:56.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:25:56.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:56.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:25:56.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:25:56.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:56.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:25:56.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:25:56.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:56.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:25:56.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:25:56.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:56.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:25:56.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:25:56.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:25:56.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:25:56.451 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.451 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.451 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.451 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:56.451 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:56.452 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.914764005000002, 2024-04-19T04:25:56.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:25:56.452 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.452 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:56.452 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.452 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.452 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.452 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:25:56.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.452 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:56.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:56.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:25:56.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:56.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:25:56.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:25:56.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:25:56.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:25:56.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:25:56.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:56.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:25:56.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:25:56.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:25:56.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:25:56.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:56.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:25:56.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:25:56.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:56.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:25:56.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:25:56.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:56.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:25:56.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:25:56.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:56.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:25:56.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:25:56.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:25:56.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:25:56.458 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.458 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.458 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.458 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:56.458 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:56.458 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.912532741, 2024-04-19T04:25:56.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:25:56.458 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.459 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:56.459 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.459 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.459 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.459 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:25:56.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.459 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:56.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:25:56.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:25:56.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:56.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:25:56.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:25:56.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:25:56.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:25:56.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:25:56.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:25:56.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:25:56.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:25:56.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:25:56.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:25:56.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:56.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:25:56.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:25:56.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:56.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:25:56.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:25:56.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:56.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:25:56.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:25:56.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:56.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:25:56.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:25:56.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:25:56.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:25:56.464 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.464 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.464 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.465 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:56.465 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:56.465 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.909135702999997, 2024-04-19T04:25:56.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:25:56.465 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.465 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:56.465 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.465 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.465 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.465 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:25:56.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.466 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:56.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:25:56.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:25:56.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:56.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:25:56.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:25:56.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:25:56.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:25:56.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:25:56.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:25:56.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:25:56.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:25:56.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:25:56.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:25:56.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:56.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:25:56.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:25:56.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:56.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:25:56.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:25:56.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:56.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:25:56.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:25:56.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:56.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:25:56.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:25:56.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:25:56.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:25:56.471 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.471 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.471 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.471 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:56.472 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:56.472 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.904007505000003, 2024-04-19T04:25:56.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:25:56.472 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.472 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:56.472 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.472 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.472 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.472 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:25:56.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.472 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:56.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:25:56.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:25:56.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:56.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:25:56.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:25:56.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:25:56.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:25:56.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:25:56.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:25:56.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:25:56.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:25:56.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:25:56.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:25:56.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:56.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:25:56.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:25:56.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:56.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:25:56.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:25:56.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:56.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:25:56.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:25:56.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:56.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:25:56.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:25:56.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:25:56.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:25:56.478 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.478 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.478 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.479 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:56.479 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:56.479 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.589979, 2024-04-19T04:25:56.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:25:56.479 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.479 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:56.479 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.479 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.479 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.479 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:25:56.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.479 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:56.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:25:56.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:25:56.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:56.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:25:56.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:25:56.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:25:56.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:25:56.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:25:56.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:25:56.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:25:56.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:25:56.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:25:56.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:25:56.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:56.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:25:56.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:25:56.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:56.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:25:56.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:25:56.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:56.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:25:56.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:25:56.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:56.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:25:56.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:25:56.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:25:56.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:25:56.485 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.485 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.485 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.486 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:56.486 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:56.486 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.467619589999998, 2024-04-19T04:25:56.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:25:56.486 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.486 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:56.486 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.486 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.486 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.486 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:25:56.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.487 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:56.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:25:56.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:25:56.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:25:56.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:25:56.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:25:56.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:25:56.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:25:56.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:25:56.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:25:56.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:25:56.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:25:56.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:25:56.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:25:56.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:56.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:25:56.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:25:56.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:56.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:25:56.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:25:56.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:25:56.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:25:56.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:56.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:25:56.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:25:56.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:25:56.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:25:56.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:25:56.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:25:56.492 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.492 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.493 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.493 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:56.493 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:56.493 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.462557943999997, 2024-04-19T04:25:56.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:25:56.493 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.493 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:56.493 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.493 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.493 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.493 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:25:56.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.494 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:56.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:25:56.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:25:56.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:56.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:25:56.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:25:56.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:25:56.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:25:56.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:25:56.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:25:56.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:25:56.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:25:56.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:25:56.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:25:56.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:56.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:25:56.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:25:56.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:25:56.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:25:56.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:56.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:25:56.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:25:56.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:25:56.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:25:56.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:25:56.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:25:56.499 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.499 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.499 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.500 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:56.500 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:56.500 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.462458032000001, 2024-04-19T04:25:56.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:25:56.500 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.500 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:56.500 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.500 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.500 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.500 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:25:56.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.501 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:56.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:56.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:25:56.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:56.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:25:56.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:25:56.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:25:56.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:25:56.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:25:56.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:25:56.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:25:56.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:25:56.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:25:56.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:25:56.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:56.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:25:56.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:25:56.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:25:56.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:25:56.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:56.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:25:56.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:25:56.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:25:56.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:25:56.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:25:56.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:25:56.506 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.506 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.506 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.507 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:56.507 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:56.507 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.462332279000002, 2024-04-19T04:25:56.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:25:56.507 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.507 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:56.507 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.507 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.507 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.507 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:25:56.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.507 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:56.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:25:56.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:25:56.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:56.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:25:56.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:25:56.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:56.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:25:56.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:25:56.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:25:56.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:25:56.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:25:56.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:25:56.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:25:56.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:56.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:25:56.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:25:56.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:25:56.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:25:56.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:56.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:25:56.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:25:56.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:25:56.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:25:56.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:25:56.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:25:56.513 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.513 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.513 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.513 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:56.514 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:56.514 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.458488334000002, 2024-04-19T04:25:56.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:25:56.514 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.514 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:56.514 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.514 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.514 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.514 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:25:56.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.515 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:56.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:25:56.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:25:56.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:56.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:25:56.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:25:56.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:25:56.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:25:56.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:25:56.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:25:56.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:25:56.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:25:56.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:56.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:25:56.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:25:56.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:25:56.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:25:56.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:25:56.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:25:56.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:56.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:25:56.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:25:56.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:56.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:25:56.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:25:56.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:25:56.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:25:56.520 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.520 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.520 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.521 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:56.521 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:56.521 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.451317232999997, 2024-04-19T04:25:56.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:25:56.521 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.521 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:56.521 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.521 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.521 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.521 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:25:56.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.522 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:56.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:25:56.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:25:56.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:56.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:25:56.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:25:56.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:25:56.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:25:56.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:25:56.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:25:56.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:56.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:25:56.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:56.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:25:56.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:25:56.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:25:56.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:25:56.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:25:56.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:25:56.526 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.526 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.526 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.526 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:56.526 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:56.527 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.451145128999997, 2024-04-19T04:25:56.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:25:56.527 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.527 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:56.527 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.527 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.527 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.527 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:25:56.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.528 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:56.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:56.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:25:56.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:56.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:25:56.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:25:56.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:25:56.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:25:56.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:25:56.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:25:56.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:25:56.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:25:56.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:56.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:25:56.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:25:56.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:25:56.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:25:56.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:25:56.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:25:56.532 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.532 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.532 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.532 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:56.532 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:56.532 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.451082004, 2024-04-19T04:25:56.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:25:56.532 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.532 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:56.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.533 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:25:56.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.533 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:56.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:56.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:25:56.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:56.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:25:56.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:25:56.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:25:56.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:25:56.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:25:56.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:25:56.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:25:56.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:25:56.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:56.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:25:56.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:25:56.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:25:56.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:25:56.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:25:56.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:25:56.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:56.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:25:56.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:25:56.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:56.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:25:56.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:25:56.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:25:56.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:25:56.539 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.539 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.539 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.539 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:56.539 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:56.540 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.450953407, 2024-04-19T04:25:56.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:25:56.540 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.540 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:56.540 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.540 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.540 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.540 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:25:56.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.540 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:56.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:25:56.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:25:56.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:56.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:25:56.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:25:56.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:25:56.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:25:56.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:25:56.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:25:56.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:25:56.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:25:56.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:56.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:25:56.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:25:56.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:25:56.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:25:56.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:25:56.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:25:56.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:56.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:25:56.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:25:56.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:56.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:25:56.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:25:56.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:25:56.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:25:56.546 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.546 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.546 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.546 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:56.547 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:56.547 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.450885436, 2024-04-19T04:25:56.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:25:56.547 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.547 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:56.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.547 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:25:56.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.547 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:56.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:25:56.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:25:56.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:56.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:25:56.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:25:56.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:25:56.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:25:56.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:25:56.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:25:56.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:25:56.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:25:56.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:25:56.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:25:56.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:25:56.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:25:56.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:25:56.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:25:56.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:25:56.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:56.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:25:56.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:25:56.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:56.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:25:56.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:25:56.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:25:56.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:25:56.553 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.553 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.553 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.553 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:111654 5.0 5:0b6b473d:::benchmark_data_smithi007_19526_object111653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:25:56.553 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:56.553 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.50309433, 2024-04-19T04:25:56.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023122753999999999, 2024-04-19T04:25:56.554 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:56.554 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:56.554 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:56.554 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:56.554 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.554 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 111654 2024-04-19T04:25:56.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.554 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:56.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:56.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:56.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:56.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:25:56.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:56.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:56.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915865+0000", 2024-04-19T04:25:56.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:56.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:56.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915897+0000", 2024-04-19T04:25:56.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1708999999999997e-05 2024-04-19T04:25:56.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:56.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915905+0000", 2024-04-19T04:25:56.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.481e-06 2024-04-19T04:25:56.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915911+0000", 2024-04-19T04:25:56.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6880000000000002e-06 2024-04-19T04:25:56.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:56.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925564+0000", 2024-04-19T04:25:56.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096527039999999998 2024-04-19T04:25:56.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:56.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925771+0000", 2024-04-19T04:25:56.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020717199999999999 2024-04-19T04:25:56.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:25:56.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938888+0000", 2024-04-19T04:25:56.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013117105 2024-04-19T04:25:56.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:56.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938931+0000", 2024-04-19T04:25:56.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2447000000000002e-05 2024-04-19T04:25:56.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:56.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:56.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:25:56.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938989+0000", 2024-04-19T04:25:56.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7997000000000001e-05 2024-04-19T04:25:56.558 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.559 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.559 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.559 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:56.559 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:56.559 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:56.560 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:56.561+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:56.561 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:56.662 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:56.661+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:56.695 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:56.695 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:56.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.695 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:154543 5.5 5:afc9f7fc:::benchmark_data_smithi007_19526_object28809:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:56.695 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:56.686608+0000", 2024-04-19T04:25:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0087648840000000006, 2024-04-19T04:25:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0087859930000000006, 2024-04-19T04:25:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 154543 2024-04-19T04:25:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686608+0000", 2024-04-19T04:25:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686608+0000", 2024-04-19T04:25:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686607+0000", 2024-04-19T04:25:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686612+0000", 2024-04-19T04:25:56.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.536e-06 2024-04-19T04:25:56.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.698 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.698 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:56.698 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686626+0000", 2024-04-19T04:25:56.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3777e-05 2024-04-19T04:25:56.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.698 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.698 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.698 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686633+0000", 2024-04-19T04:25:56.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6429999999999998e-06 2024-04-19T04:25:56.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.699 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:56.699 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686681+0000", 2024-04-19T04:25:56.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8717999999999997e-05 2024-04-19T04:25:56.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.699 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:56.699 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686872+0000", 2024-04-19T04:25:56.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000191153 2024-04-19T04:25:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:154545 5.f 5:f1d573a2:::benchmark_data_smithi007_19526_object28811:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:56.686652+0000", 2024-04-19T04:25:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0087204369999999993, 2024-04-19T04:25:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0087895390000000007, 2024-04-19T04:25:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 154545 2024-04-19T04:25:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686652+0000", 2024-04-19T04:25:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686652+0000", 2024-04-19T04:25:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686652+0000", 2024-04-19T04:25:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686655+0000", 2024-04-19T04:25:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1149999999999998e-06 2024-04-19T04:25:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686666+0000", 2024-04-19T04:25:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1304999999999999e-05 2024-04-19T04:25:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686670+0000", 2024-04-19T04:25:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2169999999999996e-06 2024-04-19T04:25:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686724+0000", 2024-04-19T04:25:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.393e-05 2024-04-19T04:25:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686875+0000", 2024-04-19T04:25:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015087799999999999 2024-04-19T04:25:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686984+0000", 2024-04-19T04:25:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109103 2024-04-19T04:25:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.692736+0000", 2024-04-19T04:25:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0057514549999999999 2024-04-19T04:25:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:154546 5.f 5:f43f3fa4:::benchmark_data_smithi007_19526_object28812:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:56.686745+0000", 2024-04-19T04:25:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0086271920000000005, 2024-04-19T04:25:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0087441700000000008, 2024-04-19T04:25:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 154546 2024-04-19T04:25:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686745+0000", 2024-04-19T04:25:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686745+0000", 2024-04-19T04:25:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686745+0000", 2024-04-19T04:25:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686748+0000", 2024-04-19T04:25:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.619e-06 2024-04-19T04:25:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686759+0000", 2024-04-19T04:25:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0995000000000001e-05 2024-04-19T04:25:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686763+0000", 2024-04-19T04:25:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2780000000000004e-06 2024-04-19T04:25:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.689152+0000", 2024-04-19T04:25:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023887489999999999 2024-04-19T04:25:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.689232+0000", 2024-04-19T04:25:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9975000000000006e-05 2024-04-19T04:25:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.689297+0000", 2024-04-19T04:25:56.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4509000000000002e-05 2024-04-19T04:25:56.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.709 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.709 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:56.709 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.694692+0000", 2024-04-19T04:25:56.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0053951829999999996 2024-04-19T04:25:56.709 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.709 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:56.709 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.709 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.710 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:154547 5.9 5:91f6c11e:::benchmark_data_smithi007_19526_object28813:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:56.710 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:56.686972+0000", 2024-04-19T04:25:56.710 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.008400233, 2024-04-19T04:25:56.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0085642429999999992, 2024-04-19T04:25:56.710 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:56.710 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:56.710 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:56.710 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:56.710 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.710 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 154547 2024-04-19T04:25:56.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.711 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:56.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:56.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686972+0000", 2024-04-19T04:25:56.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:56.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686972+0000", 2024-04-19T04:25:56.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:56.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686971+0000", 2024-04-19T04:25:56.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:56.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:56.712 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686979+0000", 2024-04-19T04:25:56.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5950000000000001e-06 2024-04-19T04:25:56.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:56.712 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686987+0000", 2024-04-19T04:25:56.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5760000000000006e-06 2024-04-19T04:25:56.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.713 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.686994+0000", 2024-04-19T04:25:56.713 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2450000000000003e-06 2024-04-19T04:25:56.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.713 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.713 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:56.713 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687038+0000", 2024-04-19T04:25:56.713 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4699e-05 2024-04-19T04:25:56.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.713 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.713 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:56.713 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687123+0000", 2024-04-19T04:25:56.713 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4963999999999995e-05 2024-04-19T04:25:56.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.713 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.713 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:56.714 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687198+0000", 2024-04-19T04:25:56.714 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4350999999999993e-05 2024-04-19T04:25:56.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.714 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.714 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:56.714 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.690876+0000", 2024-04-19T04:25:56.714 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0036783660000000002 2024-04-19T04:25:56.714 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.714 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:56.714 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.714 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.715 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:154548 5.f 5:f96bf835:::benchmark_data_smithi007_19526_object28814:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:56.715 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:56.687106+0000", 2024-04-19T04:25:56.715 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0082664850000000005, 2024-04-19T04:25:56.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0084753120000000005, 2024-04-19T04:25:56.715 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:56.715 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:56.715 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:56.715 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:56.715 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.715 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 154548 2024-04-19T04:25:56.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.715 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:56.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:56.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687106+0000", 2024-04-19T04:25:56.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:56.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687106+0000", 2024-04-19T04:25:56.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:56.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687105+0000", 2024-04-19T04:25:56.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:56.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:56.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687109+0000", 2024-04-19T04:25:56.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9079999999999997e-06 2024-04-19T04:25:56.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:56.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687116+0000", 2024-04-19T04:25:56.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6189999999999996e-06 2024-04-19T04:25:56.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687120+0000", 2024-04-19T04:25:56.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1910000000000002e-06 2024-04-19T04:25:56.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.718 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:56.718 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.690770+0000", 2024-04-19T04:25:56.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0036496950000000001 2024-04-19T04:25:56.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.718 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:56.718 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.690896+0000", 2024-04-19T04:25:56.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012634300000000001 2024-04-19T04:25:56.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.718 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:56.718 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.691010+0000", 2024-04-19T04:25:56.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114271 2024-04-19T04:25:56.719 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.719 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:56.719 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.719 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:154549 5.7 5:e3e8633a:::benchmark_data_smithi007_19526_object28815:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:56.719 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:56.687124+0000", 2024-04-19T04:25:56.719 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0082485170000000003, 2024-04-19T04:25:56.719 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0084987870000000007, 2024-04-19T04:25:56.719 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:56.719 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:56.719 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:56.719 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:56.720 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.720 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 154549 2024-04-19T04:25:56.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.720 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:56.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:56.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687124+0000", 2024-04-19T04:25:56.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:56.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687124+0000", 2024-04-19T04:25:56.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:56.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687124+0000", 2024-04-19T04:25:56.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:56.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:56.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687125+0000", 2024-04-19T04:25:56.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.748e-06 2024-04-19T04:25:56.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.722 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:56.722 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687129+0000", 2024-04-19T04:25:56.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2059999999999999e-06 2024-04-19T04:25:56.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687131+0000", 2024-04-19T04:25:56.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8049999999999998e-06 2024-04-19T04:25:56.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:56.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.690754+0000", 2024-04-19T04:25:56.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0036226000000000001 2024-04-19T04:25:56.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:56.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.690879+0000", 2024-04-19T04:25:56.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012456199999999999 2024-04-19T04:25:56.725 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.725 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:56.725 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.725 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:154551 5.1 5:87527308:::benchmark_data_smithi007_19526_object28817:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:56.726 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:56.687334+0000", 2024-04-19T04:25:56.726 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0080387930000000007, 2024-04-19T04:25:56.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0083271230000000005, 2024-04-19T04:25:56.726 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:56.726 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:56.726 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:56.727 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:56.727 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.727 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 154551 2024-04-19T04:25:56.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.727 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:56.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:56.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687334+0000", 2024-04-19T04:25:56.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:56.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687334+0000", 2024-04-19T04:25:56.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:56.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687333+0000", 2024-04-19T04:25:56.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:56.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:56.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687336+0000", 2024-04-19T04:25:56.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.7049999999999999e-06 2024-04-19T04:25:56.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:56.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687346+0000", 2024-04-19T04:25:56.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0283e-05 2024-04-19T04:25:56.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687350+0000", 2024-04-19T04:25:56.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.8360000000000002e-06 2024-04-19T04:25:56.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:56.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687398+0000", 2024-04-19T04:25:56.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7917999999999998e-05 2024-04-19T04:25:56.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.730 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:56.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.687572+0000", 2024-04-19T04:25:56.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000174291 2024-04-19T04:25:56.730 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.730 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:56.730 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.730 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:154554 5.f 5:f7db4c0f:::benchmark_data_smithi007_19526_object28820:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:56.730 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:56.689388+0000", 2024-04-19T04:25:56.730 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0059843259999999999, 2024-04-19T04:25:56.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0063124920000000003, 2024-04-19T04:25:56.731 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:56.731 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:56.731 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:56.731 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:56.731 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.731 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 154554 2024-04-19T04:25:56.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.731 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:56.731 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:56.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.689388+0000", 2024-04-19T04:25:56.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:56.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.689388+0000", 2024-04-19T04:25:56.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:56.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.689387+0000", 2024-04-19T04:25:56.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:56.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:56.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.689393+0000", 2024-04-19T04:25:56.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1210000000000003e-06 2024-04-19T04:25:56.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:56.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.689409+0000", 2024-04-19T04:25:56.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6045e-05 2024-04-19T04:25:56.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.689417+0000", 2024-04-19T04:25:56.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1790000000000008e-06 2024-04-19T04:25:56.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:56.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.692761+0000", 2024-04-19T04:25:56.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0033440760000000001 2024-04-19T04:25:56.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:56.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.692916+0000", 2024-04-19T04:25:56.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000154535 2024-04-19T04:25:56.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:56.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.693057+0000", 2024-04-19T04:25:56.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014110199999999999 2024-04-19T04:25:56.735 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.735 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:56.735 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.735 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:154556 5.9 5:95ff3419:::benchmark_data_smithi007_19526_object28822:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:56.735 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:56.691083+0000", 2024-04-19T04:25:56.735 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0042893380000000002, 2024-04-19T04:25:56.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0046592669999999999, 2024-04-19T04:25:56.735 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:56.735 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:56.736 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:56.736 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:56.736 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.736 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 154556 2024-04-19T04:25:56.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.736 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:56.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:56.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.691083+0000", 2024-04-19T04:25:56.736 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:56.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.691083+0000", 2024-04-19T04:25:56.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:56.737 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.691082+0000", 2024-04-19T04:25:56.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:56.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:56.737 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.691087+0000", 2024-04-19T04:25:56.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5759999999999999e-06 2024-04-19T04:25:56.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:56.738 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.691095+0000", 2024-04-19T04:25:56.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8369999999999997e-06 2024-04-19T04:25:56.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.738 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.738 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.738 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.691099+0000", 2024-04-19T04:25:56.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8110000000000002e-06 2024-04-19T04:25:56.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.738 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.738 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:56.738 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.691149+0000", 2024-04-19T04:25:56.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9889000000000003e-05 2024-04-19T04:25:56.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.739 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:56.739 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.691358+0000", 2024-04-19T04:25:56.739 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00020821899999999999 2024-04-19T04:25:56.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.739 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:56.739 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.691520+0000", 2024-04-19T04:25:56.739 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016217400000000001 2024-04-19T04:25:56.739 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.739 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:56.739 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.740 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.740 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:154559 5.7 5:e28eb740:::benchmark_data_smithi007_19526_object28825:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:56.740 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:56.693136+0000", 2024-04-19T04:25:56.740 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.002236348, 2024-04-19T04:25:56.740 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026471160000000001, 2024-04-19T04:25:56.740 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:56.740 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:25:56.740 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:56.740 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:56.740 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.740 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 154559 2024-04-19T04:25:56.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.740 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:56.740 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.740 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:56.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.693136+0000", 2024-04-19T04:25:56.741 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:56.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.693136+0000", 2024-04-19T04:25:56.741 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:56.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.693135+0000", 2024-04-19T04:25:56.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:56.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:56.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.693141+0000", 2024-04-19T04:25:56.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2639999999999997e-06 2024-04-19T04:25:56.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:56.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.693153+0000", 2024-04-19T04:25:56.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2223e-05 2024-04-19T04:25:56.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.743 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.693163+0000", 2024-04-19T04:25:56.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.6080000000000002e-06 2024-04-19T04:25:56.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.743 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:56.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.693193+0000", 2024-04-19T04:25:56.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.0301999999999999e-05 2024-04-19T04:25:56.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.743 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:56.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.693279+0000", 2024-04-19T04:25:56.744 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5525000000000005e-05 2024-04-19T04:25:56.744 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.744 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:56.744 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.744 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.744 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:154560 5.d 5:be814ed1:::benchmark_data_smithi007_19526_object28826:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:56.744 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:56.693478+0000", 2024-04-19T04:25:56.744 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001894286, 2024-04-19T04:25:56.744 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023440790000000002, 2024-04-19T04:25:56.744 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:56.744 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:56.744 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:56.744 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:56.744 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.745 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 154560 2024-04-19T04:25:56.745 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.745 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:56.745 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.745 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:56.745 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.693478+0000", 2024-04-19T04:25:56.745 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.745 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.745 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.745 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:56.745 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.693478+0000", 2024-04-19T04:25:56.745 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.745 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.745 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.745 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:56.746 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.693477+0000", 2024-04-19T04:25:56.746 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:56.746 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.746 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.746 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:56.746 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.693482+0000", 2024-04-19T04:25:56.746 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4569999999999998e-06 2024-04-19T04:25:56.746 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.746 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.746 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:56.746 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.693493+0000", 2024-04-19T04:25:56.747 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0937e-05 2024-04-19T04:25:56.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.747 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.747 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.747 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.693500+0000", 2024-04-19T04:25:56.747 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5560000000000002e-06 2024-04-19T04:25:56.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.747 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.747 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:56.747 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.693548+0000", 2024-04-19T04:25:56.747 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8139000000000001e-05 2024-04-19T04:25:56.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.747 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.748 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:56.748 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.693666+0000", 2024-04-19T04:25:56.748 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000117657 2024-04-19T04:25:56.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.748 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.748 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:56.748 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.693813+0000", 2024-04-19T04:25:56.748 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000147484 2024-04-19T04:25:56.749 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.749 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:56.749 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.749 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.749 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:154561 5.f 5:f84e8db1:::benchmark_data_smithi007_19526_object28827:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:56.749 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:56.694592+0000", 2024-04-19T04:25:56.750 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00078016100000000003, 2024-04-19T04:25:56.750 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012728220000000001, 2024-04-19T04:25:56.750 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:56.750 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:25:56.750 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:56.750 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:56.750 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:56.751 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 154561 2024-04-19T04:25:56.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.751 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:56.751 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.751 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:56.751 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.694592+0000", 2024-04-19T04:25:56.752 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.752 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.752 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:56.752 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.694592+0000", 2024-04-19T04:25:56.752 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:56.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.753 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.753 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:56.753 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.694592+0000", 2024-04-19T04:25:56.753 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:56.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.753 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.754 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:56.754 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.694596+0000", 2024-04-19T04:25:56.754 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7010000000000004e-06 2024-04-19T04:25:56.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.754 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.754 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:56.754 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.694622+0000", 2024-04-19T04:25:56.754 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5318000000000001e-05 2024-04-19T04:25:56.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.755 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:56.755 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.694627+0000", 2024-04-19T04:25:56.755 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1410000000000004e-06 2024-04-19T04:25:56.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.755 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:56.756 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.694728+0000", 2024-04-19T04:25:56.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010168899999999999 2024-04-19T04:25:56.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.756 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:56.756 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.694844+0000", 2024-04-19T04:25:56.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011527399999999999 2024-04-19T04:25:56.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:56.757 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:56.757 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:56.757 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:56.694946+0000", 2024-04-19T04:25:56.757 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000102209 2024-04-19T04:25:56.757 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.758 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:56.758 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.758 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:56.758 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:25:56.758 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 12 2024-04-19T04:25:56.758 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:56.760 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:56.762 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:56.761+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:56.864 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:56.865+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:56.897 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:56.897 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:56.897 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:56.897 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:56.897 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:56.911 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:56.965 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:56.965+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:57.066 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:57.065+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:57.092 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:57.092 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:57.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:57.092 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:57.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.092 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:57.092 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:57.093 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 62.859203643000001, 2024-04-19T04:25:57.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:57.093 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.093 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:57.093 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:57.093 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:57.093 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.094 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:57.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.094 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:57.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:57.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:57.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:57.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:57.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:57.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:57.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:57.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:57.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:57.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:57.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:57.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:57.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:57.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:57.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:57.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:57.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:57.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:57.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:57.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:57.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:57.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:57.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:57.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:57.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:57.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:57.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:57.100 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.100 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.100 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.100 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:57.100 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:57.100 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 62.856022486999997, 2024-04-19T04:25:57.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:57.101 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.101 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:57.101 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:57.101 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:57.101 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.101 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:57.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.101 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:57.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:57.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:57.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:57.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:57.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:57.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:57.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:57.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:57.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:57.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:57.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:57.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:57.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:57.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:57.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:57.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:57.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:57.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:57.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:57.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:57.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:57.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:57.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:57.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:57.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:57.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:57.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:57.106 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.106 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.106 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.106 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:57.106 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:57.106 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 62.855454383000001, 2024-04-19T04:25:57.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:57.106 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.107 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:57.107 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.107 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.107 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:57.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.107 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.107 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:57.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:57.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:57.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:57.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:57.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:57.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:57.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:57.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:57.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:57.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:57.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:57.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:57.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:57.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:57.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:57.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:57.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:57.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:57.111 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.112 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.112 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.112 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:57.112 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:57.112 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 62.855108721999997, 2024-04-19T04:25:57.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:57.112 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.112 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:57.112 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:57.112 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:57.112 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.112 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:57.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.113 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.113 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.113 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:57.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.113 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.113 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:57.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:57.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:57.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:57.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.116 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:57.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:57.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.116 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:57.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:57.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.116 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:57.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:57.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.117 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:57.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:57.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:57.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.117 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:57.117 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:57.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:57.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:57.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:57.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:57.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:57.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:57.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:57.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:57.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:57.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:57.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:57.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:57.119 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.119 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.119 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.119 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:57.120 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:57.120 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 62.854384283999998, 2024-04-19T04:25:57.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:57.120 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.120 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:57.120 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:57.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:57.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:57.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:57.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:57.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:57.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:57.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.125 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:57.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:57.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.125 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.125 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:57.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:57.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:57.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:57.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:57.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:57.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:57.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:57.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:57.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:57.128 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.128 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.128 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.129 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:57.129 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:57.129 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 62.854376889000001, 2024-04-19T04:25:57.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:57.130 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.130 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:57.130 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:57.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:57.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:57.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:57.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:57.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:57.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:57.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:57.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:57.134 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:57.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:57.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:57.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:57.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:57.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:57.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:57.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:57.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:57.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.137 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:57.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:57.137 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.137 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.138 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.138 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:57.138 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:57.138 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 62.852551742000003, 2024-04-19T04:25:57.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:57.139 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.139 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:57.139 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:57.139 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:57.139 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.140 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:57.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.140 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:57.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:57.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.142 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.142 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:57.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.143 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.143 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:57.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:57.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:57.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:57.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:57.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:57.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:57.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:57.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:57.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:57.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:57.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.147 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:57.147 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:57.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:57.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:57.148 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:57.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:57.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:57.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:57.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:57.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:57.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:57.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:57.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.151 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:57.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:57.151 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.151 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.151 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.152 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:57.152 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:57.152 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 62.851817537000002, 2024-04-19T04:25:57.152 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:57.152 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.153 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:57.153 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:57.153 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:57.153 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.153 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:57.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.154 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.154 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.154 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.154 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:57.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.155 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.155 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.155 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:57.155 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.155 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.155 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.155 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:57.156 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.156 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.157 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.157 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:57.157 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:57.157 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.157 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.157 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.157 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:57.157 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:57.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:57.158 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:57.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.159 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.159 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:57.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:57.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.159 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:57.159 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:57.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:57.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.160 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.160 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:57.160 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:57.160 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:57.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.160 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.160 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:57.161 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:57.161 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:57.161 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.161 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.161 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:57.161 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:57.161 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:57.161 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.162 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.162 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:57.162 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:57.162 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:57.162 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.162 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.162 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.162 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:57.162 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:57.162 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.162 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.162 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.163 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.163 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.163 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:57.163 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:57.163 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 62.851283260999999, 2024-04-19T04:25:57.163 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:57.163 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.163 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:57.163 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.163 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.163 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.163 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:57.163 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.163 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.164 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.164 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.164 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:57.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.164 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.164 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.164 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:57.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.164 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.164 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.164 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:57.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:57.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:57.165 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:57.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:57.165 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:57.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:57.166 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:57.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.166 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.166 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:57.166 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:57.166 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:57.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.166 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.166 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:57.166 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:57.166 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:57.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.166 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.167 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.167 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:57.167 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:57.167 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.167 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.167 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.167 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.167 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.167 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:57.167 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:57.167 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.134428071999999, 2024-04-19T04:25:57.167 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:57.167 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.167 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:57.168 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:57.168 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:57.168 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.168 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:57.168 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.168 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.168 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.168 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.168 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:57.168 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.168 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.168 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.168 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.168 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:57.169 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.169 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.169 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.169 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.169 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:57.169 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:57.169 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.169 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.169 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.169 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:57.169 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:57.169 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.169 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.169 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.170 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:57.170 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:57.170 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.170 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.170 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.170 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:57.170 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:57.170 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.170 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.170 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.170 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:57.170 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:57.170 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.170 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.171 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:57.171 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:57.171 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:57.171 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.171 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.171 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:57.171 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:57.171 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:57.171 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.171 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.171 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:57.171 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:57.171 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:57.171 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.172 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.172 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.172 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:57.172 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:57.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.172 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.172 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:57.172 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:57.172 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:57.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.172 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.172 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.172 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:57.172 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:57.173 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.173 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.173 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.173 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:57.173 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:57.173 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.173 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.173 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.173 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.173 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.173 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:57.173 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:57.173 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.114197623000003, 2024-04-19T04:25:57.174 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:57.174 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.174 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:57.174 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:57.174 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:57.174 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.174 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:57.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.174 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.174 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.174 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.174 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:57.175 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.175 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.175 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.175 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:57.175 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.175 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.176 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.176 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:57.176 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:57.176 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.176 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.176 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.176 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:57.176 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:57.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.177 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.177 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.177 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:57.177 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:57.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.177 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.177 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:57.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:57.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:57.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:57.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:57.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:57.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:57.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.180 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.180 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:57.180 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:57.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.180 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.180 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.181 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:57.181 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:57.181 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.181 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.181 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.181 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.181 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.182 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:57.182 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:57.182 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.114089765999999, 2024-04-19T04:25:57.182 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:57.182 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.183 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:57.183 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:57.183 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:57.183 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.183 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:57.183 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.183 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:57.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:57.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:57.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:57.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:57.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:57.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.186 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.186 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:57.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:57.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.186 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.186 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:57.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:57.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.186 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.187 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:57.187 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:57.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.187 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:57.187 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:57.187 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:57.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.187 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.187 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:57.187 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:57.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.188 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.188 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:57.188 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:57.188 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.188 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.188 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.188 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.188 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:57.188 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:57.188 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.112123077, 2024-04-19T04:25:57.188 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:57.188 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.188 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:57.189 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:57.189 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:57.189 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.189 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:57.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.189 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.189 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.189 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.189 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:57.189 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.189 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.189 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.189 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:57.189 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.190 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.190 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:57.190 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:57.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.190 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.190 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:57.190 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:57.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.190 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.190 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:57.191 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:57.191 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.191 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.191 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.191 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:57.191 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:57.191 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.191 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.191 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.191 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:57.191 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:57.191 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.191 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.191 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:57.191 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:57.192 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:57.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.192 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.192 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.192 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:57.192 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:57.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.192 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.192 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:57.192 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:57.192 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:57.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.192 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.192 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:57.192 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:57.193 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:57.193 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.193 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.193 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:57.193 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:57.193 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:57.193 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.193 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.193 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.193 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:57.193 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:57.193 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.193 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.193 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.193 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.194 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.194 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:57.194 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:57.194 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.108758881999997, 2024-04-19T04:25:57.194 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:57.194 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.194 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:57.194 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:57.194 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:57.194 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.194 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:57.194 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.194 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.194 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.195 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.195 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:57.195 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.195 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.195 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.195 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.195 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:57.195 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.195 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.195 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.195 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.195 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:57.195 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.195 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.196 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.196 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.196 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:57.196 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:57.196 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.196 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.196 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.196 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:57.196 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:57.196 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.196 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.196 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.196 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:57.196 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:57.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.197 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.197 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.197 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:57.197 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:57.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.197 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.197 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:57.197 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:57.197 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:57.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.197 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.197 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.197 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:57.197 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:57.198 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.198 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.198 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:57.198 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:57.198 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:57.198 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.198 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.198 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:57.198 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:57.198 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:57.198 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.198 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.198 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:57.198 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:57.199 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:57.199 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.199 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.199 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.199 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:57.199 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:57.199 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.199 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.199 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.199 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.199 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.199 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:57.199 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:57.199 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 41.104947903999999, 2024-04-19T04:25:57.200 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:57.200 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.200 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:57.200 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:57.200 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:57.200 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.200 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:57.200 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.200 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.200 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.200 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.200 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:57.200 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.200 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.201 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.201 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.201 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:57.201 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.201 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.201 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.201 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.201 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:57.201 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.201 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.201 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.201 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.201 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:57.201 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:57.201 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.202 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.202 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.202 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:57.202 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:57.202 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.202 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.202 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.202 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:57.202 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:57.202 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.202 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.202 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.202 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:57.202 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:57.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.203 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.203 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:57.203 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:57.203 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:57.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.203 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.203 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.203 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:57.203 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:57.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.203 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.203 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:57.203 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:57.204 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:57.204 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.204 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.204 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:57.204 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:57.204 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:57.204 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.204 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.204 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:57.204 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:57.204 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:57.204 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.204 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.204 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.204 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:57.205 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:57.205 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.205 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.205 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.205 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.205 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.205 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93735 5.1 5:8e609d1b:::benchmark_data_smithi007_19526_object93734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:57.205 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:57.205 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.863247260000001, 2024-04-19T04:25:57.205 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048424842000000003, 2024-04-19T04:25:57.205 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.205 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:57.205 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:57.205 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:57.205 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.206 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93735 2024-04-19T04:25:57.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.206 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.206 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.206 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.206 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:57.206 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.206 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.206 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.206 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:57.206 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.206 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.207 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.207 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227480+0000", 2024-04-19T04:25:57.207 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.207 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.207 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.207 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.207 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227533+0000", 2024-04-19T04:25:57.207 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2964999999999999e-05 2024-04-19T04:25:57.207 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.207 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.207 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.207 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227542+0000", 2024-04-19T04:25:57.207 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1449999999999997e-06 2024-04-19T04:25:57.208 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.208 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.208 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.208 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227561+0000", 2024-04-19T04:25:57.208 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9116000000000001e-05 2024-04-19T04:25:57.208 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.208 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.208 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.208 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227610+0000", 2024-04-19T04:25:57.208 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9234000000000003e-05 2024-04-19T04:25:57.208 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.208 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.208 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:57.208 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227697+0000", 2024-04-19T04:25:57.208 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6682999999999997e-05 2024-04-19T04:25:57.209 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.209 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.209 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:57.209 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275809+0000", 2024-04-19T04:25:57.209 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048112265000000001 2024-04-19T04:25:57.209 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.209 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.209 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:57.209 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275845+0000", 2024-04-19T04:25:57.209 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5275999999999999e-05 2024-04-19T04:25:57.209 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.209 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.209 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.209 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275906+0000", 2024-04-19T04:25:57.210 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1002999999999999e-05 2024-04-19T04:25:57.210 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.210 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.210 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.210 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.210 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.210 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93736 5.1 5:852229ec:::benchmark_data_smithi007_19526_object93735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:57.210 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:57.210 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.863143229999999, 2024-04-19T04:25:57.210 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048414497000000001, 2024-04-19T04:25:57.210 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.210 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:57.210 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:57.211 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:57.211 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.211 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93736 2024-04-19T04:25:57.211 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.211 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.211 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.211 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.211 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:57.211 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.211 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.211 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.211 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.211 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:57.212 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.212 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.212 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.212 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227584+0000", 2024-04-19T04:25:57.212 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:57.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.212 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.212 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.212 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227624+0000", 2024-04-19T04:25:57.212 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9833000000000003e-05 2024-04-19T04:25:57.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.212 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.212 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.213 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227630+0000", 2024-04-19T04:25:57.213 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0759999999999999e-06 2024-04-19T04:25:57.213 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.213 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.213 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.213 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227634+0000", 2024-04-19T04:25:57.213 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1570000000000002e-06 2024-04-19T04:25:57.213 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.213 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.213 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.213 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229531+0000", 2024-04-19T04:25:57.213 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018962339999999999 2024-04-19T04:25:57.213 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.213 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.214 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:57.214 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229662+0000", 2024-04-19T04:25:57.214 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013192999999999999 2024-04-19T04:25:57.214 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.214 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.214 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:57.214 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275915+0000", 2024-04-19T04:25:57.214 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046252140999999997 2024-04-19T04:25:57.214 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.214 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.214 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:57.214 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275944+0000", 2024-04-19T04:25:57.214 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9539999999999998e-05 2024-04-19T04:25:57.215 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.215 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.215 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.215 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275999+0000", 2024-04-19T04:25:57.215 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5062999999999998e-05 2024-04-19T04:25:57.215 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.215 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.215 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.215 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.215 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.215 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:57.215 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:57.215 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.863085547000001, 2024-04-19T04:25:57.215 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:25:57.215 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.216 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:57.216 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:57.216 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:57.216 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.216 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:25:57.216 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.216 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.216 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.216 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.216 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:57.216 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.216 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.216 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.217 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.217 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:57.217 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.217 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.217 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.217 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.217 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:57.217 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:57.217 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.217 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.217 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.217 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:25:57.217 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:25:57.217 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.217 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.218 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.218 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:25:57.218 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:25:57.218 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.218 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.218 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.218 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:25:57.218 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:25:57.218 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.218 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.218 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.218 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:25:57.218 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:25:57.218 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.219 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.219 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:57.219 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:25:57.219 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:25:57.219 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.219 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.219 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:57.219 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:25:57.219 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:25:57.219 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.219 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.219 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:57.219 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:25:57.219 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:25:57.220 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.220 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.220 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.220 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:25:57.220 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:25:57.220 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.220 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.220 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.220 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.220 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.220 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:57.220 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:57.220 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.862491266999999, 2024-04-19T04:25:57.220 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:25:57.221 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.221 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:57.221 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:57.221 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:57.221 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.221 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:25:57.221 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.221 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.221 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.221 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.221 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:57.221 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.221 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.221 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.222 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.222 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:57.222 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.222 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.222 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.222 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.222 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:25:57.222 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.222 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.222 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.222 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.222 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:25:57.222 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:25:57.223 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.223 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.223 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.223 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:25:57.223 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:25:57.223 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.223 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.223 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.223 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:25:57.223 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:25:57.223 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.223 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.223 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.223 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:25:57.224 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:25:57.224 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.224 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.224 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:57.224 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:25:57.224 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:25:57.224 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.224 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.224 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:57.224 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:25:57.224 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:25:57.224 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.224 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.224 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:57.225 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:25:57.225 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:25:57.225 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.225 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.225 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:57.225 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:25:57.225 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:25:57.225 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.225 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.225 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:57.225 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:25:57.225 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:25:57.225 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.225 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.225 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.226 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:25:57.226 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:25:57.226 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.226 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.226 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.226 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.226 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.226 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93744 5.1 5:87b91c25:::benchmark_data_smithi007_19526_object93743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:57.226 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:57.226 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.858821716000001, 2024-04-19T04:25:57.226 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044295022000000003, 2024-04-19T04:25:57.226 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:57.226 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:57.227 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:57.227 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:57.227 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.227 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93744 2024-04-19T04:25:57.227 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.227 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:57.227 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.227 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:57.227 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:57.227 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.227 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.227 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.227 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:57.227 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:57.227 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:57.228 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.228 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.228 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:57.228 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231905+0000", 2024-04-19T04:25:57.228 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.228 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.228 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.228 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:57.228 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231935+0000", 2024-04-19T04:25:57.228 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9442e-05 2024-04-19T04:25:57.228 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.228 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.228 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:57.228 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264224+0000", 2024-04-19T04:25:57.229 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.032288836000000001 2024-04-19T04:25:57.229 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.229 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.229 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.229 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264238+0000", 2024-04-19T04:25:57.229 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4494999999999999e-05 2024-04-19T04:25:57.229 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.229 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.229 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:57.229 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268311+0000", 2024-04-19T04:25:57.229 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040726629999999998 2024-04-19T04:25:57.229 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.229 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.229 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:57.229 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268587+0000", 2024-04-19T04:25:57.230 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00027623200000000001 2024-04-19T04:25:57.230 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.230 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.230 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:57.230 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276099+0000", 2024-04-19T04:25:57.230 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075116180000000003 2024-04-19T04:25:57.230 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.230 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.230 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:57.230 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276123+0000", 2024-04-19T04:25:57.230 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4675e-05 2024-04-19T04:25:57.230 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:57.230 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:57.230 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:57.231 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276201+0000", 2024-04-19T04:25:57.231 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7836000000000005e-05 2024-04-19T04:25:57.231 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.231 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.231 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.231 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:57.231 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:57.231 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:57.231 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:25:57.232 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T04:25:57.234 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:57.229+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:57.234 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:57.334 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:57.333+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:57.364 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:25:57.364 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:25:57.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.364 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:156156 5.9 e52/20 5:9467639e:::benchmark_data_smithi007_19526_object30422:head v 52'10019, mlcod=52'10015)", 2024-04-19T04:25:57.364 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:57.360351+0000", 2024-04-19T04:25:57.364 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0032881030000000001, 2024-04-19T04:25:57.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033167489999999999, 2024-04-19T04:25:57.364 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:57.364 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:57.364 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:57.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:57.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360351+0000", 2024-04-19T04:25:57.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:57.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360351+0000", 2024-04-19T04:25:57.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:57.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360351+0000", 2024-04-19T04:25:57.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:57.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:57.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360355+0000", 2024-04-19T04:25:57.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3270000000000002e-06 2024-04-19T04:25:57.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:57.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360360+0000", 2024-04-19T04:25:57.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4870000000000002e-06 2024-04-19T04:25:57.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360365+0000", 2024-04-19T04:25:57.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2209999999999999e-06 2024-04-19T04:25:57.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:57.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360420+0000", 2024-04-19T04:25:57.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5695999999999997e-05 2024-04-19T04:25:57.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:57.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360437+0000", 2024-04-19T04:25:57.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6943999999999999e-05 2024-04-19T04:25:57.367 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.367 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:57.367 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.368 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:156167 5.4 5:211fcde8:::benchmark_data_smithi007_19526_object30433:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:57.368 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:57.360715+0000", 2024-04-19T04:25:57.368 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002923943, 2024-04-19T04:25:57.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030427420000000002, 2024-04-19T04:25:57.368 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:57.368 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:57.368 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:57.368 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:57.368 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.368 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 156167 2024-04-19T04:25:57.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.368 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:57.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:57.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360715+0000", 2024-04-19T04:25:57.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:57.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360715+0000", 2024-04-19T04:25:57.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:57.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360714+0000", 2024-04-19T04:25:57.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:57.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:57.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360722+0000", 2024-04-19T04:25:57.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1759999999999993e-06 2024-04-19T04:25:57.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:57.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360766+0000", 2024-04-19T04:25:57.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3850000000000002e-05 2024-04-19T04:25:57.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360777+0000", 2024-04-19T04:25:57.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0781999999999999e-05 2024-04-19T04:25:57.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:57.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360830+0000", 2024-04-19T04:25:57.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3550000000000001e-05 2024-04-19T04:25:57.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:57.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360991+0000", 2024-04-19T04:25:57.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016039200000000001 2024-04-19T04:25:57.371 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.371 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:57.371 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.371 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:156168 5.8 5:10fded57:::benchmark_data_smithi007_19526_object30434:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:57.372 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:57.360795+0000", 2024-04-19T04:25:57.372 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0028440430000000001, 2024-04-19T04:25:57.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003061191, 2024-04-19T04:25:57.372 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:57.372 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:57.373 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:57.373 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:57.373 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.373 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 156168 2024-04-19T04:25:57.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.373 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:57.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:57.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360795+0000", 2024-04-19T04:25:57.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:57.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360795+0000", 2024-04-19T04:25:57.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:57.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360794+0000", 2024-04-19T04:25:57.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:57.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360799+0000", 2024-04-19T04:25:57.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8659999999999997e-06 2024-04-19T04:25:57.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:57.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360808+0000", 2024-04-19T04:25:57.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0880000000000001e-06 2024-04-19T04:25:57.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360816+0000", 2024-04-19T04:25:57.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3799999999999996e-06 2024-04-19T04:25:57.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:57.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.360859+0000", 2024-04-19T04:25:57.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3007999999999999e-05 2024-04-19T04:25:57.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:57.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.361039+0000", 2024-04-19T04:25:57.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000180242 2024-04-19T04:25:57.376 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.376 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:57.376 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.376 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:156169 5.0 5:0369f2d1:::benchmark_data_smithi007_19526_object30435:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:57.376 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:57.361151+0000", 2024-04-19T04:25:57.376 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0024884949999999999, 2024-04-19T04:25:57.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027975719999999999, 2024-04-19T04:25:57.376 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:57.377 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:25:57.377 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:57.377 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:57.377 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.377 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 156169 2024-04-19T04:25:57.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.377 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:57.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:57.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.361151+0000", 2024-04-19T04:25:57.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:57.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.361151+0000", 2024-04-19T04:25:57.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:57.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.361150+0000", 2024-04-19T04:25:57.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:57.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.361156+0000", 2024-04-19T04:25:57.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2790000000000004e-06 2024-04-19T04:25:57.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:57.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.361168+0000", 2024-04-19T04:25:57.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2162e-05 2024-04-19T04:25:57.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.361177+0000", 2024-04-19T04:25:57.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8740000000000001e-06 2024-04-19T04:25:57.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:57.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.361224+0000", 2024-04-19T04:25:57.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7376999999999997e-05 2024-04-19T04:25:57.379 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.379 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:57.379 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.380 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:156166 5.d e52/29 5:b95a9298:::benchmark_data_smithi007_19526_object30432:head v 52'9465, mlcod=52'9463)", 2024-04-19T04:25:57.380 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:57.361292+0000", 2024-04-19T04:25:57.380 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0023471910000000002, 2024-04-19T04:25:57.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027411060000000001, 2024-04-19T04:25:57.380 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:57.380 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:57.380 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:57.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:57.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.361292+0000", 2024-04-19T04:25:57.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:57.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.361292+0000", 2024-04-19T04:25:57.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:57.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.361291+0000", 2024-04-19T04:25:57.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:57.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.361299+0000", 2024-04-19T04:25:57.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6340000000000001e-06 2024-04-19T04:25:57.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:57.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.361310+0000", 2024-04-19T04:25:57.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1143e-05 2024-04-19T04:25:57.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.361318+0000", 2024-04-19T04:25:57.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:25:57.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:57.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.361358+0000", 2024-04-19T04:25:57.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.926e-05 2024-04-19T04:25:57.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:57.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.361382+0000", 2024-04-19T04:25:57.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4297000000000001e-05 2024-04-19T04:25:57.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:25:57.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.363999+0000", 2024-04-19T04:25:57.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026175320000000001 2024-04-19T04:25:57.385 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.385 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:57.385 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.385 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:156161 5.9 e52/20)", 2024-04-19T04:25:57.385 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:57.362658+0000", 2024-04-19T04:25:57.385 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00098148500000000004, 2024-04-19T04:25:57.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0014779820000000001, 2024-04-19T04:25:57.385 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:57.385 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:57.385 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:57.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:57.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.362658+0000", 2024-04-19T04:25:57.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:57.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.362658+0000", 2024-04-19T04:25:57.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:57.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.362657+0000", 2024-04-19T04:25:57.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:57.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.362664+0000", 2024-04-19T04:25:57.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:25:57.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:57.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.362680+0000", 2024-04-19T04:25:57.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5926999999999998e-05 2024-04-19T04:25:57.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.362687+0000", 2024-04-19T04:25:57.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0269999999999998e-06 2024-04-19T04:25:57.390 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.390 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:57.390 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.390 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:156172 5.8 5:15ae307b:::benchmark_data_smithi007_19526_object30438:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:57.390 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:57.362896+0000", 2024-04-19T04:25:57.390 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00074338900000000001, 2024-04-19T04:25:57.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013156299999999999, 2024-04-19T04:25:57.390 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:57.390 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:57.390 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:57.391 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:57.391 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.391 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 156172 2024-04-19T04:25:57.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.391 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:57.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:57.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.362896+0000", 2024-04-19T04:25:57.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:57.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.362896+0000", 2024-04-19T04:25:57.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:57.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.362895+0000", 2024-04-19T04:25:57.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:57.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.362901+0000", 2024-04-19T04:25:57.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2049999999999999e-06 2024-04-19T04:25:57.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:57.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.362924+0000", 2024-04-19T04:25:57.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3167e-05 2024-04-19T04:25:57.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.362936+0000", 2024-04-19T04:25:57.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1426e-05 2024-04-19T04:25:57.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:57.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.363652+0000", 2024-04-19T04:25:57.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00071666999999999998 2024-04-19T04:25:57.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:57.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.363845+0000", 2024-04-19T04:25:57.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000192549 2024-04-19T04:25:57.394 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.394 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:57.394 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.394 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:156171 5.d e52/29 5:ba030351:::benchmark_data_smithi007_19526_object30437:head v 52'9466, mlcod=52'9463)", 2024-04-19T04:25:57.394 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:57.364073+0000", 2024-04-19T04:25:57.394 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9995661, 2024-04-19T04:25:57.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000232838, 2024-04-19T04:25:57.394 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:57.394 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:57.394 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:57.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:57.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.364073+0000", 2024-04-19T04:25:57.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:57.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.364073+0000", 2024-04-19T04:25:57.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:57.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.364072+0000", 2024-04-19T04:25:57.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:57.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:57.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.364078+0000", 2024-04-19T04:25:57.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9059999999999999e-06 2024-04-19T04:25:57.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:57.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.364086+0000", 2024-04-19T04:25:57.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0509999999999997e-06 2024-04-19T04:25:57.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.364092+0000", 2024-04-19T04:25:57.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6799999999999998e-06 2024-04-19T04:25:57.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:57.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.364149+0000", 2024-04-19T04:25:57.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7136000000000003e-05 2024-04-19T04:25:57.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:57.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.364169+0000", 2024-04-19T04:25:57.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9347999999999998e-05 2024-04-19T04:25:57.398 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.398 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:57.398 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.399 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:156165 5.9 e52/20)", 2024-04-19T04:25:57.399 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:57.364244+0000", 2024-04-19T04:25:57.399 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9993949, 2024-04-19T04:25:57.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014309199999999999, 2024-04-19T04:25:57.399 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:57.399 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:25:57.399 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:57.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:57.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.364244+0000", 2024-04-19T04:25:57.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:57.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.364244+0000", 2024-04-19T04:25:57.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:57.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.364244+0000", 2024-04-19T04:25:57.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:57.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.364250+0000", 2024-04-19T04:25:57.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8020000000000003e-06 2024-04-19T04:25:57.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:57.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.364259+0000", 2024-04-19T04:25:57.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9549999999999998e-06 2024-04-19T04:25:57.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.364266+0000", 2024-04-19T04:25:57.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5169999999999996e-06 2024-04-19T04:25:57.404 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.404 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:57.404 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.404 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:156162 5.0 5:081cc5e0:::benchmark_data_smithi007_19526_object30428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T04:25:57.404 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:57.357747+0000", 2024-04-19T04:25:57.404 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0058923760000000004, 2024-04-19T04:25:57.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066871650000000001, 2024-04-19T04:25:57.405 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:25:57.405 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:25:57.405 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:25:57.405 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:25:57.405 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:57.406 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 156162 2024-04-19T04:25:57.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.406 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:25:57.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:25:57.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.357747+0000", 2024-04-19T04:25:57.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:25:57.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.357747+0000", 2024-04-19T04:25:57.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:25:57.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:25:57.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.357746+0000", 2024-04-19T04:25:57.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:25:57.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:25:57.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.357750+0000", 2024-04-19T04:25:57.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5449999999999997e-06 2024-04-19T04:25:57.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:25:57.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.357761+0000", 2024-04-19T04:25:57.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0428000000000001e-05 2024-04-19T04:25:57.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:25:57.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.357767+0000", 2024-04-19T04:25:57.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4189999999999999e-06 2024-04-19T04:25:57.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:25:57.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.357855+0000", 2024-04-19T04:25:57.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.776e-05 2024-04-19T04:25:57.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:25:57.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:25:57.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:25:57.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:57.358028+0000", 2024-04-19T04:25:57.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000172879 2024-04-19T04:25:57.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.413 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:25:57.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:25:57.413 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:25:57.414 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 10 2024-04-19T04:25:57.414 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:25:57.415 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:57.415 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:57.416 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:57.416 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:57.416 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:57.417 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:57.435 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:57.433+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:57.535 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:57.533+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:57.540 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:57.540 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:57.553 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:57.638 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:57.637+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:57.712 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:57.713 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:57.724 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:57.768 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:57.769+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:57.838 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:57.837+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:57.850 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:57.851 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:57.863 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:57.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~41s 2024-04-19T04:25:57.939 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:57.937+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:57.993 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:57.993 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:58.006 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:58.041 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:58.037+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:58.137 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:58.137 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:58.140 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:58.137+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:58.150 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:58.162 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2024-04-19T04:25:58.241 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:58.237+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:58.278 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:58.278 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:58.290 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:58.342 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:58.341+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:58.410 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:58.411 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:58.422 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:58.444 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:58.441+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:58.543 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:58.543 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:58.546 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:58.541+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:58.556 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:58.646 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:58.645+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:58.691 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:58.692 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:58.705 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:58.747 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:58.745+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:58.837 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:58.837 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:58.847 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:58.845+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:58.849 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:58.948 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:58.949+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:58.978 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:58.979 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:58.992 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:59.050 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:59.049+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:59.117 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:59.117 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:59.130 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:25:59.150 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:59.149+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:59.249 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:59.249 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:59.251 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:59.249+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:59.263 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:25:59.352 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:59.353+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:59.380 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:59.381 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:59.392 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:25:59.418 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:25:59.453 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:59.453+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:59.524 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:25:59.524 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:25:59.538 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:25:59.555 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:59.553+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:59.578 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:25:59.602 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:25:59.602 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:25:59.602 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:25:59.602 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:25:59.606 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:25:59.606 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:25:59.655 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:25:59.653+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:25:59.667 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:59.667 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:25:59.667 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:25:59.668 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:25:59.668 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:59.679 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:25:59.756 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:59.753+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:25:59.817 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:25:59.817 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:25:59.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:25:59.818 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:25:59.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.818 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:59.818 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:59.818 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 65.584215068999995, 2024-04-19T04:25:59.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:25:59.818 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.818 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:59.818 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:59.818 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:59.818 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:59.818 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:25:59.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.819 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:59.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:25:59.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:25:59.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:59.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:25:59.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:25:59.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:25:59.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:25:59.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:25:59.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:25:59.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:25:59.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:25:59.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:59.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:25:59.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:25:59.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:59.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:25:59.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:25:59.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:59.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:25:59.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:25:59.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:59.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:25:59.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:25:59.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:59.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:25:59.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:25:59.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:25:59.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:25:59.823 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.823 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.824 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.824 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:59.824 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:59.824 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 65.581033912999999, 2024-04-19T04:25:59.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:25:59.824 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.824 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:59.824 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:59.824 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:59.824 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:59.824 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:25:59.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.825 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:59.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:59.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:25:59.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:59.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:25:59.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:25:59.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:25:59.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:25:59.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:25:59.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:25:59.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:25:59.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:25:59.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:59.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:25:59.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:25:59.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:59.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:25:59.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:25:59.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:59.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:25:59.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:25:59.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:59.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:25:59.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:25:59.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:59.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:25:59.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:25:59.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:25:59.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:25:59.829 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.829 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.829 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.829 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:25:59.829 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:59.829 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 65.580465809000003, 2024-04-19T04:25:59.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:25:59.829 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.830 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:59.830 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:59.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:25:59.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:25:59.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:59.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:25:59.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:25:59.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:25:59.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:25:59.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:25:59.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:25:59.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:25:59.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:25:59.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:59.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:25:59.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:25:59.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:59.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:25:59.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:25:59.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:25:59.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:25:59.833 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.833 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.834 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.834 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:59.834 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:59.834 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 65.580120148000006, 2024-04-19T04:25:59.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:25:59.834 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.834 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:59.834 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:59.834 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:59.834 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:59.834 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:25:59.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.835 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:59.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:25:59.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:25:59.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:59.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:25:59.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:25:59.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:25:59.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:25:59.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:25:59.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:25:59.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:25:59.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:25:59.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:59.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:25:59.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:25:59.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:59.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:25:59.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:25:59.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:59.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:25:59.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:25:59.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:59.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:25:59.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:25:59.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:59.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:25:59.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:25:59.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:25:59.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:25:59.839 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.839 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.839 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.840 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:25:59.840 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:59.840 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 65.57939571, 2024-04-19T04:25:59.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:25:59.840 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.840 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:59.840 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:59.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:25:59.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:25:59.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:59.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:25:59.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:25:59.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:25:59.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:25:59.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:25:59.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:25:59.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:25:59.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:25:59.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:59.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:25:59.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:25:59.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:59.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:25:59.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:25:59.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:25:59.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:25:59.844 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.844 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.844 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.844 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:25:59.844 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:59.844 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 65.579388315000003, 2024-04-19T04:25:59.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:25:59.844 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.844 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:59.844 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:59.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:59.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:25:59.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:59.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:25:59.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:25:59.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:25:59.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:25:59.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:25:59.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:25:59.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:25:59.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:25:59.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:59.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:25:59.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:25:59.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:59.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:25:59.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:25:59.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:25:59.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:25:59.848 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.848 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.848 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.848 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:59.849 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:59.849 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 65.577563167999998, 2024-04-19T04:25:59.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:25:59.849 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.849 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:59.849 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:59.849 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:59.849 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:59.849 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:25:59.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.849 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:59.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:25:59.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:25:59.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:59.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:25:59.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:25:59.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:25:59.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:25:59.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:25:59.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:25:59.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:25:59.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:25:59.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:59.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:25:59.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:25:59.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:59.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:25:59.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:25:59.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:59.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:25:59.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:25:59.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:59.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:25:59.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:25:59.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:59.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:25:59.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:25:59.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:25:59.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:25:59.854 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.854 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.854 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.854 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:25:59.854 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:59.854 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 65.576828962999997, 2024-04-19T04:25:59.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:25:59.854 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.854 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:59.855 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:59.855 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:59.855 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:59.855 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:25:59.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.855 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:59.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:25:59.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:25:59.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:59.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:25:59.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:25:59.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:25:59.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:25:59.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:25:59.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:25:59.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:25:59.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:25:59.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:59.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:25:59.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:25:59.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:59.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:25:59.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:25:59.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:59.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:25:59.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:25:59.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:59.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:25:59.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:25:59.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:59.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:25:59.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:25:59.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:25:59.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:25:59.860 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.860 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.860 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.860 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:25:59.860 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:59.860 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 65.576294687000001, 2024-04-19T04:25:59.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:25:59.860 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.860 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:59.860 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:59.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:25:59.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:25:59.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:59.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:25:59.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:25:59.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:25:59.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:25:59.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:25:59.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:25:59.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:25:59.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:25:59.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:59.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:25:59.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:25:59.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:59.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:25:59.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:25:59.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:25:59.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:25:59.864 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.864 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.864 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.864 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:25:59.864 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:59.864 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.859439498, 2024-04-19T04:25:59.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:25:59.864 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.865 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:59.865 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:59.865 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:59.865 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:59.865 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:25:59.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.865 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:59.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:25:59.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:25:59.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:59.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:25:59.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:25:59.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:25:59.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:25:59.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:25:59.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:25:59.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:25:59.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:25:59.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:59.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:25:59.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:25:59.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:25:59.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:25:59.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:25:59.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:59.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:25:59.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:25:59.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:25:59.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:25:59.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:59.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:25:59.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:25:59.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:25:59.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:25:59.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:25:59.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:25:59.870 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.870 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.870 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.871 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:59.871 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:59.871 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.839209048999997, 2024-04-19T04:25:59.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:25:59.871 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.871 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:59.871 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:59.871 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:59.871 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:59.871 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:25:59.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.871 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:59.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:25:59.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:25:59.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:25:59.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:25:59.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:25:59.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:25:59.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:25:59.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:25:59.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:25:59.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:25:59.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:25:59.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:59.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:25:59.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:25:59.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:25:59.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:25:59.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:25:59.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:25:59.875 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.875 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.875 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.875 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:59.875 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:59.876 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.839101192000001, 2024-04-19T04:25:59.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:25:59.876 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.876 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:25:59.876 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:59.876 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:59.876 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:59.876 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:25:59.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.876 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:59.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:25:59.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:25:59.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:59.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:25:59.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:25:59.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:25:59.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:25:59.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:25:59.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:25:59.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:25:59.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:25:59.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:59.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:25:59.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:25:59.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:25:59.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:25:59.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:25:59.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:25:59.880 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.880 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.880 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.880 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:59.880 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:59.880 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.837134503000001, 2024-04-19T04:25:59.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:25:59.880 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.880 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:59.880 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:59.880 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:59.880 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:59.881 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:25:59.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.881 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:59.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:25:59.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:25:59.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:25:59.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:25:59.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:25:59.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:25:59.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:25:59.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:25:59.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:25:59.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:25:59.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:25:59.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:59.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:25:59.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:25:59.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:25:59.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:25:59.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:59.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:25:59.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:25:59.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:59.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:25:59.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:25:59.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:59.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:25:59.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:25:59.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:25:59.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:25:59.885 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.886 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.886 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.886 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:59.886 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:59.886 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.833770307999998, 2024-04-19T04:25:59.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:25:59.886 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.886 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:59.886 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:59.886 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:59.886 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:59.887 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:25:59.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.887 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:59.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:25:59.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:25:59.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:59.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:25:59.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:25:59.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:25:59.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:25:59.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:25:59.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:25:59.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:25:59.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:25:59.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:59.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:25:59.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:25:59.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:25:59.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:25:59.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:59.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:25:59.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:25:59.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:59.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:25:59.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:25:59.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:59.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:25:59.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:25:59.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:25:59.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:25:59.891 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.892 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.892 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.892 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:25:59.892 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:59.892 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 43.829959330000001, 2024-04-19T04:25:59.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:25:59.892 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.892 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:59.892 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:59.892 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:59.892 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:59.892 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:25:59.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.893 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.893 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.893 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:59.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.893 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.893 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:25:59.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.893 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.893 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:25:59.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:59.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:25:59.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:25:59.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:25:59.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:25:59.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:25:59.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:25:59.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:25:59.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:25:59.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:25:59.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:25:59.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:25:59.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:25:59.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:25:59.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:59.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:25:59.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:25:59.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:59.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:25:59.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:25:59.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:59.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:25:59.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:25:59.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:25:59.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:25:59.897 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.897 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.897 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.897 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93735 5.1 5:8e609d1b:::benchmark_data_smithi007_19526_object93734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:59.897 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:59.897 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.588258686, 2024-04-19T04:25:59.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048424842000000003, 2024-04-19T04:25:59.898 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.898 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:59.898 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:59.898 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:59.898 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:59.898 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93735 2024-04-19T04:25:59.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.898 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.898 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.898 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:59.898 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:25:59.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227480+0000", 2024-04-19T04:25:59.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:59.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227533+0000", 2024-04-19T04:25:59.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2964999999999999e-05 2024-04-19T04:25:59.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227542+0000", 2024-04-19T04:25:59.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1449999999999997e-06 2024-04-19T04:25:59.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227561+0000", 2024-04-19T04:25:59.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9116000000000001e-05 2024-04-19T04:25:59.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227610+0000", 2024-04-19T04:25:59.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9234000000000003e-05 2024-04-19T04:25:59.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:59.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227697+0000", 2024-04-19T04:25:59.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6682999999999997e-05 2024-04-19T04:25:59.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:59.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275809+0000", 2024-04-19T04:25:59.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048112265000000001 2024-04-19T04:25:59.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:59.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275845+0000", 2024-04-19T04:25:59.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5275999999999999e-05 2024-04-19T04:25:59.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275906+0000", 2024-04-19T04:25:59.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1002999999999999e-05 2024-04-19T04:25:59.902 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.902 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.902 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.902 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93736 5.1 5:852229ec:::benchmark_data_smithi007_19526_object93735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:59.902 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:59.902 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.588154656, 2024-04-19T04:25:59.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048414497000000001, 2024-04-19T04:25:59.903 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.903 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:59.903 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:59.903 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:59.903 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:59.903 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93736 2024-04-19T04:25:59.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.903 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.903 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.903 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:59.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:25:59.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227584+0000", 2024-04-19T04:25:59.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:59.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227624+0000", 2024-04-19T04:25:59.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9833000000000003e-05 2024-04-19T04:25:59.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227630+0000", 2024-04-19T04:25:59.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0759999999999999e-06 2024-04-19T04:25:59.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227634+0000", 2024-04-19T04:25:59.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1570000000000002e-06 2024-04-19T04:25:59.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229531+0000", 2024-04-19T04:25:59.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018962339999999999 2024-04-19T04:25:59.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:59.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229662+0000", 2024-04-19T04:25:59.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013192999999999999 2024-04-19T04:25:59.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:59.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275915+0000", 2024-04-19T04:25:59.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046252140999999997 2024-04-19T04:25:59.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:59.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275944+0000", 2024-04-19T04:25:59.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9539999999999998e-05 2024-04-19T04:25:59.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275999+0000", 2024-04-19T04:25:59.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5062999999999998e-05 2024-04-19T04:25:59.908 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.908 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.909 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.909 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:59.909 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:59.909 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.588096972999999, 2024-04-19T04:25:59.909 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:25:59.909 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.909 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:59.909 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:59.909 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:59.909 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:59.909 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:25:59.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.910 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:59.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:59.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:25:59.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:25:59.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:25:59.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:25:59.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:25:59.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:25:59.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:25:59.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:25:59.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:25:59.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:25:59.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:59.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:25:59.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:25:59.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:59.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:25:59.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:25:59.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:59.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:25:59.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:25:59.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:25:59.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:25:59.913 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.913 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.914 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.914 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:59.914 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:59.914 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.587502693000001, 2024-04-19T04:25:59.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:25:59.914 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.914 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:59.914 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:59.915 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:59.915 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:59.915 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:25:59.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.915 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:59.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:25:59.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:25:59.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:59.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:25:59.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:25:59.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:25:59.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:25:59.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:25:59.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:25:59.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:25:59.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:25:59.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:59.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:25:59.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:25:59.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:25:59.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:25:59.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:25:59.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:25:59.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:25:59.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:25:59.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:59.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:25:59.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:25:59.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:59.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:25:59.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:25:59.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:25:59.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:25:59.920 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.920 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.920 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.920 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93744 5.1 5:87b91c25:::benchmark_data_smithi007_19526_object93743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:25:59.920 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:59.920 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.583833142, 2024-04-19T04:25:59.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044295022000000003, 2024-04-19T04:25:59.920 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:25:59.920 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:25:59.920 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:25:59.920 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:25:59.920 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:25:59.920 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93744 2024-04-19T04:25:59.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.921 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:25:59.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:25:59.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:59.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:25:59.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:25:59.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:25:59.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:25:59.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231905+0000", 2024-04-19T04:25:59.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:25:59.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:25:59.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231935+0000", 2024-04-19T04:25:59.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9442e-05 2024-04-19T04:25:59.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:25:59.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264224+0000", 2024-04-19T04:25:59.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.032288836000000001 2024-04-19T04:25:59.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:25:59.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264238+0000", 2024-04-19T04:25:59.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4494999999999999e-05 2024-04-19T04:25:59.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:25:59.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268311+0000", 2024-04-19T04:25:59.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040726629999999998 2024-04-19T04:25:59.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:25:59.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268587+0000", 2024-04-19T04:25:59.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00027623200000000001 2024-04-19T04:25:59.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:25:59.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276099+0000", 2024-04-19T04:25:59.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075116180000000003 2024-04-19T04:25:59.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:25:59.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276123+0000", 2024-04-19T04:25:59.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4675e-05 2024-04-19T04:25:59.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:25:59.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:25:59.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:25:59.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276201+0000", 2024-04-19T04:25:59.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7836000000000005e-05 2024-04-19T04:25:59.925 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.925 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.925 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.925 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:25:59.925 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:25:59.925 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:25:59.926 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:25:59.927 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:25:59.925+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:00.027 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:00.025+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:00.046 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:00.046 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:00.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.047 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:162761 5.b 5:de66beea:::benchmark_data_smithi007_19526_object37027:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T04:26:00.047 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:00.043736+0000", 2024-04-19T04:26:00.047 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.003255389, 2024-04-19T04:26:00.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032731029999999999, 2024-04-19T04:26:00.047 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.047 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:00.048 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.048 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.048 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.048 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 162761 2024-04-19T04:26:00.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.048 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.043736+0000", 2024-04-19T04:26:00.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.043736+0000", 2024-04-19T04:26:00.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.043735+0000", 2024-04-19T04:26:00.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.043741+0000", 2024-04-19T04:26:00.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7320000000000003e-06 2024-04-19T04:26:00.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.043752+0000", 2024-04-19T04:26:00.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0729e-05 2024-04-19T04:26:00.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.043759+0000", 2024-04-19T04:26:00.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6960000000000005e-06 2024-04-19T04:26:00.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.043821+0000", 2024-04-19T04:26:00.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1731999999999998e-05 2024-04-19T04:26:00.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044030+0000", 2024-04-19T04:26:00.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020882799999999999 2024-04-19T04:26:00.054 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.054 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.054 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.054 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:162765 5.8 5:19c85af6:::benchmark_data_smithi007_19526_object37031:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T04:26:00.054 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:00.044167+0000", 2024-04-19T04:26:00.054 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0028248499999999998, 2024-04-19T04:26:00.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002884925, 2024-04-19T04:26:00.055 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.055 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:00.055 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.055 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.055 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.055 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 162765 2024-04-19T04:26:00.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.056 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044167+0000", 2024-04-19T04:26:00.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044167+0000", 2024-04-19T04:26:00.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044166+0000", 2024-04-19T04:26:00.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044170+0000", 2024-04-19T04:26:00.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2259999999999999e-06 2024-04-19T04:26:00.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044184+0000", 2024-04-19T04:26:00.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3665e-05 2024-04-19T04:26:00.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044190+0000", 2024-04-19T04:26:00.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6319999999999996e-06 2024-04-19T04:26:00.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044244+0000", 2024-04-19T04:26:00.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4780000000000001e-05 2024-04-19T04:26:00.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044328+0000", 2024-04-19T04:26:00.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3478000000000003e-05 2024-04-19T04:26:00.059 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.059 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.059 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.060 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:162766 5.4 5:2b828125:::benchmark_data_smithi007_19526_object37032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T04:26:00.060 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:00.044200+0000", 2024-04-19T04:26:00.060 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0027910809999999999, 2024-04-19T04:26:00.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028866740000000001, 2024-04-19T04:26:00.060 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.060 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:00.060 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.060 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.060 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.061 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 162766 2024-04-19T04:26:00.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.061 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044200+0000", 2024-04-19T04:26:00.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044200+0000", 2024-04-19T04:26:00.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044200+0000", 2024-04-19T04:26:00.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044203+0000", 2024-04-19T04:26:00.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9330000000000001e-06 2024-04-19T04:26:00.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044210+0000", 2024-04-19T04:26:00.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5799999999999997e-06 2024-04-19T04:26:00.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044221+0000", 2024-04-19T04:26:00.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1768e-05 2024-04-19T04:26:00.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044268+0000", 2024-04-19T04:26:00.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6530999999999999e-05 2024-04-19T04:26:00.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044396+0000", 2024-04-19T04:26:00.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128011 2024-04-19T04:26:00.067 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.068 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.068 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.068 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:162763 5.9 e53/20 5:9103127b:::benchmark_data_smithi007_19526_object37029:head v 53'10420, mlcod=53'10418)", 2024-04-19T04:26:00.068 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:00.044382+0000", 2024-04-19T04:26:00.068 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0026099069999999999, 2024-04-19T04:26:00.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00274953, 2024-04-19T04:26:00.069 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.069 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:00.069 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044382+0000", 2024-04-19T04:26:00.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044382+0000", 2024-04-19T04:26:00.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044381+0000", 2024-04-19T04:26:00.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044389+0000", 2024-04-19T04:26:00.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0199999999999994e-06 2024-04-19T04:26:00.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044398+0000", 2024-04-19T04:26:00.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5519999999999993e-06 2024-04-19T04:26:00.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044405+0000", 2024-04-19T04:26:00.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0759999999999997e-06 2024-04-19T04:26:00.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044449+0000", 2024-04-19T04:26:00.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3597000000000003e-05 2024-04-19T04:26:00.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.044468+0000", 2024-04-19T04:26:00.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9102000000000001e-05 2024-04-19T04:26:00.073 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.073 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.073 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.073 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:162767 5.9 e53/20 5:907531e2:::benchmark_data_smithi007_19526_object37033:head v 53'10421, mlcod=53'10418)", 2024-04-19T04:26:00.073 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:00.046168+0000", 2024-04-19T04:26:00.074 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00082313600000000003, 2024-04-19T04:26:00.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00099383000000000002, 2024-04-19T04:26:00.074 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.074 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:00.074 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.046168+0000", 2024-04-19T04:26:00.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.046168+0000", 2024-04-19T04:26:00.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.046168+0000", 2024-04-19T04:26:00.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.046175+0000", 2024-04-19T04:26:00.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2869999999999999e-06 2024-04-19T04:26:00.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.046185+0000", 2024-04-19T04:26:00.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0382e-05 2024-04-19T04:26:00.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.046192+0000", 2024-04-19T04:26:00.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7710000000000001e-06 2024-04-19T04:26:00.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.046526+0000", 2024-04-19T04:26:00.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00033413300000000002 2024-04-19T04:26:00.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:00.046555+0000", 2024-04-19T04:26:00.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9105e-05 2024-04-19T04:26:00.077 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.077 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.077 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.077 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.077 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:26:00.077 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 5 2024-04-19T04:26:00.077 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:00.078 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:00.127 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:00.125+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:00.176 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T04:26:00.199 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:00.200 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:00.200 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:00.200 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:00.200 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:00.212 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:00.229 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:00.225+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:00.329 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:00.329+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:00.334 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:00.334 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:00.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:00.335 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:00.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.335 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:00.335 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:26:00.335 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 66.097696693000003, 2024-04-19T04:26:00.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:26:00.335 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.335 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.335 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.335 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.335 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.335 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:26:00.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.335 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:26:00.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:26:00.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:26:00.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:00.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:26:00.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:26:00.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:26:00.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:26:00.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:26:00.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:26:00.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:26:00.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:26:00.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:26:00.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:26:00.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:26:00.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:26:00.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:26:00.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:00.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:26:00.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:26:00.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:00.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:26:00.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:26:00.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:00.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:26:00.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:26:00.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:26:00.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:26:00.340 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.340 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.340 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.340 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:00.341 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:26:00.341 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 66.093247777000002, 2024-04-19T04:26:00.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:26:00.341 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.341 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.341 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.341 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.341 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.341 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:26:00.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.341 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:26:00.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:26:00.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:26:00.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:00.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:26:00.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:26:00.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:26:00.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:26:00.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:26:00.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:26:00.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:26:00.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:26:00.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:26:00.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:26:00.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:26:00.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:26:00.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:26:00.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:00.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:26:00.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:26:00.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:00.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:26:00.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:26:00.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:00.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:26:00.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:26:00.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:26:00.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:26:00.346 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.346 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.347 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.347 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:00.347 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:26:00.347 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 47.265315534000003, 2024-04-19T04:26:00.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:26:00.347 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.347 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.347 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.347 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.347 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.347 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:26:00.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.348 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:26:00.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:26:00.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:26:00.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:26:00.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:26:00.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:26:00.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:26:00.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:26:00.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:26:00.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:26:00.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:26:00.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:26:00.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:26:00.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:00.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:26:00.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:26:00.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:00.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:26:00.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:26:00.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:00.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:26:00.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:26:00.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:00.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:26:00.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:26:00.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:26:00.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:26:00.352 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.352 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.352 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.353 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:00.353 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:26:00.353 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 44.829461496999997, 2024-04-19T04:26:00.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:26:00.353 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.353 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.353 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.353 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.353 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.353 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:26:00.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.353 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:26:00.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:26:00.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:26:00.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:26:00.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:26:00.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:26:00.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:26:00.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:26:00.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:26:00.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:26:00.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:26:00.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:26:00.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:26:00.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:00.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:26:00.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:26:00.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:00.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:26:00.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:26:00.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:00.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:26:00.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:26:00.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:00.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:26:00.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:26:00.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:26:00.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:26:00.358 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.358 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.358 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.359 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:00.359 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:26:00.359 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 44.829031077000003, 2024-04-19T04:26:00.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:26:00.359 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.359 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.359 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.359 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.359 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.359 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:26:00.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.359 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:26:00.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:26:00.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:26:00.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:26:00.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:26:00.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:26:00.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:26:00.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:26:00.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:26:00.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:26:00.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:26:00.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:26:00.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:26:00.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:00.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:26:00.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:26:00.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:00.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:26:00.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:26:00.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:00.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:26:00.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:26:00.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:00.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:26:00.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:26:00.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:26:00.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:26:00.364 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.364 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.364 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.365 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:00.365 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:26:00.365 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 44.826799813000001, 2024-04-19T04:26:00.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:26:00.365 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.365 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.365 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.365 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.365 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.365 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:26:00.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.365 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:26:00.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:26:00.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:26:00.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:00.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:26:00.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:26:00.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:26:00.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:26:00.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:26:00.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:26:00.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:26:00.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:26:00.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:26:00.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:26:00.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:00.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:26:00.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:26:00.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:00.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:26:00.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:26:00.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:00.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:26:00.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:26:00.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:00.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:26:00.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:26:00.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:26:00.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:26:00.370 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.370 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.370 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.370 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:00.370 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:26:00.371 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 44.823402774999998, 2024-04-19T04:26:00.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:26:00.371 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.371 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.371 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.371 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.371 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.371 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:26:00.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.371 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:26:00.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:26:00.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:26:00.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:00.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:26:00.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:26:00.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:26:00.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:26:00.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:26:00.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:26:00.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:26:00.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:26:00.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:26:00.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:26:00.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:00.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:26:00.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:26:00.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:00.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:26:00.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:26:00.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:00.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:26:00.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:26:00.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:00.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:26:00.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:26:00.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:26:00.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:26:00.376 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.376 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.377 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.377 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:00.377 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:26:00.377 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 44.818274576999997, 2024-04-19T04:26:00.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:26:00.378 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.378 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.378 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.378 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.378 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.378 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:26:00.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.378 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:26:00.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:26:00.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:26:00.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:26:00.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:26:00.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:26:00.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:26:00.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:26:00.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:26:00.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:26:00.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:26:00.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:26:00.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:26:00.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:00.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:26:00.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:26:00.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:00.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:26:00.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:26:00.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:00.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:26:00.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:26:00.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:00.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:26:00.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:26:00.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:26:00.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:26:00.382 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.382 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.382 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.383 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:00.383 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:26:00.383 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 44.504246072000001, 2024-04-19T04:26:00.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:26:00.383 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.383 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.383 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.383 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.383 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.383 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:26:00.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.383 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:26:00.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:26:00.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:26:00.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:26:00.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:26:00.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:26:00.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:26:00.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:26:00.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:26:00.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:26:00.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:26:00.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:26:00.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:26:00.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:00.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:26:00.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:26:00.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:00.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:26:00.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:26:00.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:00.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:26:00.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:26:00.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:00.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:26:00.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:26:00.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:26:00.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:26:00.388 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.388 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.388 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.389 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:00.389 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:00.389 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 44.381886661999999, 2024-04-19T04:26:00.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:00.389 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.389 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:00.389 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.389 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.389 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.389 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:00.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.389 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:00.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:00.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:00.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:00.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:00.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:00.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:00.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:00.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:00.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:00.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:00.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:00.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:00.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:00.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:00.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:00.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:00.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:00.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:00.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:00.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:00.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:00.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:00.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:00.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:00.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:00.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:00.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:00.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:00.395 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.395 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.395 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.395 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:00.395 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:00.395 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 44.376825015999998, 2024-04-19T04:26:00.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:00.395 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.395 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:00.395 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.396 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.396 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.396 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:00.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.396 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:00.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:00.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:00.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:00.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:00.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:00.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:00.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:00.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:00.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:00.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:00.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:00.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:00.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:00.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:00.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:00.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:00.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:00.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:00.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:00.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:00.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:00.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:00.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:00.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:00.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:00.400 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.400 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.400 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.401 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:00.401 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:00.401 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 44.376725104000002, 2024-04-19T04:26:00.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:00.401 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.401 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:00.401 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.401 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.401 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.401 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:00.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.401 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:00.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:00.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:00.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:00.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:00.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:00.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:00.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:00.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:00.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:00.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:00.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:00.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:00.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:00.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:00.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:00.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:00.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:00.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:00.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:00.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:00.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:00.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:00.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:00.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:00.407 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.407 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.407 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.407 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:00.407 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:00.407 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 44.376599351000003, 2024-04-19T04:26:00.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:00.408 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.408 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:00.408 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.408 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.408 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.408 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:00.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.408 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:00.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:00.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:00.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:00.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:00.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:00.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:00.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:00.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:00.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:00.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:00.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:00.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:00.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:00.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:00.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:00.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:00.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:00.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:00.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:00.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:00.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:00.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:00.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:00.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:00.412 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.412 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.413 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:00.413 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:00.413 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 44.372755406000003, 2024-04-19T04:26:00.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:00.413 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.413 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.413 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.413 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.413 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.413 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:00.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.414 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:00.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:00.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:00.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:00.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:00.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:00.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:00.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:00.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:00.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:00.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:00.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:00.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:00.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:00.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:00.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:00.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:00.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:00.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:00.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:00.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:00.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:00.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:00.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:00.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:00.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:00.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:00.418 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.418 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.418 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.419 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:00.419 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:00.419 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 44.365584304999999, 2024-04-19T04:26:00.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:00.419 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.419 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:00.419 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.419 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.419 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.419 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:00.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.419 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:00.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:00.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:00.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:00.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:00.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:00.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:00.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:00.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:00.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:00.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:00.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:00.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:00.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:00.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:00.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:00.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:00.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:00.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:00.423 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.423 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.423 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.423 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:00.423 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:00.423 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 44.365412200999998, 2024-04-19T04:26:00.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:00.423 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.423 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:00.424 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.424 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.424 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.424 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:00.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.424 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:00.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:00.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:00.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:00.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:00.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:00.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:00.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:00.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:00.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:00.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:00.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:00.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:00.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:00.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:00.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:00.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:00.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:00.427 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.427 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.427 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.428 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:00.428 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:00.428 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 44.365349076000001, 2024-04-19T04:26:00.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:00.428 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.428 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.428 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.428 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.428 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.429 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:00.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.429 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:00.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:00.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:00.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:00.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:00.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:00.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:00.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:00.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:00.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:00.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:00.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:00.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:00.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:00.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:00.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:00.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:00.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:00.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:00.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:00.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:00.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:00.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:00.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:00.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:00.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:00.433 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.433 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.433 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.434 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:00.434 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:00.434 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 44.365220479000001, 2024-04-19T04:26:00.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:00.434 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.434 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.434 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.434 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.434 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.434 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:00.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.434 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:00.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:00.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:00.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:00.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:00.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:00.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:00.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:00.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:00.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:00.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:00.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:00.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:00.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:00.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:00.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:00.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:00.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:00.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:00.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:00.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:00.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:00.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:00.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:00.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:00.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:00.439 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.439 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.439 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.440 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:00.440 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:00.440 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 44.365152508000001, 2024-04-19T04:26:00.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:00.440 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.440 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.440 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.440 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.440 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.440 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:00.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.440 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:00.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:00.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:00.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:00.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:00.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:00.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:00.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:00.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:00.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:00.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:00.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:00.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:00.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:00.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:00.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:00.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:00.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:00.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:00.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:00.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:00.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:00.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:00.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:00.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:00.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:00.445 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.445 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.445 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.445 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:111654 5.0 5:0b6b473d:::benchmark_data_smithi007_19526_object111653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:26:00.445 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:26:00.445 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.417361402000001, 2024-04-19T04:26:00.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023122753999999999, 2024-04-19T04:26:00.445 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:00.446 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.446 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:00.446 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:00.446 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.446 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 111654 2024-04-19T04:26:00.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.446 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:00.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:00.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:26:00.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:00.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:26:00.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:00.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:00.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915865+0000", 2024-04-19T04:26:00.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:00.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915897+0000", 2024-04-19T04:26:00.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1708999999999997e-05 2024-04-19T04:26:00.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:00.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915905+0000", 2024-04-19T04:26:00.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.481e-06 2024-04-19T04:26:00.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915911+0000", 2024-04-19T04:26:00.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6880000000000002e-06 2024-04-19T04:26:00.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:00.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925564+0000", 2024-04-19T04:26:00.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096527039999999998 2024-04-19T04:26:00.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:00.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925771+0000", 2024-04-19T04:26:00.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020717199999999999 2024-04-19T04:26:00.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:00.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938888+0000", 2024-04-19T04:26:00.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013117105 2024-04-19T04:26:00.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:00.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938931+0000", 2024-04-19T04:26:00.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2447000000000002e-05 2024-04-19T04:26:00.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:00.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:00.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:00.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938989+0000", 2024-04-19T04:26:00.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7997000000000001e-05 2024-04-19T04:26:00.450 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.450 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.450 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.450 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:00.450 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:00.450 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:00.451 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:00.449+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:00.452 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:00.553 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:00.549+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:00.585 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:00.585 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:00.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.586 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:164085 5.f 5:f2427045:::benchmark_data_smithi007_19526_object38351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T04:26:00.586 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:00.576686+0000", 2024-04-19T04:26:00.586 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00898411, 2024-04-19T04:26:00.586 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0090095020000000008, 2024-04-19T04:26:00.586 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.586 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:00.587 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.587 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.587 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.587 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 164085 2024-04-19T04:26:00.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.587 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.587 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.587 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.587 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.576686+0000", 2024-04-19T04:26:00.587 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.576686+0000", 2024-04-19T04:26:00.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.576685+0000", 2024-04-19T04:26:00.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.576688+0000", 2024-04-19T04:26:00.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.7989999999999998e-06 2024-04-19T04:26:00.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.589 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.589 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.576694+0000", 2024-04-19T04:26:00.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9739999999999999e-06 2024-04-19T04:26:00.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.589 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.589 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.576699+0000", 2024-04-19T04:26:00.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8899999999999998e-06 2024-04-19T04:26:00.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.589 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.590 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.580433+0000", 2024-04-19T04:26:00.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003733779 2024-04-19T04:26:00.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.590 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.590 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.590 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.580566+0000", 2024-04-19T04:26:00.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013364799999999999 2024-04-19T04:26:00.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.590 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.590 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:00.590 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.580699+0000", 2024-04-19T04:26:00.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013257399999999999 2024-04-19T04:26:00.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:00.591 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.585307+0000", 2024-04-19T04:26:00.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0046080009999999996 2024-04-19T04:26:00.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:00.591 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.585668+0000", 2024-04-19T04:26:00.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00036081299999999998 2024-04-19T04:26:00.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:00.591 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.585703+0000", 2024-04-19T04:26:00.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4978000000000003e-05 2024-04-19T04:26:00.591 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.592 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.592 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.592 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:164089 5.6 5:654b5b8f:::benchmark_data_smithi007_19526_object38355:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T04:26:00.592 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:00.577237+0000", 2024-04-19T04:26:00.592 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0084325430000000007, 2024-04-19T04:26:00.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0085412539999999999, 2024-04-19T04:26:00.592 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.592 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:00.592 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.592 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.592 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.592 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 164089 2024-04-19T04:26:00.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.593 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.593 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.577237+0000", 2024-04-19T04:26:00.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.593 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.577237+0000", 2024-04-19T04:26:00.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.594 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.594 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.577236+0000", 2024-04-19T04:26:00.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.594 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.594 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.594 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.594 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.577240+0000", 2024-04-19T04:26:00.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4060000000000001e-06 2024-04-19T04:26:00.594 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.594 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.594 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.594 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.577255+0000", 2024-04-19T04:26:00.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4746000000000001e-05 2024-04-19T04:26:00.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.577259+0000", 2024-04-19T04:26:00.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7809999999999996e-06 2024-04-19T04:26:00.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.579916+0000", 2024-04-19T04:26:00.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026563580000000002 2024-04-19T04:26:00.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.580007+0000", 2024-04-19T04:26:00.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1068000000000003e-05 2024-04-19T04:26:00.598 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.598 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.598 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.599 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:164095 5.7 5:e39fbf42:::benchmark_data_smithi007_19526_object38361:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T04:26:00.599 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:00.578310+0000", 2024-04-19T04:26:00.599 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0073598179999999997, 2024-04-19T04:26:00.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075078760000000001, 2024-04-19T04:26:00.599 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.599 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:00.599 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.599 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.599 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.599 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 164095 2024-04-19T04:26:00.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.599 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.599 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.578310+0000", 2024-04-19T04:26:00.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.578310+0000", 2024-04-19T04:26:00.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.578309+0000", 2024-04-19T04:26:00.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.578313+0000", 2024-04-19T04:26:00.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1489999999999998e-06 2024-04-19T04:26:00.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.578318+0000", 2024-04-19T04:26:00.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8939999999999998e-06 2024-04-19T04:26:00.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.578322+0000", 2024-04-19T04:26:00.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0130000000000004e-06 2024-04-19T04:26:00.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.580422+0000", 2024-04-19T04:26:00.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0020990290000000001 2024-04-19T04:26:00.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.580567+0000", 2024-04-19T04:26:00.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014531599999999999 2024-04-19T04:26:00.602 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.602 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.602 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.603 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:164096 5.d 5:b8e0701b:::benchmark_data_smithi007_19526_object38362:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T04:26:00.603 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:00.580031+0000", 2024-04-19T04:26:00.603 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0056383880000000003, 2024-04-19T04:26:00.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0058329410000000003, 2024-04-19T04:26:00.603 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.603 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:00.603 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.603 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.603 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.603 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 164096 2024-04-19T04:26:00.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.604 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.580031+0000", 2024-04-19T04:26:00.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.580031+0000", 2024-04-19T04:26:00.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.580030+0000", 2024-04-19T04:26:00.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.580035+0000", 2024-04-19T04:26:00.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9409999999999998e-06 2024-04-19T04:26:00.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.580043+0000", 2024-04-19T04:26:00.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0290000000000005e-06 2024-04-19T04:26:00.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.580051+0000", 2024-04-19T04:26:00.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.481e-06 2024-04-19T04:26:00.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.580099+0000", 2024-04-19T04:26:00.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7713999999999998e-05 2024-04-19T04:26:00.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.580173+0000", 2024-04-19T04:26:00.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4742999999999999e-05 2024-04-19T04:26:00.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:00.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.580231+0000", 2024-04-19T04:26:00.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7367000000000001e-05 2024-04-19T04:26:00.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:00.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583711+0000", 2024-04-19T04:26:00.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00348066 2024-04-19T04:26:00.607 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.607 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.607 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.608 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:164098 5.c 5:3368fe91:::benchmark_data_smithi007_19526_object38364:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T04:26:00.608 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:00.581472+0000", 2024-04-19T04:26:00.608 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.004197999, 2024-04-19T04:26:00.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0044330020000000001, 2024-04-19T04:26:00.608 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.608 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:00.608 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.608 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.608 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.608 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 164098 2024-04-19T04:26:00.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.608 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.581472+0000", 2024-04-19T04:26:00.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.581472+0000", 2024-04-19T04:26:00.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.581471+0000", 2024-04-19T04:26:00.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.581475+0000", 2024-04-19T04:26:00.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1019999999999999e-06 2024-04-19T04:26:00.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.581485+0000", 2024-04-19T04:26:00.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5559999999999996e-06 2024-04-19T04:26:00.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.581490+0000", 2024-04-19T04:26:00.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9740000000000001e-06 2024-04-19T04:26:00.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.581532+0000", 2024-04-19T04:26:00.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2493999999999997e-05 2024-04-19T04:26:00.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.581613+0000", 2024-04-19T04:26:00.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0548000000000002e-05 2024-04-19T04:26:00.611 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.611 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.611 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.612 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:164100 5.f 5:fb23b204:::benchmark_data_smithi007_19526_object38366:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T04:26:00.612 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:00.583278+0000", 2024-04-19T04:26:00.612 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0023921559999999999, 2024-04-19T04:26:00.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026603220000000001, 2024-04-19T04:26:00.612 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.612 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:00.612 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.612 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.612 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.612 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 164100 2024-04-19T04:26:00.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.612 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.612 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.612 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583278+0000", 2024-04-19T04:26:00.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583278+0000", 2024-04-19T04:26:00.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583277+0000", 2024-04-19T04:26:00.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583282+0000", 2024-04-19T04:26:00.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9919999999999998e-06 2024-04-19T04:26:00.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583293+0000", 2024-04-19T04:26:00.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1073000000000001e-05 2024-04-19T04:26:00.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583298+0000", 2024-04-19T04:26:00.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.643e-06 2024-04-19T04:26:00.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583333+0000", 2024-04-19T04:26:00.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4615e-05 2024-04-19T04:26:00.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583426+0000", 2024-04-19T04:26:00.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2725000000000004e-05 2024-04-19T04:26:00.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:00.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583492+0000", 2024-04-19T04:26:00.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6626999999999998e-05 2024-04-19T04:26:00.616 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.616 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.616 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.616 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:164102 5.3 5:ce043bdf:::benchmark_data_smithi007_19526_object38368:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T04:26:00.616 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:00.583399+0000", 2024-04-19T04:26:00.616 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0022707309999999998, 2024-04-19T04:26:00.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0025748390000000002, 2024-04-19T04:26:00.616 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.616 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:00.616 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.616 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.617 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.617 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 164102 2024-04-19T04:26:00.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.617 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583399+0000", 2024-04-19T04:26:00.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583399+0000", 2024-04-19T04:26:00.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583398+0000", 2024-04-19T04:26:00.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583405+0000", 2024-04-19T04:26:00.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.426e-06 2024-04-19T04:26:00.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583411+0000", 2024-04-19T04:26:00.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:00.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583415+0000", 2024-04-19T04:26:00.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.8789999999999996e-06 2024-04-19T04:26:00.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583456+0000", 2024-04-19T04:26:00.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.125e-05 2024-04-19T04:26:00.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583530+0000", 2024-04-19T04:26:00.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3759999999999999e-05 2024-04-19T04:26:00.620 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.620 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.620 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.620 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:164104 5.2 5:42d37c44:::benchmark_data_smithi007_19526_object38370:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T04:26:00.620 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:00.583879+0000", 2024-04-19T04:26:00.620 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0017905600000000001, 2024-04-19T04:26:00.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0021359030000000002, 2024-04-19T04:26:00.620 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.621 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:00.621 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.621 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.621 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.621 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 164104 2024-04-19T04:26:00.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.621 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583879+0000", 2024-04-19T04:26:00.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583879+0000", 2024-04-19T04:26:00.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583878+0000", 2024-04-19T04:26:00.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583882+0000", 2024-04-19T04:26:00.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5999999999999998e-06 2024-04-19T04:26:00.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583891+0000", 2024-04-19T04:26:00.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2690000000000005e-06 2024-04-19T04:26:00.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583896+0000", 2024-04-19T04:26:00.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8770000000000001e-06 2024-04-19T04:26:00.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.583950+0000", 2024-04-19T04:26:00.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3696999999999998e-05 2024-04-19T04:26:00.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.584109+0000", 2024-04-19T04:26:00.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015919799999999999 2024-04-19T04:26:00.624 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.624 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.624 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.624 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:164105 5.6 5:6053c7e7:::benchmark_data_smithi007_19526_object38371:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T04:26:00.624 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:00.584365+0000", 2024-04-19T04:26:00.625 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0013045050000000001, 2024-04-19T04:26:00.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001718654, 2024-04-19T04:26:00.625 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.625 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:00.625 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.625 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.625 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.625 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 164105 2024-04-19T04:26:00.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.625 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.584365+0000", 2024-04-19T04:26:00.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.584365+0000", 2024-04-19T04:26:00.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.584365+0000", 2024-04-19T04:26:00.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.584368+0000", 2024-04-19T04:26:00.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1609999999999999e-06 2024-04-19T04:26:00.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.584380+0000", 2024-04-19T04:26:00.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.172e-05 2024-04-19T04:26:00.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.584383+0000", 2024-04-19T04:26:00.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7220000000000001e-06 2024-04-19T04:26:00.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.584419+0000", 2024-04-19T04:26:00.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5589000000000001e-05 2024-04-19T04:26:00.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.584508+0000", 2024-04-19T04:26:00.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.8714000000000005e-05 2024-04-19T04:26:00.628 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.628 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.628 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.628 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:164107 5.d 5:be0b5ffe:::benchmark_data_smithi007_19526_object38373:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T04:26:00.628 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:00.584598+0000", 2024-04-19T04:26:00.628 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0010718889999999999, 2024-04-19T04:26:00.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001548628, 2024-04-19T04:26:00.628 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.629 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:00.629 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.629 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.629 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.629 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 164107 2024-04-19T04:26:00.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.629 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.584598+0000", 2024-04-19T04:26:00.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.584598+0000", 2024-04-19T04:26:00.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.584597+0000", 2024-04-19T04:26:00.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.584602+0000", 2024-04-19T04:26:00.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2959999999999998e-06 2024-04-19T04:26:00.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.584612+0000", 2024-04-19T04:26:00.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8549999999999997e-06 2024-04-19T04:26:00.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.584620+0000", 2024-04-19T04:26:00.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5519999999999999e-06 2024-04-19T04:26:00.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.584669+0000", 2024-04-19T04:26:00.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9184999999999997e-05 2024-04-19T04:26:00.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.584799+0000", 2024-04-19T04:26:00.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000129763 2024-04-19T04:26:00.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:00.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:00.584897+0000", 2024-04-19T04:26:00.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8515000000000001e-05 2024-04-19T04:26:00.632 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.632 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.632 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.633 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.633 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:00.633 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 10 2024-04-19T04:26:00.633 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:00.634 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:00.653 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:00.653+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:00.754 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:00.753+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:00.761 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:00.761 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:00.761 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:00.761 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:00.761 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:00.774 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:00.855 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:00.853+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:00.911 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:00.911 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:00.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:00.911 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:00.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.912 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:00.912 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:00.912 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 66.678780505000006, 2024-04-19T04:26:00.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:00.912 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.912 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.912 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.912 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.912 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.912 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:00.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.912 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:00.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:00.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:00.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:00.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:00.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:00.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:00.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:00.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:00.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:00.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:00.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:00.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:00.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:00.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:00.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:00.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:00.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:00.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:00.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:00.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:00.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:00.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:00.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:00.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:00.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:00.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:00.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:00.918 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.918 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.918 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.918 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26160 5.f 5:ffed8892:::benchmark_data_smithi007_19526_object26159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:00.919 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:26:00.919 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 66.675599348999995, 2024-04-19T04:26:00.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047316307000000002, 2024-04-19T04:26:00.919 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.919 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.919 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.919 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.919 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.919 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26160 2024-04-19T04:26:00.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.919 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:26:00.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.920 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:26:00.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.920 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234705+0000", 2024-04-19T04:26:00.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234797+0000", 2024-04-19T04:26:00.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2439e-05 2024-04-19T04:26:00.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234807+0000", 2024-04-19T04:26:00.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0057e-05 2024-04-19T04:26:00.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234813+0000", 2024-04-19T04:26:00.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7980000000000002e-06 2024-04-19T04:26:00.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234850+0000", 2024-04-19T04:26:00.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7348999999999998e-05 2024-04-19T04:26:00.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234932+0000", 2024-04-19T04:26:00.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1672e-05 2024-04-19T04:26:00.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:00.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235017+0000", 2024-04-19T04:26:00.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4882000000000005e-05 2024-04-19T04:26:00.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:00.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280308+0000", 2024-04-19T04:26:00.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045291089 2024-04-19T04:26:00.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:00.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281863+0000", 2024-04-19T04:26:00.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015553030000000001 2024-04-19T04:26:00.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:00.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281953+0000", 2024-04-19T04:26:00.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9468999999999993e-05 2024-04-19T04:26:00.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.925 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:00.925 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282022+0000", 2024-04-19T04:26:00.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9156e-05 2024-04-19T04:26:00.925 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.925 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.925 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.925 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:26:00.925 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:26:00.925 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 66.675031245, 2024-04-19T04:26:00.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:26:00.925 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.925 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.926 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.926 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.926 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:26:00.926 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.926 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.926 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:26:00.926 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.926 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.926 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:26:00.926 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:26:00.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:26:00.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:26:00.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:26:00.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:26:00.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:26:00.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:26:00.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:26:00.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:26:00.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:26:00.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:00.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:26:00.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:26:00.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:00.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:26:00.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:26:00.929 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.929 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.929 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.930 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:00.930 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:00.930 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 66.674685584000002, 2024-04-19T04:26:00.930 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:00.930 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.930 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.930 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.930 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.930 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.930 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:00.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.930 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:00.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:00.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:00.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.932 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.932 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:00.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:00.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.932 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.932 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:00.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:00.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.932 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.933 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:00.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:00.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.933 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:00.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:00.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.933 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:00.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:00.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.934 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:00.934 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:00.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:00.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.934 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:00.934 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:00.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:00.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.934 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:00.934 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:00.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:00.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.935 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.935 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:00.935 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:00.935 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:00.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.935 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.935 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:00.935 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:00.935 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:00.935 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.935 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.935 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.936 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.936 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26162 5.d e27/20 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head v 27'1549, mlcod=27'1547)", 2024-04-19T04:26:00.936 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:26:00.936 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 66.673961145999996, 2024-04-19T04:26:00.936 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047289108000000003, 2024-04-19T04:26:00.936 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.936 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.936 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.936 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.936 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.936 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:26:00.936 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.936 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.936 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.936 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.937 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236344+0000", 2024-04-19T04:26:00.937 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.937 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.937 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.937 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.937 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236343+0000", 2024-04-19T04:26:00.937 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.937 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.937 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.937 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.937 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236466+0000", 2024-04-19T04:26:00.937 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012358599999999999 2024-04-19T04:26:00.937 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.937 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.938 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.938 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236480+0000", 2024-04-19T04:26:00.938 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4093999999999999e-05 2024-04-19T04:26:00.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.938 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.938 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.938 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236486+0000", 2024-04-19T04:26:00.938 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9449999999999998e-06 2024-04-19T04:26:00.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.938 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.938 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.938 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236528+0000", 2024-04-19T04:26:00.938 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2054000000000001e-05 2024-04-19T04:26:00.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.938 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.939 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.939 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236544+0000", 2024-04-19T04:26:00.939 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5732000000000001e-05 2024-04-19T04:26:00.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.939 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.939 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:00.939 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283506+0000", 2024-04-19T04:26:00.939 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046962232 2024-04-19T04:26:00.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.939 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.939 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:00.939 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283633+0000", 2024-04-19T04:26:00.939 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126344 2024-04-19T04:26:00.939 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.939 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.940 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.940 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26164 5.6 e27/20 5:63a08103:::benchmark_data_smithi007_19526_object26163:head v 27'1663, mlcod=27'1660)", 2024-04-19T04:26:00.940 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:26:00.940 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 66.673953750999999, 2024-04-19T04:26:00.940 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046549159, 2024-04-19T04:26:00.940 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.940 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.940 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.940 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.940 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:26:00.940 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.941 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.941 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.941 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:26:00.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.941 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.941 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.941 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236351+0000", 2024-04-19T04:26:00.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.941 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.941 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.941 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236421+0000", 2024-04-19T04:26:00.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0393000000000002e-05 2024-04-19T04:26:00.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.942 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.942 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.942 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236432+0000", 2024-04-19T04:26:00.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1181e-05 2024-04-19T04:26:00.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.942 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.942 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.942 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236440+0000", 2024-04-19T04:26:00.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3540000000000002e-06 2024-04-19T04:26:00.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.942 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236493+0000", 2024-04-19T04:26:00.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3041999999999998e-05 2024-04-19T04:26:00.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236509+0000", 2024-04-19T04:26:00.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6501999999999999e-05 2024-04-19T04:26:00.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:00.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282742+0000", 2024-04-19T04:26:00.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046232629999999997 2024-04-19T04:26:00.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:00.944 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.282900+0000", 2024-04-19T04:26:00.944 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158505 2024-04-19T04:26:00.944 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.944 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.944 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.944 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26169 5.9 5:98e6d315:::benchmark_data_smithi007_19526_object26168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:00.944 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:26:00.944 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 66.672128603999994, 2024-04-19T04:26:00.944 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046067657999999997, 2024-04-19T04:26:00.944 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.944 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.945 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.945 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.945 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.945 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26169 2024-04-19T04:26:00.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.945 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.945 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:26:00.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.945 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238176+0000", 2024-04-19T04:26:00.946 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238175+0000", 2024-04-19T04:26:00.946 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238219+0000", 2024-04-19T04:26:00.946 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3890000000000002e-05 2024-04-19T04:26:00.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.947 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238230+0000", 2024-04-19T04:26:00.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0747999999999999e-05 2024-04-19T04:26:00.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.947 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.947 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.947 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238236+0000", 2024-04-19T04:26:00.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9150000000000001e-06 2024-04-19T04:26:00.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.947 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.947 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.947 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238302+0000", 2024-04-19T04:26:00.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6482000000000005e-05 2024-04-19T04:26:00.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.947 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238429+0000", 2024-04-19T04:26:00.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012721499999999999 2024-04-19T04:26:00.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:00.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238560+0000", 2024-04-19T04:26:00.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013049000000000001 2024-04-19T04:26:00.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:00.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283867+0000", 2024-04-19T04:26:00.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.045307282999999997 2024-04-19T04:26:00.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:00.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284092+0000", 2024-04-19T04:26:00.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022428699999999999 2024-04-19T04:26:00.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:00.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284147+0000", 2024-04-19T04:26:00.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5328999999999998e-05 2024-04-19T04:26:00.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:00.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284244+0000", 2024-04-19T04:26:00.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7016999999999996e-05 2024-04-19T04:26:00.949 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.949 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.950 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.950 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:00.950 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:00.950 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 66.671394398999993, 2024-04-19T04:26:00.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:00.950 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.950 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.950 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.950 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.950 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.950 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:00.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.950 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:00.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:00.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:00.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.952 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.952 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.952 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:00.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:00.952 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.952 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.952 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.952 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:00.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:00.952 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.952 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.952 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.952 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:00.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:00.953 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.953 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.953 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.953 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:00.953 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:00.953 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.953 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.953 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.953 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:00.953 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:00.953 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.953 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.953 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:00.953 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:00.953 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:00.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.954 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.954 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:00.954 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:00.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:00.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.954 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.954 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:00.954 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:00.954 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:00.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.954 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.954 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:00.955 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:00.955 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:00.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.955 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:00.955 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:00.955 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:00.955 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.955 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.955 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.955 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26170 5.c e27/20 5:3064fd07:::benchmark_data_smithi007_19526_object26169:head v 27'1578, mlcod=27'1576)", 2024-04-19T04:26:00.955 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:26:00.955 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 66.670860122999997, 2024-04-19T04:26:00.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043872535999999997, 2024-04-19T04:26:00.956 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.956 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.956 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:26:00.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.956 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.956 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239445+0000", 2024-04-19T04:26:00.956 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239444+0000", 2024-04-19T04:26:00.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239480+0000", 2024-04-19T04:26:00.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6417e-05 2024-04-19T04:26:00.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.957 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.957 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239497+0000", 2024-04-19T04:26:00.957 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.734e-05 2024-04-19T04:26:00.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.957 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239507+0000", 2024-04-19T04:26:00.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8430000000000005e-06 2024-04-19T04:26:00.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239564+0000", 2024-04-19T04:26:00.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6313000000000001e-05 2024-04-19T04:26:00.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.958 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.958 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239584+0000", 2024-04-19T04:26:00.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0319999999999999e-05 2024-04-19T04:26:00.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.959 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.959 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:00.959 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283216+0000", 2024-04-19T04:26:00.959 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.043631842999999997 2024-04-19T04:26:00.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.959 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.959 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:00.959 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283317+0000", 2024-04-19T04:26:00.959 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010145 2024-04-19T04:26:00.959 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.959 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.959 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.959 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.960 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:00.960 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:00.960 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 44.954004933999997, 2024-04-19T04:26:00.960 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:00.960 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.960 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:00.960 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.960 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.960 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.960 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:00.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.960 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.960 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.960 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:00.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:00.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:00.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:00.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:00.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:00.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:00.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:00.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:00.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:00.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:00.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:00.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:00.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:00.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:00.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:00.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:00.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:00.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:00.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:00.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:00.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:00.965 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:00.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:00.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.965 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.965 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:00.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:00.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.965 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:00.965 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:00.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:00.965 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.965 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.966 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.966 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.966 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:00.966 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:00.966 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 44.933774485000001, 2024-04-19T04:26:00.966 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:00.966 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.966 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:00.966 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.966 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.966 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.966 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:00.966 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.967 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:00.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:00.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:00.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:00.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:00.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:00.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:00.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:00.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:00.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:00.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:00.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:00.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:00.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:00.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:00.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:00.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:00.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:00.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:00.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:00.970 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.970 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.970 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.971 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:00.971 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:00.971 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 44.933666627999997, 2024-04-19T04:26:00.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:00.971 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.971 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:00.971 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.971 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.971 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.971 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:00.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.971 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:00.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:00.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:00.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:00.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:00.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:00.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:00.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:00.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:00.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.974 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.974 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:00.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:00.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.974 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:00.974 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:00.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:00.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.974 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.974 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:00.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:00.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.975 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:00.975 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:00.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:00.975 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.975 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.975 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.975 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:00.975 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:00.975 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 44.931699938999998, 2024-04-19T04:26:00.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:00.976 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.976 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.976 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.976 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.976 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.976 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:00.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.976 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:00.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:00.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:00.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:00.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:00.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:00.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.978 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.978 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:00.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:00.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.978 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.978 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.978 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:00.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:00.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.978 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.978 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.978 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:00.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:00.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:00.979 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:00.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:00.979 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.979 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:00.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:00.979 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.979 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.979 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:00.979 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:00.979 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.980 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:00.980 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:00.980 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:00.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.980 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:00.980 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:00.980 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:00.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.980 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:00.980 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:00.980 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:00.980 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.980 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.981 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.981 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.981 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:00.981 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:00.981 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 44.928335744000002, 2024-04-19T04:26:00.981 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:00.981 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.981 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.981 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.981 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.981 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.981 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:00.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.982 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.982 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:00.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.982 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:00.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.982 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.982 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:00.982 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:00.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:00.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:00.983 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:00.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.983 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.983 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.983 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:00.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:00.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:00.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:00.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:00.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:00.984 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:00.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.984 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.984 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.984 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:00.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:00.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:00.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:00.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:00.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:00.985 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:00.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.985 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:00.985 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:00.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:00.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.986 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:00.986 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:00.986 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:00.986 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.986 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.986 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.986 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:00.986 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:00.986 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 44.924524765999998, 2024-04-19T04:26:00.987 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:00.987 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.987 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.987 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.987 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.987 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.987 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:00.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.987 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.987 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.987 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.987 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:00.987 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:00.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:00.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.988 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.988 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.988 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:00.988 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:00.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.989 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.989 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:00.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:00.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.989 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.989 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:00.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:00.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.989 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.989 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.989 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:00.989 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:00.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:00.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:00.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:00.990 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:00.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:00.990 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.990 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.990 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.990 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:00.990 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:00.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:00.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:00.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:00.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:00.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:00.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:00.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.991 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.991 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:00.991 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:00.991 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:00.992 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.992 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.992 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.992 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.992 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93735 5.1 5:8e609d1b:::benchmark_data_smithi007_19526_object93734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:00.992 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:26:00.992 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.682824122, 2024-04-19T04:26:00.992 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048424842000000003, 2024-04-19T04:26:00.992 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.992 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.992 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.992 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.992 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.992 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93735 2024-04-19T04:26:00.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.993 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:26:00.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:26:00.993 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.993 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.993 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.993 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227480+0000", 2024-04-19T04:26:00.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:00.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227533+0000", 2024-04-19T04:26:00.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2964999999999999e-05 2024-04-19T04:26:00.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.994 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227542+0000", 2024-04-19T04:26:00.994 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1449999999999997e-06 2024-04-19T04:26:00.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.994 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.995 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227561+0000", 2024-04-19T04:26:00.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9116000000000001e-05 2024-04-19T04:26:00.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.995 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:00.995 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227610+0000", 2024-04-19T04:26:00.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9234000000000003e-05 2024-04-19T04:26:00.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.995 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:00.995 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227697+0000", 2024-04-19T04:26:00.995 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6682999999999997e-05 2024-04-19T04:26:00.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:00.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275809+0000", 2024-04-19T04:26:00.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048112265000000001 2024-04-19T04:26:00.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:00.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275845+0000", 2024-04-19T04:26:00.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5275999999999999e-05 2024-04-19T04:26:00.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.996 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.996 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:00.996 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275906+0000", 2024-04-19T04:26:00.996 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1002999999999999e-05 2024-04-19T04:26:00.996 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.996 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:00.997 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:00.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.997 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93736 5.1 5:852229ec:::benchmark_data_smithi007_19526_object93735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:00.997 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:26:00.997 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.682720092, 2024-04-19T04:26:00.997 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048414497000000001, 2024-04-19T04:26:00.997 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:00.997 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:00.997 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:00.997 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:00.997 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:00.997 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93736 2024-04-19T04:26:00.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.998 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:00.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:00.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:26:00.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:00.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:26:00.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:00.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.998 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:00.998 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227584+0000", 2024-04-19T04:26:00.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:00.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.999 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:00.999 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227624+0000", 2024-04-19T04:26:00.999 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9833000000000003e-05 2024-04-19T04:26:00.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.999 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:00.999 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227630+0000", 2024-04-19T04:26:00.999 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0759999999999999e-06 2024-04-19T04:26:00.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:00.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:00.999 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:00.999 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227634+0000", 2024-04-19T04:26:01.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1570000000000002e-06 2024-04-19T04:26:01.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.000 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:01.000 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229531+0000", 2024-04-19T04:26:01.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018962339999999999 2024-04-19T04:26:01.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.000 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:01.000 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229662+0000", 2024-04-19T04:26:01.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013192999999999999 2024-04-19T04:26:01.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.000 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:01.000 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275915+0000", 2024-04-19T04:26:01.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046252140999999997 2024-04-19T04:26:01.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:01.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275944+0000", 2024-04-19T04:26:01.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9539999999999998e-05 2024-04-19T04:26:01.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:01.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275999+0000", 2024-04-19T04:26:01.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5062999999999998e-05 2024-04-19T04:26:01.001 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:01.001 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:01.001 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:01.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.002 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:01.002 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:01.002 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.682662408999999, 2024-04-19T04:26:01.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:01.002 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:01.002 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:01.002 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:01.002 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:01.002 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.002 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:01.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.002 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:01.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.003 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:01.003 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:01.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:01.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.003 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:01.003 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:01.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:01.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.003 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:01.003 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:01.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:01.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.004 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:01.004 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:01.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:01.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.004 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:01.004 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:01.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:01.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.004 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.004 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:01.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:01.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:01.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:01.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:01.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:01.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:01.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:01.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:01.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:01.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:01.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:01.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:01.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:01.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:01.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:01.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:01.006 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:01.006 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:01.006 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:01.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.007 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:01.007 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:01.007 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.682068129000001, 2024-04-19T04:26:01.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:01.007 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:01.007 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:01.007 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:01.007 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:01.007 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.007 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:01.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.008 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:01.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:01.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:01.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:01.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:01.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:01.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:01.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:01.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:01.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:01.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:01.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:01.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:01.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:01.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:01.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:01.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.010 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:01.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:01.010 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.010 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.010 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:01.010 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:01.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:01.010 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.010 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.010 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:01.010 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:01.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:01.010 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.010 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.011 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:01.011 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:01.011 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:01.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.011 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.011 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:01.011 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:01.011 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:01.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.011 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.011 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:01.011 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:01.011 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:01.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.011 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.012 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:01.012 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:01.012 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:01.012 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.012 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.012 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:01.012 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:01.012 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:01.012 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:01.012 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:01.012 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:01.012 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.012 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.012 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93744 5.1 5:87b91c25:::benchmark_data_smithi007_19526_object93743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:01.013 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:26:01.013 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.678398577999999, 2024-04-19T04:26:01.013 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044295022000000003, 2024-04-19T04:26:01.013 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:01.013 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:01.013 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:01.013 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:01.013 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.013 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93744 2024-04-19T04:26:01.013 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.013 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:01.013 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.013 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:01.013 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:26:01.013 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:01.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.014 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:01.014 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231906+0000", 2024-04-19T04:26:01.014 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:01.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.014 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:01.014 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231905+0000", 2024-04-19T04:26:01.014 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:01.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.014 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:01.014 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.231935+0000", 2024-04-19T04:26:01.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9442e-05 2024-04-19T04:26:01.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.015 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:01.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264224+0000", 2024-04-19T04:26:01.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.032288836000000001 2024-04-19T04:26:01.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.015 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264238+0000", 2024-04-19T04:26:01.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4494999999999999e-05 2024-04-19T04:26:01.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.015 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:01.015 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268311+0000", 2024-04-19T04:26:01.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0040726629999999998 2024-04-19T04:26:01.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:01.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.268587+0000", 2024-04-19T04:26:01.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00027623200000000001 2024-04-19T04:26:01.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:01.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276099+0000", 2024-04-19T04:26:01.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075116180000000003 2024-04-19T04:26:01.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:01.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276123+0000", 2024-04-19T04:26:01.017 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4675e-05 2024-04-19T04:26:01.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.017 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.017 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:01.017 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276201+0000", 2024-04-19T04:26:01.017 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7836000000000005e-05 2024-04-19T04:26:01.017 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:01.017 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:01.017 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:01.017 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:01.017 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:01.017 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:01.019 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:01.019 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:01.017+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:01.119 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:01.117+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:01.144 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:165480 5.9 e53/20 5:9ec1151a:::benchmark_data_smithi007_19526_object39746:head v 53'10587, mlcod=53'10584)", 2024-04-19T04:26:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:01.143075+0000", 2024-04-19T04:26:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0019252939999999999, 2024-04-19T04:26:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001947645, 2024-04-19T04:26:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.143075+0000", 2024-04-19T04:26:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.143075+0000", 2024-04-19T04:26:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.143074+0000", 2024-04-19T04:26:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.143085+0000", 2024-04-19T04:26:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023e-05 2024-04-19T04:26:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.143097+0000", 2024-04-19T04:26:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2126999999999999e-05 2024-04-19T04:26:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.143102+0000", 2024-04-19T04:26:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6590000000000004e-06 2024-04-19T04:26:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.143149+0000", 2024-04-19T04:26:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6446000000000002e-05 2024-04-19T04:26:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.143169+0000", 2024-04-19T04:26:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0037000000000001e-05 2024-04-19T04:26:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:165486 5.b 5:d03f464a:::benchmark_data_smithi007_19526_object39752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T04:26:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:01.144923+0000", 2024-04-19T04:26:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.7144999999999994e-05, 2024-04-19T04:26:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016521, 2024-04-19T04:26:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 165486 2024-04-19T04:26:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.144923+0000", 2024-04-19T04:26:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.144923+0000", 2024-04-19T04:26:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.144922+0000", 2024-04-19T04:26:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.144930+0000", 2024-04-19T04:26:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4710000000000001e-06 2024-04-19T04:26:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.144943+0000", 2024-04-19T04:26:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3268000000000001e-05 2024-04-19T04:26:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.144952+0000", 2024-04-19T04:26:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0739999999999999e-06 2024-04-19T04:26:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.144992+0000", 2024-04-19T04:26:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0241999999999999e-05 2024-04-19T04:26:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.145084+0000", 2024-04-19T04:26:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1786000000000005e-05 2024-04-19T04:26:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:165474 5.a 5:55cc4916:::benchmark_data_smithi007_19526_object39740:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T04:26:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:01.140269+0000", 2024-04-19T04:26:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0047315550000000001, 2024-04-19T04:26:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048941749999999997, 2024-04-19T04:26:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 165474 2024-04-19T04:26:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.140269+0000", 2024-04-19T04:26:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.140269+0000", 2024-04-19T04:26:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.140268+0000", 2024-04-19T04:26:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.140273+0000", 2024-04-19T04:26:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9370000000000003e-06 2024-04-19T04:26:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.140282+0000", 2024-04-19T04:26:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2599999999999994e-06 2024-04-19T04:26:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.140289+0000", 2024-04-19T04:26:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5939999999999999e-06 2024-04-19T04:26:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.142571+0000", 2024-04-19T04:26:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002281862 2024-04-19T04:26:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.142651+0000", 2024-04-19T04:26:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0105999999999995e-05 2024-04-19T04:26:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:165479 5.0 5:097a70ab:::benchmark_data_smithi007_19526_object39745:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T04:26:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:01.142195+0000", 2024-04-19T04:26:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0028050710000000001, 2024-04-19T04:26:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030294409999999999, 2024-04-19T04:26:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 165479 2024-04-19T04:26:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.142195+0000", 2024-04-19T04:26:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.142195+0000", 2024-04-19T04:26:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.142195+0000", 2024-04-19T04:26:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.142199+0000", 2024-04-19T04:26:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9349999999999996e-06 2024-04-19T04:26:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.142206+0000", 2024-04-19T04:26:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5739999999999998e-06 2024-04-19T04:26:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.142212+0000", 2024-04-19T04:26:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8019999999999997e-06 2024-04-19T04:26:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.142340+0000", 2024-04-19T04:26:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0001284 2024-04-19T04:26:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:01.142490+0000", 2024-04-19T04:26:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014918700000000001 2024-04-19T04:26:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:26:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 4 2024-04-19T04:26:01.161 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:01.162 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:01.181 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-04-19T04:26:01.220 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:01.217+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:01.282 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:01.283 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:01.283 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:01.283 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:01.283 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:01.296 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:01.320 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:01.321+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:01.422 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:01.422 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:01.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:01.422 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:01.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.422 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:01.422 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:26:01.422 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.185527893, 2024-04-19T04:26:01.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:26:01.422 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.423 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:01.423 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.423 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.423 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.423 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:26:01.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.423 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:26:01.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:26:01.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:26:01.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:01.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:26:01.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:26:01.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:26:01.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:26:01.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:26:01.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:26:01.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:26:01.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:26:01.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:26:01.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:26:01.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:26:01.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:26:01.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:26:01.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:01.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:26:01.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:26:01.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:01.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:26:01.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:26:01.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:01.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:26:01.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:26:01.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:26:01.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:26:01.427 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.428 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.428 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.428 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:01.428 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:26:01.428 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.181078976999999, 2024-04-19T04:26:01.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:26:01.428 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.428 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:01.428 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.428 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.428 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.428 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:26:01.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.429 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:26:01.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:26:01.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:26:01.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:01.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:26:01.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:26:01.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:26:01.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:26:01.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:26:01.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:26:01.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:26:01.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:26:01.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:26:01.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:26:01.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:26:01.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:26:01.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:26:01.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:01.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:26:01.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:26:01.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:01.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:26:01.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:26:01.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:01.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:26:01.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:26:01.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:26:01.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:26:01.433 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.433 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.433 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.434 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:01.434 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:26:01.434 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.353146733999999, 2024-04-19T04:26:01.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:26:01.434 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.434 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:01.434 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.434 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.434 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.434 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:26:01.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.434 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:26:01.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:26:01.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:26:01.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:01.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:26:01.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:26:01.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:26:01.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:26:01.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:26:01.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:26:01.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:26:01.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:26:01.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:26:01.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:26:01.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:01.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:26:01.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:26:01.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:01.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:26:01.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:26:01.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:01.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:26:01.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:26:01.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:01.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:26:01.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:26:01.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:26:01.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:26:01.439 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.439 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.439 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.439 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:01.439 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:26:01.439 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.917292697000001, 2024-04-19T04:26:01.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:26:01.439 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.439 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:01.440 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.440 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.440 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.440 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:26:01.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.440 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:26:01.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:26:01.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:26:01.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:01.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:26:01.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:26:01.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:26:01.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:26:01.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:26:01.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:26:01.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:26:01.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:26:01.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:26:01.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:26:01.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:01.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:26:01.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:26:01.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:01.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:26:01.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:26:01.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:01.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:26:01.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:26:01.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:01.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:26:01.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:26:01.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:26:01.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:26:01.445 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.445 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.445 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.445 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:01.445 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:26:01.445 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.916862277, 2024-04-19T04:26:01.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:26:01.445 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.445 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:01.446 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.446 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.446 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.446 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:26:01.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.446 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:26:01.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:26:01.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:26:01.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:01.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:26:01.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:26:01.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:26:01.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:26:01.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:26:01.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:26:01.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:26:01.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:26:01.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:26:01.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:26:01.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:01.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:26:01.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:26:01.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:01.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:26:01.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:26:01.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:01.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:26:01.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:26:01.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:01.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:26:01.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:26:01.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:26:01.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:26:01.450 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.451 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.451 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.451 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:01.451 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:26:01.451 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.914631012999997, 2024-04-19T04:26:01.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:26:01.451 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.451 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:01.451 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.451 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.451 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.451 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:26:01.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.452 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:26:01.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:26:01.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:26:01.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:01.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:26:01.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:26:01.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:26:01.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:26:01.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:26:01.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:26:01.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:26:01.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:26:01.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:26:01.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:26:01.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:01.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:26:01.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:26:01.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:01.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:26:01.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:26:01.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:01.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:26:01.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:26:01.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:01.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:26:01.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:26:01.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:26:01.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:26:01.456 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.456 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.456 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.456 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:01.456 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:26:01.457 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.911233975000002, 2024-04-19T04:26:01.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:26:01.457 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.457 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:01.457 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.457 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.457 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.457 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:26:01.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.457 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:26:01.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:26:01.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:26:01.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:01.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:26:01.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:26:01.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:26:01.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:26:01.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:26:01.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:26:01.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:26:01.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:26:01.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:26:01.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:26:01.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:01.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:26:01.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:26:01.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:01.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:26:01.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:26:01.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:01.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:26:01.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:26:01.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:01.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:26:01.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:26:01.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:26:01.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:26:01.461 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.462 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.462 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.462 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:01.462 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:26:01.462 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.906105777000001, 2024-04-19T04:26:01.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:26:01.462 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.462 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:01.462 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.462 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.462 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.462 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:26:01.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.463 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:26:01.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:26:01.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:26:01.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:01.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:26:01.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:26:01.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:26:01.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:26:01.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:26:01.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:26:01.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:26:01.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:26:01.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:26:01.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:26:01.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:01.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:26:01.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:26:01.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:01.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:26:01.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:26:01.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:01.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:26:01.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:26:01.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:01.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:26:01.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:26:01.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:26:01.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:26:01.467 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.467 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.467 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.467 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:01.467 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:26:01.468 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.592077271999997, 2024-04-19T04:26:01.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:26:01.468 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.468 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:01.468 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.468 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.468 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.468 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:26:01.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.468 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:26:01.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:26:01.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:26:01.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:01.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:26:01.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:26:01.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:26:01.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:26:01.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:26:01.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:26:01.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:26:01.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:26:01.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:26:01.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:26:01.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:01.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:26:01.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:26:01.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:01.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:26:01.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:26:01.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:01.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:26:01.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:26:01.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:01.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:26:01.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:26:01.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:26:01.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:26:01.473 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.473 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.473 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.473 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:01.473 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:01.473 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.469717862000003, 2024-04-19T04:26:01.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:01.474 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.474 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:01.474 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.474 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.474 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.474 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:01.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.474 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:01.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:01.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:01.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:01.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:01.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:01.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:01.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:01.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:01.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:01.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:01.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:01.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:01.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:01.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:01.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:01.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:01.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:01.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:01.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:01.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:01.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:01.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:01.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:01.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:01.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:01.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:01.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:01.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:01.479 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.479 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.479 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.480 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:01.480 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:01.480 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.464656216000002, 2024-04-19T04:26:01.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:01.480 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.480 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:01.480 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.480 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.480 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.480 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:01.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.480 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:01.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:01.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:01.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:01.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:01.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:01.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:01.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:01.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:01.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:01.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:01.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:01.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:01.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:01.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:01.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:01.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:01.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:01.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:01.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:01.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:01.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:01.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:01.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:01.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:01.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:01.485 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.485 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.485 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.485 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:01.485 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:01.485 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.464556303999998, 2024-04-19T04:26:01.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:01.485 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.486 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:01.486 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.486 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.486 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.486 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:01.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.486 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:01.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:01.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:01.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:01.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:01.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:01.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:01.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:01.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:01.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:01.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:01.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:01.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:01.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:01.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:01.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:01.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:01.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:01.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:01.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:01.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:01.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:01.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:01.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:01.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:01.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:01.491 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.491 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.491 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.491 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:01.491 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:01.491 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.464430551, 2024-04-19T04:26:01.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:01.491 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.491 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:01.491 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.491 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.491 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.491 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:01.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.492 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:01.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:01.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:01.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:01.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:01.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:01.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:01.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:01.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:01.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:01.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:01.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:01.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:01.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:01.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:01.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:01.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:01.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:01.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:01.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:01.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:01.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:01.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:01.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:01.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:01.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:01.496 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.496 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.496 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.496 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:01.497 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:01.497 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.460586606, 2024-04-19T04:26:01.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:01.497 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.497 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:01.497 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.497 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.497 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.497 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:01.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.497 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:01.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:01.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:01.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:01.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:01.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:01.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:01.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:01.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:01.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:01.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:01.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:01.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:01.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:01.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:01.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:01.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:01.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:01.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:01.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:01.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:01.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:01.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.501 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:01.421+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:01.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:01.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:01.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:01.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:01.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:01.503 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.503 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.503 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.504 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:01.504 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:01.504 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.453415505000002, 2024-04-19T04:26:01.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:01.504 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.504 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:01.504 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.504 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.504 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.504 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:01.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.504 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:01.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:01.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:01.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:01.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:01.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:01.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:01.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:01.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:01.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:01.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:01.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:01.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:01.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:01.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:01.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:01.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:01.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:01.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:01.508 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.508 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.508 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.508 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:01.508 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:01.508 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.453243401000002, 2024-04-19T04:26:01.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:01.509 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.509 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:01.509 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.509 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.509 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.509 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:01.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.509 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:01.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:01.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:01.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:01.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:01.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:01.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:01.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:01.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:01.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:01.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:01.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:01.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:01.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:01.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:01.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:01.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:01.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:01.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:01.513 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.513 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.513 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.513 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:01.513 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:01.513 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.453180275999998, 2024-04-19T04:26:01.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:01.513 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.513 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:01.513 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.513 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.514 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.514 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:01.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.514 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:01.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:01.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:01.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:01.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:01.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:01.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:01.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:01.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:01.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:01.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:01.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:01.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:01.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:01.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:01.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:01.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:01.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:01.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:01.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:01.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:01.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:01.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:01.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:01.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:01.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:01.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:01.518 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.519 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.519 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.519 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:01.519 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:01.519 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.453051678999998, 2024-04-19T04:26:01.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:01.519 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.519 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:01.519 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.519 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.519 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.519 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:01.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.520 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:01.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:01.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:01.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:01.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:01.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:01.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:01.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:01.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:01.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:01.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:01.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:01.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:01.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:01.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:01.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:01.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:01.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:01.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:01.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:01.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:01.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:01.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:01.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:01.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:01.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:01.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:01.524 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.524 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.524 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.524 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:01.525 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:01.525 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.452983707999998, 2024-04-19T04:26:01.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:01.525 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.525 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:01.525 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.525 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.525 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.525 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:01.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.525 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:01.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:01.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:01.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:01.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:01.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:01.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:01.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:01.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:01.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:01.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:01.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:01.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:01.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:01.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:01.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:01.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:01.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:01.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:01.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:01.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:01.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:01.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:01.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:01.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:01.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:01.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:01.530 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.530 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.530 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.530 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:111654 5.0 5:0b6b473d:::benchmark_data_smithi007_19526_object111653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:26:01.530 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:26:01.530 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.505192602000001, 2024-04-19T04:26:01.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023122753999999999, 2024-04-19T04:26:01.530 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:01.530 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:01.531 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:01.531 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:01.531 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.531 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 111654 2024-04-19T04:26:01.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.531 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:01.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:01.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:26:01.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:01.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:26:01.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:01.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:01.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915865+0000", 2024-04-19T04:26:01.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:01.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:01.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915897+0000", 2024-04-19T04:26:01.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1708999999999997e-05 2024-04-19T04:26:01.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:01.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915905+0000", 2024-04-19T04:26:01.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.481e-06 2024-04-19T04:26:01.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915911+0000", 2024-04-19T04:26:01.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6880000000000002e-06 2024-04-19T04:26:01.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:01.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925564+0000", 2024-04-19T04:26:01.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096527039999999998 2024-04-19T04:26:01.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:01.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925771+0000", 2024-04-19T04:26:01.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020717199999999999 2024-04-19T04:26:01.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:01.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938888+0000", 2024-04-19T04:26:01.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013117105 2024-04-19T04:26:01.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:01.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938931+0000", 2024-04-19T04:26:01.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2447000000000002e-05 2024-04-19T04:26:01.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:01.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:01.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:01.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938989+0000", 2024-04-19T04:26:01.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7997000000000001e-05 2024-04-19T04:26:01.535 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.535 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.535 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.535 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:01.535 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:01.535 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:01.535 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:01.537 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:01.537+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:01.608 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:26:01.638 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:01.637+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:01.666 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:01.666 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:01.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.666 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:166757 5.7 5:ed64583c:::benchmark_data_smithi007_19526_object41023:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:01.666 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:01.664307+0000", 2024-04-19T04:26:01.666 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.002458909, 2024-04-19T04:26:01.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024833849999999998, 2024-04-19T04:26:01.666 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:01.666 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:01.666 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:01.666 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:01.667 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.667 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 166757 2024-04-19T04:26:01.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.667 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:01.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:01.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.664307+0000", 2024-04-19T04:26:01.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:01.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:01.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.664307+0000", 2024-04-19T04:26:01.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:01.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:01.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.664306+0000", 2024-04-19T04:26:01.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:01.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:01.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.664311+0000", 2024-04-19T04:26:01.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:01.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:01.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.664322+0000", 2024-04-19T04:26:01.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1657e-05 2024-04-19T04:26:01.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.664330+0000", 2024-04-19T04:26:01.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0139999999999998e-06 2024-04-19T04:26:01.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:01.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.664401+0000", 2024-04-19T04:26:01.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0086000000000006e-05 2024-04-19T04:26:01.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:01.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.664517+0000", 2024-04-19T04:26:01.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000116221 2024-04-19T04:26:01.669 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:01.670 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:01.670 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:01.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.670 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:166758 5.3 5:c70dfa28:::benchmark_data_smithi007_19526_object41024:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:01.670 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:01.664661+0000", 2024-04-19T04:26:01.670 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0021040870000000001, 2024-04-19T04:26:01.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0021807979999999999, 2024-04-19T04:26:01.670 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:01.670 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:01.670 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:01.670 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:01.671 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.671 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 166758 2024-04-19T04:26:01.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.671 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:01.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:01.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.664661+0000", 2024-04-19T04:26:01.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:01.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:01.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.664661+0000", 2024-04-19T04:26:01.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:01.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:01.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.664660+0000", 2024-04-19T04:26:01.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:01.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:01.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.664667+0000", 2024-04-19T04:26:01.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1670000000000004e-06 2024-04-19T04:26:01.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:01.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.664679+0000", 2024-04-19T04:26:01.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2371000000000001e-05 2024-04-19T04:26:01.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.664692+0000", 2024-04-19T04:26:01.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.307e-05 2024-04-19T04:26:01.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:01.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.664741+0000", 2024-04-19T04:26:01.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9353e-05 2024-04-19T04:26:01.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.674 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:01.674 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.664878+0000", 2024-04-19T04:26:01.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000136293 2024-04-19T04:26:01.674 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:01.674 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:01.674 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:01.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.674 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:166760 5.9 5:9c38ea7d:::benchmark_data_smithi007_19526_object41026:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:01.674 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:01.665256+0000", 2024-04-19T04:26:01.674 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0015097960000000001, 2024-04-19T04:26:01.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016235589999999999, 2024-04-19T04:26:01.674 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:01.675 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:01.675 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:01.675 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:01.675 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.675 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 166760 2024-04-19T04:26:01.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.675 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:01.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:01.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.665256+0000", 2024-04-19T04:26:01.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:01.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:01.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.665256+0000", 2024-04-19T04:26:01.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:01.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:01.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.665255+0000", 2024-04-19T04:26:01.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:01.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:01.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.665260+0000", 2024-04-19T04:26:01.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3020000000000002e-06 2024-04-19T04:26:01.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:01.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.665279+0000", 2024-04-19T04:26:01.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8527000000000001e-05 2024-04-19T04:26:01.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.665283+0000", 2024-04-19T04:26:01.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2150000000000003e-06 2024-04-19T04:26:01.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:01.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.665330+0000", 2024-04-19T04:26:01.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7102999999999999e-05 2024-04-19T04:26:01.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:01.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.665528+0000", 2024-04-19T04:26:01.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000198211 2024-04-19T04:26:01.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:01.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.665681+0000", 2024-04-19T04:26:01.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015327900000000001 2024-04-19T04:26:01.678 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:01.678 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:01.678 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:01.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.678 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:166763 5.2 5:4dc62ecc:::benchmark_data_smithi007_19526_object41029:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:01.678 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:01.666144+0000", 2024-04-19T04:26:01.678 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00062124800000000003, 2024-04-19T04:26:01.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00077309099999999995, 2024-04-19T04:26:01.679 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:01.679 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:01.679 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:01.679 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:01.679 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:01.680 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 166763 2024-04-19T04:26:01.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.680 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:01.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:01.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.666144+0000", 2024-04-19T04:26:01.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:01.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:01.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.666144+0000", 2024-04-19T04:26:01.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:01.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:01.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.666144+0000", 2024-04-19T04:26:01.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:01.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:01.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.666148+0000", 2024-04-19T04:26:01.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0400000000000003e-06 2024-04-19T04:26:01.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:01.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.666160+0000", 2024-04-19T04:26:01.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2672e-05 2024-04-19T04:26:01.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:01.683 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.666168+0000", 2024-04-19T04:26:01.683 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5000000000000002e-06 2024-04-19T04:26:01.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:01.683 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.666222+0000", 2024-04-19T04:26:01.683 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4523e-05 2024-04-19T04:26:01.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:01.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:01.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:01.684 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:01.666428+0000", 2024-04-19T04:26:01.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000205424 2024-04-19T04:26:01.684 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:01.684 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:01.684 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:01.684 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:01.684 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:01.684 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 4 2024-04-19T04:26:01.685 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:01.686 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:01.739 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:01.737+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:01.764 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:01.786 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:01.786 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:01.787 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:01.787 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:01.790 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:01.791 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:01.819 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:01.820 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:01.834 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:01.841 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:01.837+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:01.942 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:01.941+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:01.962 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:01.962 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:01.974 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:02.044 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:02.041+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:02.101 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:02.102 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:02.114 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:02.144 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:02.145+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:02.234 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:02.235 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:02.245 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:02.245+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:02.247 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:02.346 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:02.345+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:02.369 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:02.369 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:02.382 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:02.447 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:02.445+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:02.508 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:02.509 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:02.520 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:02.548 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:02.549+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:02.649 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:02.645+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:02.659 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:02.659 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:02.672 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:02.750 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:02.749+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:02.841 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:02.841 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:02.850 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:02.849+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:02.854 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:02.951 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:02.949+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:02.986 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:02.986 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:02.997 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:03.052 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:03.049+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:03.123 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:03.123 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:03.136 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:03.153 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:03.149+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:03.194 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T04:26:03.254 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:03.253+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:03.264 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:03.264 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:03.275 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:03.354 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:03.353+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:03.401 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:03.402 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:03.413 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:03.459 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:03.453+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:03.542 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:03.542 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:03.554 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:03.556 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:03.557+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:03.657 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:03.653+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:03.679 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:03.679 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:03.693 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:03.744 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~47s 2024-04-19T04:26:03.758 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:03.757+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:03.793 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:26:03.818 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:03.818 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:03.828 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:03.859 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:03.857+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:03.947 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:03.951 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:03.951 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:03.961 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:04.037 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:03.957+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:04.061 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:04.061+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:04.070 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:04.070 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:04.071 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:04.071 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:04.075 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:04.076 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:04.140 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:04.140 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:04.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:04.141 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:04.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.141 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26162 5.d 5:bba74c78:::benchmark_data_smithi007_19526_object26161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:04.141 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:26:04.141 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 69.903006880000007, 2024-04-19T04:26:04.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.048435644999999999, 2024-04-19T04:26:04.141 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.141 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.141 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.141 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.141 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.141 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26162 2024-04-19T04:26:04.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.142 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:26:04.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235531+0000", 2024-04-19T04:26:04.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235529+0000", 2024-04-19T04:26:04.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:04.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235638+0000", 2024-04-19T04:26:04.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108213 2024-04-19T04:26:04.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235674+0000", 2024-04-19T04:26:04.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917000000000002e-05 2024-04-19T04:26:04.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235686+0000", 2024-04-19T04:26:04.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2462e-05 2024-04-19T04:26:04.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235740+0000", 2024-04-19T04:26:04.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3992000000000001e-05 2024-04-19T04:26:04.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.235869+0000", 2024-04-19T04:26:04.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128529 2024-04-19T04:26:04.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:26:04.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.236012+0000", 2024-04-19T04:26:04.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143895 2024-04-19T04:26:04.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:04.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.241432+0000", 2024-04-19T04:26:04.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054191389999999999 2024-04-19T04:26:04.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:04.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283805+0000", 2024-04-19T04:26:04.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042372976 2024-04-19T04:26:04.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:04.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283898+0000", 2024-04-19T04:26:04.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3220000000000005e-05 2024-04-19T04:26:04.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.283966+0000", 2024-04-19T04:26:04.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8621999999999995e-05 2024-04-19T04:26:04.147 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.147 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.147 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.147 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:26172 5.d 5:bb0e316b:::benchmark_data_smithi007_19526_object26171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:04.148 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:26:04.148 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 69.898557964000005, 2024-04-19T04:26:04.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.046586720999999998, 2024-04-19T04:26:04.148 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.148 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.148 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.148 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.148 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.148 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 26172 2024-04-19T04:26:04.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.148 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:26:04.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239980+0000", 2024-04-19T04:26:04.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.239978+0000", 2024-04-19T04:26:04.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:04.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240032+0000", 2024-04-19T04:26:04.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3182e-05 2024-04-19T04:26:04.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240046+0000", 2024-04-19T04:26:04.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4664999999999999e-05 2024-04-19T04:26:04.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240056+0000", 2024-04-19T04:26:04.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2909999999999996e-06 2024-04-19T04:26:04.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240119+0000", 2024-04-19T04:26:04.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3533000000000003e-05 2024-04-19T04:26:04.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240275+0000", 2024-04-19T04:26:04.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015633800000000001 2024-04-19T04:26:04.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-19T04:26:04.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.240420+0000", 2024-04-19T04:26:04.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144463 2024-04-19T04:26:04.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:04.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.243044+0000", 2024-04-19T04:26:04.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00262379 2024-04-19T04:26:04.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:04.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286389+0000", 2024-04-19T04:26:04.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.043345574999999997 2024-04-19T04:26:04.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:04.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286496+0000", 2024-04-19T04:26:04.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107118 2024-04-19T04:26:04.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:24:54.286566+0000", 2024-04-19T04:26:04.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0023000000000004e-05 2024-04-19T04:26:04.153 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.153 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.153 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.154 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:63059 5.b 5:db904963:::benchmark_data_smithi007_19526_object63058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:04.154 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:26:04.154 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 51.070625720999999, 2024-04-19T04:26:04.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.026369632, 2024-04-19T04:26:04.154 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.154 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.154 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.154 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.154 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.154 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63059 2024-04-19T04:26:04.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.154 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:26:04.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067912+0000", 2024-04-19T04:26:04.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067911+0000", 2024-04-19T04:26:04.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.067960+0000", 2024-04-19T04:26:04.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8823000000000003e-05 2024-04-19T04:26:04.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068027+0000", 2024-04-19T04:26:04.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6835999999999995e-05 2024-04-19T04:26:04.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.068058+0000", 2024-04-19T04:26:04.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1752999999999999e-05 2024-04-19T04:26:04.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075764+0000", 2024-04-19T04:26:04.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077055880000000002 2024-04-19T04:26:04.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.075933+0000", 2024-04-19T04:26:04.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016946999999999999 2024-04-19T04:26:04.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:04.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.076024+0000", 2024-04-19T04:26:04.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0725999999999998e-05 2024-04-19T04:26:04.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:04.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.078658+0000", 2024-04-19T04:26:04.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026341960000000001 2024-04-19T04:26:04.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:04.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094174+0000", 2024-04-19T04:26:04.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015515839 2024-04-19T04:26:04.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:04.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094233+0000", 2024-04-19T04:26:04.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8393999999999997e-05 2024-04-19T04:26:04.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:13.094282+0000", 2024-04-19T04:26:04.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8984999999999999e-05 2024-04-19T04:26:04.159 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.159 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.159 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.159 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67428 5.b 5:d21decd3:::benchmark_data_smithi007_19526_object67427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:04.159 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:26:04.159 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.634771684, 2024-04-19T04:26:04.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030507784999999999, 2024-04-19T04:26:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67428 2024-04-19T04:26:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:26:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503766+0000", 2024-04-19T04:26:04.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503765+0000", 2024-04-19T04:26:04.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503804+0000", 2024-04-19T04:26:04.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9150999999999998e-05 2024-04-19T04:26:04.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503814+0000", 2024-04-19T04:26:04.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7370000000000001e-06 2024-04-19T04:26:04.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.503822+0000", 2024-04-19T04:26:04.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1140000000000006e-06 2024-04-19T04:26:04.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504041+0000", 2024-04-19T04:26:04.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021909499999999999 2024-04-19T04:26:04.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504211+0000", 2024-04-19T04:26:04.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017027500000000001 2024-04-19T04:26:04.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:04.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504313+0000", 2024-04-19T04:26:04.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102116 2024-04-19T04:26:04.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:04.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509521+0000", 2024-04-19T04:26:04.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052072020000000002 2024-04-19T04:26:04.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:04.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534189+0000", 2024-04-19T04:26:04.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024668677999999999 2024-04-19T04:26:04.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:04.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534239+0000", 2024-04-19T04:26:04.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9360000000000002e-05 2024-04-19T04:26:04.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534274+0000", 2024-04-19T04:26:04.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5029e-05 2024-04-19T04:26:04.165 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.165 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.165 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.165 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67430 5.0 5:029a577b:::benchmark_data_smithi007_19526_object67429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:04.165 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:26:04.165 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.634341264, 2024-04-19T04:26:04.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.030073592, 2024-04-19T04:26:04.165 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.165 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.165 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.165 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.165 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.166 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67430 2024-04-19T04:26:04.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.166 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:26:04.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:26:04.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504196+0000", 2024-04-19T04:26:04.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504236+0000", 2024-04-19T04:26:04.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0079e-05 2024-04-19T04:26:04.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504245+0000", 2024-04-19T04:26:04.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8139999999999995e-06 2024-04-19T04:26:04.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504253+0000", 2024-04-19T04:26:04.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1879999999999996e-06 2024-04-19T04:26:04.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504306+0000", 2024-04-19T04:26:04.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3757e-05 2024-04-19T04:26:04.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504461+0000", 2024-04-19T04:26:04.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154439 2024-04-19T04:26:04.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:04.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.504620+0000", 2024-04-19T04:26:04.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015954000000000001 2024-04-19T04:26:04.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:04.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509134+0000", 2024-04-19T04:26:04.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004513792 2024-04-19T04:26:04.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:04.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534163+0000", 2024-04-19T04:26:04.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025028379 2024-04-19T04:26:04.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:04.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534235+0000", 2024-04-19T04:26:04.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2936999999999996e-05 2024-04-19T04:26:04.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534270+0000", 2024-04-19T04:26:04.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4499000000000003e-05 2024-04-19T04:26:04.170 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.170 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.171 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.171 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67434 5.b 5:d4820fd1:::benchmark_data_smithi007_19526_object67433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:04.171 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:26:04.171 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.632109999999997, 2024-04-19T04:26:04.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.028024128999999998, 2024-04-19T04:26:04.171 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.171 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.171 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.171 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.171 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.171 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67434 2024-04-19T04:26:04.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.172 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:26:04.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506428+0000", 2024-04-19T04:26:04.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506426+0000", 2024-04-19T04:26:04.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:04.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506467+0000", 2024-04-19T04:26:04.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0181e-05 2024-04-19T04:26:04.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506501+0000", 2024-04-19T04:26:04.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4319000000000001e-05 2024-04-19T04:26:04.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506510+0000", 2024-04-19T04:26:04.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5759999999999995e-06 2024-04-19T04:26:04.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506716+0000", 2024-04-19T04:26:04.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020552400000000001 2024-04-19T04:26:04.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.506880+0000", 2024-04-19T04:26:04.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164289 2024-04-19T04:26:04.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:04.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.507133+0000", 2024-04-19T04:26:04.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025318900000000002 2024-04-19T04:26:04.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:04.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510413+0000", 2024-04-19T04:26:04.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032797759999999999 2024-04-19T04:26:04.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:04.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534323+0000", 2024-04-19T04:26:04.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023909884999999999 2024-04-19T04:26:04.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:04.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534391+0000", 2024-04-19T04:26:04.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490999999999995e-05 2024-04-19T04:26:04.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534452+0000", 2024-04-19T04:26:04.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1101999999999999e-05 2024-04-19T04:26:04.176 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.176 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.176 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.176 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67443 5.e 5:751f5de4:::benchmark_data_smithi007_19526_object67442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:04.176 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:26:04.177 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.628712962000002, 2024-04-19T04:26:04.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024659599000000001, 2024-04-19T04:26:04.177 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.177 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.177 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.177 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.177 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.177 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67443 2024-04-19T04:26:04.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.177 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:26:04.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509825+0000", 2024-04-19T04:26:04.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509823+0000", 2024-04-19T04:26:04.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:04.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509878+0000", 2024-04-19T04:26:04.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4617999999999998e-05 2024-04-19T04:26:04.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509893+0000", 2024-04-19T04:26:04.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5325999999999999e-05 2024-04-19T04:26:04.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509901+0000", 2024-04-19T04:26:04.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0630000000000006e-06 2024-04-19T04:26:04.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.509967+0000", 2024-04-19T04:26:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5696000000000003e-05 2024-04-19T04:26:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510205+0000", 2024-04-19T04:26:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023805899999999999 2024-04-19T04:26:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.510402+0000", 2024-04-19T04:26:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019691000000000001 2024-04-19T04:26:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.513794+0000", 2024-04-19T04:26:04.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033916660000000002 2024-04-19T04:26:04.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:04.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534387+0000", 2024-04-19T04:26:04.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020593730000000001 2024-04-19T04:26:04.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:04.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534445+0000", 2024-04-19T04:26:04.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7259000000000002e-05 2024-04-19T04:26:04.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.534484+0000", 2024-04-19T04:26:04.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9644999999999997e-05 2024-04-19T04:26:04.182 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.182 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.182 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.182 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67446 5.e 5:7947ae34:::benchmark_data_smithi007_19526_object67445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:04.182 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:26:04.182 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.623584764, 2024-04-19T04:26:04.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025516100999999999, 2024-04-19T04:26:04.182 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.182 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.182 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.182 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.183 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.183 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67446 2024-04-19T04:26:04.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.183 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:26:04.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514953+0000", 2024-04-19T04:26:04.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.514952+0000", 2024-04-19T04:26:04.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515020+0000", 2024-04-19T04:26:04.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7835000000000004e-05 2024-04-19T04:26:04.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515032+0000", 2024-04-19T04:26:04.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.219e-05 2024-04-19T04:26:04.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515038+0000", 2024-04-19T04:26:04.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.387e-06 2024-04-19T04:26:04.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515074+0000", 2024-04-19T04:26:04.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5218000000000001e-05 2024-04-19T04:26:04.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515188+0000", 2024-04-19T04:26:04.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114685 2024-04-19T04:26:04.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:04.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.515289+0000", 2024-04-19T04:26:04.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100411 2024-04-19T04:26:04.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:04.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.517262+0000", 2024-04-19T04:26:04.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019732920000000002 2024-04-19T04:26:04.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:04.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540378+0000", 2024-04-19T04:26:04.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023116279999999999 2024-04-19T04:26:04.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:04.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540435+0000", 2024-04-19T04:26:04.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7095000000000001e-05 2024-04-19T04:26:04.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.540469+0000", 2024-04-19T04:26:04.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3559000000000002e-05 2024-04-19T04:26:04.187 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.187 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.187 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.188 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:67942 5.b 5:dc6d53a0:::benchmark_data_smithi007_19526_object67941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:04.188 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:26:04.188 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.309556258999997, 2024-04-19T04:26:04.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.025532866000000001, 2024-04-19T04:26:04.188 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.188 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.188 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.188 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.188 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.188 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 67942 2024-04-19T04:26:04.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.188 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:26:04.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828981+0000", 2024-04-19T04:26:04.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.828980+0000", 2024-04-19T04:26:04.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829092+0000", 2024-04-19T04:26:04.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111797 2024-04-19T04:26:04.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829105+0000", 2024-04-19T04:26:04.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3498e-05 2024-04-19T04:26:04.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829112+0000", 2024-04-19T04:26:04.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:26:04.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.829806+0000", 2024-04-19T04:26:04.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069436900000000002 2024-04-19T04:26:04.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830131+0000", 2024-04-19T04:26:04.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032433100000000002 2024-04-19T04:26:04.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:04.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.830644+0000", 2024-04-19T04:26:04.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000513193 2024-04-19T04:26:04.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:04.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.836739+0000", 2024-04-19T04:26:04.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060952810000000001 2024-04-19T04:26:04.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:04.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854431+0000", 2024-04-19T04:26:04.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017691499999999999 2024-04-19T04:26:04.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:04.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854479+0000", 2024-04-19T04:26:04.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7824999999999997e-05 2024-04-19T04:26:04.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.854514+0000", 2024-04-19T04:26:04.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5608000000000002e-05 2024-04-19T04:26:04.193 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.193 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.193 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.193 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:04.193 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:04.193 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.187196849000003, 2024-04-19T04:26:04.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:04.193 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.193 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:04.193 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.193 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.194 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.194 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:04.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.194 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:04.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:04.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:04.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:04.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:04.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:04.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:04.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:04.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:04.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:04.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:04.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:04.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:04.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:04.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:04.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:04.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:04.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:04.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:04.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:04.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:04.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:04.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:04.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:04.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:04.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:04.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:04.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:04.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:04.200 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.200 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.200 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.200 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:04.200 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:04.200 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.182135203000001, 2024-04-19T04:26:04.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:04.201 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.201 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:04.201 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.201 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.201 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.201 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:04.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.201 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:04.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:04.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:04.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:04.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:04.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:04.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:04.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:04.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:04.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:04.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:04.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:04.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:04.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:04.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:04.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:04.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:04.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:04.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:04.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:04.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:04.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:04.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:04.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:04.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:04.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:04.205 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.206 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.206 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.206 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:04.206 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:04.206 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.182035290999998, 2024-04-19T04:26:04.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:04.206 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.206 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:04.206 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.206 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.206 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.206 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:04.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.207 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:04.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:04.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:04.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:04.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:04.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:04.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:04.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:04.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:04.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.209 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.209 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:04.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:04.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.209 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.209 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:04.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:04.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.209 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:04.209 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:04.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:04.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:04.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:04.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:04.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:04.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:04.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:04.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:04.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:04.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:04.211 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.211 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.211 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.211 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:04.211 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:04.211 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.181909537999999, 2024-04-19T04:26:04.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:04.212 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.212 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:04.212 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.212 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.212 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.212 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:04.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.212 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:04.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:04.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:04.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:04.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:04.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:04.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:04.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:04.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:04.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:04.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:04.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:04.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:04.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:04.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:04.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:04.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:04.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:04.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:04.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:04.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:04.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:04.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:04.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:04.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:04.217 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.217 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.217 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.217 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:04.217 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:04.217 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.178065592999999, 2024-04-19T04:26:04.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:04.218 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.218 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.218 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.218 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.218 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.218 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:04.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.218 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:04.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:04.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:04.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:04.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:04.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:04.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:04.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:04.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:04.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:04.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:04.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:04.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:04.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:04.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:04.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:04.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:04.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:04.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:04.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.222 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:04.222 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:04.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:04.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.222 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:04.222 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:04.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:04.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.222 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.222 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:04.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:04.223 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.223 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.223 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.223 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:04.223 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:04.223 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.170894492000002, 2024-04-19T04:26:04.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:04.223 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.223 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:04.223 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.223 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.224 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.224 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:04.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.224 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:04.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:04.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:04.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:04.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:04.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:04.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:04.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:04.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:04.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:04.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:04.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:04.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:04.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:04.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:04.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:04.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:04.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:04.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:04.227 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.227 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.227 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.227 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:04.228 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:04.228 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.170722388000002, 2024-04-19T04:26:04.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:04.228 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.228 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:04.228 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.228 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.228 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.228 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:04.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.228 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:04.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:04.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:04.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:04.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:04.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:04.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:04.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:04.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:04.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:04.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:04.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:04.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:04.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:04.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:04.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:04.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:04.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:04.232 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.232 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.232 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.232 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:04.232 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:04.232 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.170659262999997, 2024-04-19T04:26:04.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:04.232 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.232 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.232 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.232 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.232 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.233 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:04.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.233 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:04.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:04.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:04.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:04.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:04.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:04.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:04.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:04.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:04.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:04.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:04.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:04.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:04.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:04.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:04.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:04.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:04.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:04.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:04.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:04.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:04.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:04.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:04.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:04.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:04.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:04.237 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.237 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.237 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.238 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:04.238 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:04.238 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.170530665999998, 2024-04-19T04:26:04.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:04.238 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.238 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.238 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.238 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.238 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.238 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:04.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.239 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:04.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:04.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:04.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:04.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:04.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:04.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:04.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:04.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:04.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:04.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:04.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:04.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:04.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:04.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:04.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:04.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:04.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:04.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:04.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:04.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:04.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:04.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:04.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:04.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:04.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:04.243 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.243 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.243 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.243 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:04.243 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:04.243 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.170462694999998, 2024-04-19T04:26:04.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:04.244 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.244 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.244 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.244 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.244 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.244 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:04.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.244 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:04.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:04.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:04.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:04.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:04.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:04.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:04.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:04.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:04.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:04.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:04.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:04.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:04.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:04.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:04.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:04.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:04.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:04.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:04.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:04.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:04.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:04.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:04.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:04.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:04.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:04.249 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.249 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.249 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.249 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:111654 5.0 5:0b6b473d:::benchmark_data_smithi007_19526_object111653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T04:26:04.249 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:26:04.249 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.222671589000001, 2024-04-19T04:26:04.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023122753999999999, 2024-04-19T04:26:04.249 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.249 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.249 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.249 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.250 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.250 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 111654 2024-04-19T04:26:04.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.250 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:26:04.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915866+0000", 2024-04-19T04:26:04.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915865+0000", 2024-04-19T04:26:04.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915897+0000", 2024-04-19T04:26:04.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1708999999999997e-05 2024-04-19T04:26:04.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915905+0000", 2024-04-19T04:26:04.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.481e-06 2024-04-19T04:26:04.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.915911+0000", 2024-04-19T04:26:04.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6880000000000002e-06 2024-04-19T04:26:04.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925564+0000", 2024-04-19T04:26:04.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096527039999999998 2024-04-19T04:26:04.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.925771+0000", 2024-04-19T04:26:04.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020717199999999999 2024-04-19T04:26:04.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:04.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938888+0000", 2024-04-19T04:26:04.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013117105 2024-04-19T04:26:04.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:04.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938931+0000", 2024-04-19T04:26:04.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2447000000000002e-05 2024-04-19T04:26:04.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:04.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:37.938989+0000", 2024-04-19T04:26:04.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7997000000000001e-05 2024-04-19T04:26:04.254 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.254 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.254 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.254 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.254 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.254 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:04.256 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-04-19T04:26:04.256 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:04.253+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:04.256 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:04.356 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:04.353+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:04.386 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:04.386 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:04.386 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.386 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:173071 5.9 5:9a883c0d:::benchmark_data_smithi007_19526_object47337:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.386 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.385405+0000", 2024-04-19T04:26:04.386 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001200893, 2024-04-19T04:26:04.386 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012269430000000001, 2024-04-19T04:26:04.387 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.387 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:04.387 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.387 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.387 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.387 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 173071 2024-04-19T04:26:04.387 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.387 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.385405+0000", 2024-04-19T04:26:04.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.385405+0000", 2024-04-19T04:26:04.389 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.389 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.389 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.389 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.389 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.385404+0000", 2024-04-19T04:26:04.389 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.390 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.390 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.390 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.390 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.385408+0000", 2024-04-19T04:26:04.390 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5279999999999999e-06 2024-04-19T04:26:04.391 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.391 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.391 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.391 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.385413+0000", 2024-04-19T04:26:04.391 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6699999999999999e-06 2024-04-19T04:26:04.391 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.392 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.392 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.392 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.385417+0000", 2024-04-19T04:26:04.392 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.63e-06 2024-04-19T04:26:04.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.392 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.393 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.393 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.385467+0000", 2024-04-19T04:26:04.393 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0206e-05 2024-04-19T04:26:04.393 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.393 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.393 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.394 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.385627+0000", 2024-04-19T04:26:04.394 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000159421 2024-04-19T04:26:04.394 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.394 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.394 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:04.394 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.385732+0000", 2024-04-19T04:26:04.394 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000105237 2024-04-19T04:26:04.394 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.394 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.394 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.395 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.395 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:173072 5.7 5:ea01f076:::benchmark_data_smithi007_19526_object47338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.395 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.385830+0000", 2024-04-19T04:26:04.395 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00077556700000000001, 2024-04-19T04:26:04.395 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00089220399999999996, 2024-04-19T04:26:04.395 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.395 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:04.395 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.395 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.395 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.395 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 173072 2024-04-19T04:26:04.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.395 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.385830+0000", 2024-04-19T04:26:04.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.396 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.385830+0000", 2024-04-19T04:26:04.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.397 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.397 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.385829+0000", 2024-04-19T04:26:04.397 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.397 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.397 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.385833+0000", 2024-04-19T04:26:04.397 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.8060000000000001e-06 2024-04-19T04:26:04.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.397 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.397 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.385840+0000", 2024-04-19T04:26:04.397 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4680000000000003e-06 2024-04-19T04:26:04.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.398 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.398 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.398 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.385856+0000", 2024-04-19T04:26:04.398 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5509e-05 2024-04-19T04:26:04.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.398 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.398 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.398 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.385905+0000", 2024-04-19T04:26:04.398 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8971999999999998e-05 2024-04-19T04:26:04.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.399 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.399 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.399 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.386000+0000", 2024-04-19T04:26:04.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5484999999999998e-05 2024-04-19T04:26:04.401 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.401 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.401 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.402 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:173074 5.7 5.d13ccc7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.402 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.386477+0000", 2024-04-19T04:26:04.402 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.000128436, 2024-04-19T04:26:04.402 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031829299999999998, 2024-04-19T04:26:04.402 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.402 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:04.402 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.402 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.402 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.402 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 173074 2024-04-19T04:26:04.402 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.402 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.402 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.402 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.403 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.386477+0000", 2024-04-19T04:26:04.403 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.403 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.403 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.386477+0000", 2024-04-19T04:26:04.403 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.403 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.386476+0000", 2024-04-19T04:26:04.404 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.404 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.386483+0000", 2024-04-19T04:26:04.404 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7939999999999997e-06 2024-04-19T04:26:04.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.404 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.405 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.386501+0000", 2024-04-19T04:26:04.405 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7863000000000002e-05 2024-04-19T04:26:04.405 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.405 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.405 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.405 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.386510+0000", 2024-04-19T04:26:04.405 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1670000000000005e-06 2024-04-19T04:26:04.405 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.405 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.405 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.405 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.405 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.405 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:173064 5.1 5:897d601a:::benchmark_data_smithi007_19526_object47330:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.405 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.382166+0000", 2024-04-19T04:26:04.406 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0044393669999999996, 2024-04-19T04:26:04.406 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0046929609999999998, 2024-04-19T04:26:04.406 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.406 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:04.406 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.406 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.406 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.406 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 173064 2024-04-19T04:26:04.406 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.406 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.406 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.406 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.406 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.382166+0000", 2024-04-19T04:26:04.407 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.407 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.407 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.407 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.407 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.382166+0000", 2024-04-19T04:26:04.407 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.407 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.407 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.407 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.407 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.382165+0000", 2024-04-19T04:26:04.407 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.407 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.407 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.407 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.408 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.382170+0000", 2024-04-19T04:26:04.408 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2259999999999999e-06 2024-04-19T04:26:04.408 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.408 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.408 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.408 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.382179+0000", 2024-04-19T04:26:04.408 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1940000000000004e-06 2024-04-19T04:26:04.408 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.408 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.408 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.408 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.382184+0000", 2024-04-19T04:26:04.408 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9529999999999998e-06 2024-04-19T04:26:04.408 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.409 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.409 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.409 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.382213+0000", 2024-04-19T04:26:04.409 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8755000000000002e-05 2024-04-19T04:26:04.409 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.409 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.409 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.409 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.382300+0000", 2024-04-19T04:26:04.409 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7862999999999995e-05 2024-04-19T04:26:04.409 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.409 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.409 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.409 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.409 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.410 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:173066 5.7 5:e5db9a6e:::benchmark_data_smithi007_19526_object47332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.410 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.383337+0000", 2024-04-19T04:26:04.410 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0032685269999999998, 2024-04-19T04:26:04.410 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003598099, 2024-04-19T04:26:04.410 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.410 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:04.410 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.410 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.410 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.410 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 173066 2024-04-19T04:26:04.410 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.410 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.410 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.411 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.411 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.383337+0000", 2024-04-19T04:26:04.411 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.411 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.411 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.411 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.411 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.383337+0000", 2024-04-19T04:26:04.411 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.411 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.411 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.411 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.411 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.383336+0000", 2024-04-19T04:26:04.411 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.411 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.411 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.412 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.412 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.383342+0000", 2024-04-19T04:26:04.412 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8340000000000004e-06 2024-04-19T04:26:04.412 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.412 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.412 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.412 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.383357+0000", 2024-04-19T04:26:04.412 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.523e-05 2024-04-19T04:26:04.412 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.412 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.412 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.412 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.383364+0000", 2024-04-19T04:26:04.412 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2479999999999999e-06 2024-04-19T04:26:04.412 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.413 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.413 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.413 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.383410+0000", 2024-04-19T04:26:04.413 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5065999999999998e-05 2024-04-19T04:26:04.413 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.413 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.413 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.413 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.383527+0000", 2024-04-19T04:26:04.413 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011717099999999999 2024-04-19T04:26:04.413 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.413 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.413 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.414 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.414 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.414 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:173068 5.5 5:a215ce13:::benchmark_data_smithi007_19526_object47334:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.414 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.384879+0000", 2024-04-19T04:26:04.414 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0017267680000000001, 2024-04-19T04:26:04.414 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0021312380000000001, 2024-04-19T04:26:04.414 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.414 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:04.415 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.415 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.415 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.415 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 173068 2024-04-19T04:26:04.415 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.415 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.415 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.415 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.415 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.384879+0000", 2024-04-19T04:26:04.415 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.415 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.416 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.416 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.416 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.384879+0000", 2024-04-19T04:26:04.416 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.416 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.416 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.416 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.416 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.384878+0000", 2024-04-19T04:26:04.416 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.416 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.416 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.416 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.416 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.384883+0000", 2024-04-19T04:26:04.417 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7729999999999999e-06 2024-04-19T04:26:04.417 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.417 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.417 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.417 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.384893+0000", 2024-04-19T04:26:04.417 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0291e-05 2024-04-19T04:26:04.417 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.417 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.417 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.417 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.384899+0000", 2024-04-19T04:26:04.417 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4580000000000001e-06 2024-04-19T04:26:04.417 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.417 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.417 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.418 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.384943+0000", 2024-04-19T04:26:04.418 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4552999999999998e-05 2024-04-19T04:26:04.418 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.418 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.418 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.418 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.385091+0000", 2024-04-19T04:26:04.418 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000147625 2024-04-19T04:26:04.418 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.418 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.419 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.419 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.419 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.419 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:173070 5.3 5:c4f24b82:::benchmark_data_smithi007_19526_object47336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.419 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.384917+0000", 2024-04-19T04:26:04.419 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001689032, 2024-04-19T04:26:04.419 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0021667919999999999, 2024-04-19T04:26:04.419 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.419 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:04.419 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.420 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.420 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.420 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 173070 2024-04-19T04:26:04.420 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.420 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.420 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.420 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.420 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.384917+0000", 2024-04-19T04:26:04.420 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.420 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.420 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.420 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.421 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.384917+0000", 2024-04-19T04:26:04.421 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.421 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.421 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.421 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.421 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.384916+0000", 2024-04-19T04:26:04.421 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.421 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.421 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.421 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.421 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.384919+0000", 2024-04-19T04:26:04.421 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.836e-06 2024-04-19T04:26:04.421 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.422 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.422 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.422 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.384926+0000", 2024-04-19T04:26:04.422 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7220000000000002e-06 2024-04-19T04:26:04.422 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.422 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.422 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.422 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.384930+0000", 2024-04-19T04:26:04.422 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9650000000000002e-06 2024-04-19T04:26:04.422 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.422 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.422 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.423 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.384966+0000", 2024-04-19T04:26:04.423 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6604999999999999e-05 2024-04-19T04:26:04.423 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.423 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.423 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.423 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.385058+0000", 2024-04-19T04:26:04.423 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1531000000000002e-05 2024-04-19T04:26:04.423 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.423 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.423 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.423 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.423 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:04.423 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 7 2024-04-19T04:26:04.424 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:04.425 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:04.457 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:04.457+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:04.554 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:04.554 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:04.554 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:04.554 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:04.554 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:04.558 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:04.557+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:04.567 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:04.659 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:04.657+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:04.700 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:04.700 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:04.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:04.700 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:04.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.701 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:04.701 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:04.701 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 70.467733285999998, 2024-04-19T04:26:04.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:04.701 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.701 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.701 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.701 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.701 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.701 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:04.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.701 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:04.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:04.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:04.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:04.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:04.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:04.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:04.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.704 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:04.704 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:04.704 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.705 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.705 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:04.705 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:04.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:04.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:04.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:04.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:04.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:04.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:04.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:04.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:04.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.707 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:04.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:04.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:04.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.707 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:04.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:04.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:04.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.707 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:04.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:04.708 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.708 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.708 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.708 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.708 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop(client.4746.0:26158 5.3 e27/20 5:c69e6a81:::benchmark_data_smithi007_19526_object26157:head v 27'1623, mlcod=27'1621)", 2024-04-19T04:26:04.708 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:26:04.708 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 70.463984026000006, 2024-04-19T04:26:04.708 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048376980999999999, 2024-04-19T04:26:04.708 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.708 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.708 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.708 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.708 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.709 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:26:04.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.709 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.709 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.709 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235274+0000", 2024-04-19T04:26:04.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.709 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.709 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.709 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235273+0000", 2024-04-19T04:26:04.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.709 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.709 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235316+0000", 2024-04-19T04:26:04.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2743000000000001e-05 2024-04-19T04:26:04.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.710 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.710 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235322+0000", 2024-04-19T04:26:04.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5969999999999997e-06 2024-04-19T04:26:04.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.710 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.710 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235327+0000", 2024-04-19T04:26:04.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0319999999999997e-06 2024-04-19T04:26:04.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.710 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235380+0000", 2024-04-19T04:26:04.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3284e-05 2024-04-19T04:26:04.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235394+0000", 2024-04-19T04:26:04.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4436e-05 2024-04-19T04:26:04.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:04.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283590+0000", 2024-04-19T04:26:04.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048195978 2024-04-19T04:26:04.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.712 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283651+0000", 2024-04-19T04:26:04.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0333e-05 2024-04-19T04:26:04.712 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.712 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.712 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.712 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:04.712 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:04.712 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 70.463638364999994, 2024-04-19T04:26:04.713 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:04.713 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.713 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.713 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.713 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.713 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.713 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:04.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.713 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.713 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.713 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.713 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:04.713 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.714 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.714 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.714 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:04.714 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.714 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.714 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.714 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:04.714 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.714 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.714 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.714 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:04.714 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:04.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:04.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:04.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:04.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:04.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:04.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:04.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:04.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:04.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:04.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:04.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:04.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:04.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:04.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:04.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:04.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:04.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:04.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:04.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:04.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:04.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:04.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:04.718 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.718 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.718 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.718 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:04.718 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:04.718 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 70.460347179999999, 2024-04-19T04:26:04.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:04.718 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.718 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.718 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.719 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.719 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.719 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:04.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.719 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.719 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.719 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:04.719 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.719 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.719 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:04.719 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:04.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:04.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:04.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:04.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:04.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:04.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:04.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:04.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:04.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.722 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.722 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:04.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:04.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.722 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:04.722 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:04.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:04.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.722 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:04.722 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:04.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:04.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:04.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:04.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:04.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:04.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:04.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:04.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:04.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:04.724 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.724 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.724 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.724 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:04.724 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:04.724 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 48.742957715000003, 2024-04-19T04:26:04.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:04.724 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.724 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:04.724 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.725 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.725 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.725 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:04.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.725 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:04.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:04.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.726 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:04.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.726 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:04.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:04.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:04.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:04.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:04.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:04.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:04.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:04.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:04.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:04.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:04.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:04.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:04.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:04.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:04.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:04.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:04.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:04.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:04.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:04.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:04.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:04.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:04.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.730 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:04.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:04.730 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.730 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.730 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.730 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:04.730 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:04.730 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 48.722727266, 2024-04-19T04:26:04.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:04.731 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.731 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:04.731 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.731 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.731 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.731 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:04.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.731 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.731 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.731 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.731 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:04.731 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:04.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:04.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:04.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:04.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:04.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:04.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:04.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:04.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:04.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:04.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:04.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:04.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:04.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:04.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:04.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:04.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:04.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:04.735 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.735 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.735 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.736 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:04.736 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:04.736 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 48.722619409000004, 2024-04-19T04:26:04.736 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:04.736 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.736 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:04.736 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.736 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.736 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.736 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:04.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.736 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.737 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:04.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.737 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:04.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.737 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:04.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.738 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.738 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:04.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:04.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.738 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.738 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.738 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:04.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:04.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.738 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.738 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.738 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:04.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:04.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.739 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.739 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:04.739 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:04.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.739 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:04.739 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:04.739 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:04.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.739 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.739 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:04.739 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:04.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.740 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.740 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.740 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:04.740 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:04.740 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.740 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.740 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.740 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.740 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:04.740 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:04.740 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 48.720652719999997, 2024-04-19T04:26:04.740 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:04.741 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.741 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.741 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.741 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.741 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.741 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:04.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.741 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:04.741 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:04.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:04.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:04.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:04.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:04.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.743 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:04.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:04.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.743 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:04.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:04.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.743 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:04.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:04.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.744 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.744 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:04.744 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:04.744 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:04.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.744 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.744 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.744 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:04.744 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:04.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.744 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.744 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.744 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:04.744 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:04.745 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.745 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.745 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:04.745 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:04.745 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:04.745 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.745 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.745 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:04.745 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:04.745 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:04.745 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.745 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.745 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.746 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:04.746 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:04.746 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.746 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.746 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.746 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.746 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.746 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:04.746 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:04.746 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 48.717288525000001, 2024-04-19T04:26:04.747 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:04.747 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.747 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.747 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.747 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.747 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.747 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:04.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.747 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.747 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.747 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.747 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:04.748 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.748 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.748 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.748 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:04.748 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.748 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.748 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.748 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:04.748 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.749 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.749 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.749 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:04.749 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:04.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.749 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.749 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.749 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:04.749 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:04.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.749 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.749 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.749 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:04.749 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:04.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.750 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.750 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.750 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:04.750 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:04.750 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.750 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.750 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:04.750 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:04.750 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:04.750 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.750 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.750 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.750 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:04.751 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:04.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.751 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.751 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.751 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:04.751 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:04.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.751 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.751 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:04.751 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:04.751 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:04.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.751 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.751 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:04.752 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:04.752 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:04.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.752 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.752 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.752 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:04.752 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:04.752 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.752 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.752 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.752 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.752 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:04.752 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:04.752 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 48.713477546999997, 2024-04-19T04:26:04.753 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:04.753 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.753 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.753 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.753 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.753 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.753 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:04.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.753 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.753 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.753 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.753 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:04.753 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.753 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.754 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.754 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:04.754 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.754 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.754 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.754 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:04.754 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.754 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.754 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.754 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:04.754 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:04.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.755 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.755 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:04.755 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:04.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.755 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.755 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:04.755 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:04.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.756 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.756 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:04.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:04.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.756 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:04.756 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:04.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:04.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.756 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.756 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:04.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:04.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.757 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.757 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.757 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:04.757 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:04.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.757 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.757 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:04.757 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:04.757 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:04.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.757 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.757 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:04.757 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:04.757 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:04.758 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.758 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.758 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.758 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:04.758 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:04.758 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.758 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.758 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.758 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.758 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.758 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93735 5.1 5:8e609d1b:::benchmark_data_smithi007_19526_object93734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:04.758 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:26:04.758 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.471776902999999, 2024-04-19T04:26:04.758 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048424842000000003, 2024-04-19T04:26:04.759 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.759 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.759 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.759 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.759 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.759 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93735 2024-04-19T04:26:04.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.759 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.759 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.759 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.759 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:26:04.759 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.759 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.760 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.760 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227481+0000", 2024-04-19T04:26:04.760 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.760 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.760 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.760 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.760 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227480+0000", 2024-04-19T04:26:04.760 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.760 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.760 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.760 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.760 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227533+0000", 2024-04-19T04:26:04.760 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2964999999999999e-05 2024-04-19T04:26:04.760 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.761 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.761 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227542+0000", 2024-04-19T04:26:04.761 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1449999999999997e-06 2024-04-19T04:26:04.761 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.761 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.761 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227561+0000", 2024-04-19T04:26:04.761 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9116000000000001e-05 2024-04-19T04:26:04.761 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.761 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.761 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227610+0000", 2024-04-19T04:26:04.762 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9234000000000003e-05 2024-04-19T04:26:04.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.762 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.762 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.762 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227697+0000", 2024-04-19T04:26:04.762 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6682999999999997e-05 2024-04-19T04:26:04.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.762 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.762 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:04.762 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275809+0000", 2024-04-19T04:26:04.762 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048112265000000001 2024-04-19T04:26:04.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.763 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.763 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:04.763 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275845+0000", 2024-04-19T04:26:04.763 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5275999999999999e-05 2024-04-19T04:26:04.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.763 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.763 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.763 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275906+0000", 2024-04-19T04:26:04.763 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1002999999999999e-05 2024-04-19T04:26:04.763 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.763 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.763 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.764 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.764 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93736 5.1 5:852229ec:::benchmark_data_smithi007_19526_object93735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:04.764 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:26:04.764 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.471672873000003, 2024-04-19T04:26:04.764 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048414497000000001, 2024-04-19T04:26:04.764 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.764 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.764 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.765 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.765 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.765 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93736 2024-04-19T04:26:04.765 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.765 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.765 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.765 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.765 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:26:04.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.765 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.765 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.765 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.766 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227585+0000", 2024-04-19T04:26:04.766 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.766 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.766 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.766 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.766 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227584+0000", 2024-04-19T04:26:04.766 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.766 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.766 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.767 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.767 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227624+0000", 2024-04-19T04:26:04.767 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9833000000000003e-05 2024-04-19T04:26:04.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.767 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.767 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.767 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227630+0000", 2024-04-19T04:26:04.767 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0759999999999999e-06 2024-04-19T04:26:04.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.768 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.768 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227634+0000", 2024-04-19T04:26:04.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1570000000000002e-06 2024-04-19T04:26:04.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.768 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.768 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229531+0000", 2024-04-19T04:26:04.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018962339999999999 2024-04-19T04:26:04.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.769 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.229662+0000", 2024-04-19T04:26:04.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013192999999999999 2024-04-19T04:26:04.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.769 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:04.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275915+0000", 2024-04-19T04:26:04.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.046252140999999997 2024-04-19T04:26:04.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.770 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:04.770 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275944+0000", 2024-04-19T04:26:04.770 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9539999999999998e-05 2024-04-19T04:26:04.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.770 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.770 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.770 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.275999+0000", 2024-04-19T04:26:04.770 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5062999999999998e-05 2024-04-19T04:26:04.770 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.770 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.770 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.771 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.771 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:04.771 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:04.771 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.471615190000001, 2024-04-19T04:26:04.771 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:04.771 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.771 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.771 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.771 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.771 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.771 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:04.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.771 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.771 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.771 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.772 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:04.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.772 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.772 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:04.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.772 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.772 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:04.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:04.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:04.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:04.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:04.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:04.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.774 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:04.775 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:04.775 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:04.775 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.775 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:04.775 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:04.775 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:04.775 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.775 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.775 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:04.775 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:04.775 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.775 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.776 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.776 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.776 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:04.776 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:04.776 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.47102091, 2024-04-19T04:26:04.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:04.776 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.776 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.776 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.776 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.776 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.776 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:04.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.777 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.777 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:04.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.777 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:04.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.778 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.778 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:04.778 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.778 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.778 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.778 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:04.778 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:04.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.778 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.778 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.778 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:04.778 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:04.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.779 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.779 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.779 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:04.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:04.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.779 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.779 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.779 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:04.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:04.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.779 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:04.780 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:04.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:04.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:04.780 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:04.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:04.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:04.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:04.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:04.781 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:04.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:04.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:04.781 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:04.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:04.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.782 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.782 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.782 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:04.782 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:04.782 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.782 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.782 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.782 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.782 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:04.782 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:04.782 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.746373752, 2024-04-19T04:26:04.782 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:04.782 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.783 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.783 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.783 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.783 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.783 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:04.783 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.783 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.783 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.783 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.783 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:04.783 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.783 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.783 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.783 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.783 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:04.784 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.784 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.784 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.784 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.784 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:04.784 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.784 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.784 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.784 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.784 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:04.784 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:04.784 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.784 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.784 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.784 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:04.785 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:04.785 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.785 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.785 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.785 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:04.785 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:04.785 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.785 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.785 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.785 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:04.785 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:04.785 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.785 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.785 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.785 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:04.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:04.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.786 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:04.786 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:04.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:04.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.786 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:04.786 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:04.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:04.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.786 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:04.786 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:04.787 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:04.787 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.787 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.787 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:04.787 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:04.787 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:04.787 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.787 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.787 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.787 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:04.787 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:04.787 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.788 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.788 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.788 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.788 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.788 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:04.788 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:04.788 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.74633333599999996, 2024-04-19T04:26:04.788 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:04.788 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.788 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.788 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.788 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.788 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.789 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:04.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.789 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.789 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.789 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.789 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:04.789 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.789 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.789 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.789 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:04.789 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.789 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.790 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.790 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:04.790 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.790 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.790 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.790 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.790 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:04.790 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:04.790 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.790 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.790 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.791 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:04.791 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:04.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.791 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.791 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.791 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:04.791 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:04.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.791 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.791 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.791 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:04.791 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:04.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.792 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.792 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.792 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:04.792 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:04.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.792 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.792 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:04.792 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:04.792 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:04.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.792 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.792 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:04.792 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:04.792 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:04.793 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.793 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.793 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:04.793 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:04.793 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:04.793 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.793 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.793 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:04.793 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:04.793 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:04.793 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.793 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.793 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.793 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:04.793 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:04.793 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.794 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.794 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.794 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.794 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.794 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:04.794 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:04.794 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.74263702700000001, 2024-04-19T04:26:04.794 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:04.794 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.794 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.794 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.794 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.794 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.794 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:04.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.795 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.795 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.795 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.795 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:04.795 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.795 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.795 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.795 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:04.795 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.795 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.795 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.795 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:04.795 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.796 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.796 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:04.796 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:04.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.796 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.796 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:04.796 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:04.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.796 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.796 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:04.796 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:04.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.797 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.797 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.797 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:04.797 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:04.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.797 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.797 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.797 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:04.797 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:04.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.797 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.797 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:04.797 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:04.797 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:04.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.798 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.798 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:04.798 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:04.798 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:04.798 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.798 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.798 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:04.798 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:04.798 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:04.798 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.798 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.798 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:04.798 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:04.798 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:04.799 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.799 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.799 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.799 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:04.799 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:04.799 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.799 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.799 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.799 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.799 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.799 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.799 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:04.799 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.48902655299999997, 2024-04-19T04:26:04.799 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:04.800 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.800 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.800 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.800 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.800 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.800 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:04.800 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.800 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.800 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.800 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.800 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:04.800 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.800 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.801 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.801 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.801 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:04.801 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.801 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.801 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.801 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:04.801 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.801 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.801 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.801 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:04.802 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:04.802 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.802 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.802 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.802 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:04.802 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:04.802 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.802 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.802 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.802 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:04.802 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:04.802 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.802 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.802 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.803 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:04.803 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:04.803 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.803 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.803 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.803 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:04.803 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:04.803 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.803 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.803 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:04.803 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:04.803 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:04.804 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.804 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.804 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:04.804 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:04.804 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:04.804 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.804 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.804 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.804 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:04.804 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:04.804 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.804 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.805 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.805 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.805 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.805 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.805 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:04.805 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.48673314099999998, 2024-04-19T04:26:04.805 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:04.805 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.805 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.805 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.805 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.806 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.806 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:04.806 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.806 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.806 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.806 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.806 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:04.806 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.806 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.806 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.806 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.806 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:04.806 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.807 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.807 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.807 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.807 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:04.807 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.807 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.807 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.807 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.807 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:04.807 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:04.807 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.808 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.808 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.808 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:04.808 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:04.808 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.808 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.808 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.808 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:04.808 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:04.808 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.808 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.808 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.809 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:04.809 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:04.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.809 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.809 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.809 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:04.809 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:04.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.809 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.809 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:04.809 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:04.809 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:04.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.809 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.810 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:04.810 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:04.810 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:04.810 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.810 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.810 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.810 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:04.810 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:04.810 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.810 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.810 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.810 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.810 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.810 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.811 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:04.811 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.486687325, 2024-04-19T04:26:04.811 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:04.811 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:04.811 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:04.811 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:04.811 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:04.811 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.811 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:04.811 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.811 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:04.811 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.811 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:04.811 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:04.812 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.812 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.812 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:04.812 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:04.812 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:04.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.812 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.812 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:04.812 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:04.812 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.812 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.812 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:04.812 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:04.813 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:04.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.813 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:04.813 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:04.813 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:04.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.813 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.813 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:04.813 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:04.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:04.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:04.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:04.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:04.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:04.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:04.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:04.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:04.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:04.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:04.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:04.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:04.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:04.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:04.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:04.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:04.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:04.815 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.815 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.815 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.815 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:04.815 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:04.815 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:04.817 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:04.818 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:04.813+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:04.918 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:04.917+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:04.929 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:04.929 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:04.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.929 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.929 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:04.929 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.039032130999999998, 2024-04-19T04:26:04.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.039067664000000002, 2024-04-19T04:26:04.929 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.929 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:04.930 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.930 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.930 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.930 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:04.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.930 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:04.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.037821749000000002, 2024-04-19T04:26:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.037939522000000003, 2024-04-19T04:26:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.934 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:04.934 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.934 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.934 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.934 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:04.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.934 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:04.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.036870258000000003, 2024-04-19T04:26:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.037059611999999999, 2024-04-19T04:26:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.033862679999999999, 2024-04-19T04:26:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.034121685999999998, 2024-04-19T04:26:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.942 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:04.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.942 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:04.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:04.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:04.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:04.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:04.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:04.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:04.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:04.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:04.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:04.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:04.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:04.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:04.944 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.944 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.945 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.945 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174334 5.8 5:101fbe8a:::benchmark_data_smithi007_19526_object48600:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.945 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895186+0000", 2024-04-19T04:26:04.945 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.033813052000000003, 2024-04-19T04:26:04.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.03414176, 2024-04-19T04:26:04.945 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.945 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:04.945 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.945 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.945 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.945 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174334 2024-04-19T04:26:04.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.945 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895186+0000", 2024-04-19T04:26:04.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895186+0000", 2024-04-19T04:26:04.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895186+0000", 2024-04-19T04:26:04.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895189+0000", 2024-04-19T04:26:04.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3859999999999999e-06 2024-04-19T04:26:04.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895201+0000", 2024-04-19T04:26:04.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1729000000000001e-05 2024-04-19T04:26:04.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895206+0000", 2024-04-19T04:26:04.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.575e-06 2024-04-19T04:26:04.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895721+0000", 2024-04-19T04:26:04.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00051423799999999998 2024-04-19T04:26:04.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895888+0000", 2024-04-19T04:26:04.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000167567 2024-04-19T04:26:04.948 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.948 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.948 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.949 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5.371aef1e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.949 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:04.949 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.033488556000000003, 2024-04-19T04:26:04.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.033884427000000002, 2024-04-19T04:26:04.949 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.949 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:04.949 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.949 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.949 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.949 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:04.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.949 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:04.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:04.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:04.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:04.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:04.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:04.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:04.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:04.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:04.951 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.951 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.952 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.952 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.952 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:04.952 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.033398603999999998, 2024-04-19T04:26:04.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.033852255999999997, 2024-04-19T04:26:04.952 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.952 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:04.952 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.952 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.952 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.952 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:04.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.953 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:04.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:04.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:04.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:04.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:04.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:04.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:04.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:04.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:04.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:04.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:04.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:04.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:04.955 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.955 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.956 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.956 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:174342 5.9 e55/20 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head v 55'11192, mlcod=55'11189)", 2024-04-19T04:26:04.956 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.897989+0000", 2024-04-19T04:26:04.956 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.031010098, 2024-04-19T04:26:04.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.031533107999999997, 2024-04-19T04:26:04.956 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.956 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:04.956 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.956 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.897989+0000", 2024-04-19T04:26:04.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.897989+0000", 2024-04-19T04:26:04.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.897988+0000", 2024-04-19T04:26:04.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.897995+0000", 2024-04-19T04:26:04.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.686e-06 2024-04-19T04:26:04.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898005+0000", 2024-04-19T04:26:04.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4800000000000007e-06 2024-04-19T04:26:04.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898011+0000", 2024-04-19T04:26:04.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7089999999999996e-06 2024-04-19T04:26:04.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898052+0000", 2024-04-19T04:26:04.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0428e-05 2024-04-19T04:26:04.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898072+0000", 2024-04-19T04:26:04.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0625e-05 2024-04-19T04:26:04.959 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.959 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.959 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.959 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:174344 5.d e55/29 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head v 55'10558, mlcod=55'10556)", 2024-04-19T04:26:04.959 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.898585+0000", 2024-04-19T04:26:04.959 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.030414424999999998, 2024-04-19T04:26:04.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.031001092000000001, 2024-04-19T04:26:04.960 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.960 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:04.960 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898585+0000", 2024-04-19T04:26:04.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898585+0000", 2024-04-19T04:26:04.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898584+0000", 2024-04-19T04:26:04.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898591+0000", 2024-04-19T04:26:04.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7889999999999997e-06 2024-04-19T04:26:04.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898600+0000", 2024-04-19T04:26:04.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9099999999999994e-06 2024-04-19T04:26:04.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.962 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.962 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.962 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:04.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2890000000000003e-06 2024-04-19T04:26:04.962 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.962 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.962 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.962 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898659+0000", 2024-04-19T04:26:04.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2672e-05 2024-04-19T04:26:04.962 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.962 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.962 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.962 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898678+0000", 2024-04-19T04:26:04.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9726000000000001e-05 2024-04-19T04:26:04.963 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.963 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.963 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.963 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:174346 5.f e55/20 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head v 55'10739, mlcod=55'10737)", 2024-04-19T04:26:04.963 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900551+0000", 2024-04-19T04:26:04.963 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.028447917999999999, 2024-04-19T04:26:04.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.029095256999999999, 2024-04-19T04:26:04.963 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.963 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:04.963 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900551+0000", 2024-04-19T04:26:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900551+0000", 2024-04-19T04:26:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900551+0000", 2024-04-19T04:26:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900557+0000", 2024-04-19T04:26:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8129999999999998e-06 2024-04-19T04:26:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900567+0000", 2024-04-19T04:26:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4420000000000004e-06 2024-04-19T04:26:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900576+0000", 2024-04-19T04:26:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9109999999999999e-06 2024-04-19T04:26:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900621+0000", 2024-04-19T04:26:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5562000000000002e-05 2024-04-19T04:26:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900641+0000", 2024-04-19T04:26:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9792999999999998e-05 2024-04-19T04:26:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174347 5.0 5.2d3d0340 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900668+0000", 2024-04-19T04:26:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.028331137999999999, 2024-04-19T04:26:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.029037952999999998, 2024-04-19T04:26:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174347 2024-04-19T04:26:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900668+0000", 2024-04-19T04:26:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900668+0000", 2024-04-19T04:26:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900667+0000", 2024-04-19T04:26:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900672+0000", 2024-04-19T04:26:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2230000000000001e-06 2024-04-19T04:26:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900678+0000", 2024-04-19T04:26:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5989999999999998e-06 2024-04-19T04:26:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900683+0000", 2024-04-19T04:26:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.763e-06 2024-04-19T04:26:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5.7adde50e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.028311606999999999, 2024-04-19T04:26:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.029072891999999999, 2024-04-19T04:26:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.041384648000000003, 2024-04-19T04:26:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042204078999999999, 2024-04-19T04:26:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.041353650999999998, 2024-04-19T04:26:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.042241308999999998, 2024-04-19T04:26:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:26:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 14 2024-04-19T04:26:04.981 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:04.982 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:05.018 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:05.017+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:05.103 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:05.103 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:05.103 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:05.103 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:05.103 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:05.117 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:05.119 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:05.117+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:05.223 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:05.221+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:05.238 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:05.239 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:05.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:05.239 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:05.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.239 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:05.239 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:05.239 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 49.286122671000001, 2024-04-19T04:26:05.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:05.239 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.239 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:05.239 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.239 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.240 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.240 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:05.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.240 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:05.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:05.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:05.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:05.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:05.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:05.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:05.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:05.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:05.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:05.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:05.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:05.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:05.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:05.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:05.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:05.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:05.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:05.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:05.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:05.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:05.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:05.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:05.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:05.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:05.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:05.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:05.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:05.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:05.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:05.245 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.245 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.245 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.245 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:05.245 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:05.245 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 49.281061025, 2024-04-19T04:26:05.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:05.245 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.245 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:05.245 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.246 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.246 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.246 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:05.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.246 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:05.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:05.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:05.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:05.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:05.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:05.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:05.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:05.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:05.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:05.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:05.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:05.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:05.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:05.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:05.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:05.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:05.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:05.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:05.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:05.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:05.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:05.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:05.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:05.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:05.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:05.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:05.250 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.250 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.250 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.251 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:05.251 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:05.251 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 49.280961112999996, 2024-04-19T04:26:05.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:05.251 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.251 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:05.251 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.252 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.252 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.252 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:05.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.252 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:05.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:05.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:05.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:05.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:05.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:05.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:05.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:05.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:05.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:05.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:05.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:05.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:05.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:05.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:05.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:05.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:05.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:05.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:05.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:05.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:05.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:05.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:05.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:05.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:05.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:05.256 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.257 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.257 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.257 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:05.257 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:05.257 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 49.280835359999998, 2024-04-19T04:26:05.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:05.257 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.257 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:05.257 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.257 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.257 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.257 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:05.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.258 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:05.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:05.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:05.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 49.276991414999998, 2024-04-19T04:26:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:05.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:05.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:05.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:05.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:05.268 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.268 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.268 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.268 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 49.269820314, 2024-04-19T04:26:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 49.26964821, 2024-04-19T04:26:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 49.269585085000003, 2024-04-19T04:26:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 49.269456488000003, 2024-04-19T04:26:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 49.269388517000003, 2024-04-19T04:26:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.34984885199999999, 2024-04-19T04:26:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078453623, 2024-04-19T04:26:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965893+0000", 2024-04-19T04:26:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.076646455000000002 2024-04-19T04:26:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965956+0000", 2024-04-19T04:26:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3200000000000005e-05 2024-04-19T04:26:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966068+0000", 2024-04-19T04:26:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011194800000000001 2024-04-19T04:26:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.34981785500000001, 2024-04-19T04:26:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083782388999999999, 2024-04-19T04:26:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971179+0000", 2024-04-19T04:26:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079349476000000002 2024-04-19T04:26:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971259+0000", 2024-04-19T04:26:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9083000000000002e-05 2024-04-19T04:26:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971428+0000", 2024-04-19T04:26:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169419 2024-04-19T04:26:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.34749633499999999, 2024-04-19T04:26:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081686998999999996, 2024-04-19T04:26:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971454+0000", 2024-04-19T04:26:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077525997999999999 2024-04-19T04:26:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971540+0000", 2024-04-19T04:26:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6285000000000005e-05 2024-04-19T04:26:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971654+0000", 2024-04-19T04:26:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114095 2024-04-19T04:26:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.34628595299999998, 2024-04-19T04:26:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080734265999999999, 2024-04-19T04:26:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971677+0000", 2024-04-19T04:26:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.073192023999999994 2024-04-19T04:26:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971771+0000", 2024-04-19T04:26:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4235999999999997e-05 2024-04-19T04:26:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971912+0000", 2024-04-19T04:26:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014055099999999999 2024-04-19T04:26:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.34533446200000001, 2024-04-19T04:26:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085645857000000006, 2024-04-19T04:26:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977634+0000", 2024-04-19T04:26:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077144335999999994 2024-04-19T04:26:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977699+0000", 2024-04-19T04:26:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4518999999999997e-05 2024-04-19T04:26:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977775+0000", 2024-04-19T04:26:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6219999999999999e-05 2024-04-19T04:26:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.342326884, 2024-04-19T04:26:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075403611999999995, 2024-04-19T04:26:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970369+0000", 2024-04-19T04:26:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.074967992999999997 2024-04-19T04:26:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970419+0000", 2024-04-19T04:26:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9700999999999997e-05 2024-04-19T04:26:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970540+0000", 2024-04-19T04:26:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121512 2024-04-19T04:26:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5:78f758ec:::benchmark_data_smithi007_19526_object48602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.34195276000000002, 2024-04-19T04:26:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085171609999999995, 2024-04-19T04:26:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966154+0000", 2024-04-19T04:26:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.070613543000000001 2024-04-19T04:26:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966382+0000", 2024-04-19T04:26:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022741800000000001 2024-04-19T04:26:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980581+0000", 2024-04-19T04:26:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014199916999999999 2024-04-19T04:26:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980621+0000", 2024-04-19T04:26:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9685999999999999e-05 2024-04-19T04:26:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980682+0000", 2024-04-19T04:26:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1130000000000006e-05 2024-04-19T04:26:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.34186280800000002, 2024-04-19T04:26:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075073230000000005, 2024-04-19T04:26:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970556+0000", 2024-04-19T04:26:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.072076192999999997 2024-04-19T04:26:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970608+0000", 2024-04-19T04:26:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2549000000000001e-05 2024-04-19T04:26:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970674+0000", 2024-04-19T04:26:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5549000000000005e-05 2024-04-19T04:26:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5:70a7bb5e:::benchmark_data_smithi007_19526_object48614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.33677581099999998, 2024-04-19T04:26:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080099220999999998, 2024-04-19T04:26:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971978+0000", 2024-04-19T04:26:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.071282358000000004 2024-04-19T04:26:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.972180+0000", 2024-04-19T04:26:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020191100000000001 2024-04-19T04:26:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980701+0000", 2024-04-19T04:26:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085211760000000001 2024-04-19T04:26:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980729+0000", 2024-04-19T04:26:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8068e-05 2024-04-19T04:26:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980787+0000", 2024-04-19T04:26:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7521e-05 2024-04-19T04:26:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174350 5.e 5:7f36609a:::benchmark_data_smithi007_19526_object48616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.335004739, 2024-04-19T04:26:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079723622999999993, 2024-04-19T04:26:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174350 2024-04-19T04:26:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902458+0000", 2024-04-19T04:26:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902463+0000", 2024-04-19T04:26:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5889999999999996e-06 2024-04-19T04:26:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965576+0000", 2024-04-19T04:26:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063113328999999996 2024-04-19T04:26:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965614+0000", 2024-04-19T04:26:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8285999999999999e-05 2024-04-19T04:26:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974787+0000", 2024-04-19T04:26:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009172599 2024-04-19T04:26:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974999+0000", 2024-04-19T04:26:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021270999999999999 2024-04-19T04:26:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982086+0000", 2024-04-19T04:26:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070869160000000004 2024-04-19T04:26:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982115+0000", 2024-04-19T04:26:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8603999999999999e-05 2024-04-19T04:26:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982182+0000", 2024-04-19T04:26:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7350999999999999e-05 2024-04-19T04:26:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:05.343 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:05.345 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:05.341+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:05.345 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:05.445 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:05.445+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:05.475 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:05.475 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:05.475 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.475 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:175581 5.f 5.dd7e9cdf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.475 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:05.471635+0000", 2024-04-19T04:26:05.475 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0035673979999999998, 2024-04-19T04:26:05.475 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003587495, 2024-04-19T04:26:05.475 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.476 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:05.476 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.476 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.476 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.476 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 175581 2024-04-19T04:26:05.476 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.476 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.476 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.476 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.476 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471635+0000", 2024-04-19T04:26:05.476 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.476 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.477 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.477 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.477 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471635+0000", 2024-04-19T04:26:05.477 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.477 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.477 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.477 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.477 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471635+0000", 2024-04-19T04:26:05.477 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.477 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.477 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.477 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.478 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471639+0000", 2024-04-19T04:26:05.478 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7780000000000001e-06 2024-04-19T04:26:05.478 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.478 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.478 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.478 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471646+0000", 2024-04-19T04:26:05.478 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3000000000000004e-06 2024-04-19T04:26:05.478 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.478 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.478 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.478 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471658+0000", 2024-04-19T04:26:05.478 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1946e-05 2024-04-19T04:26:05.479 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.479 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.479 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.479 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.479 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.479 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:175582 5.d 5:beb964a9:::benchmark_data_smithi007_19526_object49848:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.479 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:05.471665+0000", 2024-04-19T04:26:05.479 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0035380379999999999, 2024-04-19T04:26:05.479 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003601351, 2024-04-19T04:26:05.479 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.479 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:05.479 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.479 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.480 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.480 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 175582 2024-04-19T04:26:05.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.480 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.480 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.480 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.480 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471665+0000", 2024-04-19T04:26:05.480 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.480 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.480 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.480 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471665+0000", 2024-04-19T04:26:05.481 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.481 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.481 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.481 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.481 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471664+0000", 2024-04-19T04:26:05.481 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.481 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.481 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.481 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.481 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471667+0000", 2024-04-19T04:26:05.481 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.3379999999999999e-06 2024-04-19T04:26:05.481 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.482 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.482 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.482 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471671+0000", 2024-04-19T04:26:05.482 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.233e-06 2024-04-19T04:26:05.482 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.482 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.482 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.482 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471674+0000", 2024-04-19T04:26:05.482 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.993e-06 2024-04-19T04:26:05.482 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.482 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.482 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.483 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.472601+0000", 2024-04-19T04:26:05.483 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00092670700000000003 2024-04-19T04:26:05.483 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.483 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.483 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.483 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.472752+0000", 2024-04-19T04:26:05.483 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000151481 2024-04-19T04:26:05.483 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.483 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.483 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:05.483 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.472857+0000", 2024-04-19T04:26:05.483 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000104505 2024-04-19T04:26:05.483 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.484 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.484 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.484 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475201+0000", 2024-04-19T04:26:05.484 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023442020000000001 2024-04-19T04:26:05.484 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.484 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.484 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.484 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.484 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.484 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:175584 5.f 5.97d47dcf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.484 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:05.473495+0000", 2024-04-19T04:26:05.484 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0017079790000000001, 2024-04-19T04:26:05.485 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001842008, 2024-04-19T04:26:05.485 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.485 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:05.485 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.485 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.485 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.485 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 175584 2024-04-19T04:26:05.485 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.485 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.485 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.485 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.485 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.473495+0000", 2024-04-19T04:26:05.485 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.486 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.486 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.486 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.486 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.473495+0000", 2024-04-19T04:26:05.486 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.486 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.486 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.486 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.486 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.473494+0000", 2024-04-19T04:26:05.486 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.486 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.486 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.487 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.487 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.473499+0000", 2024-04-19T04:26:05.487 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6210000000000003e-06 2024-04-19T04:26:05.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.487 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.487 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.487 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.473509+0000", 2024-04-19T04:26:05.487 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0117e-05 2024-04-19T04:26:05.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.487 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.487 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.487 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.473514+0000", 2024-04-19T04:26:05.488 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.135e-06 2024-04-19T04:26:05.488 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.488 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.488 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.488 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.488 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.488 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:175585 5.f 5.d5301f2f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.488 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:05.473519+0000", 2024-04-19T04:26:05.488 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001684044, 2024-04-19T04:26:05.488 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018729440000000001, 2024-04-19T04:26:05.488 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.488 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:05.488 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.489 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.489 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.489 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 175585 2024-04-19T04:26:05.489 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.489 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.489 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.489 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.489 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.473519+0000", 2024-04-19T04:26:05.489 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.489 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.489 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.489 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.489 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.473519+0000", 2024-04-19T04:26:05.490 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.490 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.490 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.490 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.490 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.473518+0000", 2024-04-19T04:26:05.490 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.490 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.490 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.490 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.490 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.473520+0000", 2024-04-19T04:26:05.490 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0320000000000002e-06 2024-04-19T04:26:05.490 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.491 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.491 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.491 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.473524+0000", 2024-04-19T04:26:05.491 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4079999999999998e-06 2024-04-19T04:26:05.491 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.491 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.491 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.491 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.473526+0000", 2024-04-19T04:26:05.491 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6309999999999999e-06 2024-04-19T04:26:05.491 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.491 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.491 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.492 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.492 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.492 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:175587 5.2 5:4c6acee0:::benchmark_data_smithi007_19526_object49853:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.492 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:05.474113+0000", 2024-04-19T04:26:05.492 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001089294, 2024-04-19T04:26:05.492 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001336896, 2024-04-19T04:26:05.492 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.492 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:05.492 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.492 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.492 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.492 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 175587 2024-04-19T04:26:05.493 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.493 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.493 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.493 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.493 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.474113+0000", 2024-04-19T04:26:05.493 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.493 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.493 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.493 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.493 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.474113+0000", 2024-04-19T04:26:05.493 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.493 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.494 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.494 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.494 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.474113+0000", 2024-04-19T04:26:05.494 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.494 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.494 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.494 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.494 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.474118+0000", 2024-04-19T04:26:05.494 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2020000000000003e-06 2024-04-19T04:26:05.494 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.494 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.494 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.494 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.474135+0000", 2024-04-19T04:26:05.495 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7204999999999999e-05 2024-04-19T04:26:05.495 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.495 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.495 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.495 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.474155+0000", 2024-04-19T04:26:05.495 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9621999999999999e-05 2024-04-19T04:26:05.495 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.495 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.495 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.495 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.474209+0000", 2024-04-19T04:26:05.495 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4802000000000001e-05 2024-04-19T04:26:05.495 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.495 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.496 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.496 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.474425+0000", 2024-04-19T04:26:05.496 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000216054 2024-04-19T04:26:05.496 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.496 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.496 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.496 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.496 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.496 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:175588 5.1 5:8657ebf5:::benchmark_data_smithi007_19526_object49854:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.496 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:05.475262+0000", 2024-04-19T04:26:05.496 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9999404, 2024-04-19T04:26:05.496 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00025512899999999999, 2024-04-19T04:26:05.497 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.497 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:05.497 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.497 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.497 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.497 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 175588 2024-04-19T04:26:05.497 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.497 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.497 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.497 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.497 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475262+0000", 2024-04-19T04:26:05.497 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.498 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.498 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.498 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.498 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475262+0000", 2024-04-19T04:26:05.498 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.498 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.498 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.498 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.498 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475261+0000", 2024-04-19T04:26:05.498 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.498 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.498 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.499 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.499 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475266+0000", 2024-04-19T04:26:05.499 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8149999999999996e-06 2024-04-19T04:26:05.499 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.499 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.499 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.499 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475276+0000", 2024-04-19T04:26:05.499 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0121e-05 2024-04-19T04:26:05.499 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.500 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.500 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.500 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475282+0000", 2024-04-19T04:26:05.500 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4229999999999996e-06 2024-04-19T04:26:05.500 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.500 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.500 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.500 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475320+0000", 2024-04-19T04:26:05.500 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.8135e-05 2024-04-19T04:26:05.500 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.500 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.500 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.501 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475395+0000", 2024-04-19T04:26:05.501 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5582999999999998e-05 2024-04-19T04:26:05.501 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.501 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.501 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.501 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.501 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.501 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:175589 5.9 5:9d82b5f5:::benchmark_data_smithi007_19526_object49855:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.501 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:05.475292+0000", 2024-04-19T04:26:05.501 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9999104, 2024-04-19T04:26:05.501 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00029283299999999999, 2024-04-19T04:26:05.502 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.502 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:05.502 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.502 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.502 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.502 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 175589 2024-04-19T04:26:05.502 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.502 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.502 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.502 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.502 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475292+0000", 2024-04-19T04:26:05.503 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.503 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.503 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.503 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.503 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475292+0000", 2024-04-19T04:26:05.503 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.503 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.503 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.503 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.503 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475292+0000", 2024-04-19T04:26:05.503 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.503 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.504 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.504 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.504 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475295+0000", 2024-04-19T04:26:05.504 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.253e-06 2024-04-19T04:26:05.504 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.504 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.504 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.504 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475307+0000", 2024-04-19T04:26:05.504 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.183e-05 2024-04-19T04:26:05.504 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.504 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.504 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.505 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475312+0000", 2024-04-19T04:26:05.505 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5210000000000002e-06 2024-04-19T04:26:05.505 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.505 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.505 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.505 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475339+0000", 2024-04-19T04:26:05.505 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6859000000000002e-05 2024-04-19T04:26:05.505 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.505 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.505 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.505 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475455+0000", 2024-04-19T04:26:05.505 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000116051 2024-04-19T04:26:05.506 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.506 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.506 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:05.506 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475559+0000", 2024-04-19T04:26:05.506 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0001038 2024-04-19T04:26:05.506 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.506 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.506 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.506 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.506 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.506 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:175590 5.c 5:33264e20:::benchmark_data_smithi007_19526_object49856:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.506 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:05.475318+0000", 2024-04-19T04:26:05.507 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9998851, 2024-04-19T04:26:05.507 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034166399999999999, 2024-04-19T04:26:05.507 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.507 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:05.507 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.507 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.507 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.507 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 175590 2024-04-19T04:26:05.507 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.507 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.507 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.507 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.508 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475318+0000", 2024-04-19T04:26:05.508 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.508 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.508 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.508 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475318+0000", 2024-04-19T04:26:05.508 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.508 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.508 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.508 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475317+0000", 2024-04-19T04:26:05.508 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.508 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.509 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.509 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.509 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475320+0000", 2024-04-19T04:26:05.509 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8789999999999999e-06 2024-04-19T04:26:05.509 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.509 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.509 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.509 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475326+0000", 2024-04-19T04:26:05.509 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0310000000000004e-06 2024-04-19T04:26:05.509 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.509 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.509 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.510 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475331+0000", 2024-04-19T04:26:05.510 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1200000000000001e-06 2024-04-19T04:26:05.510 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.510 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.510 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.510 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475371+0000", 2024-04-19T04:26:05.510 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9965000000000001e-05 2024-04-19T04:26:05.510 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.510 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.510 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.510 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.475478+0000", 2024-04-19T04:26:05.510 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000107077 2024-04-19T04:26:05.511 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.511 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.511 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.511 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.511 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.511 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:175574 5.f 5:fd0db84a:::benchmark_data_smithi007_19526_object49840:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.511 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:05.469352+0000", 2024-04-19T04:26:05.511 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0058509850000000004, 2024-04-19T04:26:05.511 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0063604519999999999, 2024-04-19T04:26:05.511 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.511 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:05.512 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.512 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.512 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.512 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 175574 2024-04-19T04:26:05.512 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.512 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.512 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.512 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.512 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.469352+0000", 2024-04-19T04:26:05.512 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.512 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.512 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.513 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.513 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.469352+0000", 2024-04-19T04:26:05.513 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.513 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.513 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.513 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.513 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.469351+0000", 2024-04-19T04:26:05.513 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.513 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.513 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.513 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.513 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.469357+0000", 2024-04-19T04:26:05.513 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9850000000000003e-06 2024-04-19T04:26:05.514 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.514 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.514 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.514 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.469367+0000", 2024-04-19T04:26:05.514 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8970000000000003e-06 2024-04-19T04:26:05.514 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.514 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.514 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.514 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.469375+0000", 2024-04-19T04:26:05.514 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8259999999999993e-06 2024-04-19T04:26:05.514 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.514 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.515 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.515 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471107+0000", 2024-04-19T04:26:05.515 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001732796 2024-04-19T04:26:05.515 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.515 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.515 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.515 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471253+0000", 2024-04-19T04:26:05.515 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014596100000000001 2024-04-19T04:26:05.515 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.515 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.515 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:05.515 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471392+0000", 2024-04-19T04:26:05.516 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013821300000000001 2024-04-19T04:26:05.516 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.516 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.516 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.516 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.516 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.516 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:175577 5.f 5:fe815823:::benchmark_data_smithi007_19526_object49843:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.516 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:05.471556+0000", 2024-04-19T04:26:05.516 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0036467639999999998, 2024-04-19T04:26:05.516 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0041923619999999998, 2024-04-19T04:26:05.516 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.516 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:05.516 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.517 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.517 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.517 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 175577 2024-04-19T04:26:05.517 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.517 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.517 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.517 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.517 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471556+0000", 2024-04-19T04:26:05.517 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.517 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.517 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.517 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.518 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471556+0000", 2024-04-19T04:26:05.518 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.518 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.518 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.518 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471555+0000", 2024-04-19T04:26:05.518 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.518 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.518 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.518 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471560+0000", 2024-04-19T04:26:05.518 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2130000000000002e-06 2024-04-19T04:26:05.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.519 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.519 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.519 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471568+0000", 2024-04-19T04:26:05.519 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7339999999999997e-06 2024-04-19T04:26:05.519 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.519 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.519 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.519 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.471574+0000", 2024-04-19T04:26:05.519 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0549999999999996e-06 2024-04-19T04:26:05.519 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.519 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.519 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.519 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.473729+0000", 2024-04-19T04:26:05.520 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0021550480000000001 2024-04-19T04:26:05.520 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.520 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.520 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.520 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.473811+0000", 2024-04-19T04:26:05.520 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1834000000000003e-05 2024-04-19T04:26:05.520 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.520 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.520 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:05.520 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:05.473886+0000", 2024-04-19T04:26:05.520 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5104999999999993e-05 2024-04-19T04:26:05.520 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.520 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.521 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.521 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.521 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:05.521 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 10 2024-04-19T04:26:05.521 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:05.522 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:05.546 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:05.545+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:05.648 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:05.649+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:05.653 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:05.654 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:05.654 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:05.654 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:05.654 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:05.667 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:05.749 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:05.749+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:05.841 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:05.842 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:05.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:05.842 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:05.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.842 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:05.842 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:05.842 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 71.608725845999999, 2024-04-19T04:26:05.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:05.842 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.842 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.842 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.842 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.843 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.843 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:05.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.843 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:05.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:05.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:05.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:05.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:05.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:05.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:05.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:05.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:05.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:05.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:05.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:05.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:05.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:05.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:05.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:05.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:05.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:05.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:05.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:05.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:05.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:05.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:05.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:05.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:05.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:05.848 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.848 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.848 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.848 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:05.848 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:05.848 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 71.604630924999995, 2024-04-19T04:26:05.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:05.848 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.848 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.848 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.848 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.849 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.849 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:05.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.849 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:05.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:05.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:05.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:05.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:05.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:05.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:05.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:05.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:05.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:05.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:05.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:05.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:05.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:05.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:05.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:05.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:05.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:05.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:05.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:05.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:05.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:05.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:05.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:05.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:05.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:05.853 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.853 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.853 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.854 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:05.854 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:05.854 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 71.60133974, 2024-04-19T04:26:05.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:05.854 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.854 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.854 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.854 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.854 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.854 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:05.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.854 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:05.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:05.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:05.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:05.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:05.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:05.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:05.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:05.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:05.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:05.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:05.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:05.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:05.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:05.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:05.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:05.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:05.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:05.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:05.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:05.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:05.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:05.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:05.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:05.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:05.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:05.860 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.860 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.860 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.860 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:05.860 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:05.860 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 49.883950274999997, 2024-04-19T04:26:05.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:05.860 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.860 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:05.860 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.860 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.861 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.861 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:05.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.861 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:05.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:05.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:05.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:05.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:05.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:05.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:05.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:05.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:05.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:05.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:05.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:05.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:05.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:05.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:05.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:05.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:05.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:05.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:05.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:05.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:05.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:05.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:05.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:05.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:05.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:05.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:05.866 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.866 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.866 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.866 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:05.866 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:05.866 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 49.863719826000001, 2024-04-19T04:26:05.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:05.866 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.866 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:05.866 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.866 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.866 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.867 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:05.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.867 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:05.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:05.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:05.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:05.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:05.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:05.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:05.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:05.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:05.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:05.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:05.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:05.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:05.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:05.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:05.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:05.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:05.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:05.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:05.870 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.870 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.870 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.870 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:05.871 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:05.871 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 49.863611968999997, 2024-04-19T04:26:05.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:05.871 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.871 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:05.871 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.871 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.871 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.871 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:05.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.871 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:05.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:05.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:05.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:05.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:05.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:05.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:05.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:05.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:05.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:05.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:05.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:05.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:05.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:05.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:05.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:05.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:05.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:05.875 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.875 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.876 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.876 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:05.876 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:05.876 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 49.861645279999998, 2024-04-19T04:26:05.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:05.876 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.876 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.876 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.876 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.876 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.876 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:05.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.877 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:05.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:05.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:05.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:05.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:05.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:05.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:05.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:05.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:05.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:05.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:05.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:05.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:05.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:05.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:05.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:05.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:05.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:05.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:05.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:05.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:05.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:05.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:05.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:05.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:05.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:05.881 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.881 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.881 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.881 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:05.881 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:05.882 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 49.858281085000002, 2024-04-19T04:26:05.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:05.882 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.882 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.882 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.882 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.882 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.882 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:05.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.882 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:05.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:05.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:05.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:05.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:05.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:05.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:05.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:05.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:05.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:05.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:05.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:05.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:05.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:05.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:05.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:05.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:05.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:05.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.886 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.886 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:05.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:05.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.886 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:05.886 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:05.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:05.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.886 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:05.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:05.887 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.887 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.887 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.887 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:05.887 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:05.887 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 49.854470106999997, 2024-04-19T04:26:05.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:05.887 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.887 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.887 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.887 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.888 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.888 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:05.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.888 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:05.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:05.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:05.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:05.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:05.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:05.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:05.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:05.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:05.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:05.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:05.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:05.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:05.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:05.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:05.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:05.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:05.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:05.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:05.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:05.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:05.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:05.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:05.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:05.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:05.892 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.892 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.892 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.893 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:05.893 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:05.893 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 36.612607750000002, 2024-04-19T04:26:05.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:05.893 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.893 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.893 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.893 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.893 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.893 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:05.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.893 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.893 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:05.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:05.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:05.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:05.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:05.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:05.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:05.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:05.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:05.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:05.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:05.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:05.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:05.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:05.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:05.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:05.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:05.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:05.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:05.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:05.897 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.897 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.897 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.898 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:05.898 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:05.898 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 36.612013470000001, 2024-04-19T04:26:05.898 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:05.898 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.898 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.898 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.898 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.898 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.898 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:05.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.898 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:05.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:05.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:05.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:05.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:05.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:05.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:05.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:05.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:05.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:05.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:05.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:05.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:05.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:05.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:05.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:05.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:05.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:05.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:05.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:05.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:05.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:05.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:05.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:05.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.903 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.903 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:05.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:05.903 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.903 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.903 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.903 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:05.903 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:05.903 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.8873663120000002, 2024-04-19T04:26:05.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:05.904 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.904 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.904 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.904 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.904 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.904 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:05.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.904 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.904 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:05.904 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.904 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:05.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:05.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:05.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:05.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:05.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:05.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:05.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:05.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:05.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:05.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:05.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:05.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:05.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:05.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:05.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:05.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:05.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:05.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:05.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:05.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:05.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:05.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:05.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:05.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:05.908 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.909 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.909 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.909 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:05.909 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:05.909 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.8873258960000001, 2024-04-19T04:26:05.909 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:05.909 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.909 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.909 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.909 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.909 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.909 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:05.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.910 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:05.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:05.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:05.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:05.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:05.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:05.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:05.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:05.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:05.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:05.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:05.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:05.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:05.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:05.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:05.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:05.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:05.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:05.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:05.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:05.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:05.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:05.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:05.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:05.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:05.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:05.914 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.914 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.914 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.914 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:05.915 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:05.915 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.8836295870000002, 2024-04-19T04:26:05.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:05.915 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.915 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.915 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.915 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.915 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.915 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:05.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.915 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:05.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:05.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:05.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:05.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:05.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:05.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:05.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:05.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:05.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:05.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:05.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:05.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:05.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:05.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:05.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:05.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:05.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:05.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:05.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:05.920 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.920 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.920 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.920 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.920 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:05.920 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.6300191129999999, 2024-04-19T04:26:05.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:05.920 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.920 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.920 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.921 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.921 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.921 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:05.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.921 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:05.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.921 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.921 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:05.921 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:05.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:05.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:05.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.922 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.922 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.922 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:05.922 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:05.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:05.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:05.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:05.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:05.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.923 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.923 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:05.923 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:05.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:05.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:05.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:05.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:05.924 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:05.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.924 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.924 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.924 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:05.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:05.925 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.925 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.925 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.925 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.925 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.925 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:05.925 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.6277257010000001, 2024-04-19T04:26:05.925 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:05.925 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.925 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.925 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.925 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.925 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.926 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:05.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.926 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.926 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.926 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:05.926 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.926 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.926 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:05.926 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:05.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:05.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:05.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.927 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.927 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:05.927 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:05.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.927 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:05.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:05.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:05.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:05.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.928 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.928 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.928 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:05.928 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:05.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:05.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:05.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:05.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:05.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:05.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.929 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.929 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.929 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:05.929 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:05.929 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.930 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.930 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.930 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.930 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.930 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:05.930 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 1.627679885, 2024-04-19T04:26:05.930 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:05.930 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.930 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.930 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.930 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.930 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.930 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:05.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.931 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:05.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:05.931 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.931 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.931 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:05.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.932 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.932 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:05.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:05.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.932 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.932 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:05.932 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:05.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.932 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.932 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.932 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:05.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:05.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.933 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:05.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:05.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.933 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:05.933 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:05.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.933 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.933 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.934 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:05.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:05.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.934 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.934 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:05.934 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:05.934 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:05.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.935 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.935 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.935 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:05.935 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:05.935 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.935 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.935 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.935 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.935 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174342 5.9 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.935 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:05.935 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.94252318499999999, 2024-04-19T04:26:05.935 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068615152999999998, 2024-04-19T04:26:05.935 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.936 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.936 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.936 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.936 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.936 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174342 2024-04-19T04:26:05.936 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.936 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.936 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.936 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.936 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:05.936 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.936 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.936 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.936 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.937 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:05.937 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.937 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.937 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.937 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.937 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897726+0000", 2024-04-19T04:26:05.937 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.937 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.937 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.937 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.937 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897731+0000", 2024-04-19T04:26:05.937 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1449999999999999e-06 2024-04-19T04:26:05.937 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.937 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.937 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.938 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897744+0000", 2024-04-19T04:26:05.938 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2833000000000001e-05 2024-04-19T04:26:05.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.938 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.938 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.938 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897749+0000", 2024-04-19T04:26:05.938 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1540000000000001e-06 2024-04-19T04:26:05.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.938 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.938 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.938 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897810+0000", 2024-04-19T04:26:05.938 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0724999999999999e-05 2024-04-19T04:26:05.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.939 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.939 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.939 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897920+0000", 2024-04-19T04:26:05.939 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011024 2024-04-19T04:26:05.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.939 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.939 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:05.939 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897993+0000", 2024-04-19T04:26:05.939 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2335000000000005e-05 2024-04-19T04:26:05.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.939 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.939 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.939 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.899597+0000", 2024-04-19T04:26:05.939 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016048919999999999 2024-04-19T04:26:05.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.940 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:05.940 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966230+0000", 2024-04-19T04:26:05.940 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.066632882000000004 2024-04-19T04:26:05.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.940 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:05.940 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966296+0000", 2024-04-19T04:26:05.940 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5361e-05 2024-04-19T04:26:05.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.940 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.940 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966342+0000", 2024-04-19T04:26:05.940 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6476e-05 2024-04-19T04:26:05.940 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.941 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.941 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.941 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.941 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174344 5.d 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.941 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:05.941 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.94184434699999997, 2024-04-19T04:26:05.941 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068211329000000001, 2024-04-19T04:26:05.941 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.941 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.941 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.941 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.941 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.941 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174344 2024-04-19T04:26:05.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.942 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.942 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.942 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.942 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:05.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.942 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.942 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.942 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:05.942 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.942 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898405+0000", 2024-04-19T04:26:05.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:05.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898409+0000", 2024-04-19T04:26:05.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5149999999999998e-06 2024-04-19T04:26:05.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.943 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.943 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898415+0000", 2024-04-19T04:26:05.943 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:26:05.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.944 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898419+0000", 2024-04-19T04:26:05.944 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.89e-06 2024-04-19T04:26:05.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.944 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898459+0000", 2024-04-19T04:26:05.944 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0017e-05 2024-04-19T04:26:05.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.944 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.944 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898540+0000", 2024-04-19T04:26:05.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1237999999999997e-05 2024-04-19T04:26:05.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.945 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:05.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:05.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6060000000000001e-05 2024-04-19T04:26:05.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.945 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.945 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.901321+0000", 2024-04-19T04:26:05.945 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027152109999999999 2024-04-19T04:26:05.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.945 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:05.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966512+0000", 2024-04-19T04:26:05.946 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.065190440000000002 2024-04-19T04:26:05.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:05.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966563+0000", 2024-04-19T04:26:05.946 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1436e-05 2024-04-19T04:26:05.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.946 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.946 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966617+0000", 2024-04-19T04:26:05.946 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.401e-05 2024-04-19T04:26:05.947 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.947 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.947 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.947 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.947 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174346 5.f 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:05.947 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:05.947 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.94005812, 2024-04-19T04:26:05.947 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.067185536000000004, 2024-04-19T04:26:05.947 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:05.947 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:05.947 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:05.947 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:05.947 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:05.947 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174346 2024-04-19T04:26:05.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.948 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:05.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:05.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:05.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:05.948 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:05.948 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:05.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.948 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:05.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900191+0000", 2024-04-19T04:26:05.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:05.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:05.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900196+0000", 2024-04-19T04:26:05.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3329999999999998e-06 2024-04-19T04:26:05.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:05.949 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900206+0000", 2024-04-19T04:26:05.949 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9699999999999994e-06 2024-04-19T04:26:05.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.949 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.949 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:05.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900210+0000", 2024-04-19T04:26:05.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3359999999999997e-06 2024-04-19T04:26:05.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:05.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900243+0000", 2024-04-19T04:26:05.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2669999999999997e-05 2024-04-19T04:26:05.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.950 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:05.950 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900365+0000", 2024-04-19T04:26:05.950 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122648 2024-04-19T04:26:05.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.950 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:05.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900559+0000", 2024-04-19T04:26:05.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019358799999999999 2024-04-19T04:26:05.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:05.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.903018+0000", 2024-04-19T04:26:05.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024592300000000002 2024-04-19T04:26:05.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.951 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:05.951 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967180+0000", 2024-04-19T04:26:05.951 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.064161587000000006 2024-04-19T04:26:05.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.951 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.952 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:05.952 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967293+0000", 2024-04-19T04:26:05.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112921 2024-04-19T04:26:05.952 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:05.952 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:05.952 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:05.952 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967378+0000", 2024-04-19T04:26:05.952 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5000999999999995e-05 2024-04-19T04:26:05.952 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.952 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.952 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.952 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:05.952 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:05.952 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:05.954 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:05.953+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:05.955 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:06.054 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:06.052+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:06.074 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:06.074 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:06.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.074 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:177025 5.0 5:0b8c59ed:::benchmark_data_smithi007_19526_object51291:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:06.074 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:06.068048+0000", 2024-04-19T04:26:06.075 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.006651517, 2024-04-19T04:26:06.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066809240000000004, 2024-04-19T04:26:06.075 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:06.075 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:06.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:06.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:06.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:06.075 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 177025 2024-04-19T04:26:06.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.075 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:06.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:06.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.068048+0000", 2024-04-19T04:26:06.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:06.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:06.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.068048+0000", 2024-04-19T04:26:06.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:06.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:06.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.068047+0000", 2024-04-19T04:26:06.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:06.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:06.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.068051+0000", 2024-04-19T04:26:06.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9269999999999998e-06 2024-04-19T04:26:06.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:06.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.068061+0000", 2024-04-19T04:26:06.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9690000000000006e-06 2024-04-19T04:26:06.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:06.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.068067+0000", 2024-04-19T04:26:06.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2809999999999997e-06 2024-04-19T04:26:06.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:06.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.068107+0000", 2024-04-19T04:26:06.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9441999999999999e-05 2024-04-19T04:26:06.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:06.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.068224+0000", 2024-04-19T04:26:06.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117695 2024-04-19T04:26:06.079 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:06.079 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:06.079 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:06.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.080 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:177027 5.e 5:74b207bd:::benchmark_data_smithi007_19526_object51293:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:06.080 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:06.068525+0000", 2024-04-19T04:26:06.080 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0061742969999999996, 2024-04-19T04:26:06.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0062537859999999999, 2024-04-19T04:26:06.080 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:06.080 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:06.080 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:06.080 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:06.080 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:06.080 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 177027 2024-04-19T04:26:06.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.081 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:06.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:06.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.068525+0000", 2024-04-19T04:26:06.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:06.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:06.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.068525+0000", 2024-04-19T04:26:06.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:06.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:06.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.068524+0000", 2024-04-19T04:26:06.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:06.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:06.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.068531+0000", 2024-04-19T04:26:06.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1600000000000001e-06 2024-04-19T04:26:06.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:06.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.068541+0000", 2024-04-19T04:26:06.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.013e-05 2024-04-19T04:26:06.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:06.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.068547+0000", 2024-04-19T04:26:06.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9179999999999999e-06 2024-04-19T04:26:06.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:06.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.068581+0000", 2024-04-19T04:26:06.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3816000000000003e-05 2024-04-19T04:26:06.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:06.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.068669+0000", 2024-04-19T04:26:06.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7966000000000004e-05 2024-04-19T04:26:06.084 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:06.084 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:06.084 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:06.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.084 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:177028 5.0 5:01826402:::benchmark_data_smithi007_19526_object51294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:06.084 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:06.070036+0000", 2024-04-19T04:26:06.085 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0046628579999999998, 2024-04-19T04:26:06.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004808952, 2024-04-19T04:26:06.085 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:06.085 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:06.085 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:06.085 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:06.085 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:06.085 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 177028 2024-04-19T04:26:06.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.085 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:06.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:06.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.070036+0000", 2024-04-19T04:26:06.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:06.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:06.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.070036+0000", 2024-04-19T04:26:06.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:06.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:06.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.070036+0000", 2024-04-19T04:26:06.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:06.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:06.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.070040+0000", 2024-04-19T04:26:06.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2950000000000004e-06 2024-04-19T04:26:06.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:06.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.070049+0000", 2024-04-19T04:26:06.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6440000000000006e-06 2024-04-19T04:26:06.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:06.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.070054+0000", 2024-04-19T04:26:06.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9269999999999996e-06 2024-04-19T04:26:06.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:06.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.070235+0000", 2024-04-19T04:26:06.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000181538 2024-04-19T04:26:06.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:06.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.070306+0000", 2024-04-19T04:26:06.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0825e-05 2024-04-19T04:26:06.088 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:06.088 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:06.088 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:06.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.088 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:177031 5.a 5:5d6fb7ad:::benchmark_data_smithi007_19526_object51297:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:06.089 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:06.070775+0000", 2024-04-19T04:26:06.089 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0039242649999999997, 2024-04-19T04:26:06.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0041381279999999996, 2024-04-19T04:26:06.089 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:06.089 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:06.089 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:06.089 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:06.089 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:06.089 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 177031 2024-04-19T04:26:06.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.089 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:06.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:06.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.070775+0000", 2024-04-19T04:26:06.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:06.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:06.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.070775+0000", 2024-04-19T04:26:06.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:06.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:06.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.070774+0000", 2024-04-19T04:26:06.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:06.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:06.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.070779+0000", 2024-04-19T04:26:06.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.831e-06 2024-04-19T04:26:06.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:06.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.070788+0000", 2024-04-19T04:26:06.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3400000000000004e-06 2024-04-19T04:26:06.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:06.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.070794+0000", 2024-04-19T04:26:06.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4430000000000002e-06 2024-04-19T04:26:06.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:06.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.070830+0000", 2024-04-19T04:26:06.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5933000000000003e-05 2024-04-19T04:26:06.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:06.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.070913+0000", 2024-04-19T04:26:06.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3735999999999999e-05 2024-04-19T04:26:06.092 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:06.092 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:06.092 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:06.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.093 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:177036 5.f e55/20 5:fd88a4ba:::benchmark_data_smithi007_19526_object51302:head v 55'10911, mlcod=55'10909)", 2024-04-19T04:26:06.093 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:06.072642+0000", 2024-04-19T04:26:06.093 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0020570929999999999, 2024-04-19T04:26:06.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023215240000000002, 2024-04-19T04:26:06.093 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:06.093 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:06.093 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:06.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:06.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.072642+0000", 2024-04-19T04:26:06.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:06.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:06.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.072642+0000", 2024-04-19T04:26:06.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:06.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:06.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.072641+0000", 2024-04-19T04:26:06.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:06.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:06.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.072650+0000", 2024-04-19T04:26:06.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7579999999999998e-06 2024-04-19T04:26:06.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:06.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.072659+0000", 2024-04-19T04:26:06.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8359999999999998e-06 2024-04-19T04:26:06.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:06.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.072663+0000", 2024-04-19T04:26:06.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3479999999999997e-06 2024-04-19T04:26:06.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:06.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.072693+0000", 2024-04-19T04:26:06.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0043e-05 2024-04-19T04:26:06.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:06.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.072705+0000", 2024-04-19T04:26:06.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1888e-05 2024-04-19T04:26:06.096 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:06.096 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:06.096 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:06.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.096 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:177038 5.e 5:7ec0dc17:::benchmark_data_smithi007_19526_object51304:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:06.096 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:06.073755+0000", 2024-04-19T04:26:06.096 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00094390900000000005, 2024-04-19T04:26:06.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012419180000000001, 2024-04-19T04:26:06.096 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:06.097 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:06.097 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:06.097 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:06.097 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:06.097 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 177038 2024-04-19T04:26:06.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.097 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:06.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:06.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.073755+0000", 2024-04-19T04:26:06.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:06.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:06.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.073755+0000", 2024-04-19T04:26:06.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:06.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:06.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.073755+0000", 2024-04-19T04:26:06.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:06.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:06.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.073760+0000", 2024-04-19T04:26:06.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2630000000000003e-06 2024-04-19T04:26:06.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:06.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.073772+0000", 2024-04-19T04:26:06.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1983e-05 2024-04-19T04:26:06.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:06.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.073779+0000", 2024-04-19T04:26:06.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0659999999999998e-06 2024-04-19T04:26:06.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:06.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.073832+0000", 2024-04-19T04:26:06.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3440999999999999e-05 2024-04-19T04:26:06.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:06.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.073944+0000", 2024-04-19T04:26:06.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111591 2024-04-19T04:26:06.100 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:06.100 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:06.100 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:06.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.100 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:177039 5.4 5:240c814a:::benchmark_data_smithi007_19526_object51305:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:06.100 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:06.074741+0000", 2024-04-19T04:26:06.100 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.999958, 2024-04-19T04:26:06.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00030027500000000002, 2024-04-19T04:26:06.100 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:06.100 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:06.100 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:06.101 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:06.101 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:06.101 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 177039 2024-04-19T04:26:06.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.101 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:06.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:06.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.074741+0000", 2024-04-19T04:26:06.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:06.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:06.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.074741+0000", 2024-04-19T04:26:06.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:06.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:06.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.074740+0000", 2024-04-19T04:26:06.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:06.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:06.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.074745+0000", 2024-04-19T04:26:06.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.848e-06 2024-04-19T04:26:06.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:06.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.074767+0000", 2024-04-19T04:26:06.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2126000000000001e-05 2024-04-19T04:26:06.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:06.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.074776+0000", 2024-04-19T04:26:06.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1480000000000006e-06 2024-04-19T04:26:06.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:06.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.074815+0000", 2024-04-19T04:26:06.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9619999999999997e-05 2024-04-19T04:26:06.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:06.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:06.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:06.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:06.074937+0000", 2024-04-19T04:26:06.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000122247 2024-04-19T04:26:06.104 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:06.104 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:06.104 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:06.104 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:06.104 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:26:06.104 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 7 2024-04-19T04:26:06.104 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:06.104 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:26:06.106 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:06.155 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:06.153+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:06.231 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:06.231 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:06.231 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:06.231 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:06.231 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:06.242 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:06.256 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:06.256+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:06.258 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T04:26:06.260 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:06.283 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:06.283 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:06.283 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:06.283 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:06.286 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:06.287 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:06.358 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:06.356+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:06.362 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:06.362 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:06.373 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:06.459 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:06.457+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:06.501 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:06.501 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:06.513 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:06.560 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:06.560+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:06.640 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:06.641 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:06.653 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:06.662 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:06.660+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:06.762 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:06.760+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:06.784 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:06.784 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:06.796 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:06.864 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:06.861+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:06.919 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:06.919 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:06.930 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:06.965 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:06.964+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:07.051 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:07.051 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:07.063 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:07.065 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:07.061+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:07.166 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:07.164+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:07.187 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:07.187 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:07.200 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:07.207 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-04-19T04:26:07.267 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:07.265+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:07.332 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:07.332 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:07.347 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:07.368 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:07.368+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:07.469 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:07.468+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:07.471 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:07.472 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:07.485 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:07.570 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:07.569+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:07.656 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:07.656 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:07.668 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:07.673 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:07.669+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:07.771 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:07.769+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:07.789 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:07.789 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:07.801 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:07.872 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:07.869+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:07.928 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:07.928 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:07.941 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:07.982 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:07.981+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:08.074 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:08.072+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:08.102 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:08.102 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:08.113 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:08.174 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:08.173+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:08.238 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:08.238 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:08.252 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:08.275 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:08.273+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:08.287 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:26:08.376 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:08.373+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:08.383 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:08.383 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:08.395 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:08.443 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:08.463 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:08.463 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:08.463 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:08.463 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:08.468 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:08.468 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:08.476 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:08.473+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:08.528 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:08.528 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:08.528 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:08.528 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:08.528 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.528 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 74.295203595000004, 2024-04-19T04:26:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.529 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.530 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.531 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.532 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.533 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 74.291108674, 2024-04-19T04:26:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:08.534 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:08.535 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:08.536 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:08.537 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:08.538 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.539 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:08.540 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 74.287817489000005, 2024-04-19T04:26:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:08.541 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.542 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.543 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.544 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.545 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.546 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.570428024000002, 2024-04-19T04:26:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:08.547 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.548 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.549 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.550 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:08.552 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.550197574999999, 2024-04-19T04:26:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.553 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:08.554 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.555 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.550089718000002, 2024-04-19T04:26:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.557 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.558 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:08.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:08.560 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.561 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.548123029000003, 2024-04-19T04:26:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.562 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.564 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.565 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.566 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.544758834, 2024-04-19T04:26:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.567 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.568 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.569 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.570 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.570 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:08.570 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:08.570 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.570 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.570 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.570 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:08.570 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:08.570 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.570 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.570 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:08.570 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:08.570 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:08.570 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.571 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.571 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.571 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:08.571 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:08.571 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.571 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.571 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:08.571 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:08.571 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:08.571 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.571 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.571 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:08.571 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:08.571 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:08.572 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.572 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.572 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:08.572 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:08.572 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:08.572 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.572 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.572 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.572 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:08.572 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:08.572 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.572 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.572 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.573 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.573 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.573 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:08.573 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:08.573 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 52.540947856000003, 2024-04-19T04:26:08.573 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:08.573 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.573 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:08.573 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.573 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.573 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.573 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:08.573 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.573 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.574 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.574 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.574 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:08.574 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.574 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.574 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.574 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.574 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:08.574 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.574 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.574 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.574 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.574 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:08.574 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:08.575 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.575 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.575 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.575 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:08.575 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:08.575 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.575 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.575 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.575 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:08.575 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:08.575 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.575 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.575 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.575 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:08.576 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:08.576 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.576 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.576 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.576 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:08.576 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:08.576 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.576 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.576 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:08.576 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:08.576 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:08.576 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.576 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.576 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.577 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:08.577 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:08.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.577 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.577 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:08.577 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:08.577 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:08.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.577 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.577 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:08.577 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:08.577 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:08.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.577 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.577 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:08.578 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:08.578 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:08.578 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.578 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.578 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.578 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:08.578 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:08.578 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.578 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.578 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.578 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.578 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.578 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:08.579 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:08.579 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.299085499, 2024-04-19T04:26:08.579 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:08.579 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.579 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:08.579 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.579 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.579 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.579 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:08.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.579 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.579 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.579 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:08.579 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.580 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.580 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.580 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.580 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:08.580 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.580 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.580 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.580 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.580 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:08.580 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:08.580 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.580 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.580 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.580 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:08.580 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:08.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.581 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.581 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.581 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:08.581 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:08.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.581 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.581 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.581 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:08.581 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:08.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.581 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.581 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.581 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:08.581 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:08.582 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.582 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.582 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:08.582 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:08.582 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:08.582 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.582 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.582 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:08.582 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:08.582 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:08.582 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.582 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.582 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:08.582 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:08.583 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:08.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.583 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.583 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.583 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:08.583 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:08.583 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.583 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.583 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.583 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.583 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:08.583 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:08.583 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.298491218999999, 2024-04-19T04:26:08.584 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:08.584 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.584 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:08.584 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.584 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.584 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.584 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:08.584 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.584 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.584 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.584 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.584 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:08.584 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.585 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.585 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.585 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.585 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:08.585 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.585 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.585 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.585 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.585 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:08.585 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:08.585 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.585 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.585 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.585 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:08.586 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:08.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.586 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.586 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:08.586 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:08.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.586 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.586 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:08.586 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:08.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.586 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.587 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:08.587 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:08.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.587 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.587 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:08.587 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:08.587 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:08.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.587 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.587 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:08.587 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:08.587 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:08.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.587 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:08.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:08.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:08.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:08.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:08.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:08.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:08.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:08.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:08.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.589 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.589 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:08.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:08.589 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.589 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.589 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.589 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:08.589 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:08.589 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.573844061, 2024-04-19T04:26:08.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:08.589 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.589 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:08.589 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.590 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.590 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.590 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:08.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.590 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.590 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.590 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.590 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:08.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.590 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.590 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.590 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:08.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.591 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:08.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:08.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.591 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:08.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:08.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.591 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:08.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:08.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:08.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:08.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:08.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:08.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:08.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:08.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:08.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.593 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:08.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:08.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:08.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.593 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:08.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:08.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:08.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.593 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:08.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:08.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:08.594 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.594 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.594 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:08.594 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:08.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:08.594 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.594 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.594 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.594 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:08.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:08.594 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.594 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.594 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.594 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.595 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:08.595 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:08.595 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.5738036449999999, 2024-04-19T04:26:08.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:08.595 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.595 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:08.595 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.595 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.595 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.595 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:08.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.596 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:08.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:08.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:08.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:08.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:08.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:08.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:08.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:08.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:08.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:08.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:08.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:08.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:08.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:08.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:08.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:08.599 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:08.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:08.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.599 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:08.599 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:08.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:08.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.599 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:08.599 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:08.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:08.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.599 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:08.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:08.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:08.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:08.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:08.600 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.600 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.600 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.600 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:08.601 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:08.601 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.5701073359999995, 2024-04-19T04:26:08.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:08.601 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.601 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:08.601 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.601 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.601 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.601 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:08.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.601 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:08.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:08.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:08.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:08.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:08.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:08.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:08.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:08.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:08.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:08.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:08.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:08.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:08.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:08.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:08.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:08.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:08.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:08.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:08.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:08.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:08.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:08.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:08.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:08.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:08.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:08.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:08.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:08.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:08.606 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.606 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.606 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.606 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:08.606 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:08.606 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.3164968620000002, 2024-04-19T04:26:08.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:08.606 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.606 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:08.606 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.607 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.607 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.607 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:08.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.607 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:08.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:08.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:08.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:08.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:08.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:08.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:08.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:08.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:08.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:08.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:08.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:08.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:08.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:08.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:08.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:08.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:08.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:08.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:08.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:08.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:08.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:08.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:08.611 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.611 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.611 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.611 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:08.611 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:08.611 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.3142034499999999, 2024-04-19T04:26:08.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:08.611 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.611 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:08.611 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.612 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.612 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.612 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:08.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.612 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.612 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.612 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:08.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.612 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.612 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:08.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:08.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:08.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:08.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:08.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:08.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:08.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:08.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:08.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:08.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:08.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:08.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:08.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:08.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:08.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:08.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:08.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:08.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:08.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:08.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:08.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:08.616 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.616 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.616 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.616 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:08.616 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:08.616 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.3141576339999999, 2024-04-19T04:26:08.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:08.616 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.616 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:08.616 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.616 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.616 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.616 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:08.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.617 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:08.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:08.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:08.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:08.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:08.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:08.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:08.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:08.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:08.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:08.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:08.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:08.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:08.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:08.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:08.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:08.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:08.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:08.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:08.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:08.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:08.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:08.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:08.621 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.621 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.621 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.621 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174342 5.9 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:08.621 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:08.621 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 3.629000934, 2024-04-19T04:26:08.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068615152999999998, 2024-04-19T04:26:08.621 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.622 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:08.622 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.622 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.622 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.622 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174342 2024-04-19T04:26:08.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.622 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:08.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:08.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897726+0000", 2024-04-19T04:26:08.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:08.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897731+0000", 2024-04-19T04:26:08.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1449999999999999e-06 2024-04-19T04:26:08.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897744+0000", 2024-04-19T04:26:08.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2833000000000001e-05 2024-04-19T04:26:08.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897749+0000", 2024-04-19T04:26:08.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1540000000000001e-06 2024-04-19T04:26:08.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897810+0000", 2024-04-19T04:26:08.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0724999999999999e-05 2024-04-19T04:26:08.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:08.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897920+0000", 2024-04-19T04:26:08.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011024 2024-04-19T04:26:08.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:08.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897993+0000", 2024-04-19T04:26:08.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2335000000000005e-05 2024-04-19T04:26:08.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:08.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.899597+0000", 2024-04-19T04:26:08.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016048919999999999 2024-04-19T04:26:08.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:08.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966230+0000", 2024-04-19T04:26:08.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.066632882000000004 2024-04-19T04:26:08.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:08.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966296+0000", 2024-04-19T04:26:08.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5361e-05 2024-04-19T04:26:08.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966342+0000", 2024-04-19T04:26:08.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6476e-05 2024-04-19T04:26:08.627 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.627 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.627 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.627 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174344 5.d 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:08.627 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:08.627 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 3.6283220959999998, 2024-04-19T04:26:08.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068211329000000001, 2024-04-19T04:26:08.627 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.627 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:08.627 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.627 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.627 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.628 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174344 2024-04-19T04:26:08.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.628 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:08.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:08.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898405+0000", 2024-04-19T04:26:08.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:08.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898409+0000", 2024-04-19T04:26:08.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5149999999999998e-06 2024-04-19T04:26:08.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898415+0000", 2024-04-19T04:26:08.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:26:08.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898419+0000", 2024-04-19T04:26:08.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.89e-06 2024-04-19T04:26:08.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898459+0000", 2024-04-19T04:26:08.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0017e-05 2024-04-19T04:26:08.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:08.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898540+0000", 2024-04-19T04:26:08.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1237999999999997e-05 2024-04-19T04:26:08.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:08.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:08.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6060000000000001e-05 2024-04-19T04:26:08.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:08.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.901321+0000", 2024-04-19T04:26:08.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027152109999999999 2024-04-19T04:26:08.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:08.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966512+0000", 2024-04-19T04:26:08.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.065190440000000002 2024-04-19T04:26:08.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:08.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966563+0000", 2024-04-19T04:26:08.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1436e-05 2024-04-19T04:26:08.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966617+0000", 2024-04-19T04:26:08.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.401e-05 2024-04-19T04:26:08.632 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.632 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.632 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.632 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174346 5.f 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:08.632 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:08.632 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 3.626535869, 2024-04-19T04:26:08.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.067185536000000004, 2024-04-19T04:26:08.633 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:08.633 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:08.633 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:08.633 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:08.633 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:08.633 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174346 2024-04-19T04:26:08.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.633 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:08.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:08.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:08.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:08.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:08.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:08.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:08.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900191+0000", 2024-04-19T04:26:08.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:08.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:08.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900196+0000", 2024-04-19T04:26:08.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3329999999999998e-06 2024-04-19T04:26:08.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:08.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900206+0000", 2024-04-19T04:26:08.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9699999999999994e-06 2024-04-19T04:26:08.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:08.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900210+0000", 2024-04-19T04:26:08.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3359999999999997e-06 2024-04-19T04:26:08.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:08.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900243+0000", 2024-04-19T04:26:08.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2669999999999997e-05 2024-04-19T04:26:08.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:08.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900365+0000", 2024-04-19T04:26:08.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122648 2024-04-19T04:26:08.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:08.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900559+0000", 2024-04-19T04:26:08.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019358799999999999 2024-04-19T04:26:08.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:08.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.903018+0000", 2024-04-19T04:26:08.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024592300000000002 2024-04-19T04:26:08.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:08.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967180+0000", 2024-04-19T04:26:08.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.064161587000000006 2024-04-19T04:26:08.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:08.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967293+0000", 2024-04-19T04:26:08.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112921 2024-04-19T04:26:08.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:08.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:08.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:08.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967378+0000", 2024-04-19T04:26:08.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5000999999999995e-05 2024-04-19T04:26:08.638 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.638 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.638 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.638 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:08.638 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:08.638 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:08.640 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:08.640 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:08.637+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:08.741 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:08.740+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:08.762 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:08.762 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:08.762 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 0 2024-04-19T04:26:08.762 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:08.773 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:08.841 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:08.837+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:08.894 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:08.894 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:08.894 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:08.894 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:08.894 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:08.905 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:08.941 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:08.940+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:09.021 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:09.021 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:09.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:09.021 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:09.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.021 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:09.021 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:09.021 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 53.068764854000001, 2024-04-19T04:26:09.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:09.021 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.021 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:09.022 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.022 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.022 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.022 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:09.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.022 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:09.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:09.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:09.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:09.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:09.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:09.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:09.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:09.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:09.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:09.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:09.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:09.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:09.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:09.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:09.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:09.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:09.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:09.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:09.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:09.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:09.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:09.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:09.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:09.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:09.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:09.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:09.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:09.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:09.028 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.028 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.028 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.028 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:09.028 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:09.029 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 53.063703208, 2024-04-19T04:26:09.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:09.029 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.029 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:09.029 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.029 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.029 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.029 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:09.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.029 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:09.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:09.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:09.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:09.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:09.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:09.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:09.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:09.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:09.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:09.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:09.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:09.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:09.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:09.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:09.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:09.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:09.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:09.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:09.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:09.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:09.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:09.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:09.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:09.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:09.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:09.034 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.034 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.034 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.034 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:09.034 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:09.034 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 53.063603295999997, 2024-04-19T04:26:09.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:09.034 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.034 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:09.034 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.034 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.035 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.035 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:09.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.035 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:09.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:09.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:09.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:09.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:09.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:09.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:09.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:09.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:09.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:09.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:09.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:09.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:09.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:09.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:09.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:09.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:09.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:09.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:09.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:09.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:09.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:09.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:09.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:09.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:09.043 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.043 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.043 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.043 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:09.043 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:09.043 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 53.063477542999998, 2024-04-19T04:26:09.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:09.043 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.043 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:09.044 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.044 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.044 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.044 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:09.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.044 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:09.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:09.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:09.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:09.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:09.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:09.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:09.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:09.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:09.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:09.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:09.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:09.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:09.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:09.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:09.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:09.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:09.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:09.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 53.059633597999998, 2024-04-19T04:26:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 53.052462497, 2024-04-19T04:26:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 53.052290393, 2024-04-19T04:26:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 53.052227268000003, 2024-04-19T04:26:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 53.052098671000003, 2024-04-19T04:26:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 53.052030700000003, 2024-04-19T04:26:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.1324910350000001, 2024-04-19T04:26:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078453623, 2024-04-19T04:26:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965893+0000", 2024-04-19T04:26:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.076646455000000002 2024-04-19T04:26:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965956+0000", 2024-04-19T04:26:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3200000000000005e-05 2024-04-19T04:26:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966068+0000", 2024-04-19T04:26:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011194800000000001 2024-04-19T04:26:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.1324600379999996, 2024-04-19T04:26:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083782388999999999, 2024-04-19T04:26:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971179+0000", 2024-04-19T04:26:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079349476000000002 2024-04-19T04:26:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971259+0000", 2024-04-19T04:26:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9083000000000002e-05 2024-04-19T04:26:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971428+0000", 2024-04-19T04:26:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169419 2024-04-19T04:26:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.1301385179999999, 2024-04-19T04:26:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081686998999999996, 2024-04-19T04:26:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971454+0000", 2024-04-19T04:26:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077525997999999999 2024-04-19T04:26:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971540+0000", 2024-04-19T04:26:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6285000000000005e-05 2024-04-19T04:26:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971654+0000", 2024-04-19T04:26:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114095 2024-04-19T04:26:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.1289281359999999, 2024-04-19T04:26:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080734265999999999, 2024-04-19T04:26:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:09.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:09.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:09.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:09.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:09.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:09.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:09.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:09.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:09.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:09.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:09.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:09.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:09.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971677+0000", 2024-04-19T04:26:09.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.073192023999999994 2024-04-19T04:26:09.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:09.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971771+0000", 2024-04-19T04:26:09.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4235999999999997e-05 2024-04-19T04:26:09.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971912+0000", 2024-04-19T04:26:09.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014055099999999999 2024-04-19T04:26:09.102 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.102 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.102 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.102 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:09.102 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:09.102 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.1279766450000004, 2024-04-19T04:26:09.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085645857000000006, 2024-04-19T04:26:09.102 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.103 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.103 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.103 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.103 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.103 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:09.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.103 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:09.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:09.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:09.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:09.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:09.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:09.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:09.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:09.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:09.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:09.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:09.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:09.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:09.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:09.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977634+0000", 2024-04-19T04:26:09.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077144335999999994 2024-04-19T04:26:09.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:09.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977699+0000", 2024-04-19T04:26:09.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4518999999999997e-05 2024-04-19T04:26:09.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977775+0000", 2024-04-19T04:26:09.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6219999999999999e-05 2024-04-19T04:26:09.107 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.107 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.107 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.107 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:09.107 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:09.107 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.1249690670000003, 2024-04-19T04:26:09.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075403611999999995, 2024-04-19T04:26:09.108 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.108 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.108 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.108 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.108 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.108 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:09.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.108 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:09.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:09.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:09.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:09.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:09.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:09.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:09.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:09.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:09.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:09.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:09.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:09.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:09.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:09.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970369+0000", 2024-04-19T04:26:09.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.074967992999999997 2024-04-19T04:26:09.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:09.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970419+0000", 2024-04-19T04:26:09.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9700999999999997e-05 2024-04-19T04:26:09.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970540+0000", 2024-04-19T04:26:09.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121512 2024-04-19T04:26:09.112 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.112 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.112 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.112 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5:78f758ec:::benchmark_data_smithi007_19526_object48602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:09.113 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:09.113 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.124594943, 2024-04-19T04:26:09.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085171609999999995, 2024-04-19T04:26:09.113 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.113 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.113 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.113 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.113 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.113 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:09.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.113 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:09.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:09.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:09.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:09.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:09.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:09.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:09.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:09.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:09.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966154+0000", 2024-04-19T04:26:09.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.070613543000000001 2024-04-19T04:26:09.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966382+0000", 2024-04-19T04:26:09.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022741800000000001 2024-04-19T04:26:09.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:09.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980581+0000", 2024-04-19T04:26:09.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014199916999999999 2024-04-19T04:26:09.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:09.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980621+0000", 2024-04-19T04:26:09.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9685999999999999e-05 2024-04-19T04:26:09.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980682+0000", 2024-04-19T04:26:09.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1130000000000006e-05 2024-04-19T04:26:09.117 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.117 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.117 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.118 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:09.118 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:09.118 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.1245049910000002, 2024-04-19T04:26:09.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075073230000000005, 2024-04-19T04:26:09.118 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.118 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.118 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.118 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.118 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.118 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:09.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.118 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:09.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:09.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:09.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:09.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:09.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:09.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:09.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:09.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:09.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:09.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:09.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:09.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:09.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:09.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970556+0000", 2024-04-19T04:26:09.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.072076192999999997 2024-04-19T04:26:09.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:09.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970608+0000", 2024-04-19T04:26:09.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2549000000000001e-05 2024-04-19T04:26:09.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970674+0000", 2024-04-19T04:26:09.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5549000000000005e-05 2024-04-19T04:26:09.123 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.123 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.123 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.123 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5:70a7bb5e:::benchmark_data_smithi007_19526_object48614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:09.123 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:09.123 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.119417994, 2024-04-19T04:26:09.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080099220999999998, 2024-04-19T04:26:09.123 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.123 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.123 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.123 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.123 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.124 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:09.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.124 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:09.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:09.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:09.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:09.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:09.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:09.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:09.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:09.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:09.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:09.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971978+0000", 2024-04-19T04:26:09.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.071282358000000004 2024-04-19T04:26:09.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.972180+0000", 2024-04-19T04:26:09.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020191100000000001 2024-04-19T04:26:09.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:09.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980701+0000", 2024-04-19T04:26:09.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085211760000000001 2024-04-19T04:26:09.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:09.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980729+0000", 2024-04-19T04:26:09.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8068e-05 2024-04-19T04:26:09.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980787+0000", 2024-04-19T04:26:09.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7521e-05 2024-04-19T04:26:09.128 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.128 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.128 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.128 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174350 5.e 5:7f36609a:::benchmark_data_smithi007_19526_object48616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:09.128 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:09.128 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.1176469219999996, 2024-04-19T04:26:09.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079723622999999993, 2024-04-19T04:26:09.128 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.128 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.128 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.128 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.129 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.129 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174350 2024-04-19T04:26:09.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.129 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:09.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:09.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902458+0000", 2024-04-19T04:26:09.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902463+0000", 2024-04-19T04:26:09.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5889999999999996e-06 2024-04-19T04:26:09.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965576+0000", 2024-04-19T04:26:09.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063113328999999996 2024-04-19T04:26:09.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965614+0000", 2024-04-19T04:26:09.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8285999999999999e-05 2024-04-19T04:26:09.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974787+0000", 2024-04-19T04:26:09.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009172599 2024-04-19T04:26:09.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974999+0000", 2024-04-19T04:26:09.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021270999999999999 2024-04-19T04:26:09.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:09.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982086+0000", 2024-04-19T04:26:09.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070869160000000004 2024-04-19T04:26:09.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:09.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982115+0000", 2024-04-19T04:26:09.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8603999999999999e-05 2024-04-19T04:26:09.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:09.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982182+0000", 2024-04-19T04:26:09.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7350999999999999e-05 2024-04-19T04:26:09.132 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.133 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.133 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.133 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.133 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.133 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:09.134 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:09.133+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:09.135 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:09.221 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T04:26:09.235 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:09.233+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:09.266 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:09.266 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:09.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.267 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:184592 5.f 5:fba254ec:::benchmark_data_smithi007_19526_object58858:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T04:26:09.267 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:09.262347+0000", 2024-04-19T04:26:09.267 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0042556410000000001, 2024-04-19T04:26:09.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042808780000000001, 2024-04-19T04:26:09.267 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.267 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:09.267 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.267 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.267 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.267 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 184592 2024-04-19T04:26:09.267 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.267 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.267 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.267 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.268 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.262347+0000", 2024-04-19T04:26:09.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.268 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.268 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.262347+0000", 2024-04-19T04:26:09.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.268 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.268 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.262346+0000", 2024-04-19T04:26:09.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.269 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.269 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.262352+0000", 2024-04-19T04:26:09.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4099999999999996e-06 2024-04-19T04:26:09.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.269 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.269 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.262363+0000", 2024-04-19T04:26:09.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1112e-05 2024-04-19T04:26:09.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.269 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.269 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.262380+0000", 2024-04-19T04:26:09.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6500000000000001e-05 2024-04-19T04:26:09.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.262423+0000", 2024-04-19T04:26:09.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2709000000000001e-05 2024-04-19T04:26:09.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.262568+0000", 2024-04-19T04:26:09.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014522999999999999 2024-04-19T04:26:09.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:09.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.262701+0000", 2024-04-19T04:26:09.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000133442 2024-04-19T04:26:09.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265509+0000", 2024-04-19T04:26:09.272 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028078069999999998 2024-04-19T04:26:09.272 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.272 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.272 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.272 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.272 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:184597 5.9 5:93da4513:::benchmark_data_smithi007_19526_object58863:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T04:26:09.272 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:09.262919+0000", 2024-04-19T04:26:09.272 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0036838000000000001, 2024-04-19T04:26:09.272 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0037969079999999999, 2024-04-19T04:26:09.272 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.272 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:09.272 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.272 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.273 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.273 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 184597 2024-04-19T04:26:09.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.273 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.273 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.262919+0000", 2024-04-19T04:26:09.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.273 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.262919+0000", 2024-04-19T04:26:09.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.274 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.262918+0000", 2024-04-19T04:26:09.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.274 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.262923+0000", 2024-04-19T04:26:09.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4410000000000001e-06 2024-04-19T04:26:09.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.274 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.262956+0000", 2024-04-19T04:26:09.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2149e-05 2024-04-19T04:26:09.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.262964+0000", 2024-04-19T04:26:09.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6719999999999993e-06 2024-04-19T04:26:09.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.263091+0000", 2024-04-19T04:26:09.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012727800000000001 2024-04-19T04:26:09.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.263246+0000", 2024-04-19T04:26:09.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000154671 2024-04-19T04:26:09.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:09.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.263380+0000", 2024-04-19T04:26:09.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013426599999999999 2024-04-19T04:26:09.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265816+0000", 2024-04-19T04:26:09.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024354400000000001 2024-04-19T04:26:09.276 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.276 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.276 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.277 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:184599 5.5 5:aaf171e4:::benchmark_data_smithi007_19526_object58865:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T04:26:09.277 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:09.265392+0000", 2024-04-19T04:26:09.277 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0012104920000000001, 2024-04-19T04:26:09.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001403921, 2024-04-19T04:26:09.277 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.277 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:09.277 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.277 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.277 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.277 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 184599 2024-04-19T04:26:09.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.278 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265392+0000", 2024-04-19T04:26:09.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265392+0000", 2024-04-19T04:26:09.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265391+0000", 2024-04-19T04:26:09.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.279 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.279 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265406+0000", 2024-04-19T04:26:09.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4418e-05 2024-04-19T04:26:09.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.279 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.279 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265416+0000", 2024-04-19T04:26:09.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9469999999999998e-06 2024-04-19T04:26:09.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.279 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.279 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265423+0000", 2024-04-19T04:26:09.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5140000000000004e-06 2024-04-19T04:26:09.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265471+0000", 2024-04-19T04:26:09.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7994999999999997e-05 2024-04-19T04:26:09.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265613+0000", 2024-04-19T04:26:09.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014192999999999999 2024-04-19T04:26:09.280 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.280 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.280 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.281 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:184600 5.6 5:65cfb921:::benchmark_data_smithi007_19526_object58866:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T04:26:09.281 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:09.265435+0000", 2024-04-19T04:26:09.281 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0011679959999999999, 2024-04-19T04:26:09.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001428576, 2024-04-19T04:26:09.281 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.281 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:09.281 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.281 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.281 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.282 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 184600 2024-04-19T04:26:09.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.282 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265435+0000", 2024-04-19T04:26:09.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265435+0000", 2024-04-19T04:26:09.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.283 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.283 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265434+0000", 2024-04-19T04:26:09.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.283 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.283 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265437+0000", 2024-04-19T04:26:09.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.3079999999999999e-06 2024-04-19T04:26:09.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.283 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.283 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265444+0000", 2024-04-19T04:26:09.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6429999999999998e-06 2024-04-19T04:26:09.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265450+0000", 2024-04-19T04:26:09.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8119999999999996e-06 2024-04-19T04:26:09.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265502+0000", 2024-04-19T04:26:09.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2092999999999997e-05 2024-04-19T04:26:09.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265624+0000", 2024-04-19T04:26:09.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122392 2024-04-19T04:26:09.285 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.285 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.285 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.285 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:184601 5.1 5:8dbc7777:::benchmark_data_smithi007_19526_object58867:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T04:26:09.285 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:09.265589+0000", 2024-04-19T04:26:09.285 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0010132870000000001, 2024-04-19T04:26:09.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0013392879999999999, 2024-04-19T04:26:09.285 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.285 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:09.285 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.285 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.285 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.286 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 184601 2024-04-19T04:26:09.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.286 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265589+0000", 2024-04-19T04:26:09.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265589+0000", 2024-04-19T04:26:09.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265589+0000", 2024-04-19T04:26:09.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265592+0000", 2024-04-19T04:26:09.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.388e-06 2024-04-19T04:26:09.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265598+0000", 2024-04-19T04:26:09.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2369999999999997e-06 2024-04-19T04:26:09.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265604+0000", 2024-04-19T04:26:09.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3809999999999998e-06 2024-04-19T04:26:09.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265655+0000", 2024-04-19T04:26:09.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1140999999999997e-05 2024-04-19T04:26:09.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265790+0000", 2024-04-19T04:26:09.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013474900000000001 2024-04-19T04:26:09.289 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.289 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.289 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.289 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:184602 5.2 5:47d2b11e:::benchmark_data_smithi007_19526_object58868:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T04:26:09.289 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:09.265614+0000", 2024-04-19T04:26:09.289 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.000988919, 2024-04-19T04:26:09.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0013822789999999999, 2024-04-19T04:26:09.289 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.289 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:09.289 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.289 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.289 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.290 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 184602 2024-04-19T04:26:09.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.290 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.290 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.290 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265614+0000", 2024-04-19T04:26:09.290 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.290 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.290 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265614+0000", 2024-04-19T04:26:09.290 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265613+0000", 2024-04-19T04:26:09.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265617+0000", 2024-04-19T04:26:09.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.8060000000000001e-06 2024-04-19T04:26:09.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265626+0000", 2024-04-19T04:26:09.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.541e-06 2024-04-19T04:26:09.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.292 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.292 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265633+0000", 2024-04-19T04:26:09.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3889999999999999e-06 2024-04-19T04:26:09.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.292 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.292 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265693+0000", 2024-04-19T04:26:09.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0294000000000002e-05 2024-04-19T04:26:09.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.292 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.292 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265818+0000", 2024-04-19T04:26:09.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012438099999999999 2024-04-19T04:26:09.292 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.293 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.293 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.293 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:184604 5.c 5:39fa2987:::benchmark_data_smithi007_19526_object58870:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T04:26:09.293 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:09.265670+0000", 2024-04-19T04:26:09.293 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00093233599999999997, 2024-04-19T04:26:09.293 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0013912009999999999, 2024-04-19T04:26:09.293 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.293 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:09.293 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.293 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.293 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.293 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 184604 2024-04-19T04:26:09.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.294 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.294 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.294 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.294 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265670+0000", 2024-04-19T04:26:09.294 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.294 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.294 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.294 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.294 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265670+0000", 2024-04-19T04:26:09.294 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.294 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.294 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.294 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.294 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265670+0000", 2024-04-19T04:26:09.294 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.295 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.295 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265674+0000", 2024-04-19T04:26:09.295 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0489999999999997e-06 2024-04-19T04:26:09.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.295 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.295 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265688+0000", 2024-04-19T04:26:09.295 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4282e-05 2024-04-19T04:26:09.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.295 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.295 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265695+0000", 2024-04-19T04:26:09.295 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8220000000000001e-06 2024-04-19T04:26:09.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265741+0000", 2024-04-19T04:26:09.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6415999999999997e-05 2024-04-19T04:26:09.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265893+0000", 2024-04-19T04:26:09.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015157899999999999 2024-04-19T04:26:09.296 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.296 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.296 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.297 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:184605 5.3 5:c9c328df:::benchmark_data_smithi007_19526_object58871:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T04:26:09.297 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:09.265708+0000", 2024-04-19T04:26:09.297 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00089427199999999999, 2024-04-19T04:26:09.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001421641, 2024-04-19T04:26:09.297 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.297 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:09.297 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.297 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.297 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.297 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 184605 2024-04-19T04:26:09.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.297 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.297 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.297 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265708+0000", 2024-04-19T04:26:09.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.298 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265708+0000", 2024-04-19T04:26:09.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.298 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265708+0000", 2024-04-19T04:26:09.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.298 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265711+0000", 2024-04-19T04:26:09.299 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6370000000000001e-06 2024-04-19T04:26:09.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.299 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.299 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265719+0000", 2024-04-19T04:26:09.299 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.379e-06 2024-04-19T04:26:09.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.299 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.299 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265724+0000", 2024-04-19T04:26:09.299 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5029999999999997e-06 2024-04-19T04:26:09.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.299 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.299 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265789+0000", 2024-04-19T04:26:09.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4807000000000005e-05 2024-04-19T04:26:09.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:09.265939+0000", 2024-04-19T04:26:09.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014958199999999999 2024-04-19T04:26:09.300 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.300 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.300 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.300 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.300 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:09.301 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 8 2024-04-19T04:26:09.301 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:09.302 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:09.335 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:09.332+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:09.430 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:09.430 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:09.430 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:09.430 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:09.430 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:09.437 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:09.436+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:09.442 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:09.538 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:09.536+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:09.612 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:09.612 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:09.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:09.612 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:09.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.612 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:09.612 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:09.612 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 75.379237521999997, 2024-04-19T04:26:09.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:09.612 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.612 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.613 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.613 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.613 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.613 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:09.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.613 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:09.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:09.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:09.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:09.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:09.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:09.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:09.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:09.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:09.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:09.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:09.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.616 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:09.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:09.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:09.616 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:09.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:09.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:09.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:09.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:09.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:09.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:09.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:09.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:09.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:09.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:09.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:09.620 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.620 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.620 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.620 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:09.620 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:09.620 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 75.375142600999993, 2024-04-19T04:26:09.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:09.620 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.620 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.620 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.620 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.621 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.621 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:09.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.621 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:09.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:09.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:09.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:09.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:09.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:09.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:09.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:09.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:09.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:09.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:09.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:09.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:09.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:09.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:09.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:09.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:09.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:09.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:09.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:09.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:09.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:09.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:09.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:09.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:09.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:09.627 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.627 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.627 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.627 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:09.627 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:09.627 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 75.371851415999998, 2024-04-19T04:26:09.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:09.627 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.628 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.628 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.628 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.628 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.628 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:09.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.628 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:09.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:09.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:09.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:09.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:09.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:09.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:09.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:09.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:09.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:09.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:09.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:09.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:09.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:09.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:09.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:09.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:09.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:09.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:09.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:09.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:09.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:09.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:09.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:09.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:09.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:09.634 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.634 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.634 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.634 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:09.634 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:09.635 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 53.654461951000002, 2024-04-19T04:26:09.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:09.635 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.635 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:09.635 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.635 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.635 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.635 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:09.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.635 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:09.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:09.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:09.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:09.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:09.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:09.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:09.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:09.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:09.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:09.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:09.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:09.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:09.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:09.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:09.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:09.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:09.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:09.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:09.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:09.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:09.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:09.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:09.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:09.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:09.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.642 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.642 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:09.642 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:09.642 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.642 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.642 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.642 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:09.642 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:09.642 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 53.634231501999999, 2024-04-19T04:26:09.643 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:09.643 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.643 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:09.643 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.643 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.643 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.643 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:09.643 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.643 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.643 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.643 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:09.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:09.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:09.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:09.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:09.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:09.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:09.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:09.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:09.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:09.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:09.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:09.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:09.647 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:09.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:09.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.647 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.647 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:09.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:09.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.647 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.647 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:09.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:09.648 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.648 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.648 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.648 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.648 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:09.648 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:09.648 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 53.634123645000003, 2024-04-19T04:26:09.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:09.648 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.648 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:09.648 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.648 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.649 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.649 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:09.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.649 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.649 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.649 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:09.649 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:09.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:09.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:09.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:09.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:09.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:09.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.652 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:09.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:09.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.652 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:09.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:09.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:09.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:09.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:09.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:09.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:09.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:09.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:09.654 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.654 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.654 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.654 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:09.654 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:09.654 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 53.632156956000003, 2024-04-19T04:26:09.654 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:09.655 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.655 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.655 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.655 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.655 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.655 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:09.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.655 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:09.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:09.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:09.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:09.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:09.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:09.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:09.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:09.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:09.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:09.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:09.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:09.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:09.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:09.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:09.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:09.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:09.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:09.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:09.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:09.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:09.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:09.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:09.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:09.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:09.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:09.660 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.661 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.661 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.661 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:09.661 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:09.661 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 53.628792761, 2024-04-19T04:26:09.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:09.661 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.661 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.661 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.661 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.662 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.662 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:09.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.662 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.662 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.662 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:09.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.662 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:09.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:09.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:09.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:09.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:09.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:09.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:09.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:09.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:09.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:09.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:09.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:09.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:09.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:09.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:09.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:09.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:09.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:09.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:09.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:09.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:09.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:09.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:09.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:09.667 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.667 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.667 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.668 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:09.668 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:09.668 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 53.624981783000003, 2024-04-19T04:26:09.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:09.668 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.668 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.668 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.668 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.668 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.668 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:09.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.669 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:09.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:09.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:09.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:09.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:09.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:09.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:09.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:09.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:09.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:09.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:09.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:09.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:09.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:09.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:09.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:09.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:09.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:09.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:09.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:09.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:09.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:09.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:09.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.674 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.674 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:09.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:09.674 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.674 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.674 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.674 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:09.674 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:09.674 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 40.383119426, 2024-04-19T04:26:09.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:09.675 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.675 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.675 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.675 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.675 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.675 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:09.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.675 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:09.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:09.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:09.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:09.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:09.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:09.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:09.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:09.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:09.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:09.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:09.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:09.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:09.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:09.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:09.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:09.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:09.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:09.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:09.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:09.680 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.680 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.680 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.680 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:09.680 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:09.681 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 40.382525145999999, 2024-04-19T04:26:09.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:09.681 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.681 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.681 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.681 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.681 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.681 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:09.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.681 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:09.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:09.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:09.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.683 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:09.683 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:09.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.683 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:09.683 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:09.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.683 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:09.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:09.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.684 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.684 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:09.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:09.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.684 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.684 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:09.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:09.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:09.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:09.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:09.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:09.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:09.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:09.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:09.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:09.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.686 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:09.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:09.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:09.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.686 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:09.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:09.686 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.686 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.687 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.687 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.687 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.687 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:09.687 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:09.687 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 5.6578779880000001, 2024-04-19T04:26:09.687 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:09.687 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.687 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.687 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.687 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.687 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.687 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:09.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.688 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:09.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:09.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:09.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:09.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:09.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.690 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:09.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:09.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.690 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:09.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:09.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.690 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:09.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:09.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.691 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.691 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.691 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:09.691 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:09.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.691 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.691 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:09.691 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:09.691 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:09.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.691 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.691 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.692 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:09.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:09.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.692 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.692 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:09.692 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:09.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:09.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.692 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.692 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:09.692 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:09.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:09.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.693 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.693 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:09.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:09.693 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.693 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.693 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.693 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:09.693 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:09.693 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 5.657837572, 2024-04-19T04:26:09.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:09.694 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.694 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.694 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.694 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.694 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.694 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:09.694 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.694 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.694 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.694 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.694 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:09.694 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.695 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.695 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:09.695 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.695 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.695 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:09.695 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:09.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:09.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:09.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:09.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:09.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:09.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:09.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:09.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:09.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:09.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.698 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:09.698 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:09.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:09.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.698 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.698 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.698 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:09.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:09.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.698 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.698 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:09.698 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:09.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:09.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.699 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:09.699 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:09.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:09.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.699 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.699 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:09.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:09.699 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.700 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.700 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.700 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:09.700 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:09.700 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 5.6541412629999996, 2024-04-19T04:26:09.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:09.700 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.700 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.700 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.700 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.701 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.701 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:09.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.701 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:09.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:09.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:09.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:09.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:09.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:09.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:09.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:09.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:09.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.704 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.704 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:09.704 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:09.704 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.704 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.704 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.704 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:09.704 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:09.704 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.704 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.704 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:09.704 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:09.705 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:09.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.705 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.705 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:09.705 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:09.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.705 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:09.705 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:09.705 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:09.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:09.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:09.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:09.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:09.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:09.706 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.706 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.706 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.707 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:09.707 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:09.707 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 5.4005307890000003, 2024-04-19T04:26:09.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:09.707 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.707 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.707 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.707 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.707 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.707 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:09.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.708 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.708 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.708 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.708 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:09.708 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.708 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.708 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.708 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:09.708 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.708 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.709 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.709 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:09.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.709 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.709 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.709 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:09.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:09.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.709 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.709 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.709 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:09.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:09.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.710 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.710 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:09.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:09.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.710 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.710 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:09.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:09.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:09.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:09.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:09.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:09.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:09.712 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:09.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:09.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.712 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:09.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:09.712 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.712 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.712 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.713 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:09.713 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:09.713 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 5.3982373770000001, 2024-04-19T04:26:09.713 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:09.713 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.713 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.713 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.713 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.713 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.713 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:09.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.714 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.714 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.714 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.714 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:09.714 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.714 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.714 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.714 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:09.714 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.714 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:09.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:09.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:09.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:09.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:09.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:09.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:09.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:09.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:09.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:09.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:09.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:09.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:09.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:09.718 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:09.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:09.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.718 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.718 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:09.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:09.718 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.718 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.718 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.718 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:09.719 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:09.719 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 5.398191561, 2024-04-19T04:26:09.719 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:09.719 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.719 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.719 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.719 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.719 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.719 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:09.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.719 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:09.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:09.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:09.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:09.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:09.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:09.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:09.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.722 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.722 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:09.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:09.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.722 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.722 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:09.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:09.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.722 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:09.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:09.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:09.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:09.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:09.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:09.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:09.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:09.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:09.724 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.724 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.724 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.724 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174342 5.9 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:09.724 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:09.724 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.7130348609999997, 2024-04-19T04:26:09.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068615152999999998, 2024-04-19T04:26:09.725 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.725 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.725 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.725 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.725 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.725 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174342 2024-04-19T04:26:09.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.725 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:09.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.726 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:09.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.726 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897726+0000", 2024-04-19T04:26:09.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897731+0000", 2024-04-19T04:26:09.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1449999999999999e-06 2024-04-19T04:26:09.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897744+0000", 2024-04-19T04:26:09.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2833000000000001e-05 2024-04-19T04:26:09.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897749+0000", 2024-04-19T04:26:09.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1540000000000001e-06 2024-04-19T04:26:09.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897810+0000", 2024-04-19T04:26:09.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0724999999999999e-05 2024-04-19T04:26:09.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897920+0000", 2024-04-19T04:26:09.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011024 2024-04-19T04:26:09.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:09.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897993+0000", 2024-04-19T04:26:09.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2335000000000005e-05 2024-04-19T04:26:09.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.899597+0000", 2024-04-19T04:26:09.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016048919999999999 2024-04-19T04:26:09.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.730 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:09.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966230+0000", 2024-04-19T04:26:09.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.066632882000000004 2024-04-19T04:26:09.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.730 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:09.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966296+0000", 2024-04-19T04:26:09.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5361e-05 2024-04-19T04:26:09.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.731 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.731 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966342+0000", 2024-04-19T04:26:09.731 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6476e-05 2024-04-19T04:26:09.731 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.731 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.731 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.731 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.731 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174344 5.d 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:09.731 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:09.731 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.7123560229999999, 2024-04-19T04:26:09.731 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068211329000000001, 2024-04-19T04:26:09.732 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.732 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.732 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.732 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.732 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.732 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174344 2024-04-19T04:26:09.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.732 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:09.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:09.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898405+0000", 2024-04-19T04:26:09.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898409+0000", 2024-04-19T04:26:09.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5149999999999998e-06 2024-04-19T04:26:09.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898415+0000", 2024-04-19T04:26:09.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:26:09.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898419+0000", 2024-04-19T04:26:09.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.89e-06 2024-04-19T04:26:09.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898459+0000", 2024-04-19T04:26:09.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0017e-05 2024-04-19T04:26:09.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898540+0000", 2024-04-19T04:26:09.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1237999999999997e-05 2024-04-19T04:26:09.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:09.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:09.736 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6060000000000001e-05 2024-04-19T04:26:09.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.901321+0000", 2024-04-19T04:26:09.736 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027152109999999999 2024-04-19T04:26:09.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:09.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966512+0000", 2024-04-19T04:26:09.736 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.065190440000000002 2024-04-19T04:26:09.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:09.737 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966563+0000", 2024-04-19T04:26:09.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1436e-05 2024-04-19T04:26:09.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.737 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966617+0000", 2024-04-19T04:26:09.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.401e-05 2024-04-19T04:26:09.737 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.737 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.737 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.738 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.738 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174346 5.f 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:09.738 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:09.738 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4.7105697959999997, 2024-04-19T04:26:09.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.067185536000000004, 2024-04-19T04:26:09.738 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:09.738 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.738 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:09.738 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:09.738 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.738 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174346 2024-04-19T04:26:09.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.739 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:09.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.739 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:09.739 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:09.739 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.739 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:09.739 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:09.739 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:09.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.740 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:09.740 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900191+0000", 2024-04-19T04:26:09.740 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.740 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.740 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:09.740 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900196+0000", 2024-04-19T04:26:09.740 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3329999999999998e-06 2024-04-19T04:26:09.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.740 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.740 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:09.740 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900206+0000", 2024-04-19T04:26:09.740 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9699999999999994e-06 2024-04-19T04:26:09.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900210+0000", 2024-04-19T04:26:09.741 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3359999999999997e-06 2024-04-19T04:26:09.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:09.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900243+0000", 2024-04-19T04:26:09.741 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2669999999999997e-05 2024-04-19T04:26:09.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:09.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900365+0000", 2024-04-19T04:26:09.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122648 2024-04-19T04:26:09.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:09.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900559+0000", 2024-04-19T04:26:09.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019358799999999999 2024-04-19T04:26:09.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:09.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.903018+0000", 2024-04-19T04:26:09.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024592300000000002 2024-04-19T04:26:09.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.743 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:09.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967180+0000", 2024-04-19T04:26:09.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.064161587000000006 2024-04-19T04:26:09.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.743 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:09.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967293+0000", 2024-04-19T04:26:09.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112921 2024-04-19T04:26:09.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:09.744 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:09.744 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:09.744 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967378+0000", 2024-04-19T04:26:09.744 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5000999999999995e-05 2024-04-19T04:26:09.744 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.744 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.744 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.744 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:09.744 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:09.744 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:09.745 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~53s 2024-04-19T04:26:09.746 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:09.745+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:09.746 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:09.847 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:09.844+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:09.876 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:09.876 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:09.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.877 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:186051 5.b 5:d5d190b5:::benchmark_data_smithi007_19526_object60317:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T04:26:09.877 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:09.871920+0000", 2024-04-19T04:26:09.877 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0045881439999999997, 2024-04-19T04:26:09.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046118069999999999, 2024-04-19T04:26:09.877 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.877 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:09.877 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.877 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.877 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.877 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 186051 2024-04-19T04:26:09.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.877 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.871920+0000", 2024-04-19T04:26:09.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.871920+0000", 2024-04-19T04:26:09.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.871919+0000", 2024-04-19T04:26:09.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.871924+0000", 2024-04-19T04:26:09.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1340000000000003e-06 2024-04-19T04:26:09.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.871933+0000", 2024-04-19T04:26:09.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5860000000000005e-06 2024-04-19T04:26:09.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.871939+0000", 2024-04-19T04:26:09.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4520000000000002e-06 2024-04-19T04:26:09.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.872005+0000", 2024-04-19T04:26:09.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6210999999999993e-05 2024-04-19T04:26:09.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.872145+0000", 2024-04-19T04:26:09.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000140016 2024-04-19T04:26:09.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:09.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876451+0000", 2024-04-19T04:26:09.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0043060319999999996 2024-04-19T04:26:09.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:09.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876488+0000", 2024-04-19T04:26:09.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6390999999999998e-05 2024-04-19T04:26:09.881 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.881 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.881 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.882 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:186049 5.d e56/29 5:b7fcdf63:::benchmark_data_smithi007_19526_object60315:head v 56'11250, mlcod=56'11248)", 2024-04-19T04:26:09.882 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:09.871996+0000", 2024-04-19T04:26:09.882 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0045121060000000001, 2024-04-19T04:26:09.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046243109999999999, 2024-04-19T04:26:09.882 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.882 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:09.882 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.871996+0000", 2024-04-19T04:26:09.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.871996+0000", 2024-04-19T04:26:09.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.871995+0000", 2024-04-19T04:26:09.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.872001+0000", 2024-04-19T04:26:09.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2610000000000001e-06 2024-04-19T04:26:09.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.872008+0000", 2024-04-19T04:26:09.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8460000000000002e-06 2024-04-19T04:26:09.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.872012+0000", 2024-04-19T04:26:09.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:09.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.872046+0000", 2024-04-19T04:26:09.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3958000000000003e-05 2024-04-19T04:26:09.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.872064+0000", 2024-04-19T04:26:09.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7489000000000001e-05 2024-04-19T04:26:09.885 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.885 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.885 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.885 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:186050 5.f e56/20 5:f3ae8894:::benchmark_data_smithi007_19526_object60316:head v 56'11448, mlcod=56'11445)", 2024-04-19T04:26:09.885 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:09.873471+0000", 2024-04-19T04:26:09.886 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00303696, 2024-04-19T04:26:09.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032053960000000001, 2024-04-19T04:26:09.886 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.886 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:09.886 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.873471+0000", 2024-04-19T04:26:09.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.873471+0000", 2024-04-19T04:26:09.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.873470+0000", 2024-04-19T04:26:09.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.873477+0000", 2024-04-19T04:26:09.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4139999999999999e-06 2024-04-19T04:26:09.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.873494+0000", 2024-04-19T04:26:09.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7181999999999999e-05 2024-04-19T04:26:09.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.873500+0000", 2024-04-19T04:26:09.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4670000000000001e-06 2024-04-19T04:26:09.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.873808+0000", 2024-04-19T04:26:09.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00030750900000000003 2024-04-19T04:26:09.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.873829+0000", 2024-04-19T04:26:09.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1489e-05 2024-04-19T04:26:09.889 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.889 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.889 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.889 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:186053 5.d e56/29 5:bb5a6cc2:::benchmark_data_smithi007_19526_object60319:head v 56'11251, mlcod=56'11248)", 2024-04-19T04:26:09.889 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:09.874243+0000", 2024-04-19T04:26:09.889 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0022651519999999999, 2024-04-19T04:26:09.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024919170000000002, 2024-04-19T04:26:09.889 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.890 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:09.890 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.874243+0000", 2024-04-19T04:26:09.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.874243+0000", 2024-04-19T04:26:09.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.874242+0000", 2024-04-19T04:26:09.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.874248+0000", 2024-04-19T04:26:09.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7699999999999998e-06 2024-04-19T04:26:09.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.874254+0000", 2024-04-19T04:26:09.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2079999999999997e-06 2024-04-19T04:26:09.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.874259+0000", 2024-04-19T04:26:09.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2079999999999999e-06 2024-04-19T04:26:09.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.874291+0000", 2024-04-19T04:26:09.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1415999999999999e-05 2024-04-19T04:26:09.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.874306+0000", 2024-04-19T04:26:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5551000000000001e-05 2024-04-19T04:26:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:186057 5.e 5:7082ab7b:::benchmark_data_smithi007_19526_object60323:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T04:26:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:09.876091+0000", 2024-04-19T04:26:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00041753899999999997, 2024-04-19T04:26:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070711099999999996, 2024-04-19T04:26:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.894 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.894 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.894 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 186057 2024-04-19T04:26:09.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.894 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876091+0000", 2024-04-19T04:26:09.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876091+0000", 2024-04-19T04:26:09.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876090+0000", 2024-04-19T04:26:09.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876095+0000", 2024-04-19T04:26:09.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6949999999999997e-06 2024-04-19T04:26:09.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876105+0000", 2024-04-19T04:26:09.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0254999999999999e-05 2024-04-19T04:26:09.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876113+0000", 2024-04-19T04:26:09.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8429999999999993e-06 2024-04-19T04:26:09.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876152+0000", 2024-04-19T04:26:09.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8423999999999997e-05 2024-04-19T04:26:09.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876261+0000", 2024-04-19T04:26:09.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000109434 2024-04-19T04:26:09.897 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.897 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.897 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.897 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:186058 5.0 5:01bc1e0a:::benchmark_data_smithi007_19526_object60324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T04:26:09.897 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:09.876491+0000", 2024-04-19T04:26:09.898 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.677e-05, 2024-04-19T04:26:09.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00036837699999999997, 2024-04-19T04:26:09.898 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.898 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:09.898 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.898 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.898 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.898 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 186058 2024-04-19T04:26:09.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.898 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876491+0000", 2024-04-19T04:26:09.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876491+0000", 2024-04-19T04:26:09.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876490+0000", 2024-04-19T04:26:09.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876496+0000", 2024-04-19T04:26:09.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2109999999999997e-06 2024-04-19T04:26:09.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876505+0000", 2024-04-19T04:26:09.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8529999999999998e-06 2024-04-19T04:26:09.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876512+0000", 2024-04-19T04:26:09.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1720000000000001e-06 2024-04-19T04:26:09.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876575+0000", 2024-04-19T04:26:09.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3372000000000002e-05 2024-04-19T04:26:09.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876707+0000", 2024-04-19T04:26:09.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013179500000000001 2024-04-19T04:26:09.901 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.901 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.901 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.901 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:186059 5.e 5.f7809bee (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T04:26:09.901 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:09.876703+0000", 2024-04-19T04:26:09.901 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9998055, 2024-04-19T04:26:09.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021571900000000001, 2024-04-19T04:26:09.902 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.902 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:09.902 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.902 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.902 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.902 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 186059 2024-04-19T04:26:09.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.902 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876703+0000", 2024-04-19T04:26:09.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876703+0000", 2024-04-19T04:26:09.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876702+0000", 2024-04-19T04:26:09.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876707+0000", 2024-04-19T04:26:09.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1619999999999999e-06 2024-04-19T04:26:09.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876715+0000", 2024-04-19T04:26:09.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7659999999999998e-06 2024-04-19T04:26:09.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876721+0000", 2024-04-19T04:26:09.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5699999999999998e-06 2024-04-19T04:26:09.904 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.904 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.904 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.904 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:186060 5.0 5.ff8c88a0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T04:26:09.905 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:09.876732+0000", 2024-04-19T04:26:09.905 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9997764, 2024-04-19T04:26:09.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023592700000000001, 2024-04-19T04:26:09.905 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.905 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:09.905 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.905 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.905 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.905 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 186060 2024-04-19T04:26:09.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.905 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876732+0000", 2024-04-19T04:26:09.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876732+0000", 2024-04-19T04:26:09.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876731+0000", 2024-04-19T04:26:09.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876734+0000", 2024-04-19T04:26:09.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.774e-06 2024-04-19T04:26:09.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876740+0000", 2024-04-19T04:26:09.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:09.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876746+0000", 2024-04-19T04:26:09.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.55e-06 2024-04-19T04:26:09.908 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.908 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.908 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.908 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:186063 5.a 5:5f3b8690:::benchmark_data_smithi007_19526_object60329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T04:26:09.908 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:09.876760+0000", 2024-04-19T04:26:09.908 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9997482, 2024-04-19T04:26:09.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00026197299999999998, 2024-04-19T04:26:09.908 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.908 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:09.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.909 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.909 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.909 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 186063 2024-04-19T04:26:09.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.909 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876760+0000", 2024-04-19T04:26:09.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876760+0000", 2024-04-19T04:26:09.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876760+0000", 2024-04-19T04:26:09.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:09.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876763+0000", 2024-04-19T04:26:09.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0460000000000001e-06 2024-04-19T04:26:09.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876772+0000", 2024-04-19T04:26:09.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7550000000000006e-06 2024-04-19T04:26:09.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876778+0000", 2024-04-19T04:26:09.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4519999999999996e-06 2024-04-19T04:26:09.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876820+0000", 2024-04-19T04:26:09.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2097e-05 2024-04-19T04:26:09.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.876978+0000", 2024-04-19T04:26:09.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015807899999999999 2024-04-19T04:26:09.913 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.913 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.913 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.913 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:186044 5.0 5:081716a3:::benchmark_data_smithi007_19526_object60310:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T04:26:09.913 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:09.870559+0000", 2024-04-19T04:26:09.913 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0059490530000000002, 2024-04-19T04:26:09.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0065371450000000003, 2024-04-19T04:26:09.913 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:09.913 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:09.913 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:09.913 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:09.914 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:09.914 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 186044 2024-04-19T04:26:09.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.914 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:09.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:09.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.870559+0000", 2024-04-19T04:26:09.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:09.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.870559+0000", 2024-04-19T04:26:09.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:09.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:09.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.870558+0000", 2024-04-19T04:26:09.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:09.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:09.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.870563+0000", 2024-04-19T04:26:09.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8099999999999997e-06 2024-04-19T04:26:09.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:09.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.870573+0000", 2024-04-19T04:26:09.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9939999999999995e-06 2024-04-19T04:26:09.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:09.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.870580+0000", 2024-04-19T04:26:09.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0999999999999998e-06 2024-04-19T04:26:09.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:09.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.873459+0000", 2024-04-19T04:26:09.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028785519999999999 2024-04-19T04:26:09.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:09.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:09.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:09.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:09.874105+0000", 2024-04-19T04:26:09.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00064623199999999995 2024-04-19T04:26:09.917 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.917 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:09.917 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.917 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:09.917 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:26:09.917 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 10 2024-04-19T04:26:09.917 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:09.918 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:09.947 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:09.944+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:10.039 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:10.039 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:10.039 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:10.040 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:10.040 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:10.049 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:10.045+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:10.054 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:10.150 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:10.148+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:10.175 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:10.175 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:10.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.222184787000003, 2024-04-19T04:26:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:10.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:10.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:10.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:10.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:10.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:10.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:10.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:10.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:10.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:10.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:10.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:10.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:10.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:10.181 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.181 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.182 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.182 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:10.182 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:10.182 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.217123141000002, 2024-04-19T04:26:10.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:10.182 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.182 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:10.182 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.182 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.182 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.182 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:10.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.183 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:10.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:10.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:10.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:10.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:10.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:10.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:10.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:10.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:10.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:10.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:10.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:10.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:10.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:10.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:10.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:10.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:10.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:10.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:10.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:10.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:10.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:10.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:10.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:10.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:10.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:10.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:10.187 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.188 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.188 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.188 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:10.188 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:10.188 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.217023228999999, 2024-04-19T04:26:10.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:10.188 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.188 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:10.188 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.188 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.188 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.188 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:10.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.189 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:10.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:10.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:10.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:10.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:10.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:10.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:10.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:10.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:10.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:10.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:10.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:10.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:10.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:10.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:10.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:10.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:10.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:10.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:10.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:10.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:10.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:10.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:10.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:10.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:10.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:10.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:10.193 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.193 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.193 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.193 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:10.193 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:10.193 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.216897476, 2024-04-19T04:26:10.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:10.194 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.194 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:10.194 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.194 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.194 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.194 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:10.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.194 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:10.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:10.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:10.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:10.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:10.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:10.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:10.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:10.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:10.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:10.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:10.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:10.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:10.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:10.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:10.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:10.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:10.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:10.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:10.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:10.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:10.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:10.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:10.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:10.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:10.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:10.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:10.199 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.199 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.199 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.199 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:10.199 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:10.199 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.213053531, 2024-04-19T04:26:10.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:10.199 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.199 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:10.199 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.199 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.199 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.205882430000003, 2024-04-19T04:26:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.205710326000002, 2024-04-19T04:26:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.205647200999998, 2024-04-19T04:26:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.205518603999998, 2024-04-19T04:26:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.205450632999998, 2024-04-19T04:26:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.2859109679999996, 2024-04-19T04:26:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078453623, 2024-04-19T04:26:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965893+0000", 2024-04-19T04:26:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.076646455000000002 2024-04-19T04:26:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965956+0000", 2024-04-19T04:26:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3200000000000005e-05 2024-04-19T04:26:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966068+0000", 2024-04-19T04:26:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011194800000000001 2024-04-19T04:26:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.285879971, 2024-04-19T04:26:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083782388999999999, 2024-04-19T04:26:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971179+0000", 2024-04-19T04:26:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079349476000000002 2024-04-19T04:26:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971259+0000", 2024-04-19T04:26:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9083000000000002e-05 2024-04-19T04:26:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971428+0000", 2024-04-19T04:26:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169419 2024-04-19T04:26:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.2835584510000002, 2024-04-19T04:26:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081686998999999996, 2024-04-19T04:26:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971454+0000", 2024-04-19T04:26:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077525997999999999 2024-04-19T04:26:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971540+0000", 2024-04-19T04:26:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6285000000000005e-05 2024-04-19T04:26:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971654+0000", 2024-04-19T04:26:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114095 2024-04-19T04:26:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.2823480690000002, 2024-04-19T04:26:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080734265999999999, 2024-04-19T04:26:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971677+0000", 2024-04-19T04:26:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.073192023999999994 2024-04-19T04:26:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971771+0000", 2024-04-19T04:26:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4235999999999997e-05 2024-04-19T04:26:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971912+0000", 2024-04-19T04:26:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014055099999999999 2024-04-19T04:26:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.2813965779999998, 2024-04-19T04:26:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085645857000000006, 2024-04-19T04:26:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977634+0000", 2024-04-19T04:26:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077144335999999994 2024-04-19T04:26:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977699+0000", 2024-04-19T04:26:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4518999999999997e-05 2024-04-19T04:26:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977775+0000", 2024-04-19T04:26:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6219999999999999e-05 2024-04-19T04:26:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.2783889999999998, 2024-04-19T04:26:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075403611999999995, 2024-04-19T04:26:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970369+0000", 2024-04-19T04:26:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.074967992999999997 2024-04-19T04:26:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970419+0000", 2024-04-19T04:26:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9700999999999997e-05 2024-04-19T04:26:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970540+0000", 2024-04-19T04:26:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121512 2024-04-19T04:26:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5:78f758ec:::benchmark_data_smithi007_19526_object48602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.2780148760000003, 2024-04-19T04:26:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085171609999999995, 2024-04-19T04:26:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966154+0000", 2024-04-19T04:26:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.070613543000000001 2024-04-19T04:26:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966382+0000", 2024-04-19T04:26:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022741800000000001 2024-04-19T04:26:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980581+0000", 2024-04-19T04:26:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014199916999999999 2024-04-19T04:26:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980621+0000", 2024-04-19T04:26:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9685999999999999e-05 2024-04-19T04:26:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980682+0000", 2024-04-19T04:26:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1130000000000006e-05 2024-04-19T04:26:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.2779249239999997, 2024-04-19T04:26:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075073230000000005, 2024-04-19T04:26:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970556+0000", 2024-04-19T04:26:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.072076192999999997 2024-04-19T04:26:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970608+0000", 2024-04-19T04:26:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2549000000000001e-05 2024-04-19T04:26:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970674+0000", 2024-04-19T04:26:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5549000000000005e-05 2024-04-19T04:26:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5:70a7bb5e:::benchmark_data_smithi007_19526_object48614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.2728379270000003, 2024-04-19T04:26:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080099220999999998, 2024-04-19T04:26:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971978+0000", 2024-04-19T04:26:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.071282358000000004 2024-04-19T04:26:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.972180+0000", 2024-04-19T04:26:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020191100000000001 2024-04-19T04:26:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980701+0000", 2024-04-19T04:26:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085211760000000001 2024-04-19T04:26:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980729+0000", 2024-04-19T04:26:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8068e-05 2024-04-19T04:26:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980787+0000", 2024-04-19T04:26:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7521e-05 2024-04-19T04:26:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174350 5.e 5:7f36609a:::benchmark_data_smithi007_19526_object48616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.2710668549999999, 2024-04-19T04:26:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079723622999999993, 2024-04-19T04:26:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174350 2024-04-19T04:26:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902458+0000", 2024-04-19T04:26:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902463+0000", 2024-04-19T04:26:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5889999999999996e-06 2024-04-19T04:26:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965576+0000", 2024-04-19T04:26:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063113328999999996 2024-04-19T04:26:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965614+0000", 2024-04-19T04:26:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8285999999999999e-05 2024-04-19T04:26:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974787+0000", 2024-04-19T04:26:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009172599 2024-04-19T04:26:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974999+0000", 2024-04-19T04:26:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021270999999999999 2024-04-19T04:26:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982086+0000", 2024-04-19T04:26:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070869160000000004 2024-04-19T04:26:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982115+0000", 2024-04-19T04:26:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8603999999999999e-05 2024-04-19T04:26:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982182+0000", 2024-04-19T04:26:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7350999999999999e-05 2024-04-19T04:26:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.281 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.281 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:10.281 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:10.281 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:10.282 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:10.280+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:10.283 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2024-04-19T04:26:10.283 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:10.383 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:10.381+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:10.421 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:10.421 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:10.421 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.421 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:187328 5.9 5:941935c6:::benchmark_data_smithi007_19526_object61594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T04:26:10.421 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:10.412620+0000", 2024-04-19T04:26:10.422 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0078465380000000001, 2024-04-19T04:26:10.422 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0078721920000000001, 2024-04-19T04:26:10.422 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:10.422 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:10.422 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:10.422 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:10.422 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.422 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 187328 2024-04-19T04:26:10.422 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.422 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:10.422 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.422 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:10.422 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412620+0000", 2024-04-19T04:26:10.423 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.423 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.423 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.423 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:10.423 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412620+0000", 2024-04-19T04:26:10.423 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.423 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.423 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.423 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:10.423 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412619+0000", 2024-04-19T04:26:10.423 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:10.424 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.424 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.424 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:10.424 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412622+0000", 2024-04-19T04:26:10.424 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.3680000000000002e-06 2024-04-19T04:26:10.424 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.424 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.424 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:10.424 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412628+0000", 2024-04-19T04:26:10.424 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.412e-06 2024-04-19T04:26:10.425 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.425 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.425 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.425 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412631+0000", 2024-04-19T04:26:10.425 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4960000000000001e-06 2024-04-19T04:26:10.425 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.425 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.425 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:10.425 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.418502+0000", 2024-04-19T04:26:10.425 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0058701129999999997 2024-04-19T04:26:10.425 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.425 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.426 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:10.426 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.418628+0000", 2024-04-19T04:26:10.426 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126799 2024-04-19T04:26:10.426 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.426 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.426 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:10.426 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.418782+0000", 2024-04-19T04:26:10.426 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015333 2024-04-19T04:26:10.426 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.426 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:10.426 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.426 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.426 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.427 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:187330 5.1 5.a8c6dc1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T04:26:10.427 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:10.414517+0000", 2024-04-19T04:26:10.427 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0059493280000000003, 2024-04-19T04:26:10.427 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0060569320000000001, 2024-04-19T04:26:10.427 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:10.427 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:10.427 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:10.427 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:10.427 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.427 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 187330 2024-04-19T04:26:10.427 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.427 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:10.427 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.427 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:10.428 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.414517+0000", 2024-04-19T04:26:10.428 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.428 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.428 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.428 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:10.428 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.414517+0000", 2024-04-19T04:26:10.428 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.428 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.428 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.428 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:10.428 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.414516+0000", 2024-04-19T04:26:10.428 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:10.428 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.429 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.429 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:10.429 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.414523+0000", 2024-04-19T04:26:10.429 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4729999999999997e-06 2024-04-19T04:26:10.429 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.429 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.429 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:10.429 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.414544+0000", 2024-04-19T04:26:10.429 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1447999999999999e-05 2024-04-19T04:26:10.429 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.429 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.429 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.430 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.414560+0000", 2024-04-19T04:26:10.430 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5710999999999999e-05 2024-04-19T04:26:10.430 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.430 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:10.430 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.430 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.430 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.430 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:187335 5.9 5:9b193bb2:::benchmark_data_smithi007_19526_object61601:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T04:26:10.430 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:10.416362+0000", 2024-04-19T04:26:10.430 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.004103972, 2024-04-19T04:26:10.430 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042723830000000003, 2024-04-19T04:26:10.430 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:10.430 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:10.431 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:10.431 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:10.431 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.431 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 187335 2024-04-19T04:26:10.431 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.431 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:10.431 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.431 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:10.431 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.416362+0000", 2024-04-19T04:26:10.431 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.431 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.431 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.431 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:10.431 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.416362+0000", 2024-04-19T04:26:10.432 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.432 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.432 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.432 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:10.432 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.416362+0000", 2024-04-19T04:26:10.432 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:10.432 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.433 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.433 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:10.433 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.416366+0000", 2024-04-19T04:26:10.433 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.8469999999999998e-06 2024-04-19T04:26:10.433 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.433 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.433 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:10.433 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.416374+0000", 2024-04-19T04:26:10.434 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6559999999999998e-06 2024-04-19T04:26:10.434 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.434 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.434 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.434 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.416380+0000", 2024-04-19T04:26:10.434 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.604e-06 2024-04-19T04:26:10.434 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.434 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.434 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:10.434 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420575+0000", 2024-04-19T04:26:10.434 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0041950770000000002 2024-04-19T04:26:10.434 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.434 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:10.435 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.435 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.435 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.435 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:187336 5.9 5.8d4ccdc9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T04:26:10.435 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:10.417017+0000", 2024-04-19T04:26:10.435 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.003449138, 2024-04-19T04:26:10.435 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0036775269999999999, 2024-04-19T04:26:10.435 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:10.435 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:10.435 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:10.435 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:10.435 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.435 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 187336 2024-04-19T04:26:10.435 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.436 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:10.436 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.436 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:10.436 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.417017+0000", 2024-04-19T04:26:10.436 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.436 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.436 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.436 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:10.436 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.417017+0000", 2024-04-19T04:26:10.436 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.436 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.436 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.436 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:10.436 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.417016+0000", 2024-04-19T04:26:10.437 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:10.437 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.437 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.437 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:10.437 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.417020+0000", 2024-04-19T04:26:10.437 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6449999999999998e-06 2024-04-19T04:26:10.437 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.437 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.437 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:10.437 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.417030+0000", 2024-04-19T04:26:10.437 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.4190000000000008e-06 2024-04-19T04:26:10.437 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.437 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.437 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.438 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.417038+0000", 2024-04-19T04:26:10.438 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.123e-06 2024-04-19T04:26:10.438 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.438 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:10.438 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.438 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.438 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.438 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:187337 5.f 5:f7e8244f:::benchmark_data_smithi007_19526_object61603:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T04:26:10.438 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:10.418979+0000", 2024-04-19T04:26:10.438 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001486984, 2024-04-19T04:26:10.438 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0017731999999999999, 2024-04-19T04:26:10.438 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:10.438 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:10.439 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:10.439 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:10.439 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.439 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 187337 2024-04-19T04:26:10.439 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.439 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:10.439 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.439 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:10.439 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.418979+0000", 2024-04-19T04:26:10.439 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.439 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.439 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.439 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:10.440 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.418979+0000", 2024-04-19T04:26:10.440 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.440 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.440 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.440 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:10.440 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.418979+0000", 2024-04-19T04:26:10.440 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:10.440 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.440 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.440 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:10.440 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.418983+0000", 2024-04-19T04:26:10.440 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7190000000000001e-06 2024-04-19T04:26:10.440 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.440 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.441 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:10.441 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.418996+0000", 2024-04-19T04:26:10.441 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2427e-05 2024-04-19T04:26:10.441 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.441 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.441 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.441 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.419002+0000", 2024-04-19T04:26:10.441 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1149999999999999e-06 2024-04-19T04:26:10.441 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.441 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.441 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:10.441 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.419048+0000", 2024-04-19T04:26:10.441 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5809999999999997e-05 2024-04-19T04:26:10.442 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.442 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.442 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:10.442 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.419251+0000", 2024-04-19T04:26:10.442 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00020331599999999999 2024-04-19T04:26:10.442 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.442 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.442 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:10.442 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.419401+0000", 2024-04-19T04:26:10.443 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150004 2024-04-19T04:26:10.443 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.443 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:10.443 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.443 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.443 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.443 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:187338 5.5 5:a4bdb3c5:::benchmark_data_smithi007_19526_object61604:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T04:26:10.443 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:10.419013+0000", 2024-04-19T04:26:10.443 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0014532830000000001, 2024-04-19T04:26:10.444 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001786127, 2024-04-19T04:26:10.444 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:10.444 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:10.444 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:10.444 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:10.444 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.444 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 187338 2024-04-19T04:26:10.444 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.444 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:10.444 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.444 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:10.444 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.419013+0000", 2024-04-19T04:26:10.444 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.445 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.445 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.445 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:10.445 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.419013+0000", 2024-04-19T04:26:10.445 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.445 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.445 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.445 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:10.445 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.419012+0000", 2024-04-19T04:26:10.445 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:10.445 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.445 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.446 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:10.446 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.419016+0000", 2024-04-19T04:26:10.446 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5590000000000001e-06 2024-04-19T04:26:10.446 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.446 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.446 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:10.446 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.419023+0000", 2024-04-19T04:26:10.446 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1210000000000001e-06 2024-04-19T04:26:10.446 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.446 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.446 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.446 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.419029+0000", 2024-04-19T04:26:10.446 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1090000000000003e-06 2024-04-19T04:26:10.447 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.447 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.447 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:10.447 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.419071+0000", 2024-04-19T04:26:10.447 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1384999999999998e-05 2024-04-19T04:26:10.447 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.447 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.447 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:10.447 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.419269+0000", 2024-04-19T04:26:10.447 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019819 2024-04-19T04:26:10.447 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.447 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:10.447 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.447 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.448 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.448 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:187340 5.c 5:37f416eb:::benchmark_data_smithi007_19526_object61606:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T04:26:10.448 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:10.420479+0000", 2024-04-19T04:26:10.448 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9999876, 2024-04-19T04:26:10.448 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00038987499999999998, 2024-04-19T04:26:10.448 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:10.448 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:10.448 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:10.448 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:10.448 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.448 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 187340 2024-04-19T04:26:10.449 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.449 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:10.449 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.449 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:10.449 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420479+0000", 2024-04-19T04:26:10.449 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.449 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.449 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.449 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:10.450 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420479+0000", 2024-04-19T04:26:10.450 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.450 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.450 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.450 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:10.450 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420478+0000", 2024-04-19T04:26:10.450 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:10.450 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.450 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.451 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:10.451 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420482+0000", 2024-04-19T04:26:10.451 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2880000000000003e-06 2024-04-19T04:26:10.451 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.451 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.451 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:10.451 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420490+0000", 2024-04-19T04:26:10.451 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1019999999999997e-06 2024-04-19T04:26:10.451 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.451 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.451 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.452 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420497+0000", 2024-04-19T04:26:10.452 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6000000000000003e-06 2024-04-19T04:26:10.452 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.452 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.452 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:10.452 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420558+0000", 2024-04-19T04:26:10.452 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1404999999999999e-05 2024-04-19T04:26:10.452 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.452 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.452 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:10.452 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420732+0000", 2024-04-19T04:26:10.452 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017357599999999999 2024-04-19T04:26:10.452 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.452 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:10.452 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.453 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.453 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.453 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:187341 5.f 5.819a84ff (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T04:26:10.453 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:10.420677+0000", 2024-04-19T04:26:10.453 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9997897, 2024-04-19T04:26:10.453 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00023099000000000001, 2024-04-19T04:26:10.453 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:10.453 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:10.453 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:10.453 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:10.453 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.453 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 187341 2024-04-19T04:26:10.453 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.454 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:10.454 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.454 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:10.454 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420677+0000", 2024-04-19T04:26:10.454 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.454 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.454 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.454 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:10.454 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420677+0000", 2024-04-19T04:26:10.454 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.454 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.454 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.454 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:10.455 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420676+0000", 2024-04-19T04:26:10.455 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:10.455 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.455 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.455 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:10.455 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420681+0000", 2024-04-19T04:26:10.455 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8470000000000003e-06 2024-04-19T04:26:10.455 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.455 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.455 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:10.455 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420689+0000", 2024-04-19T04:26:10.455 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5040000000000002e-06 2024-04-19T04:26:10.455 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.456 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.456 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.456 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420698+0000", 2024-04-19T04:26:10.456 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0729999999999994e-06 2024-04-19T04:26:10.456 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.456 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:10.456 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.456 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.456 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.456 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:187327 5.9 e57/20)", 2024-04-19T04:26:10.456 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:10.420797+0000", 2024-04-19T04:26:10.456 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9996696, 2024-04-19T04:26:10.457 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014277699999999999, 2024-04-19T04:26:10.457 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:10.457 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:10.457 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:10.457 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.457 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:10.457 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420797+0000", 2024-04-19T04:26:10.457 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.457 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.457 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.457 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:10.457 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420797+0000", 2024-04-19T04:26:10.457 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.457 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.457 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.458 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:10.458 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420796+0000", 2024-04-19T04:26:10.458 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:10.458 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.458 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.458 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:10.458 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420801+0000", 2024-04-19T04:26:10.458 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5349999999999998e-06 2024-04-19T04:26:10.458 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.458 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.458 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:10.458 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420809+0000", 2024-04-19T04:26:10.458 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9179999999999994e-06 2024-04-19T04:26:10.458 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.459 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.459 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.459 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420815+0000", 2024-04-19T04:26:10.459 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2539999999999998e-06 2024-04-19T04:26:10.459 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.459 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:10.459 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.459 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.459 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:187342 5.d 5.561e5b7d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T04:26:10.459 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:10.420952+0000", 2024-04-19T04:26:10.459 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9995136, 2024-04-19T04:26:10.459 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2835e-05, 2024-04-19T04:26:10.459 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:10.459 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:10.460 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:10.460 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:10.460 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.460 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 187342 2024-04-19T04:26:10.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.460 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:10.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.460 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:10.460 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420952+0000", 2024-04-19T04:26:10.460 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.460 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:10.461 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420952+0000", 2024-04-19T04:26:10.461 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.461 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.461 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.461 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:10.461 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420952+0000", 2024-04-19T04:26:10.461 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:10.461 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.461 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.461 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:10.461 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420957+0000", 2024-04-19T04:26:10.461 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9069999999999998e-06 2024-04-19T04:26:10.461 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.462 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.462 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:10.462 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420965+0000", 2024-04-19T04:26:10.462 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.8230000000000001e-06 2024-04-19T04:26:10.462 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.462 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.462 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.462 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420972+0000", 2024-04-19T04:26:10.462 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9609999999999999e-06 2024-04-19T04:26:10.462 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.462 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:10.462 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.462 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.462 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.463 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:187343 5.c 5.b45af67c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T04:26:10.463 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:10.421007+0000", 2024-04-19T04:26:10.463 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9994593, 2024-04-19T04:26:10.463 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5901000000000001e-05, 2024-04-19T04:26:10.463 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:10.463 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:10.463 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:10.463 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:10.463 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.463 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 187343 2024-04-19T04:26:10.463 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.463 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:10.463 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.463 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:10.464 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.421007+0000", 2024-04-19T04:26:10.464 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.464 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.464 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.464 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:10.464 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.421007+0000", 2024-04-19T04:26:10.464 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.464 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.464 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.464 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:10.464 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.421006+0000", 2024-04-19T04:26:10.464 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:10.465 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.465 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.465 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:10.466 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.421010+0000", 2024-04-19T04:26:10.466 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6950000000000002e-06 2024-04-19T04:26:10.466 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.466 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.466 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:10.466 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.421018+0000", 2024-04-19T04:26:10.466 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6869999999999994e-06 2024-04-19T04:26:10.466 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.466 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.466 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.466 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.421024+0000", 2024-04-19T04:26:10.466 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0750000000000003e-06 2024-04-19T04:26:10.466 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.467 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:10.467 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.467 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.467 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.467 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:187322 5.1 5:89076191:::benchmark_data_smithi007_19526_object61588:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T04:26:10.467 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:10.410059+0000", 2024-04-19T04:26:10.467 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.010406999, 2024-04-19T04:26:10.467 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011041864, 2024-04-19T04:26:10.467 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:10.467 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:10.467 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:10.467 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:10.467 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.467 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 187322 2024-04-19T04:26:10.468 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.468 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:10.468 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.468 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:10.468 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.410059+0000", 2024-04-19T04:26:10.468 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.468 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.468 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.468 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:10.468 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.410059+0000", 2024-04-19T04:26:10.468 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.468 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.468 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.468 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:10.468 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.410059+0000", 2024-04-19T04:26:10.468 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:10.469 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.469 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.469 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:10.469 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.410062+0000", 2024-04-19T04:26:10.469 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8109999999999999e-06 2024-04-19T04:26:10.469 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.469 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.469 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:10.469 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.410069+0000", 2024-04-19T04:26:10.469 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7570000000000004e-06 2024-04-19T04:26:10.469 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.469 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.469 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.469 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.410073+0000", 2024-04-19T04:26:10.470 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.45e-06 2024-04-19T04:26:10.470 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.470 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.470 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:10.470 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412243+0000", 2024-04-19T04:26:10.470 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0021700080000000002 2024-04-19T04:26:10.470 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.470 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.470 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:10.470 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412383+0000", 2024-04-19T04:26:10.470 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000140469 2024-04-19T04:26:10.470 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.470 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:10.470 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.471 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.471 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.471 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:187324 5.1 5:8eb7d80f:::benchmark_data_smithi007_19526_object61590:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T04:26:10.471 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:10.410643+0000", 2024-04-19T04:26:10.471 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0098229749999999994, 2024-04-19T04:26:10.471 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010525293, 2024-04-19T04:26:10.471 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:10.471 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:10.471 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:10.471 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:10.471 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.471 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 187324 2024-04-19T04:26:10.471 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.471 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:10.472 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.472 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:10.472 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.410643+0000", 2024-04-19T04:26:10.472 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.472 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.472 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.472 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:10.472 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.410643+0000", 2024-04-19T04:26:10.472 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.472 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.472 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.472 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:10.472 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.410642+0000", 2024-04-19T04:26:10.472 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:10.472 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.473 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.473 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:10.473 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.410647+0000", 2024-04-19T04:26:10.473 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.527e-06 2024-04-19T04:26:10.473 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.473 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.473 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:10.473 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.410662+0000", 2024-04-19T04:26:10.473 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4973e-05 2024-04-19T04:26:10.473 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.473 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.473 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.473 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.410667+0000", 2024-04-19T04:26:10.473 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6569999999999996e-06 2024-04-19T04:26:10.473 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.474 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.474 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:10.474 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.414221+0000", 2024-04-19T04:26:10.474 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0035546729999999999 2024-04-19T04:26:10.474 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.474 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.474 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:10.474 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.414442+0000", 2024-04-19T04:26:10.474 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00022068500000000001 2024-04-19T04:26:10.474 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.474 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:10.474 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.474 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.474 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.475 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:187326 5.9 5:9d7414f1:::benchmark_data_smithi007_19526_object61592:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T04:26:10.475 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:10.412507+0000", 2024-04-19T04:26:10.475 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0079588980000000007, 2024-04-19T04:26:10.475 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0087306950000000001, 2024-04-19T04:26:10.475 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:10.475 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:10.475 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:10.475 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:10.475 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.475 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 187326 2024-04-19T04:26:10.475 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.475 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:10.475 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.475 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:10.475 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412507+0000", 2024-04-19T04:26:10.476 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.476 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.476 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.476 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:10.476 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412507+0000", 2024-04-19T04:26:10.476 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.476 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.476 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.476 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:10.476 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412506+0000", 2024-04-19T04:26:10.476 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:10.476 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.476 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.476 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:10.476 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412511+0000", 2024-04-19T04:26:10.477 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7040000000000002e-06 2024-04-19T04:26:10.477 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.477 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.477 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:10.477 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412519+0000", 2024-04-19T04:26:10.477 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7980000000000006e-06 2024-04-19T04:26:10.477 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.477 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.477 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.477 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412524+0000", 2024-04-19T04:26:10.477 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8659999999999997e-06 2024-04-19T04:26:10.477 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.477 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.477 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:10.477 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.414209+0000", 2024-04-19T04:26:10.478 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001684961 2024-04-19T04:26:10.478 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.478 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.478 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:10.478 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.414389+0000", 2024-04-19T04:26:10.478 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00018035600000000001 2024-04-19T04:26:10.478 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.478 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.478 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:10.478 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.414523+0000", 2024-04-19T04:26:10.478 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000134036 2024-04-19T04:26:10.478 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.478 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.478 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:10.478 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.420344+0000", 2024-04-19T04:26:10.479 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0058210110000000001 2024-04-19T04:26:10.479 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.479 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:10.479 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.479 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.479 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.479 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:187327 5.9 5:976c586a:::benchmark_data_smithi007_19526_object61593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T04:26:10.479 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:10.412529+0000", 2024-04-19T04:26:10.479 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0079377809999999997, 2024-04-19T04:26:10.479 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0087908399999999994, 2024-04-19T04:26:10.479 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:10.479 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:10.479 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:10.479 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:10.479 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:10.479 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 187327 2024-04-19T04:26:10.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.480 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:10.480 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.480 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:10.480 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412529+0000", 2024-04-19T04:26:10.480 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.480 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.480 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:10.480 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412529+0000", 2024-04-19T04:26:10.480 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:10.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.480 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.480 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:10.480 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412528+0000", 2024-04-19T04:26:10.481 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:10.481 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.481 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.481 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:10.481 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412530+0000", 2024-04-19T04:26:10.481 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8870000000000001e-06 2024-04-19T04:26:10.481 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.481 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.481 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:10.481 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412533+0000", 2024-04-19T04:26:10.481 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.3019999999999999e-06 2024-04-19T04:26:10.481 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.481 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.482 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:10.482 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.412536+0000", 2024-04-19T04:26:10.482 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.7020000000000001e-06 2024-04-19T04:26:10.482 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.482 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.482 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:10.482 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.416858+0000", 2024-04-19T04:26:10.482 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0043221869999999999 2024-04-19T04:26:10.482 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.482 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.483 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:10.483 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.416976+0000", 2024-04-19T04:26:10.483 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011759700000000001 2024-04-19T04:26:10.483 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:10.483 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:10.483 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:10.483 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:10.417067+0000", 2024-04-19T04:26:10.483 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0944000000000002e-05 2024-04-19T04:26:10.483 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.483 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:10.483 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.483 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:10.483 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:10.483 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 15 2024-04-19T04:26:10.483 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:10.484 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:26:10.486 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:10.486 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:10.484+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:10.586 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:10.585+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:10.618 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:10.618 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:10.619 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:10.619 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:10.619 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:10.632 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:10.647 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:10.677 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:10.678 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:10.678 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:10.678 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:10.683 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:10.683 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:10.687 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:10.685+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:10.762 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:10.763 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:10.774 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:10.818 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:10.817+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:10.889 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:10.889+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:10.898 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:10.898 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:10.909 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:10.990 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:10.988+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:11.031 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:11.031 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:11.044 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:11.091 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:11.089+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:11.164 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:11.390 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:11.392 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:11.389+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:11.392 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:11.492 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:11.489+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:11.524 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:11.524 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:11.537 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:11.593 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:11.593+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:11.667 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:11.667 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:11.679 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:11.694 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:11.692+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:11.796 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:11.792+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:11.807 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:11.807 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:11.821 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:11.897 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:11.893+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:11.947 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:11.947 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:11.959 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:11.998 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:11.996+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:12.082 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:12.083 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:12.093 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:12.099 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:12.096+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:12.200 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:12.197+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:12.215 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:12.215 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:12.228 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:12.284 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T04:26:12.301 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:12.300+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:12.353 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:12.353 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:12.366 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:12.402 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:12.401+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:12.503 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:12.500+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:12.505 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:12.505 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:12.517 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:12.604 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:12.601+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:12.638 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:12.638 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:12.651 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:12.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:26:12.705 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:12.701+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:12.779 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:12.779 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:12.790 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:12.806 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:12.805+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:12.840 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:12.867 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:12.867 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:12.867 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:12.867 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:12.871 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:12.872 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:12.907 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:12.904+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:12.909 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:12.910 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:12.910 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:12.910 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:12.910 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:12.922 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:13.009 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:13.008+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:13.085 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:13.085 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:13.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:13.086 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:13.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.086 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:13.086 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:13.086 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 57.132834254999999, 2024-04-19T04:26:13.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:13.086 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.086 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:13.086 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.086 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.086 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.086 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:13.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.087 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:13.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:13.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:13.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:13.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:13.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:13.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:13.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:13.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:13.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:13.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:13.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:13.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:13.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:13.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:13.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:13.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:13.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:13.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:13.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:13.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:13.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:13.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:13.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:13.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:13.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:13.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:13.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:13.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:13.092 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.092 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.092 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.092 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:13.092 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:13.092 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 57.127772608999997, 2024-04-19T04:26:13.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:13.092 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.092 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:13.093 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.093 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.093 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.093 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:13.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.093 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:13.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:13.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:13.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:13.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:13.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:13.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:13.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:13.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:13.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:13.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:13.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:13.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:13.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:13.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:13.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:13.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:13.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:13.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:13.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:13.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:13.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:13.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:13.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:13.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:13.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:13.098 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.098 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.098 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.098 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:13.098 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:13.098 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 57.127672697000001, 2024-04-19T04:26:13.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:13.098 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.098 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:13.098 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.099 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.099 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.099 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:13.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.099 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:13.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:13.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:13.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:13.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:13.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:13.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:13.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:13.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:13.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:13.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:13.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:13.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:13.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:13.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:13.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:13.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:13.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:13.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:13.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:13.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:13.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:13.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:13.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:13.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:13.104 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.104 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.104 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.104 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:13.104 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:13.104 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 57.127546944000002, 2024-04-19T04:26:13.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:13.104 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.104 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:13.105 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.105 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.105 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.105 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:13.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.105 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:13.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:13.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:13.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:13.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:13.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:13.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:13.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:13.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:13.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:13.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:13.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:13.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:13.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:13.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:13.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:13.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:13.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:13.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:13.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:13.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:13.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:13.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:13.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:13.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:13.110 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.110 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.110 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.110 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:13.110 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:13.110 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 57.123702999000002, 2024-04-19T04:26:13.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:13.110 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.110 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.110 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.111 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.111 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.111 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:13.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.111 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:13.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:13.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:13.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:13.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:13.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:13.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:13.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:13.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:13.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:13.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:13.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:13.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:13.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:13.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:13.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:13.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:13.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:13.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:13.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:13.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:13.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:13.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:13.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:13.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:13.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:13.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:13.116 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.116 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.116 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.116 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:13.116 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:13.116 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 57.116531897999998, 2024-04-19T04:26:13.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:13.116 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.116 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:13.117 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.117 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.117 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.117 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:13.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.117 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:13.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:13.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:13.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:13.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:13.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:13.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:13.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:13.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:13.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:13.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:13.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:13.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:13.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:13.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:13.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:13.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:13.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:13.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:13.121 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.121 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.121 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.121 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:13.121 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:13.121 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 57.116359793999997, 2024-04-19T04:26:13.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:13.121 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.121 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:13.122 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.122 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.122 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.122 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:13.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.122 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:13.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:13.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:13.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:13.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:13.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:13.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:13.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:13.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:13.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:13.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:13.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:13.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:13.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:13.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:13.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:13.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:13.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:13.126 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.126 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.126 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.126 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:13.126 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:13.126 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 57.116296669, 2024-04-19T04:26:13.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:13.126 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.126 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.127 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.127 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.127 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.127 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:13.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.127 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:13.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:13.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:13.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:13.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:13.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:13.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:13.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:13.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:13.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:13.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:13.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:13.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:13.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:13.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:13.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:13.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:13.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:13.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:13.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:13.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:13.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:13.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:13.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:13.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:13.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:13.132 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.132 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.132 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.132 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:13.132 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:13.132 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 57.116168072000001, 2024-04-19T04:26:13.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:13.132 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.132 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.133 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.133 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.133 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.133 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:13.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.133 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:13.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:13.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:13.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:13.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:13.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:13.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:13.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:13.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:13.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:13.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:13.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:13.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:13.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:13.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:13.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:13.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:13.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:13.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:13.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:13.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:13.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:13.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:13.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 57.116100101000001, 2024-04-19T04:26:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:13.138 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.1965604360000004, 2024-04-19T04:26:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078453623, 2024-04-19T04:26:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.144 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:13.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965893+0000", 2024-04-19T04:26:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.076646455000000002 2024-04-19T04:26:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965956+0000", 2024-04-19T04:26:13.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3200000000000005e-05 2024-04-19T04:26:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966068+0000", 2024-04-19T04:26:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011194800000000001 2024-04-19T04:26:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.1965294390000007, 2024-04-19T04:26:13.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083782388999999999, 2024-04-19T04:26:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:13.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:13.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971179+0000", 2024-04-19T04:26:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079349476000000002 2024-04-19T04:26:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971259+0000", 2024-04-19T04:26:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9083000000000002e-05 2024-04-19T04:26:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971428+0000", 2024-04-19T04:26:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169419 2024-04-19T04:26:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.1942079190000001, 2024-04-19T04:26:13.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081686998999999996, 2024-04-19T04:26:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:13.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:13.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:13.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:13.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:13.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971454+0000", 2024-04-19T04:26:13.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077525997999999999 2024-04-19T04:26:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971540+0000", 2024-04-19T04:26:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6285000000000005e-05 2024-04-19T04:26:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971654+0000", 2024-04-19T04:26:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114095 2024-04-19T04:26:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.1929975370000001, 2024-04-19T04:26:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080734265999999999, 2024-04-19T04:26:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.161 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:13.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:13.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:13.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:13.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:13.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:13.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:13.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:13.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:13.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971677+0000", 2024-04-19T04:26:13.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.073192023999999994 2024-04-19T04:26:13.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:13.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971771+0000", 2024-04-19T04:26:13.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4235999999999997e-05 2024-04-19T04:26:13.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971912+0000", 2024-04-19T04:26:13.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014055099999999999 2024-04-19T04:26:13.166 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.166 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.166 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.166 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:13.166 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:13.166 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.1920460459999997, 2024-04-19T04:26:13.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085645857000000006, 2024-04-19T04:26:13.166 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.167 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.167 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.167 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.167 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.167 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:13.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.167 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:13.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:13.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:13.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:13.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:13.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:13.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:13.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:13.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:13.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:13.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:13.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:13.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:13.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:13.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977634+0000", 2024-04-19T04:26:13.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077144335999999994 2024-04-19T04:26:13.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:13.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977699+0000", 2024-04-19T04:26:13.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4518999999999997e-05 2024-04-19T04:26:13.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977775+0000", 2024-04-19T04:26:13.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6219999999999999e-05 2024-04-19T04:26:13.171 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.171 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.171 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.171 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:13.171 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:13.171 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.1890384679999997, 2024-04-19T04:26:13.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075403611999999995, 2024-04-19T04:26:13.172 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.172 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.172 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.172 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.172 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.172 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:13.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.172 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:13.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:13.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:13.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:13.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:13.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:13.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:13.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:13.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:13.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:13.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:13.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:13.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:13.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:13.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970369+0000", 2024-04-19T04:26:13.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.074967992999999997 2024-04-19T04:26:13.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:13.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970419+0000", 2024-04-19T04:26:13.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9700999999999997e-05 2024-04-19T04:26:13.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970540+0000", 2024-04-19T04:26:13.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121512 2024-04-19T04:26:13.177 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.177 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.177 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.177 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5:78f758ec:::benchmark_data_smithi007_19526_object48602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:13.177 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:13.177 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.1886643439999993, 2024-04-19T04:26:13.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085171609999999995, 2024-04-19T04:26:13.177 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.177 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.177 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.178 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.178 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.178 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:13.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.178 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:13.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:13.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:13.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:13.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:13.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:13.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:13.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:13.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:13.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966154+0000", 2024-04-19T04:26:13.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.070613543000000001 2024-04-19T04:26:13.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966382+0000", 2024-04-19T04:26:13.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022741800000000001 2024-04-19T04:26:13.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:13.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980581+0000", 2024-04-19T04:26:13.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014199916999999999 2024-04-19T04:26:13.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:13.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980621+0000", 2024-04-19T04:26:13.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9685999999999999e-05 2024-04-19T04:26:13.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980682+0000", 2024-04-19T04:26:13.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1130000000000006e-05 2024-04-19T04:26:13.182 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.182 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.182 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.182 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:13.182 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:13.182 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.1885743919999996, 2024-04-19T04:26:13.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075073230000000005, 2024-04-19T04:26:13.182 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.182 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.182 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.182 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.182 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.183 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:13.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.183 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:13.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:13.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:13.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:13.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:13.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:13.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:13.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:13.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:13.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:13.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:13.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:13.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:13.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:13.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970556+0000", 2024-04-19T04:26:13.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.072076192999999997 2024-04-19T04:26:13.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:13.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970608+0000", 2024-04-19T04:26:13.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2549000000000001e-05 2024-04-19T04:26:13.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970674+0000", 2024-04-19T04:26:13.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5549000000000005e-05 2024-04-19T04:26:13.187 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.187 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.187 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.188 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5:70a7bb5e:::benchmark_data_smithi007_19526_object48614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:13.188 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:13.188 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.1834873950000002, 2024-04-19T04:26:13.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080099220999999998, 2024-04-19T04:26:13.188 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.188 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.188 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.188 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.188 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.188 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:13.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.188 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:13.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:13.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:13.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:13.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:13.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:13.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:13.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:13.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:13.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:13.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971978+0000", 2024-04-19T04:26:13.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.071282358000000004 2024-04-19T04:26:13.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.972180+0000", 2024-04-19T04:26:13.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020191100000000001 2024-04-19T04:26:13.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:13.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980701+0000", 2024-04-19T04:26:13.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085211760000000001 2024-04-19T04:26:13.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:13.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980729+0000", 2024-04-19T04:26:13.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8068e-05 2024-04-19T04:26:13.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980787+0000", 2024-04-19T04:26:13.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7521e-05 2024-04-19T04:26:13.193 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.193 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.193 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.193 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174350 5.e 5:7f36609a:::benchmark_data_smithi007_19526_object48616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:13.193 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:13.193 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.1817163229999998, 2024-04-19T04:26:13.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079723622999999993, 2024-04-19T04:26:13.194 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.194 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.194 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.194 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.194 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.194 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174350 2024-04-19T04:26:13.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.194 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:13.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:13.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902458+0000", 2024-04-19T04:26:13.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902463+0000", 2024-04-19T04:26:13.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5889999999999996e-06 2024-04-19T04:26:13.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965576+0000", 2024-04-19T04:26:13.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063113328999999996 2024-04-19T04:26:13.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965614+0000", 2024-04-19T04:26:13.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8285999999999999e-05 2024-04-19T04:26:13.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974787+0000", 2024-04-19T04:26:13.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009172599 2024-04-19T04:26:13.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974999+0000", 2024-04-19T04:26:13.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021270999999999999 2024-04-19T04:26:13.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:13.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982086+0000", 2024-04-19T04:26:13.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070869160000000004 2024-04-19T04:26:13.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:13.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982115+0000", 2024-04-19T04:26:13.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8603999999999999e-05 2024-04-19T04:26:13.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:13.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982182+0000", 2024-04-19T04:26:13.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7350999999999999e-05 2024-04-19T04:26:13.199 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.199 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.199 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.199 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.199 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.199 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:13.201 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:13.197+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:13.201 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:13.246 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-04-19T04:26:13.302 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:13.301+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:13.328 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:13.328 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:13.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.329 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:194123 5.d 5:b4cd4e58:::benchmark_data_smithi007_19526_object68389:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:13.329 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:13.322812+0000", 2024-04-19T04:26:13.329 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0059208710000000003, 2024-04-19T04:26:13.329 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0059543299999999999, 2024-04-19T04:26:13.329 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.329 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:13.329 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.329 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.329 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.329 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 194123 2024-04-19T04:26:13.329 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.329 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.329 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.322812+0000", 2024-04-19T04:26:13.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.330 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.322812+0000", 2024-04-19T04:26:13.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.330 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.322811+0000", 2024-04-19T04:26:13.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.322816+0000", 2024-04-19T04:26:13.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.181e-06 2024-04-19T04:26:13.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.322830+0000", 2024-04-19T04:26:13.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.417e-05 2024-04-19T04:26:13.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.322838+0000", 2024-04-19T04:26:13.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4880000000000001e-06 2024-04-19T04:26:13.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.332 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.332 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.323076+0000", 2024-04-19T04:26:13.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00023816500000000001 2024-04-19T04:26:13.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.332 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.332 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.323155+0000", 2024-04-19T04:26:13.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8909e-05 2024-04-19T04:26:13.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.332 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:13.332 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.323228+0000", 2024-04-19T04:26:13.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2821e-05 2024-04-19T04:26:13.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.333 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327686+0000", 2024-04-19T04:26:13.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0044583239999999996 2024-04-19T04:26:13.333 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.333 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.333 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.333 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:194124 5.d 5:b5e4f0e6:::benchmark_data_smithi007_19526_object68390:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:13.333 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:13.322962+0000", 2024-04-19T04:26:13.333 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0057705400000000002, 2024-04-19T04:26:13.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0059251590000000002, 2024-04-19T04:26:13.333 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.334 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:13.334 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.334 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.334 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.334 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 194124 2024-04-19T04:26:13.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.334 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.322962+0000", 2024-04-19T04:26:13.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.322962+0000", 2024-04-19T04:26:13.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.322961+0000", 2024-04-19T04:26:13.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.322966+0000", 2024-04-19T04:26:13.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0379999999999999e-06 2024-04-19T04:26:13.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.322987+0000", 2024-04-19T04:26:13.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0803000000000001e-05 2024-04-19T04:26:13.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.323004+0000", 2024-04-19T04:26:13.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6608000000000001e-05 2024-04-19T04:26:13.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.337 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.337 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.325106+0000", 2024-04-19T04:26:13.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0021019939999999998 2024-04-19T04:26:13.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.337 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.337 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.325360+0000", 2024-04-19T04:26:13.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00025400599999999998 2024-04-19T04:26:13.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.337 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:13.338 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.325486+0000", 2024-04-19T04:26:13.338 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012656700000000001 2024-04-19T04:26:13.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.338 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.338 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327927+0000", 2024-04-19T04:26:13.338 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024403049999999998 2024-04-19T04:26:13.338 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.338 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.338 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.338 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:194132 5.c 5:3571a63e:::benchmark_data_smithi007_19526_object68398:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:13.338 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:13.327269+0000", 2024-04-19T04:26:13.339 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001463764, 2024-04-19T04:26:13.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001731699, 2024-04-19T04:26:13.339 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.339 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:13.339 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.339 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.339 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.339 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 194132 2024-04-19T04:26:13.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.339 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327269+0000", 2024-04-19T04:26:13.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327269+0000", 2024-04-19T04:26:13.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327268+0000", 2024-04-19T04:26:13.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327274+0000", 2024-04-19T04:26:13.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7969999999999997e-06 2024-04-19T04:26:13.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327288+0000", 2024-04-19T04:26:13.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3787e-05 2024-04-19T04:26:13.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327297+0000", 2024-04-19T04:26:13.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2669999999999995e-06 2024-04-19T04:26:13.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327367+0000", 2024-04-19T04:26:13.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0498000000000002e-05 2024-04-19T04:26:13.342 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.342 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.342 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.342 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327530+0000", 2024-04-19T04:26:13.342 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000162263 2024-04-19T04:26:13.342 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.342 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.342 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.342 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.342 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.342 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:194134 5.5 5:abe6bb1b:::benchmark_data_smithi007_19526_object68400:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:13.342 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:13.327534+0000", 2024-04-19T04:26:13.342 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0011982550000000001, 2024-04-19T04:26:13.342 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001563456, 2024-04-19T04:26:13.343 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.343 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:13.343 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.343 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.343 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.343 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 194134 2024-04-19T04:26:13.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.343 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.343 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.343 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327534+0000", 2024-04-19T04:26:13.343 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.344 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.344 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327534+0000", 2024-04-19T04:26:13.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.344 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.344 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327534+0000", 2024-04-19T04:26:13.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.344 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.344 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327539+0000", 2024-04-19T04:26:13.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.288e-06 2024-04-19T04:26:13.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.345 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.345 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327550+0000", 2024-04-19T04:26:13.345 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1031e-05 2024-04-19T04:26:13.345 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.345 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.345 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327558+0000", 2024-04-19T04:26:13.345 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7249999999999997e-06 2024-04-19T04:26:13.345 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.345 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.345 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327721+0000", 2024-04-19T04:26:13.345 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016382500000000001 2024-04-19T04:26:13.345 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.346 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.346 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327880+0000", 2024-04-19T04:26:13.346 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015881200000000001 2024-04-19T04:26:13.346 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.346 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.346 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.346 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:194135 5.6 5:61b713c8:::benchmark_data_smithi007_19526_object68401:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:13.346 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:13.327607+0000", 2024-04-19T04:26:13.346 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001125912, 2024-04-19T04:26:13.346 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001584273, 2024-04-19T04:26:13.346 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.347 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:13.347 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.347 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.347 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.347 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 194135 2024-04-19T04:26:13.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.347 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327607+0000", 2024-04-19T04:26:13.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327607+0000", 2024-04-19T04:26:13.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.348 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.348 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.348 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327606+0000", 2024-04-19T04:26:13.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.348 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.348 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.348 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327611+0000", 2024-04-19T04:26:13.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9269999999999996e-06 2024-04-19T04:26:13.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.348 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.348 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.349 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327622+0000", 2024-04-19T04:26:13.349 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0981e-05 2024-04-19T04:26:13.349 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.349 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.349 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327631+0000", 2024-04-19T04:26:13.349 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7139999999999999e-06 2024-04-19T04:26:13.349 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.349 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.349 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327698+0000", 2024-04-19T04:26:13.349 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7178e-05 2024-04-19T04:26:13.349 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.350 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.350 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327907+0000", 2024-04-19T04:26:13.350 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00020966 2024-04-19T04:26:13.350 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.350 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.350 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.350 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.350 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.350 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:194136 5.7 5:e6ff7cbb:::benchmark_data_smithi007_19526_object68402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:13.350 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:13.327649+0000", 2024-04-19T04:26:13.350 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0010836660000000001, 2024-04-19T04:26:13.350 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001634574, 2024-04-19T04:26:13.350 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.350 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:13.351 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.351 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.351 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.351 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 194136 2024-04-19T04:26:13.351 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.351 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.351 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.351 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.351 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327649+0000", 2024-04-19T04:26:13.351 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.351 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.351 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.351 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.351 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327649+0000", 2024-04-19T04:26:13.352 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.352 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.352 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.352 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.352 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327648+0000", 2024-04-19T04:26:13.352 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.352 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.352 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.352 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.352 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327652+0000", 2024-04-19T04:26:13.352 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.065e-06 2024-04-19T04:26:13.352 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.352 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.352 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.352 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327662+0000", 2024-04-19T04:26:13.353 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.4259999999999992e-06 2024-04-19T04:26:13.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.353 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.353 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327668+0000", 2024-04-19T04:26:13.353 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.635e-06 2024-04-19T04:26:13.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.353 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.353 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327799+0000", 2024-04-19T04:26:13.353 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013060599999999999 2024-04-19T04:26:13.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.353 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.354 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327958+0000", 2024-04-19T04:26:13.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158579 2024-04-19T04:26:13.354 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.354 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.354 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.354 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:194137 5.7 5.57ec4a27 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:13.354 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:13.327780+0000", 2024-04-19T04:26:13.354 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00095286800000000005, 2024-04-19T04:26:13.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015923300000000001, 2024-04-19T04:26:13.354 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.354 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:13.354 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.355 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.355 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.355 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 194137 2024-04-19T04:26:13.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.355 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327780+0000", 2024-04-19T04:26:13.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327780+0000", 2024-04-19T04:26:13.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.356 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327779+0000", 2024-04-19T04:26:13.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327785+0000", 2024-04-19T04:26:13.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1430000000000003e-06 2024-04-19T04:26:13.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.357 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327795+0000", 2024-04-19T04:26:13.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9899999999999992e-06 2024-04-19T04:26:13.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.357 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:13.327802+0000", 2024-04-19T04:26:13.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3019999999999997e-06 2024-04-19T04:26:13.357 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.358 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.358 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.358 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.358 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:13.358 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 7 2024-04-19T04:26:13.358 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:13.359 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:13.402 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:13.401+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:13.495 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:13.495 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:13.495 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:13.495 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:13.495 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:13.503 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:13.500+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:13.507 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:13.604 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:13.601+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:13.643 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:13.643 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:13.643 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:13.643 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:13.643 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.643 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:13.643 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:13.643 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 79.407422850000003, 2024-04-19T04:26:13.643 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:13.643 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.643 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.643 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.644 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.644 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.644 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:13.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.644 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:13.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:13.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:13.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:13.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:13.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:13.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:13.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:13.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:13.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:13.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:13.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:13.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:13.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.647 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:13.647 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:13.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:13.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.647 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.647 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:13.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:13.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.647 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:13.647 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:13.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:13.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.648 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.648 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:13.648 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:13.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:13.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.648 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.648 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.648 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:13.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:13.648 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.648 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.648 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.649 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:13.649 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:13.649 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 79.403327929, 2024-04-19T04:26:13.649 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:13.649 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.649 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.649 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.649 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.649 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.649 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:13.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.649 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.649 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:13.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:13.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:13.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:13.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:13.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:13.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:13.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:13.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:13.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.652 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:13.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:13.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.652 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:13.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:13.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:13.652 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:13.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:13.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:13.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:13.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:13.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:13.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:13.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:13.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:13.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:13.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.654 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:13.654 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:13.654 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.654 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.654 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.654 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:13.654 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:13.654 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 79.400036744000005, 2024-04-19T04:26:13.654 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:13.654 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.654 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.654 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.655 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.655 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.655 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:13.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.655 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:13.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:13.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:13.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:13.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:13.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:13.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:13.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:13.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:13.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:13.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:13.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:13.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:13.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:13.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:13.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:13.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:13.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:13.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:13.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:13.659 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.659 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.659 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.660 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:13.660 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:13.660 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 57.682647279000001, 2024-04-19T04:26:13.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:13.660 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.660 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:13.660 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.660 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.660 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.660 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:13.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.660 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:13.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:13.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:13.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.662 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:13.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:13.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.662 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.662 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:13.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:13.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.662 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.662 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:13.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:13.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:13.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:13.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:13.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:13.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:13.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:13.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:13.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:13.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:13.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:13.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:13.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:13.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:13.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:13.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:13.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:13.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:13.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:13.665 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.665 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.665 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.665 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:13.666 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:13.666 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 57.662416829999998, 2024-04-19T04:26:13.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:13.666 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.666 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:13.666 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.666 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.666 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.666 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:13.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.666 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:13.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:13.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:13.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:13.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:13.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:13.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:13.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:13.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:13.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:13.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:13.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:13.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:13.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:13.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:13.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:13.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:13.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:13.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:13.669 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.670 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.670 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.670 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:13.670 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:13.670 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 57.662308973000002, 2024-04-19T04:26:13.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:13.670 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.670 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:13.670 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.670 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.670 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.670 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:13.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.671 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:13.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:13.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:13.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:13.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:13.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:13.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:13.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:13.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:13.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:13.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:13.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:13.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:13.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:13.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:13.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:13.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.674 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.674 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:13.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:13.674 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.674 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.674 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.674 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:13.674 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:13.674 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 57.660342284000002, 2024-04-19T04:26:13.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:13.675 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.675 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.675 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.675 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.675 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.675 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:13.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.675 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:13.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:13.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:13.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:13.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:13.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:13.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:13.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:13.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:13.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:13.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:13.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:13.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:13.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:13.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:13.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:13.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:13.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:13.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:13.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:13.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:13.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:13.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:13.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:13.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:13.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:13.679 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.680 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.680 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.680 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:13.680 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:13.680 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 57.656978088999999, 2024-04-19T04:26:13.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:13.680 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.680 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.680 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.680 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.680 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.680 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:13.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.681 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:13.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:13.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:13.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:13.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:13.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:13.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:13.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:13.683 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:13.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.683 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:13.683 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:13.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:13.683 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:13.683 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:13.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.684 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:13.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:13.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:13.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:13.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:13.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:13.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:13.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:13.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:13.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.686 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:13.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:13.686 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.686 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.686 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.686 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:13.686 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:13.686 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 57.653167111000002, 2024-04-19T04:26:13.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:13.686 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.686 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.687 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.687 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.687 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.687 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:13.687 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.687 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.687 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.687 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.687 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:13.687 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.687 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.687 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.687 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.687 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:13.687 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:13.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:13.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:13.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:13.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:13.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:13.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:13.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:13.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:13.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:13.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:13.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:13.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.690 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:13.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:13.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.690 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:13.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:13.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.690 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:13.691 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:13.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.691 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.691 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:13.691 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:13.691 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:13.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.691 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.691 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.691 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:13.691 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:13.691 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.691 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.691 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.692 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.692 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:13.692 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:13.692 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 44.411304754, 2024-04-19T04:26:13.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:13.692 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.692 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.692 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.692 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.692 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.692 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:13.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.692 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.692 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.692 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.692 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:13.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.693 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.693 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:13.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.693 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.693 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:13.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.693 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.693 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:13.694 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:13.694 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.694 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.694 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.694 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:13.694 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:13.694 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.694 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.694 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.694 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:13.694 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:13.694 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.695 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.695 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:13.695 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:13.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.695 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.695 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:13.695 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:13.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.695 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.695 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:13.695 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:13.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:13.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:13.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:13.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:13.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:13.696 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.696 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.696 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.697 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:13.697 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:13.697 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 44.410710473999998, 2024-04-19T04:26:13.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:13.697 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.697 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.697 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.697 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.697 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.697 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:13.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.697 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:13.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.698 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.698 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.698 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:13.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.698 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.698 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.698 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:13.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.698 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.698 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.699 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:13.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:13.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.699 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.699 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:13.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:13.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.699 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.699 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:13.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:13.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.699 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.700 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:13.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:13.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.700 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.700 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:13.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:13.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.700 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:13.700 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:13.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:13.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.700 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:13.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:13.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:13.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:13.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:13.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:13.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:13.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:13.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:13.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:13.702 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.702 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.702 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.702 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:13.702 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:13.702 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.6860633160000003, 2024-04-19T04:26:13.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:13.702 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.702 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.702 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.703 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.703 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.703 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:13.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.703 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:13.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:13.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.704 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.704 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:13.704 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.704 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.704 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.704 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.704 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:13.704 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:13.704 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.704 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.704 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.704 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:13.704 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:13.704 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.704 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.705 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.705 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:13.705 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:13.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.705 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.705 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:13.705 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:13.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.705 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.705 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:13.705 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:13.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:13.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:13.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:13.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:13.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:13.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:13.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:13.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:13.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.707 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:13.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:13.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:13.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.707 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:13.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:13.707 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.707 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.707 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.707 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:13.708 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:13.708 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.6860228999999993, 2024-04-19T04:26:13.708 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:13.708 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.708 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.708 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.708 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.708 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.708 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:13.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.708 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.708 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.708 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.708 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:13.708 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.709 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.709 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.709 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:13.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.709 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.709 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.709 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:13.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.709 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.709 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.709 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:13.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:13.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.710 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.710 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:13.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:13.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.710 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.710 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:13.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:13.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.710 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.710 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:13.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:13.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:13.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:13.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:13.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:13.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:13.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:13.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:13.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:13.712 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:13.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:13.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:13.712 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:13.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:13.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.712 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:13.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:13.712 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.713 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.713 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.713 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.713 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:13.713 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:13.713 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.6823265910000007, 2024-04-19T04:26:13.713 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:13.713 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.713 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.713 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.713 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.713 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.713 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:13.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.714 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.714 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.714 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.714 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:13.714 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.714 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.714 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.714 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:13.714 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.714 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.714 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.714 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:13.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:13.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:13.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:13.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:13.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:13.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:13.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:13.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:13.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:13.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:13.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:13.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:13.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:13.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:13.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:13.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:13.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:13.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:13.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:13.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:13.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:13.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.718 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.718 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:13.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:13.718 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.718 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.718 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.718 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:13.718 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:13.718 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.4287161170000005, 2024-04-19T04:26:13.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:13.718 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.718 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.719 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.719 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.719 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.719 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:13.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.719 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.719 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.719 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:13.719 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.719 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.719 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:13.719 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:13.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:13.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:13.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:13.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:13.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:13.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:13.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:13.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:13.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:13.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:13.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.722 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.722 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:13.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:13.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.722 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:13.722 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:13.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:13.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.722 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.722 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:13.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:13.723 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.723 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.723 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.723 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:13.723 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:13.723 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.4264227050000002, 2024-04-19T04:26:13.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:13.723 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.723 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.723 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.723 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.723 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.724 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:13.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.724 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:13.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:13.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:13.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:13.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:13.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:13.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:13.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:13.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:13.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.726 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:13.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:13.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.726 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:13.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:13.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:13.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:13.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:13.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:13.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:13.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:13.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:13.727 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.727 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.728 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.728 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:13.728 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:13.728 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.4263768890000001, 2024-04-19T04:26:13.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:13.728 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.728 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.728 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.728 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.728 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.728 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:13.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.728 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:13.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:13.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:13.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.730 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:13.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:13.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.730 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:13.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:13.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.730 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:13.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:13.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.731 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.731 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:13.731 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:13.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.731 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.731 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.731 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:13.731 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:13.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.731 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.731 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.731 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:13.731 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:13.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.731 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:13.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:13.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:13.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:13.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:13.732 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.732 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.732 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.732 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174342 5.9 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:13.732 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:13.733 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.7412201889999999, 2024-04-19T04:26:13.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068615152999999998, 2024-04-19T04:26:13.733 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.733 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.733 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.733 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.733 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.733 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174342 2024-04-19T04:26:13.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.733 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:13.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:13.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897726+0000", 2024-04-19T04:26:13.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897731+0000", 2024-04-19T04:26:13.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1449999999999999e-06 2024-04-19T04:26:13.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897744+0000", 2024-04-19T04:26:13.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2833000000000001e-05 2024-04-19T04:26:13.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897749+0000", 2024-04-19T04:26:13.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1540000000000001e-06 2024-04-19T04:26:13.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897810+0000", 2024-04-19T04:26:13.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0724999999999999e-05 2024-04-19T04:26:13.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897920+0000", 2024-04-19T04:26:13.736 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011024 2024-04-19T04:26:13.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:13.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897993+0000", 2024-04-19T04:26:13.736 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2335000000000005e-05 2024-04-19T04:26:13.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.737 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.899597+0000", 2024-04-19T04:26:13.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016048919999999999 2024-04-19T04:26:13.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:13.737 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966230+0000", 2024-04-19T04:26:13.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.066632882000000004 2024-04-19T04:26:13.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:13.737 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966296+0000", 2024-04-19T04:26:13.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5361e-05 2024-04-19T04:26:13.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.738 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.738 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.738 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966342+0000", 2024-04-19T04:26:13.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6476e-05 2024-04-19T04:26:13.738 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.738 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.738 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.738 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.738 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174344 5.d 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:13.738 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:13.738 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.7405413509999992, 2024-04-19T04:26:13.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068211329000000001, 2024-04-19T04:26:13.738 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.738 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.739 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.739 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.739 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.739 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174344 2024-04-19T04:26:13.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.739 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.739 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.739 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:13.739 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.739 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.739 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:13.740 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.740 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.740 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.740 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898405+0000", 2024-04-19T04:26:13.740 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.740 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.740 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.740 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898409+0000", 2024-04-19T04:26:13.740 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5149999999999998e-06 2024-04-19T04:26:13.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.740 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.740 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.740 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898415+0000", 2024-04-19T04:26:13.741 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:26:13.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898419+0000", 2024-04-19T04:26:13.741 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.89e-06 2024-04-19T04:26:13.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898459+0000", 2024-04-19T04:26:13.741 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0017e-05 2024-04-19T04:26:13.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898540+0000", 2024-04-19T04:26:13.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1237999999999997e-05 2024-04-19T04:26:13.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:13.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:13.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6060000000000001e-05 2024-04-19T04:26:13.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.901321+0000", 2024-04-19T04:26:13.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027152109999999999 2024-04-19T04:26:13.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:13.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966512+0000", 2024-04-19T04:26:13.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.065190440000000002 2024-04-19T04:26:13.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.743 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:13.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966563+0000", 2024-04-19T04:26:13.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1436e-05 2024-04-19T04:26:13.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.743 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966617+0000", 2024-04-19T04:26:13.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.401e-05 2024-04-19T04:26:13.743 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.743 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.743 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.744 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.744 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174346 5.f 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:13.744 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:13.744 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 8.7387551240000008, 2024-04-19T04:26:13.744 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.067185536000000004, 2024-04-19T04:26:13.744 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:13.744 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:13.744 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:13.744 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:13.744 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.744 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174346 2024-04-19T04:26:13.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.744 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:13.744 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.745 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:13.745 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:13.745 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.745 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.745 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.745 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:13.745 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:13.745 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:13.745 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.745 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.745 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:13.745 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900191+0000", 2024-04-19T04:26:13.745 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.745 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.745 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.746 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:13.746 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900196+0000", 2024-04-19T04:26:13.746 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3329999999999998e-06 2024-04-19T04:26:13.746 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.746 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.746 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:13.746 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900206+0000", 2024-04-19T04:26:13.746 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9699999999999994e-06 2024-04-19T04:26:13.746 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.746 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.746 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.746 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900210+0000", 2024-04-19T04:26:13.746 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3359999999999997e-06 2024-04-19T04:26:13.746 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.747 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.747 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:13.747 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900243+0000", 2024-04-19T04:26:13.747 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2669999999999997e-05 2024-04-19T04:26:13.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.747 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.747 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:13.747 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900365+0000", 2024-04-19T04:26:13.747 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122648 2024-04-19T04:26:13.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.747 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.747 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:13.747 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900559+0000", 2024-04-19T04:26:13.747 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019358799999999999 2024-04-19T04:26:13.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.748 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.748 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:13.748 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.903018+0000", 2024-04-19T04:26:13.748 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024592300000000002 2024-04-19T04:26:13.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.748 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.748 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:13.748 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967180+0000", 2024-04-19T04:26:13.748 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.064161587000000006 2024-04-19T04:26:13.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.748 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.748 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:13.748 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967293+0000", 2024-04-19T04:26:13.748 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112921 2024-04-19T04:26:13.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:13.749 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:13.749 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:13.749 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967378+0000", 2024-04-19T04:26:13.749 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5000999999999995e-05 2024-04-19T04:26:13.749 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.749 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.749 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.749 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:13.749 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:13.749 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:13.751 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:13.751 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:13.749+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:13.851 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:13.848+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:13.875 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:195410 5.0 5:0109911f:::benchmark_data_smithi007_19526_object69676:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:13.871761+0000", 2024-04-19T04:26:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0037844390000000001, 2024-04-19T04:26:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038022809999999998, 2024-04-19T04:26:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 195410 2024-04-19T04:26:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.871761+0000", 2024-04-19T04:26:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.871761+0000", 2024-04-19T04:26:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.871760+0000", 2024-04-19T04:26:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.871765+0000", 2024-04-19T04:26:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9529999999999998e-06 2024-04-19T04:26:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.871778+0000", 2024-04-19T04:26:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3175e-05 2024-04-19T04:26:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.871785+0000", 2024-04-19T04:26:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0369999999999997e-06 2024-04-19T04:26:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.871815+0000", 2024-04-19T04:26:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9274000000000001e-05 2024-04-19T04:26:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.871902+0000", 2024-04-19T04:26:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7362999999999997e-05 2024-04-19T04:26:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:195412 5.4 5:21a14b24:::benchmark_data_smithi007_19526_object69678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:13.871874+0000", 2024-04-19T04:26:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0036719729999999998, 2024-04-19T04:26:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037312170000000002, 2024-04-19T04:26:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 195412 2024-04-19T04:26:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.871874+0000", 2024-04-19T04:26:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.871874+0000", 2024-04-19T04:26:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.871873+0000", 2024-04-19T04:26:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.871876+0000", 2024-04-19T04:26:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1599999999999998e-06 2024-04-19T04:26:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.871883+0000", 2024-04-19T04:26:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8249999999999999e-06 2024-04-19T04:26:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.871888+0000", 2024-04-19T04:26:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4550000000000003e-06 2024-04-19T04:26:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.871930+0000", 2024-04-19T04:26:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1668999999999997e-05 2024-04-19T04:26:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.872004+0000", 2024-04-19T04:26:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3535000000000007e-05 2024-04-19T04:26:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:195409 5.9 e58/20 5:90bb426a:::benchmark_data_smithi007_19526_object69675:head v 58'12559, mlcod=58'12557)", 2024-04-19T04:26:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:13.872101+0000", 2024-04-19T04:26:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0034442850000000001, 2024-04-19T04:26:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035384399999999999, 2024-04-19T04:26:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.872101+0000", 2024-04-19T04:26:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.872101+0000", 2024-04-19T04:26:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.872101+0000", 2024-04-19T04:26:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.872106+0000", 2024-04-19T04:26:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5110000000000003e-06 2024-04-19T04:26:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.872113+0000", 2024-04-19T04:26:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.007e-06 2024-04-19T04:26:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.872118+0000", 2024-04-19T04:26:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7910000000000004e-06 2024-04-19T04:26:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.872164+0000", 2024-04-19T04:26:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5670999999999997e-05 2024-04-19T04:26:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.872183+0000", 2024-04-19T04:26:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8904999999999999e-05 2024-04-19T04:26:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:195413 5.4 5:224d43bf:::benchmark_data_smithi007_19526_object69679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:13.874384+0000", 2024-04-19T04:26:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0011615460000000001, 2024-04-19T04:26:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012861859999999999, 2024-04-19T04:26:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 195413 2024-04-19T04:26:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874384+0000", 2024-04-19T04:26:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874384+0000", 2024-04-19T04:26:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874383+0000", 2024-04-19T04:26:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874388+0000", 2024-04-19T04:26:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7480000000000001e-06 2024-04-19T04:26:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874397+0000", 2024-04-19T04:26:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0620000000000007e-06 2024-04-19T04:26:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874402+0000", 2024-04-19T04:26:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1699999999999996e-06 2024-04-19T04:26:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874457+0000", 2024-04-19T04:26:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4409e-05 2024-04-19T04:26:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874553+0000", 2024-04-19T04:26:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6401000000000001e-05 2024-04-19T04:26:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:195417 5.8 5:123a1fd4:::benchmark_data_smithi007_19526_object69683:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:13.874418+0000", 2024-04-19T04:26:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001127982, 2024-04-19T04:26:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012867530000000001, 2024-04-19T04:26:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 195417 2024-04-19T04:26:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874418+0000", 2024-04-19T04:26:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874418+0000", 2024-04-19T04:26:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874417+0000", 2024-04-19T04:26:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874420+0000", 2024-04-19T04:26:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.604e-06 2024-04-19T04:26:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874426+0000", 2024-04-19T04:26:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1489999999999999e-06 2024-04-19T04:26:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874429+0000", 2024-04-19T04:26:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4939999999999999e-06 2024-04-19T04:26:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874457+0000", 2024-04-19T04:26:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7222000000000001e-05 2024-04-19T04:26:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874544+0000", 2024-04-19T04:26:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6855999999999996e-05 2024-04-19T04:26:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:195421 5.8 5.5bc33c88 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:13.874678+0000", 2024-04-19T04:26:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00086759499999999998, 2024-04-19T04:26:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010578, 2024-04-19T04:26:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 195421 2024-04-19T04:26:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874678+0000", 2024-04-19T04:26:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874678+0000", 2024-04-19T04:26:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874677+0000", 2024-04-19T04:26:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874680+0000", 2024-04-19T04:26:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7199999999999998e-06 2024-04-19T04:26:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874684+0000", 2024-04-19T04:26:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.211e-06 2024-04-19T04:26:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.874687+0000", 2024-04-19T04:26:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0259999999999999e-06 2024-04-19T04:26:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:195407 5.b 5:d606c3dd:::benchmark_data_smithi007_19526_object69673:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:13.870443+0000", 2024-04-19T04:26:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0051028039999999998, 2024-04-19T04:26:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053239230000000004, 2024-04-19T04:26:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 195407 2024-04-19T04:26:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.870443+0000", 2024-04-19T04:26:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.870443+0000", 2024-04-19T04:26:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.870442+0000", 2024-04-19T04:26:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.870447+0000", 2024-04-19T04:26:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.023e-06 2024-04-19T04:26:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.870458+0000", 2024-04-19T04:26:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1089e-05 2024-04-19T04:26:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.870464+0000", 2024-04-19T04:26:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7250000000000002e-06 2024-04-19T04:26:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.870503+0000", 2024-04-19T04:26:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8915000000000003e-05 2024-04-19T04:26:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:13.870586+0000", 2024-04-19T04:26:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3095000000000003e-05 2024-04-19T04:26:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:26:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 7 2024-04-19T04:26:13.902 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:13.903 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:13.952 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:13.952+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:14.030 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:14.031 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:14.031 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:14.031 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:14.031 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:14.046 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:14.090 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:14.089+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:14.154 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:14.153+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:14.172 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:14.172 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:14.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:14.172 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 58.219515762999997, 2024-04-19T04:26:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 58.214454117000002, 2024-04-19T04:26:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 58.214354204999999, 2024-04-19T04:26:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:14.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:14.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:14.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:14.190 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.190 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 58.214228452, 2024-04-19T04:26:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:14.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:14.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:14.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:14.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:14.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:14.197 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.197 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.197 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.198 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:14.198 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:14.198 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 58.210384507000001, 2024-04-19T04:26:14.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:14.198 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.198 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.198 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.199 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.199 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.199 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:14.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.199 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:14.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:14.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:14.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:14.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:14.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:14.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:14.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:14.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:14.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:14.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:14.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:14.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:14.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:14.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:14.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:14.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:14.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:14.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:14.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:14.203 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.204 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.204 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.204 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:14.204 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:14.204 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 58.203213406000003, 2024-04-19T04:26:14.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:14.204 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.204 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:14.204 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.204 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.204 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.205 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:14.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.205 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:14.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:14.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:14.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:14.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:14.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:14.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:14.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:14.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:14.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:14.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:14.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:14.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:14.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:14.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:14.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:14.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:14.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:14.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:14.208 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.208 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.208 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.209 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:14.209 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:14.209 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 58.203041302000003, 2024-04-19T04:26:14.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:14.209 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.209 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:14.209 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.209 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.209 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.209 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:14.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.209 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:14.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:14.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:14.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:14.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:14.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:14.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:14.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:14.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:14.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:14.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:14.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:14.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:14.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:14.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:14.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:14.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:14.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:14.215 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.215 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.215 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.215 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:14.215 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:14.215 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 58.202978176999999, 2024-04-19T04:26:14.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:14.215 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.215 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.215 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.215 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.216 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.216 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:14.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.216 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:14.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:14.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:14.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:14.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:14.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:14.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:14.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:14.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:14.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:14.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:14.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:14.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:14.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:14.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:14.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:14.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:14.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:14.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:14.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:14.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:14.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:14.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:14.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:14.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:14.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:14.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:14.221 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.221 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.221 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.221 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:14.221 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:14.221 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 58.202849579999999, 2024-04-19T04:26:14.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:14.222 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.222 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.222 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.222 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.222 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.222 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:14.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.222 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.222 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.222 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:14.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:14.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:14.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:14.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:14.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:14.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:14.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:14.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:14.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:14.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:14.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:14.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:14.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:14.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:14.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:14.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:14.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:14.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:14.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:14.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:14.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:14.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:14.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:14.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:14.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:14.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:14.228 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.228 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.228 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.228 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:14.228 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:14.229 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 58.202781608999999, 2024-04-19T04:26:14.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:14.229 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.229 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.229 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.229 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.229 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.229 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:14.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.229 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:14.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:14.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:14.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:14.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:14.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:14.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:14.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:14.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:14.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:14.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:14.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:14.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:14.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:14.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:14.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:14.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:14.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:14.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:14.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:14.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:14.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:14.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:14.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:14.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:14.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:14.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:14.234 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.234 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.234 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.234 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:14.234 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:14.234 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.2832419440000002, 2024-04-19T04:26:14.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078453623, 2024-04-19T04:26:14.235 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.235 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.235 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.235 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.235 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.235 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:14.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.235 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:14.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:14.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:14.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:14.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:14.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:14.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:14.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:14.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:14.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:14.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:14.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:14.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:14.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:14.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:14.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965893+0000", 2024-04-19T04:26:14.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.076646455000000002 2024-04-19T04:26:14.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:14.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965956+0000", 2024-04-19T04:26:14.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3200000000000005e-05 2024-04-19T04:26:14.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966068+0000", 2024-04-19T04:26:14.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011194800000000001 2024-04-19T04:26:14.239 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.239 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.239 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.239 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:14.239 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:14.240 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.2832109470000006, 2024-04-19T04:26:14.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083782388999999999, 2024-04-19T04:26:14.240 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.240 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.240 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.240 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.240 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.240 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:14.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.240 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:14.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:14.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:14.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:14.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:14.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:14.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:14.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:14.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:14.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:14.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:14.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:14.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:14.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:14.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:14.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971179+0000", 2024-04-19T04:26:14.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079349476000000002 2024-04-19T04:26:14.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:14.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971259+0000", 2024-04-19T04:26:14.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9083000000000002e-05 2024-04-19T04:26:14.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971428+0000", 2024-04-19T04:26:14.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169419 2024-04-19T04:26:14.244 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.244 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.244 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.245 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:14.245 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:14.245 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.280889427, 2024-04-19T04:26:14.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081686998999999996, 2024-04-19T04:26:14.245 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.245 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.245 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.245 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.245 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.245 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:14.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.245 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:14.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:14.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:14.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:14.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:14.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:14.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:14.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:14.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:14.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:14.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:14.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:14.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:14.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:14.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:14.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971454+0000", 2024-04-19T04:26:14.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077525997999999999 2024-04-19T04:26:14.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:14.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971540+0000", 2024-04-19T04:26:14.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6285000000000005e-05 2024-04-19T04:26:14.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971654+0000", 2024-04-19T04:26:14.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114095 2024-04-19T04:26:14.251 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.251 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.251 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.252 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:14.252 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:14.252 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.279679045, 2024-04-19T04:26:14.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080734265999999999, 2024-04-19T04:26:14.252 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.252 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.252 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.252 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.252 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.252 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:14.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.252 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:14.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:14.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:14.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:14.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:14.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:14.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:14.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:14.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:14.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:14.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:14.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:14.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:14.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:14.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:14.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971677+0000", 2024-04-19T04:26:14.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.073192023999999994 2024-04-19T04:26:14.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:14.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971771+0000", 2024-04-19T04:26:14.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4235999999999997e-05 2024-04-19T04:26:14.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971912+0000", 2024-04-19T04:26:14.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014055099999999999 2024-04-19T04:26:14.256 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.256 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.256 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.257 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:14.257 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:14.257 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.2787275539999996, 2024-04-19T04:26:14.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085645857000000006, 2024-04-19T04:26:14.257 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.257 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.257 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.257 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.257 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.257 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:14.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.257 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:14.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:14.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:14.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:14.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:14.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:14.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:14.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:14.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:14.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:14.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:14.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:14.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:14.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:14.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:14.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977634+0000", 2024-04-19T04:26:14.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077144335999999994 2024-04-19T04:26:14.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:14.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977699+0000", 2024-04-19T04:26:14.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4518999999999997e-05 2024-04-19T04:26:14.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977775+0000", 2024-04-19T04:26:14.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6219999999999999e-05 2024-04-19T04:26:14.261 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.261 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.262 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.262 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:14.262 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:14.262 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.2757199759999995, 2024-04-19T04:26:14.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075403611999999995, 2024-04-19T04:26:14.262 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.262 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.262 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.262 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.263 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.263 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:14.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.263 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:14.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:14.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:14.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:14.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:14.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:14.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:14.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:14.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:14.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:14.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:14.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:14.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:14.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:14.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:14.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970369+0000", 2024-04-19T04:26:14.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.074967992999999997 2024-04-19T04:26:14.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:14.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970419+0000", 2024-04-19T04:26:14.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9700999999999997e-05 2024-04-19T04:26:14.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970540+0000", 2024-04-19T04:26:14.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121512 2024-04-19T04:26:14.267 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.267 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.267 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.267 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5:78f758ec:::benchmark_data_smithi007_19526_object48602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:14.267 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:14.267 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.2753458519999992, 2024-04-19T04:26:14.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085171609999999995, 2024-04-19T04:26:14.267 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.268 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.268 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.268 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.268 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.268 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:14.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.268 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:14.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:14.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:14.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:14.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:14.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:14.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:14.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:14.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:14.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966154+0000", 2024-04-19T04:26:14.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.070613543000000001 2024-04-19T04:26:14.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:14.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966382+0000", 2024-04-19T04:26:14.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022741800000000001 2024-04-19T04:26:14.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:14.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980581+0000", 2024-04-19T04:26:14.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014199916999999999 2024-04-19T04:26:14.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:14.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980621+0000", 2024-04-19T04:26:14.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9685999999999999e-05 2024-04-19T04:26:14.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980682+0000", 2024-04-19T04:26:14.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1130000000000006e-05 2024-04-19T04:26:14.272 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.272 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.272 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.272 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:14.272 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:14.272 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.2752558999999994, 2024-04-19T04:26:14.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075073230000000005, 2024-04-19T04:26:14.272 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.273 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.273 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.273 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.273 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.273 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:14.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.273 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:14.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:14.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:14.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:14.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:14.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:14.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:14.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:14.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:14.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:14.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:14.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:14.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:14.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:14.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:14.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970556+0000", 2024-04-19T04:26:14.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.072076192999999997 2024-04-19T04:26:14.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:14.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970608+0000", 2024-04-19T04:26:14.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2549000000000001e-05 2024-04-19T04:26:14.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970674+0000", 2024-04-19T04:26:14.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5549000000000005e-05 2024-04-19T04:26:14.277 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.277 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.277 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.277 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5:70a7bb5e:::benchmark_data_smithi007_19526_object48614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:14.277 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:14.277 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.2701689030000001, 2024-04-19T04:26:14.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080099220999999998, 2024-04-19T04:26:14.277 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.277 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.277 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.278 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.278 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.278 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:14.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.278 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:14.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:14.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:14.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:14.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:14.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:14.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:14.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:14.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:14.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:14.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971978+0000", 2024-04-19T04:26:14.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.071282358000000004 2024-04-19T04:26:14.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:14.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.972180+0000", 2024-04-19T04:26:14.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020191100000000001 2024-04-19T04:26:14.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:14.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980701+0000", 2024-04-19T04:26:14.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085211760000000001 2024-04-19T04:26:14.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:14.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980729+0000", 2024-04-19T04:26:14.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8068e-05 2024-04-19T04:26:14.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980787+0000", 2024-04-19T04:26:14.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7521e-05 2024-04-19T04:26:14.282 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.282 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.282 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.282 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174350 5.e 5:7f36609a:::benchmark_data_smithi007_19526_object48616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:14.282 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:14.282 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.2683978309999997, 2024-04-19T04:26:14.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079723622999999993, 2024-04-19T04:26:14.282 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:14.283 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.283 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:14.283 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:14.283 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.283 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174350 2024-04-19T04:26:14.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.283 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:14.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:14.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:14.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:14.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:14.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:14.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:14.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902458+0000", 2024-04-19T04:26:14.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:14.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902463+0000", 2024-04-19T04:26:14.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5889999999999996e-06 2024-04-19T04:26:14.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:14.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965576+0000", 2024-04-19T04:26:14.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063113328999999996 2024-04-19T04:26:14.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965614+0000", 2024-04-19T04:26:14.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8285999999999999e-05 2024-04-19T04:26:14.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:14.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974787+0000", 2024-04-19T04:26:14.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009172599 2024-04-19T04:26:14.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:14.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974999+0000", 2024-04-19T04:26:14.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021270999999999999 2024-04-19T04:26:14.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:14.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982086+0000", 2024-04-19T04:26:14.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070869160000000004 2024-04-19T04:26:14.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:14.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982115+0000", 2024-04-19T04:26:14.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8603999999999999e-05 2024-04-19T04:26:14.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:14.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:14.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:14.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982182+0000", 2024-04-19T04:26:14.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7350999999999999e-05 2024-04-19T04:26:14.287 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.287 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.287 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.287 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:14.287 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:14.287 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:14.289 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:14.289 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:14.288+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:14.389 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:14.388+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:14.425 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:14.425 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:14.426 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.426 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:196700 5.7 5:eb60c7e3:::benchmark_data_smithi007_19526_object70966:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:14.426 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:14.414837+0000", 2024-04-19T04:26:14.426 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.010854875, 2024-04-19T04:26:14.426 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010871804000000001, 2024-04-19T04:26:14.426 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.426 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:14.426 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.426 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.426 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.426 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 196700 2024-04-19T04:26:14.426 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.426 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.426 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.427 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.427 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.414837+0000", 2024-04-19T04:26:14.427 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.427 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.427 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.427 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.427 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.414837+0000", 2024-04-19T04:26:14.427 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.427 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.427 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.427 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.427 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.414836+0000", 2024-04-19T04:26:14.427 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.428 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.428 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.428 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.428 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.414841+0000", 2024-04-19T04:26:14.428 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4309999999999996e-06 2024-04-19T04:26:14.428 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.428 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.428 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.428 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.414849+0000", 2024-04-19T04:26:14.428 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2269999999999993e-06 2024-04-19T04:26:14.428 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.428 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.428 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.428 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.414856+0000", 2024-04-19T04:26:14.428 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:14.429 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.429 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.429 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.429 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422992+0000", 2024-04-19T04:26:14.429 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0081350650000000004 2024-04-19T04:26:14.429 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.429 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.429 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.429 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.423133+0000", 2024-04-19T04:26:14.429 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000141311 2024-04-19T04:26:14.429 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.429 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.429 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.430 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.430 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.430 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:196703 5.f 5:fc9bdbc2:::benchmark_data_smithi007_19526_object70969:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:14.430 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:14.414937+0000", 2024-04-19T04:26:14.430 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.010754948, 2024-04-19T04:26:14.430 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010821516, 2024-04-19T04:26:14.430 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.430 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:14.430 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.430 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.430 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.430 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 196703 2024-04-19T04:26:14.431 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.431 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.431 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.431 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.431 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.414937+0000", 2024-04-19T04:26:14.431 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.431 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.431 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.431 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.431 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.414937+0000", 2024-04-19T04:26:14.431 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.431 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.431 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.431 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.432 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.414936+0000", 2024-04-19T04:26:14.432 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.432 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.432 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.432 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.432 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.414940+0000", 2024-04-19T04:26:14.432 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1420000000000003e-06 2024-04-19T04:26:14.432 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.432 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.432 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.432 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.414948+0000", 2024-04-19T04:26:14.432 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0989999999999999e-06 2024-04-19T04:26:14.432 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.432 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.433 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.433 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.414956+0000", 2024-04-19T04:26:14.433 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.216e-06 2024-04-19T04:26:14.433 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.433 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.433 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.433 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422980+0000", 2024-04-19T04:26:14.433 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0080240780000000005 2024-04-19T04:26:14.433 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.433 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.433 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.433 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.423132+0000", 2024-04-19T04:26:14.433 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152635 2024-04-19T04:26:14.434 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.434 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.434 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:14.434 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.423247+0000", 2024-04-19T04:26:14.434 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000114783 2024-04-19T04:26:14.434 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.434 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.434 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.434 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.434 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.434 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:196713 5.7 5:eeaf3d52:::benchmark_data_smithi007_19526_object70979:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:14.434 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:14.418250+0000", 2024-04-19T04:26:14.434 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0074419300000000002, 2024-04-19T04:26:14.435 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075654989999999998, 2024-04-19T04:26:14.435 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.435 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:14.435 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.435 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.435 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.435 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 196713 2024-04-19T04:26:14.435 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.435 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.435 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.435 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.435 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.418250+0000", 2024-04-19T04:26:14.435 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.435 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.436 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.436 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.436 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.418250+0000", 2024-04-19T04:26:14.436 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.436 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.436 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.436 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.436 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.418249+0000", 2024-04-19T04:26:14.436 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.436 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.436 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.436 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.436 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.418253+0000", 2024-04-19T04:26:14.437 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6899999999999998e-06 2024-04-19T04:26:14.437 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.437 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.437 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.437 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.418260+0000", 2024-04-19T04:26:14.437 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2849999999999997e-06 2024-04-19T04:26:14.437 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.437 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.437 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.437 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.418267+0000", 2024-04-19T04:26:14.437 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8689999999999998e-06 2024-04-19T04:26:14.437 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.437 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.438 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.438 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.424959+0000", 2024-04-19T04:26:14.438 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0066923759999999999 2024-04-19T04:26:14.438 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.438 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.438 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.438 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425054+0000", 2024-04-19T04:26:14.438 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.4451999999999996e-05 2024-04-19T04:26:14.438 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.438 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.438 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.439 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.439 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.439 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:196716 5.2 5:4cc55e84:::benchmark_data_smithi007_19526_object70982:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:14.439 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:14.421747+0000", 2024-04-19T04:26:14.439 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.003944258, 2024-04-19T04:26:14.439 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0041153550000000002, 2024-04-19T04:26:14.439 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.439 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:14.439 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.439 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.439 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.439 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 196716 2024-04-19T04:26:14.439 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.439 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.440 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.440 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.440 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.421747+0000", 2024-04-19T04:26:14.440 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.440 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.440 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.440 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.440 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.421747+0000", 2024-04-19T04:26:14.440 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.440 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.440 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.440 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.440 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.421746+0000", 2024-04-19T04:26:14.440 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.441 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.441 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.441 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.441 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.421752+0000", 2024-04-19T04:26:14.441 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4360000000000001e-06 2024-04-19T04:26:14.441 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.441 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.441 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.441 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.421765+0000", 2024-04-19T04:26:14.441 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3171e-05 2024-04-19T04:26:14.441 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.441 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.441 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.441 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.421771+0000", 2024-04-19T04:26:14.441 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7629999999999997e-06 2024-04-19T04:26:14.442 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.442 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.442 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.442 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.421822+0000", 2024-04-19T04:26:14.442 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1477000000000002e-05 2024-04-19T04:26:14.442 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.442 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.442 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.442 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.421950+0000", 2024-04-19T04:26:14.442 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012757400000000001 2024-04-19T04:26:14.442 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.442 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.442 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.443 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.443 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.443 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:196718 5.f 5:f4ac06d5:::benchmark_data_smithi007_19526_object70984:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:14.443 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:14.422326+0000", 2024-04-19T04:26:14.443 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.003365406, 2024-04-19T04:26:14.443 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0035716749999999998, 2024-04-19T04:26:14.443 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.443 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:14.443 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.443 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.443 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.443 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 196718 2024-04-19T04:26:14.443 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.443 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.444 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.444 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.444 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422326+0000", 2024-04-19T04:26:14.444 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.444 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.444 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.444 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.444 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422326+0000", 2024-04-19T04:26:14.444 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.444 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.444 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.444 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.444 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422325+0000", 2024-04-19T04:26:14.444 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.445 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.445 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.445 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.445 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422332+0000", 2024-04-19T04:26:14.445 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3770000000000001e-06 2024-04-19T04:26:14.445 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.445 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.445 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.445 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422344+0000", 2024-04-19T04:26:14.445 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2088e-05 2024-04-19T04:26:14.445 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.445 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.445 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.445 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422352+0000", 2024-04-19T04:26:14.445 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0870000000000007e-06 2024-04-19T04:26:14.446 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.446 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.446 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.446 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425437+0000", 2024-04-19T04:26:14.446 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0030855499999999998 2024-04-19T04:26:14.446 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.446 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.446 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.446 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425562+0000", 2024-04-19T04:26:14.446 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012423100000000001 2024-04-19T04:26:14.446 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.446 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.446 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:14.446 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425695+0000", 2024-04-19T04:26:14.447 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013311200000000001 2024-04-19T04:26:14.447 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.447 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.447 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.447 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.447 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.447 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:196719 5.d 5:bbd9b994:::benchmark_data_smithi007_19526_object70985:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:14.447 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:14.422360+0000", 2024-04-19T04:26:14.447 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0033316309999999998, 2024-04-19T04:26:14.447 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0035753880000000001, 2024-04-19T04:26:14.447 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.447 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:14.447 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.447 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.448 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.448 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 196719 2024-04-19T04:26:14.448 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.448 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.448 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.448 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.448 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422360+0000", 2024-04-19T04:26:14.448 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.448 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.448 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.448 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.448 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422360+0000", 2024-04-19T04:26:14.448 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.448 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.449 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.449 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.449 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422360+0000", 2024-04-19T04:26:14.449 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.449 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.449 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.449 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.449 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422363+0000", 2024-04-19T04:26:14.449 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.0139999999999999e-06 2024-04-19T04:26:14.449 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.449 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.449 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.449 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422370+0000", 2024-04-19T04:26:14.449 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3289999999999996e-06 2024-04-19T04:26:14.449 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.450 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.450 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.450 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422376+0000", 2024-04-19T04:26:14.450 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5709999999999997e-06 2024-04-19T04:26:14.450 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.450 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.450 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.450 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422439+0000", 2024-04-19T04:26:14.450 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3464000000000001e-05 2024-04-19T04:26:14.450 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.450 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.450 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.450 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422665+0000", 2024-04-19T04:26:14.450 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000225596 2024-04-19T04:26:14.451 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.451 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.451 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:14.451 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422802+0000", 2024-04-19T04:26:14.451 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000137164 2024-04-19T04:26:14.453 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.453 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.453 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:14.453 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425782+0000", 2024-04-19T04:26:14.453 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0029802029999999998 2024-04-19T04:26:14.453 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.454 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.454 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.454 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.454 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.454 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:196720 5.f 5.26f1c20f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:14.455 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:14.422389+0000", 2024-04-19T04:26:14.455 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0033029219999999998, 2024-04-19T04:26:14.455 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0035841639999999999, 2024-04-19T04:26:14.455 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.455 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:14.455 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.455 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.455 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.455 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 196720 2024-04-19T04:26:14.455 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.455 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.455 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.455 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.455 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422389+0000", 2024-04-19T04:26:14.456 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.456 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.456 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.456 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.456 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422389+0000", 2024-04-19T04:26:14.456 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.456 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.456 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.456 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.456 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422388+0000", 2024-04-19T04:26:14.456 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.456 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.456 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.457 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.457 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422391+0000", 2024-04-19T04:26:14.457 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8609999999999998e-06 2024-04-19T04:26:14.457 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.457 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.457 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.457 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422399+0000", 2024-04-19T04:26:14.457 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6750000000000002e-06 2024-04-19T04:26:14.457 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.457 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.457 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.457 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422404+0000", 2024-04-19T04:26:14.457 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4060000000000004e-06 2024-04-19T04:26:14.457 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.457 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.458 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.458 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.458 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.458 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:196721 5.7 5.c1a36cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:14.458 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:14.422620+0000", 2024-04-19T04:26:14.458 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0030719810000000001, 2024-04-19T04:26:14.458 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0033820640000000002, 2024-04-19T04:26:14.458 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.458 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:14.458 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.458 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.458 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.459 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 196721 2024-04-19T04:26:14.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.459 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.459 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.459 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.459 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422620+0000", 2024-04-19T04:26:14.459 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.459 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.459 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.459 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422620+0000", 2024-04-19T04:26:14.459 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.460 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.460 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422619+0000", 2024-04-19T04:26:14.460 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.460 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.460 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422623+0000", 2024-04-19T04:26:14.460 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3590000000000001e-06 2024-04-19T04:26:14.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.460 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.460 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422633+0000", 2024-04-19T04:26:14.460 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9879999999999999e-06 2024-04-19T04:26:14.461 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.461 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.461 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.461 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.422640+0000", 2024-04-19T04:26:14.461 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1149999999999996e-06 2024-04-19T04:26:14.461 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.461 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.461 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.461 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.461 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.461 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:196724 5.6 5:69e969f3:::benchmark_data_smithi007_19526_object70990:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:14.461 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:14.424282+0000", 2024-04-19T04:26:14.461 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001409425, 2024-04-19T04:26:14.462 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001746577, 2024-04-19T04:26:14.462 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.462 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:14.462 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.462 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.462 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.462 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 196724 2024-04-19T04:26:14.462 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.462 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.462 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.462 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.462 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.424282+0000", 2024-04-19T04:26:14.462 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.462 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.463 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.463 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.463 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.424282+0000", 2024-04-19T04:26:14.463 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.463 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.463 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.463 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.463 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.424281+0000", 2024-04-19T04:26:14.463 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:14.463 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.463 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.463 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.463 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.424288+0000", 2024-04-19T04:26:14.464 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.737e-06 2024-04-19T04:26:14.464 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.464 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.464 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.465 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.424304+0000", 2024-04-19T04:26:14.465 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6252e-05 2024-04-19T04:26:14.465 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.465 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.465 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.465 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.424313+0000", 2024-04-19T04:26:14.465 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5839999999999995e-06 2024-04-19T04:26:14.465 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.465 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.465 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.466 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.424357+0000", 2024-04-19T04:26:14.466 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4056e-05 2024-04-19T04:26:14.466 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.466 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.466 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.466 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.424523+0000", 2024-04-19T04:26:14.466 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016668100000000001 2024-04-19T04:26:14.466 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.466 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.466 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.466 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.467 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.467 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:196725 5.1 5:85b19c25:::benchmark_data_smithi007_19526_object70991:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:14.467 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:14.425527+0000", 2024-04-19T04:26:14.467 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00016448299999999999, 2024-04-19T04:26:14.467 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00053415799999999996, 2024-04-19T04:26:14.467 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.467 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:14.467 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.467 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.467 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.467 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 196725 2024-04-19T04:26:14.467 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.467 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.468 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.468 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.468 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425527+0000", 2024-04-19T04:26:14.468 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.468 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.468 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.468 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.468 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425527+0000", 2024-04-19T04:26:14.468 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.468 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.468 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.468 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.468 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425526+0000", 2024-04-19T04:26:14.468 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.469 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.469 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.469 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.469 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425531+0000", 2024-04-19T04:26:14.469 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9089999999999999e-06 2024-04-19T04:26:14.469 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.469 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.469 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.469 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425542+0000", 2024-04-19T04:26:14.469 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1119e-05 2024-04-19T04:26:14.469 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.469 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.469 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.470 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425557+0000", 2024-04-19T04:26:14.470 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4301000000000001e-05 2024-04-19T04:26:14.470 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.470 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.470 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.470 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425613+0000", 2024-04-19T04:26:14.470 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6186e-05 2024-04-19T04:26:14.470 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.470 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.470 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.470 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425749+0000", 2024-04-19T04:26:14.470 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013559600000000001 2024-04-19T04:26:14.470 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.470 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.471 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.471 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.471 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.471 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:196727 5.3 5:c4b7bc6e:::benchmark_data_smithi007_19526_object70993:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:14.471 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:14.425577+0000", 2024-04-19T04:26:14.471 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00011497099999999999, 2024-04-19T04:26:14.471 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000516725, 2024-04-19T04:26:14.471 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.471 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:14.471 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.471 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.471 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.471 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 196727 2024-04-19T04:26:14.472 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.472 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.472 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.472 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.472 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425577+0000", 2024-04-19T04:26:14.472 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.472 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.472 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.472 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.472 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425577+0000", 2024-04-19T04:26:14.472 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.472 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.473 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.473 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.473 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425576+0000", 2024-04-19T04:26:14.473 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.473 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.473 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.473 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.473 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425580+0000", 2024-04-19T04:26:14.473 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.41e-06 2024-04-19T04:26:14.473 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.474 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.474 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.474 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425589+0000", 2024-04-19T04:26:14.474 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.3549999999999994e-06 2024-04-19T04:26:14.474 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.474 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.474 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.474 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425596+0000", 2024-04-19T04:26:14.474 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5579999999999997e-06 2024-04-19T04:26:14.475 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.475 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.475 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.475 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425642+0000", 2024-04-19T04:26:14.475 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6545999999999998e-05 2024-04-19T04:26:14.475 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.475 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.475 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.475 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425765+0000", 2024-04-19T04:26:14.475 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012307299999999999 2024-04-19T04:26:14.475 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.475 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.475 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.476 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.476 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.476 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:196728 5.f 5.cb708d3f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:14.476 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:14.425682+0000", 2024-04-19T04:26:14.476 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.4879999999999996e-06, 2024-04-19T04:26:14.476 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00044227999999999997, 2024-04-19T04:26:14.476 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.476 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:14.476 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.476 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.476 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.476 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 196728 2024-04-19T04:26:14.477 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.477 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.477 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.477 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.477 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425682+0000", 2024-04-19T04:26:14.477 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.477 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.477 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.477 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.477 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425682+0000", 2024-04-19T04:26:14.477 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.477 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.477 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.477 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.478 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425681+0000", 2024-04-19T04:26:14.478 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.478 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.478 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.478 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.478 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425686+0000", 2024-04-19T04:26:14.478 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.403e-06 2024-04-19T04:26:14.478 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.478 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.478 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.478 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425694+0000", 2024-04-19T04:26:14.478 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0080000000000002e-06 2024-04-19T04:26:14.478 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.478 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.479 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.479 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425700+0000", 2024-04-19T04:26:14.479 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1059999999999996e-06 2024-04-19T04:26:14.479 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.479 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.479 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.479 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.479 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.479 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:196703 5.f e58/20)", 2024-04-19T04:26:14.479 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:14.425744+0000", 2024-04-19T04:26:14.479 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.999948, 2024-04-19T04:26:14.479 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00040642, 2024-04-19T04:26:14.479 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.479 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:14.480 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.480 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.480 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.480 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425744+0000", 2024-04-19T04:26:14.480 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.480 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.480 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.480 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425744+0000", 2024-04-19T04:26:14.480 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.480 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.480 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.480 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425743+0000", 2024-04-19T04:26:14.480 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.481 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.481 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.481 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.481 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425746+0000", 2024-04-19T04:26:14.481 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1959999999999998e-06 2024-04-19T04:26:14.481 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.481 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.481 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.481 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425750+0000", 2024-04-19T04:26:14.481 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8350000000000003e-06 2024-04-19T04:26:14.481 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.481 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.482 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.482 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.425754+0000", 2024-04-19T04:26:14.482 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9480000000000001e-06 2024-04-19T04:26:14.482 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.482 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.482 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.482 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.483 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.483 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:196697 5.7 5:e2088fc8:::benchmark_data_smithi007_19526_object70963:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:14.483 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:14.414399+0000", 2024-04-19T04:26:14.483 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.011292315000000001, 2024-04-19T04:26:14.483 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011775568, 2024-04-19T04:26:14.483 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.483 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:14.483 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.483 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.483 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.483 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 196697 2024-04-19T04:26:14.483 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.483 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.483 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.484 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.484 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.414399+0000", 2024-04-19T04:26:14.484 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.484 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.484 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.484 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.484 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.414399+0000", 2024-04-19T04:26:14.484 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.484 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.484 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.484 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.484 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.414399+0000", 2024-04-19T04:26:14.484 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.484 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.484 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.485 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.485 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.414403+0000", 2024-04-19T04:26:14.485 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6779999999999999e-06 2024-04-19T04:26:14.485 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.485 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.485 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.485 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.414412+0000", 2024-04-19T04:26:14.485 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1330000000000005e-06 2024-04-19T04:26:14.485 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.485 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.485 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.485 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.414419+0000", 2024-04-19T04:26:14.485 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4300000000000003e-06 2024-04-19T04:26:14.485 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.485 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.486 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.486 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.420528+0000", 2024-04-19T04:26:14.486 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0061093079999999999 2024-04-19T04:26:14.486 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.486 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.486 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.486 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:14.420619+0000", 2024-04-19T04:26:14.486 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0779000000000006e-05 2024-04-19T04:26:14.486 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.486 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.486 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.486 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.486 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:14.486 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 14 2024-04-19T04:26:14.487 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:14.488 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:14.489 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:14.489+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:14.590 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:14.589+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:14.613 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:14.613 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:14.613 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:14.613 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:14.614 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:14.625 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:14.691 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:14.688+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:14.765 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:14.765 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:14.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:14.765 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:14.765 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.765 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:14.766 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:14.766 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 80.531612260000003, 2024-04-19T04:26:14.766 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:14.766 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.766 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.766 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.766 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.766 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.766 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:14.766 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.766 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.766 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.766 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.767 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:14.767 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.767 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.767 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.767 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:14.767 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.767 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.767 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.767 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:14.767 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.768 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.768 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:14.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:14.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.768 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.768 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:14.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:14.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.768 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.768 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:14.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:14.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.769 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:14.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:14.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.769 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:14.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:14.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.769 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:14.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:14.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:14.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.770 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.770 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:14.770 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:14.770 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:14.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.770 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.770 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:14.770 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:14.770 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:14.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.770 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.770 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:14.771 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:14.771 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:14.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.771 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.771 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.771 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:14.771 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:14.771 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.771 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.771 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.771 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.771 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:14.771 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:14.772 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 80.527517338999999, 2024-04-19T04:26:14.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:14.772 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.772 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.772 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.772 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.772 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.772 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:14.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.772 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.772 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.772 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:14.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:14.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:14.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.774 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.774 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.774 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:14.774 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:14.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.774 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.774 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.774 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:14.774 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:14.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.774 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.774 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.775 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:14.775 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:14.775 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.775 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.775 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:14.775 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:14.775 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.775 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.775 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:14.775 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:14.775 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.776 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:14.776 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:14.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:14.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.776 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.776 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:14.776 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:14.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:14.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.776 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.776 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:14.776 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:14.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:14.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:14.777 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:14.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:14.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.777 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:14.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:14.777 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.777 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.777 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.778 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:14.778 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:14.778 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 80.524226154000004, 2024-04-19T04:26:14.778 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:14.778 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.778 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.778 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.778 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.778 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.778 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:14.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.778 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.778 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.779 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.779 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:14.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.779 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.779 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.779 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:14.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.779 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.779 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.779 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:14.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:14.780 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:14.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:14.780 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:14.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:14.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:14.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.781 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:14.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:14.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.781 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:14.781 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:14.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.781 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:14.782 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:14.782 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:14.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.782 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.782 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:14.782 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:14.782 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:14.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.782 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.782 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:14.782 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:14.782 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:14.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.783 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.783 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:14.783 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:14.783 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:14.783 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.785 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.785 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.785 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:14.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:14.786 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.786 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.786 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.786 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:14.786 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:14.786 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 58.806836689000001, 2024-04-19T04:26:14.786 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:14.786 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.786 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:14.787 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.787 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.787 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.787 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:14.787 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.787 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.787 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.787 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.787 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:14.787 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.787 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.788 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.788 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.788 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:14.788 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.788 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.788 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.788 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.788 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:14.788 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.788 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.788 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.788 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.788 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:14.789 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:14.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.789 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.789 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.789 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:14.789 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:14.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.789 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.789 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.789 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:14.789 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:14.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.790 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.790 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.790 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:14.790 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:14.790 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.790 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.790 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.790 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:14.790 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:14.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.791 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.791 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:14.791 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:14.791 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:14.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.791 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.791 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:14.791 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:14.791 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:14.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.791 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.791 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.792 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:14.792 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:14.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.792 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.792 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:14.792 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:14.792 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:14.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.792 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.792 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.792 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:14.792 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:14.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.792 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.793 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.793 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:14.793 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:14.793 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.793 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.793 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.793 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.793 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.793 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:14.794 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:14.794 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 58.786606239999998, 2024-04-19T04:26:14.794 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:14.794 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.794 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:14.794 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.794 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.794 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.794 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:14.794 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.795 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.795 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.795 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.795 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:14.795 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.795 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.795 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.795 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:14.795 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.795 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.795 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.795 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:14.796 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:14.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.796 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.796 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:14.796 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:14.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.796 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.796 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:14.796 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:14.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.797 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.797 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:14.797 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:14.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.797 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.797 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.797 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:14.797 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:14.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.797 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.797 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:14.797 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:14.798 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:14.798 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.798 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.798 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.798 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:14.798 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:14.798 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.798 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.798 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.799 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:14.799 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:14.799 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.799 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.799 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.799 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.800 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.800 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:14.800 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:14.800 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 58.786498383000001, 2024-04-19T04:26:14.800 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:14.800 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.800 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:14.800 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.800 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.800 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.801 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:14.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.801 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.801 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.801 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.801 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:14.801 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.801 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.801 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.801 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:14.802 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.802 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.802 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.802 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.802 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:14.802 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.802 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.802 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.802 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.802 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:14.803 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:14.803 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.803 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.803 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.803 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:14.803 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:14.803 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.803 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.803 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.803 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:14.803 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:14.803 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.804 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.804 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.804 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:14.804 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:14.804 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.804 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.804 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:14.804 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:14.804 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:14.804 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.804 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.804 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.804 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:14.805 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:14.805 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.805 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.805 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.805 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:14.805 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:14.805 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.805 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.805 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.805 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.805 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.805 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:14.806 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:14.806 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 58.784531694000002, 2024-04-19T04:26:14.806 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:14.806 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.806 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.806 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.806 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.806 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.806 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:14.806 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.806 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.806 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.806 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.807 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:14.807 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.807 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.807 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.807 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.807 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:14.807 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.807 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.807 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.807 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.807 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:14.807 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:14.807 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.807 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.808 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.808 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:14.808 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:14.808 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.808 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.808 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.808 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:14.808 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:14.808 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.808 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.808 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.808 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:14.808 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:14.808 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.809 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.809 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.809 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:14.809 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:14.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.809 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.809 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:14.809 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:14.809 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:14.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.809 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.809 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.809 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:14.809 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:14.810 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.810 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.811 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.811 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:14.811 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:14.811 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.811 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.811 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:14.811 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:14.811 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:14.811 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.811 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.811 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:14.811 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:14.811 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:14.811 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.812 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.812 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.812 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:14.812 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:14.812 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.812 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.812 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.813 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:14.813 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:14.813 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 58.781167498999999, 2024-04-19T04:26:14.813 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:14.813 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.813 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.813 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.813 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.813 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.813 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:14.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.813 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.813 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:14.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:14.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:14.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:14.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:14.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:14.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:14.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:14.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:14.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.816 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:14.816 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:14.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.816 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:14.817 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:14.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:14.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.817 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.817 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:14.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:14.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.817 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.817 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:14.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:14.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.818 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:14.818 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:14.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:14.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.818 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:14.818 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:14.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:14.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:14.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:14.819 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.819 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.819 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.819 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:14.819 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:14.819 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 58.777356521000002, 2024-04-19T04:26:14.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:14.820 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.820 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.820 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.820 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.820 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.820 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:14.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.820 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:14.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:14.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:14.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:14.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:14.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:14.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:14.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:14.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:14.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:14.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:14.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:14.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:14.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:14.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:14.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:14.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:14.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:14.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:14.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:14.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:14.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:14.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:14.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:14.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:14.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:14.826 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.826 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.826 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.826 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:14.826 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:14.826 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 45.535494163999999, 2024-04-19T04:26:14.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:14.827 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.827 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.827 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.827 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.827 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.827 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:14.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.827 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:14.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:14.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:14.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:14.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:14.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:14.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:14.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:14.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:14.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:14.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:14.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:14.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:14.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:14.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:14.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:14.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:14.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:14.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:14.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:14.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:14.832 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.832 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.832 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.832 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:14.832 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:14.832 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 45.534899883999998, 2024-04-19T04:26:14.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:14.832 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.832 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.833 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.833 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.833 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.833 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:14.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.833 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:14.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:14.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:14.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:14.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:14.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:14.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:14.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:14.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:14.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:14.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:14.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:14.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:14.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:14.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:14.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:14.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:14.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:14.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:14.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:14.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:14.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:14.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:14.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:14.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:14.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:14.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:14.838 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.838 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.838 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.838 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:14.839 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:14.839 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 10.810252726, 2024-04-19T04:26:14.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:14.839 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.839 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.839 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.839 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.839 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.839 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:14.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.840 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:14.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:14.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:14.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:14.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:14.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:14.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:14.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:14.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:14.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:14.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:14.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:14.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:14.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:14.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:14.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:14.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:14.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:14.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:14.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:14.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:14.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:14.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:14.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:14.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:14.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:14.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:14.844 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.844 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.844 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.845 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:14.845 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:14.845 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 10.810212310000001, 2024-04-19T04:26:14.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:14.845 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.845 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.845 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.845 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.845 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.845 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:14.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.845 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:14.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:14.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:14.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:14.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:14.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:14.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:14.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:14.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:14.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:14.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:14.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:14.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:14.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:14.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:14.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:14.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:14.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:14.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:14.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:14.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:14.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:14.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:14.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:14.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:14.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:14.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:14.851 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.851 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.851 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.851 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:14.851 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:14.851 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 10.806516001, 2024-04-19T04:26:14.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:14.851 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.851 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.851 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.851 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.851 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.852 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:14.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.852 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:14.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:14.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:14.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:14.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:14.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:14.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:14.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:14.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:14.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:14.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:14.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:14.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:14.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:14.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:14.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:14.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:14.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:14.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:14.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:14.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:14.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:14.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:14.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:14.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:14.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:14.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:14.857 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.857 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.857 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.857 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:14.857 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:14.857 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 10.552905527, 2024-04-19T04:26:14.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:14.857 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.857 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.857 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.857 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.857 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.857 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:14.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.858 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:14.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:14.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:14.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:14.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:14.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:14.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:14.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:14.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:14.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:14.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:14.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:14.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:14.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:14.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:14.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:14.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:14.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:14.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:14.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:14.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:14.861 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.861 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.862 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.862 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:14.862 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:14.862 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 10.550612115, 2024-04-19T04:26:14.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:14.862 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.862 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.862 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.862 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.862 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.862 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:14.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.863 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:14.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:14.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:14.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:14.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:14.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:14.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:14.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:14.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:14.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:14.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:14.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:14.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:14.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:14.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:14.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:14.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:14.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:14.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:14.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:14.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:14.868 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.868 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.868 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.868 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:14.868 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:14.869 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 10.550566299, 2024-04-19T04:26:14.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:14.869 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.869 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.869 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.869 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.869 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.869 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:14.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.869 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:14.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:14.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:14.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:14.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:14.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:14.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:14.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:14.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:14.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:14.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:14.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:14.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:14.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:14.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:14.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:14.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:14.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:14.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:14.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.873 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.873 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:14.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:14.873 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.873 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.873 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.874 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174342 5.9 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:14.874 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:14.874 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.8654095989999995, 2024-04-19T04:26:14.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068615152999999998, 2024-04-19T04:26:14.874 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.874 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.874 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.874 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.874 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.874 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174342 2024-04-19T04:26:14.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.874 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:14.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:14.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897726+0000", 2024-04-19T04:26:14.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897731+0000", 2024-04-19T04:26:14.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1449999999999999e-06 2024-04-19T04:26:14.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897744+0000", 2024-04-19T04:26:14.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2833000000000001e-05 2024-04-19T04:26:14.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897749+0000", 2024-04-19T04:26:14.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1540000000000001e-06 2024-04-19T04:26:14.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897810+0000", 2024-04-19T04:26:14.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0724999999999999e-05 2024-04-19T04:26:14.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897920+0000", 2024-04-19T04:26:14.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011024 2024-04-19T04:26:14.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:14.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897993+0000", 2024-04-19T04:26:14.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2335000000000005e-05 2024-04-19T04:26:14.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:14.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.899597+0000", 2024-04-19T04:26:14.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016048919999999999 2024-04-19T04:26:14.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:14.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966230+0000", 2024-04-19T04:26:14.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.066632882000000004 2024-04-19T04:26:14.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:14.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966296+0000", 2024-04-19T04:26:14.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5361e-05 2024-04-19T04:26:14.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966342+0000", 2024-04-19T04:26:14.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6476e-05 2024-04-19T04:26:14.879 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.879 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.880 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.880 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174344 5.d 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:14.880 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:14.880 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.8647307610000006, 2024-04-19T04:26:14.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068211329000000001, 2024-04-19T04:26:14.880 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.880 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.880 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.880 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.880 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.880 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174344 2024-04-19T04:26:14.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.881 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:14.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:14.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898405+0000", 2024-04-19T04:26:14.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:14.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898409+0000", 2024-04-19T04:26:14.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5149999999999998e-06 2024-04-19T04:26:14.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898415+0000", 2024-04-19T04:26:14.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:26:14.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898419+0000", 2024-04-19T04:26:14.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.89e-06 2024-04-19T04:26:14.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898459+0000", 2024-04-19T04:26:14.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0017e-05 2024-04-19T04:26:14.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898540+0000", 2024-04-19T04:26:14.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1237999999999997e-05 2024-04-19T04:26:14.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:14.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:14.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6060000000000001e-05 2024-04-19T04:26:14.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:14.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.901321+0000", 2024-04-19T04:26:14.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027152109999999999 2024-04-19T04:26:14.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.884 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:14.884 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966512+0000", 2024-04-19T04:26:14.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.065190440000000002 2024-04-19T04:26:14.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:14.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966563+0000", 2024-04-19T04:26:14.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1436e-05 2024-04-19T04:26:14.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966617+0000", 2024-04-19T04:26:14.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.401e-05 2024-04-19T04:26:14.885 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.885 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.885 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.886 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174346 5.f 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:14.886 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:14.886 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 9.8629445340000004, 2024-04-19T04:26:14.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.067185536000000004, 2024-04-19T04:26:14.886 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:14.886 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:14.886 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:14.886 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:14.886 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:14.886 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174346 2024-04-19T04:26:14.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.886 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:14.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:14.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:14.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:14.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:14.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:14.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:14.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900191+0000", 2024-04-19T04:26:14.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:14.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:14.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900196+0000", 2024-04-19T04:26:14.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3329999999999998e-06 2024-04-19T04:26:14.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:14.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900206+0000", 2024-04-19T04:26:14.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9699999999999994e-06 2024-04-19T04:26:14.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:14.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900210+0000", 2024-04-19T04:26:14.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3359999999999997e-06 2024-04-19T04:26:14.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:14.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900243+0000", 2024-04-19T04:26:14.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2669999999999997e-05 2024-04-19T04:26:14.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:14.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900365+0000", 2024-04-19T04:26:14.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122648 2024-04-19T04:26:14.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:14.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900559+0000", 2024-04-19T04:26:14.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019358799999999999 2024-04-19T04:26:14.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:14.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.903018+0000", 2024-04-19T04:26:14.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024592300000000002 2024-04-19T04:26:14.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:14.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967180+0000", 2024-04-19T04:26:14.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.064161587000000006 2024-04-19T04:26:14.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:14.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967293+0000", 2024-04-19T04:26:14.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112921 2024-04-19T04:26:14.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:14.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:14.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:14.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967378+0000", 2024-04-19T04:26:14.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5000999999999995e-05 2024-04-19T04:26:14.891 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.891 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.891 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.891 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:14.891 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:14.892 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:14.892 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:26:14.893 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:14.889+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:14.894 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:14.994 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:14.993+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:15.016 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:15.017 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:15.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.017 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:198122 5.8 5:124799c5:::benchmark_data_smithi007_19526_object72388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:15.017 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:15.009077+0000", 2024-04-19T04:26:15.017 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0069950500000000001, 2024-04-19T04:26:15.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070208479999999997, 2024-04-19T04:26:15.018 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:15.018 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:15.018 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:15.018 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:15.018 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:15.018 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 198122 2024-04-19T04:26:15.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.018 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:15.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:15.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.009077+0000", 2024-04-19T04:26:15.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:15.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.009077+0000", 2024-04-19T04:26:15.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:15.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.009077+0000", 2024-04-19T04:26:15.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:15.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:15.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.009081+0000", 2024-04-19T04:26:15.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6979999999999997e-06 2024-04-19T04:26:15.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:15.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.009091+0000", 2024-04-19T04:26:15.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6129999999999993e-06 2024-04-19T04:26:15.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:15.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.009098+0000", 2024-04-19T04:26:15.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2930000000000003e-06 2024-04-19T04:26:15.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:15.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.009155+0000", 2024-04-19T04:26:15.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6734999999999998e-05 2024-04-19T04:26:15.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:15.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.009321+0000", 2024-04-19T04:26:15.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016642299999999999 2024-04-19T04:26:15.023 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.023 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:15.023 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.023 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:198120 5.9 e58/20 5:9ccfb13b:::benchmark_data_smithi007_19526_object72386:head v 58'12710, mlcod=58'12706)", 2024-04-19T04:26:15.024 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:15.010096+0000", 2024-04-19T04:26:15.024 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0059763710000000003, 2024-04-19T04:26:15.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060737600000000001, 2024-04-19T04:26:15.024 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:15.024 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:15.024 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:15.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:15.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.010096+0000", 2024-04-19T04:26:15.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:15.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.010096+0000", 2024-04-19T04:26:15.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:15.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.010095+0000", 2024-04-19T04:26:15.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:15.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:15.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.010103+0000", 2024-04-19T04:26:15.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3730000000000004e-06 2024-04-19T04:26:15.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:15.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.010116+0000", 2024-04-19T04:26:15.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3546999999999999e-05 2024-04-19T04:26:15.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:15.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.010122+0000", 2024-04-19T04:26:15.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0569999999999998e-06 2024-04-19T04:26:15.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:15.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.010163+0000", 2024-04-19T04:26:15.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0611999999999997e-05 2024-04-19T04:26:15.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:15.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.010189+0000", 2024-04-19T04:26:15.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5697000000000001e-05 2024-04-19T04:26:15.028 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.029 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:15.029 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.029 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:198125 5.d e58/29 5:b7b43636:::benchmark_data_smithi007_19526_object72391:head v 58'11995, mlcod=58'11993)", 2024-04-19T04:26:15.030 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:15.010190+0000", 2024-04-19T04:26:15.030 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0058820060000000004, 2024-04-19T04:26:15.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060371230000000001, 2024-04-19T04:26:15.030 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:15.030 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:15.030 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:15.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:15.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.010190+0000", 2024-04-19T04:26:15.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:15.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.010190+0000", 2024-04-19T04:26:15.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:15.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.010190+0000", 2024-04-19T04:26:15.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:15.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:15.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.010195+0000", 2024-04-19T04:26:15.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7439999999999998e-06 2024-04-19T04:26:15.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:15.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.010202+0000", 2024-04-19T04:26:15.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9299999999999997e-06 2024-04-19T04:26:15.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:15.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.010207+0000", 2024-04-19T04:26:15.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9200000000000003e-06 2024-04-19T04:26:15.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:15.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.010245+0000", 2024-04-19T04:26:15.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8170000000000002e-05 2024-04-19T04:26:15.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:15.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.010261+0000", 2024-04-19T04:26:15.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6359999999999999e-05 2024-04-19T04:26:15.035 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.035 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:15.035 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.036 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:198127 5.e 5:7cff4a83:::benchmark_data_smithi007_19526_object72393:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:15.036 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:15.011751+0000", 2024-04-19T04:26:15.036 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0043217059999999998, 2024-04-19T04:26:15.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045344859999999999, 2024-04-19T04:26:15.036 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:15.036 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:15.036 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:15.036 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:15.037 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:15.037 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 198127 2024-04-19T04:26:15.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.037 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:15.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:15.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.011751+0000", 2024-04-19T04:26:15.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:15.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.011751+0000", 2024-04-19T04:26:15.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:15.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.011750+0000", 2024-04-19T04:26:15.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:15.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:15.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.011755+0000", 2024-04-19T04:26:15.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5210000000000002e-06 2024-04-19T04:26:15.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:15.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.011766+0000", 2024-04-19T04:26:15.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0478e-05 2024-04-19T04:26:15.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:15.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.011773+0000", 2024-04-19T04:26:15.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5089999999999996e-06 2024-04-19T04:26:15.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:15.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.011815+0000", 2024-04-19T04:26:15.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1343e-05 2024-04-19T04:26:15.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:15.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.011915+0000", 2024-04-19T04:26:15.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010033 2024-04-19T04:26:15.041 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.041 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:15.041 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.041 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:198128 5.e 5:7fdd27b2:::benchmark_data_smithi007_19526_object72394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:15.041 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:15.011795+0000", 2024-04-19T04:26:15.041 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0042770239999999999, 2024-04-19T04:26:15.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045559629999999997, 2024-04-19T04:26:15.041 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:15.042 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:15.042 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:15.042 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:15.042 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:15.042 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 198128 2024-04-19T04:26:15.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.042 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:15.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:15.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.011795+0000", 2024-04-19T04:26:15.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:15.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.011795+0000", 2024-04-19T04:26:15.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:15.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.011795+0000", 2024-04-19T04:26:15.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:15.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:15.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.011799+0000", 2024-04-19T04:26:15.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9770000000000002e-06 2024-04-19T04:26:15.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:15.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.011806+0000", 2024-04-19T04:26:15.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8680000000000001e-06 2024-04-19T04:26:15.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:15.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.011811+0000", 2024-04-19T04:26:15.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7599999999999999e-06 2024-04-19T04:26:15.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:15.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014989+0000", 2024-04-19T04:26:15.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031776880000000001 2024-04-19T04:26:15.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:15.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.015057+0000", 2024-04-19T04:26:15.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7933000000000002e-05 2024-04-19T04:26:15.046 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.046 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:15.046 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.047 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:198126 5.d e58/29 5:bf30d858:::benchmark_data_smithi007_19526_object72392:head v 58'11996, mlcod=58'11993)", 2024-04-19T04:26:15.047 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:15.012295+0000", 2024-04-19T04:26:15.047 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.003776995, 2024-04-19T04:26:15.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004117903, 2024-04-19T04:26:15.047 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:15.047 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:15.047 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:15.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:15.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.012295+0000", 2024-04-19T04:26:15.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:15.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.012295+0000", 2024-04-19T04:26:15.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:15.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.012295+0000", 2024-04-19T04:26:15.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:15.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:15.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.012300+0000", 2024-04-19T04:26:15.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2650000000000004e-06 2024-04-19T04:26:15.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:15.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.012307+0000", 2024-04-19T04:26:15.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-19T04:26:15.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:15.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.012312+0000", 2024-04-19T04:26:15.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.994e-06 2024-04-19T04:26:15.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:15.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.012356+0000", 2024-04-19T04:26:15.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4075000000000001e-05 2024-04-19T04:26:15.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:15.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.012375+0000", 2024-04-19T04:26:15.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9147000000000002e-05 2024-04-19T04:26:15.051 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.051 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:15.051 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.051 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:198131 5.f e58/20 5:fefd1a7b:::benchmark_data_smithi007_19526_object72397:head v 58'12156, mlcod=58'12154)", 2024-04-19T04:26:15.051 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:15.013356+0000", 2024-04-19T04:26:15.051 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00271617, 2024-04-19T04:26:15.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003112755, 2024-04-19T04:26:15.051 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:15.051 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:15.051 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:15.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:15.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.013356+0000", 2024-04-19T04:26:15.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:15.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.013356+0000", 2024-04-19T04:26:15.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:15.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.013356+0000", 2024-04-19T04:26:15.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:15.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:15.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.013360+0000", 2024-04-19T04:26:15.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2640000000000002e-06 2024-04-19T04:26:15.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:15.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.013367+0000", 2024-04-19T04:26:15.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9179999999999997e-06 2024-04-19T04:26:15.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:15.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.013371+0000", 2024-04-19T04:26:15.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0980000000000004e-06 2024-04-19T04:26:15.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:15.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.013413+0000", 2024-04-19T04:26:15.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2024999999999998e-05 2024-04-19T04:26:15.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:15.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.013439+0000", 2024-04-19T04:26:15.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.567e-05 2024-04-19T04:26:15.055 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.055 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:15.055 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.055 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:198132 5.8 5:10cc301b:::benchmark_data_smithi007_19526_object72398:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:15.056 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:15.013466+0000", 2024-04-19T04:26:15.056 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0026068580000000001, 2024-04-19T04:26:15.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030602680000000001, 2024-04-19T04:26:15.056 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:15.056 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:15.056 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:15.056 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:15.056 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:15.056 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 198132 2024-04-19T04:26:15.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.056 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:15.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:15.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.013466+0000", 2024-04-19T04:26:15.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:15.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.013466+0000", 2024-04-19T04:26:15.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:15.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.013465+0000", 2024-04-19T04:26:15.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:15.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:15.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.013471+0000", 2024-04-19T04:26:15.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5899999999999996e-06 2024-04-19T04:26:15.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:15.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.013482+0000", 2024-04-19T04:26:15.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0691e-05 2024-04-19T04:26:15.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:15.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.013490+0000", 2024-04-19T04:26:15.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3550000000000005e-06 2024-04-19T04:26:15.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:15.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.013537+0000", 2024-04-19T04:26:15.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6776000000000001e-05 2024-04-19T04:26:15.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:15.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.013630+0000", 2024-04-19T04:26:15.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2731000000000004e-05 2024-04-19T04:26:15.059 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.059 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:15.060 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.060 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:198133 5.0 5:0dd941fb:::benchmark_data_smithi007_19526_object72399:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:15.060 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:15.014082+0000", 2024-04-19T04:26:15.060 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0019901210000000001, 2024-04-19T04:26:15.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025131680000000001, 2024-04-19T04:26:15.060 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:15.060 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:15.060 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:15.061 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:15.061 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:15.061 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 198133 2024-04-19T04:26:15.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.061 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:15.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:15.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014082+0000", 2024-04-19T04:26:15.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:15.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014082+0000", 2024-04-19T04:26:15.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:15.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014081+0000", 2024-04-19T04:26:15.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:15.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:15.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014087+0000", 2024-04-19T04:26:15.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6289999999999998e-06 2024-04-19T04:26:15.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:15.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014106+0000", 2024-04-19T04:26:15.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8550999999999999e-05 2024-04-19T04:26:15.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:15.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014112+0000", 2024-04-19T04:26:15.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7479999999999996e-06 2024-04-19T04:26:15.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:15.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014162+0000", 2024-04-19T04:26:15.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9240000000000003e-05 2024-04-19T04:26:15.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:15.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014286+0000", 2024-04-19T04:26:15.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012406599999999999 2024-04-19T04:26:15.064 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.064 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:15.064 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.065 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:198134 5.4 5:2c2e4c57:::benchmark_data_smithi007_19526_object72400:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:15.065 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:15.014375+0000", 2024-04-19T04:26:15.065 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0016973139999999999, 2024-04-19T04:26:15.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022800239999999999, 2024-04-19T04:26:15.065 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:15.065 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:15.065 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:15.065 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:15.065 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:15.065 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 198134 2024-04-19T04:26:15.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.066 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:15.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:15.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014375+0000", 2024-04-19T04:26:15.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:15.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014375+0000", 2024-04-19T04:26:15.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:15.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014374+0000", 2024-04-19T04:26:15.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:15.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:15.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014379+0000", 2024-04-19T04:26:15.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.938e-06 2024-04-19T04:26:15.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:15.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014387+0000", 2024-04-19T04:26:15.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7060000000000004e-06 2024-04-19T04:26:15.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:15.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014393+0000", 2024-04-19T04:26:15.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2190000000000001e-06 2024-04-19T04:26:15.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:15.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014455+0000", 2024-04-19T04:26:15.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1631999999999995e-05 2024-04-19T04:26:15.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:15.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014607+0000", 2024-04-19T04:26:15.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000152535 2024-04-19T04:26:15.072 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.073 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:15.073 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.073 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:198135 5.0 5:026ed8ae:::benchmark_data_smithi007_19526_object72401:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:15.074 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:15.014459+0000", 2024-04-19T04:26:15.074 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0016131069999999999, 2024-04-19T04:26:15.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002232815, 2024-04-19T04:26:15.074 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:15.074 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:15.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:15.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:15.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:15.075 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 198135 2024-04-19T04:26:15.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.075 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:15.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:15.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014459+0000", 2024-04-19T04:26:15.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:15.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014459+0000", 2024-04-19T04:26:15.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:15.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014459+0000", 2024-04-19T04:26:15.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:15.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:15.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014463+0000", 2024-04-19T04:26:15.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:15.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:15.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014470+0000", 2024-04-19T04:26:15.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2400000000000001e-06 2024-04-19T04:26:15.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:15.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014476+0000", 2024-04-19T04:26:15.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.049e-06 2024-04-19T04:26:15.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:15.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.016646+0000", 2024-04-19T04:26:15.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021695350000000002 2024-04-19T04:26:15.082 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.082 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:15.082 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.082 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:198137 5.e 5.ab4f77de (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T04:26:15.083 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:15.014717+0000", 2024-04-19T04:26:15.083 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0013558579999999999, 2024-04-19T04:26:15.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020074540000000001, 2024-04-19T04:26:15.083 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:15.083 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:15.083 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:15.083 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:15.083 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:15.083 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 198137 2024-04-19T04:26:15.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.083 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:15.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:15.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014717+0000", 2024-04-19T04:26:15.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:15.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014717+0000", 2024-04-19T04:26:15.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:15.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014716+0000", 2024-04-19T04:26:15.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:15.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:15.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014721+0000", 2024-04-19T04:26:15.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3750000000000002e-06 2024-04-19T04:26:15.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:15.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014730+0000", 2024-04-19T04:26:15.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3699999999999995e-06 2024-04-19T04:26:15.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:15.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.014736+0000", 2024-04-19T04:26:15.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3080000000000004e-06 2024-04-19T04:26:15.086 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.086 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:15.086 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.087 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:198139 5.d e58/29 5:bce29282:::benchmark_data_smithi007_19526_object72405:head v 58'11997, mlcod=58'11993)", 2024-04-19T04:26:15.087 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:15.015429+0000", 2024-04-19T04:26:15.087 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00064335399999999995, 2024-04-19T04:26:15.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001324443, 2024-04-19T04:26:15.087 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:15.087 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:15.087 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:15.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:15.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.015429+0000", 2024-04-19T04:26:15.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:15.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.015429+0000", 2024-04-19T04:26:15.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:15.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:15.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.015428+0000", 2024-04-19T04:26:15.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:15.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:15.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.015435+0000", 2024-04-19T04:26:15.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8820000000000003e-06 2024-04-19T04:26:15.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:15.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.015444+0000", 2024-04-19T04:26:15.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-19T04:26:15.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:15.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.015450+0000", 2024-04-19T04:26:15.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9839999999999998e-06 2024-04-19T04:26:15.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:15.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.015489+0000", 2024-04-19T04:26:15.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9424000000000001e-05 2024-04-19T04:26:15.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:15.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:15.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:15.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:15.015507+0000", 2024-04-19T04:26:15.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7515000000000001e-05 2024-04-19T04:26:15.090 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.090 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:15.090 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.090 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:15.090 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:26:15.090 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 13 2024-04-19T04:26:15.090 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:15.091 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:15.091 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:15.092 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:15.093 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:15.093 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:15.093 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:15.093 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:15.094 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:15.094 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:15.092+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:15.195 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:15.193+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:15.221 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:15.221 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:15.234 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:15.260 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T04:26:15.296 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:15.296+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:15.395 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:15.395 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:15.397 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:15.393+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:15.407 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:15.498 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:15.497+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:15.537 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:15.537 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:15.550 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:15.599 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~59s 2024-04-19T04:26:15.600 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:15.596+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:15.676 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:15.676 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:15.689 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:15.701 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:15.700+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:15.802 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:15.801+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:15.819 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:15.820 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:15.833 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:15.904 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:15.901+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:15.962 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:15.963 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:15.973 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:16.005 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:16.004+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:16.098 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:16.099 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:16.106 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:16.105+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:16.109 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:16.207 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:16.205+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:16.265 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-04-19T04:26:16.276 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:16.277 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:16.288 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:16.336 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:16.336+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:16.409 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:16.405+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:16.419 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:16.419 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:16.431 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:16.509 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:16.509+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:16.564 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:16.564 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:16.579 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:16.611 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:16.609+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:16.706 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:16.706 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:16.712 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:16.712+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:16.719 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:16.813 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:16.812+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:16.841 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:16.841 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:16.853 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:16.914 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:16.913+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:16.973 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:16.973 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:16.985 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:17.015 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:17.012+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:17.094 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:26:17.109 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:17.109 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:17.118 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:17.117+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:17.121 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:17.220 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:17.217+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:17.247 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:17.255 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:17.256 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:17.256 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.256 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:203374 5.1 5:88c6919c:::benchmark_data_smithi007_19526_object77640:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:17.256 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:17.252443+0000", 2024-04-19T04:26:17.256 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0037570910000000002, 2024-04-19T04:26:17.256 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0037845510000000001, 2024-04-19T04:26:17.256 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.256 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:17.256 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.256 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.256 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.256 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 203374 2024-04-19T04:26:17.256 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.256 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.257 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.257 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.257 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.252443+0000", 2024-04-19T04:26:17.257 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.257 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.257 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.257 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.252443+0000", 2024-04-19T04:26:17.257 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.257 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.257 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.257 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.252442+0000", 2024-04-19T04:26:17.257 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:17.258 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.258 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.258 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.258 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.252448+0000", 2024-04-19T04:26:17.258 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1800000000000001e-06 2024-04-19T04:26:17.258 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.258 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.258 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.258 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.252459+0000", 2024-04-19T04:26:17.258 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1487e-05 2024-04-19T04:26:17.258 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.258 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.258 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.259 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.252468+0000", 2024-04-19T04:26:17.259 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7420000000000003e-06 2024-04-19T04:26:17.259 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.259 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.259 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.259 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.254195+0000", 2024-04-19T04:26:17.259 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0017267070000000001 2024-04-19T04:26:17.259 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.259 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.259 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.259 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.254267+0000", 2024-04-19T04:26:17.259 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2051999999999994e-05 2024-04-19T04:26:17.259 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.259 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.260 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.260 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.260 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:203378 5.6 5:6e55f100:::benchmark_data_smithi007_19526_object77644:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:17.260 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:17.255632+0000", 2024-04-19T04:26:17.260 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00056794099999999998, 2024-04-19T04:26:17.260 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00067985699999999997, 2024-04-19T04:26:17.260 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.260 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:17.260 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.260 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.260 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.260 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 203378 2024-04-19T04:26:17.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.261 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.261 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.261 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.261 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.255632+0000", 2024-04-19T04:26:17.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.261 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.261 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.261 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.261 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.255632+0000", 2024-04-19T04:26:17.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.261 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.261 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.261 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.261 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.255631+0000", 2024-04-19T04:26:17.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:17.262 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.262 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.262 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.262 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.255637+0000", 2024-04-19T04:26:17.262 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6950000000000003e-06 2024-04-19T04:26:17.262 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.262 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.262 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.262 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.255647+0000", 2024-04-19T04:26:17.262 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0122999999999999e-05 2024-04-19T04:26:17.262 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.262 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.262 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.262 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.255655+0000", 2024-04-19T04:26:17.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3019999999999997e-06 2024-04-19T04:26:17.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.263 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.263 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.263 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.255701+0000", 2024-04-19T04:26:17.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5804999999999999e-05 2024-04-19T04:26:17.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.263 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.263 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.263 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.255780+0000", 2024-04-19T04:26:17.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9037999999999998e-05 2024-04-19T04:26:17.263 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.263 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.263 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.264 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:203379 5.7 5:e03e55b5:::benchmark_data_smithi007_19526_object77645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:17.264 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:17.255674+0000", 2024-04-19T04:26:17.264 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00052598499999999997, 2024-04-19T04:26:17.264 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00071841699999999995, 2024-04-19T04:26:17.264 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.264 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:17.264 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.264 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.264 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.264 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 203379 2024-04-19T04:26:17.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.264 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.255674+0000", 2024-04-19T04:26:17.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.255674+0000", 2024-04-19T04:26:17.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.255673+0000", 2024-04-19T04:26:17.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:17.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.266 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.255677+0000", 2024-04-19T04:26:17.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.703e-06 2024-04-19T04:26:17.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.266 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.255684+0000", 2024-04-19T04:26:17.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9959999999999996e-06 2024-04-19T04:26:17.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.266 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.255690+0000", 2024-04-19T04:26:17.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.93e-06 2024-04-19T04:26:17.267 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.267 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.267 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.267 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.255730+0000", 2024-04-19T04:26:17.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0333000000000002e-05 2024-04-19T04:26:17.267 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.267 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.267 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.267 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.255821+0000", 2024-04-19T04:26:17.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1414000000000003e-05 2024-04-19T04:26:17.267 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.267 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.267 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.268 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:203381 5.c 5:3ef49e08:::benchmark_data_smithi007_19526_object77647:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:17.268 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:17.256256+0000", 2024-04-19T04:26:17.268 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9999433, 2024-04-19T04:26:17.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00021227099999999999, 2024-04-19T04:26:17.268 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.268 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:17.268 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.268 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.268 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.268 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 203381 2024-04-19T04:26:17.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.268 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.269 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.269 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256256+0000", 2024-04-19T04:26:17.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.269 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.269 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256256+0000", 2024-04-19T04:26:17.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.269 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.269 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256255+0000", 2024-04-19T04:26:17.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:17.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256260+0000", 2024-04-19T04:26:17.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8230000000000002e-06 2024-04-19T04:26:17.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256273+0000", 2024-04-19T04:26:17.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3266e-05 2024-04-19T04:26:17.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256282+0000", 2024-04-19T04:26:17.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7010000000000002e-06 2024-04-19T04:26:17.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256328+0000", 2024-04-19T04:26:17.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5723999999999998e-05 2024-04-19T04:26:17.271 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.271 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.271 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.271 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:203383 5.9 5:91211434:::benchmark_data_smithi007_19526_object77649:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:17.271 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:17.256297+0000", 2024-04-19T04:26:17.271 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9999027, 2024-04-19T04:26:17.272 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000242511, 2024-04-19T04:26:17.272 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.272 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:17.272 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.272 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.272 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.272 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 203383 2024-04-19T04:26:17.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.272 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.272 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.272 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.272 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256297+0000", 2024-04-19T04:26:17.272 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.273 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256297+0000", 2024-04-19T04:26:17.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.273 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256296+0000", 2024-04-19T04:26:17.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:17.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256301+0000", 2024-04-19T04:26:17.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2189999999999998e-06 2024-04-19T04:26:17.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.274 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256308+0000", 2024-04-19T04:26:17.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4919999999999996e-06 2024-04-19T04:26:17.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.274 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256315+0000", 2024-04-19T04:26:17.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2899999999999997e-06 2024-04-19T04:26:17.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256361+0000", 2024-04-19T04:26:17.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5336000000000001e-05 2024-04-19T04:26:17.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256504+0000", 2024-04-19T04:26:17.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014284000000000001 2024-04-19T04:26:17.275 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.275 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.275 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.275 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:203386 5.1 5.13b90a31 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:17.276 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:17.256432+0000", 2024-04-19T04:26:17.276 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9997678, 2024-04-19T04:26:17.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00018571399999999999, 2024-04-19T04:26:17.276 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.276 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:17.276 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.276 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.276 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.276 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 203386 2024-04-19T04:26:17.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.276 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256432+0000", 2024-04-19T04:26:17.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256432+0000", 2024-04-19T04:26:17.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256431+0000", 2024-04-19T04:26:17.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:17.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256437+0000", 2024-04-19T04:26:17.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5100000000000004e-06 2024-04-19T04:26:17.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256454+0000", 2024-04-19T04:26:17.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7210999999999998e-05 2024-04-19T04:26:17.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256463+0000", 2024-04-19T04:26:17.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3850000000000002e-06 2024-04-19T04:26:17.278 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.278 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.278 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.279 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:203387 5.7 5.46ef3db7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:17.279 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:17.256483+0000", 2024-04-19T04:26:17.279 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9997163, 2024-04-19T04:26:17.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000197095, 2024-04-19T04:26:17.279 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.279 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:17.279 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.279 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.279 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.279 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 203387 2024-04-19T04:26:17.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.279 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256483+0000", 2024-04-19T04:26:17.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256483+0000", 2024-04-19T04:26:17.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256483+0000", 2024-04-19T04:26:17.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:17.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256487+0000", 2024-04-19T04:26:17.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2679999999999996e-06 2024-04-19T04:26:17.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256495+0000", 2024-04-19T04:26:17.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4519999999999997e-06 2024-04-19T04:26:17.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:17.256502+0000", 2024-04-19T04:26:17.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3289999999999999e-06 2024-04-19T04:26:17.282 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.282 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.282 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.282 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.282 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:17.282 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 7 2024-04-19T04:26:17.282 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:17.283 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:17.284 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:17.284 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:17.285 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:17.285 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:17.285 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:17.285 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:17.322 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:17.320+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:17.419 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:17.420 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:17.420 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:17.420 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:17.420 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:17.423 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:17.421+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:17.431 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:17.526 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:17.524+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:17.561 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:17.561 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:17.561 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:17.562 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:17.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.562 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:17.562 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:17.562 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 83.328273354000004, 2024-04-19T04:26:17.562 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:17.562 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.562 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:17.562 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.562 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.562 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.563 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:17.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.563 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:17.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:17.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.564 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.564 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:17.564 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:17.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.564 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.564 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.564 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:17.564 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:17.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.564 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.564 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.564 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:17.564 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:17.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.565 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.565 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:17.565 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:17.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.565 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.565 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:17.565 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:17.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.565 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.566 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:17.566 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:17.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.566 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.566 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:17.566 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:17.566 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:17.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.566 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.566 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:17.566 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:17.566 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:17.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.567 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.567 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:17.567 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:17.567 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:17.567 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.567 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.567 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:17.567 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:17.567 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:17.568 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.568 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.568 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.568 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:17.568 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:17.568 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.568 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.568 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.568 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.568 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.568 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:17.568 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:17.569 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 83.324178433, 2024-04-19T04:26:17.569 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:17.569 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.569 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:17.569 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.569 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.569 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.569 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:17.569 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.569 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.570 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.570 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.570 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:17.570 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.570 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.570 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.570 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.570 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:17.570 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.570 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.570 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.570 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.570 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:17.571 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:17.571 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.571 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.571 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.571 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:17.571 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:17.571 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.571 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.571 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.571 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:17.571 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:17.572 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.572 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.572 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.572 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:17.572 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:17.572 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.572 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.572 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.572 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:17.572 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:17.572 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.572 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.572 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.572 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:17.573 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:17.573 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.573 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.573 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:17.573 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:17.573 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:17.573 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.573 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.573 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:17.573 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:17.573 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:17.573 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.574 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.574 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:17.574 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:17.574 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:17.574 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.574 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.574 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:17.574 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:17.574 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:17.574 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.574 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.574 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.574 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:17.574 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:17.575 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.575 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.575 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.575 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.575 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.575 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:17.575 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:17.575 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 83.320887248000005, 2024-04-19T04:26:17.575 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:17.575 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.575 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:17.575 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.575 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.575 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.576 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:17.576 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.576 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.576 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.576 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.576 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:17.576 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.576 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.576 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.576 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.576 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:17.576 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.576 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.576 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.577 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.577 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:17.577 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:17.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.577 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.577 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.577 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:17.577 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:17.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.577 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.577 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.577 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:17.577 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:17.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.578 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.578 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.578 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:17.578 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:17.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.579 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.579 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:17.579 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:17.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.579 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.579 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:17.579 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:17.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.580 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:17.580 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:17.580 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:17.580 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.580 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.580 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:17.580 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:17.580 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:17.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.581 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.581 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:17.581 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:17.581 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:17.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.581 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.582 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:17.582 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:17.582 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:17.582 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.582 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.582 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.582 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:17.582 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:17.582 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.582 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.583 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.583 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.583 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:17.583 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:17.583 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.603497783000002, 2024-04-19T04:26:17.583 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:17.583 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.583 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:17.583 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.583 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.583 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.584 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:17.584 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.584 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.584 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.584 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.584 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:17.584 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.584 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.584 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.584 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.584 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:17.584 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.584 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.585 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.585 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.585 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:17.585 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:17.585 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.585 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.585 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.585 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:17.585 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:17.585 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.585 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.585 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.585 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:17.585 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:17.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.586 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.586 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:17.586 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:17.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.586 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.586 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:17.586 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:17.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.587 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.587 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:17.587 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:17.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.587 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.587 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:17.587 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:17.587 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:17.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.587 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.587 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:17.587 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:17.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:17.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:17.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:17.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:17.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:17.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:17.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.589 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:17.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:17.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.589 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.589 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:17.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:17.589 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.589 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.589 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.589 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:17.589 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:17.589 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.583267333999999, 2024-04-19T04:26:17.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:17.590 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.590 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:17.590 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.590 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.590 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.590 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:17.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.590 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.590 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.590 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.590 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:17.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.591 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:17.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.591 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:17.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:17.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.591 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:17.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:17.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:17.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:17.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:17.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:17.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:17.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:17.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.593 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:17.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:17.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:17.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.593 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:17.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:17.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.593 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:17.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:17.594 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.594 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.594 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.594 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.594 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.594 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:17.594 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:17.594 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.583159477000002, 2024-04-19T04:26:17.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:17.594 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.594 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:17.594 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.594 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.595 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.595 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:17.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.595 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.595 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.595 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:17.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.595 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.595 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:17.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:17.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:17.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:17.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:17.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:17.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:17.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:17.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:17.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:17.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:17.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:17.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:17.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:17.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:17.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:17.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:17.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:17.598 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.599 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.599 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.599 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:17.599 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:17.599 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.581192788000003, 2024-04-19T04:26:17.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:17.599 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.599 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:17.599 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.599 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.599 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.599 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:17.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.600 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:17.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:17.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:17.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:17.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:17.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:17.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:17.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:17.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:17.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:17.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:17.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:17.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:17.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:17.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:17.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:17.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:17.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:17.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:17.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:17.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:17.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:17.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:17.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:17.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:17.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:17.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:17.605 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.605 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.605 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.605 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:17.605 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:17.605 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.577828593, 2024-04-19T04:26:17.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:17.606 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.606 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:17.606 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.606 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.606 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.606 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:17.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.606 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:17.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:17.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:17.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:17.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:17.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.611 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.574017615000002, 2024-04-19T04:26:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:17.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:17.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:17.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:17.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 48.332155258, 2024-04-19T04:26:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:17.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.622 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 48.331560977999999, 2024-04-19T04:26:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:17.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 13.606913820000001, 2024-04-19T04:26:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 13.606873404, 2024-04-19T04:26:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:17.634 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:17.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 13.603177094999999, 2024-04-19T04:26:17.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.642 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.643 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:17.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 13.349566620999999, 2024-04-19T04:26:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.646 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.647 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.648 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:17.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.648 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.648 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.648 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:17.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:17.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.648 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.648 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.648 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:17.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:17.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.648 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.649 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.649 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:17.649 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:17.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.649 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.649 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:17.649 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:17.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.649 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.649 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:17.649 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:17.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:17.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:17.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:17.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:17.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:17.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:17.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:17.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:17.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:17.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:17.651 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.651 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.651 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.651 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:17.651 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:17.651 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 13.347273209000001, 2024-04-19T04:26:17.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:17.652 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.652 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:17.652 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.652 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.652 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.652 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:17.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.652 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.652 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:17.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:17.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:17.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:17.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:17.654 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:17.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.654 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.654 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:17.654 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:17.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.654 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.654 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:17.654 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:17.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.654 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 13.347227393000001, 2024-04-19T04:26:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174342 5.9 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.662070693, 2024-04-19T04:26:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068615152999999998, 2024-04-19T04:26:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174342 2024-04-19T04:26:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897726+0000", 2024-04-19T04:26:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897731+0000", 2024-04-19T04:26:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1449999999999999e-06 2024-04-19T04:26:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897744+0000", 2024-04-19T04:26:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2833000000000001e-05 2024-04-19T04:26:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897749+0000", 2024-04-19T04:26:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1540000000000001e-06 2024-04-19T04:26:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897810+0000", 2024-04-19T04:26:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0724999999999999e-05 2024-04-19T04:26:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897920+0000", 2024-04-19T04:26:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011024 2024-04-19T04:26:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897993+0000", 2024-04-19T04:26:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2335000000000005e-05 2024-04-19T04:26:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.899597+0000", 2024-04-19T04:26:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016048919999999999 2024-04-19T04:26:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966230+0000", 2024-04-19T04:26:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.066632882000000004 2024-04-19T04:26:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966296+0000", 2024-04-19T04:26:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5361e-05 2024-04-19T04:26:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966342+0000", 2024-04-19T04:26:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6476e-05 2024-04-19T04:26:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174344 5.d 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.661391855, 2024-04-19T04:26:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068211329000000001, 2024-04-19T04:26:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174344 2024-04-19T04:26:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898405+0000", 2024-04-19T04:26:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898409+0000", 2024-04-19T04:26:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5149999999999998e-06 2024-04-19T04:26:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898415+0000", 2024-04-19T04:26:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:26:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898419+0000", 2024-04-19T04:26:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.89e-06 2024-04-19T04:26:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898459+0000", 2024-04-19T04:26:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0017e-05 2024-04-19T04:26:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898540+0000", 2024-04-19T04:26:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1237999999999997e-05 2024-04-19T04:26:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6060000000000001e-05 2024-04-19T04:26:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.901321+0000", 2024-04-19T04:26:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027152109999999999 2024-04-19T04:26:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966512+0000", 2024-04-19T04:26:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.065190440000000002 2024-04-19T04:26:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966563+0000", 2024-04-19T04:26:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1436e-05 2024-04-19T04:26:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966617+0000", 2024-04-19T04:26:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.401e-05 2024-04-19T04:26:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174346 5.f 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 12.659605628, 2024-04-19T04:26:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.067185536000000004, 2024-04-19T04:26:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174346 2024-04-19T04:26:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900191+0000", 2024-04-19T04:26:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900196+0000", 2024-04-19T04:26:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3329999999999998e-06 2024-04-19T04:26:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900206+0000", 2024-04-19T04:26:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9699999999999994e-06 2024-04-19T04:26:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900210+0000", 2024-04-19T04:26:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3359999999999997e-06 2024-04-19T04:26:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900243+0000", 2024-04-19T04:26:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2669999999999997e-05 2024-04-19T04:26:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900365+0000", 2024-04-19T04:26:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122648 2024-04-19T04:26:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900559+0000", 2024-04-19T04:26:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019358799999999999 2024-04-19T04:26:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:17.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.903018+0000", 2024-04-19T04:26:17.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024592300000000002 2024-04-19T04:26:17.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:17.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967180+0000", 2024-04-19T04:26:17.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.064161587000000006 2024-04-19T04:26:17.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:17.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967293+0000", 2024-04-19T04:26:17.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112921 2024-04-19T04:26:17.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:17.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:17.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:17.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967378+0000", 2024-04-19T04:26:17.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5000999999999995e-05 2024-04-19T04:26:17.679 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.679 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.679 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.679 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:17.680 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:17.680 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:17.681 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:17.682 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:17.677+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:17.781 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:17.780+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:17.805 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:17.805 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:17.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.806 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:204640 5.b 5:d5cca1bf:::benchmark_data_smithi007_19526_object78906:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:17.806 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:17.802745+0000", 2024-04-19T04:26:17.806 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0032107049999999999, 2024-04-19T04:26:17.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032376509999999998, 2024-04-19T04:26:17.807 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:17.807 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:17.807 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:17.807 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:17.807 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.807 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 204640 2024-04-19T04:26:17.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.808 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:17.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:17.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.802745+0000", 2024-04-19T04:26:17.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:17.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:17.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.802745+0000", 2024-04-19T04:26:17.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:17.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:17.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.802744+0000", 2024-04-19T04:26:17.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:17.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:17.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.802749+0000", 2024-04-19T04:26:17.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.502e-06 2024-04-19T04:26:17.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:17.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.802760+0000", 2024-04-19T04:26:17.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0377000000000001e-05 2024-04-19T04:26:17.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.802765+0000", 2024-04-19T04:26:17.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4670000000000003e-06 2024-04-19T04:26:17.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:17.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.802810+0000", 2024-04-19T04:26:17.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5371000000000003e-05 2024-04-19T04:26:17.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:17.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.802936+0000", 2024-04-19T04:26:17.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000125489 2024-04-19T04:26:17.814 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:17.814 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:17.814 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:17.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.815 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:204644 5.0 5:0afc23bd:::benchmark_data_smithi007_19526_object78910:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:17.815 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:17.803429+0000", 2024-04-19T04:26:17.815 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002526361, 2024-04-19T04:26:17.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026359999999999999, 2024-04-19T04:26:17.815 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:17.815 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:17.816 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:17.816 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:17.816 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.816 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 204644 2024-04-19T04:26:17.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.816 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:17.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:17.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.803429+0000", 2024-04-19T04:26:17.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:17.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:17.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.803429+0000", 2024-04-19T04:26:17.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:17.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:17.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.803428+0000", 2024-04-19T04:26:17.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:17.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:17.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.803434+0000", 2024-04-19T04:26:17.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9179999999999999e-06 2024-04-19T04:26:17.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:17.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.803449+0000", 2024-04-19T04:26:17.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5248e-05 2024-04-19T04:26:17.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.803457+0000", 2024-04-19T04:26:17.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1899999999999995e-06 2024-04-19T04:26:17.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:17.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.803509+0000", 2024-04-19T04:26:17.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1913999999999998e-05 2024-04-19T04:26:17.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:17.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.803676+0000", 2024-04-19T04:26:17.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016683600000000001 2024-04-19T04:26:17.824 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:17.824 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:17.824 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:17.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.824 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:204645 5.8 5:14a66b70:::benchmark_data_smithi007_19526_object78911:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:17.824 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:17.804312+0000", 2024-04-19T04:26:17.824 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00164284, 2024-04-19T04:26:17.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001831753, 2024-04-19T04:26:17.824 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:17.824 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:17.824 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:17.824 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:17.824 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.824 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 204645 2024-04-19T04:26:17.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.825 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:17.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:17.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.804312+0000", 2024-04-19T04:26:17.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:17.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:17.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.804312+0000", 2024-04-19T04:26:17.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:17.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:17.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.804311+0000", 2024-04-19T04:26:17.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:17.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:17.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.804317+0000", 2024-04-19T04:26:17.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6200000000000004e-06 2024-04-19T04:26:17.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:17.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.804332+0000", 2024-04-19T04:26:17.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5143000000000001e-05 2024-04-19T04:26:17.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.804341+0000", 2024-04-19T04:26:17.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4009999999999997e-06 2024-04-19T04:26:17.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.827 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:17.827 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.804375+0000", 2024-04-19T04:26:17.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4035000000000002e-05 2024-04-19T04:26:17.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.827 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:17.827 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.804502+0000", 2024-04-19T04:26:17.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012715299999999999 2024-04-19T04:26:17.827 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:17.827 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:17.827 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:17.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.828 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:204647 5.b 5:d636d247:::benchmark_data_smithi007_19526_object78913:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:17.828 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:17.804474+0000", 2024-04-19T04:26:17.828 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0014817669999999999, 2024-04-19T04:26:17.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0017453220000000001, 2024-04-19T04:26:17.828 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:17.828 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:17.828 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:17.828 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:17.828 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:17.828 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 204647 2024-04-19T04:26:17.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.828 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:17.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:17.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.804474+0000", 2024-04-19T04:26:17.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:17.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:17.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.804474+0000", 2024-04-19T04:26:17.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:17.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:17.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.804472+0000", 2024-04-19T04:26:17.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:17.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:17.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.804477+0000", 2024-04-19T04:26:17.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5399999999999997e-06 2024-04-19T04:26:17.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:17.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.804487+0000", 2024-04-19T04:26:17.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7170000000000003e-06 2024-04-19T04:26:17.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:17.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.804494+0000", 2024-04-19T04:26:17.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3939999999999998e-06 2024-04-19T04:26:17.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:17.831 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.804561+0000", 2024-04-19T04:26:17.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7302e-05 2024-04-19T04:26:17.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:17.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:17.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:17.831 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:17.804646+0000", 2024-04-19T04:26:17.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4652000000000002e-05 2024-04-19T04:26:17.831 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:17.831 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:17.831 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:17.831 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:17.831 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:26:17.831 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 4 2024-04-19T04:26:17.831 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:17.833 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:17.883 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:17.880+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:17.952 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:17.952 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:17.952 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:17.952 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:17.952 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:17.965 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:17.984 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:17.981+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:18.085 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:18.084+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:18.088 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 62.135844556000002, 2024-04-19T04:26:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 62.130782910000001, 2024-04-19T04:26:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 62.130682997999997, 2024-04-19T04:26:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 62.130557244999999, 2024-04-19T04:26:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 62.126713299999999, 2024-04-19T04:26:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 62.119542199000001, 2024-04-19T04:26:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 62.119370095000001, 2024-04-19T04:26:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 62.119306969999997, 2024-04-19T04:26:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:18.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:18.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:18.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:18.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:18.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:18.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:18.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:18.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:18.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:18.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:18.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:18.131 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.131 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.131 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.131 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:18.132 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:18.132 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 62.119178372999997, 2024-04-19T04:26:18.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:18.132 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.132 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.132 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.132 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.132 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.132 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:18.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.132 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:18.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:18.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:18.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:18.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:18.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:18.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:18.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:18.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:18.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:18.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:18.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:18.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:18.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:18.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:18.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:18.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:18.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:18.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:18.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:18.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:18.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:18.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:18.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:18.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:18.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:18.138 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.138 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.138 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.138 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:18.138 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:18.138 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 62.119110401999997, 2024-04-19T04:26:18.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:18.139 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.139 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.139 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.139 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.139 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.139 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:18.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.139 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:18.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:18.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:18.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:18.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:18.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:18.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:18.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:18.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:18.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:18.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:18.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:18.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:18.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:18.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:18.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:18.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:18.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:18.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:18.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:18.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:18.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:18.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:18.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:18.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:18.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:18.144 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.145 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.145 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.145 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:18.145 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:18.145 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.199570737, 2024-04-19T04:26:18.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078453623, 2024-04-19T04:26:18.145 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.145 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.146 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.146 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.146 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.146 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:18.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.146 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:18.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:18.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:18.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:18.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:18.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:18.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:18.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:18.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:18.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:18.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:18.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:18.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:18.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:18.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965893+0000", 2024-04-19T04:26:18.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.076646455000000002 2024-04-19T04:26:18.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:18.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965956+0000", 2024-04-19T04:26:18.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3200000000000005e-05 2024-04-19T04:26:18.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966068+0000", 2024-04-19T04:26:18.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011194800000000001 2024-04-19T04:26:18.150 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.150 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.150 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.150 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:18.150 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:18.150 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.199539740000001, 2024-04-19T04:26:18.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083782388999999999, 2024-04-19T04:26:18.150 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.150 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.150 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.150 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.151 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.151 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:18.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.151 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:18.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:18.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:18.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:18.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:18.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:18.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:18.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:18.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:18.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:18.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:18.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:18.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:18.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:18.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971179+0000", 2024-04-19T04:26:18.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079349476000000002 2024-04-19T04:26:18.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:18.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971259+0000", 2024-04-19T04:26:18.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9083000000000002e-05 2024-04-19T04:26:18.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971428+0000", 2024-04-19T04:26:18.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169419 2024-04-19T04:26:18.155 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.155 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.155 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.155 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:18.155 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:18.155 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.19721822, 2024-04-19T04:26:18.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081686998999999996, 2024-04-19T04:26:18.155 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.155 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.156 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.156 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.156 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.156 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:18.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.156 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:18.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:18.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:18.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:18.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:18.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:18.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:18.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:18.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:18.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:18.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:18.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:18.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:18.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:18.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971454+0000", 2024-04-19T04:26:18.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077525997999999999 2024-04-19T04:26:18.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:18.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971540+0000", 2024-04-19T04:26:18.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6285000000000005e-05 2024-04-19T04:26:18.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971654+0000", 2024-04-19T04:26:18.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114095 2024-04-19T04:26:18.160 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.160 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.160 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.196007838, 2024-04-19T04:26:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080734265999999999, 2024-04-19T04:26:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:18.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:18.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:18.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:18.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:18.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:18.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:18.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:18.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:18.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:18.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:18.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:18.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:18.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:18.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971677+0000", 2024-04-19T04:26:18.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.073192023999999994 2024-04-19T04:26:18.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:18.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971771+0000", 2024-04-19T04:26:18.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4235999999999997e-05 2024-04-19T04:26:18.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971912+0000", 2024-04-19T04:26:18.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014055099999999999 2024-04-19T04:26:18.165 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.165 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.166 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.166 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:18.166 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:18.166 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.195056347, 2024-04-19T04:26:18.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085645857000000006, 2024-04-19T04:26:18.166 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.166 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.166 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.166 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.166 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.166 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:18.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.166 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:18.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:18.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:18.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:18.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:18.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:18.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:18.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:18.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:18.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:18.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:18.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:18.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:18.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:18.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977634+0000", 2024-04-19T04:26:18.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077144335999999994 2024-04-19T04:26:18.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:18.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977699+0000", 2024-04-19T04:26:18.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4518999999999997e-05 2024-04-19T04:26:18.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977775+0000", 2024-04-19T04:26:18.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6219999999999999e-05 2024-04-19T04:26:18.170 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.170 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.170 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.171 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:18.171 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:18.171 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.192048768999999, 2024-04-19T04:26:18.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075403611999999995, 2024-04-19T04:26:18.171 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.171 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.171 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.171 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.171 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.171 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:18.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.171 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:18.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:18.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:18.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:18.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:18.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:18.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:18.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:18.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:18.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:18.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:18.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:18.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:18.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:18.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970369+0000", 2024-04-19T04:26:18.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.074967992999999997 2024-04-19T04:26:18.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:18.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970419+0000", 2024-04-19T04:26:18.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9700999999999997e-05 2024-04-19T04:26:18.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970540+0000", 2024-04-19T04:26:18.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121512 2024-04-19T04:26:18.175 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.175 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.175 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.176 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5:78f758ec:::benchmark_data_smithi007_19526_object48602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:18.176 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:18.176 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.191674645000001, 2024-04-19T04:26:18.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085171609999999995, 2024-04-19T04:26:18.176 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.176 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.176 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.176 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.176 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.176 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:18.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.176 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:18.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:18.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:18.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:18.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:18.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:18.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:18.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:18.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:18.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966154+0000", 2024-04-19T04:26:18.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.070613543000000001 2024-04-19T04:26:18.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966382+0000", 2024-04-19T04:26:18.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022741800000000001 2024-04-19T04:26:18.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:18.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980581+0000", 2024-04-19T04:26:18.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014199916999999999 2024-04-19T04:26:18.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:18.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980621+0000", 2024-04-19T04:26:18.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9685999999999999e-05 2024-04-19T04:26:18.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980682+0000", 2024-04-19T04:26:18.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1130000000000006e-05 2024-04-19T04:26:18.180 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.180 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.180 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.180 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:18.180 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:18.180 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.191584692999999, 2024-04-19T04:26:18.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075073230000000005, 2024-04-19T04:26:18.181 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.181 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.181 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.181 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.181 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.181 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:18.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.181 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:18.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:18.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:18.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:18.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:18.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:18.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:18.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:18.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:18.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:18.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:18.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:18.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:18.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:18.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970556+0000", 2024-04-19T04:26:18.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.072076192999999997 2024-04-19T04:26:18.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:18.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970608+0000", 2024-04-19T04:26:18.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2549000000000001e-05 2024-04-19T04:26:18.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970674+0000", 2024-04-19T04:26:18.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5549000000000005e-05 2024-04-19T04:26:18.185 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.185 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.185 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.185 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5:70a7bb5e:::benchmark_data_smithi007_19526_object48614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:18.186 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:18.186 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.186497696, 2024-04-19T04:26:18.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080099220999999998, 2024-04-19T04:26:18.186 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.186 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.186 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.186 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.186 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.186 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:18.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.186 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:18.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:18.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:18.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:18.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:18.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:18.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:18.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:18.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:18.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:18.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971978+0000", 2024-04-19T04:26:18.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.071282358000000004 2024-04-19T04:26:18.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.972180+0000", 2024-04-19T04:26:18.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020191100000000001 2024-04-19T04:26:18.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:18.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980701+0000", 2024-04-19T04:26:18.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085211760000000001 2024-04-19T04:26:18.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:18.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980729+0000", 2024-04-19T04:26:18.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8068e-05 2024-04-19T04:26:18.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980787+0000", 2024-04-19T04:26:18.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7521e-05 2024-04-19T04:26:18.190 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.190 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.190 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.190 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174350 5.e 5:7f36609a:::benchmark_data_smithi007_19526_object48616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:18.190 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:18.191 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.184726624, 2024-04-19T04:26:18.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079723622999999993, 2024-04-19T04:26:18.191 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.191 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.191 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.191 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.191 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.191 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174350 2024-04-19T04:26:18.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.191 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:18.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:18.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902458+0000", 2024-04-19T04:26:18.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902463+0000", 2024-04-19T04:26:18.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5889999999999996e-06 2024-04-19T04:26:18.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965576+0000", 2024-04-19T04:26:18.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063113328999999996 2024-04-19T04:26:18.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965614+0000", 2024-04-19T04:26:18.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8285999999999999e-05 2024-04-19T04:26:18.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974787+0000", 2024-04-19T04:26:18.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009172599 2024-04-19T04:26:18.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974999+0000", 2024-04-19T04:26:18.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021270999999999999 2024-04-19T04:26:18.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:18.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982086+0000", 2024-04-19T04:26:18.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070869160000000004 2024-04-19T04:26:18.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:18.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982115+0000", 2024-04-19T04:26:18.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8603999999999999e-05 2024-04-19T04:26:18.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:18.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982182+0000", 2024-04-19T04:26:18.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7350999999999999e-05 2024-04-19T04:26:18.195 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.195 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.195 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.195 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.195 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.195 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:18.197 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:18.198 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:18.196+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:18.280 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T04:26:18.297 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:18.297+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:18.331 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:18.332 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:18.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.332 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:205851 5.f 5:f41c19f5:::benchmark_data_smithi007_19526_object80117:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.332 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:18.324804+0000", 2024-04-19T04:26:18.332 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.006646051, 2024-04-19T04:26:18.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0066729229999999999, 2024-04-19T04:26:18.332 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.332 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:18.332 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.332 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.332 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.332 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 205851 2024-04-19T04:26:18.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.333 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.333 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.324804+0000", 2024-04-19T04:26:18.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.333 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.324804+0000", 2024-04-19T04:26:18.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.324803+0000", 2024-04-19T04:26:18.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.324809+0000", 2024-04-19T04:26:18.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4110000000000001e-06 2024-04-19T04:26:18.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.324822+0000", 2024-04-19T04:26:18.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2877999999999999e-05 2024-04-19T04:26:18.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.324831+0000", 2024-04-19T04:26:18.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7290000000000006e-06 2024-04-19T04:26:18.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.324875+0000", 2024-04-19T04:26:18.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3912999999999998e-05 2024-04-19T04:26:18.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.325169+0000", 2024-04-19T04:26:18.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00029466099999999999 2024-04-19T04:26:18.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:18.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.325351+0000", 2024-04-19T04:26:18.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000181354 2024-04-19T04:26:18.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.330344+0000", 2024-04-19T04:26:18.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0049933900000000003 2024-04-19T04:26:18.336 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.336 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.336 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.336 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:205853 5.c 5:3c244ba0:::benchmark_data_smithi007_19526_object80119:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.337 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:18.326528+0000", 2024-04-19T04:26:18.337 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0049218389999999999, 2024-04-19T04:26:18.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0050456540000000001, 2024-04-19T04:26:18.337 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.337 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:18.337 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.337 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.337 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.337 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 205853 2024-04-19T04:26:18.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.337 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.337 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.337 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.326528+0000", 2024-04-19T04:26:18.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.338 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.338 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.326528+0000", 2024-04-19T04:26:18.338 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.338 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.338 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.326527+0000", 2024-04-19T04:26:18.338 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.338 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.338 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.326533+0000", 2024-04-19T04:26:18.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2589999999999997e-06 2024-04-19T04:26:18.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.326544+0000", 2024-04-19T04:26:18.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1124000000000001e-05 2024-04-19T04:26:18.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.326553+0000", 2024-04-19T04:26:18.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1049999999999995e-06 2024-04-19T04:26:18.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.326613+0000", 2024-04-19T04:26:18.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0705999999999998e-05 2024-04-19T04:26:18.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.326766+0000", 2024-04-19T04:26:18.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152941 2024-04-19T04:26:18.341 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.341 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.342 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.342 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.342 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.342 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:205854 5.9 5:97dd4daf:::benchmark_data_smithi007_19526_object80120:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.342 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:18.326814+0000", 2024-04-19T04:26:18.342 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0046355779999999996, 2024-04-19T04:26:18.342 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0048353909999999996, 2024-04-19T04:26:18.342 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.342 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:18.342 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.342 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.342 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.342 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 205854 2024-04-19T04:26:18.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.343 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.343 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.343 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.326814+0000", 2024-04-19T04:26:18.343 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.343 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.343 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.326814+0000", 2024-04-19T04:26:18.343 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.343 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.343 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.326813+0000", 2024-04-19T04:26:18.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.344 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.344 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.326819+0000", 2024-04-19T04:26:18.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2939999999999996e-06 2024-04-19T04:26:18.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.344 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.344 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.326829+0000", 2024-04-19T04:26:18.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0336999999999999e-05 2024-04-19T04:26:18.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.344 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.344 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.326836+0000", 2024-04-19T04:26:18.345 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3080000000000002e-06 2024-04-19T04:26:18.345 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.345 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.345 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.326995+0000", 2024-04-19T04:26:18.345 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000158901 2024-04-19T04:26:18.345 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.345 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.345 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.327135+0000", 2024-04-19T04:26:18.345 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013953199999999999 2024-04-19T04:26:18.345 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.345 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:18.345 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.327278+0000", 2024-04-19T04:26:18.346 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143511 2024-04-19T04:26:18.346 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.346 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.346 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.346 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:205855 5.5 5:a7f90e9f:::benchmark_data_smithi007_19526_object80121:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.346 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:18.327996+0000", 2024-04-19T04:26:18.346 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0034534489999999999, 2024-04-19T04:26:18.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0037353550000000001, 2024-04-19T04:26:18.347 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.347 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:18.347 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.347 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.347 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.347 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 205855 2024-04-19T04:26:18.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.347 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.327996+0000", 2024-04-19T04:26:18.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.348 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.348 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.348 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.327996+0000", 2024-04-19T04:26:18.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.348 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.348 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.348 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.327995+0000", 2024-04-19T04:26:18.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.348 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.348 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.348 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328001+0000", 2024-04-19T04:26:18.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3979999999999998e-06 2024-04-19T04:26:18.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.349 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.349 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328016+0000", 2024-04-19T04:26:18.349 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5153e-05 2024-04-19T04:26:18.349 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.349 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.349 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328027+0000", 2024-04-19T04:26:18.349 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0944000000000001e-05 2024-04-19T04:26:18.349 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.349 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.349 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328075+0000", 2024-04-19T04:26:18.349 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8131999999999999e-05 2024-04-19T04:26:18.350 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.350 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.350 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.350 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328179+0000", 2024-04-19T04:26:18.350 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010429099999999999 2024-04-19T04:26:18.350 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.350 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.350 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.350 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.350 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.350 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:205856 5.5 5:a31671a9:::benchmark_data_smithi007_19526_object80122:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.350 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:18.328080+0000", 2024-04-19T04:26:18.350 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0033702350000000001, 2024-04-19T04:26:18.350 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003728987, 2024-04-19T04:26:18.351 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.351 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:18.351 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.351 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.351 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.351 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 205856 2024-04-19T04:26:18.351 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.351 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.351 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.351 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.351 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328080+0000", 2024-04-19T04:26:18.351 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.351 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.351 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.351 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.352 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328080+0000", 2024-04-19T04:26:18.352 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.352 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.352 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.352 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.352 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328079+0000", 2024-04-19T04:26:18.352 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.352 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.352 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.352 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.352 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328087+0000", 2024-04-19T04:26:18.352 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9480000000000008e-06 2024-04-19T04:26:18.352 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.352 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.353 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.353 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328096+0000", 2024-04-19T04:26:18.353 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.4339999999999998e-06 2024-04-19T04:26:18.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.353 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.353 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328103+0000", 2024-04-19T04:26:18.353 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0520000000000004e-06 2024-04-19T04:26:18.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.353 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.353 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.330473+0000", 2024-04-19T04:26:18.353 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023698870000000002 2024-04-19T04:26:18.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.354 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.354 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.330653+0000", 2024-04-19T04:26:18.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000180197 2024-04-19T04:26:18.354 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.354 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.354 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.354 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:205857 5.6 5:628e0e32:::benchmark_data_smithi007_19526_object80123:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.354 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:18.328114+0000", 2024-04-19T04:26:18.354 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0033359879999999998, 2024-04-19T04:26:18.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0037631629999999999, 2024-04-19T04:26:18.354 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.354 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:18.355 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.355 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.355 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.355 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 205857 2024-04-19T04:26:18.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.355 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328114+0000", 2024-04-19T04:26:18.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328114+0000", 2024-04-19T04:26:18.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.356 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328113+0000", 2024-04-19T04:26:18.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.357 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328117+0000", 2024-04-19T04:26:18.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.264e-06 2024-04-19T04:26:18.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.357 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328124+0000", 2024-04-19T04:26:18.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9809999999999997e-06 2024-04-19T04:26:18.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328129+0000", 2024-04-19T04:26:18.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0579999999999997e-06 2024-04-19T04:26:18.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328196+0000", 2024-04-19T04:26:18.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7082000000000006e-05 2024-04-19T04:26:18.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.359 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328343+0000", 2024-04-19T04:26:18.359 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014683400000000001 2024-04-19T04:26:18.359 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.359 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.359 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.359 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.359 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:205858 5.2 5:490f6776:::benchmark_data_smithi007_19526_object80124:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.359 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:18.328148+0000", 2024-04-19T04:26:18.359 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0033014659999999999, 2024-04-19T04:26:18.359 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003797861, 2024-04-19T04:26:18.359 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.359 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:18.359 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.360 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.360 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.360 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 205858 2024-04-19T04:26:18.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.360 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.360 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328148+0000", 2024-04-19T04:26:18.360 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.360 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328148+0000", 2024-04-19T04:26:18.360 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328148+0000", 2024-04-19T04:26:18.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328151+0000", 2024-04-19T04:26:18.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.7920000000000001e-06 2024-04-19T04:26:18.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328164+0000", 2024-04-19T04:26:18.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3275000000000001e-05 2024-04-19T04:26:18.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.362 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328173+0000", 2024-04-19T04:26:18.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.4630000000000007e-06 2024-04-19T04:26:18.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.362 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328231+0000", 2024-04-19T04:26:18.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7782999999999999e-05 2024-04-19T04:26:18.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.362 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328352+0000", 2024-04-19T04:26:18.363 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121101 2024-04-19T04:26:18.363 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.363 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.363 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.363 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.363 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.363 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:205859 5.5 5.b5ef1715 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.363 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:18.328198+0000", 2024-04-19T04:26:18.363 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0032518289999999999, 2024-04-19T04:26:18.363 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038182559999999999, 2024-04-19T04:26:18.363 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.363 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:18.363 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.363 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.363 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.364 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 205859 2024-04-19T04:26:18.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.364 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.364 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.364 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.364 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328198+0000", 2024-04-19T04:26:18.364 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.364 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.364 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.364 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328198+0000", 2024-04-19T04:26:18.364 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328197+0000", 2024-04-19T04:26:18.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328201+0000", 2024-04-19T04:26:18.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6689999999999999e-06 2024-04-19T04:26:18.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328209+0000", 2024-04-19T04:26:18.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3760000000000002e-06 2024-04-19T04:26:18.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328214+0000", 2024-04-19T04:26:18.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6289999999999998e-06 2024-04-19T04:26:18.366 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.366 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.366 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.366 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:205861 5.3 5:c4e362d6:::benchmark_data_smithi007_19526_object80127:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.366 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:18.328221+0000", 2024-04-19T04:26:18.366 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.003229249, 2024-04-19T04:26:18.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038541690000000002, 2024-04-19T04:26:18.367 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.367 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:18.367 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.367 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.367 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.367 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 205861 2024-04-19T04:26:18.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.367 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.367 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328221+0000", 2024-04-19T04:26:18.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328221+0000", 2024-04-19T04:26:18.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328220+0000", 2024-04-19T04:26:18.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328223+0000", 2024-04-19T04:26:18.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.3969999999999998e-06 2024-04-19T04:26:18.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328230+0000", 2024-04-19T04:26:18.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6229999999999999e-06 2024-04-19T04:26:18.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328235+0000", 2024-04-19T04:26:18.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2000000000000002e-06 2024-04-19T04:26:18.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328277+0000", 2024-04-19T04:26:18.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1683000000000001e-05 2024-04-19T04:26:18.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328401+0000", 2024-04-19T04:26:18.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012436000000000001 2024-04-19T04:26:18.370 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.370 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.370 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.370 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:205862 5.7 5:e07c778e:::benchmark_data_smithi007_19526_object80128:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.370 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:18.328907+0000", 2024-04-19T04:26:18.370 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0025431, 2024-04-19T04:26:18.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032374019999999999, 2024-04-19T04:26:18.370 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.371 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:18.371 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.371 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.371 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.371 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 205862 2024-04-19T04:26:18.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.371 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328907+0000", 2024-04-19T04:26:18.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328907+0000", 2024-04-19T04:26:18.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328906+0000", 2024-04-19T04:26:18.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328911+0000", 2024-04-19T04:26:18.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3909999999999997e-06 2024-04-19T04:26:18.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328925+0000", 2024-04-19T04:26:18.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3926e-05 2024-04-19T04:26:18.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.328932+0000", 2024-04-19T04:26:18.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:18.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.330221+0000", 2024-04-19T04:26:18.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012889010000000001 2024-04-19T04:26:18.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.330377+0000", 2024-04-19T04:26:18.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000155561 2024-04-19T04:26:18.374 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.374 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.374 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.374 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:205863 5.c 5:3dda8da6:::benchmark_data_smithi007_19526_object80129:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.374 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:18.331892+0000", 2024-04-19T04:26:18.374 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.999558, 2024-04-19T04:26:18.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00032478200000000002, 2024-04-19T04:26:18.374 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.374 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:18.374 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.374 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.374 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.375 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 205863 2024-04-19T04:26:18.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.375 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331892+0000", 2024-04-19T04:26:18.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331892+0000", 2024-04-19T04:26:18.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.376 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.376 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331891+0000", 2024-04-19T04:26:18.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.376 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.376 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.376 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331896+0000", 2024-04-19T04:26:18.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1209999999999998e-06 2024-04-19T04:26:18.376 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.376 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.376 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331906+0000", 2024-04-19T04:26:18.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0197000000000001e-05 2024-04-19T04:26:18.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331915+0000", 2024-04-19T04:26:18.377 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1179999999999992e-06 2024-04-19T04:26:18.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331952+0000", 2024-04-19T04:26:18.377 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7437000000000001e-05 2024-04-19T04:26:18.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.332092+0000", 2024-04-19T04:26:18.378 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013998 2024-04-19T04:26:18.378 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.378 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.378 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.378 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:205864 5.5 5.b200dba5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.378 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:18.331931+0000", 2024-04-19T04:26:18.378 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9995184, 2024-04-19T04:26:18.378 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00035366800000000002, 2024-04-19T04:26:18.378 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.378 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:18.378 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.378 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.379 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.379 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 205864 2024-04-19T04:26:18.379 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.379 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.379 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.379 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.379 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331931+0000", 2024-04-19T04:26:18.379 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.379 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.379 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.379 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.379 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331931+0000", 2024-04-19T04:26:18.379 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.379 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.380 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.380 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.380 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331931+0000", 2024-04-19T04:26:18.380 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.380 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.380 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.380 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331934+0000", 2024-04-19T04:26:18.380 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5860000000000001e-06 2024-04-19T04:26:18.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.380 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.380 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.380 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331942+0000", 2024-04-19T04:26:18.380 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.464e-06 2024-04-19T04:26:18.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.381 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331948+0000", 2024-04-19T04:26:18.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.156e-06 2024-04-19T04:26:18.381 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.381 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.381 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.381 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:205865 5.f 5:fc7ce0dc:::benchmark_data_smithi007_19526_object80131:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.381 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:18.331953+0000", 2024-04-19T04:26:18.381 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9994965, 2024-04-19T04:26:18.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00039235399999999998, 2024-04-19T04:26:18.381 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.382 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:18.382 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.382 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.382 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.382 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 205865 2024-04-19T04:26:18.382 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.382 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.382 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.382 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.382 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331953+0000", 2024-04-19T04:26:18.382 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.382 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.382 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331953+0000", 2024-04-19T04:26:18.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331953+0000", 2024-04-19T04:26:18.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331956+0000", 2024-04-19T04:26:18.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2629999999999999e-06 2024-04-19T04:26:18.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.384 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.384 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.384 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331962+0000", 2024-04-19T04:26:18.384 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3090000000000001e-06 2024-04-19T04:26:18.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.384 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.384 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.384 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331968+0000", 2024-04-19T04:26:18.384 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3329999999999996e-06 2024-04-19T04:26:18.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.384 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.384 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.384 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.332001+0000", 2024-04-19T04:26:18.385 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.3544000000000003e-05 2024-04-19T04:26:18.385 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.385 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.385 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.385 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.332178+0000", 2024-04-19T04:26:18.385 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017674100000000001 2024-04-19T04:26:18.385 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.385 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.385 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:18.385 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.332321+0000", 2024-04-19T04:26:18.385 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000142757 2024-04-19T04:26:18.385 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.385 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.385 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.386 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.386 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.386 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:205866 5.c 5.589fa88c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.386 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:18.331977+0000", 2024-04-19T04:26:18.386 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9994731, 2024-04-19T04:26:18.386 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000454208, 2024-04-19T04:26:18.386 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.386 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:18.386 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.386 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.386 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.386 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 205866 2024-04-19T04:26:18.386 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.386 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.387 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.387 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331977+0000", 2024-04-19T04:26:18.387 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.387 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.387 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.387 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331977+0000", 2024-04-19T04:26:18.387 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.387 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.387 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.387 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331976+0000", 2024-04-19T04:26:18.387 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.387 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331979+0000", 2024-04-19T04:26:18.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.3289999999999998e-06 2024-04-19T04:26:18.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331986+0000", 2024-04-19T04:26:18.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8000000000000001e-06 2024-04-19T04:26:18.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:18.331992+0000", 2024-04-19T04:26:18.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8900000000000004e-06 2024-04-19T04:26:18.388 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.389 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.389 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.389 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.389 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:18.389 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 14 2024-04-19T04:26:18.389 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:18.390 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:18.398 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:18.397+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:18.499 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:18.497+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:18.519 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:18.520 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:18.520 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:18.520 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:18.520 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:18.533 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:18.600 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:18.597+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:18.663 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:18.663 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:18.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:18.663 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:18.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.663 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:18.663 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:18.663 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 84.430397791999994, 2024-04-19T04:26:18.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:18.664 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.664 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.664 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.664 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.664 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.664 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:18.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.664 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:18.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:18.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:18.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:18.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:18.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:18.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:18.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:18.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:18.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:18.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:18.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:18.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:18.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:18.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:18.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:18.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:18.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:18.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:18.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:18.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:18.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:18.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:18.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:18.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:18.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:18.670 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.670 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.670 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.671 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:18.671 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:18.671 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 84.426302871000004, 2024-04-19T04:26:18.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:18.671 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.671 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.671 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.671 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.671 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.672 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:18.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.672 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:18.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:18.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:18.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:18.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:18.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:18.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:18.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.674 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.674 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:18.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:18.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.674 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.674 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:18.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:18.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:18.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:18.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:18.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:18.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:18.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:18.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:18.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:18.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:18.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:18.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:18.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:18.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:18.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:18.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:18.677 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.677 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.678 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.678 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:18.678 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:18.678 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 84.423011685999995, 2024-04-19T04:26:18.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:18.678 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.678 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.678 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.678 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.678 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.678 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:18.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.679 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:18.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:18.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:18.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:18.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:18.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:18.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:18.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:18.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:18.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:18.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:18.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:18.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:18.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:18.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:18.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:18.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:18.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:18.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:18.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:18.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:18.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:18.683 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:18.683 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:18.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.683 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:18.683 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:18.683 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.683 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.683 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.684 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:18.684 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:18.684 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 62.705622220999999, 2024-04-19T04:26:18.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:18.684 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.684 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:18.684 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.684 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.684 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.684 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:18.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.684 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.684 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:18.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:18.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.685 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:18.685 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.685 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:18.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:18.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.686 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:18.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:18.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.686 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:18.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:18.687 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.687 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.687 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.687 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:18.687 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:18.687 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.687 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.687 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.687 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:18.687 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:18.687 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.687 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.687 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:18.687 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:18.687 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:18.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:18.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:18.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:18.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:18.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:18.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:18.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:18.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:18.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:18.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:18.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:18.689 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.689 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.689 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.690 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:18.690 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:18.690 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 62.685391772000003, 2024-04-19T04:26:18.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:18.690 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.690 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:18.690 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.690 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.690 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.690 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:18.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.690 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.691 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.691 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:18.691 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.691 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.691 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.691 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:18.691 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.691 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.691 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.691 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:18.691 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:18.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.692 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.692 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.692 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:18.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:18.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.692 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.692 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.692 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:18.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:18.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.692 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.692 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.692 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:18.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:18.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.693 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.693 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:18.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:18.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.693 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:18.693 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:18.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:18.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.693 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.693 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:18.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:18.694 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.694 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.694 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.694 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:18.694 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:18.694 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.694 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.694 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.694 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.694 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.694 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:18.694 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:18.694 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 62.685283914999999, 2024-04-19T04:26:18.694 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:18.695 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.695 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:18.695 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.695 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.695 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.695 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:18.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.695 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.695 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.695 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:18.695 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:18.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:18.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:18.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:18.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:18.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:18.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:18.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:18.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:18.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:18.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.698 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.698 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:18.698 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:18.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:18.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.698 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.698 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.698 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:18.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:18.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.698 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.698 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.698 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:18.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:18.699 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.699 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.699 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.699 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:18.699 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:18.699 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 62.683317226, 2024-04-19T04:26:18.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:18.699 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.699 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.699 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.699 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.700 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.700 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:18.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.700 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.700 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.700 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:18.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.700 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.700 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:18.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:18.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:18.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:18.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:18.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:18.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:18.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:18.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:18.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:18.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:18.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:18.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:18.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:18.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:18.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:18.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:18.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:18.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:18.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:18.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.704 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.704 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:18.704 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:18.704 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:18.704 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.704 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.704 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.704 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:18.704 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:18.704 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.704 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.704 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.705 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:18.705 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:18.705 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 62.679953030999997, 2024-04-19T04:26:18.705 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:18.705 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.705 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.705 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.705 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.705 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.705 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:18.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.705 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:18.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:18.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.707 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:18.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.707 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:18.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:18.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.708 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.708 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:18.708 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:18.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.708 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.708 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.708 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:18.708 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:18.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.708 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.708 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.708 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:18.708 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:18.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.709 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.709 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:18.709 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:18.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:18.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.709 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.709 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.709 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:18.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:18.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.709 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.709 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.709 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:18.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:18.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.710 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.710 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:18.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:18.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.710 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.710 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:18.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:18.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:18.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.710 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.710 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:18.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:18.711 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.711 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.711 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.711 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:18.711 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:18.711 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 62.676142053, 2024-04-19T04:26:18.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:18.711 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.711 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.711 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.711 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.712 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.712 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:18.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.712 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.712 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:18.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.712 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:18.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.713 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.713 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.713 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:18.713 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.713 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.713 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.713 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:18.713 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:18.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.713 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.713 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.713 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:18.713 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:18.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.714 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.714 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.714 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:18.714 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:18.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.714 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.714 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.714 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:18.714 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:18.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.714 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.714 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:18.714 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:18.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:18.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:18.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:18.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:18.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:18.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:18.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:18.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:18.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:18.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:18.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:18.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:18.716 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.716 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.716 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.717 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:18.717 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:18.717 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 49.434279695999997, 2024-04-19T04:26:18.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:18.717 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.717 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.717 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.717 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.717 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.717 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:18.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.717 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.718 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.718 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:18.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.718 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.718 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:18.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.718 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.718 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:18.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.719 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.719 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:18.719 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:18.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.719 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.719 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:18.719 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:18.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.719 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.719 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:18.719 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:18.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:18.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:18.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:18.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:18.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:18.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:18.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:18.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:18.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:18.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:18.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:18.721 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.721 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.721 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.722 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:18.722 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:18.722 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 49.433685416000003, 2024-04-19T04:26:18.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:18.722 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.722 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.722 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.722 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.722 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.722 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:18.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.722 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:18.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:18.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:18.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:18.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:18.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:18.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:18.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:18.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:18.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:18.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:18.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:18.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:18.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:18.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:18.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:18.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.726 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:18.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:18.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:18.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.726 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:18.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:18.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.726 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:18.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:18.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:18.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:18.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:18.727 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.727 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.727 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.727 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:18.728 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:18.728 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.709038258, 2024-04-19T04:26:18.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:18.728 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.728 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.728 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.728 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.728 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.728 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:18.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.728 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:18.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:18.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:18.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:18.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:18.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.730 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:18.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:18.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.730 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:18.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:18.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.731 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.731 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:18.731 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:18.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.731 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.731 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.731 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:18.731 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:18.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.731 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.731 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:18.731 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:18.731 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:18.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.731 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:18.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:18.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:18.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:18.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:18.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:18.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:18.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:18.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:18.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:18.733 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.733 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.733 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.733 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:18.733 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:18.733 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.708997842, 2024-04-19T04:26:18.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:18.734 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.734 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.734 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.734 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.734 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.734 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:18.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.734 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:18.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:18.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:18.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:18.736 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:18.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:18.736 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:18.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:18.736 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:18.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.736 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.736 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.736 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:18.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:18.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.737 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:18.737 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:18.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.737 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:18.738 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:18.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:18.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.738 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.738 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.738 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:18.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:18.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.738 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.738 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:18.738 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:18.738 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:18.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.739 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:18.739 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:18.739 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:18.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.739 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.739 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.739 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:18.739 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:18.739 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.739 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.740 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.740 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.740 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:18.740 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:18.740 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.705301533, 2024-04-19T04:26:18.740 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:18.740 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.740 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.740 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.740 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.740 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.740 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:18.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.741 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:18.741 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.741 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:18.741 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.741 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.741 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:18.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.742 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:18.742 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:18.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.742 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.742 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:18.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:18.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.743 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:18.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:18.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.743 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.743 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:18.743 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:18.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.744 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.744 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.744 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:18.744 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:18.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.744 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.744 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:18.744 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:18.744 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:18.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.744 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.744 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.744 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:18.744 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:18.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.745 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.745 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:18.745 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:18.745 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:18.745 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.745 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.745 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:18.745 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:18.745 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:18.745 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.745 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.745 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.745 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:18.745 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:18.746 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.746 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.746 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.746 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.746 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.746 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:18.746 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:18.746 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.451691059, 2024-04-19T04:26:18.746 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:18.746 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.746 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.746 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.746 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.747 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.747 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:18.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.747 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.747 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.747 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.747 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:18.747 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.747 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.747 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.747 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:18.747 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.747 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.748 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.748 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:18.748 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.748 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.748 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.748 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:18.748 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:18.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.748 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.749 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.749 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:18.749 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:18.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.749 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.750 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.750 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:18.750 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:18.750 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.750 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.750 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.750 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:18.750 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:18.750 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.750 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.750 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.750 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:18.750 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:18.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.751 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.751 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.751 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:18.751 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:18.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.751 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.751 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:18.751 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:18.751 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:18.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.751 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.751 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.751 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:18.752 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:18.752 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.752 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.752 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.752 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.752 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:18.752 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:18.752 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.449397647, 2024-04-19T04:26:18.752 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:18.752 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.752 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.752 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.752 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.753 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.753 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:18.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.753 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.753 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.753 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.753 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:18.753 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.753 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.753 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.753 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:18.753 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.754 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.754 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.754 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:18.754 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.754 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.754 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.754 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:18.754 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:18.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.754 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.754 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.754 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:18.754 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:18.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.755 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.755 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:18.755 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:18.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.755 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.755 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:18.755 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:18.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.755 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.755 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:18.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:18.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.756 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.756 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:18.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:18.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.756 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:18.756 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:18.756 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:18.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.756 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.757 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:18.757 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:18.757 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.757 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.757 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.757 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.757 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:18.757 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:18.757 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 14.449351831, 2024-04-19T04:26:18.757 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:18.757 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.757 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.758 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.758 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.758 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.758 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:18.758 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.758 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.758 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.758 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.758 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:18.758 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.758 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.758 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.758 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.759 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:18.759 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.759 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.759 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.759 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:18.759 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.759 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.759 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.759 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:18.759 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:18.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.759 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.760 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.760 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:18.760 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:18.760 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.760 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.760 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.760 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:18.760 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:18.760 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.760 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.760 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.760 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:18.760 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:18.760 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.760 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.761 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.761 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:18.761 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:18.761 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.761 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.761 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:18.761 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:18.761 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.761 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:18.761 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:18.761 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:18.761 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.762 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.762 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.762 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:18.762 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:18.762 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.762 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.762 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.762 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.762 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174342 5.9 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:18.762 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:18.762 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 13.764195130999999, 2024-04-19T04:26:18.762 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068615152999999998, 2024-04-19T04:26:18.762 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.763 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.763 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.763 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.763 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.763 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174342 2024-04-19T04:26:18.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.763 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.763 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.763 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.763 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:18.763 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.763 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.763 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.764 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:18.764 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.764 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.764 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.764 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897726+0000", 2024-04-19T04:26:18.764 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.764 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.764 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.764 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897731+0000", 2024-04-19T04:26:18.764 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1449999999999999e-06 2024-04-19T04:26:18.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.764 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.765 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.765 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897744+0000", 2024-04-19T04:26:18.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2833000000000001e-05 2024-04-19T04:26:18.765 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.765 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.765 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.765 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897749+0000", 2024-04-19T04:26:18.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1540000000000001e-06 2024-04-19T04:26:18.765 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.765 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.765 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.765 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897810+0000", 2024-04-19T04:26:18.765 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0724999999999999e-05 2024-04-19T04:26:18.766 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.766 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.766 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.766 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897920+0000", 2024-04-19T04:26:18.766 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011024 2024-04-19T04:26:18.766 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.766 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.766 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:18.766 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897993+0000", 2024-04-19T04:26:18.766 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2335000000000005e-05 2024-04-19T04:26:18.766 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.766 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.766 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.767 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.899597+0000", 2024-04-19T04:26:18.767 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016048919999999999 2024-04-19T04:26:18.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.767 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.767 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:18.767 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966230+0000", 2024-04-19T04:26:18.767 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.066632882000000004 2024-04-19T04:26:18.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.767 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.767 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:18.767 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966296+0000", 2024-04-19T04:26:18.767 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5361e-05 2024-04-19T04:26:18.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.767 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.767 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.768 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966342+0000", 2024-04-19T04:26:18.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6476e-05 2024-04-19T04:26:18.768 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.768 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.768 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.768 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.768 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174344 5.d 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:18.768 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:18.768 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 13.763516293, 2024-04-19T04:26:18.768 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068211329000000001, 2024-04-19T04:26:18.768 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.768 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.768 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.769 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.769 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.769 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174344 2024-04-19T04:26:18.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.769 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.769 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:18.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.769 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.769 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.769 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:18.769 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.770 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.770 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.770 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898405+0000", 2024-04-19T04:26:18.770 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.770 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.770 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.770 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898409+0000", 2024-04-19T04:26:18.770 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5149999999999998e-06 2024-04-19T04:26:18.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.770 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.770 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.770 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898415+0000", 2024-04-19T04:26:18.771 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:26:18.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.771 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.771 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.771 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898419+0000", 2024-04-19T04:26:18.771 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.89e-06 2024-04-19T04:26:18.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.771 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.771 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.771 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898459+0000", 2024-04-19T04:26:18.771 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0017e-05 2024-04-19T04:26:18.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.772 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.772 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898540+0000", 2024-04-19T04:26:18.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1237999999999997e-05 2024-04-19T04:26:18.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.772 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:18.772 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:18.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6060000000000001e-05 2024-04-19T04:26:18.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.772 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.772 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.901321+0000", 2024-04-19T04:26:18.772 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027152109999999999 2024-04-19T04:26:18.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:18.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966512+0000", 2024-04-19T04:26:18.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.065190440000000002 2024-04-19T04:26:18.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:18.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966563+0000", 2024-04-19T04:26:18.773 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1436e-05 2024-04-19T04:26:18.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.773 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.773 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.773 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966617+0000", 2024-04-19T04:26:18.774 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.401e-05 2024-04-19T04:26:18.774 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.774 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.774 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.774 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.774 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174346 5.f 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:18.774 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:18.774 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 13.761730066, 2024-04-19T04:26:18.774 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.067185536000000004, 2024-04-19T04:26:18.774 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:18.774 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.774 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:18.774 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:18.775 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.775 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174346 2024-04-19T04:26:18.775 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.775 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:18.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.775 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:18.775 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:18.775 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.775 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.775 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:18.775 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:18.775 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:18.775 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.776 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.776 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:18.776 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900191+0000", 2024-04-19T04:26:18.776 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.776 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.776 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:18.776 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900196+0000", 2024-04-19T04:26:18.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3329999999999998e-06 2024-04-19T04:26:18.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:18.777 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900206+0000", 2024-04-19T04:26:18.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9699999999999994e-06 2024-04-19T04:26:18.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.777 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900210+0000", 2024-04-19T04:26:18.777 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3359999999999997e-06 2024-04-19T04:26:18.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.777 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.777 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:18.778 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900243+0000", 2024-04-19T04:26:18.778 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2669999999999997e-05 2024-04-19T04:26:18.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.778 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.778 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:18.778 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900365+0000", 2024-04-19T04:26:18.778 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122648 2024-04-19T04:26:18.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.778 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.778 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:18.778 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900559+0000", 2024-04-19T04:26:18.778 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019358799999999999 2024-04-19T04:26:18.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.778 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.779 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:18.779 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.903018+0000", 2024-04-19T04:26:18.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024592300000000002 2024-04-19T04:26:18.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.779 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.779 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:18.779 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967180+0000", 2024-04-19T04:26:18.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.064161587000000006 2024-04-19T04:26:18.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.779 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.779 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:18.779 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967293+0000", 2024-04-19T04:26:18.779 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112921 2024-04-19T04:26:18.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:18.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:18.780 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:18.780 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967378+0000", 2024-04-19T04:26:18.780 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5000999999999995e-05 2024-04-19T04:26:18.780 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.780 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.780 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.780 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:18.780 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:18.780 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:18.782 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:18.783 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:18.781+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:18.882 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:18.880+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:18.913 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:18.913 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:18.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:207208 5.b 5:dd30f701:::benchmark_data_smithi007_19526_object81474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:18.906060+0000", 2024-04-19T04:26:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0065321579999999997, 2024-04-19T04:26:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0065591720000000003, 2024-04-19T04:26:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 207208 2024-04-19T04:26:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.906060+0000", 2024-04-19T04:26:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.906060+0000", 2024-04-19T04:26:18.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.906060+0000", 2024-04-19T04:26:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.906064+0000", 2024-04-19T04:26:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8060000000000001e-06 2024-04-19T04:26:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.906071+0000", 2024-04-19T04:26:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3479999999999998e-06 2024-04-19T04:26:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.906076+0000", 2024-04-19T04:26:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2809999999999999e-06 2024-04-19T04:26:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.907804+0000", 2024-04-19T04:26:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001728261 2024-04-19T04:26:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.907959+0000", 2024-04-19T04:26:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154921 2024-04-19T04:26:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:207206 5.f e59/20 5:f173476d:::benchmark_data_smithi007_19526_object81472:head v 59'12705, mlcod=59'12702)", 2024-04-19T04:26:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:18.906779+0000", 2024-04-19T04:26:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0058135139999999997, 2024-04-19T04:26:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059130659999999998, 2024-04-19T04:26:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.906779+0000", 2024-04-19T04:26:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.906779+0000", 2024-04-19T04:26:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.906778+0000", 2024-04-19T04:26:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.906789+0000", 2024-04-19T04:26:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1051e-05 2024-04-19T04:26:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.906815+0000", 2024-04-19T04:26:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5559e-05 2024-04-19T04:26:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.906822+0000", 2024-04-19T04:26:18.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6909999999999997e-06 2024-04-19T04:26:18.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.907165+0000", 2024-04-19T04:26:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00034290900000000002 2024-04-19T04:26:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.907177+0000", 2024-04-19T04:26:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.181e-05 2024-04-19T04:26:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:207211 5.4 5:2f1d81c4:::benchmark_data_smithi007_19526_object81477:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:18.909558+0000", 2024-04-19T04:26:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0030342839999999999, 2024-04-19T04:26:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003211392, 2024-04-19T04:26:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 207211 2024-04-19T04:26:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909558+0000", 2024-04-19T04:26:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909558+0000", 2024-04-19T04:26:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909557+0000", 2024-04-19T04:26:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909562+0000", 2024-04-19T04:26:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9590000000000003e-06 2024-04-19T04:26:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909570+0000", 2024-04-19T04:26:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7200000000000006e-06 2024-04-19T04:26:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909575+0000", 2024-04-19T04:26:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1789999999999999e-06 2024-04-19T04:26:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909621+0000", 2024-04-19T04:26:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6371e-05 2024-04-19T04:26:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909771+0000", 2024-04-19T04:26:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014992099999999999 2024-04-19T04:26:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:207212 5.4 5:2cc54bb2:::benchmark_data_smithi007_19526_object81478:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:18.909749+0000", 2024-04-19T04:26:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0028436109999999998, 2024-04-19T04:26:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030845999999999998, 2024-04-19T04:26:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 207212 2024-04-19T04:26:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909749+0000", 2024-04-19T04:26:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909749+0000", 2024-04-19T04:26:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909748+0000", 2024-04-19T04:26:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909752+0000", 2024-04-19T04:26:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1060000000000002e-06 2024-04-19T04:26:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909762+0000", 2024-04-19T04:26:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8530000000000004e-06 2024-04-19T04:26:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909769+0000", 2024-04-19T04:26:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6109999999999999e-06 2024-04-19T04:26:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911785+0000", 2024-04-19T04:26:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020158960000000001 2024-04-19T04:26:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911954+0000", 2024-04-19T04:26:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016920699999999999 2024-04-19T04:26:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:207213 5.b 5:d2839614:::benchmark_data_smithi007_19526_object81479:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:18.909844+0000", 2024-04-19T04:26:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0027488119999999998, 2024-04-19T04:26:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030547220000000002, 2024-04-19T04:26:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 207213 2024-04-19T04:26:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909844+0000", 2024-04-19T04:26:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909844+0000", 2024-04-19T04:26:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909843+0000", 2024-04-19T04:26:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909848+0000", 2024-04-19T04:26:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.549e-06 2024-04-19T04:26:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909857+0000", 2024-04-19T04:26:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3689999999999996e-06 2024-04-19T04:26:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909864+0000", 2024-04-19T04:26:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6780000000000003e-06 2024-04-19T04:26:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.910071+0000", 2024-04-19T04:26:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020779500000000001 2024-04-19T04:26:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.910183+0000", 2024-04-19T04:26:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011174499999999999 2024-04-19T04:26:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:207214 5.a 5:5ac39ace:::benchmark_data_smithi007_19526_object81480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:18.909877+0000", 2024-04-19T04:26:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0027151599999999999, 2024-04-19T04:26:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030843799999999998, 2024-04-19T04:26:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 207214 2024-04-19T04:26:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909877+0000", 2024-04-19T04:26:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909877+0000", 2024-04-19T04:26:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909877+0000", 2024-04-19T04:26:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909880+0000", 2024-04-19T04:26:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8619999999999999e-06 2024-04-19T04:26:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909889+0000", 2024-04-19T04:26:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0280000000000006e-06 2024-04-19T04:26:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909895+0000", 2024-04-19T04:26:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0480000000000004e-06 2024-04-19T04:26:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909938+0000", 2024-04-19T04:26:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3250000000000001e-05 2024-04-19T04:26:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.910050+0000", 2024-04-19T04:26:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111708 2024-04-19T04:26:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:207216 5.b 5:d23c6118:::benchmark_data_smithi007_19526_object81482:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:18.911622+0000", 2024-04-19T04:26:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00097044099999999995, 2024-04-19T04:26:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00140245, 2024-04-19T04:26:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 207216 2024-04-19T04:26:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911622+0000", 2024-04-19T04:26:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911622+0000", 2024-04-19T04:26:18.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911621+0000", 2024-04-19T04:26:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911627+0000", 2024-04-19T04:26:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8289999999999996e-06 2024-04-19T04:26:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911643+0000", 2024-04-19T04:26:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6384000000000001e-05 2024-04-19T04:26:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911654+0000", 2024-04-19T04:26:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.096e-05 2024-04-19T04:26:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911972+0000", 2024-04-19T04:26:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00031754899999999998 2024-04-19T04:26:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.912049+0000", 2024-04-19T04:26:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6701999999999998e-05 2024-04-19T04:26:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:207217 5.b 5.62bf7c2b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:18.911667+0000", 2024-04-19T04:26:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00092518699999999995, 2024-04-19T04:26:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0014205279999999999, 2024-04-19T04:26:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 207217 2024-04-19T04:26:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911667+0000", 2024-04-19T04:26:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911667+0000", 2024-04-19T04:26:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911667+0000", 2024-04-19T04:26:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911670+0000", 2024-04-19T04:26:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6330000000000002e-06 2024-04-19T04:26:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911677+0000", 2024-04-19T04:26:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0709999999999997e-06 2024-04-19T04:26:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911683+0000", 2024-04-19T04:26:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2639999999999999e-06 2024-04-19T04:26:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:207218 5.8 5:1dfad0bd:::benchmark_data_smithi007_19526_object81484:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:18.911688+0000", 2024-04-19T04:26:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00090419000000000003, 2024-04-19T04:26:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001458694, 2024-04-19T04:26:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 207218 2024-04-19T04:26:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911688+0000", 2024-04-19T04:26:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911688+0000", 2024-04-19T04:26:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911688+0000", 2024-04-19T04:26:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911691+0000", 2024-04-19T04:26:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7860000000000001e-06 2024-04-19T04:26:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911697+0000", 2024-04-19T04:26:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0279999999999997e-06 2024-04-19T04:26:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911708+0000", 2024-04-19T04:26:18.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0927000000000001e-05 2024-04-19T04:26:18.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911756+0000", 2024-04-19T04:26:18.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8189000000000002e-05 2024-04-19T04:26:18.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.911930+0000", 2024-04-19T04:26:18.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017404899999999999 2024-04-19T04:26:18.952 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.952 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.952 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.953 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:207200 5.e 5:7546bee2:::benchmark_data_smithi007_19526_object81466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.953 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:18.903693+0000", 2024-04-19T04:26:18.953 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0088995740000000004, 2024-04-19T04:26:18.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0095220909999999999, 2024-04-19T04:26:18.953 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.953 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:18.953 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.953 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.953 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.953 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 207200 2024-04-19T04:26:18.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.953 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.903693+0000", 2024-04-19T04:26:18.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.903693+0000", 2024-04-19T04:26:18.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.903692+0000", 2024-04-19T04:26:18.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.903697+0000", 2024-04-19T04:26:18.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4009999999999996e-06 2024-04-19T04:26:18.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.903708+0000", 2024-04-19T04:26:18.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.046e-05 2024-04-19T04:26:18.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.903714+0000", 2024-04-19T04:26:18.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3929999999999996e-06 2024-04-19T04:26:18.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.956 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.906964+0000", 2024-04-19T04:26:18.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032497160000000001 2024-04-19T04:26:18.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.956 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.907112+0000", 2024-04-19T04:26:18.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000148314 2024-04-19T04:26:18.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:18.956 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.913027+0000", 2024-04-19T04:26:18.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059149479999999997 2024-04-19T04:26:18.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:18.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.913116+0000", 2024-04-19T04:26:18.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9084000000000003e-05 2024-04-19T04:26:18.957 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.957 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.957 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.957 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:207203 5.e 5:7a850325:::benchmark_data_smithi007_19526_object81469:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.957 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:18.904948+0000", 2024-04-19T04:26:18.957 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0076440350000000004, 2024-04-19T04:26:18.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083454110000000005, 2024-04-19T04:26:18.957 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.957 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:18.957 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.958 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.958 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.958 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 207203 2024-04-19T04:26:18.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.958 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.904948+0000", 2024-04-19T04:26:18.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.904948+0000", 2024-04-19T04:26:18.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.904948+0000", 2024-04-19T04:26:18.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.904952+0000", 2024-04-19T04:26:18.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.019e-06 2024-04-19T04:26:18.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.904969+0000", 2024-04-19T04:26:18.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6704000000000001e-05 2024-04-19T04:26:18.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.904978+0000", 2024-04-19T04:26:18.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9779999999999994e-06 2024-04-19T04:26:18.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.908331+0000", 2024-04-19T04:26:18.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033537760000000002 2024-04-19T04:26:18.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.908409+0000", 2024-04-19T04:26:18.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7243999999999994e-05 2024-04-19T04:26:18.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:18.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.913296+0000", 2024-04-19T04:26:18.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004887677 2024-04-19T04:26:18.961 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.961 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.961 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.961 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:207204 5.b 5:d85a22f1:::benchmark_data_smithi007_19526_object81470:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.962 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:18.905870+0000", 2024-04-19T04:26:18.962 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0067227169999999996, 2024-04-19T04:26:18.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007493647, 2024-04-19T04:26:18.962 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.962 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:18.962 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.962 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.962 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.962 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 207204 2024-04-19T04:26:18.962 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.962 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.962 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.962 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.962 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.905870+0000", 2024-04-19T04:26:18.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.905870+0000", 2024-04-19T04:26:18.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.905869+0000", 2024-04-19T04:26:18.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:18.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.905874+0000", 2024-04-19T04:26:18.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5550000000000002e-06 2024-04-19T04:26:18.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.905887+0000", 2024-04-19T04:26:18.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2428e-05 2024-04-19T04:26:18.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.905894+0000", 2024-04-19T04:26:18.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.985e-06 2024-04-19T04:26:18.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.905928+0000", 2024-04-19T04:26:18.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3878000000000003e-05 2024-04-19T04:26:18.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.906005+0000", 2024-04-19T04:26:18.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7179000000000001e-05 2024-04-19T04:26:18.965 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.965 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.965 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.965 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:207205 5.e 5:7ef59022:::benchmark_data_smithi007_19526_object81471:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T04:26:18.965 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:18.905909+0000", 2024-04-19T04:26:18.965 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0066832030000000004, 2024-04-19T04:26:18.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075195770000000004, 2024-04-19T04:26:18.965 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:18.966 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:18.966 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:18.966 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:18.966 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:18.966 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 207205 2024-04-19T04:26:18.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.966 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:18.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:18.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.905909+0000", 2024-04-19T04:26:18.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:18.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.905909+0000", 2024-04-19T04:26:18.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:18.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:18.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.905909+0000", 2024-04-19T04:26:18.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:18.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:18.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.905911+0000", 2024-04-19T04:26:18.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5579999999999999e-06 2024-04-19T04:26:18.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:18.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.905917+0000", 2024-04-19T04:26:18.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8220000000000003e-06 2024-04-19T04:26:18.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:18.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.905922+0000", 2024-04-19T04:26:18.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4859999999999999e-06 2024-04-19T04:26:18.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:18.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909698+0000", 2024-04-19T04:26:18.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037761880000000002 2024-04-19T04:26:18.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:18.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:18.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:18.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:18.909802+0000", 2024-04-19T04:26:18.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103912 2024-04-19T04:26:18.969 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.969 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:18.969 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.969 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:18.969 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:26:18.969 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 13 2024-04-19T04:26:18.969 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:18.970 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:18.983 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:18.980+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:19.084 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:19.084+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:19.096 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:19.096 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:19.096 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:19.096 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:19.096 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:19.108 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:19.185 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:19.184+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:19.230 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:19.230 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:19.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:19.230 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:19.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.230 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:19.230 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:19.230 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 63.276894689999999, 2024-04-19T04:26:19.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:19.230 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.231 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:19.231 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.231 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.231 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.231 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:19.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.231 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:19.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:19.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:19.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:19.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:19.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:19.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:19.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:19.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:19.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:19.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:19.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:19.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:19.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:19.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:19.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:19.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:19.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:19.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:19.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:19.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:19.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:19.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:19.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:19.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:19.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:19.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:19.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:19.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:19.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:19.236 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.236 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.236 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.237 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:19.237 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:19.237 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 63.271833043999997, 2024-04-19T04:26:19.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:19.237 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.237 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:19.237 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.237 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.237 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.237 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:19.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.237 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:19.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:19.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:19.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:19.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:19.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:19.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:19.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:19.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:19.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:19.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:19.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:19.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:19.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:19.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:19.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:19.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:19.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:19.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:19.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:19.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:19.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:19.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:19.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:19.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:19.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:19.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:19.242 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.242 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.242 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.243 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:19.243 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:19.243 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 63.271733132000001, 2024-04-19T04:26:19.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:19.243 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.243 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:19.243 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.243 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.243 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.243 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:19.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.243 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:19.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:19.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:19.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:19.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:19.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:19.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:19.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:19.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:19.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:19.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:19.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:19.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:19.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:19.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:19.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:19.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:19.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:19.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:19.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:19.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:19.249 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.249 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.249 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.249 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:19.249 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:19.249 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 63.271607379000002, 2024-04-19T04:26:19.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:19.249 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.249 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:19.249 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.250 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.250 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.250 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:19.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.250 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:19.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:19.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:19.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:19.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:19.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:19.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:19.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:19.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:19.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:19.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:19.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:19.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:19.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:19.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:19.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:19.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:19.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:19.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:19.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:19.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:19.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:19.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:19.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:19.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:19.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:19.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:19.254 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.254 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.254 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.255 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:19.255 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:19.255 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 63.267763434000003, 2024-04-19T04:26:19.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:19.255 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.255 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:19.255 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.255 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.255 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.255 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:19.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.255 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:19.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:19.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:19.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:19.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:19.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:19.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:19.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:19.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:19.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:19.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:19.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:19.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:19.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:19.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:19.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:19.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:19.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:19.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:19.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:19.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:19.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:19.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:19.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:19.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:19.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:19.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:19.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:19.260 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.260 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.260 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.260 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:19.260 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:19.260 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 63.260592332999998, 2024-04-19T04:26:19.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:19.260 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.260 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:19.261 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.261 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.261 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.261 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:19.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.261 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:19.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:19.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:19.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:19.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:19.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:19.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:19.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:19.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:19.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:19.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:19.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:19.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:19.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:19.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:19.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:19.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:19.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:19.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:19.264 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.264 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.264 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.265 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:19.265 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:19.265 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 63.260420228999998, 2024-04-19T04:26:19.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:19.265 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.265 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:19.265 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.265 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.265 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.265 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:19.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.265 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:19.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:19.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:19.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:19.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:19.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:19.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:19.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:19.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:19.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:19.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:19.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:19.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:19.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:19.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:19.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:19.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:19.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:19.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:19.269 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.269 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.269 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.269 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:19.269 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:19.269 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 63.260357104000001, 2024-04-19T04:26:19.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:19.269 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.269 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:19.269 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.270 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.270 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.270 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:19.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.270 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:19.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:19.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:19.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:19.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:19.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:19.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:19.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:19.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:19.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:19.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:19.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:19.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:19.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:19.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:19.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:19.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:19.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:19.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:19.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:19.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:19.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:19.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:19.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:19.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:19.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:19.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:19.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:19.274 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.274 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.274 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.275 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:19.275 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:19.275 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 63.260228507000001, 2024-04-19T04:26:19.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:19.275 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.275 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:19.275 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.275 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.275 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.275 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:19.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.275 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:19.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:19.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:19.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:19.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:19.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:19.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:19.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:19.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:19.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:19.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:19.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:19.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:19.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:19.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:19.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:19.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:19.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:19.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:19.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:19.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:19.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:19.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:19.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:19.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:19.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:19.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:19.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:19.280 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.281 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.281 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.281 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:19.281 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:19.281 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 63.260160536000001, 2024-04-19T04:26:19.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:19.281 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.281 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:19.281 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.281 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.281 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.281 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:19.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.282 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:19.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:19.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:19.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:19.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:19.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:19.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:19.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:19.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:19.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:19.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:19.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:19.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:19.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:19.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:19.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:19.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:19.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:19.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:19.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:19.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:19.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:19.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:19.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:19.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:19.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:19.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:19.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:19.286 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.286 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.286 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.286 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:19.286 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:19.286 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.340620871, 2024-04-19T04:26:19.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078453623, 2024-04-19T04:26:19.287 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.287 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:19.287 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.287 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.287 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.287 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:19.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.287 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:19.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:19.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:19.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:19.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:19.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:19.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:19.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:19.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:19.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:19.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:19.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:19.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:19.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:19.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:19.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:19.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965893+0000", 2024-04-19T04:26:19.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.076646455000000002 2024-04-19T04:26:19.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965956+0000", 2024-04-19T04:26:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3200000000000005e-05 2024-04-19T04:26:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966068+0000", 2024-04-19T04:26:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011194800000000001 2024-04-19T04:26:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.340589874000001, 2024-04-19T04:26:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083782388999999999, 2024-04-19T04:26:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971179+0000", 2024-04-19T04:26:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079349476000000002 2024-04-19T04:26:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971259+0000", 2024-04-19T04:26:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9083000000000002e-05 2024-04-19T04:26:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971428+0000", 2024-04-19T04:26:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169419 2024-04-19T04:26:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.338268354, 2024-04-19T04:26:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081686998999999996, 2024-04-19T04:26:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971454+0000", 2024-04-19T04:26:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077525997999999999 2024-04-19T04:26:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971540+0000", 2024-04-19T04:26:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6285000000000005e-05 2024-04-19T04:26:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971654+0000", 2024-04-19T04:26:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114095 2024-04-19T04:26:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.337057972, 2024-04-19T04:26:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080734265999999999, 2024-04-19T04:26:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971677+0000", 2024-04-19T04:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.073192023999999994 2024-04-19T04:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971771+0000", 2024-04-19T04:26:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4235999999999997e-05 2024-04-19T04:26:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971912+0000", 2024-04-19T04:26:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014055099999999999 2024-04-19T04:26:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.336106481, 2024-04-19T04:26:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085645857000000006, 2024-04-19T04:26:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977634+0000", 2024-04-19T04:26:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077144335999999994 2024-04-19T04:26:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977699+0000", 2024-04-19T04:26:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4518999999999997e-05 2024-04-19T04:26:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977775+0000", 2024-04-19T04:26:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6219999999999999e-05 2024-04-19T04:26:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.333098903, 2024-04-19T04:26:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075403611999999995, 2024-04-19T04:26:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970369+0000", 2024-04-19T04:26:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.074967992999999997 2024-04-19T04:26:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970419+0000", 2024-04-19T04:26:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9700999999999997e-05 2024-04-19T04:26:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970540+0000", 2024-04-19T04:26:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121512 2024-04-19T04:26:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5:78f758ec:::benchmark_data_smithi007_19526_object48602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.332724778999999, 2024-04-19T04:26:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085171609999999995, 2024-04-19T04:26:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966154+0000", 2024-04-19T04:26:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.070613543000000001 2024-04-19T04:26:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966382+0000", 2024-04-19T04:26:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022741800000000001 2024-04-19T04:26:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980581+0000", 2024-04-19T04:26:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014199916999999999 2024-04-19T04:26:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980621+0000", 2024-04-19T04:26:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9685999999999999e-05 2024-04-19T04:26:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980682+0000", 2024-04-19T04:26:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1130000000000006e-05 2024-04-19T04:26:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.332634827, 2024-04-19T04:26:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075073230000000005, 2024-04-19T04:26:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970556+0000", 2024-04-19T04:26:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.072076192999999997 2024-04-19T04:26:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970608+0000", 2024-04-19T04:26:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2549000000000001e-05 2024-04-19T04:26:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970674+0000", 2024-04-19T04:26:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5549000000000005e-05 2024-04-19T04:26:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5:70a7bb5e:::benchmark_data_smithi007_19526_object48614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.32754783, 2024-04-19T04:26:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080099220999999998, 2024-04-19T04:26:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971978+0000", 2024-04-19T04:26:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.071282358000000004 2024-04-19T04:26:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.972180+0000", 2024-04-19T04:26:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020191100000000001 2024-04-19T04:26:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980701+0000", 2024-04-19T04:26:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085211760000000001 2024-04-19T04:26:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980729+0000", 2024-04-19T04:26:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8068e-05 2024-04-19T04:26:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980787+0000", 2024-04-19T04:26:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7521e-05 2024-04-19T04:26:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174350 5.e 5:7f36609a:::benchmark_data_smithi007_19526_object48616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.325776758, 2024-04-19T04:26:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079723622999999993, 2024-04-19T04:26:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174350 2024-04-19T04:26:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902458+0000", 2024-04-19T04:26:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902463+0000", 2024-04-19T04:26:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5889999999999996e-06 2024-04-19T04:26:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965576+0000", 2024-04-19T04:26:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063113328999999996 2024-04-19T04:26:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965614+0000", 2024-04-19T04:26:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8285999999999999e-05 2024-04-19T04:26:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974787+0000", 2024-04-19T04:26:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009172599 2024-04-19T04:26:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974999+0000", 2024-04-19T04:26:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021270999999999999 2024-04-19T04:26:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982086+0000", 2024-04-19T04:26:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070869160000000004 2024-04-19T04:26:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982115+0000", 2024-04-19T04:26:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8603999999999999e-05 2024-04-19T04:26:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982182+0000", 2024-04-19T04:26:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7350999999999999e-05 2024-04-19T04:26:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:19.337 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:19.338 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:26:19.340 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-04-19T04:26:19.340 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:19.337+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:19.340 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:19.439 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:19.436+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:19.468 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:19.468 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:19.468 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.468 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:208475 5.7 5:e2e122fc:::benchmark_data_smithi007_19526_object82741:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:19.468 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:19.460681+0000", 2024-04-19T04:26:19.468 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0076237620000000001, 2024-04-19T04:26:19.468 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0076428169999999997, 2024-04-19T04:26:19.468 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:19.469 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:19.469 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:19.469 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:19.469 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.469 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 208475 2024-04-19T04:26:19.469 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.469 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:19.469 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.469 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:19.469 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.460681+0000", 2024-04-19T04:26:19.469 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.469 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.469 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.469 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:19.469 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.460681+0000", 2024-04-19T04:26:19.470 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.470 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.470 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.470 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:19.470 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.460681+0000", 2024-04-19T04:26:19.470 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:19.470 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.470 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.470 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:19.470 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.460685+0000", 2024-04-19T04:26:19.470 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.702e-06 2024-04-19T04:26:19.470 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.470 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.470 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:19.471 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.460701+0000", 2024-04-19T04:26:19.471 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5928000000000001e-05 2024-04-19T04:26:19.471 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.471 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.471 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.471 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.460708+0000", 2024-04-19T04:26:19.471 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0450000000000003e-06 2024-04-19T04:26:19.471 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.471 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.471 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:19.471 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.460759+0000", 2024-04-19T04:26:19.471 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0736999999999999e-05 2024-04-19T04:26:19.471 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.471 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.472 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:19.472 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.460906+0000", 2024-04-19T04:26:19.472 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014711499999999999 2024-04-19T04:26:19.472 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.472 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:19.472 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.472 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.472 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.472 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:208477 5.1 5:82c4a62b:::benchmark_data_smithi007_19526_object82743:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:19.472 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:19.461628+0000", 2024-04-19T04:26:19.472 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0066770070000000004, 2024-04-19T04:26:19.472 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.006742858, 2024-04-19T04:26:19.472 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:19.472 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:19.473 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:19.473 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:19.473 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.473 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 208477 2024-04-19T04:26:19.473 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.473 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:19.473 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.473 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:19.473 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461628+0000", 2024-04-19T04:26:19.473 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.473 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.473 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.473 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:19.473 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461628+0000", 2024-04-19T04:26:19.473 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.474 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.474 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.474 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:19.474 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461627+0000", 2024-04-19T04:26:19.474 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:19.474 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.474 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.474 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:19.474 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461631+0000", 2024-04-19T04:26:19.474 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.8840000000000004e-06 2024-04-19T04:26:19.474 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.474 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.474 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:19.474 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461646+0000", 2024-04-19T04:26:19.475 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4246999999999999e-05 2024-04-19T04:26:19.475 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.475 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.475 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.475 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461655+0000", 2024-04-19T04:26:19.475 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0580000000000004e-06 2024-04-19T04:26:19.475 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.475 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.475 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:19.475 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461680+0000", 2024-04-19T04:26:19.475 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5406e-05 2024-04-19T04:26:19.475 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.475 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.475 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:19.476 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461799+0000", 2024-04-19T04:26:19.476 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000119258 2024-04-19T04:26:19.476 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.476 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:19.476 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.476 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.476 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.476 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:208479 5.5 5:abe40fca:::benchmark_data_smithi007_19526_object82745:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:19.476 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:19.461737+0000", 2024-04-19T04:26:19.476 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0065684999999999997, 2024-04-19T04:26:19.476 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0066836029999999998, 2024-04-19T04:26:19.476 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:19.476 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:19.476 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:19.477 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:19.477 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.477 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 208479 2024-04-19T04:26:19.477 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.477 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:19.477 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.478 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:19.478 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461737+0000", 2024-04-19T04:26:19.478 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.478 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.478 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.478 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:19.478 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461737+0000", 2024-04-19T04:26:19.478 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.478 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.478 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.478 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:19.479 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461736+0000", 2024-04-19T04:26:19.479 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:19.479 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.479 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.479 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:19.479 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461739+0000", 2024-04-19T04:26:19.479 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.3419999999999999e-06 2024-04-19T04:26:19.479 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.479 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.479 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:19.480 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461750+0000", 2024-04-19T04:26:19.480 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0448999999999999e-05 2024-04-19T04:26:19.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.480 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.480 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.480 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461753+0000", 2024-04-19T04:26:19.480 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.8010000000000001e-06 2024-04-19T04:26:19.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.480 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.480 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:19.480 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461805+0000", 2024-04-19T04:26:19.480 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1650000000000002e-05 2024-04-19T04:26:19.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.480 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.480 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:19.481 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461956+0000", 2024-04-19T04:26:19.481 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000151199 2024-04-19T04:26:19.481 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.481 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:19.481 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.481 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.481 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.481 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:208480 5.5 5:a180c970:::benchmark_data_smithi007_19526_object82746:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:19.481 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:19.461764+0000", 2024-04-19T04:26:19.481 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0065409889999999997, 2024-04-19T04:26:19.481 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0066915639999999997, 2024-04-19T04:26:19.481 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:19.481 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:19.481 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:19.482 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:19.482 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.482 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 208480 2024-04-19T04:26:19.482 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.482 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:19.482 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.482 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:19.482 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461764+0000", 2024-04-19T04:26:19.482 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.482 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.482 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.482 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:19.482 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461764+0000", 2024-04-19T04:26:19.482 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.483 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.483 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.483 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:19.483 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461764+0000", 2024-04-19T04:26:19.483 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:19.483 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.483 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.483 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:19.483 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461766+0000", 2024-04-19T04:26:19.483 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9759999999999998e-06 2024-04-19T04:26:19.483 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.483 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.483 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:19.483 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461779+0000", 2024-04-19T04:26:19.484 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2843000000000001e-05 2024-04-19T04:26:19.484 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.484 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.484 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.484 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461784+0000", 2024-04-19T04:26:19.484 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0610000000000003e-06 2024-04-19T04:26:19.484 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.484 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.484 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:19.484 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.464092+0000", 2024-04-19T04:26:19.484 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002307824 2024-04-19T04:26:19.484 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.484 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.485 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:19.485 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.464171+0000", 2024-04-19T04:26:19.485 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9023999999999994e-05 2024-04-19T04:26:19.485 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.485 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:19.485 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.485 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.485 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.485 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:208483 5.6 5:6697d28d:::benchmark_data_smithi007_19526_object82749:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:19.485 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:19.461867+0000", 2024-04-19T04:26:19.485 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0064377230000000002, 2024-04-19T04:26:19.485 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0066224379999999996, 2024-04-19T04:26:19.485 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:19.485 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:19.486 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:19.486 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:19.486 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.486 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 208483 2024-04-19T04:26:19.486 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.486 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:19.486 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.486 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:19.486 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461867+0000", 2024-04-19T04:26:19.486 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.486 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.486 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.486 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:19.486 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461867+0000", 2024-04-19T04:26:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461867+0000", 2024-04-19T04:26:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:19.488 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461871+0000", 2024-04-19T04:26:19.488 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.8809999999999998e-06 2024-04-19T04:26:19.488 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.488 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.488 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:19.488 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461877+0000", 2024-04-19T04:26:19.488 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9129999999999997e-06 2024-04-19T04:26:19.488 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.488 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.488 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.488 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461882+0000", 2024-04-19T04:26:19.488 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0180000000000003e-06 2024-04-19T04:26:19.488 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.489 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.489 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:19.489 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461929+0000", 2024-04-19T04:26:19.489 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7466999999999998e-05 2024-04-19T04:26:19.489 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.489 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.489 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:19.489 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.462065+0000", 2024-04-19T04:26:19.489 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013561199999999999 2024-04-19T04:26:19.489 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.489 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:19.489 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.489 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.489 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.490 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:208484 5.1 5:8a0999ab:::benchmark_data_smithi007_19526_object82750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:19.490 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:19.461903+0000", 2024-04-19T04:26:19.490 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0064023910000000003, 2024-04-19T04:26:19.490 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0066194579999999999, 2024-04-19T04:26:19.490 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:19.490 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:19.490 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:19.490 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:19.490 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.490 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 208484 2024-04-19T04:26:19.490 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.490 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:19.490 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.490 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:19.491 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461903+0000", 2024-04-19T04:26:19.491 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.491 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.491 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.491 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:19.491 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461903+0000", 2024-04-19T04:26:19.491 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.491 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.491 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.491 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:19.491 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461902+0000", 2024-04-19T04:26:19.491 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:19.491 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.491 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.492 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:19.492 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461906+0000", 2024-04-19T04:26:19.492 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4769999999999999e-06 2024-04-19T04:26:19.492 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.492 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.492 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:19.492 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461913+0000", 2024-04-19T04:26:19.492 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5320000000000001e-06 2024-04-19T04:26:19.492 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.492 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.492 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.492 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.461919+0000", 2024-04-19T04:26:19.492 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9479999999999996e-06 2024-04-19T04:26:19.492 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.492 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.493 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:19.493 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.464178+0000", 2024-04-19T04:26:19.493 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0022585650000000001 2024-04-19T04:26:19.493 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.493 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.493 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:19.493 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.464275+0000", 2024-04-19T04:26:19.493 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7158999999999996e-05 2024-04-19T04:26:19.493 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.493 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:19.493 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.493 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.493 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.493 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:208487 5.5 5:a5fcd175:::benchmark_data_smithi007_19526_object82753:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:19.493 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:19.464030+0000", 2024-04-19T04:26:19.494 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0042748889999999996, 2024-04-19T04:26:19.494 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0045244880000000001, 2024-04-19T04:26:19.494 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:19.494 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:19.494 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:19.494 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:19.494 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.494 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 208487 2024-04-19T04:26:19.494 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.495 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:19.495 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.495 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:19.496 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.464030+0000", 2024-04-19T04:26:19.497 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.497 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.497 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.497 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:19.497 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.464030+0000", 2024-04-19T04:26:19.497 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.498 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.498 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.498 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:19.498 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.464029+0000", 2024-04-19T04:26:19.498 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:19.498 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.498 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.499 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:19.499 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.464036+0000", 2024-04-19T04:26:19.499 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.533e-06 2024-04-19T04:26:19.499 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.499 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.499 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:19.499 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.464056+0000", 2024-04-19T04:26:19.499 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.0398999999999999e-05 2024-04-19T04:26:19.499 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.499 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.499 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.499 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.464070+0000", 2024-04-19T04:26:19.499 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4178999999999999e-05 2024-04-19T04:26:19.499 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.500 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.500 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:19.500 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465465+0000", 2024-04-19T04:26:19.500 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0013945979999999999 2024-04-19T04:26:19.500 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.500 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.500 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:19.501 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465545+0000", 2024-04-19T04:26:19.501 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9537999999999996e-05 2024-04-19T04:26:19.501 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.501 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:19.501 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.501 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.501 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.501 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:208488 5.9 5:97429cdd:::benchmark_data_smithi007_19526_object82754:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:19.501 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:19.465677+0000", 2024-04-19T04:26:19.501 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0026283579999999999, 2024-04-19T04:26:19.501 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002912623, 2024-04-19T04:26:19.501 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:19.501 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:19.501 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:19.502 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:19.502 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.502 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 208488 2024-04-19T04:26:19.502 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.502 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:19.502 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.502 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:19.502 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465677+0000", 2024-04-19T04:26:19.502 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.502 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.502 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.502 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:19.502 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465677+0000", 2024-04-19T04:26:19.502 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.503 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.503 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.503 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:19.503 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465676+0000", 2024-04-19T04:26:19.503 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:19.503 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.503 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.503 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:19.503 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465682+0000", 2024-04-19T04:26:19.503 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4570000000000002e-06 2024-04-19T04:26:19.503 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.503 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.503 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:19.503 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465694+0000", 2024-04-19T04:26:19.503 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2225999999999999e-05 2024-04-19T04:26:19.504 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.504 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.504 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.504 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465703+0000", 2024-04-19T04:26:19.504 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4570000000000005e-06 2024-04-19T04:26:19.504 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.504 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.504 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:19.504 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465782+0000", 2024-04-19T04:26:19.504 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9552e-05 2024-04-19T04:26:19.504 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.504 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.504 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:19.504 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465883+0000", 2024-04-19T04:26:19.505 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000100473 2024-04-19T04:26:19.505 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.505 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.505 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:19.505 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465949+0000", 2024-04-19T04:26:19.505 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6284000000000004e-05 2024-04-19T04:26:19.505 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.505 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:19.505 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.505 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.505 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.505 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:208489 5.6 5:6ec76bc3:::benchmark_data_smithi007_19526_object82755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:19.506 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:19.465727+0000", 2024-04-19T04:26:19.506 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.002577771, 2024-04-19T04:26:19.506 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028976340000000001, 2024-04-19T04:26:19.506 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:19.506 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:19.506 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:19.507 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:19.507 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.507 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 208489 2024-04-19T04:26:19.507 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.507 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:19.507 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.507 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:19.507 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465727+0000", 2024-04-19T04:26:19.507 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.507 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.507 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.507 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:19.507 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465727+0000", 2024-04-19T04:26:19.507 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.508 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.508 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:19.508 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465727+0000", 2024-04-19T04:26:19.508 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:19.508 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.508 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:19.508 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465731+0000", 2024-04-19T04:26:19.508 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3560000000000003e-06 2024-04-19T04:26:19.508 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.508 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:19.508 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465740+0000", 2024-04-19T04:26:19.508 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.3729999999999999e-06 2024-04-19T04:26:19.509 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.509 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.509 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.509 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465749+0000", 2024-04-19T04:26:19.509 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.8359999999999998e-06 2024-04-19T04:26:19.509 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.509 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.509 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:19.509 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465801+0000", 2024-04-19T04:26:19.509 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1579999999999997e-05 2024-04-19T04:26:19.509 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.509 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.509 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:19.509 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.465984+0000", 2024-04-19T04:26:19.509 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000183117 2024-04-19T04:26:19.510 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.510 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:19.510 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.510 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.510 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.511 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:208491 5.7 5:ea9e5c67:::benchmark_data_smithi007_19526_object82757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:19.511 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:19.467872+0000", 2024-04-19T04:26:19.511 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0004327, 2024-04-19T04:26:19.511 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00078478599999999999, 2024-04-19T04:26:19.511 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:19.511 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:19.512 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:19.512 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:19.512 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.512 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 208491 2024-04-19T04:26:19.512 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.512 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:19.512 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.513 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:19.513 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467872+0000", 2024-04-19T04:26:19.513 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.513 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.513 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.513 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:19.513 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467872+0000", 2024-04-19T04:26:19.513 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.513 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.513 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.513 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:19.513 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467871+0000", 2024-04-19T04:26:19.513 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:19.513 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.513 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.514 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:19.514 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467878+0000", 2024-04-19T04:26:19.514 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4160000000000001e-06 2024-04-19T04:26:19.514 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.514 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.514 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:19.514 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467892+0000", 2024-04-19T04:26:19.514 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4272e-05 2024-04-19T04:26:19.514 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.515 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.515 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.515 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467901+0000", 2024-04-19T04:26:19.515 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1509999999999993e-06 2024-04-19T04:26:19.515 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.515 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.515 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:19.515 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467954+0000", 2024-04-19T04:26:19.515 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2944e-05 2024-04-19T04:26:19.516 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.516 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.516 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:19.516 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.468102+0000", 2024-04-19T04:26:19.516 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000147751 2024-04-19T04:26:19.516 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.516 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:19.516 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.516 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.516 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.516 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:208492 5.f 5:ff32ba7c:::benchmark_data_smithi007_19526_object82758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:19.516 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:19.467928+0000", 2024-04-19T04:26:19.517 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00037700199999999998, 2024-04-19T04:26:19.517 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00076102400000000001, 2024-04-19T04:26:19.517 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:19.517 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:19.517 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:19.517 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:19.517 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.517 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 208492 2024-04-19T04:26:19.517 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.517 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:19.517 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.517 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:19.517 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467928+0000", 2024-04-19T04:26:19.517 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.518 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.518 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:19.518 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467928+0000", 2024-04-19T04:26:19.518 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.518 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.518 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:19.518 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467927+0000", 2024-04-19T04:26:19.518 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:19.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.518 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.518 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:19.518 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467932+0000", 2024-04-19T04:26:19.519 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6650000000000002e-06 2024-04-19T04:26:19.519 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.519 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.519 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:19.519 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467941+0000", 2024-04-19T04:26:19.519 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.8009999999999993e-06 2024-04-19T04:26:19.519 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.519 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.519 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.519 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467949+0000", 2024-04-19T04:26:19.519 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8259999999999993e-06 2024-04-19T04:26:19.519 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.519 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.519 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:19.519 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467980+0000", 2024-04-19T04:26:19.520 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1059000000000002e-05 2024-04-19T04:26:19.520 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.520 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.520 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:19.520 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.468124+0000", 2024-04-19T04:26:19.520 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014429500000000001 2024-04-19T04:26:19.520 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.520 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.520 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:19.520 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.468214+0000", 2024-04-19T04:26:19.520 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0593000000000005e-05 2024-04-19T04:26:19.520 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.520 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:19.520 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.520 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.520 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.521 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:208493 5.c 5:3ebbc5dd:::benchmark_data_smithi007_19526_object82759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:19.521 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:19.467962+0000", 2024-04-19T04:26:19.521 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.000342732, 2024-04-19T04:26:19.521 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00076187200000000003, 2024-04-19T04:26:19.521 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:19.521 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:19.521 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:19.521 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:19.521 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:19.521 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 208493 2024-04-19T04:26:19.521 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.521 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:19.521 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.521 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:19.521 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467962+0000", 2024-04-19T04:26:19.522 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.522 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.522 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.522 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:19.522 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467962+0000", 2024-04-19T04:26:19.522 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:19.522 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.522 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.522 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:19.522 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467962+0000", 2024-04-19T04:26:19.522 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:19.522 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.522 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.522 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:19.523 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467965+0000", 2024-04-19T04:26:19.523 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.3560000000000001e-06 2024-04-19T04:26:19.523 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.523 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.523 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:19.523 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467973+0000", 2024-04-19T04:26:19.523 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1589999999999993e-06 2024-04-19T04:26:19.523 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.523 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.523 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:19.523 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.467980+0000", 2024-04-19T04:26:19.523 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5540000000000003e-06 2024-04-19T04:26:19.523 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.523 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.524 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:19.524 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.468029+0000", 2024-04-19T04:26:19.524 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9477000000000001e-05 2024-04-19T04:26:19.524 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:19.524 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:19.524 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:19.524 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:19.468190+0000", 2024-04-19T04:26:19.524 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016093699999999999 2024-04-19T04:26:19.524 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.524 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:19.524 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.524 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:19.524 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:19.524 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 12 2024-04-19T04:26:19.524 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:19.525 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:19.526 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:19.526 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:19.527 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:19.527 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:19.527 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:19.528 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:19.528 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:19.572 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:19.572+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:19.642 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:19.640+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:19.657 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:19.658 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:19.670 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:19.744 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:19.740+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:19.804 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:19.805 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:19.817 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:19.845 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:19.841+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:19.939 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:19.940 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:19.946 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:19.944+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:19.952 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:20.047 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:20.044+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:20.082 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:20.082 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:20.094 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:20.147 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:20.144+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:20.217 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:20.217 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:20.230 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:20.248 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:20.244+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:20.348 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:20.348+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:20.355 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:20.355 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:20.369 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:20.449 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:20.448+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:20.501 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:20.501 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:20.513 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:20.551 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:20.548+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:20.643 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:20.643 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:20.651 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:20.648+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:20.655 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:20.752 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:20.752+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:20.777 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:20.777 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:20.789 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:20.854 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:20.852+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:20.907 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:20.907 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:20.919 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:20.955 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:20.952+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:21.041 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:21.041 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:21.053 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:21.056 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:21.052+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:21.158 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:21.156+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:21.180 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:21.180 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:21.193 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:21.257 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:21.256+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:21.321 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:21.321 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:21.333 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:21.341 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T04:26:21.358 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:21.356+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:21.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~65s 2024-04-19T04:26:21.458 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:21.456+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:21.459 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:21.459 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:21.471 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:21.529 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:26:21.559 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:21.556+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:21.596 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:21.597 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:21.608 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:21.660 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:21.660+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:21.677 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:21.698 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:21.698 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:21.698 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:21.699 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:21.700 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:21.701 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:21.734 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:21.734 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:21.734 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:21.734 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:21.734 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:21.747 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:21.761 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:21.756+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:21.862 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:21.860+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:21.873 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:21.873 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:21.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:21.873 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:21.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.874 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:21.874 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:21.874 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 65.919871127999997, 2024-04-19T04:26:21.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:21.874 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.874 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:21.874 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.874 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.874 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.874 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:21.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.874 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:21.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:21.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:21.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:21.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:21.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:21.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:21.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:21.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:21.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:21.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:21.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:21.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:21.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:21.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:21.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:21.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:21.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:21.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:21.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:21.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:21.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:21.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:21.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:21.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:21.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:21.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:21.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:21.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:21.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:21.880 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.880 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.880 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.881 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:21.881 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:21.881 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 65.914809481999995, 2024-04-19T04:26:21.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:21.881 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.881 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:21.881 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.881 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.881 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.881 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:21.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.881 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:21.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:21.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:21.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:21.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:21.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:21.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:21.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:21.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:21.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:21.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:21.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:21.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:21.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:21.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:21.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:21.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:21.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:21.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:21.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:21.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:21.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:21.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:21.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:21.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:21.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:21.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:21.887 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.887 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.887 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.888 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:21.888 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:21.888 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 65.914709569999999, 2024-04-19T04:26:21.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:21.888 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.888 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:21.888 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.888 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.888 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.888 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:21.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.888 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:21.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:21.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:21.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:21.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:21.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:21.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:21.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:21.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:21.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:21.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:21.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:21.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:21.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:21.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:21.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:21.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:21.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:21.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:21.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:21.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:21.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:21.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:21.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:21.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:21.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:21.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:21.893 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.893 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.893 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.893 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:21.893 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:21.894 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 65.914583816999993, 2024-04-19T04:26:21.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:21.894 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.894 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:21.894 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.894 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.894 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.894 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:21.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.894 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:21.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:21.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:21.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:21.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:21.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:21.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:21.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:21.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:21.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:21.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:21.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:21.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:21.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:21.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:21.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:21.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:21.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:21.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:21.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:21.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:21.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:21.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:21.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:21.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:21.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:21.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:21.899 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.899 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.899 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.899 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:21.899 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:21.899 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 65.910739871999994, 2024-04-19T04:26:21.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:21.899 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.900 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:21.900 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.900 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.900 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.900 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:21.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.900 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:21.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:21.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:21.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:21.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:21.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:21.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:21.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:21.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:21.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:21.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:21.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:21.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:21.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:21.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:21.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:21.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:21.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:21.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:21.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:21.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:21.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:21.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:21.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:21.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:21.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:21.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:21.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:21.905 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.905 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.905 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.905 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:21.905 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:21.905 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 65.903568770999996, 2024-04-19T04:26:21.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:21.905 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.905 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:21.905 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.906 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.906 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.906 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:21.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.906 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:21.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:21.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:21.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:21.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:21.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:21.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:21.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:21.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:21.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:21.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:21.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:21.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:21.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:21.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:21.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:21.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:21.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:21.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:21.910 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.910 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.910 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.910 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:21.910 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:21.910 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 65.903396666999996, 2024-04-19T04:26:21.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:21.910 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.910 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:21.911 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.911 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.911 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.911 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:21.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.911 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:21.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:21.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:21.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:21.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:21.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:21.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:21.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:21.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:21.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:21.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:21.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:21.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:21.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:21.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:21.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:21.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:21.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:21.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:21.915 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.915 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.915 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.915 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:21.915 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:21.916 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 65.903333541999999, 2024-04-19T04:26:21.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:21.916 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.916 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:21.916 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.916 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.916 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.916 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:21.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.916 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:21.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:21.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:21.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:21.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:21.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:21.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:21.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:21.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:21.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:21.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:21.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:21.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:21.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:21.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:21.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:21.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:21.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:21.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:21.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:21.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:21.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:21.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:21.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:21.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:21.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:21.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:21.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:21.921 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.921 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.921 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.921 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:21.921 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:21.922 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 65.903204944999999, 2024-04-19T04:26:21.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:21.922 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.922 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:21.922 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.922 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.922 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.922 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:21.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.922 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:21.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:21.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:21.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:21.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:21.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:21.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:21.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:21.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:21.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:21.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:21.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:21.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:21.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:21.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:21.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:21.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:21.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:21.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:21.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:21.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:21.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:21.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:21.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:21.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:21.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:21.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:21.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:21.927 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.927 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.927 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.927 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:21.927 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:21.927 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 65.903136974000006, 2024-04-19T04:26:21.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:21.927 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.928 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:21.928 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.928 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.928 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.928 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:21.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.928 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:21.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:21.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:21.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:21.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:21.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:21.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:21.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:21.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:21.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:21.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:21.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:21.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:21.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:21.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:21.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:21.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:21.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:21.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:21.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:21.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:21.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:21.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:21.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:21.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:21.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:21.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:21.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:21.933 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.933 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.933 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.933 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:21.933 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:21.933 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.983597309, 2024-04-19T04:26:21.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078453623, 2024-04-19T04:26:21.933 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.933 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:21.933 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.933 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.933 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.934 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:21.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.934 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:21.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:21.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:21.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:21.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:21.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:21.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.936 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:21.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:21.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.936 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:21.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:21.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:21.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:21.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:21.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:21.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:21.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:21.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965893+0000", 2024-04-19T04:26:21.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.076646455000000002 2024-04-19T04:26:21.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:21.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965956+0000", 2024-04-19T04:26:21.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3200000000000005e-05 2024-04-19T04:26:21.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966068+0000", 2024-04-19T04:26:21.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011194800000000001 2024-04-19T04:26:21.938 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.938 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.938 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.939 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:21.939 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:21.939 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.983566312000001, 2024-04-19T04:26:21.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083782388999999999, 2024-04-19T04:26:21.939 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.939 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:21.939 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.939 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.939 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.939 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:21.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.940 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:21.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:21.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:21.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:21.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:21.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:21.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:21.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:21.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:21.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:21.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:21.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:21.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:21.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:21.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:21.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:21.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971179+0000", 2024-04-19T04:26:21.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079349476000000002 2024-04-19T04:26:21.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:21.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971259+0000", 2024-04-19T04:26:21.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9083000000000002e-05 2024-04-19T04:26:21.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971428+0000", 2024-04-19T04:26:21.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169419 2024-04-19T04:26:21.944 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.944 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.944 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.944 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:21.944 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:21.944 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.981244791999998, 2024-04-19T04:26:21.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081686998999999996, 2024-04-19T04:26:21.945 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.945 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:21.945 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.945 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.945 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.945 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:21.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.945 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:21.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:21.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:21.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:21.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:21.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:21.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:21.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:21.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:21.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:21.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:21.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:21.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:21.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:21.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:21.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:21.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971454+0000", 2024-04-19T04:26:21.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077525997999999999 2024-04-19T04:26:21.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:21.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971540+0000", 2024-04-19T04:26:21.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6285000000000005e-05 2024-04-19T04:26:21.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971654+0000", 2024-04-19T04:26:21.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114095 2024-04-19T04:26:21.949 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.949 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.949 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.949 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:21.949 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:21.949 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.980034410000002, 2024-04-19T04:26:21.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080734265999999999, 2024-04-19T04:26:21.950 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.950 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:21.950 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.950 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.950 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.950 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:21.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.950 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:21.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:21.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:21.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:21.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:21.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:21.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:21.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:21.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:21.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:21.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:21.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:21.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:21.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:21.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:21.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:21.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971677+0000", 2024-04-19T04:26:21.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.073192023999999994 2024-04-19T04:26:21.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:21.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971771+0000", 2024-04-19T04:26:21.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4235999999999997e-05 2024-04-19T04:26:21.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971912+0000", 2024-04-19T04:26:21.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014055099999999999 2024-04-19T04:26:21.954 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.954 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.954 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.954 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:21.955 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:21.955 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.979082919, 2024-04-19T04:26:21.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085645857000000006, 2024-04-19T04:26:21.955 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.955 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:21.955 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.955 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.955 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.955 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:21.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.955 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:21.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.956 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:21.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.956 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:21.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:21.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:21.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:21.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:21.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:21.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:21.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:21.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:21.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:21.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:21.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:21.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:21.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:21.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977634+0000", 2024-04-19T04:26:21.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077144335999999994 2024-04-19T04:26:21.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:21.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977699+0000", 2024-04-19T04:26:21.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4518999999999997e-05 2024-04-19T04:26:21.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977775+0000", 2024-04-19T04:26:21.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6219999999999999e-05 2024-04-19T04:26:21.959 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.959 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.960 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.960 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:21.960 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:21.960 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.976075341000001, 2024-04-19T04:26:21.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075403611999999995, 2024-04-19T04:26:21.960 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.960 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:21.960 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.960 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.960 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.960 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:21.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.961 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:21.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:21.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:21.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:21.962 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.962 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.962 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.962 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:21.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:21.962 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.962 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:21.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:21.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:21.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:21.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:21.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:21.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:21.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:21.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:21.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:21.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970369+0000", 2024-04-19T04:26:21.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.074967992999999997 2024-04-19T04:26:21.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:21.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970419+0000", 2024-04-19T04:26:21.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9700999999999997e-05 2024-04-19T04:26:21.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970540+0000", 2024-04-19T04:26:21.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121512 2024-04-19T04:26:21.965 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.965 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.965 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.965 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5:78f758ec:::benchmark_data_smithi007_19526_object48602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:21.965 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:21.965 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.975701217000001, 2024-04-19T04:26:21.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085171609999999995, 2024-04-19T04:26:21.966 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.966 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:21.966 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.966 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.966 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.966 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:21.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.966 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:21.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:21.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:21.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:21.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:21.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:21.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:21.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:21.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:21.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:21.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966154+0000", 2024-04-19T04:26:21.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.070613543000000001 2024-04-19T04:26:21.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:21.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966382+0000", 2024-04-19T04:26:21.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022741800000000001 2024-04-19T04:26:21.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:21.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980581+0000", 2024-04-19T04:26:21.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014199916999999999 2024-04-19T04:26:21.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:21.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980621+0000", 2024-04-19T04:26:21.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9685999999999999e-05 2024-04-19T04:26:21.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.970 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.970 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980682+0000", 2024-04-19T04:26:21.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1130000000000006e-05 2024-04-19T04:26:21.970 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.970 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.970 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.970 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:21.970 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:21.970 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.975611265000001, 2024-04-19T04:26:21.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075073230000000005, 2024-04-19T04:26:21.970 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.971 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:21.971 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.971 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.971 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.971 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:21.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.971 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:21.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:21.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:21.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:21.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:21.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:21.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:21.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:21.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:21.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:21.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:21.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:21.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:21.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:21.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:21.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:21.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970556+0000", 2024-04-19T04:26:21.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.072076192999999997 2024-04-19T04:26:21.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:21.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970608+0000", 2024-04-19T04:26:21.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2549000000000001e-05 2024-04-19T04:26:21.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970674+0000", 2024-04-19T04:26:21.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5549000000000005e-05 2024-04-19T04:26:21.975 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.975 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.975 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.975 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5:70a7bb5e:::benchmark_data_smithi007_19526_object48614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:21.975 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:21.975 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.970524267999998, 2024-04-19T04:26:21.976 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080099220999999998, 2024-04-19T04:26:21.976 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.976 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:21.976 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.976 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.976 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.976 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:21.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.976 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.976 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.976 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:21.976 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:21.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:21.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:21.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:21.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:21.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:21.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:21.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:21.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:21.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971978+0000", 2024-04-19T04:26:21.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.071282358000000004 2024-04-19T04:26:21.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:21.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.972180+0000", 2024-04-19T04:26:21.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020191100000000001 2024-04-19T04:26:21.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:21.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980701+0000", 2024-04-19T04:26:21.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085211760000000001 2024-04-19T04:26:21.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:21.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980729+0000", 2024-04-19T04:26:21.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8068e-05 2024-04-19T04:26:21.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980787+0000", 2024-04-19T04:26:21.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7521e-05 2024-04-19T04:26:21.980 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.980 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.980 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.980 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174350 5.e 5:7f36609a:::benchmark_data_smithi007_19526_object48616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:21.980 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:21.980 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.968753196000002, 2024-04-19T04:26:21.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079723622999999993, 2024-04-19T04:26:21.980 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:21.981 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:21.981 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:21.981 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:21.981 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:21.981 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174350 2024-04-19T04:26:21.981 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.981 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:21.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:21.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:21.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.981 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:21.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:21.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:21.982 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.982 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.982 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:21.982 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902458+0000", 2024-04-19T04:26:21.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:21.982 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.982 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.982 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:21.982 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902463+0000", 2024-04-19T04:26:21.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5889999999999996e-06 2024-04-19T04:26:21.982 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.982 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:21.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965576+0000", 2024-04-19T04:26:21.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063113328999999996 2024-04-19T04:26:21.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:21.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965614+0000", 2024-04-19T04:26:21.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8285999999999999e-05 2024-04-19T04:26:21.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:21.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974787+0000", 2024-04-19T04:26:21.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009172599 2024-04-19T04:26:21.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:21.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974999+0000", 2024-04-19T04:26:21.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021270999999999999 2024-04-19T04:26:21.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:21.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982086+0000", 2024-04-19T04:26:21.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070869160000000004 2024-04-19T04:26:21.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:21.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982115+0000", 2024-04-19T04:26:21.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8603999999999999e-05 2024-04-19T04:26:21.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:21.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:21.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:21.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982182+0000", 2024-04-19T04:26:21.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7350999999999999e-05 2024-04-19T04:26:21.985 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.985 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.985 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.985 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:21.985 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:21.985 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:21.986 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:21.984+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:21.987 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:22.088 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:22.088+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:22.120 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:214692 5.5 5:a485c0dd:::benchmark_data_smithi007_19526_object88958:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:22.112266+0000", 2024-04-19T04:26:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0072141920000000003, 2024-04-19T04:26:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00724378, 2024-04-19T04:26:22.120 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 214692 2024-04-19T04:26:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.112266+0000", 2024-04-19T04:26:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.112266+0000", 2024-04-19T04:26:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.112265+0000", 2024-04-19T04:26:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.112271+0000", 2024-04-19T04:26:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1019999999999996e-06 2024-04-19T04:26:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.112283+0000", 2024-04-19T04:26:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1932e-05 2024-04-19T04:26:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.112288+0000", 2024-04-19T04:26:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9209999999999997e-06 2024-04-19T04:26:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.113625+0000", 2024-04-19T04:26:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0013362179999999999 2024-04-19T04:26:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.113819+0000", 2024-04-19T04:26:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019399200000000001 2024-04-19T04:26:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:214695 5.7 5:edb8d55f:::benchmark_data_smithi007_19526_object88961:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:22.113017+0000", 2024-04-19T04:26:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0064634109999999996, 2024-04-19T04:26:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0065802209999999998, 2024-04-19T04:26:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:22.124 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 214695 2024-04-19T04:26:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.113017+0000", 2024-04-19T04:26:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.113017+0000", 2024-04-19T04:26:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.113016+0000", 2024-04-19T04:26:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.113022+0000", 2024-04-19T04:26:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6969999999999998e-06 2024-04-19T04:26:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.113037+0000", 2024-04-19T04:26:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4713e-05 2024-04-19T04:26:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.113044+0000", 2024-04-19T04:26:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8040000000000002e-06 2024-04-19T04:26:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.113119+0000", 2024-04-19T04:26:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4747999999999997e-05 2024-04-19T04:26:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.128 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.113224+0000", 2024-04-19T04:26:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000105067 2024-04-19T04:26:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:214696 5.7 5:e9c35f3c:::benchmark_data_smithi007_19526_object88962:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:22.113401+0000", 2024-04-19T04:26:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.006079114, 2024-04-19T04:26:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062735239999999999, 2024-04-19T04:26:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:22.129 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 214696 2024-04-19T04:26:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.113401+0000", 2024-04-19T04:26:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.113401+0000", 2024-04-19T04:26:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.113401+0000", 2024-04-19T04:26:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.113405+0000", 2024-04-19T04:26:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5630000000000002e-06 2024-04-19T04:26:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.113428+0000", 2024-04-19T04:26:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.2915999999999999e-05 2024-04-19T04:26:22.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.113435+0000", 2024-04-19T04:26:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7630000000000003e-06 2024-04-19T04:26:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115354+0000", 2024-04-19T04:26:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0019188829999999999 2024-04-19T04:26:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115440+0000", 2024-04-19T04:26:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.6265000000000002e-05 2024-04-19T04:26:22.132 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:214697 5.d 5:b4006a3a:::benchmark_data_smithi007_19526_object88963:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:22.114191+0000", 2024-04-19T04:26:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0052895679999999997, 2024-04-19T04:26:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055600670000000001, 2024-04-19T04:26:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 214697 2024-04-19T04:26:22.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.134 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.134 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.134 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114191+0000", 2024-04-19T04:26:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114191+0000", 2024-04-19T04:26:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114190+0000", 2024-04-19T04:26:22.135 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114196+0000", 2024-04-19T04:26:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8150000000000002e-06 2024-04-19T04:26:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114207+0000", 2024-04-19T04:26:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1385e-05 2024-04-19T04:26:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.136 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114215+0000", 2024-04-19T04:26:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4150000000000002e-06 2024-04-19T04:26:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114281+0000", 2024-04-19T04:26:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6353000000000007e-05 2024-04-19T04:26:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114445+0000", 2024-04-19T04:26:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016403300000000001 2024-04-19T04:26:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114560+0000", 2024-04-19T04:26:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115189 2024-04-19T04:26:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.118317+0000", 2024-04-19T04:26:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003757294 2024-04-19T04:26:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:214698 5.9 5:92de3389:::benchmark_data_smithi007_19526_object88964:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:22.114383+0000", 2024-04-19T04:26:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0050975980000000001, 2024-04-19T04:26:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0054593869999999996, 2024-04-19T04:26:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.139 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 214698 2024-04-19T04:26:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114383+0000", 2024-04-19T04:26:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114383+0000", 2024-04-19T04:26:22.140 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114382+0000", 2024-04-19T04:26:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114388+0000", 2024-04-19T04:26:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4770000000000002e-06 2024-04-19T04:26:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.141 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114399+0000", 2024-04-19T04:26:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1634000000000001e-05 2024-04-19T04:26:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114415+0000", 2024-04-19T04:26:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5999999999999999e-05 2024-04-19T04:26:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114459+0000", 2024-04-19T04:26:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3958999999999997e-05 2024-04-19T04:26:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.142 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114605+0000", 2024-04-19T04:26:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014586300000000001 2024-04-19T04:26:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114727+0000", 2024-04-19T04:26:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121878 2024-04-19T04:26:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.117773+0000", 2024-04-19T04:26:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003046258 2024-04-19T04:26:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.143 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:214700 5.5 5:a5235252:::benchmark_data_smithi007_19526_object88966:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:22.114649+0000", 2024-04-19T04:26:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0048312839999999999, 2024-04-19T04:26:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0052887120000000001, 2024-04-19T04:26:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 214700 2024-04-19T04:26:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.144 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114649+0000", 2024-04-19T04:26:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114649+0000", 2024-04-19T04:26:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114648+0000", 2024-04-19T04:26:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114654+0000", 2024-04-19T04:26:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1510000000000003e-06 2024-04-19T04:26:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114664+0000", 2024-04-19T04:26:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114672+0000", 2024-04-19T04:26:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3760000000000002e-06 2024-04-19T04:26:22.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115965+0000", 2024-04-19T04:26:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001293396 2024-04-19T04:26:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.116095+0000", 2024-04-19T04:26:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012975000000000001 2024-04-19T04:26:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.147 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:214701 5.c 5:39f01ee1:::benchmark_data_smithi007_19526_object88967:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:22.114691+0000", 2024-04-19T04:26:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0047891959999999999, 2024-04-19T04:26:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0053270380000000001, 2024-04-19T04:26:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 214701 2024-04-19T04:26:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114691+0000", 2024-04-19T04:26:22.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114691+0000", 2024-04-19T04:26:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114691+0000", 2024-04-19T04:26:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114695+0000", 2024-04-19T04:26:22.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3100000000000002e-06 2024-04-19T04:26:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114704+0000", 2024-04-19T04:26:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1190000000000003e-06 2024-04-19T04:26:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114710+0000", 2024-04-19T04:26:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2890000000000003e-06 2024-04-19T04:26:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114758+0000", 2024-04-19T04:26:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7988000000000002e-05 2024-04-19T04:26:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.114885+0000", 2024-04-19T04:26:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000126167 2024-04-19T04:26:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:214703 5.7 5:eaf624a6:::benchmark_data_smithi007_19526_object88969:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:22.115176+0000", 2024-04-19T04:26:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0043044190000000003, 2024-04-19T04:26:22.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0049268280000000003, 2024-04-19T04:26:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 214703 2024-04-19T04:26:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115176+0000", 2024-04-19T04:26:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.152 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115176+0000", 2024-04-19T04:26:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115175+0000", 2024-04-19T04:26:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115179+0000", 2024-04-19T04:26:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.177e-06 2024-04-19T04:26:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115193+0000", 2024-04-19T04:26:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3657e-05 2024-04-19T04:26:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115198+0000", 2024-04-19T04:26:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2360000000000004e-06 2024-04-19T04:26:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.118171+0000", 2024-04-19T04:26:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002972976 2024-04-19T04:26:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.154 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.118318+0000", 2024-04-19T04:26:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014630000000000001 2024-04-19T04:26:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:214705 5.3 5:c63aa525:::benchmark_data_smithi007_19526_object88971:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:22.115430+0000", 2024-04-19T04:26:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0040508899999999997, 2024-04-19T04:26:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0047578070000000002, 2024-04-19T04:26:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.155 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 214705 2024-04-19T04:26:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115430+0000", 2024-04-19T04:26:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115430+0000", 2024-04-19T04:26:22.156 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115429+0000", 2024-04-19T04:26:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115434+0000", 2024-04-19T04:26:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3959999999999997e-06 2024-04-19T04:26:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115444+0000", 2024-04-19T04:26:22.157 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5219999999999996e-06 2024-04-19T04:26:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115451+0000", 2024-04-19T04:26:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9119999999999998e-06 2024-04-19T04:26:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115506+0000", 2024-04-19T04:26:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4985999999999998e-05 2024-04-19T04:26:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115653+0000", 2024-04-19T04:26:22.158 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014644699999999999 2024-04-19T04:26:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:214706 5.1 5:8be843af:::benchmark_data_smithi007_19526_object88972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:22.115613+0000", 2024-04-19T04:26:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0038676539999999999, 2024-04-19T04:26:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0046548750000000002, 2024-04-19T04:26:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.159 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 214706 2024-04-19T04:26:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115613+0000", 2024-04-19T04:26:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115613+0000", 2024-04-19T04:26:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115612+0000", 2024-04-19T04:26:22.160 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.161 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.161 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.161 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.161 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115617+0000", 2024-04-19T04:26:22.161 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1739999999999999e-06 2024-04-19T04:26:22.161 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.161 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.161 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.161 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115628+0000", 2024-04-19T04:26:22.161 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0528e-05 2024-04-19T04:26:22.161 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.161 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.161 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.161 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115635+0000", 2024-04-19T04:26:22.161 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4019999999999996e-06 2024-04-19T04:26:22.162 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.162 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.162 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.162 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115679+0000", 2024-04-19T04:26:22.162 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4277999999999999e-05 2024-04-19T04:26:22.162 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.162 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.162 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.162 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.115803+0000", 2024-04-19T04:26:22.162 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012410500000000001 2024-04-19T04:26:22.162 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.162 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.162 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.162 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.163 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.163 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:214709 5.d 5:b8303b64:::benchmark_data_smithi007_19526_object88975:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T04:26:22.163 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:22.118693+0000", 2024-04-19T04:26:22.163 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00078734300000000003, 2024-04-19T04:26:22.163 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001656226, 2024-04-19T04:26:22.163 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.163 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:22.163 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.163 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.163 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.163 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 214709 2024-04-19T04:26:22.163 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.163 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.163 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.163 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.164 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.118693+0000", 2024-04-19T04:26:22.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.164 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.164 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.164 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.118693+0000", 2024-04-19T04:26:22.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.164 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.164 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.164 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.118692+0000", 2024-04-19T04:26:22.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.164 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.164 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.118698+0000", 2024-04-19T04:26:22.165 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5249999999999996e-06 2024-04-19T04:26:22.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.118710+0000", 2024-04-19T04:26:22.165 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1756000000000001e-05 2024-04-19T04:26:22.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.118716+0000", 2024-04-19T04:26:22.165 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0889999999999996e-06 2024-04-19T04:26:22.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.118756+0000", 2024-04-19T04:26:22.166 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0509999999999997e-05 2024-04-19T04:26:22.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.166 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.166 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.166 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.118848+0000", 2024-04-19T04:26:22.166 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2279000000000002e-05 2024-04-19T04:26:22.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.166 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.166 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:22.166 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:22.118918+0000", 2024-04-19T04:26:22.166 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9330000000000002e-05 2024-04-19T04:26:22.166 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.166 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.166 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.166 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.167 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:22.167 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 11 2024-04-19T04:26:22.167 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:22.168 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:22.190 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:22.188+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:22.285 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2024-04-19T04:26:22.292 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:22.292+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:22.299 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:22.299 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:22.299 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:22.299 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:22.299 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:22.312 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:22.393 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:22.388+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:22.493 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:22.493 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:22.493 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:22.493 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:22.493 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.493 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:22.493 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:22.493 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 88.2601674, 2024-04-19T04:26:22.493 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:22.493 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.493 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:22.493 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.494 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.494 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.494 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:22.494 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.494 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.494 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.494 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.494 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:22.494 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.494 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.494 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.494 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.494 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:22.494 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.495 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.495 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.495 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.495 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:22.495 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.495 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.495 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.495 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.495 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:22.495 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:22.495 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.495 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.495 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.495 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:22.495 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:22.496 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.496 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.496 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.496 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:22.496 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:22.496 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.496 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.496 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.496 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:22.496 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:22.496 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.496 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.496 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.496 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:22.497 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:22.497 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.497 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.497 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:22.497 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:22.497 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:22.497 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.497 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.497 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:22.497 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:22.497 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:22.497 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.497 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.497 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:22.497 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:22.498 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:22.498 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.498 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.498 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:22.498 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:22.498 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:22.498 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.498 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.498 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.498 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:22.499 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:22.499 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.499 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.499 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.499 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.499 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.499 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:22.499 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:22.499 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 88.256072478999997, 2024-04-19T04:26:22.499 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:22.499 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.499 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:22.499 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.499 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.499 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.500 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:22.500 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.500 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.500 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.500 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.500 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:22.500 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.500 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.500 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.500 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.500 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:22.500 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.500 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.500 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.500 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.501 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:22.501 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.501 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.501 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.501 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.501 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:22.501 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:22.501 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.501 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.501 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.501 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:22.501 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:22.501 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.501 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.501 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.502 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:22.502 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:22.502 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.502 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.502 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.502 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:22.502 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:22.502 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.502 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.502 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.502 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:22.502 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:22.502 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.502 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.503 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:22.503 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:22.503 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:22.503 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.503 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.503 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:22.503 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:22.503 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:22.503 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.503 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.503 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:22.503 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:22.503 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:22.503 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.503 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.504 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:22.504 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:22.504 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:22.504 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.504 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.504 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.504 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:22.504 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:22.504 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.504 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.504 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.504 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.504 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.504 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:22.504 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:22.505 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 88.252781294000002, 2024-04-19T04:26:22.505 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:22.505 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.505 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:22.505 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.505 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.505 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.505 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:22.505 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.505 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.505 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.506 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.506 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:22.506 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.506 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.506 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.506 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.506 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:22.506 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.506 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.506 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.506 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.506 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:22.506 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.507 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.507 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.507 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.507 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:22.507 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:22.507 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.507 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.507 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.507 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:22.507 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:22.507 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.507 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.507 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.507 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:22.507 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:22.508 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.508 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.508 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:22.508 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:22.508 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.508 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.508 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:22.508 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:22.508 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.508 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:22.508 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:22.508 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:22.509 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.509 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.509 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:22.509 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:22.509 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:22.509 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.509 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.509 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:22.509 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:22.509 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:22.509 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.509 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.509 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:22.509 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:22.509 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:22.510 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.510 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.510 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.510 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:22.510 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:22.510 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.510 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.510 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.510 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.511 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.511 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:22.511 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:22.511 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 66.535391829000005, 2024-04-19T04:26:22.511 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:22.511 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.511 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:22.511 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.511 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.511 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.511 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:22.511 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.512 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.512 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.512 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.512 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:22.512 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.512 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.512 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.512 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.512 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:22.512 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.512 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.512 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.512 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.512 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:22.513 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:22.513 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.513 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.513 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.513 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:22.513 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:22.513 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.513 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.513 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.513 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:22.513 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:22.513 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.513 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.513 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.514 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:22.514 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:22.514 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.514 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.514 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.514 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:22.514 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:22.514 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.514 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.514 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.514 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:22.514 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:22.514 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.514 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.515 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:22.515 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:22.515 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:22.515 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.515 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.515 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:22.515 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:22.515 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:22.515 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.515 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.515 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.515 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:22.515 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:22.515 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.515 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.516 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:22.516 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:22.516 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:22.516 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.516 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.516 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.516 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:22.516 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:22.516 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.516 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.516 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.516 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:22.516 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:22.516 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.516 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.517 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.517 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.517 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.517 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:22.517 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:22.517 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 66.515161379999995, 2024-04-19T04:26:22.517 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:22.517 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.517 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:22.517 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.517 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.517 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.517 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:22.517 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.517 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.518 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.518 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.518 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:22.518 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.518 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.518 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.518 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:22.518 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.518 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.518 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.518 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:22.518 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:22.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.519 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.519 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.519 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:22.519 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:22.519 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.519 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.519 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.519 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:22.519 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:22.519 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.519 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.520 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.520 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:22.520 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:22.520 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.520 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.520 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.520 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:22.520 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:22.520 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.520 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.521 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:22.521 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:22.521 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:22.521 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.521 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.521 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.521 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:22.521 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:22.521 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.521 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.521 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.521 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:22.521 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:22.521 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.522 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.522 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.522 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.522 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.522 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:22.522 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:22.522 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 66.515053523000006, 2024-04-19T04:26:22.522 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:22.522 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.522 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:22.522 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.522 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.522 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.523 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:22.523 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.523 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.523 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.523 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.523 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:22.523 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.523 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.523 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.523 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.523 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:22.523 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.523 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.523 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.524 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.524 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:22.524 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:22.524 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.524 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.524 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.524 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:22.524 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:22.524 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.524 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.524 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.524 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:22.524 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:22.524 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.525 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.525 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.525 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:22.525 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:22.525 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.525 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.525 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.525 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:22.525 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:22.525 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.525 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.525 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:22.525 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:22.525 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:22.526 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.526 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.526 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.526 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:22.526 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:22.526 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.526 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.526 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.526 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:22.526 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:22.526 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.526 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.526 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.526 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.527 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.527 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:22.527 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:22.527 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 66.513086834000006, 2024-04-19T04:26:22.527 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:22.527 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.527 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:22.527 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.527 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.527 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.527 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:22.527 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.528 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.528 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.528 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.528 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:22.528 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.528 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.528 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.528 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.528 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:22.528 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.528 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.528 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.528 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.528 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:22.528 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:22.529 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.529 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.529 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.529 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:22.529 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:22.529 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.529 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.529 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.529 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:22.529 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:22.529 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.529 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.529 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.529 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:22.529 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:22.530 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.530 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.530 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.530 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:22.530 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:22.530 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.530 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.530 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:22.530 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:22.530 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:22.530 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.530 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.530 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.530 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:22.531 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:22.531 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.531 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.531 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.531 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:22.531 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:22.531 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.531 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.531 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:22.531 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:22.531 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:22.531 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.531 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.531 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:22.532 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:22.532 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:22.532 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.532 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.532 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.532 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:22.532 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:22.532 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.532 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.533 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.533 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.533 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.533 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:22.533 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:22.533 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 66.509722639000003, 2024-04-19T04:26:22.533 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:22.533 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.533 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:22.533 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.533 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.533 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.533 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:22.533 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.533 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.534 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.534 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.534 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:22.534 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.534 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.534 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.534 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.534 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:22.534 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.534 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.534 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.534 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.534 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:22.534 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.535 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.535 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.535 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.535 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:22.535 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:22.535 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.535 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.535 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.535 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:22.535 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:22.535 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.535 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.535 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.535 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:22.535 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:22.536 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.536 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.536 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.536 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:22.536 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:22.536 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.536 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.536 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:22.536 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:22.536 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:22.536 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.536 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.536 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.536 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:22.536 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:22.537 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.537 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.537 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.537 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:22.537 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:22.537 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.537 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.537 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:22.537 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:22.537 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:22.537 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.538 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.538 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:22.538 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:22.538 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:22.538 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.538 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.538 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.538 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:22.538 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:22.538 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.538 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.538 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.538 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.538 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.539 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:22.539 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:22.539 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 66.505911660999999, 2024-04-19T04:26:22.539 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:22.539 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.539 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:22.539 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.539 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.539 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.539 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:22.539 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.539 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.539 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.539 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.540 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:22.540 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.540 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.540 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.540 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.540 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:22.540 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.540 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.540 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.540 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.540 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:22.540 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.540 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.540 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.540 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.541 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:22.541 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:22.541 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.541 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.541 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.541 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:22.541 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:22.541 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.541 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.541 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.541 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:22.541 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:22.541 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.542 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.542 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.542 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:22.542 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:22.542 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.542 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.542 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:22.542 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:22.542 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:22.542 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.542 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.542 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.542 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:22.542 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:22.542 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.543 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.543 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.543 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:22.543 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:22.543 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.543 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.543 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:22.543 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:22.543 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:22.543 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.543 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.543 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:22.543 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:22.543 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:22.543 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.544 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.544 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.544 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:22.544 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:22.544 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.544 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.544 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.544 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.544 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.544 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:22.544 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:22.544 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 53.264049303999997, 2024-04-19T04:26:22.544 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:22.544 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.544 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:22.545 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.545 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.545 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.545 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:22.545 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.545 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.545 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.545 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.545 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:22.545 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.545 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.545 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.545 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.545 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:22.546 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.546 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.546 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.546 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.546 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:22.546 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:22.546 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.546 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.546 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.546 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:22.546 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:22.546 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.546 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.547 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.547 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:22.547 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:22.547 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.547 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.547 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.547 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:22.547 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:22.547 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.547 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.547 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.547 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:22.547 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:22.547 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.547 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.548 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.548 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:22.548 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:22.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.548 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.548 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:22.548 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:22.548 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:22.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.548 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.548 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:22.548 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:22.548 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:22.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.548 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.549 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.549 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:22.549 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:22.549 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.549 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.549 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.549 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.549 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.549 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:22.549 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:22.549 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 53.263455024000002, 2024-04-19T04:26:22.549 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:22.549 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.549 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:22.550 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.550 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.550 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.550 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:22.550 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.550 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.550 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.550 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.550 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:22.550 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.550 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.551 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.551 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.551 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:22.551 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.551 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.551 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.551 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.551 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:22.551 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.551 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.551 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.551 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.551 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:22.551 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:22.552 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.552 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.552 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.552 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:22.552 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:22.552 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.552 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.552 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.552 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:22.552 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:22.552 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.552 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.552 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.552 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:22.552 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:22.553 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.553 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.553 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.553 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:22.553 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:22.553 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.553 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.553 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:22.553 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:22.553 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:22.553 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.553 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.553 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:22.553 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:22.554 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:22.554 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.554 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.554 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:22.554 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:22.554 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:22.554 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.554 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.554 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:22.554 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:22.554 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:22.554 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.554 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.554 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.555 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:22.555 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:22.555 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.555 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.555 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.555 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.555 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.555 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:22.555 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:22.555 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.538807865999999, 2024-04-19T04:26:22.555 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:22.555 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.555 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:22.555 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.556 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.556 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.556 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:22.556 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.556 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.556 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.556 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.556 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:22.556 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.556 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.556 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.556 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.556 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:22.556 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.557 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.557 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.557 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.557 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:22.557 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:22.557 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.557 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.557 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.557 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:22.557 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:22.557 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.557 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.557 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.557 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:22.558 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:22.558 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.558 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.558 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.558 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:22.558 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:22.558 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.558 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.558 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.558 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:22.558 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:22.558 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.558 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.558 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.558 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:22.559 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:22.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.559 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.559 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:22.559 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:22.559 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:22.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.559 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.559 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:22.559 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:22.559 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:22.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.559 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.560 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:22.560 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:22.560 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:22.560 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.560 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.560 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:22.560 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:22.560 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:22.560 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.560 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.560 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.560 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:22.560 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:22.561 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.561 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.561 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.561 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.561 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.561 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:22.561 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:22.561 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.538767450000002, 2024-04-19T04:26:22.561 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:22.561 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.561 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:22.561 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.561 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.561 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.562 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:22.562 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.562 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.562 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.562 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:22.562 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.562 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.562 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.562 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:22.562 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.562 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:22.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:22.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:22.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:22.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:22.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:22.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.564 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.564 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:22.564 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:22.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.564 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.564 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.564 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:22.564 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:22.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.564 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.564 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.564 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:22.564 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:22.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.564 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.565 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:22.565 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:22.565 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:22.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.565 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:22.565 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:22.565 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:22.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.565 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:22.565 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:22.565 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:22.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.566 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.566 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:22.567 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:22.567 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:22.567 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.567 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.567 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.567 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:22.567 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:22.567 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.567 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.567 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.567 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.567 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.567 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:22.568 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:22.568 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.535071141, 2024-04-19T04:26:22.568 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:22.568 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.568 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:22.568 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.568 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.568 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.568 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:22.568 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.568 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.568 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.568 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.568 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:22.569 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.569 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.569 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.569 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.569 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:22.569 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.569 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.569 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.569 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.569 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:22.569 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.569 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.569 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.569 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.569 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:22.570 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:22.570 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.570 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.570 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.570 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:22.570 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:22.570 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.570 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.570 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.570 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:22.570 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:22.570 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.570 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.570 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.571 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:22.571 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:22.571 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.571 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.571 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.571 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:22.571 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:22.571 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.571 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.571 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:22.571 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:22.571 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:22.571 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.571 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.571 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:22.572 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:22.572 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:22.572 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.572 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.572 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:22.572 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:22.572 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:22.572 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.572 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.572 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:22.572 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:22.573 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:22.573 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.573 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.573 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.573 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:22.573 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:22.574 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.574 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.574 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.574 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.574 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.574 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:22.574 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:22.574 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.281460667000001, 2024-04-19T04:26:22.574 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:22.574 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.574 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:22.574 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.574 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.574 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.575 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:22.575 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.575 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.575 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.575 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.575 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:22.575 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.575 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.575 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.575 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.575 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:22.575 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.575 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.575 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.576 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.576 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:22.576 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:22.576 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.576 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.576 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.576 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:22.576 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:22.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.577 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.577 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.577 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:22.577 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:22.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.577 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.577 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.577 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:22.577 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:22.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.577 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.577 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.577 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:22.578 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:22.578 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.578 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.578 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.578 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:22.578 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:22.578 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.578 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.578 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:22.578 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:22.578 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:22.578 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.578 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.579 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:22.579 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:22.579 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:22.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.579 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.579 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:22.579 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:22.579 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.579 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.579 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.579 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:22.579 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:22.580 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.279167255000001, 2024-04-19T04:26:22.580 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:22.580 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.580 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:22.580 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.580 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.580 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.580 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:22.580 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.580 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.580 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.580 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.580 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:22.580 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.581 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.581 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.581 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:22.581 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.581 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.581 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.581 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:22.581 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.581 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.581 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.582 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:22.582 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:22.582 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.582 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.582 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.582 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:22.582 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:22.582 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.582 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.582 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.582 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:22.582 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:22.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.583 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.583 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.583 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:22.583 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:22.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.583 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.583 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.583 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:22.583 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:22.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.583 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.583 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:22.583 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:22.584 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:22.584 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.584 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.584 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:22.584 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:22.584 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:22.584 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.584 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.584 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.584 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:22.584 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:22.585 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.585 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.585 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.585 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.585 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.585 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:22.585 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:22.585 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.279121439000001, 2024-04-19T04:26:22.585 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:22.585 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.585 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:22.585 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.585 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.585 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.586 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:22.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.586 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.586 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.586 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:22.586 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.586 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.586 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:22.586 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.587 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.587 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:22.587 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:22.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.587 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.587 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.587 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:22.587 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:22.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.587 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.587 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.587 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:22.587 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:22.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.587 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:22.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:22.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:22.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:22.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:22.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:22.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.589 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:22.589 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:22.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:22.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.589 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:22.589 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:22.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:22.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.589 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.589 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:22.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:22.589 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.590 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.590 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.590 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.590 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174342 5.9 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:22.590 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:22.590 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 17.593964739, 2024-04-19T04:26:22.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068615152999999998, 2024-04-19T04:26:22.590 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.590 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:22.590 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.590 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.590 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.590 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174342 2024-04-19T04:26:22.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.591 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.591 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:22.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.591 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:22.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897726+0000", 2024-04-19T04:26:22.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897731+0000", 2024-04-19T04:26:22.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1449999999999999e-06 2024-04-19T04:26:22.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897744+0000", 2024-04-19T04:26:22.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2833000000000001e-05 2024-04-19T04:26:22.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897749+0000", 2024-04-19T04:26:22.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1540000000000001e-06 2024-04-19T04:26:22.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.593 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897810+0000", 2024-04-19T04:26:22.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0724999999999999e-05 2024-04-19T04:26:22.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.593 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897920+0000", 2024-04-19T04:26:22.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011024 2024-04-19T04:26:22.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.594 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:22.594 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897993+0000", 2024-04-19T04:26:22.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2335000000000005e-05 2024-04-19T04:26:22.594 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.594 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.594 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:22.594 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.899597+0000", 2024-04-19T04:26:22.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016048919999999999 2024-04-19T04:26:22.594 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.594 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.594 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:22.594 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966230+0000", 2024-04-19T04:26:22.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.066632882000000004 2024-04-19T04:26:22.594 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.595 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:22.595 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966296+0000", 2024-04-19T04:26:22.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5361e-05 2024-04-19T04:26:22.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.595 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.595 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966342+0000", 2024-04-19T04:26:22.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6476e-05 2024-04-19T04:26:22.595 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.595 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.595 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.595 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174344 5.d 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:22.596 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:22.596 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 17.593285901000002, 2024-04-19T04:26:22.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068211329000000001, 2024-04-19T04:26:22.596 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.596 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:22.596 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.596 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.596 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.596 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174344 2024-04-19T04:26:22.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.596 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:22.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:22.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898405+0000", 2024-04-19T04:26:22.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:22.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898409+0000", 2024-04-19T04:26:22.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5149999999999998e-06 2024-04-19T04:26:22.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898415+0000", 2024-04-19T04:26:22.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:26:22.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898419+0000", 2024-04-19T04:26:22.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.89e-06 2024-04-19T04:26:22.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.599 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898459+0000", 2024-04-19T04:26:22.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0017e-05 2024-04-19T04:26:22.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.599 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.599 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898540+0000", 2024-04-19T04:26:22.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1237999999999997e-05 2024-04-19T04:26:22.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.599 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:22.599 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:22.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6060000000000001e-05 2024-04-19T04:26:22.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.599 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:22.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.901321+0000", 2024-04-19T04:26:22.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027152109999999999 2024-04-19T04:26:22.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:22.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966512+0000", 2024-04-19T04:26:22.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.065190440000000002 2024-04-19T04:26:22.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:22.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966563+0000", 2024-04-19T04:26:22.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1436e-05 2024-04-19T04:26:22.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966617+0000", 2024-04-19T04:26:22.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.401e-05 2024-04-19T04:26:22.601 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.601 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.601 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.601 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174346 5.f 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:22.601 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:22.601 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 17.591499674000001, 2024-04-19T04:26:22.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.067185536000000004, 2024-04-19T04:26:22.601 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:22.601 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:22.601 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:22.602 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:22.602 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.602 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174346 2024-04-19T04:26:22.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.602 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:22.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:22.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:22.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:22.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:22.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:22.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:22.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900191+0000", 2024-04-19T04:26:22.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:22.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900196+0000", 2024-04-19T04:26:22.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3329999999999998e-06 2024-04-19T04:26:22.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:22.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900206+0000", 2024-04-19T04:26:22.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9699999999999994e-06 2024-04-19T04:26:22.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900210+0000", 2024-04-19T04:26:22.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3359999999999997e-06 2024-04-19T04:26:22.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:22.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900243+0000", 2024-04-19T04:26:22.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2669999999999997e-05 2024-04-19T04:26:22.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:22.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900365+0000", 2024-04-19T04:26:22.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122648 2024-04-19T04:26:22.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:22.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900559+0000", 2024-04-19T04:26:22.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019358799999999999 2024-04-19T04:26:22.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:22.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.903018+0000", 2024-04-19T04:26:22.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024592300000000002 2024-04-19T04:26:22.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:22.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967180+0000", 2024-04-19T04:26:22.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.064161587000000006 2024-04-19T04:26:22.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:22.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967293+0000", 2024-04-19T04:26:22.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112921 2024-04-19T04:26:22.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:22.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:22.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:22.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967378+0000", 2024-04-19T04:26:22.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5000999999999995e-05 2024-04-19T04:26:22.606 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.606 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.606 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.607 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:22.607 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:22.607 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:22.608 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:22.609 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:22.604+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:22.709 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:22.708+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:22.738 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:22.738 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:22.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.738 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:216130 5.b 5:d1fd2dec:::benchmark_data_smithi007_19526_object90396:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:22.738 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:22.735732+0000", 2024-04-19T04:26:22.738 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0030356580000000001, 2024-04-19T04:26:22.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030622499999999999, 2024-04-19T04:26:22.738 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:22.738 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:22.739 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:22.739 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:22.739 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.739 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 216130 2024-04-19T04:26:22.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.739 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:22.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:22.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.735732+0000", 2024-04-19T04:26:22.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:22.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:22.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.735732+0000", 2024-04-19T04:26:22.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:22.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:22.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.735731+0000", 2024-04-19T04:26:22.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:22.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.735737+0000", 2024-04-19T04:26:22.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0560000000000001e-06 2024-04-19T04:26:22.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:22.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.735748+0000", 2024-04-19T04:26:22.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1291000000000001e-05 2024-04-19T04:26:22.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.735755+0000", 2024-04-19T04:26:22.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8390000000000001e-06 2024-04-19T04:26:22.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:22.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.735790+0000", 2024-04-19T04:26:22.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4363999999999998e-05 2024-04-19T04:26:22.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:22.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.735878+0000", 2024-04-19T04:26:22.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8943000000000005e-05 2024-04-19T04:26:22.742 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:22.742 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:22.742 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:22.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.742 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:216129 5.9 e61/20 5:928826b8:::benchmark_data_smithi007_19526_object90395:head v 61'13883, mlcod=61'13880)", 2024-04-19T04:26:22.742 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:22.736459+0000", 2024-04-19T04:26:22.742 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002309148, 2024-04-19T04:26:22.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024090589999999999, 2024-04-19T04:26:22.742 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:22.742 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:22.742 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:22.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:22.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.736459+0000", 2024-04-19T04:26:22.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:22.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:22.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.736459+0000", 2024-04-19T04:26:22.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:22.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:22.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.736458+0000", 2024-04-19T04:26:22.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:22.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.736466+0000", 2024-04-19T04:26:22.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4020000000000002e-06 2024-04-19T04:26:22.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:22.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.736479+0000", 2024-04-19T04:26:22.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2422999999999999e-05 2024-04-19T04:26:22.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.736487+0000", 2024-04-19T04:26:22.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5059999999999995e-06 2024-04-19T04:26:22.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:22.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.736533+0000", 2024-04-19T04:26:22.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6026000000000003e-05 2024-04-19T04:26:22.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:22.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.736552+0000", 2024-04-19T04:26:22.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9000000000000001e-05 2024-04-19T04:26:22.745 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:22.745 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:22.745 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:22.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.745 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:216133 5.4 5:2a45d24b:::benchmark_data_smithi007_19526_object90399:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:22.746 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:22.736897+0000", 2024-04-19T04:26:22.746 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001870877, 2024-04-19T04:26:22.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020627000000000002, 2024-04-19T04:26:22.746 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:22.746 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:22.746 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:22.746 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:22.746 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:22.746 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 216133 2024-04-19T04:26:22.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.746 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:22.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:22.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.736897+0000", 2024-04-19T04:26:22.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:22.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:22.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.736897+0000", 2024-04-19T04:26:22.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:22.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:22.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.736896+0000", 2024-04-19T04:26:22.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:22.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:22.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.736900+0000", 2024-04-19T04:26:22.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:22.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:22.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.736913+0000", 2024-04-19T04:26:22.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2187e-05 2024-04-19T04:26:22.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:22.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.736922+0000", 2024-04-19T04:26:22.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7559999999999994e-06 2024-04-19T04:26:22.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:22.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.736974+0000", 2024-04-19T04:26:22.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1607999999999998e-05 2024-04-19T04:26:22.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:22.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:22.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:22.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:22.737077+0000", 2024-04-19T04:26:22.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103288 2024-04-19T04:26:22.749 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:22.749 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:22.749 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:22.749 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:22.749 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:26:22.749 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 3 2024-04-19T04:26:22.749 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:22.751 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:22.809 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:22.808+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:22.876 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:22.876 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:22.876 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:22.876 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:22.876 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:22.888 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:22.911 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:22.908+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:23.012 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:23.012 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:23.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:23.012 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:23.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.012 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:23.012 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:23.012 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.058811105999993, 2024-04-19T04:26:23.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:23.012 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.012 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:23.013 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.013 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.013 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.013 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:23.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.013 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:23.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:23.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:23.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:23.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:23.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:23.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:23.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:23.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:23.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:23.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:23.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:23.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:23.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:23.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:23.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:23.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:23.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:23.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:23.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:23.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:23.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:23.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:23.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:23.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:23.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:23.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:23.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.018 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:23.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:23.018 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.018 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.018 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.018 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:23.018 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:23.018 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.053749460000006, 2024-04-19T04:26:23.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:23.018 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.019 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:23.019 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.019 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.019 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.019 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:23.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.019 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:23.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:23.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:23.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:23.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:23.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:23.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:23.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:23.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:23.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:23.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:23.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:23.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:23.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:23.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:23.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:23.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:23.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:23.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:23.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:23.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:23.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:23.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:23.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:23.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:23.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:23.023 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.023 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.023 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.024 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:23.024 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:23.024 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.053649547999996, 2024-04-19T04:26:23.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:23.024 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.024 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:23.024 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.024 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.024 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.024 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:23.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.024 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:23.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:23.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:23.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:23.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:23.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:23.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:23.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:23.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:23.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:23.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:23.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:23.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:23.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:23.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:23.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:23.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:23.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:23.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:23.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:23.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:23.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:23.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:23.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:23.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:23.029 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.029 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.029 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.029 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:23.029 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:23.029 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.053523795000004, 2024-04-19T04:26:23.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:23.029 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.030 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:23.030 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.030 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.030 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.030 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:23.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.030 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:23.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:23.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:23.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:23.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:23.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:23.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:23.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:23.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:23.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:23.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:23.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:23.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:23.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:23.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:23.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:23.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:23.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:23.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:23.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:23.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:23.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:23.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:23.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:23.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:23.034 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.034 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.034 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.035 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:23.035 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:23.035 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.049679850000004, 2024-04-19T04:26:23.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:23.035 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.035 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.035 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.035 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.035 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.035 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:23.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.035 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:23.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:23.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:23.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:23.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:23.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:23.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:23.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:23.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:23.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:23.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:23.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:23.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:23.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:23.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:23.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:23.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:23.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:23.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:23.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:23.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:23.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:23.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:23.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:23.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:23.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:23.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:23.041 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.041 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.041 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.041 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:23.041 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:23.041 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.042508749000007, 2024-04-19T04:26:23.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:23.041 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.041 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:23.041 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.041 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.042 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.042 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:23.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.042 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:23.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:23.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:23.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:23.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:23.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:23.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:23.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:23.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:23.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:23.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:23.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:23.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:23.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:23.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:23.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:23.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:23.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:23.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:23.045 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.045 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.045 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.046 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:23.046 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:23.046 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.042336645000006, 2024-04-19T04:26:23.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:23.046 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.046 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:23.046 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.046 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.046 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.046 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:23.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.046 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:23.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:23.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:23.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:23.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:23.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:23.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:23.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:23.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:23.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:23.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:23.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:23.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:23.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:23.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:23.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:23.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:23.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:23.050 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.050 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.050 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.051 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:23.051 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:23.051 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.042273519999995, 2024-04-19T04:26:23.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:23.051 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.051 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.051 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.051 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.051 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.051 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:23.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.051 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:23.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:23.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:23.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:23.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:23.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:23.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:23.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:23.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:23.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:23.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:23.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:23.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:23.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:23.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:23.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:23.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:23.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:23.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:23.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:23.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:23.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:23.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:23.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:23.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:23.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:23.057 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.057 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.057 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.057 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:23.057 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:23.057 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.042144922999995, 2024-04-19T04:26:23.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:23.058 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.058 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.058 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.058 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.058 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.058 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:23.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.058 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:23.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:23.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:23.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:23.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:23.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:23.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:23.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:23.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:23.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:23.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:23.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:23.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:23.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:23.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:23.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:23.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:23.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:23.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:23.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:23.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:23.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:23.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:23.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:23.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:23.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:23.065 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.065 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.065 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.065 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:23.065 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:23.065 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.042076952000002, 2024-04-19T04:26:23.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:23.066 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.066 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.066 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.066 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.066 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.066 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:23.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.066 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:23.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:23.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:23.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:23.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:23.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:23.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:23.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:23.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:23.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:23.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:23.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:23.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:23.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:23.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:23.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:23.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:23.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:23.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:23.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:23.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:23.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:23.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:23.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:23.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:23.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:23.071 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.071 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.071 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.071 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:23.071 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:23.071 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.122537287, 2024-04-19T04:26:23.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078453623, 2024-04-19T04:26:23.071 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.071 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.072 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:23.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.072 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:23.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:23.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:23.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:23.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:23.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:23.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:23.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:23.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:23.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:23.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:23.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:23.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:23.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:23.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965893+0000", 2024-04-19T04:26:23.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.076646455000000002 2024-04-19T04:26:23.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:23.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965956+0000", 2024-04-19T04:26:23.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3200000000000005e-05 2024-04-19T04:26:23.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966068+0000", 2024-04-19T04:26:23.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011194800000000001 2024-04-19T04:26:23.076 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.076 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.076 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.076 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:23.076 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:23.076 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.12250629, 2024-04-19T04:26:23.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083782388999999999, 2024-04-19T04:26:23.076 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.076 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.076 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.077 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.077 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.077 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:23.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.077 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:23.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:23.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:23.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:23.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:23.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:23.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:23.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:23.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:23.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:23.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:23.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:23.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:23.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:23.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971179+0000", 2024-04-19T04:26:23.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079349476000000002 2024-04-19T04:26:23.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:23.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971259+0000", 2024-04-19T04:26:23.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9083000000000002e-05 2024-04-19T04:26:23.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971428+0000", 2024-04-19T04:26:23.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169419 2024-04-19T04:26:23.082 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.082 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.082 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.082 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:23.082 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:23.082 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.120184770000002, 2024-04-19T04:26:23.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081686998999999996, 2024-04-19T04:26:23.082 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.082 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.082 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.082 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.082 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.082 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:23.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.083 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:23.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:23.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:23.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:23.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:23.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:23.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:23.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:23.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:23.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:23.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:23.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:23.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:23.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:23.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971454+0000", 2024-04-19T04:26:23.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077525997999999999 2024-04-19T04:26:23.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:23.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971540+0000", 2024-04-19T04:26:23.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6285000000000005e-05 2024-04-19T04:26:23.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971654+0000", 2024-04-19T04:26:23.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114095 2024-04-19T04:26:23.087 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.087 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.087 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.087 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:23.087 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:23.087 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.118974388000002, 2024-04-19T04:26:23.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080734265999999999, 2024-04-19T04:26:23.087 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.087 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.087 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.087 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.087 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.088 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:23.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.088 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:23.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:23.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:23.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:23.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:23.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:23.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:23.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:23.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:23.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:23.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:23.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:23.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:23.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:23.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971677+0000", 2024-04-19T04:26:23.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.073192023999999994 2024-04-19T04:26:23.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:23.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971771+0000", 2024-04-19T04:26:23.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4235999999999997e-05 2024-04-19T04:26:23.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971912+0000", 2024-04-19T04:26:23.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014055099999999999 2024-04-19T04:26:23.092 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.092 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.092 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.092 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:23.092 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:23.092 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.118022896999999, 2024-04-19T04:26:23.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085645857000000006, 2024-04-19T04:26:23.092 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.092 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.092 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.093 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.093 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.093 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:23.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.093 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:23.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:23.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:23.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:23.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:23.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:23.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:23.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:23.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:23.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:23.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:23.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:23.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:23.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:23.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977634+0000", 2024-04-19T04:26:23.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077144335999999994 2024-04-19T04:26:23.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:23.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977699+0000", 2024-04-19T04:26:23.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4518999999999997e-05 2024-04-19T04:26:23.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977775+0000", 2024-04-19T04:26:23.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6219999999999999e-05 2024-04-19T04:26:23.096 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.097 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.097 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.097 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:23.097 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:23.097 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.115015319000001, 2024-04-19T04:26:23.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075403611999999995, 2024-04-19T04:26:23.097 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.097 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.097 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.097 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.097 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.098 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:23.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.098 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:23.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:23.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:23.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:23.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:23.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:23.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:23.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:23.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:23.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:23.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:23.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:23.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:23.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:23.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970369+0000", 2024-04-19T04:26:23.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.074967992999999997 2024-04-19T04:26:23.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:23.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970419+0000", 2024-04-19T04:26:23.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9700999999999997e-05 2024-04-19T04:26:23.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970540+0000", 2024-04-19T04:26:23.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121512 2024-04-19T04:26:23.101 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.102 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.102 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.102 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5:78f758ec:::benchmark_data_smithi007_19526_object48602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:23.102 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:23.102 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.114641195000001, 2024-04-19T04:26:23.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085171609999999995, 2024-04-19T04:26:23.102 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.102 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.102 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.102 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.102 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.102 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:23.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.103 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:23.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:23.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:23.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:23.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:23.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:23.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:23.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:23.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:23.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966154+0000", 2024-04-19T04:26:23.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.070613543000000001 2024-04-19T04:26:23.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966382+0000", 2024-04-19T04:26:23.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022741800000000001 2024-04-19T04:26:23.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:23.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980581+0000", 2024-04-19T04:26:23.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014199916999999999 2024-04-19T04:26:23.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:23.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980621+0000", 2024-04-19T04:26:23.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9685999999999999e-05 2024-04-19T04:26:23.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980682+0000", 2024-04-19T04:26:23.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1130000000000006e-05 2024-04-19T04:26:23.106 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.106 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.106 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.107 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:23.107 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:23.107 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.114551243000001, 2024-04-19T04:26:23.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075073230000000005, 2024-04-19T04:26:23.107 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.107 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.107 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.107 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.107 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.107 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:23.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.107 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:23.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:23.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:23.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:23.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:23.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:23.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:23.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:23.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:23.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:23.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:23.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970556+0000", 2024-04-19T04:26:23.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.072076192999999997 2024-04-19T04:26:23.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:23.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970608+0000", 2024-04-19T04:26:23.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2549000000000001e-05 2024-04-19T04:26:23.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970674+0000", 2024-04-19T04:26:23.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5549000000000005e-05 2024-04-19T04:26:23.111 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.111 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.111 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.111 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5:70a7bb5e:::benchmark_data_smithi007_19526_object48614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:23.111 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:23.112 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.109464246000002, 2024-04-19T04:26:23.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080099220999999998, 2024-04-19T04:26:23.112 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.112 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.112 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:23.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.112 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:23.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:23.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:23.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:23.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:23.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971978+0000", 2024-04-19T04:26:23.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.071282358000000004 2024-04-19T04:26:23.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.972180+0000", 2024-04-19T04:26:23.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020191100000000001 2024-04-19T04:26:23.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:23.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980701+0000", 2024-04-19T04:26:23.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085211760000000001 2024-04-19T04:26:23.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:23.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980729+0000", 2024-04-19T04:26:23.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8068e-05 2024-04-19T04:26:23.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980787+0000", 2024-04-19T04:26:23.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7521e-05 2024-04-19T04:26:23.116 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.116 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.116 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.116 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174350 5.e 5:7f36609a:::benchmark_data_smithi007_19526_object48616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:23.116 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:23.116 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.107693174000001, 2024-04-19T04:26:23.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079723622999999993, 2024-04-19T04:26:23.117 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.117 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.117 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.117 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.117 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.117 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174350 2024-04-19T04:26:23.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.117 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:23.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:23.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902458+0000", 2024-04-19T04:26:23.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902463+0000", 2024-04-19T04:26:23.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5889999999999996e-06 2024-04-19T04:26:23.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965576+0000", 2024-04-19T04:26:23.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063113328999999996 2024-04-19T04:26:23.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965614+0000", 2024-04-19T04:26:23.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8285999999999999e-05 2024-04-19T04:26:23.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974787+0000", 2024-04-19T04:26:23.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009172599 2024-04-19T04:26:23.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974999+0000", 2024-04-19T04:26:23.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021270999999999999 2024-04-19T04:26:23.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:23.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982086+0000", 2024-04-19T04:26:23.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070869160000000004 2024-04-19T04:26:23.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:23.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982115+0000", 2024-04-19T04:26:23.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8603999999999999e-05 2024-04-19T04:26:23.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:23.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982182+0000", 2024-04-19T04:26:23.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7350999999999999e-05 2024-04-19T04:26:23.121 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.121 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.121 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.121 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.121 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.121 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:23.122 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:23.008+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:23.123 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:23.120+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:23.123 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:23.223 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:23.220+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:23.256 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:23.257 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:23.257 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.257 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:217334 5.f 5:fd9b6757:::benchmark_data_smithi007_19526_object91600:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:23.257 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:23.252012+0000", 2024-04-19T04:26:23.257 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0033835879999999999, 2024-04-19T04:26:23.257 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034130039999999999, 2024-04-19T04:26:23.258 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.258 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:23.258 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.258 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.258 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.258 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 217334 2024-04-19T04:26:23.258 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.259 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.259 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.259 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.259 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.252012+0000", 2024-04-19T04:26:23.259 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.259 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.259 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.259 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.260 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.252012+0000", 2024-04-19T04:26:23.260 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.260 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.260 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.260 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.252011+0000", 2024-04-19T04:26:23.260 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.260 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.260 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.260 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.252017+0000", 2024-04-19T04:26:23.260 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8730000000000004e-06 2024-04-19T04:26:23.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.260 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.260 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.261 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.252031+0000", 2024-04-19T04:26:23.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4201e-05 2024-04-19T04:26:23.261 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.261 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.261 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.261 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.252039+0000", 2024-04-19T04:26:23.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1550000000000007e-06 2024-04-19T04:26:23.261 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.261 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.261 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.261 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.252084+0000", 2024-04-19T04:26:23.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4202999999999997e-05 2024-04-19T04:26:23.261 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.261 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.261 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.262 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.252191+0000", 2024-04-19T04:26:23.262 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000107151 2024-04-19T04:26:23.262 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.262 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.262 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:23.262 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.252345+0000", 2024-04-19T04:26:23.262 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015422299999999999 2024-04-19T04:26:23.262 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.262 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.262 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.262 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.262 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.262 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:217337 5.7 5:e06b2049:::benchmark_data_smithi007_19526_object91603:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:23.262 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:23.253914+0000", 2024-04-19T04:26:23.263 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001481909, 2024-04-19T04:26:23.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00157216, 2024-04-19T04:26:23.263 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.263 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:23.263 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.263 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.263 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.263 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 217337 2024-04-19T04:26:23.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.263 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.263 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.263 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.263 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.253914+0000", 2024-04-19T04:26:23.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.264 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.264 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.253914+0000", 2024-04-19T04:26:23.264 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.264 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.264 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.253913+0000", 2024-04-19T04:26:23.264 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.264 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.264 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.253917+0000", 2024-04-19T04:26:23.264 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:23.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.253924+0000", 2024-04-19T04:26:23.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3030000000000002e-06 2024-04-19T04:26:23.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.253929+0000", 2024-04-19T04:26:23.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3529999999999997e-06 2024-04-19T04:26:23.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.266 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.254045+0000", 2024-04-19T04:26:23.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000116079 2024-04-19T04:26:23.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.266 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.254199+0000", 2024-04-19T04:26:23.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015481199999999999 2024-04-19T04:26:23.266 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.266 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.266 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.267 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.267 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:217338 5.7 5.c093d087 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:23.267 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:23.253939+0000", 2024-04-19T04:26:23.267 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001456403, 2024-04-19T04:26:23.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001604545, 2024-04-19T04:26:23.267 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.267 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:23.267 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.270 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.270 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.270 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 217338 2024-04-19T04:26:23.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.270 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.253939+0000", 2024-04-19T04:26:23.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.253939+0000", 2024-04-19T04:26:23.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.253939+0000", 2024-04-19T04:26:23.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.253941+0000", 2024-04-19T04:26:23.272 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.4279999999999999e-06 2024-04-19T04:26:23.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.272 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.272 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.272 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.253945+0000", 2024-04-19T04:26:23.272 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0779999999999997e-06 2024-04-19T04:26:23.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.272 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.272 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.272 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.253949+0000", 2024-04-19T04:26:23.272 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4010000000000001e-06 2024-04-19T04:26:23.272 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.272 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.273 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.273 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:217322 5.f e61/20)", 2024-04-19T04:26:23.273 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:23.254436+0000", 2024-04-19T04:26:23.273 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00096006399999999995, 2024-04-19T04:26:23.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0011729760000000001, 2024-04-19T04:26:23.273 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.273 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:23.273 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.273 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.254436+0000", 2024-04-19T04:26:23.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.274 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.254436+0000", 2024-04-19T04:26:23.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.274 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.254435+0000", 2024-04-19T04:26:23.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.274 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.254441+0000", 2024-04-19T04:26:23.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2009999999999996e-06 2024-04-19T04:26:23.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.254453+0000", 2024-04-19T04:26:23.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2139e-05 2024-04-19T04:26:23.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.254461+0000", 2024-04-19T04:26:23.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6459999999999993e-06 2024-04-19T04:26:23.276 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.276 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.276 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.276 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:217325 5.f e61/20)", 2024-04-19T04:26:23.276 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:23.255135+0000", 2024-04-19T04:26:23.276 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00026035300000000001, 2024-04-19T04:26:23.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00052955199999999997, 2024-04-19T04:26:23.276 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.276 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:23.276 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255135+0000", 2024-04-19T04:26:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255135+0000", 2024-04-19T04:26:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255135+0000", 2024-04-19T04:26:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255139+0000", 2024-04-19T04:26:23.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6419999999999998e-06 2024-04-19T04:26:23.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255149+0000", 2024-04-19T04:26:23.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0115999999999999e-05 2024-04-19T04:26:23.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255156+0000", 2024-04-19T04:26:23.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5060000000000001e-06 2024-04-19T04:26:23.278 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.279 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.279 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.279 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:217334 5.f e61/20)", 2024-04-19T04:26:23.279 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:23.255212+0000", 2024-04-19T04:26:23.279 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00018347799999999999, 2024-04-19T04:26:23.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00050405600000000001, 2024-04-19T04:26:23.279 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.279 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:23.279 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.279 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.279 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255212+0000", 2024-04-19T04:26:23.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255212+0000", 2024-04-19T04:26:23.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255212+0000", 2024-04-19T04:26:23.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255215+0000", 2024-04-19T04:26:23.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6109999999999998e-06 2024-04-19T04:26:23.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255222+0000", 2024-04-19T04:26:23.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6340000000000003e-06 2024-04-19T04:26:23.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255227+0000", 2024-04-19T04:26:23.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9200000000000003e-06 2024-04-19T04:26:23.282 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.282 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.282 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.283 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:217342 5.5 5:a28055ca:::benchmark_data_smithi007_19526_object91608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:23.283 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:23.255510+0000", 2024-04-19T04:26:23.283 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.999886, 2024-04-19T04:26:23.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026744099999999999, 2024-04-19T04:26:23.283 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.283 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:23.283 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.283 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.284 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.284 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 217342 2024-04-19T04:26:23.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.284 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255510+0000", 2024-04-19T04:26:23.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.285 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.285 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255510+0000", 2024-04-19T04:26:23.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.285 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.285 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255509+0000", 2024-04-19T04:26:23.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.285 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.285 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255514+0000", 2024-04-19T04:26:23.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1699999999999996e-06 2024-04-19T04:26:23.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255526+0000", 2024-04-19T04:26:23.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.185e-05 2024-04-19T04:26:23.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255532+0000", 2024-04-19T04:26:23.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6619999999999999e-06 2024-04-19T04:26:23.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255574+0000", 2024-04-19T04:26:23.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1746999999999999e-05 2024-04-19T04:26:23.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255704+0000", 2024-04-19T04:26:23.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012959399999999999 2024-04-19T04:26:23.287 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.287 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.287 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.288 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:217343 5.3 5:c7ddcfb5:::benchmark_data_smithi007_19526_object91609:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:23.288 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:23.255542+0000", 2024-04-19T04:26:23.288 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9998536, 2024-04-19T04:26:23.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031381600000000002, 2024-04-19T04:26:23.288 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.288 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:23.288 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.288 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.288 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.288 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 217343 2024-04-19T04:26:23.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.288 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255542+0000", 2024-04-19T04:26:23.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255542+0000", 2024-04-19T04:26:23.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255542+0000", 2024-04-19T04:26:23.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.290 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.290 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255544+0000", 2024-04-19T04:26:23.290 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.238e-06 2024-04-19T04:26:23.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.290 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255554+0000", 2024-04-19T04:26:23.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0552e-05 2024-04-19T04:26:23.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255558+0000", 2024-04-19T04:26:23.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0729999999999998e-06 2024-04-19T04:26:23.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255607+0000", 2024-04-19T04:26:23.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8253e-05 2024-04-19T04:26:23.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.292 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.292 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255750+0000", 2024-04-19T04:26:23.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000142881 2024-04-19T04:26:23.292 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.292 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.293 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.293 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:217344 5.d 5:bc275d09:::benchmark_data_smithi007_19526_object91610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:23.293 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:23.255570+0000", 2024-04-19T04:26:23.294 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.999825, 2024-04-19T04:26:23.294 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00036846300000000003, 2024-04-19T04:26:23.294 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.294 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:23.294 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.294 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.294 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.295 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 217344 2024-04-19T04:26:23.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.295 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.295 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.295 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255570+0000", 2024-04-19T04:26:23.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255570+0000", 2024-04-19T04:26:23.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255570+0000", 2024-04-19T04:26:23.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.297 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.297 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255573+0000", 2024-04-19T04:26:23.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.3359999999999999e-06 2024-04-19T04:26:23.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.297 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.298 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255580+0000", 2024-04-19T04:26:23.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7599999999999997e-06 2024-04-19T04:26:23.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.298 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255586+0000", 2024-04-19T04:26:23.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0440000000000001e-06 2024-04-19T04:26:23.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.298 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255624+0000", 2024-04-19T04:26:23.299 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7834999999999999e-05 2024-04-19T04:26:23.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.299 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.299 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255754+0000", 2024-04-19T04:26:23.299 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013014 2024-04-19T04:26:23.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.299 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:23.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255866+0000", 2024-04-19T04:26:23.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011179999999999999 2024-04-19T04:26:23.300 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.300 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.300 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.300 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:217345 5.9 5:93a0602a:::benchmark_data_smithi007_19526_object91611:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:23.300 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:23.255596+0000", 2024-04-19T04:26:23.300 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9998002, 2024-04-19T04:26:23.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00043067600000000001, 2024-04-19T04:26:23.301 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.301 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:23.301 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.302 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.302 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.302 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 217345 2024-04-19T04:26:23.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.302 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.302 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255596+0000", 2024-04-19T04:26:23.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255596+0000", 2024-04-19T04:26:23.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255595+0000", 2024-04-19T04:26:23.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.304 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.304 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255598+0000", 2024-04-19T04:26:23.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.0740000000000001e-06 2024-04-19T04:26:23.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.304 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.304 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255605+0000", 2024-04-19T04:26:23.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1210000000000001e-06 2024-04-19T04:26:23.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.304 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.304 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255611+0000", 2024-04-19T04:26:23.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4550000000000003e-06 2024-04-19T04:26:23.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255655+0000", 2024-04-19T04:26:23.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3949999999999998e-05 2024-04-19T04:26:23.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255776+0000", 2024-04-19T04:26:23.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000121377 2024-04-19T04:26:23.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:23.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.255884+0000", 2024-04-19T04:26:23.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108344 2024-04-19T04:26:23.306 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.306 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.306 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.306 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:217322 5.f 5:f7296b47:::benchmark_data_smithi007_19526_object91588:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:23.306 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:23.245543+0000", 2024-04-19T04:26:23.306 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0098528360000000002, 2024-04-19T04:26:23.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010566420999999999, 2024-04-19T04:26:23.306 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.306 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:23.306 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.306 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.306 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.307 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 217322 2024-04-19T04:26:23.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.307 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.245543+0000", 2024-04-19T04:26:23.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.245543+0000", 2024-04-19T04:26:23.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.245542+0000", 2024-04-19T04:26:23.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.309 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.245547+0000", 2024-04-19T04:26:23.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6770000000000003e-06 2024-04-19T04:26:23.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.309 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.245562+0000", 2024-04-19T04:26:23.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4956999999999999e-05 2024-04-19T04:26:23.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.309 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.245568+0000", 2024-04-19T04:26:23.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:23.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.247864+0000", 2024-04-19T04:26:23.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002295727 2024-04-19T04:26:23.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.248032+0000", 2024-04-19T04:26:23.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000168622 2024-04-19T04:26:23.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:23.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.248234+0000", 2024-04-19T04:26:23.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00020160800000000001 2024-04-19T04:26:23.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.254004+0000", 2024-04-19T04:26:23.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0057698710000000002 2024-04-19T04:26:23.312 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.312 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.312 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.312 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:217325 5.f 5:fa7b4637:::benchmark_data_smithi007_19526_object91591:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:23.312 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:23.246115+0000", 2024-04-19T04:26:23.312 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0092805609999999997, 2024-04-19T04:26:23.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010093787, 2024-04-19T04:26:23.313 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.313 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:23.313 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.313 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.313 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.313 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 217325 2024-04-19T04:26:23.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.313 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.246115+0000", 2024-04-19T04:26:23.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.246115+0000", 2024-04-19T04:26:23.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.246114+0000", 2024-04-19T04:26:23.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.246119+0000", 2024-04-19T04:26:23.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5190000000000003e-06 2024-04-19T04:26:23.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.246127+0000", 2024-04-19T04:26:23.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.695e-06 2024-04-19T04:26:23.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.246133+0000", 2024-04-19T04:26:23.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9869999999999996e-06 2024-04-19T04:26:23.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.249988+0000", 2024-04-19T04:26:23.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038559060000000001 2024-04-19T04:26:23.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.316 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.316 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.250082+0000", 2024-04-19T04:26:23.316 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.3984e-05 2024-04-19T04:26:23.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.316 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:23.316 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:23.250156+0000", 2024-04-19T04:26:23.316 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3900999999999996e-05 2024-04-19T04:26:23.316 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.316 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.316 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.316 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.316 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:23.316 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 12 2024-04-19T04:26:23.317 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:23.318 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:23.325 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:23.324+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:23.425 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:23.424+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:23.442 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:23.443 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:23.443 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:23.443 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:23.443 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:23.455 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:23.527 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:23.524+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:23.622 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:23.623 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:23.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:23.623 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:23.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.623 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:23.623 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:23.623 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 89.390130993, 2024-04-19T04:26:23.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:23.623 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.623 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.623 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.623 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.623 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.624 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:23.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.624 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:23.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:23.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:23.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:23.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:23.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:23.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:23.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:23.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:23.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:23.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:23.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:23.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:23.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:23.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:23.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:23.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:23.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:23.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:23.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:23.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:23.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:23.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:23.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:23.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:23.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:23.628 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.628 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.629 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.629 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:23.629 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:23.629 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 89.386036071999996, 2024-04-19T04:26:23.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:23.629 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.629 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.629 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.629 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.629 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.629 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:23.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.630 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:23.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:23.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:23.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:23.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:23.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:23.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:23.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:23.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:23.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:23.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:23.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:23.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:23.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:23.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:23.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:23.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:23.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:23.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:23.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:23.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:23.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:23.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:23.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:23.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:23.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:23.634 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.634 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.634 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.635 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:23.635 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:23.635 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 89.382744887000001, 2024-04-19T04:26:23.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:23.635 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.635 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.635 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.635 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.635 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.635 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:23.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.635 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:23.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:23.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:23.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:23.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:23.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:23.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:23.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:23.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:23.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:23.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:23.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:23.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:23.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:23.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:23.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:23.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:23.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:23.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:23.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:23.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:23.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:23.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:23.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:23.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:23.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:23.640 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.640 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.640 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.640 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:23.640 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:23.640 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 67.665355422000005, 2024-04-19T04:26:23.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:23.641 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.641 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:23.641 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.641 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.641 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.641 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:23.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.641 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:23.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.642 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.642 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:23.642 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.642 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.642 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:23.642 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.642 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.642 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:23.642 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:23.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.643 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.643 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.643 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:23.643 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:23.643 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.643 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.643 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.643 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:23.643 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:23.643 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.643 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.643 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.643 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:23.643 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:23.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:23.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:23.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:23.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:23.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:23.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:23.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:23.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:23.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:23.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:23.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:23.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:23.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:23.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:23.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:23.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:23.646 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.646 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.646 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.647 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:23.647 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:23.647 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 67.645124972999994, 2024-04-19T04:26:23.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:23.647 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.647 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:23.647 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.647 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.647 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.647 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:23.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.647 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.648 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.648 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:23.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.648 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.648 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.648 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:23.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.648 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.648 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.648 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:23.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:23.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.649 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.649 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:23.649 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:23.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.649 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.649 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:23.649 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:23.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.649 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:23.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:23.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:23.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:23.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:23.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:23.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:23.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:23.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:23.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:23.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:23.651 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.651 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.651 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.652 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:23.652 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:23.652 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 67.645017116000005, 2024-04-19T04:26:23.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:23.652 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.652 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:23.652 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.652 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.652 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.652 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:23.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.652 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 67.643050427000006, 2024-04-19T04:26:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 67.639686232000003, 2024-04-19T04:26:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:23.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:23.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:23.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:23.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:23.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:23.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:23.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:23.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:23.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:23.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:23.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:23.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:23.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:23.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:23.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:23.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:23.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:23.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:23.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:23.668 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.668 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.668 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.668 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:23.668 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:23.668 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 67.635875253999998, 2024-04-19T04:26:23.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:23.668 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.668 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.668 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.668 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.668 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.669 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:23.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.669 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:23.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:23.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:23.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:23.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:23.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:23.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:23.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:23.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:23.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:23.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:23.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:23.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:23.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:23.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:23.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:23.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:23.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:23.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:23.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:23.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:23.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:23.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:23.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:23.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:23.673 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.673 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.674 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.674 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:23.674 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:23.674 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 54.394012897000003, 2024-04-19T04:26:23.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:23.674 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.674 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.674 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.674 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.674 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.674 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:23.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.675 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:23.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.675 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:23.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:23.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:23.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:23.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:23.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:23.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:23.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:23.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:23.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:23.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:23.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:23.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:23.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:23.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:23.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:23.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:23.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:23.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:23.679 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.679 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.679 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.679 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:23.679 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:23.679 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 54.393418617000002, 2024-04-19T04:26:23.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:23.679 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.679 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.679 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.679 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.679 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.680 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:23.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.680 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:23.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:23.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.680 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:23.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:23.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:23.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.681 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.681 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:23.681 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:23.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:23.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:23.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:23.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:23.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.682 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.682 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:23.682 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:23.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:23.683 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:23.683 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:23.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:23.683 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:23.683 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:23.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.683 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.683 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:23.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:23.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.684 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.684 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:23.684 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:23.684 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:23.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.686 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.686 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:23.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:23.686 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.686 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.686 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.686 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.686 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:23.686 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:23.686 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 19.668771458999998, 2024-04-19T04:26:23.686 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:23.686 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.686 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.687 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.687 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.687 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.687 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:23.687 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.687 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.687 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.687 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.687 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:23.687 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.687 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.687 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.687 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.687 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:23.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:23.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:23.688 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:23.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.688 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.688 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.688 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:23.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:23.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:23.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:23.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.689 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:23.689 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:23.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.689 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.689 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:23.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:23.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.690 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:23.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:23.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:23.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.690 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.690 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:23.690 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:23.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.690 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 19.668731043000001, 2024-04-19T04:26:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.693 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.693 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.693 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:23.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.693 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.693 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:23.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.693 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.693 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:23.693 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.694 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.694 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.694 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.694 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:23.694 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:23.694 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.694 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.694 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.694 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:23.694 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:23.694 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.694 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.694 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.694 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:23.695 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:23.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.695 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.695 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:23.695 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:23.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.695 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.695 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:23.695 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:23.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.695 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.695 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:23.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:23.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:23.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:23.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:23.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:23.696 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:23.696 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:23.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.696 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.696 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:23.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:23.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:23.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.697 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.697 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:23.697 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:23.697 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.697 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.697 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.697 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.697 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:23.698 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:23.698 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 19.665034733999999, 2024-04-19T04:26:23.698 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:23.698 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.698 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.698 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.698 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.698 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.698 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:23.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.698 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.698 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.698 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.698 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:23.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.699 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.699 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:23.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.699 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.699 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:23.699 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.699 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.700 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.700 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:23.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:23.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.700 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.700 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:23.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:23.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.700 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.700 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.700 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:23.700 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:23.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:23.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:23.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:23.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:23.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.701 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.701 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:23.701 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:23.701 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:23.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:23.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:23.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.702 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:23.702 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:23.702 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:23.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:23.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:23.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:23.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.703 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.703 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:23.703 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:23.703 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.703 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.703 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.703 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.703 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:23.704 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:23.704 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 19.41142426, 2024-04-19T04:26:23.704 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:23.704 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.704 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.704 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.704 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.704 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.704 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:23.704 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.704 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.704 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.704 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.704 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:23.705 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.705 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.705 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:23.705 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.705 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.705 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:23.705 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.705 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.705 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.705 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:23.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:23.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:23.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:23.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.706 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:23.706 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:23.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.706 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.706 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:23.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:23.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.707 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:23.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:23.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.707 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.707 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:23.707 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:23.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.707 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.708 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:23.708 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:23.708 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:23.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.708 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.708 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.708 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:23.708 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:23.708 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.708 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.708 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.708 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.708 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:23.709 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:23.709 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 19.409130848, 2024-04-19T04:26:23.709 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:23.709 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.709 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.709 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.709 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.709 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.709 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:23.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.709 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.709 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.709 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.709 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:23.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.710 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.710 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:23.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.710 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.710 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.710 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:23.710 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.710 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.710 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:23.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:23.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:23.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:23.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.711 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.711 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:23.711 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:23.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.711 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.712 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:23.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:23.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.712 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:23.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:23.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.712 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.712 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:23.712 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:23.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.712 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.713 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:23.713 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:23.713 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:23.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.713 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.713 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.713 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:23.713 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:23.713 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.713 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.713 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.713 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.713 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:23.714 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:23.714 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 19.409085032, 2024-04-19T04:26:23.714 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:23.714 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.714 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.714 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.714 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.714 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.714 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:23.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.714 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.714 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.714 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.714 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:23.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:23.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.715 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.715 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:23.715 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.715 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:23.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:23.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:23.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:23.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.716 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.716 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.716 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:23.716 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:23.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:23.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:23.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:23.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:23.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.717 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.717 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.717 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:23.717 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:23.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.718 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:23.718 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:23.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:23.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.718 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.718 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:23.718 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:23.718 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.718 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.718 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.719 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174342 5.9 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:23.719 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:23.719 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.723928332, 2024-04-19T04:26:23.719 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068615152999999998, 2024-04-19T04:26:23.719 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.719 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.719 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.719 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.719 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.719 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174342 2024-04-19T04:26:23.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.719 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.719 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.719 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:23.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:23.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.720 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897726+0000", 2024-04-19T04:26:23.720 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.720 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.720 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897731+0000", 2024-04-19T04:26:23.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1449999999999999e-06 2024-04-19T04:26:23.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897744+0000", 2024-04-19T04:26:23.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2833000000000001e-05 2024-04-19T04:26:23.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.721 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.721 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897749+0000", 2024-04-19T04:26:23.721 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1540000000000001e-06 2024-04-19T04:26:23.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.721 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.722 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.722 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897810+0000", 2024-04-19T04:26:23.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0724999999999999e-05 2024-04-19T04:26:23.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.722 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.722 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897920+0000", 2024-04-19T04:26:23.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011024 2024-04-19T04:26:23.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.722 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.722 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:23.722 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897993+0000", 2024-04-19T04:26:23.722 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2335000000000005e-05 2024-04-19T04:26:23.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.899597+0000", 2024-04-19T04:26:23.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016048919999999999 2024-04-19T04:26:23.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:23.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966230+0000", 2024-04-19T04:26:23.723 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.066632882000000004 2024-04-19T04:26:23.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.723 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.723 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:23.723 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966296+0000", 2024-04-19T04:26:23.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5361e-05 2024-04-19T04:26:23.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.724 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.724 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966342+0000", 2024-04-19T04:26:23.724 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6476e-05 2024-04-19T04:26:23.724 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.724 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.724 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.724 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174344 5.d 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:23.724 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:23.724 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.723249494000001, 2024-04-19T04:26:23.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068211329000000001, 2024-04-19T04:26:23.725 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.725 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.725 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.725 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.725 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.725 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174344 2024-04-19T04:26:23.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.725 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.725 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.725 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:23.725 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.725 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.726 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:23.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.726 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898405+0000", 2024-04-19T04:26:23.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.726 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.726 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.726 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898409+0000", 2024-04-19T04:26:23.726 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5149999999999998e-06 2024-04-19T04:26:23.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898415+0000", 2024-04-19T04:26:23.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:26:23.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898419+0000", 2024-04-19T04:26:23.727 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.89e-06 2024-04-19T04:26:23.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.727 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.727 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898459+0000", 2024-04-19T04:26:23.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0017e-05 2024-04-19T04:26:23.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898540+0000", 2024-04-19T04:26:23.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1237999999999997e-05 2024-04-19T04:26:23.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:23.728 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:23.728 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6060000000000001e-05 2024-04-19T04:26:23.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.728 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.728 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.901321+0000", 2024-04-19T04:26:23.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027152109999999999 2024-04-19T04:26:23.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:23.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966512+0000", 2024-04-19T04:26:23.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.065190440000000002 2024-04-19T04:26:23.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:23.729 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966563+0000", 2024-04-19T04:26:23.729 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1436e-05 2024-04-19T04:26:23.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.729 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.729 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.730 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966617+0000", 2024-04-19T04:26:23.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.401e-05 2024-04-19T04:26:23.730 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.730 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.730 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.730 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.730 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174346 5.f 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:23.730 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:23.730 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 18.721463267000001, 2024-04-19T04:26:23.730 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.067185536000000004, 2024-04-19T04:26:23.730 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:23.731 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:23.731 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:23.731 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:23.731 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.731 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174346 2024-04-19T04:26:23.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.731 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:23.731 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.731 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:23.731 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:23.731 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.731 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.731 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:23.731 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:23.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:23.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:23.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900191+0000", 2024-04-19T04:26:23.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:23.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900196+0000", 2024-04-19T04:26:23.732 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3329999999999998e-06 2024-04-19T04:26:23.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.732 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:23.732 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900206+0000", 2024-04-19T04:26:23.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9699999999999994e-06 2024-04-19T04:26:23.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900210+0000", 2024-04-19T04:26:23.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3359999999999997e-06 2024-04-19T04:26:23.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:23.733 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900243+0000", 2024-04-19T04:26:23.733 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2669999999999997e-05 2024-04-19T04:26:23.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.733 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:23.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900365+0000", 2024-04-19T04:26:23.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122648 2024-04-19T04:26:23.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:23.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900559+0000", 2024-04-19T04:26:23.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019358799999999999 2024-04-19T04:26:23.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:23.734 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.903018+0000", 2024-04-19T04:26:23.734 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024592300000000002 2024-04-19T04:26:23.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.734 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.734 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:23.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967180+0000", 2024-04-19T04:26:23.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.064161587000000006 2024-04-19T04:26:23.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:23.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967293+0000", 2024-04-19T04:26:23.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112921 2024-04-19T04:26:23.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:23.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:23.735 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:23.735 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967378+0000", 2024-04-19T04:26:23.735 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5000999999999995e-05 2024-04-19T04:26:23.735 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.735 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.735 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.736 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:23.736 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:23.736 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:23.736 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:26:23.738 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:23.738 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:23.736+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:23.838 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:23.836+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:23.856 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:23.856 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:23.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.857 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:218728 5.a 5:5194fdd6:::benchmark_data_smithi007_19526_object92994:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:23.857 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:23.848559+0000", 2024-04-19T04:26:23.857 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0084258030000000008, 2024-04-19T04:26:23.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084467050000000005, 2024-04-19T04:26:23.857 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.857 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:23.857 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.857 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.857 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.857 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 218728 2024-04-19T04:26:23.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.857 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.848559+0000", 2024-04-19T04:26:23.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.848559+0000", 2024-04-19T04:26:23.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.848559+0000", 2024-04-19T04:26:23.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.848562+0000", 2024-04-19T04:26:23.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3680000000000002e-06 2024-04-19T04:26:23.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.848567+0000", 2024-04-19T04:26:23.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2889999999999997e-06 2024-04-19T04:26:23.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.848571+0000", 2024-04-19T04:26:23.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4340000000000001e-06 2024-04-19T04:26:23.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.848708+0000", 2024-04-19T04:26:23.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000137303 2024-04-19T04:26:23.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.848789+0000", 2024-04-19T04:26:23.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0928999999999997e-05 2024-04-19T04:26:23.860 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.860 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.861 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.861 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:218735 5.a 5:576dc369:::benchmark_data_smithi007_19526_object93001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:23.861 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:23.852002+0000", 2024-04-19T04:26:23.862 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0049826030000000004, 2024-04-19T04:26:23.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050479050000000001, 2024-04-19T04:26:23.862 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.862 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:23.862 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.862 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.862 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.862 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 218735 2024-04-19T04:26:23.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.862 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852002+0000", 2024-04-19T04:26:23.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852002+0000", 2024-04-19T04:26:23.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852001+0000", 2024-04-19T04:26:23.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852007+0000", 2024-04-19T04:26:23.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9909999999999999e-06 2024-04-19T04:26:23.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852019+0000", 2024-04-19T04:26:23.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.111e-05 2024-04-19T04:26:23.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852027+0000", 2024-04-19T04:26:23.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0909999999999993e-06 2024-04-19T04:26:23.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852783+0000", 2024-04-19T04:26:23.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00075632900000000003 2024-04-19T04:26:23.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852863+0000", 2024-04-19T04:26:23.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9929e-05 2024-04-19T04:26:23.866 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.866 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.866 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.866 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:218737 5.a 5:5a12d90a:::benchmark_data_smithi007_19526_object93003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:23.866 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:23.852219+0000", 2024-04-19T04:26:23.867 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0047660819999999996, 2024-04-19T04:26:23.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048663810000000004, 2024-04-19T04:26:23.867 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.867 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:23.867 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.867 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.867 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.867 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 218737 2024-04-19T04:26:23.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.867 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852219+0000", 2024-04-19T04:26:23.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852219+0000", 2024-04-19T04:26:23.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852218+0000", 2024-04-19T04:26:23.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852222+0000", 2024-04-19T04:26:23.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2910000000000001e-06 2024-04-19T04:26:23.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852235+0000", 2024-04-19T04:26:23.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2937e-05 2024-04-19T04:26:23.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852245+0000", 2024-04-19T04:26:23.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4490000000000005e-06 2024-04-19T04:26:23.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854388+0000", 2024-04-19T04:26:23.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002143238 2024-04-19T04:26:23.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854459+0000", 2024-04-19T04:26:23.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0544999999999996e-05 2024-04-19T04:26:23.870 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.870 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.870 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.870 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:218736 5.d e61/29 5:ba5636c3:::benchmark_data_smithi007_19526_object93002:head v 61'13285, mlcod=61'13282)", 2024-04-19T04:26:23.870 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:23.852467+0000", 2024-04-19T04:26:23.870 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0045175409999999999, 2024-04-19T04:26:23.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046520880000000004, 2024-04-19T04:26:23.871 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.871 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:23.871 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852467+0000", 2024-04-19T04:26:23.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852467+0000", 2024-04-19T04:26:23.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852467+0000", 2024-04-19T04:26:23.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852473+0000", 2024-04-19T04:26:23.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.263e-06 2024-04-19T04:26:23.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852481+0000", 2024-04-19T04:26:23.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2190000000000004e-06 2024-04-19T04:26:23.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.852487+0000", 2024-04-19T04:26:23.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6540000000000004e-06 2024-04-19T04:26:23.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.853905+0000", 2024-04-19T04:26:23.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0014175679999999999 2024-04-19T04:26:23.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.853924+0000", 2024-04-19T04:26:23.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8946000000000001e-05 2024-04-19T04:26:23.876 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.876 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.876 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.876 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:218740 5.e 5:7609eb57:::benchmark_data_smithi007_19526_object93006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:23.876 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:23.853019+0000", 2024-04-19T04:26:23.876 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0039656630000000003, 2024-04-19T04:26:23.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0041317999999999997, 2024-04-19T04:26:23.877 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.877 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:23.877 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.877 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.877 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.877 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 218740 2024-04-19T04:26:23.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.878 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.853019+0000", 2024-04-19T04:26:23.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.853019+0000", 2024-04-19T04:26:23.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.853019+0000", 2024-04-19T04:26:23.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.853024+0000", 2024-04-19T04:26:23.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4870000000000002e-06 2024-04-19T04:26:23.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.853034+0000", 2024-04-19T04:26:23.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0069e-05 2024-04-19T04:26:23.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.853042+0000", 2024-04-19T04:26:23.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3529999999999995e-06 2024-04-19T04:26:23.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.853087+0000", 2024-04-19T04:26:23.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4335000000000002e-05 2024-04-19T04:26:23.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.853163+0000", 2024-04-19T04:26:23.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6410999999999997e-05 2024-04-19T04:26:23.882 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.883 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.883 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.883 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:218739 5.f e61/20 5:feab02fa:::benchmark_data_smithi007_19526_object93005:head v 61'13375, mlcod=61'13373)", 2024-04-19T04:26:23.883 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:23.853897+0000", 2024-04-19T04:26:23.883 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0030879649999999998, 2024-04-19T04:26:23.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032863189999999998, 2024-04-19T04:26:23.884 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.884 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:23.884 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.853897+0000", 2024-04-19T04:26:23.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.853897+0000", 2024-04-19T04:26:23.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.853897+0000", 2024-04-19T04:26:23.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.853902+0000", 2024-04-19T04:26:23.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9179999999999999e-06 2024-04-19T04:26:23.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.853910+0000", 2024-04-19T04:26:23.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5020000000000003e-06 2024-04-19T04:26:23.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.853916+0000", 2024-04-19T04:26:23.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.767e-06 2024-04-19T04:26:23.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.853984+0000", 2024-04-19T04:26:23.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8192e-05 2024-04-19T04:26:23.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.853999+0000", 2024-04-19T04:26:23.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5515e-05 2024-04-19T04:26:23.892 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.892 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.892 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.893 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:218742 5.a 5:5d790875:::benchmark_data_smithi007_19526_object93008:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:23.893 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:23.854208+0000", 2024-04-19T04:26:23.893 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002777201, 2024-04-19T04:26:23.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030052099999999999, 2024-04-19T04:26:23.893 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.893 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:23.893 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.893 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.894 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.894 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 218742 2024-04-19T04:26:23.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.894 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854208+0000", 2024-04-19T04:26:23.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854208+0000", 2024-04-19T04:26:23.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854207+0000", 2024-04-19T04:26:23.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854213+0000", 2024-04-19T04:26:23.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9229999999999999e-06 2024-04-19T04:26:23.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854224+0000", 2024-04-19T04:26:23.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1157e-05 2024-04-19T04:26:23.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854232+0000", 2024-04-19T04:26:23.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9240000000000007e-06 2024-04-19T04:26:23.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.856286+0000", 2024-04-19T04:26:23.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002054447 2024-04-19T04:26:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.856361+0000", 2024-04-19T04:26:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.504e-05 2024-04-19T04:26:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.900 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:218744 5.e 5:79365d8d:::benchmark_data_smithi007_19526_object93010:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:23.900 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:23.854464+0000", 2024-04-19T04:26:23.900 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002520895, 2024-04-19T04:26:23.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027834230000000001, 2024-04-19T04:26:23.900 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.900 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:23.901 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.901 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.901 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.901 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 218744 2024-04-19T04:26:23.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.901 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854464+0000", 2024-04-19T04:26:23.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854464+0000", 2024-04-19T04:26:23.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854463+0000", 2024-04-19T04:26:23.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854468+0000", 2024-04-19T04:26:23.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2429999999999996e-06 2024-04-19T04:26:23.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854478+0000", 2024-04-19T04:26:23.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7720000000000006e-06 2024-04-19T04:26:23.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854493+0000", 2024-04-19T04:26:23.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4987999999999999e-05 2024-04-19T04:26:23.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.855198+0000", 2024-04-19T04:26:23.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070460900000000003 2024-04-19T04:26:23.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.855327+0000", 2024-04-19T04:26:23.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012875000000000001 2024-04-19T04:26:23.907 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.907 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.908 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.908 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:218745 5.0 5:0c7cbee0:::benchmark_data_smithi007_19526_object93011:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:23.908 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:23.854517+0000", 2024-04-19T04:26:23.908 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002467997, 2024-04-19T04:26:23.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027631819999999999, 2024-04-19T04:26:23.908 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.908 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:23.909 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.909 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.909 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.909 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 218745 2024-04-19T04:26:23.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.909 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854517+0000", 2024-04-19T04:26:23.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854517+0000", 2024-04-19T04:26:23.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854516+0000", 2024-04-19T04:26:23.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:23.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854521+0000", 2024-04-19T04:26:23.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.206e-06 2024-04-19T04:26:23.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854529+0000", 2024-04-19T04:26:23.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5709999999999998e-06 2024-04-19T04:26:23.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854535+0000", 2024-04-19T04:26:23.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1e-06 2024-04-19T04:26:23.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854572+0000", 2024-04-19T04:26:23.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6559e-05 2024-04-19T04:26:23.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.854677+0000", 2024-04-19T04:26:23.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010493999999999999 2024-04-19T04:26:23.912 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.913 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.913 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.913 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:218748 5.b 5:d24b4bc3:::benchmark_data_smithi007_19526_object93014:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T04:26:23.913 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:23.856664+0000", 2024-04-19T04:26:23.913 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.000320556, 2024-04-19T04:26:23.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00064822199999999995, 2024-04-19T04:26:23.913 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:23.913 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:23.913 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:23.914 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:23.914 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:23.914 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 218748 2024-04-19T04:26:23.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.914 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:23.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:23.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.856664+0000", 2024-04-19T04:26:23.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:23.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.856664+0000", 2024-04-19T04:26:23.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:23.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:23.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.856663+0000", 2024-04-19T04:26:23.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:23.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:23.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.856669+0000", 2024-04-19T04:26:23.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5400000000000003e-06 2024-04-19T04:26:23.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:23.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.856684+0000", 2024-04-19T04:26:23.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5109999999999999e-05 2024-04-19T04:26:23.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:23.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.856692+0000", 2024-04-19T04:26:23.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1280000000000008e-06 2024-04-19T04:26:23.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:23.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.856738+0000", 2024-04-19T04:26:23.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5804999999999999e-05 2024-04-19T04:26:23.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:23.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:23.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:23.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:23.856862+0000", 2024-04-19T04:26:23.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012368599999999999 2024-04-19T04:26:23.917 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.917 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:23.917 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.917 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:23.917 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:26:23.917 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 10 2024-04-19T04:26:23.917 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:23.918 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:23.919 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:23.921 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:23.921 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:23.921 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:23.922 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:23.925 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:23.926 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:23.966 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:23.964+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:24.040 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:24.036+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:24.041 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:24.041 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:24.053 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:24.141 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:24.136+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:24.177 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:24.177 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:24.188 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:24.243 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:24.240+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:24.298 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T04:26:24.323 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:24.323 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:24.335 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:24.380 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:24.380+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:24.446 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:24.444+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:24.466 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:24.466 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:24.480 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:24.547 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:24.544+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:24.600 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:24.600 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:24.612 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:24.657 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:24.656+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:24.739 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:24.739 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:24.748 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:24.744+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:24.752 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:24.849 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:24.848+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:24.870 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:24.870 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:24.879 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:24.951 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:24.948+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:25.003 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:25.003 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:25.014 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:25.052 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:25.048+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:25.142 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:25.142 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:25.153 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:25.152+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:25.156 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:25.253 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:25.252+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:25.287 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:25.288 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:25.301 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:25.307 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-04-19T04:26:25.355 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:25.352+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:25.431 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:25.431 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:25.444 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:25.490 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:25.488+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:25.557 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:25.552+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:25.566 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:25.566 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:25.577 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:25.658 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:25.656+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:25.701 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:25.701 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:25.713 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:25.759 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:25.756+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:25.831 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:25.831 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:25.842 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:25.888 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:25.888+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:25.927 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:26:25.961 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:25.956+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:25.976 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:25.977 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:25.988 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:26.061 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:26.056+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:26.086 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:26.108 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:26.108 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:26.108 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:26.108 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:26.112 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:26.113 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:26.119 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:26.119 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:26.119 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:26.120 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:26.120 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:26.132 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:26.162 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:26.160+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:26.263 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:26.260+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:26.267 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:26.267 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:26.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:26.267 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 92.034654576999998, 2024-04-19T04:26:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 92.030559655999994, 2024-04-19T04:26:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 92.027268470999999, 2024-04-19T04:26:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 70.309879006000003, 2024-04-19T04:26:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 70.289648557000007, 2024-04-19T04:26:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 70.289540700000003, 2024-04-19T04:26:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 70.287574011000004, 2024-04-19T04:26:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 70.284209816000001, 2024-04-19T04:26:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 70.280398837999996, 2024-04-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 57.038536481000001, 2024-04-19T04:26:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 57.037942201, 2024-04-19T04:26:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.313295043, 2024-04-19T04:26:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.313254626999999, 2024-04-19T04:26:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.309558318000001, 2024-04-19T04:26:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.055947843999999, 2024-04-19T04:26:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.053654431999998, 2024-04-19T04:26:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.053608615999998, 2024-04-19T04:26:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174342 5.9 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.368451916000001, 2024-04-19T04:26:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068615152999999998, 2024-04-19T04:26:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174342 2024-04-19T04:26:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897726+0000", 2024-04-19T04:26:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897731+0000", 2024-04-19T04:26:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1449999999999999e-06 2024-04-19T04:26:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897744+0000", 2024-04-19T04:26:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2833000000000001e-05 2024-04-19T04:26:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897749+0000", 2024-04-19T04:26:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1540000000000001e-06 2024-04-19T04:26:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897810+0000", 2024-04-19T04:26:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0724999999999999e-05 2024-04-19T04:26:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897920+0000", 2024-04-19T04:26:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011024 2024-04-19T04:26:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897993+0000", 2024-04-19T04:26:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2335000000000005e-05 2024-04-19T04:26:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.899597+0000", 2024-04-19T04:26:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016048919999999999 2024-04-19T04:26:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966230+0000", 2024-04-19T04:26:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.066632882000000004 2024-04-19T04:26:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966296+0000", 2024-04-19T04:26:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5361e-05 2024-04-19T04:26:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966342+0000", 2024-04-19T04:26:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6476e-05 2024-04-19T04:26:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174344 5.d 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.367773077999999, 2024-04-19T04:26:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068211329000000001, 2024-04-19T04:26:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174344 2024-04-19T04:26:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898405+0000", 2024-04-19T04:26:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898409+0000", 2024-04-19T04:26:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5149999999999998e-06 2024-04-19T04:26:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898415+0000", 2024-04-19T04:26:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:26:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898419+0000", 2024-04-19T04:26:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.89e-06 2024-04-19T04:26:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898459+0000", 2024-04-19T04:26:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0017e-05 2024-04-19T04:26:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898540+0000", 2024-04-19T04:26:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1237999999999997e-05 2024-04-19T04:26:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6060000000000001e-05 2024-04-19T04:26:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.901321+0000", 2024-04-19T04:26:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027152109999999999 2024-04-19T04:26:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966512+0000", 2024-04-19T04:26:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.065190440000000002 2024-04-19T04:26:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966563+0000", 2024-04-19T04:26:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1436e-05 2024-04-19T04:26:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966617+0000", 2024-04-19T04:26:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.401e-05 2024-04-19T04:26:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174346 5.f 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 21.365986850999999, 2024-04-19T04:26:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.067185536000000004, 2024-04-19T04:26:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174346 2024-04-19T04:26:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900191+0000", 2024-04-19T04:26:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900196+0000", 2024-04-19T04:26:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3329999999999998e-06 2024-04-19T04:26:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900206+0000", 2024-04-19T04:26:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9699999999999994e-06 2024-04-19T04:26:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900210+0000", 2024-04-19T04:26:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3359999999999997e-06 2024-04-19T04:26:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900243+0000", 2024-04-19T04:26:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2669999999999997e-05 2024-04-19T04:26:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900365+0000", 2024-04-19T04:26:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122648 2024-04-19T04:26:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900559+0000", 2024-04-19T04:26:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019358799999999999 2024-04-19T04:26:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.903018+0000", 2024-04-19T04:26:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024592300000000002 2024-04-19T04:26:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967180+0000", 2024-04-19T04:26:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.064161587000000006 2024-04-19T04:26:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967293+0000", 2024-04-19T04:26:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112921 2024-04-19T04:26:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967378+0000", 2024-04-19T04:26:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5000999999999995e-05 2024-04-19T04:26:26.376 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.376 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.376 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.376 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:26.376 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:26.376 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:26.377 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:26.378 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:26.376+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:26.478 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:26.476+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:26.507 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:224995 5.8 5:1c8658c9:::benchmark_data_smithi007_19526_object99261:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:26.499195+0000", 2024-04-19T04:26:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0078561150000000003, 2024-04-19T04:26:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0078728659999999992, 2024-04-19T04:26:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:26.507 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 224995 2024-04-19T04:26:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.499195+0000", 2024-04-19T04:26:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.499195+0000", 2024-04-19T04:26:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.499194+0000", 2024-04-19T04:26:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.499200+0000", 2024-04-19T04:26:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7769999999999999e-06 2024-04-19T04:26:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.499211+0000", 2024-04-19T04:26:26.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0813e-05 2024-04-19T04:26:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.499219+0000", 2024-04-19T04:26:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0770000000000008e-06 2024-04-19T04:26:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.500999+0000", 2024-04-19T04:26:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001780333 2024-04-19T04:26:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.501216+0000", 2024-04-19T04:26:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021644000000000001 2024-04-19T04:26:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:224998 5.8 5:1e8f0763:::benchmark_data_smithi007_19526_object99264:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:26.500280+0000", 2024-04-19T04:26:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0067709470000000003, 2024-04-19T04:26:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0068367310000000004, 2024-04-19T04:26:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.511 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 224998 2024-04-19T04:26:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.500280+0000", 2024-04-19T04:26:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.500280+0000", 2024-04-19T04:26:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.500280+0000", 2024-04-19T04:26:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.500284+0000", 2024-04-19T04:26:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7639999999999996e-06 2024-04-19T04:26:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.500298+0000", 2024-04-19T04:26:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3371e-05 2024-04-19T04:26:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.500305+0000", 2024-04-19T04:26:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7680000000000008e-06 2024-04-19T04:26:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.503063+0000", 2024-04-19T04:26:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002757509 2024-04-19T04:26:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.503185+0000", 2024-04-19T04:26:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012176900000000001 2024-04-19T04:26:26.514 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:225002 5.0 5:0cf38912:::benchmark_data_smithi007_19526_object99268:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:26.501796+0000", 2024-04-19T04:26:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0052551270000000001, 2024-04-19T04:26:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053566919999999997, 2024-04-19T04:26:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.515 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 225002 2024-04-19T04:26:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.501796+0000", 2024-04-19T04:26:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.501796+0000", 2024-04-19T04:26:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.501795+0000", 2024-04-19T04:26:26.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.501801+0000", 2024-04-19T04:26:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8320000000000002e-06 2024-04-19T04:26:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.501817+0000", 2024-04-19T04:26:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5624000000000002e-05 2024-04-19T04:26:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.501824+0000", 2024-04-19T04:26:26.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1969999999999999e-06 2024-04-19T04:26:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.503050+0000", 2024-04-19T04:26:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001226092 2024-04-19T04:26:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.503174+0000", 2024-04-19T04:26:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012383699999999999 2024-04-19T04:26:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:225003 5.4 5:2310cc50:::benchmark_data_smithi007_19526_object99269:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:26.502495+0000", 2024-04-19T04:26:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.004556053, 2024-04-19T04:26:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046911139999999997, 2024-04-19T04:26:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 225003 2024-04-19T04:26:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.502495+0000", 2024-04-19T04:26:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.502495+0000", 2024-04-19T04:26:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.502495+0000", 2024-04-19T04:26:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.502499+0000", 2024-04-19T04:26:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2409999999999997e-06 2024-04-19T04:26:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.502507+0000", 2024-04-19T04:26:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7400000000000004e-06 2024-04-19T04:26:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.502511+0000", 2024-04-19T04:26:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5809999999999998e-06 2024-04-19T04:26:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.502550+0000", 2024-04-19T04:26:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8747e-05 2024-04-19T04:26:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.502674+0000", 2024-04-19T04:26:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012422400000000001 2024-04-19T04:26:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:225004 5.4 5:2a962b20:::benchmark_data_smithi007_19526_object99270:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:26.502633+0000", 2024-04-19T04:26:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.004418628, 2024-04-19T04:26:26.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045881409999999996, 2024-04-19T04:26:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 225004 2024-04-19T04:26:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.502633+0000", 2024-04-19T04:26:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.502633+0000", 2024-04-19T04:26:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.502632+0000", 2024-04-19T04:26:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.502635+0000", 2024-04-19T04:26:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.145e-06 2024-04-19T04:26:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.502640+0000", 2024-04-19T04:26:26.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7690000000000004e-06 2024-04-19T04:26:26.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.502643+0000", 2024-04-19T04:26:26.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2650000000000001e-06 2024-04-19T04:26:26.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.504948+0000", 2024-04-19T04:26:26.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023042399999999999 2024-04-19T04:26:26.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505092+0000", 2024-04-19T04:26:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014413300000000001 2024-04-19T04:26:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:225005 5.f e62/20 5:f32acd8a:::benchmark_data_smithi007_19526_object99271:head v 62'13765, mlcod=62'13763)", 2024-04-19T04:26:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:26.503377+0000", 2024-04-19T04:26:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.003674535, 2024-04-19T04:26:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038766059999999999, 2024-04-19T04:26:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.503377+0000", 2024-04-19T04:26:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.503377+0000", 2024-04-19T04:26:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.503376+0000", 2024-04-19T04:26:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.503383+0000", 2024-04-19T04:26:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7870000000000004e-06 2024-04-19T04:26:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.503391+0000", 2024-04-19T04:26:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5180000000000004e-06 2024-04-19T04:26:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.503397+0000", 2024-04-19T04:26:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6930000000000004e-06 2024-04-19T04:26:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.503441+0000", 2024-04-19T04:26:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3912999999999998e-05 2024-04-19T04:26:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.503459+0000", 2024-04-19T04:26:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8034e-05 2024-04-19T04:26:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:225007 5.4 5.eeb25a54 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:26.529 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:26.503381+0000", 2024-04-19T04:26:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0036701799999999999, 2024-04-19T04:26:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039009489999999999, 2024-04-19T04:26:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 225007 2024-04-19T04:26:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.503381+0000", 2024-04-19T04:26:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.503381+0000", 2024-04-19T04:26:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.503380+0000", 2024-04-19T04:26:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.503385+0000", 2024-04-19T04:26:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0989999999999998e-06 2024-04-19T04:26:26.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.503395+0000", 2024-04-19T04:26:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.312e-06 2024-04-19T04:26:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.503401+0000", 2024-04-19T04:26:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8260000000000004e-06 2024-04-19T04:26:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.532 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:225008 5.b 5:ded2ae0c:::benchmark_data_smithi007_19526_object99274:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:26.505196+0000", 2024-04-19T04:26:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0018557269999999999, 2024-04-19T04:26:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021144290000000001, 2024-04-19T04:26:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 225008 2024-04-19T04:26:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505196+0000", 2024-04-19T04:26:26.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505196+0000", 2024-04-19T04:26:26.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505195+0000", 2024-04-19T04:26:26.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505200+0000", 2024-04-19T04:26:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0309999999999998e-06 2024-04-19T04:26:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505219+0000", 2024-04-19T04:26:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8944999999999999e-05 2024-04-19T04:26:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505225+0000", 2024-04-19T04:26:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6630000000000004e-06 2024-04-19T04:26:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505279+0000", 2024-04-19T04:26:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3363999999999999e-05 2024-04-19T04:26:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505406+0000", 2024-04-19T04:26:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000127766 2024-04-19T04:26:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:225009 5.0 5:063db9d6:::benchmark_data_smithi007_19526_object99275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:26.505621+0000", 2024-04-19T04:26:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001429821, 2024-04-19T04:26:26.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0017430290000000001, 2024-04-19T04:26:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 225009 2024-04-19T04:26:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505621+0000", 2024-04-19T04:26:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505621+0000", 2024-04-19T04:26:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505621+0000", 2024-04-19T04:26:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505625+0000", 2024-04-19T04:26:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9149999999999998e-06 2024-04-19T04:26:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505631+0000", 2024-04-19T04:26:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0599999999999996e-06 2024-04-19T04:26:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505635+0000", 2024-04-19T04:26:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5399999999999997e-06 2024-04-19T04:26:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505679+0000", 2024-04-19T04:26:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3426000000000001e-05 2024-04-19T04:26:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505793+0000", 2024-04-19T04:26:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011435800000000001 2024-04-19T04:26:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:225010 5.8 5:121d87f7:::benchmark_data_smithi007_19526_object99276:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:26.505650+0000", 2024-04-19T04:26:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0014012320000000001, 2024-04-19T04:26:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001760878, 2024-04-19T04:26:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:26.540 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 225010 2024-04-19T04:26:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505650+0000", 2024-04-19T04:26:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505650+0000", 2024-04-19T04:26:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505650+0000", 2024-04-19T04:26:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505652+0000", 2024-04-19T04:26:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2419999999999999e-06 2024-04-19T04:26:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505656+0000", 2024-04-19T04:26:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9740000000000004e-06 2024-04-19T04:26:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505659+0000", 2024-04-19T04:26:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2720000000000002e-06 2024-04-19T04:26:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505777+0000", 2024-04-19T04:26:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117804 2024-04-19T04:26:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505895+0000", 2024-04-19T04:26:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117621 2024-04-19T04:26:26.543 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:225012 5.0 5.e2490cb0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:26.505831+0000", 2024-04-19T04:26:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001220437, 2024-04-19T04:26:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001612793, 2024-04-19T04:26:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 225012 2024-04-19T04:26:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.544 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505831+0000", 2024-04-19T04:26:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505831+0000", 2024-04-19T04:26:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505830+0000", 2024-04-19T04:26:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505834+0000", 2024-04-19T04:26:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4740000000000001e-06 2024-04-19T04:26:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505839+0000", 2024-04-19T04:26:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8570000000000003e-06 2024-04-19T04:26:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.505842+0000", 2024-04-19T04:26:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.252e-06 2024-04-19T04:26:26.546 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:225015 5.a 5:578ade36:::benchmark_data_smithi007_19526_object99281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:26.507342+0000", 2024-04-19T04:26:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9997091, 2024-04-19T04:26:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013076799999999999, 2024-04-19T04:26:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 225015 2024-04-19T04:26:26.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.507342+0000", 2024-04-19T04:26:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.507342+0000", 2024-04-19T04:26:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.507341+0000", 2024-04-19T04:26:26.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.507346+0000", 2024-04-19T04:26:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9139999999999999e-06 2024-04-19T04:26:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.507358+0000", 2024-04-19T04:26:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1626e-05 2024-04-19T04:26:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.507364+0000", 2024-04-19T04:26:26.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000002e-06 2024-04-19T04:26:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:26.507413+0000", 2024-04-19T04:26:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8952999999999997e-05 2024-04-19T04:26:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:26:26.550 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 12 2024-04-19T04:26:26.550 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:26.551 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:26.578 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:26.576+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:26.672 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:26.672 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:26.672 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:26.672 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:26.672 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:26.680 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:26.676+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:26.684 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:26.783 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:26.780+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:26.809 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:26.809 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:26.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:26.809 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:26.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.809 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:26.809 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:26.809 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 70.855567281000006, 2024-04-19T04:26:26.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:26.809 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.809 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:26.810 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.810 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.810 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.810 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:26.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.810 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:26.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:26.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:26.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:26.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:26.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:26.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:26.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:26.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:26.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:26.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:26.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:26.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:26.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:26.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:26.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:26.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:26.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:26.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:26.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:26.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:26.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:26.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:26.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:26.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:26.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:26.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:26.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:26.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:26.816 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.816 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.816 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.816 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:26.817 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:26.817 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 70.850505635000005, 2024-04-19T04:26:26.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:26.817 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.817 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:26.817 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.817 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.817 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.817 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:26.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.817 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:26.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:26.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:26.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:26.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:26.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:26.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:26.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:26.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:26.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:26.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:26.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:26.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:26.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:26.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:26.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:26.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:26.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:26.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:26.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:26.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:26.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:26.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:26.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:26.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:26.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:26.824 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.824 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.824 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.824 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:26.824 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:26.824 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 70.850405722999994, 2024-04-19T04:26:26.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:26.824 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.824 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:26.825 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.825 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.825 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.825 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:26.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.825 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:26.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:26.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:26.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:26.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:26.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.827 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.827 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:26.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:26.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.827 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.827 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:26.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:26.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.827 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.827 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:26.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:26.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:26.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:26.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:26.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:26.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:26.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:26.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:26.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:26.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:26.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:26.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:26.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:26.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:26.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:26.829 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.830 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.830 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.830 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:26.830 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:26.830 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 70.850279970000003, 2024-04-19T04:26:26.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:26.830 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.830 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:26.830 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.830 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.831 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.831 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:26.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.831 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.831 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:26.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.831 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:26.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:26.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:26.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:26.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:26.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:26.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:26.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:26.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:26.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:26.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:26.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:26.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:26.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:26.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:26.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:26.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:26.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:26.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:26.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:26.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.835 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.835 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:26.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:26.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.835 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.835 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:26.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:26.835 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.835 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.835 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.836 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:26.836 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:26.836 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 70.846436025000003, 2024-04-19T04:26:26.836 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:26.836 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.836 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.836 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.836 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.836 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.836 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:26.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.836 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.836 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.836 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.836 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:26.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:26.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:26.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:26.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:26.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:26.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:26.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:26.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:26.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:26.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:26.839 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:26.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.839 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.839 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:26.839 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:26.839 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:26.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.839 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.839 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.839 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:26.839 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:26.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.839 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.839 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.839 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:26.840 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:26.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.840 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.840 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:26.840 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:26.840 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:26.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.840 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.840 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:26.840 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:26.840 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:26.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.841 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.841 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.841 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:26.841 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:26.841 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.841 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.841 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.841 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.841 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.841 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:26.841 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:26.841 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 70.839264924000005, 2024-04-19T04:26:26.841 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:26.841 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.842 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:26.842 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.842 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.842 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.842 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:26.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.842 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.842 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.842 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.842 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:26.842 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.842 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.843 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:26.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.843 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:26.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:26.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.843 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:26.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:26.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:26.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:26.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:26.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:26.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:26.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:26.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:26.845 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:26.845 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:26.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:26.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:26.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.846 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.846 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:26.847 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:26.847 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.847 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.847 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.847 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.847 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:26.847 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:26.847 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 70.839092820000005, 2024-04-19T04:26:26.847 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:26.847 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.847 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:26.847 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.847 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.848 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.848 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:26.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.848 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:26.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:26.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:26.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:26.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:26.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:26.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:26.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.850 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:26.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:26.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.850 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:26.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:26.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.850 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:26.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:26.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:26.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:26.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:26.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:26.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:26.851 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.851 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.851 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.852 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:26.852 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:26.852 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 70.839029694999994, 2024-04-19T04:26:26.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:26.852 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.852 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.852 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.852 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.852 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.852 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:26.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.852 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:26.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:26.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:26.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:26.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:26.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:26.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:26.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:26.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:26.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:26.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:26.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:26.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:26.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:26.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:26.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:26.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:26.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:26.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:26.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:26.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:26.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:26.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:26.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:26.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:26.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:26.857 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.857 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.857 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.857 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:26.857 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:26.857 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 70.838901097999994, 2024-04-19T04:26:26.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:26.858 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.858 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.858 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.858 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.858 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.858 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:26.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.858 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:26.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:26.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:26.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:26.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:26.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:26.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:26.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:26.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:26.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:26.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:26.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:26.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:26.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:26.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:26.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:26.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:26.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:26.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:26.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:26.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:26.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:26.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:26.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:26.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:26.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:26.862 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.862 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.863 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.863 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:26.863 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:26.863 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 70.838833127000001, 2024-04-19T04:26:26.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:26.863 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.863 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.863 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.863 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.863 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.863 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:26.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.864 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:26.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:26.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:26.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:26.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:26.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:26.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:26.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.919293461999999, 2024-04-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078453623, 2024-04-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965893+0000", 2024-04-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.076646455000000002 2024-04-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965956+0000", 2024-04-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3200000000000005e-05 2024-04-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966068+0000", 2024-04-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011194800000000001 2024-04-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.919262464999999, 2024-04-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083782388999999999, 2024-04-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971179+0000", 2024-04-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079349476000000002 2024-04-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971259+0000", 2024-04-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9083000000000002e-05 2024-04-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971428+0000", 2024-04-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169419 2024-04-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.916940945, 2024-04-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081686998999999996, 2024-04-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971454+0000", 2024-04-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077525997999999999 2024-04-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:26.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971540+0000", 2024-04-19T04:26:26.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6285000000000005e-05 2024-04-19T04:26:26.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971654+0000", 2024-04-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114095 2024-04-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.915730563, 2024-04-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080734265999999999, 2024-04-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971677+0000", 2024-04-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.073192023999999994 2024-04-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971771+0000", 2024-04-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4235999999999997e-05 2024-04-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971912+0000", 2024-04-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014055099999999999 2024-04-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.914779072000002, 2024-04-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085645857000000006, 2024-04-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977634+0000", 2024-04-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077144335999999994 2024-04-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977699+0000", 2024-04-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4518999999999997e-05 2024-04-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977775+0000", 2024-04-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6219999999999999e-05 2024-04-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.911771494, 2024-04-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075403611999999995, 2024-04-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970369+0000", 2024-04-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.074967992999999997 2024-04-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970419+0000", 2024-04-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9700999999999997e-05 2024-04-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970540+0000", 2024-04-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121512 2024-04-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5:78f758ec:::benchmark_data_smithi007_19526_object48602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.91139737, 2024-04-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085171609999999995, 2024-04-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966154+0000", 2024-04-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.070613543000000001 2024-04-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966382+0000", 2024-04-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022741800000000001 2024-04-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980581+0000", 2024-04-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014199916999999999 2024-04-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980621+0000", 2024-04-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9685999999999999e-05 2024-04-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980682+0000", 2024-04-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1130000000000006e-05 2024-04-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.911307418, 2024-04-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075073230000000005, 2024-04-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970556+0000", 2024-04-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.072076192999999997 2024-04-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970608+0000", 2024-04-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2549000000000001e-05 2024-04-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970674+0000", 2024-04-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5549000000000005e-05 2024-04-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5:70a7bb5e:::benchmark_data_smithi007_19526_object48614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.906220421, 2024-04-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080099220999999998, 2024-04-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971978+0000", 2024-04-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.071282358000000004 2024-04-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.972180+0000", 2024-04-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020191100000000001 2024-04-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980701+0000", 2024-04-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085211760000000001 2024-04-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980729+0000", 2024-04-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8068e-05 2024-04-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980787+0000", 2024-04-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7521e-05 2024-04-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174350 5.e 5:7f36609a:::benchmark_data_smithi007_19526_object48616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.904449349, 2024-04-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079723622999999993, 2024-04-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174350 2024-04-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902458+0000", 2024-04-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902463+0000", 2024-04-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5889999999999996e-06 2024-04-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965576+0000", 2024-04-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063113328999999996 2024-04-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965614+0000", 2024-04-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8285999999999999e-05 2024-04-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974787+0000", 2024-04-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009172599 2024-04-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974999+0000", 2024-04-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021270999999999999 2024-04-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982086+0000", 2024-04-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070869160000000004 2024-04-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982115+0000", 2024-04-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8603999999999999e-05 2024-04-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982182+0000", 2024-04-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7350999999999999e-05 2024-04-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:26.923 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:26.923 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:26.920+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:27.023 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:27.020+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:27.051 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:27.051 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:226258 5.6 5:6b95f88e:::benchmark_data_smithi007_19526_object100524:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:27.044253+0000", 2024-04-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0074197409999999997, 2024-04-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0074416159999999999, 2024-04-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 226258 2024-04-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.044253+0000", 2024-04-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.044253+0000", 2024-04-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.044252+0000", 2024-04-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.044259+0000", 2024-04-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7689999999999999e-06 2024-04-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.044273+0000", 2024-04-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4297000000000001e-05 2024-04-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.044282+0000", 2024-04-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2879999999999998e-06 2024-04-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.045937+0000", 2024-04-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00165486 2024-04-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046075+0000", 2024-04-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000137966 2024-04-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:226259 5.6 5:65778a1b:::benchmark_data_smithi007_19526_object100525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:27.045505+0000", 2024-04-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0061674649999999996, 2024-04-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00624246, 2024-04-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 226259 2024-04-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.045505+0000", 2024-04-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.045505+0000", 2024-04-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.045504+0000", 2024-04-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.045511+0000", 2024-04-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6730000000000003e-06 2024-04-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.045528+0000", 2024-04-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7251000000000001e-05 2024-04-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.045540+0000", 2024-04-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2368000000000001e-05 2024-04-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048446+0000", 2024-04-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0029051889999999999 2024-04-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048617+0000", 2024-04-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017099300000000001 2024-04-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:226260 5.5 5:a5ac23f3:::benchmark_data_smithi007_19526_object100526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:27.046090+0000", 2024-04-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0055830180000000004, 2024-04-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005743527, 2024-04-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 226260 2024-04-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046090+0000", 2024-04-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046090+0000", 2024-04-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046089+0000", 2024-04-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046096+0000", 2024-04-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.187e-06 2024-04-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046107+0000", 2024-04-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0577000000000001e-05 2024-04-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046115+0000", 2024-04-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1070000000000005e-06 2024-04-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046172+0000", 2024-04-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7496e-05 2024-04-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046343+0000", 2024-04-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171149 2024-04-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:226261 5.9 5:98207fc6:::benchmark_data_smithi007_19526_object100527:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:27.046129+0000", 2024-04-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0055437919999999996, 2024-04-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005768558, 2024-04-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 226261 2024-04-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046129+0000", 2024-04-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046129+0000", 2024-04-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046129+0000", 2024-04-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046132+0000", 2024-04-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9459999999999998e-06 2024-04-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046138+0000", 2024-04-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6640000000000001e-06 2024-04-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046142+0000", 2024-04-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7479999999999999e-06 2024-04-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046192+0000", 2024-04-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0297999999999999e-05 2024-04-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046330+0000", 2024-04-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013742499999999999 2024-04-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046409+0000", 2024-04-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8967000000000005e-05 2024-04-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:226262 5.6 5:668b9bec:::benchmark_data_smithi007_19526_object100528:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:27.046153+0000", 2024-04-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0055194240000000002, 2024-04-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0057932460000000002, 2024-04-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 226262 2024-04-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046153+0000", 2024-04-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046153+0000", 2024-04-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046153+0000", 2024-04-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046156+0000", 2024-04-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4039999999999999e-06 2024-04-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046164+0000", 2024-04-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046171+0000", 2024-04-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5570000000000001e-06 2024-04-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.050649+0000", 2024-04-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0044778279999999997 2024-04-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.050818+0000", 2024-04-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016907900000000001 2024-04-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:226263 5.7 5:e353b074:::benchmark_data_smithi007_19526_object100529:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:27.046184+0000", 2024-04-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0054890989999999999, 2024-04-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0058053230000000003, 2024-04-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 226263 2024-04-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046184+0000", 2024-04-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046184+0000", 2024-04-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046183+0000", 2024-04-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046187+0000", 2024-04-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7270000000000001e-06 2024-04-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046197+0000", 2024-04-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8390000000000002e-06 2024-04-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046203+0000", 2024-04-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5649999999999998e-06 2024-04-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046258+0000", 2024-04-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4688999999999998e-05 2024-04-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046432+0000", 2024-04-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017402100000000001 2024-04-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:226264 5.f 5:f77a35a0:::benchmark_data_smithi007_19526_object100530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:27.046480+0000", 2024-04-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0051931640000000001, 2024-04-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055513630000000001, 2024-04-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 226264 2024-04-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046480+0000", 2024-04-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046480+0000", 2024-04-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046479+0000", 2024-04-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046485+0000", 2024-04-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2260000000000002e-06 2024-04-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046497+0000", 2024-04-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2181000000000001e-05 2024-04-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.046508+0000", 2024-04-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0519e-05 2024-04-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048338+0000", 2024-04-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001830082 2024-04-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048524+0000", 2024-04-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00018688099999999999 2024-04-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048625+0000", 2024-04-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000100245 2024-04-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:226266 5.9 5:981550d3:::benchmark_data_smithi007_19526_object100532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:27.048091+0000", 2024-04-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0035816559999999999, 2024-04-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0039886039999999998, 2024-04-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 226266 2024-04-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048091+0000", 2024-04-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.082 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.082 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048091+0000", 2024-04-19T04:26:27.082 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.082 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.082 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048090+0000", 2024-04-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048096+0000", 2024-04-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1e-06 2024-04-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048113+0000", 2024-04-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.6733999999999999e-05 2024-04-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048122+0000", 2024-04-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7739999999999993e-06 2024-04-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048433+0000", 2024-04-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031131300000000002 2024-04-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048530+0000", 2024-04-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.6665999999999999e-05 2024-04-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048613+0000", 2024-04-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2888999999999999e-05 2024-04-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:226267 5.f 5:f937af3c:::benchmark_data_smithi007_19526_object100533:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:27.048182+0000", 2024-04-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0034911220000000001, 2024-04-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0039467620000000004, 2024-04-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 226267 2024-04-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048182+0000", 2024-04-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048182+0000", 2024-04-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048181+0000", 2024-04-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048185+0000", 2024-04-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.42e-06 2024-04-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048199+0000", 2024-04-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3706999999999999e-05 2024-04-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.048207+0000", 2024-04-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5580000000000003e-06 2024-04-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.050470+0000", 2024-04-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002263737 2024-04-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.050648+0000", 2024-04-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017751 2024-04-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.050802+0000", 2024-04-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015357700000000001 2024-04-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:226268 5.5 5:a4f87147:::benchmark_data_smithi007_19526_object100534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:27.049157+0000", 2024-04-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0025153760000000002, 2024-04-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.003030886, 2024-04-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 226268 2024-04-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.049157+0000", 2024-04-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.049157+0000", 2024-04-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.049156+0000", 2024-04-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.049162+0000", 2024-04-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0889999999999996e-06 2024-04-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.049181+0000", 2024-04-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8468999999999999e-05 2024-04-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.049194+0000", 2024-04-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2762000000000001e-05 2024-04-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.050505+0000", 2024-04-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001310985 2024-04-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.050633+0000", 2024-04-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000128307 2024-04-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:226271 5.c 5:35097e16:::benchmark_data_smithi007_19526_object100537:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:27.050848+0000", 2024-04-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.000824945, 2024-04-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014097549999999999, 2024-04-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 226271 2024-04-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.050848+0000", 2024-04-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.050848+0000", 2024-04-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.050847+0000", 2024-04-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.050854+0000", 2024-04-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1520000000000003e-06 2024-04-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.050866+0000", 2024-04-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2105e-05 2024-04-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.050875+0000", 2024-04-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1339999999999993e-06 2024-04-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.050927+0000", 2024-04-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1771999999999998e-05 2024-04-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.051058+0000", 2024-04-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013134099999999999 2024-04-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:226272 5.f 5.300b687f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:27.052181+0000", 2024-04-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9994922, 2024-04-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000118823, 2024-04-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 226272 2024-04-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.052181+0000", 2024-04-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.052181+0000", 2024-04-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.052180+0000", 2024-04-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.052186+0000", 2024-04-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3409999999999999e-06 2024-04-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.052202+0000", 2024-04-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5902000000000001e-05 2024-04-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.052211+0000", 2024-04-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9649999999999997e-06 2024-04-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:226254 5.d 5:b82ea575:::benchmark_data_smithi007_19526_object100520:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:27.043213+0000", 2024-04-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0084599319999999999, 2024-04-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0091225100000000003, 2024-04-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 226254 2024-04-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.043213+0000", 2024-04-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.043213+0000", 2024-04-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.043212+0000", 2024-04-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.043218+0000", 2024-04-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5300000000000002e-06 2024-04-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.043228+0000", 2024-04-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.4769999999999992e-06 2024-04-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.043234+0000", 2024-04-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3879999999999997e-06 2024-04-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.043270+0000", 2024-04-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.6148e-05 2024-04-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.043359+0000", 2024-04-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.8603999999999994e-05 2024-04-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.043444+0000", 2024-04-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5073000000000004e-05 2024-04-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:27.051878+0000", 2024-04-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0084336940000000003 2024-04-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:27.106 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 13 2024-04-19T04:26:27.106 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:27.107 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:27.153 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:27.152+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:27.225 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:27.220+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:27.243 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:27.243 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:27.243 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:27.243 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:27.243 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:27.256 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:27.321 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T04:26:27.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2024-04-19T04:26:27.325 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:27.324+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:27.391 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:27.391 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:27.391 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:27.391 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:27.391 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.391 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:27.391 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:27.391 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 93.157654172999997, 2024-04-19T04:26:27.391 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:27.391 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 93.153559251999994, 2024-04-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 93.150268066999999, 2024-04-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 71.432878602000002, 2024-04-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 71.412648153000006, 2024-04-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 71.412540296000003, 2024-04-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 71.410573607000003, 2024-04-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 71.407209412, 2024-04-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 71.403398433999996, 2024-04-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 58.161536077000001, 2024-04-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 58.160941797, 2024-04-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 23.436294639, 2024-04-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 23.436254222999999, 2024-04-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 23.432557914, 2024-04-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 23.178947440000002, 2024-04-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 23.176654028000002, 2024-04-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 23.176608212000001, 2024-04-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174342 5.9 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.491451512000001, 2024-04-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068615152999999998, 2024-04-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174342 2024-04-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897726+0000", 2024-04-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897731+0000", 2024-04-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1449999999999999e-06 2024-04-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897744+0000", 2024-04-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2833000000000001e-05 2024-04-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897749+0000", 2024-04-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1540000000000001e-06 2024-04-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897810+0000", 2024-04-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0724999999999999e-05 2024-04-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897920+0000", 2024-04-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011024 2024-04-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897993+0000", 2024-04-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2335000000000005e-05 2024-04-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.899597+0000", 2024-04-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016048919999999999 2024-04-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966230+0000", 2024-04-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.066632882000000004 2024-04-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966296+0000", 2024-04-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5361e-05 2024-04-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966342+0000", 2024-04-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6476e-05 2024-04-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174344 5.d 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.490772673999999, 2024-04-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068211329000000001, 2024-04-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174344 2024-04-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898405+0000", 2024-04-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898409+0000", 2024-04-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5149999999999998e-06 2024-04-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898415+0000", 2024-04-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898419+0000", 2024-04-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.89e-06 2024-04-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898459+0000", 2024-04-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0017e-05 2024-04-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898540+0000", 2024-04-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1237999999999997e-05 2024-04-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6060000000000001e-05 2024-04-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.901321+0000", 2024-04-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027152109999999999 2024-04-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966512+0000", 2024-04-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.065190440000000002 2024-04-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966563+0000", 2024-04-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1436e-05 2024-04-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966617+0000", 2024-04-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.401e-05 2024-04-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174346 5.f 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 22.488986446999998, 2024-04-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.067185536000000004, 2024-04-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174346 2024-04-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900191+0000", 2024-04-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900196+0000", 2024-04-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3329999999999998e-06 2024-04-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900206+0000", 2024-04-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9699999999999994e-06 2024-04-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900210+0000", 2024-04-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3359999999999997e-06 2024-04-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900243+0000", 2024-04-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2669999999999997e-05 2024-04-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900365+0000", 2024-04-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122648 2024-04-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900559+0000", 2024-04-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019358799999999999 2024-04-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.903018+0000", 2024-04-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024592300000000002 2024-04-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967180+0000", 2024-04-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.064161587000000006 2024-04-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967293+0000", 2024-04-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112921 2024-04-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967378+0000", 2024-04-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5000999999999995e-05 2024-04-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:27.500 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:27.500 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:27.501 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:27.496+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:27.501 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:27.601 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:27.600+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:27.626 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:227610 5.8 5:16030d8e:::benchmark_data_smithi007_19526_object101876:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:27.626031+0000", 2024-04-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001818271, 2024-04-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0018349219999999999, 2024-04-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 227610 2024-04-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626031+0000", 2024-04-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626031+0000", 2024-04-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626031+0000", 2024-04-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626035+0000", 2024-04-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5539999999999999e-06 2024-04-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626045+0000", 2024-04-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3170000000000008e-06 2024-04-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626050+0000", 2024-04-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1889999999999998e-06 2024-04-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626079+0000", 2024-04-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9649999999999999e-05 2024-04-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626155+0000", 2024-04-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5351000000000004e-05 2024-04-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:227608 5.f e62/20 5:f20c9d09:::benchmark_data_smithi007_19526_object101874:head v 62'13939, mlcod=62'13937)", 2024-04-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:27.626345+0000", 2024-04-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001504483, 2024-04-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001562113, 2024-04-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626345+0000", 2024-04-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626345+0000", 2024-04-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626344+0000", 2024-04-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626352+0000", 2024-04-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2830000000000004e-06 2024-04-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626362+0000", 2024-04-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0118999999999999e-05 2024-04-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626368+0000", 2024-04-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5780000000000004e-06 2024-04-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626407+0000", 2024-04-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8931999999999999e-05 2024-04-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626427+0000", 2024-04-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9419000000000002e-05 2024-04-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:227611 5.9 e62/20 5:9cdab87e:::benchmark_data_smithi007_19526_object101877:head v 62'14562, mlcod=62'14559)", 2024-04-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:27.626387+0000", 2024-04-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001462524, 2024-04-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015507330000000001, 2024-04-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626387+0000", 2024-04-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626387+0000", 2024-04-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626387+0000", 2024-04-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626390+0000", 2024-04-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5760000000000002e-06 2024-04-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626397+0000", 2024-04-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3940000000000001e-06 2024-04-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626400+0000", 2024-04-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9440000000000001e-06 2024-04-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626431+0000", 2024-04-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1489999999999998e-05 2024-04-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:27.626446+0000", 2024-04-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.453e-05 2024-04-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 3 2024-04-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:27.639 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:27.702 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:27.700+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:27.777 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:27.803 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:27.800+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 71.947395623999995, 2024-04-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 71.942333977999994, 2024-04-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 71.942234065999997, 2024-04-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 71.942108313000006, 2024-04-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 71.938264368000006, 2024-04-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 71.931093266999994, 2024-04-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 71.930921162999994, 2024-04-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 71.930858037999997, 2024-04-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 71.930729440999997, 2024-04-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 71.930661470000004, 2024-04-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.011121804999998, 2024-04-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078453623, 2024-04-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965893+0000", 2024-04-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.076646455000000002 2024-04-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965956+0000", 2024-04-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3200000000000005e-05 2024-04-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966068+0000", 2024-04-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011194800000000001 2024-04-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.011090807999999, 2024-04-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083782388999999999, 2024-04-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971179+0000", 2024-04-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079349476000000002 2024-04-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971259+0000", 2024-04-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9083000000000002e-05 2024-04-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971428+0000", 2024-04-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169419 2024-04-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.008769288, 2024-04-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081686998999999996, 2024-04-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971454+0000", 2024-04-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077525997999999999 2024-04-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971540+0000", 2024-04-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6285000000000005e-05 2024-04-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971654+0000", 2024-04-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114095 2024-04-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.007558906, 2024-04-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080734265999999999, 2024-04-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971677+0000", 2024-04-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.073192023999999994 2024-04-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971771+0000", 2024-04-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4235999999999997e-05 2024-04-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971912+0000", 2024-04-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014055099999999999 2024-04-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.006607415000001, 2024-04-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085645857000000006, 2024-04-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977634+0000", 2024-04-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077144335999999994 2024-04-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977699+0000", 2024-04-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4518999999999997e-05 2024-04-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977775+0000", 2024-04-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6219999999999999e-05 2024-04-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.003599836999999, 2024-04-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075403611999999995, 2024-04-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970369+0000", 2024-04-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.074967992999999997 2024-04-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970419+0000", 2024-04-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9700999999999997e-05 2024-04-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970540+0000", 2024-04-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121512 2024-04-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5:78f758ec:::benchmark_data_smithi007_19526_object48602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.003225712999999, 2024-04-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085171609999999995, 2024-04-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966154+0000", 2024-04-19T04:26:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.070613543000000001 2024-04-19T04:26:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966382+0000", 2024-04-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022741800000000001 2024-04-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980581+0000", 2024-04-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014199916999999999 2024-04-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980621+0000", 2024-04-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9685999999999999e-05 2024-04-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980682+0000", 2024-04-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1130000000000006e-05 2024-04-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.003135760999999, 2024-04-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075073230000000005, 2024-04-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970556+0000", 2024-04-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.072076192999999997 2024-04-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970608+0000", 2024-04-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2549000000000001e-05 2024-04-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970674+0000", 2024-04-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5549000000000005e-05 2024-04-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5:70a7bb5e:::benchmark_data_smithi007_19526_object48614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.998048764, 2024-04-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080099220999999998, 2024-04-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971978+0000", 2024-04-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.071282358000000004 2024-04-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.972180+0000", 2024-04-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020191100000000001 2024-04-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980701+0000", 2024-04-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085211760000000001 2024-04-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980729+0000", 2024-04-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8068e-05 2024-04-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980787+0000", 2024-04-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7521e-05 2024-04-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174350 5.e 5:7f36609a:::benchmark_data_smithi007_19526_object48616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.996277692, 2024-04-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079723622999999993, 2024-04-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174350 2024-04-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902458+0000", 2024-04-19T04:26:28.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:28.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:28.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902463+0000", 2024-04-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5889999999999996e-06 2024-04-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965576+0000", 2024-04-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063113328999999996 2024-04-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965614+0000", 2024-04-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8285999999999999e-05 2024-04-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974787+0000", 2024-04-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009172599 2024-04-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974999+0000", 2024-04-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021270999999999999 2024-04-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982086+0000", 2024-04-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070869160000000004 2024-04-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982115+0000", 2024-04-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8603999999999999e-05 2024-04-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982182+0000", 2024-04-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7350999999999999e-05 2024-04-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:28.009 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:28.009 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:28.009 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:28.009 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:28.010 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:28.008+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:28.011 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:28.111 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:28.108+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:28.114 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:26:28.142 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:28.142 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:228803 5.6 5:67be253b:::benchmark_data_smithi007_19526_object103069:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:28.141740+0000", 2024-04-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00101961, 2024-04-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0010451690000000001, 2024-04-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 228803 2024-04-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141740+0000", 2024-04-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141740+0000", 2024-04-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141739+0000", 2024-04-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141744+0000", 2024-04-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0479999999999998e-06 2024-04-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141755+0000", 2024-04-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0419e-05 2024-04-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141762+0000", 2024-04-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3329999999999999e-06 2024-04-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141802+0000", 2024-04-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9671e-05 2024-04-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141934+0000", 2024-04-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013229600000000001 2024-04-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:228805 5.5 5:aaa702c7:::benchmark_data_smithi007_19526_object103071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:28.141777+0000", 2024-04-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00098277999999999994, 2024-04-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001086952, 2024-04-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 228805 2024-04-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141777+0000", 2024-04-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141777+0000", 2024-04-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141777+0000", 2024-04-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141780+0000", 2024-04-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.14e-06 2024-04-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141786+0000", 2024-04-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3749999999999999e-06 2024-04-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141793+0000", 2024-04-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9290000000000001e-06 2024-04-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141830+0000", 2024-04-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7225999999999999e-05 2024-04-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141974+0000", 2024-04-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014395 2024-04-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:228807 5.c 5:3d321a13:::benchmark_data_smithi007_19526_object103073:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:28.141803+0000", 2024-04-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00095721000000000001, 2024-04-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001131068, 2024-04-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 228807 2024-04-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141803+0000", 2024-04-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141803+0000", 2024-04-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141802+0000", 2024-04-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141805+0000", 2024-04-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9289999999999998e-06 2024-04-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141811+0000", 2024-04-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.93e-06 2024-04-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141816+0000", 2024-04-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2270000000000001e-06 2024-04-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141865+0000", 2024-04-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8369999999999999e-05 2024-04-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141996+0000", 2024-04-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000131667 2024-04-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:228808 5.2 5:4ea2435d:::benchmark_data_smithi007_19526_object103074:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:28.141828+0000", 2024-04-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00093212899999999997, 2024-04-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0011748170000000001, 2024-04-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 228808 2024-04-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141828+0000", 2024-04-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141828+0000", 2024-04-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141827+0000", 2024-04-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141830+0000", 2024-04-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.0130000000000002e-06 2024-04-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141837+0000", 2024-04-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4860000000000002e-06 2024-04-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141854+0000", 2024-04-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7334999999999999e-05 2024-04-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141901+0000", 2024-04-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6474999999999998e-05 2024-04-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141980+0000", 2024-04-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9084000000000004e-05 2024-04-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:228810 5.3 5.ef823eb3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:28.143007+0000", 2024-04-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.999753, 2024-04-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6765000000000002e-05, 2024-04-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 228810 2024-04-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.143007+0000", 2024-04-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.143007+0000", 2024-04-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.143006+0000", 2024-04-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.143011+0000", 2024-04-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0780000000000003e-06 2024-04-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.143025+0000", 2024-04-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3912e-05 2024-04-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.143030+0000", 2024-04-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2580000000000003e-06 2024-04-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:228790 5.9 5:9bd42086:::benchmark_data_smithi007_19526_object103056:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:28.135591+0000", 2024-04-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.007169122, 2024-04-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0075461219999999997, 2024-04-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 228790 2024-04-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.135591+0000", 2024-04-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.135591+0000", 2024-04-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.135590+0000", 2024-04-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.135595+0000", 2024-04-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6420000000000004e-06 2024-04-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.135606+0000", 2024-04-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1080999999999999e-05 2024-04-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.135621+0000", 2024-04-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5072000000000001e-05 2024-04-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.136380+0000", 2024-04-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00075840300000000005 2024-04-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.136485+0000", 2024-04-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010505000000000001 2024-04-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.136559+0000", 2024-04-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3825000000000006e-05 2024-04-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.141413+0000", 2024-04-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0048544879999999997 2024-04-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:228792 5.d 5:b5c740c8:::benchmark_data_smithi007_19526_object103058:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:28.135932+0000", 2024-04-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0068277320000000004, 2024-04-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0072845180000000002, 2024-04-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 228792 2024-04-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.135932+0000", 2024-04-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.135932+0000", 2024-04-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.135931+0000", 2024-04-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.135940+0000", 2024-04-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5459999999999992e-06 2024-04-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.135951+0000", 2024-04-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1303e-05 2024-04-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.135956+0000", 2024-04-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2140000000000004e-06 2024-04-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.137571+0000", 2024-04-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016146520000000001 2024-04-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.137742+0000", 2024-04-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017129999999999999 2024-04-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.137889+0000", 2024-04-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014657599999999999 2024-04-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:228800 5.1 5:860e2d0a:::benchmark_data_smithi007_19526_object103066:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:28.139031+0000", 2024-04-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0037286979999999999, 2024-04-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0042624129999999996, 2024-04-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 228800 2024-04-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.139031+0000", 2024-04-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.139031+0000", 2024-04-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.139030+0000", 2024-04-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.139035+0000", 2024-04-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1390000000000003e-06 2024-04-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.139046+0000", 2024-04-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0767999999999999e-05 2024-04-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.139052+0000", 2024-04-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.942e-06 2024-04-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.139092+0000", 2024-04-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9675999999999998e-05 2024-04-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.139242+0000", 2024-04-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015033599999999999 2024-04-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:228801 5.5 5:a116e4e8:::benchmark_data_smithi007_19526_object103067:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:28.139061+0000", 2024-04-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.003698916, 2024-04-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0043017050000000003, 2024-04-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 228801 2024-04-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.139061+0000", 2024-04-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.139061+0000", 2024-04-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.139061+0000", 2024-04-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.139063+0000", 2024-04-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1900000000000002e-06 2024-04-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.139066+0000", 2024-04-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.613e-06 2024-04-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.139069+0000", 2024-04-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.723e-06 2024-04-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.139100+0000", 2024-04-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1075999999999999e-05 2024-04-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:28.139244+0000", 2024-04-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014356800000000001 2024-04-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 9 2024-04-19T04:26:28.180 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:28.181 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:28.212 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:28.212+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:28.267 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:28.292 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:28.293 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:28.293 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:28.293 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:28.296 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:28.297 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:28.306 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:28.307 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:28.313 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:28.308+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:28.320 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:28.322 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-04-19T04:26:28.414 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:28.412+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:28.446 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:28.446 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:28.457 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:28.515 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:28.512+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:28.579 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:28.579 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:28.590 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:28.616 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:28.612+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:28.712 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:28.712 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:28.717 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:28.716+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:28.722 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:28.818 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:28.816+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:28.847 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:28.847 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:28.861 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:28.919 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:28.916+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:28.992 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:28.992 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:29.004 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:29.020 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:29.016+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:29.121 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:29.120+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:29.130 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:29.130 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:29.143 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:29.223 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:29.216+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:29.270 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:29.270 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:29.281 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:29.326 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:29.324+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:29.405 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:29.405 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:29.417 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:29.423 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:29.420+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:29.524 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:29.520+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:29.536 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:29.536 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:29.550 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:29.625 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:29.620+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:29.718 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:29.718 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:29.726 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:29.724+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:29.728 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:29.827 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:29.824+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:29.861 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:29.861 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:29.874 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:29.928 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:29.924+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:29.993 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:29.993 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:30.006 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:30.029 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:30.024+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:30.130 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:30.128+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:30.139 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:30.140 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:30.153 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:30.231 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:30.228+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:30.273 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:30.273 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:30.285 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:30.298 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:26:30.332 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:30.328+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:30.336 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T04:26:30.404 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:30.405 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:30.416 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:30.459 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:30.456+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:30.465 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:30.491 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:30.491 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:30.491 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:30.491 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:30.495 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:30.495 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:30.533 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:30.528+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:30.586 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 74.633682798999999, 2024-04-19T04:26:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 74.628621152999997, 2024-04-19T04:26:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 74.628521241000001, 2024-04-19T04:26:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 74.628395487999995, 2024-04-19T04:26:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 74.624551542999995, 2024-04-19T04:26:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 74.617380441999998, 2024-04-19T04:26:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 74.617208337999998, 2024-04-19T04:26:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 74.617145213000001, 2024-04-19T04:26:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 74.617016616000001, 2024-04-19T04:26:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 74.616948644999994, 2024-04-19T04:26:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.697408979999999, 2024-04-19T04:26:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078453623, 2024-04-19T04:26:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965893+0000", 2024-04-19T04:26:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.076646455000000002 2024-04-19T04:26:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965956+0000", 2024-04-19T04:26:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3200000000000005e-05 2024-04-19T04:26:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966068+0000", 2024-04-19T04:26:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011194800000000001 2024-04-19T04:26:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.697377982999999, 2024-04-19T04:26:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083782388999999999, 2024-04-19T04:26:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971179+0000", 2024-04-19T04:26:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079349476000000002 2024-04-19T04:26:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971259+0000", 2024-04-19T04:26:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9083000000000002e-05 2024-04-19T04:26:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971428+0000", 2024-04-19T04:26:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169419 2024-04-19T04:26:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.695056463, 2024-04-19T04:26:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081686998999999996, 2024-04-19T04:26:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971454+0000", 2024-04-19T04:26:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077525997999999999 2024-04-19T04:26:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971540+0000", 2024-04-19T04:26:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6285000000000005e-05 2024-04-19T04:26:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971654+0000", 2024-04-19T04:26:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114095 2024-04-19T04:26:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.693846081, 2024-04-19T04:26:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080734265999999999, 2024-04-19T04:26:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971677+0000", 2024-04-19T04:26:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.073192023999999994 2024-04-19T04:26:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971771+0000", 2024-04-19T04:26:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4235999999999997e-05 2024-04-19T04:26:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971912+0000", 2024-04-19T04:26:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014055099999999999 2024-04-19T04:26:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.692894590000002, 2024-04-19T04:26:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085645857000000006, 2024-04-19T04:26:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:30.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977634+0000", 2024-04-19T04:26:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077144335999999994 2024-04-19T04:26:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977699+0000", 2024-04-19T04:26:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4518999999999997e-05 2024-04-19T04:26:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977775+0000", 2024-04-19T04:26:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6219999999999999e-05 2024-04-19T04:26:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.669 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.689887012, 2024-04-19T04:26:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075403611999999995, 2024-04-19T04:26:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:30.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:30.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:30.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970369+0000", 2024-04-19T04:26:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.074967992999999997 2024-04-19T04:26:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970419+0000", 2024-04-19T04:26:30.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9700999999999997e-05 2024-04-19T04:26:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970540+0000", 2024-04-19T04:26:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121512 2024-04-19T04:26:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5:78f758ec:::benchmark_data_smithi007_19526_object48602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.689512887999999, 2024-04-19T04:26:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085171609999999995, 2024-04-19T04:26:30.674 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:30.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:30.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:30.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:30.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:30.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:30.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:30.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:30.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:30.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966154+0000", 2024-04-19T04:26:30.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.070613543000000001 2024-04-19T04:26:30.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:30.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966382+0000", 2024-04-19T04:26:30.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022741800000000001 2024-04-19T04:26:30.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:30.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980581+0000", 2024-04-19T04:26:30.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014199916999999999 2024-04-19T04:26:30.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:30.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980621+0000", 2024-04-19T04:26:30.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9685999999999999e-05 2024-04-19T04:26:30.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980682+0000", 2024-04-19T04:26:30.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1130000000000006e-05 2024-04-19T04:26:30.679 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.679 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.679 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.679 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:30.679 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:30.679 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.689422936, 2024-04-19T04:26:30.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075073230000000005, 2024-04-19T04:26:30.679 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.679 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:30.679 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.679 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.679 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.680 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:30.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.680 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:30.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:30.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:30.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:30.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:30.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:30.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:30.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:30.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:30.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:30.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:30.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:30.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:30.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:30.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:30.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:30.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970556+0000", 2024-04-19T04:26:30.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.072076192999999997 2024-04-19T04:26:30.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:30.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970608+0000", 2024-04-19T04:26:30.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2549000000000001e-05 2024-04-19T04:26:30.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970674+0000", 2024-04-19T04:26:30.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5549000000000005e-05 2024-04-19T04:26:30.683 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.683 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.683 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.684 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5:70a7bb5e:::benchmark_data_smithi007_19526_object48614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:30.684 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:30.684 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.684335939, 2024-04-19T04:26:30.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080099220999999998, 2024-04-19T04:26:30.684 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.684 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:30.684 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.684 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.684 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.684 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:30.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.684 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:30.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:30.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:30.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:30.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:30.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:30.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:30.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:30.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:30.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:30.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971978+0000", 2024-04-19T04:26:30.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.071282358000000004 2024-04-19T04:26:30.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:30.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.972180+0000", 2024-04-19T04:26:30.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020191100000000001 2024-04-19T04:26:30.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:30.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980701+0000", 2024-04-19T04:26:30.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085211760000000001 2024-04-19T04:26:30.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:30.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980729+0000", 2024-04-19T04:26:30.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8068e-05 2024-04-19T04:26:30.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980787+0000", 2024-04-19T04:26:30.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7521e-05 2024-04-19T04:26:30.688 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.688 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.688 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.688 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174350 5.e 5:7f36609a:::benchmark_data_smithi007_19526_object48616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:30.688 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:30.689 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.682564867, 2024-04-19T04:26:30.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079723622999999993, 2024-04-19T04:26:30.689 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:30.689 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:30.689 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:30.689 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:30.689 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.689 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174350 2024-04-19T04:26:30.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.689 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:30.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:30.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:30.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:30.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:30.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:30.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:30.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902458+0000", 2024-04-19T04:26:30.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:30.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:30.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902463+0000", 2024-04-19T04:26:30.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5889999999999996e-06 2024-04-19T04:26:30.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:30.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965576+0000", 2024-04-19T04:26:30.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063113328999999996 2024-04-19T04:26:30.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965614+0000", 2024-04-19T04:26:30.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8285999999999999e-05 2024-04-19T04:26:30.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:30.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974787+0000", 2024-04-19T04:26:30.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009172599 2024-04-19T04:26:30.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:30.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974999+0000", 2024-04-19T04:26:30.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021270999999999999 2024-04-19T04:26:30.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:30.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982086+0000", 2024-04-19T04:26:30.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070869160000000004 2024-04-19T04:26:30.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:30.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982115+0000", 2024-04-19T04:26:30.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8603999999999999e-05 2024-04-19T04:26:30.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:30.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:30.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:30.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982182+0000", 2024-04-19T04:26:30.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7350999999999999e-05 2024-04-19T04:26:30.693 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.693 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.693 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.693 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:30.693 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:30.693 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:30.694 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:30.692+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:30.695 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:30.795 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:30.792+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:235039 5.d 5:b126b018:::benchmark_data_smithi007_19526_object109305:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:30.815175+0000", 2024-04-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0074153170000000003, 2024-04-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0074361879999999998, 2024-04-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 235039 2024-04-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815175+0000", 2024-04-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815175+0000", 2024-04-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815174+0000", 2024-04-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815180+0000", 2024-04-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4559999999999999e-06 2024-04-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815189+0000", 2024-04-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.2269999999999999e-06 2024-04-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815196+0000", 2024-04-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4270000000000002e-06 2024-04-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815260+0000", 2024-04-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3242000000000002e-05 2024-04-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815450+0000", 2024-04-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019059099999999999 2024-04-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815610+0000", 2024-04-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015922000000000001 2024-04-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.820213+0000", 2024-04-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0046035970000000001 2024-04-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:235042 5.d 5:b8e68a33:::benchmark_data_smithi007_19526_object109308:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:30.815218+0000", 2024-04-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0073725559999999997, 2024-04-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0074532180000000002, 2024-04-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 235042 2024-04-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815218+0000", 2024-04-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815218+0000", 2024-04-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815218+0000", 2024-04-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815221+0000", 2024-04-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2109999999999998e-06 2024-04-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815228+0000", 2024-04-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4030000000000001e-06 2024-04-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815232+0000", 2024-04-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0539999999999996e-06 2024-04-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.817621+0000", 2024-04-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023884930000000002 2024-04-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.817710+0000", 2024-04-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.8813999999999994e-05 2024-04-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.817778+0000", 2024-04-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8110999999999999e-05 2024-04-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:235045 5.7 5:ed02a144:::benchmark_data_smithi007_19526_object109311:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:30.815388+0000", 2024-04-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0072028150000000004, 2024-04-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0073485540000000002, 2024-04-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 235045 2024-04-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815388+0000", 2024-04-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815388+0000", 2024-04-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815387+0000", 2024-04-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815391+0000", 2024-04-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9709999999999998e-06 2024-04-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815407+0000", 2024-04-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5654999999999998e-05 2024-04-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815417+0000", 2024-04-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0437e-05 2024-04-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815471+0000", 2024-04-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3412999999999998e-05 2024-04-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815607+0000", 2024-04-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013677700000000001 2024-04-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.822635+0000", 2024-04-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0070274439999999999 2024-04-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.822688+0000", 2024-04-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3173000000000001e-05 2024-04-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.822736+0000", 2024-04-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8466e-05 2024-04-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:235047 5.9 5:91c27a5e:::benchmark_data_smithi007_19526_object109313:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:30.815519+0000", 2024-04-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0070718059999999999, 2024-04-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0072733299999999997, 2024-04-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 235047 2024-04-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815519+0000", 2024-04-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815519+0000", 2024-04-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815518+0000", 2024-04-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815523+0000", 2024-04-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2259999999999996e-06 2024-04-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815539+0000", 2024-04-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5468000000000002e-05 2024-04-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815553+0000", 2024-04-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4588e-05 2024-04-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815600+0000", 2024-04-19T04:26:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6814000000000003e-05 2024-04-19T04:26:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815738+0000", 2024-04-19T04:26:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000137455 2024-04-19T04:26:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.815881+0000", 2024-04-19T04:26:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014330899999999999 2024-04-19T04:26:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.822677+0000", 2024-04-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067963420000000004 2024-04-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:235048 5.3 5:c2f6b54a:::benchmark_data_smithi007_19526_object109314:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:30.817549+0000", 2024-04-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0050420539999999998, 2024-04-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0052899380000000001, 2024-04-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 235048 2024-04-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.817549+0000", 2024-04-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.817549+0000", 2024-04-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.817547+0000", 2024-04-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.817553+0000", 2024-04-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9490000000000001e-06 2024-04-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.817566+0000", 2024-04-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2388000000000001e-05 2024-04-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.817574+0000", 2024-04-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4239999999999993e-06 2024-04-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.817635+0000", 2024-04-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0785999999999997e-05 2024-04-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.817769+0000", 2024-04-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013434699999999999 2024-04-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.822704+0000", 2024-04-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0049348889999999996 2024-04-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.822763+0000", 2024-04-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9023000000000001e-05 2024-04-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:235052 5.c 5:31832739:::benchmark_data_smithi007_19526_object109318:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:30.820042+0000", 2024-04-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0025490460000000001, 2024-04-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028455569999999999, 2024-04-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 235052 2024-04-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.820042+0000", 2024-04-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.820042+0000", 2024-04-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.820041+0000", 2024-04-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.820046+0000", 2024-04-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7140000000000001e-06 2024-04-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.820055+0000", 2024-04-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.6129999999999993e-06 2024-04-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.820060+0000", 2024-04-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.578e-06 2024-04-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.820127+0000", 2024-04-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.7133999999999998e-05 2024-04-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.820251+0000", 2024-04-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012436500000000001 2024-04-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:235053 5.2 5:4eeaa8de:::benchmark_data_smithi007_19526_object109319:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:30.820068+0000", 2024-04-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0025224750000000002, 2024-04-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002858513, 2024-04-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 235053 2024-04-19T04:26:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.820068+0000", 2024-04-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.820068+0000", 2024-04-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.820068+0000", 2024-04-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.820070+0000", 2024-04-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8640000000000001e-06 2024-04-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.820073+0000", 2024-04-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.32e-06 2024-04-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.820076+0000", 2024-04-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6359999999999998e-06 2024-04-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.820123+0000", 2024-04-19T04:26:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7568000000000003e-05 2024-04-19T04:26:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.820247+0000", 2024-04-19T04:26:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012380799999999999 2024-04-19T04:26:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:235054 5.d 5:b6c7c73e:::benchmark_data_smithi007_19526_object109320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T04:26:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:30.821093+0000", 2024-04-19T04:26:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0014982229999999999, 2024-04-19T04:26:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0018715839999999999, 2024-04-19T04:26:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 235054 2024-04-19T04:26:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.821093+0000", 2024-04-19T04:26:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.821093+0000", 2024-04-19T04:26:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.821092+0000", 2024-04-19T04:26:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:30.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.821095+0000", 2024-04-19T04:26:30.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7189999999999999e-06 2024-04-19T04:26:30.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:30.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.821104+0000", 2024-04-19T04:26:30.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1899999999999995e-06 2024-04-19T04:26:30.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.821108+0000", 2024-04-19T04:26:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.1690000000000002e-06 2024-04-19T04:26:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.821139+0000", 2024-04-19T04:26:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1016000000000003e-05 2024-04-19T04:26:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:30.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.821218+0000", 2024-04-19T04:26:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8943999999999995e-05 2024-04-19T04:26:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:30.821276+0000", 2024-04-19T04:26:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8171999999999998e-05 2024-04-19T04:26:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:30.861 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 8 2024-04-19T04:26:30.861 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:30.862 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:30.897 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:30.896+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:30.992 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:30.992 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:30.992 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:30.992 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:30.992 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:30.997 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:30.996+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:31.005 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:31.098 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:31.096+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:31.176 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:31.176 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:31.176 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:31.176 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:31.176 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.176 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:31.176 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:31.176 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 96.943542910999994, 2024-04-19T04:26:31.176 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:31.177 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.177 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.177 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.177 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.177 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.177 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:31.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.177 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.177 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.177 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.177 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:31.177 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.177 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.177 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:31.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:31.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.178 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:31.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:31.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:31.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:31.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:31.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:31.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:31.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:31.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.180 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.180 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.180 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:31.180 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:31.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.180 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.180 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:31.180 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:31.180 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:31.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.180 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.180 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:31.180 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:31.181 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:31.181 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.181 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.181 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:31.181 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:31.181 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:31.181 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.181 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.181 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:31.181 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:31.181 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:31.181 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.181 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.181 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.181 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:31.182 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:31.182 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.182 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.182 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.182 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.182 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.182 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:31.182 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:31.182 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 96.939447990000005, 2024-04-19T04:26:31.182 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:31.182 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.182 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.182 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.183 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.183 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.183 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:31.183 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.183 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.183 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.183 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.183 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:31.183 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.183 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.183 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.183 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.183 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:31.183 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:31.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:31.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:31.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:31.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:31.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:31.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:31.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:31.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:31.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:31.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:31.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.186 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:31.186 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:31.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:31.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.186 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:31.186 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:31.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:31.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.186 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:31.187 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:31.187 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:31.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.187 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:31.187 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:31.187 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:31.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.187 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.187 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:31.187 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:31.187 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.187 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.187 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.188 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.188 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:31.188 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:31.188 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 96.936156804999996, 2024-04-19T04:26:31.188 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:31.188 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.188 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.188 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.188 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.188 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.188 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:31.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.188 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.189 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.189 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.189 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:31.189 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.189 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.189 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.189 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:31.189 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.189 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.189 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.189 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:31.189 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.190 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.190 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:31.190 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:31.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.190 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.190 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:31.190 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:31.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.190 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.190 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:31.190 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:31.191 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.191 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.191 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.191 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:31.191 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:31.191 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.191 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.191 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.191 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:31.191 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:31.191 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.191 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.191 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:31.191 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:31.191 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:31.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.192 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.192 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:31.192 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:31.192 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:31.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.192 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.192 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:31.192 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:31.192 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:31.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.192 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.192 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:31.192 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:31.192 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:31.193 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.193 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.193 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.193 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:31.193 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:31.193 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.193 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.193 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.193 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.193 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.193 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:31.193 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:31.193 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 75.218767339999999, 2024-04-19T04:26:31.193 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:31.193 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.194 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:31.194 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.194 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.194 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.194 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:31.194 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.194 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.194 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.194 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.194 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:31.194 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.194 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.194 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.194 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.195 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:31.195 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.195 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.195 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.195 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.195 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:31.195 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:31.195 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.195 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.195 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.195 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:31.195 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:31.195 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.195 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.195 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.196 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:31.196 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:31.196 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.196 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.196 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.196 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:31.196 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:31.196 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.196 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.196 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.196 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:31.196 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:31.196 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.196 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.196 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.197 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:31.197 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:31.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.197 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.197 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:31.197 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:31.197 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:31.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.197 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.197 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:31.197 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:31.197 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:31.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.197 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.197 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 75.198536891000003, 2024-04-19T04:26:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.201 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.201 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.201 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.201 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:31.201 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:31.201 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.201 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.201 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.201 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:31.201 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:31.201 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.201 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.201 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.201 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:31.201 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:31.202 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.202 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.202 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.202 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:31.202 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:31.202 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.202 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.202 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.202 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:31.202 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:31.202 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.202 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.202 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:31.202 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:31.203 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:31.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.203 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.203 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.203 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:31.203 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:31.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.203 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.203 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.203 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:31.203 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:31.203 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.203 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.203 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.204 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.204 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:31.204 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:31.204 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 75.198429034, 2024-04-19T04:26:31.204 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:31.204 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.204 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:31.204 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.204 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.204 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.204 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:31.204 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.204 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.204 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.204 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.205 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:31.205 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.205 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.205 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.205 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.205 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:31.205 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.205 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.205 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.205 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.205 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:31.205 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:31.205 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.205 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.205 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.206 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:31.206 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:31.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.206 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.206 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.206 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:31.206 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:31.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.206 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.206 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.206 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:31.206 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:31.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.206 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.206 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.207 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:31.207 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:31.207 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.207 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.207 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:31.207 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:31.207 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:31.207 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.207 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.207 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.207 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:31.207 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:31.207 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.207 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.207 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.208 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:31.208 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:31.208 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.208 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.208 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.208 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.208 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.208 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:31.208 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:31.208 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 75.196462345, 2024-04-19T04:26:31.208 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:31.208 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.208 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.208 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.208 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.209 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.209 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:31.209 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.209 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.209 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.209 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.209 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:31.209 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.209 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.209 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.209 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.209 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:31.209 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.209 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.209 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.210 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.210 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:31.210 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:31.210 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.210 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.210 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.210 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:31.210 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:31.210 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.210 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.210 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.210 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:31.210 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:31.210 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.211 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.211 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.211 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:31.211 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:31.211 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.211 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.211 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.211 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:31.211 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:31.211 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.211 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.213 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:31.213 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:31.213 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:31.213 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.213 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.213 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:31.213 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:31.213 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:31.213 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.213 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.213 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.213 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:31.213 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:31.213 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.214 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.214 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.214 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.214 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.214 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:31.214 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:31.214 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 75.193098149999997, 2024-04-19T04:26:31.214 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:31.214 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.214 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.214 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.214 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.214 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.214 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:31.214 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.215 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.215 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.215 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.215 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:31.215 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.215 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.215 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.215 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.215 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:31.215 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.215 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.215 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.215 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.215 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:31.215 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.216 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.216 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.216 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.216 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:31.216 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:31.216 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.216 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.216 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.216 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:31.216 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:31.216 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.216 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.216 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.216 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:31.216 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:31.217 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.217 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.217 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.217 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:31.217 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:31.217 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.217 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.217 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:31.217 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:31.217 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:31.217 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.217 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.217 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.217 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:31.218 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:31.218 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.218 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.218 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.218 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:31.218 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:31.218 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.218 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.218 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:31.218 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:31.218 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:31.218 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.218 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.218 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:31.218 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:31.219 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:31.219 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.219 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.219 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.219 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:31.219 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:31.219 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.219 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.219 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.219 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.219 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.219 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:31.219 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:31.219 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 75.189287171999993, 2024-04-19T04:26:31.219 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:31.220 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.220 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.220 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.220 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.220 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.220 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:31.220 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.220 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.220 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.220 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.220 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:31.220 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.220 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.220 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.220 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.221 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:31.221 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.221 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.221 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.221 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.221 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:31.221 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.221 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.221 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.221 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.221 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:31.221 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:31.221 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.221 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.221 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.222 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:31.222 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:31.222 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.222 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.222 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.222 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:31.222 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:31.222 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.222 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.222 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.222 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:31.222 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:31.222 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.222 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.222 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:31.223 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:31.223 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:31.223 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.223 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.223 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.223 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:31.223 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:31.223 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.223 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.223 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.223 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:31.223 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:31.223 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.223 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.223 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:31.224 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:31.224 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:31.224 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.224 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.224 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:31.224 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:31.224 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:31.224 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.224 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.224 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.224 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:31.224 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:31.224 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.224 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.224 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.225 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.225 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.225 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:31.225 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:31.225 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.947424814999998, 2024-04-19T04:26:31.225 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:31.225 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.225 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.225 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.225 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.225 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.225 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:31.225 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.225 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.225 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.226 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.226 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:31.226 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.226 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.226 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.226 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.226 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:31.226 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.226 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.226 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.226 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.226 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:31.226 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:31.226 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.226 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.227 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.227 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:31.227 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:31.227 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.227 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.227 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.227 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:31.227 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:31.227 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.227 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.227 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.227 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:31.227 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:31.227 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.227 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.228 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.228 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:31.228 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:31.228 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.228 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.228 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.228 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:31.228 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:31.228 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.228 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.228 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:31.228 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:31.228 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:31.228 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.228 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.229 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:31.229 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:31.229 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:31.229 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.229 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.229 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.229 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:31.229 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:31.229 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.229 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.229 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.229 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.229 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.229 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:31.229 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:31.230 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 61.946830534999997, 2024-04-19T04:26:31.230 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:31.230 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.230 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.230 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.230 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.230 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.230 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:31.230 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.230 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.230 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.230 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.230 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:31.230 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.230 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.231 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.231 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.231 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:31.231 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.231 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.231 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.231 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.231 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:31.231 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.231 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.231 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.231 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.231 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:31.231 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:31.231 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.232 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.232 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.232 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:31.232 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:31.232 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.232 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.232 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.232 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:31.232 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:31.232 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.232 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.232 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.232 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:31.232 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:31.232 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.233 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.233 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.233 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:31.233 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:31.233 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.233 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.233 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:31.233 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:31.233 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:31.233 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.233 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.233 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:31.233 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:31.233 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:31.233 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.234 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.234 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:31.234 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:31.234 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:31.234 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.234 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.234 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:31.234 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:31.234 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:31.234 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.234 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.234 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.234 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:31.234 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:31.235 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.235 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.235 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.235 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.235 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.235 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:31.235 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:31.235 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.222183377, 2024-04-19T04:26:31.235 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:31.235 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.235 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.235 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.235 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.235 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.235 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:31.235 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.236 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.236 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.236 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.236 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:31.236 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.236 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.236 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.236 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.236 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:31.236 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.236 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.236 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.236 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.236 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:31.236 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:31.237 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.237 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.237 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.237 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:31.237 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:31.237 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.237 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.237 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.237 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:31.237 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:31.237 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.237 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.237 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.237 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:31.237 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:31.238 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.238 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.238 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.238 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:31.238 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:31.238 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.238 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.238 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.238 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:31.238 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:31.238 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.238 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.238 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:31.238 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:31.238 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:31.239 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.239 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.239 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:31.239 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:31.239 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:31.239 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.239 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.239 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:31.239 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:31.239 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:31.239 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.239 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.239 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:31.239 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:31.239 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:31.240 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.240 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.240 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.240 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:31.240 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:31.240 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.240 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.240 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.240 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.240 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.240 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:31.240 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:31.240 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.222142960999999, 2024-04-19T04:26:31.240 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:31.240 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.241 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.241 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.241 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.241 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.241 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:31.241 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.241 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.241 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.241 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.241 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:31.241 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.241 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.241 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.241 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.241 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:31.242 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.242 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.242 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.242 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.242 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:31.242 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:31.242 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.242 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.242 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.242 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:31.242 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:31.242 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.243 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.243 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.243 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:31.243 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:31.243 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.243 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.243 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.243 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:31.243 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:31.243 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.243 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.243 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.243 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:31.243 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:31.244 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.244 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.244 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.244 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:31.244 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:31.244 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.244 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.244 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:31.244 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:31.244 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:31.244 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.244 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.244 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:31.244 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:31.244 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:31.245 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.245 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.245 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:31.245 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:31.245 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:31.245 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.245 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.245 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:31.245 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:31.245 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:31.245 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.245 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.245 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.245 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:31.245 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:31.246 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.246 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.246 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.246 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.246 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.246 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:31.246 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:31.246 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.218446652000001, 2024-04-19T04:26:31.246 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:31.246 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.246 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.246 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.246 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.247 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.247 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:31.247 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.247 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.247 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.247 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.247 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:31.247 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.247 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.247 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.247 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.247 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:31.247 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.247 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.247 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.248 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.248 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:31.248 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.248 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.248 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.248 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.248 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:31.248 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:31.248 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.248 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.248 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.248 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:31.248 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:31.248 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.249 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.249 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.249 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:31.249 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:31.249 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.249 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.249 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.249 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:31.249 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:31.249 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.249 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.249 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.249 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:31.249 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:31.249 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.250 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.250 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:31.250 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:31.250 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:31.250 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.250 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.250 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:31.250 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:31.250 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:31.250 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.250 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.250 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:31.250 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:31.250 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:31.251 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.251 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.251 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:31.251 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:31.251 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:31.251 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.251 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.251 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.251 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:31.251 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:31.251 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.251 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.251 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.251 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.251 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.252 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:31.252 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:31.252 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.964836177999999, 2024-04-19T04:26:31.252 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:31.252 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.252 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.252 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.252 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.252 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.252 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:31.252 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.252 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.252 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.252 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.252 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:31.253 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.253 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.253 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.253 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.253 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:31.253 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.253 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.253 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.253 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.253 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:31.253 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:31.253 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.253 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.253 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.253 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:31.253 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:31.254 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.254 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.254 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.254 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:31.254 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:31.254 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.254 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.254 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.254 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:31.254 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:31.254 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.254 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.254 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.255 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:31.255 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:31.255 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.255 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.255 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.255 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:31.255 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:31.255 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.255 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.255 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:31.255 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:31.255 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:31.255 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.255 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.255 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:31.256 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:31.256 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:31.256 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.256 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.256 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.256 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:31.256 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:31.256 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.256 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.256 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.256 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.256 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.256 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:31.256 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:31.256 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.962542765999999, 2024-04-19T04:26:31.257 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:31.257 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.257 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.257 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.257 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.257 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.257 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:31.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.257 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.257 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.257 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.257 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:31.257 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.258 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.258 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.258 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:31.258 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.258 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.258 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.258 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.258 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:31.258 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.258 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.258 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.258 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.258 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:31.258 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:31.259 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.259 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.259 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.259 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:31.259 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:31.259 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.259 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.259 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.259 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:31.259 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:31.259 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.259 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.259 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.259 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:31.259 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:31.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.260 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.260 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.260 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:31.260 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:31.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.260 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.260 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:31.260 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:31.260 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:31.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.260 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.260 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:31.260 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:31.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:31.261 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.261 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.261 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.261 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:31.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:31.261 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.261 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.261 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.261 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.261 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.261 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:31.261 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:31.261 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.962496949999998, 2024-04-19T04:26:31.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:31.262 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.262 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.262 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.262 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.262 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.262 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:31.262 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.262 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.262 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.262 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.262 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:31.262 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.262 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.262 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.263 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.263 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:31.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.263 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.263 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.263 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:31.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:31.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.263 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.263 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.263 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:31.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:31.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.263 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.263 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.264 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:31.264 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:31.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.264 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.264 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:31.264 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:31.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.264 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.264 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:31.264 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:31.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.264 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:31.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:31.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:31.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:31.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:31.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:31.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:31.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:31.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:31.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:31.266 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.266 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.266 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.266 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174342 5.9 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:31.266 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:31.266 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.277340250000002, 2024-04-19T04:26:31.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068615152999999998, 2024-04-19T04:26:31.266 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.267 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.267 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.267 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.267 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.267 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174342 2024-04-19T04:26:31.267 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.267 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.267 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.267 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.267 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:31.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.267 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.267 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.267 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.268 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:31.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.268 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.268 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897726+0000", 2024-04-19T04:26:31.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.268 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.268 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897731+0000", 2024-04-19T04:26:31.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1449999999999999e-06 2024-04-19T04:26:31.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.268 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.269 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897744+0000", 2024-04-19T04:26:31.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2833000000000001e-05 2024-04-19T04:26:31.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.269 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.269 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897749+0000", 2024-04-19T04:26:31.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1540000000000001e-06 2024-04-19T04:26:31.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.269 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.269 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897810+0000", 2024-04-19T04:26:31.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0724999999999999e-05 2024-04-19T04:26:31.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897920+0000", 2024-04-19T04:26:31.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011024 2024-04-19T04:26:31.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:31.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897993+0000", 2024-04-19T04:26:31.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2335000000000005e-05 2024-04-19T04:26:31.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:31.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.899597+0000", 2024-04-19T04:26:31.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016048919999999999 2024-04-19T04:26:31.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:31.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966230+0000", 2024-04-19T04:26:31.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.066632882000000004 2024-04-19T04:26:31.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:31.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966296+0000", 2024-04-19T04:26:31.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5361e-05 2024-04-19T04:26:31.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966342+0000", 2024-04-19T04:26:31.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6476e-05 2024-04-19T04:26:31.272 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.272 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.272 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.272 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.272 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174344 5.d 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:31.272 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:31.272 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.276661411999999, 2024-04-19T04:26:31.272 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068211329000000001, 2024-04-19T04:26:31.272 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.272 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.272 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.272 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.272 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.273 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174344 2024-04-19T04:26:31.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.273 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.273 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:31.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.273 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:31.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898405+0000", 2024-04-19T04:26:31.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:31.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.274 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898409+0000", 2024-04-19T04:26:31.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5149999999999998e-06 2024-04-19T04:26:31.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.274 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898415+0000", 2024-04-19T04:26:31.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:26:31.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898419+0000", 2024-04-19T04:26:31.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.89e-06 2024-04-19T04:26:31.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898459+0000", 2024-04-19T04:26:31.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0017e-05 2024-04-19T04:26:31.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898540+0000", 2024-04-19T04:26:31.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1237999999999997e-05 2024-04-19T04:26:31.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:31.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:31.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6060000000000001e-05 2024-04-19T04:26:31.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:31.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.901321+0000", 2024-04-19T04:26:31.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027152109999999999 2024-04-19T04:26:31.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:31.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966512+0000", 2024-04-19T04:26:31.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.065190440000000002 2024-04-19T04:26:31.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:31.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966563+0000", 2024-04-19T04:26:31.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1436e-05 2024-04-19T04:26:31.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966617+0000", 2024-04-19T04:26:31.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.401e-05 2024-04-19T04:26:31.277 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.277 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.277 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.277 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174346 5.f 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:31.278 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:31.278 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 26.274875184999999, 2024-04-19T04:26:31.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.067185536000000004, 2024-04-19T04:26:31.278 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.278 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.278 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.278 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.278 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.278 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174346 2024-04-19T04:26:31.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.278 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:31.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.279 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.279 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:31.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.279 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.279 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900191+0000", 2024-04-19T04:26:31.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.279 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.279 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900196+0000", 2024-04-19T04:26:31.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3329999999999998e-06 2024-04-19T04:26:31.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900206+0000", 2024-04-19T04:26:31.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9699999999999994e-06 2024-04-19T04:26:31.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900210+0000", 2024-04-19T04:26:31.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3359999999999997e-06 2024-04-19T04:26:31.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900243+0000", 2024-04-19T04:26:31.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2669999999999997e-05 2024-04-19T04:26:31.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900365+0000", 2024-04-19T04:26:31.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122648 2024-04-19T04:26:31.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:31.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900559+0000", 2024-04-19T04:26:31.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019358799999999999 2024-04-19T04:26:31.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:31.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.903018+0000", 2024-04-19T04:26:31.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024592300000000002 2024-04-19T04:26:31.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:31.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967180+0000", 2024-04-19T04:26:31.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.064161587000000006 2024-04-19T04:26:31.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:31.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967293+0000", 2024-04-19T04:26:31.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112921 2024-04-19T04:26:31.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:31.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967378+0000", 2024-04-19T04:26:31.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5000999999999995e-05 2024-04-19T04:26:31.283 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.283 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.283 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.283 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.283 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.283 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:31.284 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:31.285 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:31.284+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:31.349 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-04-19T04:26:31.385 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:31.384+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:31.409 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:31.409 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:31.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.410 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:236440 5.e 5:72fc718e:::benchmark_data_smithi007_19526_object110706:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T04:26:31.410 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:31.408761+0000", 2024-04-19T04:26:31.410 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001854933, 2024-04-19T04:26:31.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0018773489999999999, 2024-04-19T04:26:31.410 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.410 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:31.410 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.410 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.410 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.410 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 236440 2024-04-19T04:26:31.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.410 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:31.408761+0000", 2024-04-19T04:26:31.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:31.408761+0000", 2024-04-19T04:26:31.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:31.408760+0000", 2024-04-19T04:26:31.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:31.408765+0000", 2024-04-19T04:26:31.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9309999999999999e-06 2024-04-19T04:26:31.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:31.408775+0000", 2024-04-19T04:26:31.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7860000000000008e-06 2024-04-19T04:26:31.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:31.408783+0000", 2024-04-19T04:26:31.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1899999999999995e-06 2024-04-19T04:26:31.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:31.408823+0000", 2024-04-19T04:26:31.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9954999999999999e-05 2024-04-19T04:26:31.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:31.408927+0000", 2024-04-19T04:26:31.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010407399999999999 2024-04-19T04:26:31.414 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.414 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.414 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.414 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:236429 5.d e64/29 5:bc5612e9:::benchmark_data_smithi007_19526_object110695:head v 64'14375, mlcod=64'14372)", 2024-04-19T04:26:31.414 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:31.409447+0000", 2024-04-19T04:26:31.414 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0011691189999999999, 2024-04-19T04:26:31.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012590920000000001, 2024-04-19T04:26:31.414 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.414 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:31.414 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:31.409447+0000", 2024-04-19T04:26:31.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:31.409447+0000", 2024-04-19T04:26:31.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:31.409446+0000", 2024-04-19T04:26:31.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:31.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:31.409453+0000", 2024-04-19T04:26:31.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1960000000000002e-06 2024-04-19T04:26:31.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:31.409471+0000", 2024-04-19T04:26:31.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7646999999999999e-05 2024-04-19T04:26:31.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:31.409479+0000", 2024-04-19T04:26:31.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1759999999999993e-06 2024-04-19T04:26:31.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:31.409535+0000", 2024-04-19T04:26:31.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5804999999999998e-05 2024-04-19T04:26:31.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:31.409549+0000", 2024-04-19T04:26:31.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4603000000000001e-05 2024-04-19T04:26:31.418 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.418 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.418 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.418 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.418 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:26:31.418 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 2 2024-04-19T04:26:31.418 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:31.422 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:31.486 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:31.484+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:31.539 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:31.539 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:31.550 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:31.587 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:31.584+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:31.689 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:31.684+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:31.715 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:31.715 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:31.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:31.715 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 75.762896142000002, 2024-04-19T04:26:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:31.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:31.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:31.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:31.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:31.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:31.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:31.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:31.722 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.722 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.722 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.722 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:31.722 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 75.757834496000001, 2024-04-19T04:26:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 75.757734584000005, 2024-04-19T04:26:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:31.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:31.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:31.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:31.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 75.757608830999999, 2024-04-19T04:26:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:31.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:31.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:31.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:31.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:31.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:31.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 75.753764885999999, 2024-04-19T04:26:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 75.746593785000002, 2024-04-19T04:26:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 75.746421681000001, 2024-04-19T04:26:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 75.746358556000004, 2024-04-19T04:26:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 75.746229959000004, 2024-04-19T04:26:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 75.746161987999997, 2024-04-19T04:26:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.826622322999999, 2024-04-19T04:26:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078453623, 2024-04-19T04:26:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965893+0000", 2024-04-19T04:26:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.076646455000000002 2024-04-19T04:26:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965956+0000", 2024-04-19T04:26:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3200000000000005e-05 2024-04-19T04:26:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966068+0000", 2024-04-19T04:26:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011194800000000001 2024-04-19T04:26:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.826591325999999, 2024-04-19T04:26:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083782388999999999, 2024-04-19T04:26:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971179+0000", 2024-04-19T04:26:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079349476000000002 2024-04-19T04:26:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971259+0000", 2024-04-19T04:26:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9083000000000002e-05 2024-04-19T04:26:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971428+0000", 2024-04-19T04:26:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169419 2024-04-19T04:26:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.824269806, 2024-04-19T04:26:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081686998999999996, 2024-04-19T04:26:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971454+0000", 2024-04-19T04:26:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077525997999999999 2024-04-19T04:26:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971540+0000", 2024-04-19T04:26:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6285000000000005e-05 2024-04-19T04:26:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971654+0000", 2024-04-19T04:26:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114095 2024-04-19T04:26:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.823059424, 2024-04-19T04:26:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080734265999999999, 2024-04-19T04:26:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971677+0000", 2024-04-19T04:26:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.073192023999999994 2024-04-19T04:26:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971771+0000", 2024-04-19T04:26:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4235999999999997e-05 2024-04-19T04:26:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971912+0000", 2024-04-19T04:26:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014055099999999999 2024-04-19T04:26:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.822107933000002, 2024-04-19T04:26:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085645857000000006, 2024-04-19T04:26:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977634+0000", 2024-04-19T04:26:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077144335999999994 2024-04-19T04:26:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977699+0000", 2024-04-19T04:26:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4518999999999997e-05 2024-04-19T04:26:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977775+0000", 2024-04-19T04:26:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6219999999999999e-05 2024-04-19T04:26:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.819100355, 2024-04-19T04:26:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075403611999999995, 2024-04-19T04:26:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970369+0000", 2024-04-19T04:26:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.074967992999999997 2024-04-19T04:26:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970419+0000", 2024-04-19T04:26:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9700999999999997e-05 2024-04-19T04:26:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970540+0000", 2024-04-19T04:26:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121512 2024-04-19T04:26:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5:78f758ec:::benchmark_data_smithi007_19526_object48602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:31.805 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:31.805 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.818726230999999, 2024-04-19T04:26:31.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085171609999999995, 2024-04-19T04:26:31.805 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.805 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.805 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.805 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.805 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.805 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966154+0000", 2024-04-19T04:26:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.070613543000000001 2024-04-19T04:26:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966382+0000", 2024-04-19T04:26:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022741800000000001 2024-04-19T04:26:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980581+0000", 2024-04-19T04:26:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014199916999999999 2024-04-19T04:26:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980621+0000", 2024-04-19T04:26:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9685999999999999e-05 2024-04-19T04:26:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980682+0000", 2024-04-19T04:26:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1130000000000006e-05 2024-04-19T04:26:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.818636279, 2024-04-19T04:26:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075073230000000005, 2024-04-19T04:26:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970556+0000", 2024-04-19T04:26:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.072076192999999997 2024-04-19T04:26:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970608+0000", 2024-04-19T04:26:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2549000000000001e-05 2024-04-19T04:26:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970674+0000", 2024-04-19T04:26:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5549000000000005e-05 2024-04-19T04:26:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5:70a7bb5e:::benchmark_data_smithi007_19526_object48614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.813549282, 2024-04-19T04:26:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080099220999999998, 2024-04-19T04:26:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971978+0000", 2024-04-19T04:26:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.071282358000000004 2024-04-19T04:26:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.972180+0000", 2024-04-19T04:26:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020191100000000001 2024-04-19T04:26:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980701+0000", 2024-04-19T04:26:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085211760000000001 2024-04-19T04:26:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980729+0000", 2024-04-19T04:26:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8068e-05 2024-04-19T04:26:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980787+0000", 2024-04-19T04:26:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7521e-05 2024-04-19T04:26:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174350 5.e 5:7f36609a:::benchmark_data_smithi007_19526_object48616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.81177821, 2024-04-19T04:26:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079723622999999993, 2024-04-19T04:26:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174350 2024-04-19T04:26:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902458+0000", 2024-04-19T04:26:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902463+0000", 2024-04-19T04:26:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5889999999999996e-06 2024-04-19T04:26:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965576+0000", 2024-04-19T04:26:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063113328999999996 2024-04-19T04:26:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965614+0000", 2024-04-19T04:26:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8285999999999999e-05 2024-04-19T04:26:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974787+0000", 2024-04-19T04:26:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009172599 2024-04-19T04:26:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974999+0000", 2024-04-19T04:26:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021270999999999999 2024-04-19T04:26:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982086+0000", 2024-04-19T04:26:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070869160000000004 2024-04-19T04:26:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982115+0000", 2024-04-19T04:26:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8603999999999999e-05 2024-04-19T04:26:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982182+0000", 2024-04-19T04:26:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7350999999999999e-05 2024-04-19T04:26:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:31.825 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:31.826 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:31.824+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:31.827 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:31.927 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:31.924+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:31.958 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:31.958 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:31.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.958 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:237731 5.2 5:4dd5f471:::benchmark_data_smithi007_19526_object111997:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T04:26:31.958 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:31.957441+0000", 2024-04-19T04:26:31.958 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0016088910000000001, 2024-04-19T04:26:31.958 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016279280000000001, 2024-04-19T04:26:31.958 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.959 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:31.959 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.959 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.959 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.959 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 237731 2024-04-19T04:26:31.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.959 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.959 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.959 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.959 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.957441+0000", 2024-04-19T04:26:31.959 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.959 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.959 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.960 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.957441+0000", 2024-04-19T04:26:31.960 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.960 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.960 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.957440+0000", 2024-04-19T04:26:31.960 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.960 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.960 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.957445+0000", 2024-04-19T04:26:31.960 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.677e-06 2024-04-19T04:26:31.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.960 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.957461+0000", 2024-04-19T04:26:31.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5089000000000001e-05 2024-04-19T04:26:31.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.957468+0000", 2024-04-19T04:26:31.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6299999999999998e-06 2024-04-19T04:26:31.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.961 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.961 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.961 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.958460+0000", 2024-04-19T04:26:31.961 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00099141700000000008 2024-04-19T04:26:31.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.962 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.962 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.958607+0000", 2024-04-19T04:26:31.962 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00014771200000000001 2024-04-19T04:26:31.962 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.962 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.962 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.962 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:237715 5.c 5:357412b9:::benchmark_data_smithi007_19526_object111981:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T04:26:31.962 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:31.950053+0000", 2024-04-19T04:26:31.962 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.008996446, 2024-04-19T04:26:31.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0090653680000000007, 2024-04-19T04:26:31.963 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.963 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:31.963 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.963 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.963 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.963 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 237715 2024-04-19T04:26:31.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.963 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.963 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.963 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.963 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.950053+0000", 2024-04-19T04:26:31.963 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.950053+0000", 2024-04-19T04:26:31.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.950053+0000", 2024-04-19T04:26:31.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:31.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.964 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.964 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.964 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.950056+0000", 2024-04-19T04:26:31.964 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.495e-06 2024-04-19T04:26:31.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.965 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.965 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.950066+0000", 2024-04-19T04:26:31.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5570000000000001e-06 2024-04-19T04:26:31.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.965 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.965 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.950070+0000", 2024-04-19T04:26:31.965 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4329999999999997e-06 2024-04-19T04:26:31.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.965 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.965 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.966 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.954877+0000", 2024-04-19T04:26:31.966 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0048066239999999998 2024-04-19T04:26:31.966 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.966 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.966 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.955033+0000", 2024-04-19T04:26:31.966 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015654899999999999 2024-04-19T04:26:31.966 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.966 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.966 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.966 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.966 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.966 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:237726 5.2 5:44477e64:::benchmark_data_smithi007_19526_object111992:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T04:26:31.966 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:31.954717+0000", 2024-04-19T04:26:31.967 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0043328810000000002, 2024-04-19T04:26:31.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0044440340000000004, 2024-04-19T04:26:31.967 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.967 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:31.967 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.967 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.967 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.967 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 237726 2024-04-19T04:26:31.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.967 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.967 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.967 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.954717+0000", 2024-04-19T04:26:31.967 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.954717+0000", 2024-04-19T04:26:31.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.954715+0000", 2024-04-19T04:26:31.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:31.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.968 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.968 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.954722+0000", 2024-04-19T04:26:31.968 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.1739999999999997e-06 2024-04-19T04:26:31.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.954740+0000", 2024-04-19T04:26:31.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8119999999999999e-05 2024-04-19T04:26:31.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.954757+0000", 2024-04-19T04:26:31.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.7227999999999998e-05 2024-04-19T04:26:31.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.969 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.969 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.969 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.954801+0000", 2024-04-19T04:26:31.969 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4158e-05 2024-04-19T04:26:31.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.970 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.970 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.954902+0000", 2024-04-19T04:26:31.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010123 2024-04-19T04:26:31.970 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.970 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.970 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.970 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.970 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:237728 5.2 5:40bbe8a8:::benchmark_data_smithi007_19526_object111994:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T04:26:31.970 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:31.956593+0000", 2024-04-19T04:26:31.970 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.002456335, 2024-04-19T04:26:31.970 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026068770000000001, 2024-04-19T04:26:31.970 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.971 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:31.971 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.971 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.971 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.971 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 237728 2024-04-19T04:26:31.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.971 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.971 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.971 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.956593+0000", 2024-04-19T04:26:31.971 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.971 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.971 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.971 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.956593+0000", 2024-04-19T04:26:31.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.956592+0000", 2024-04-19T04:26:31.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:31.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.972 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.956597+0000", 2024-04-19T04:26:31.972 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0250000000000002e-06 2024-04-19T04:26:31.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.972 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.956605+0000", 2024-04-19T04:26:31.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8159999999999994e-06 2024-04-19T04:26:31.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.956616+0000", 2024-04-19T04:26:31.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0474e-05 2024-04-19T04:26:31.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.973 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.973 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.956688+0000", 2024-04-19T04:26:31.973 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2150000000000005e-05 2024-04-19T04:26:31.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.973 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.974 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.974 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.956822+0000", 2024-04-19T04:26:31.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000134179 2024-04-19T04:26:31.974 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.974 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.974 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.974 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:237729 5.7 5:e94507a6:::benchmark_data_smithi007_19526_object111995:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T04:26:31.974 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:31.956623+0000", 2024-04-19T04:26:31.974 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0024262709999999998, 2024-04-19T04:26:31.974 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026173030000000001, 2024-04-19T04:26:31.974 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:31.975 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:31.975 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:31.975 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:31.975 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:31.975 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 237729 2024-04-19T04:26:31.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.975 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:31.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.975 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:31.975 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.956623+0000", 2024-04-19T04:26:31.975 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.975 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.975 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:31.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.956623+0000", 2024-04-19T04:26:31.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:31.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:31.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.956623+0000", 2024-04-19T04:26:31.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:31.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:31.976 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.956626+0000", 2024-04-19T04:26:31.976 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5220000000000002e-06 2024-04-19T04:26:31.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.976 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.976 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:31.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.956635+0000", 2024-04-19T04:26:31.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.9940000000000006e-06 2024-04-19T04:26:31.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:31.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.956638+0000", 2024-04-19T04:26:31.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.3060000000000002e-06 2024-04-19T04:26:31.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:31.977 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.956666+0000", 2024-04-19T04:26:31.977 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.817e-05 2024-04-19T04:26:31.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:31.977 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:31.977 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:31.978 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:31.956749+0000", 2024-04-19T04:26:31.978 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3258999999999997e-05 2024-04-19T04:26:31.978 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.978 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:31.978 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.978 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:31.978 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:31.978 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 5 2024-04-19T04:26:31.978 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:31.979 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:32.030 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:32.028+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:32.108 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:32.109 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:32.109 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:32.109 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:32.109 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:32.122 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:32.164 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:32.164+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:32.230 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:32.228+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:32.298 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:32.298 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:32.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:32.298 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:32.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.298 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:32.298 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:32.298 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 98.064821072000001, 2024-04-19T04:26:32.298 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:32.298 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.298 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:32.299 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.299 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.299 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.299 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:32.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.299 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.299 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.299 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:32.299 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.299 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.299 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:32.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:32.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:32.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:32.300 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:32.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.300 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.300 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:32.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:32.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:32.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:32.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:32.301 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:32.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.301 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:32.301 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:32.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:32.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:32.302 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:32.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:32.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:32.302 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:32.302 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:32.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.302 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:32.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:32.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:32.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:32.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:32.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:32.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.303 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.303 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:32.303 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:32.303 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.303 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.303 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.304 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.304 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:32.304 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:32.304 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 98.060726150999997, 2024-04-19T04:26:32.304 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:32.304 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.304 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:32.304 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.304 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.304 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.304 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:32.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.304 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.304 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:32.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:32.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.305 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.305 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:32.305 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:32.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:32.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:32.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:32.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:32.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.306 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.306 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.306 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:32.306 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:32.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:32.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:32.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:32.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:32.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:32.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.307 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.307 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:32.307 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:32.307 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:32.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:32.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:32.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:32.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:32.308 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:32.308 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:32.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.308 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:32.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:32.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:32.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.309 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.309 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:32.309 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:32.309 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.309 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.309 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.309 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.310 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:32.310 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:32.310 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 98.057434966000002, 2024-04-19T04:26:32.310 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:32.310 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.310 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:32.310 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.310 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.310 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.310 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:32.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.310 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.310 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.310 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.310 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:32.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:32.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.311 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:32.311 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:32.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.311 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.311 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:32.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:32.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:32.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:32.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.312 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:32.312 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:32.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.312 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.312 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:32.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:32.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:32.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:32.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:32.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.313 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.313 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:32.313 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:32.313 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:32.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.314 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:32.314 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:32.314 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:32.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.314 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:32.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:32.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:32.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:32.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:32.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:32.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.315 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.315 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:32.315 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:32.315 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.316 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.316 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.316 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.316 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:32.316 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:32.316 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 76.340045501000006, 2024-04-19T04:26:32.316 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:32.316 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.316 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:32.316 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.316 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.316 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.316 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:32.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.317 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.317 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.317 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:32.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.317 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.317 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:32.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.317 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.317 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.317 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:32.317 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:32.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:32.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:32.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:32.318 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:32.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.318 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.318 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.318 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:32.319 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:32.319 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.319 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.319 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.319 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:32.319 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:32.319 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.319 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.319 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:32.319 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:32.319 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:32.319 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.319 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.319 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:32.319 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:32.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:32.320 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.320 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.320 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:32.320 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:32.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:32.320 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.320 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.320 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.320 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:32.320 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:32.320 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.320 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.320 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:32.320 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:32.321 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:32.321 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.321 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.321 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.321 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:32.321 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:32.321 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.321 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.321 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.321 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:32.321 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:32.321 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.321 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.321 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.322 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.322 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:32.322 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:32.322 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 76.319815051999996, 2024-04-19T04:26:32.322 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:32.322 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.322 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:32.322 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.322 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.322 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.322 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:32.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.322 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.323 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.323 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.323 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:32.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.323 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.323 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.323 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:32.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.323 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.323 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.323 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:32.323 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:32.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.324 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.324 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.324 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:32.324 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:32.324 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.324 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.324 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.324 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:32.324 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:32.324 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.324 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.324 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.324 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:32.324 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:32.324 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.324 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.325 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.325 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:32.325 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:32.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.325 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:32.325 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:32.325 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:32.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.325 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.325 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:32.325 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:32.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.326 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.326 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.326 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:32.326 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:32.326 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.326 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.326 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.326 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.326 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.326 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:32.326 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:32.326 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 76.319707195000007, 2024-04-19T04:26:32.326 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:32.326 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.327 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:32.327 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.327 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.327 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.327 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:32.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.327 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.327 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.327 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:32.327 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.327 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.327 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:32.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:32.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:32.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:32.328 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:32.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.328 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.328 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.328 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:32.329 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:32.329 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.329 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.329 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:32.329 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:32.329 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.329 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.329 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:32.329 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:32.329 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.329 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:32.329 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:32.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:32.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.330 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:32.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:32.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.330 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.330 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:32.330 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:32.330 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.330 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.330 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.331 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:32.331 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:32.331 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 76.317740506000007, 2024-04-19T04:26:32.331 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:32.331 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.331 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:32.331 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.331 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.331 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.331 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:32.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.331 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.332 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.332 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:32.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.332 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.332 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:32.332 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.333 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:32.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:32.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.333 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:32.333 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:32.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.333 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.333 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:32.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:32.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:32.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:32.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.334 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:32.334 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:32.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.334 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.334 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:32.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:32.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:32.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.335 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:32.335 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:32.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.335 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:32.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:32.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:32.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:32.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:32.336 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:32.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.336 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:32.336 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:32.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:32.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.337 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.337 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:32.337 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:32.337 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.337 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.337 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.337 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:32.338 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:32.338 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 76.314376311000004, 2024-04-19T04:26:32.338 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:32.338 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.338 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:32.338 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.338 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.338 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.338 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:32.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.338 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:32.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:32.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.339 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.339 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:32.339 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:32.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:32.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:32.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:32.340 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:32.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.340 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.340 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:32.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:32.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.341 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.341 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:32.341 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:32.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.342 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:32.342 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:32.342 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:32.342 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.342 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.342 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.342 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:32.342 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:32.342 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.342 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.343 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:32.343 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:32.343 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:32.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.343 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:32.343 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:32.343 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:32.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.343 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:32.343 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:32.343 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:32.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.344 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.344 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:32.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:32.344 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.344 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.344 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.344 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.344 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:32.344 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:32.344 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 76.310565333, 2024-04-19T04:26:32.344 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:32.345 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.345 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:32.345 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.345 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.345 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.345 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:32.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.346 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.346 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.346 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:32.346 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.346 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.346 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:32.346 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.346 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:32.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:32.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:32.347 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:32.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.347 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.347 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.347 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:32.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:32.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.348 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.348 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.348 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:32.348 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:32.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.349 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.349 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:32.349 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:32.349 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.349 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:32.349 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:32.349 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:32.349 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.349 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.350 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.350 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:32.350 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:32.350 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.350 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.350 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:32.350 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:32.350 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:32.350 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.350 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.350 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:32.350 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:32.350 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:32.350 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.351 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.351 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:32.351 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:32.351 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:32.351 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.351 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.351 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.351 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:32.351 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:32.351 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.351 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.351 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.351 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.351 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.351 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:32.352 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:32.352 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 63.068702975999997, 2024-04-19T04:26:32.352 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:32.352 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.352 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:32.352 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.352 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.352 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.352 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:32.352 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.352 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.352 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.352 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.352 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:32.352 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.353 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.353 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:32.353 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.353 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.353 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:32.353 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:32.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.353 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.353 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:32.353 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:32.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.354 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.354 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:32.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:32.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.354 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.354 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:32.354 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:32.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.354 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.354 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.354 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:32.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:32.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:32.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:32.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:32.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:32.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:32.355 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:32.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.355 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.355 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:32.355 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:32.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:32.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.356 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.356 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:32.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:32.356 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.356 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.356 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.356 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.356 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:32.356 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:32.356 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 63.068108696000003, 2024-04-19T04:26:32.356 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:32.357 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.357 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:32.357 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.357 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.357 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.357 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:32.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.357 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.357 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:32.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.358 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:32.358 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.358 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.358 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.359 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:32.359 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:32.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.359 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.359 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.359 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:32.359 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:32.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.359 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.359 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.359 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:32.360 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:32.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.360 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:32.360 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:32.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.360 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:32.360 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:32.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.360 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.360 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:32.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:32.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:32.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:32.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:32.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:32.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:32.361 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:32.361 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:32.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.361 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.361 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:32.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:32.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:32.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.362 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:32.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:32.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:32.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.362 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.362 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:32.362 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:32.362 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.362 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.363 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.363 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.363 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.363 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:32.363 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:32.363 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.343461538, 2024-04-19T04:26:32.363 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:32.363 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.363 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:32.363 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.363 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.364 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.364 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:32.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.364 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.364 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.364 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.364 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:32.364 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.364 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.364 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:32.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:32.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:32.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.365 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:32.365 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:32.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.365 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.365 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:32.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:32.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:32.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:32.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.366 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.366 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:32.366 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:32.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.366 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:32.367 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:32.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:32.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:32.367 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:32.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:32.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.367 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:32.367 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:32.367 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:32.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.367 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:32.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:32.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:32.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:32.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:32.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:32.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.368 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.368 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.368 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:32.368 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:32.368 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.368 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.369 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.369 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.369 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:32.369 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:32.369 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.343421121999999, 2024-04-19T04:26:32.369 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:32.369 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.369 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:32.369 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.369 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.369 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.369 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:32.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.370 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:32.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:32.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.370 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.370 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.370 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:32.370 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:32.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:32.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:32.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:32.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:32.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.371 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.371 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.371 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:32.371 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:32.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:32.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:32.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:32.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:32.372 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:32.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.372 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.372 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:32.372 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:32.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:32.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:32.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:32.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:32.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:32.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:32.373 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:32.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.373 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.373 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:32.373 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:32.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:32.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.374 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.374 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:32.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:32.374 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.374 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.374 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.374 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.374 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:32.374 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:32.374 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.339724813, 2024-04-19T04:26:32.374 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:32.375 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.375 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:32.375 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.375 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.375 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.375 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:32.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.375 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.375 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.375 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:32.375 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.375 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.376 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.376 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:32.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.376 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.376 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.376 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:32.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:32.376 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.376 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.376 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:32.376 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:32.376 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.376 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:32.377 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:32.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:32.377 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:32.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.377 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.377 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:32.377 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:32.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.377 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.378 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:32.378 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:32.378 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:32.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.378 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:32.378 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:32.378 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:32.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.378 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:32.378 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:32.378 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:32.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.379 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:32.379 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:32.379 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:32.379 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.379 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.379 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:32.379 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:32.379 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:32.379 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.379 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.379 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.379 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:32.379 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:32.379 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.379 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.380 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.380 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.380 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:32.380 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:32.380 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.086114339000002, 2024-04-19T04:26:32.380 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:32.380 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.380 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:32.380 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.380 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.380 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.380 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:32.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.380 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.381 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:32.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.381 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:32.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.381 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.381 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:32.381 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:32.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.382 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.382 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:32.382 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:32.382 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.382 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.382 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.382 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:32.382 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:32.382 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.382 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.382 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.382 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:32.382 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:32.382 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:32.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:32.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:32.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:32.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:32.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.383 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:32.383 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:32.383 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:32.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.384 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.384 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:32.384 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:32.384 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:32.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.384 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.384 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.384 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:32.384 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:32.384 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.384 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.384 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.384 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.385 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:32.385 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:32.385 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.083820927000001, 2024-04-19T04:26:32.385 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:32.385 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.385 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:32.385 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.385 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.385 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.385 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:32.385 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.385 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.385 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.385 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.385 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:32.386 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.386 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.386 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.386 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.386 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:32.386 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.386 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.386 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.386 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.386 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:32.386 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:32.386 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.386 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.386 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.387 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:32.387 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:32.387 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.387 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.387 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:32.387 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:32.387 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.387 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.387 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:32.387 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:32.387 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.387 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:32.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:32.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:32.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:32.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:32.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:32.388 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:32.388 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:32.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.388 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:32.389 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:32.389 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:32.389 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.389 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.389 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.389 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:32.389 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:32.389 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.389 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.389 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.389 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.389 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.389 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:32.389 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:32.389 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 28.083775111000001, 2024-04-19T04:26:32.390 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:32.390 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.390 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:32.390 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.390 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.390 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.390 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:32.390 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.390 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.390 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.390 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.390 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:32.390 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.390 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.391 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.391 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.391 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:32.391 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.391 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.391 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.391 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.391 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:32.391 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:32.391 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.391 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.391 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.391 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:32.391 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:32.391 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.392 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.392 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.392 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:32.392 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:32.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.392 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.392 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.392 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:32.392 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:32.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.392 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.392 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.392 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:32.392 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:32.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.393 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.393 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:32.393 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:32.393 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:32.393 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.393 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.393 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:32.393 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:32.393 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:32.393 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.393 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.393 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:32.393 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:32.393 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:32.393 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.394 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.394 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.394 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:32.394 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:32.394 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.394 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.394 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.394 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.394 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.394 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174342 5.9 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:32.394 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:32.394 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.398618411000001, 2024-04-19T04:26:32.394 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068615152999999998, 2024-04-19T04:26:32.394 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.394 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:32.395 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.395 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.395 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.395 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174342 2024-04-19T04:26:32.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.395 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.395 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.395 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.395 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:32.395 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.395 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.395 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.395 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:32.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.396 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897726+0000", 2024-04-19T04:26:32.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:32.396 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897731+0000", 2024-04-19T04:26:32.396 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1449999999999999e-06 2024-04-19T04:26:32.396 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.396 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.396 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.396 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897744+0000", 2024-04-19T04:26:32.397 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2833000000000001e-05 2024-04-19T04:26:32.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.397 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.397 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897749+0000", 2024-04-19T04:26:32.397 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1540000000000001e-06 2024-04-19T04:26:32.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.397 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.397 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897810+0000", 2024-04-19T04:26:32.397 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0724999999999999e-05 2024-04-19T04:26:32.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.397 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:32.398 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897920+0000", 2024-04-19T04:26:32.398 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011024 2024-04-19T04:26:32.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.398 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.398 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:32.398 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897993+0000", 2024-04-19T04:26:32.398 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2335000000000005e-05 2024-04-19T04:26:32.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.398 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.398 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:32.398 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.899597+0000", 2024-04-19T04:26:32.398 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016048919999999999 2024-04-19T04:26:32.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.398 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.398 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:32.399 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966230+0000", 2024-04-19T04:26:32.399 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.066632882000000004 2024-04-19T04:26:32.399 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.399 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.399 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:32.399 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966296+0000", 2024-04-19T04:26:32.399 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5361e-05 2024-04-19T04:26:32.399 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.399 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.399 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.399 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966342+0000", 2024-04-19T04:26:32.399 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6476e-05 2024-04-19T04:26:32.399 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.399 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.400 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.400 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.400 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.400 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174344 5.d 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:32.400 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:32.400 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.397939572999999, 2024-04-19T04:26:32.400 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068211329000000001, 2024-04-19T04:26:32.400 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.400 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:32.400 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.400 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.400 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.400 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174344 2024-04-19T04:26:32.400 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.400 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898405+0000", 2024-04-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898409+0000", 2024-04-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5149999999999998e-06 2024-04-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898415+0000", 2024-04-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898419+0000", 2024-04-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.89e-06 2024-04-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898459+0000", 2024-04-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0017e-05 2024-04-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898540+0000", 2024-04-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1237999999999997e-05 2024-04-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6060000000000001e-05 2024-04-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.901321+0000", 2024-04-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027152109999999999 2024-04-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966512+0000", 2024-04-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.065190440000000002 2024-04-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966563+0000", 2024-04-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1436e-05 2024-04-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966617+0000", 2024-04-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.401e-05 2024-04-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174346 5.f 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 27.396153345999998, 2024-04-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.067185536000000004, 2024-04-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174346 2024-04-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900191+0000", 2024-04-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900196+0000", 2024-04-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3329999999999998e-06 2024-04-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900206+0000", 2024-04-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9699999999999994e-06 2024-04-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900210+0000", 2024-04-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3359999999999997e-06 2024-04-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900243+0000", 2024-04-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2669999999999997e-05 2024-04-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900365+0000", 2024-04-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122648 2024-04-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900559+0000", 2024-04-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019358799999999999 2024-04-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.903018+0000", 2024-04-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024592300000000002 2024-04-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967180+0000", 2024-04-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.064161587000000006 2024-04-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967293+0000", 2024-04-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112921 2024-04-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967378+0000", 2024-04-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5000999999999995e-05 2024-04-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.411 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:32.411 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:32.411 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:32.412 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:32.413 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:32.412+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:32.497 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:26:32.512 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:32.508+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:32.538 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:32.538 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:32.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.539 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:239061 5.8 5:112f5a46:::benchmark_data_smithi007_19526_object113327:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T04:26:32.539 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:32.530322+0000", 2024-04-19T04:26:32.539 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0078910720000000007, 2024-04-19T04:26:32.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079189710000000003, 2024-04-19T04:26:32.539 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:32.539 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:32.539 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:32.539 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:32.539 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.539 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 239061 2024-04-19T04:26:32.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.539 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:32.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:32.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.530322+0000", 2024-04-19T04:26:32.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:32.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.530322+0000", 2024-04-19T04:26:32.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:32.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.530321+0000", 2024-04-19T04:26:32.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:32.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:32.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.530325+0000", 2024-04-19T04:26:32.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.014e-06 2024-04-19T04:26:32.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:32.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.530334+0000", 2024-04-19T04:26:32.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1700000000000003e-06 2024-04-19T04:26:32.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.530342+0000", 2024-04-19T04:26:32.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6599999999999995e-06 2024-04-19T04:26:32.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:32.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.530398+0000", 2024-04-19T04:26:32.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5584999999999997e-05 2024-04-19T04:26:32.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:32.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.530557+0000", 2024-04-19T04:26:32.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015959000000000001 2024-04-19T04:26:32.542 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.542 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:32.542 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.543 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:239062 5.f e64/20 5:f496ac31:::benchmark_data_smithi007_19526_object113328:head v 64'14678, mlcod=64'14676)", 2024-04-19T04:26:32.543 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:32.532869+0000", 2024-04-19T04:26:32.543 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0053437249999999997, 2024-04-19T04:26:32.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054532670000000004, 2024-04-19T04:26:32.543 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:32.543 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:32.543 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:32.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:32.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.532869+0000", 2024-04-19T04:26:32.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:32.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.532869+0000", 2024-04-19T04:26:32.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:32.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.532869+0000", 2024-04-19T04:26:32.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:32.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:32.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.532877+0000", 2024-04-19T04:26:32.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9740000000000002e-06 2024-04-19T04:26:32.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:32.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.532885+0000", 2024-04-19T04:26:32.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7949999999999996e-06 2024-04-19T04:26:32.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.532890+0000", 2024-04-19T04:26:32.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.498e-06 2024-04-19T04:26:32.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:32.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.532927+0000", 2024-04-19T04:26:32.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7518999999999998e-05 2024-04-19T04:26:32.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:32.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.532949+0000", 2024-04-19T04:26:32.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1624000000000002e-05 2024-04-19T04:26:32.546 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.546 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:32.546 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.546 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:239065 5.b 5:d965d828:::benchmark_data_smithi007_19526_object113331:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T04:26:32.547 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:32.533450+0000", 2024-04-19T04:26:32.547 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.004762769, 2024-04-19T04:26:32.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004939779, 2024-04-19T04:26:32.547 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:32.547 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:32.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:32.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:32.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.547 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 239065 2024-04-19T04:26:32.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.547 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:32.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:32.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.533450+0000", 2024-04-19T04:26:32.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:32.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.533450+0000", 2024-04-19T04:26:32.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:32.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.533449+0000", 2024-04-19T04:26:32.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:32.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:32.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.533456+0000", 2024-04-19T04:26:32.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5980000000000002e-06 2024-04-19T04:26:32.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:32.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.533472+0000", 2024-04-19T04:26:32.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6450999999999999e-05 2024-04-19T04:26:32.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.533481+0000", 2024-04-19T04:26:32.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9390000000000003e-06 2024-04-19T04:26:32.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:32.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.533536+0000", 2024-04-19T04:26:32.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5197e-05 2024-04-19T04:26:32.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:32.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.533638+0000", 2024-04-19T04:26:32.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101931 2024-04-19T04:26:32.550 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.550 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:32.550 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.550 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:239068 5.b 5:d709eb93:::benchmark_data_smithi007_19526_object113334:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T04:26:32.550 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:32.533511+0000", 2024-04-19T04:26:32.550 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0047022699999999997, 2024-04-19T04:26:32.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049522180000000004, 2024-04-19T04:26:32.551 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:32.551 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:32.551 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:32.551 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:32.551 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.551 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 239068 2024-04-19T04:26:32.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.551 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:32.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:32.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.533511+0000", 2024-04-19T04:26:32.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:32.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.533511+0000", 2024-04-19T04:26:32.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:32.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.533510+0000", 2024-04-19T04:26:32.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:32.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:32.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.533514+0000", 2024-04-19T04:26:32.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9129999999999996e-06 2024-04-19T04:26:32.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:32.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.533523+0000", 2024-04-19T04:26:32.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3740000000000004e-06 2024-04-19T04:26:32.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.533530+0000", 2024-04-19T04:26:32.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4010000000000002e-06 2024-04-19T04:26:32.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:32.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535883+0000", 2024-04-19T04:26:32.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023533809999999999 2024-04-19T04:26:32.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:32.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.536020+0000", 2024-04-19T04:26:32.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000136942 2024-04-19T04:26:32.554 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.554 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:32.554 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.554 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:239069 5.a 5:5338217c:::benchmark_data_smithi007_19526_object113335:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T04:26:32.554 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:32.534661+0000", 2024-04-19T04:26:32.554 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0035522240000000001, 2024-04-19T04:26:32.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038789110000000001, 2024-04-19T04:26:32.554 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:32.554 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:32.554 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:32.554 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:32.555 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.555 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 239069 2024-04-19T04:26:32.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.555 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:32.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:32.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.534661+0000", 2024-04-19T04:26:32.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:32.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.534661+0000", 2024-04-19T04:26:32.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:32.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.534660+0000", 2024-04-19T04:26:32.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:32.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:32.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.534665+0000", 2024-04-19T04:26:32.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-19T04:26:32.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:32.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.534676+0000", 2024-04-19T04:26:32.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1289e-05 2024-04-19T04:26:32.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.534684+0000", 2024-04-19T04:26:32.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5959999999999998e-06 2024-04-19T04:26:32.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:32.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.534726+0000", 2024-04-19T04:26:32.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2273e-05 2024-04-19T04:26:32.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:32.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.534821+0000", 2024-04-19T04:26:32.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4339999999999995e-05 2024-04-19T04:26:32.557 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.557 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:32.558 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.558 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:239070 5.8 5:12271048:::benchmark_data_smithi007_19526_object113336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T04:26:32.558 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:32.534702+0000", 2024-04-19T04:26:32.558 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0035105850000000001, 2024-04-19T04:26:32.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039154130000000004, 2024-04-19T04:26:32.558 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:32.558 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:32.558 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:32.558 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:32.558 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.558 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 239070 2024-04-19T04:26:32.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.558 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:32.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:32.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.534702+0000", 2024-04-19T04:26:32.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:32.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.534702+0000", 2024-04-19T04:26:32.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:32.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.534702+0000", 2024-04-19T04:26:32.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:32.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:32.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.534705+0000", 2024-04-19T04:26:32.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4800000000000001e-06 2024-04-19T04:26:32.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:32.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.534713+0000", 2024-04-19T04:26:32.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9419999999999995e-06 2024-04-19T04:26:32.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.534720+0000", 2024-04-19T04:26:32.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4150000000000004e-06 2024-04-19T04:26:32.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:32.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.534770+0000", 2024-04-19T04:26:32.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0383000000000002e-05 2024-04-19T04:26:32.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:32.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.534911+0000", 2024-04-19T04:26:32.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014099699999999999 2024-04-19T04:26:32.561 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.561 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:32.561 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.561 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:239071 5.4 5:253f4282:::benchmark_data_smithi007_19526_object113337:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T04:26:32.562 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:32.535560+0000", 2024-04-19T04:26:32.562 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0026531739999999999, 2024-04-19T04:26:32.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031305090000000001, 2024-04-19T04:26:32.562 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:32.562 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:32.562 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:32.562 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:32.562 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.562 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 239071 2024-04-19T04:26:32.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.562 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:32.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:32.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535560+0000", 2024-04-19T04:26:32.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:32.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535560+0000", 2024-04-19T04:26:32.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:32.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535559+0000", 2024-04-19T04:26:32.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:32.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:32.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535564+0000", 2024-04-19T04:26:32.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9450000000000001e-06 2024-04-19T04:26:32.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:32.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535575+0000", 2024-04-19T04:26:32.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1212e-05 2024-04-19T04:26:32.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535580+0000", 2024-04-19T04:26:32.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8060000000000002e-06 2024-04-19T04:26:32.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:32.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535627+0000", 2024-04-19T04:26:32.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6736000000000001e-05 2024-04-19T04:26:32.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:32.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535756+0000", 2024-04-19T04:26:32.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012895300000000001 2024-04-19T04:26:32.565 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.565 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:32.565 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.565 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:239072 5.e 5:74af4148:::benchmark_data_smithi007_19526_object113338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T04:26:32.565 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:32.535609+0000", 2024-04-19T04:26:32.565 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0026043310000000001, 2024-04-19T04:26:32.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031571730000000001, 2024-04-19T04:26:32.566 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:32.566 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:32.566 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:32.566 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:32.566 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.566 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 239072 2024-04-19T04:26:32.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.566 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:32.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:32.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535609+0000", 2024-04-19T04:26:32.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:32.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535609+0000", 2024-04-19T04:26:32.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:32.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535608+0000", 2024-04-19T04:26:32.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:32.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:32.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535612+0000", 2024-04-19T04:26:32.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2470000000000002e-06 2024-04-19T04:26:32.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:32.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535618+0000", 2024-04-19T04:26:32.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0240000000000003e-06 2024-04-19T04:26:32.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535625+0000", 2024-04-19T04:26:32.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6470000000000001e-06 2024-04-19T04:26:32.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:32.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535677+0000", 2024-04-19T04:26:32.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2553000000000003e-05 2024-04-19T04:26:32.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:32.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535819+0000", 2024-04-19T04:26:32.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014204899999999999 2024-04-19T04:26:32.569 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.569 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:32.569 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.569 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:239073 5.b 5:de76ac05:::benchmark_data_smithi007_19526_object113339:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T04:26:32.569 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:32.535770+0000", 2024-04-19T04:26:32.569 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0024424389999999998, 2024-04-19T04:26:32.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030672619999999999, 2024-04-19T04:26:32.569 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:32.569 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:32.570 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:32.570 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:32.570 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.570 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 239073 2024-04-19T04:26:32.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.570 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:32.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:32.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535770+0000", 2024-04-19T04:26:32.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:32.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535770+0000", 2024-04-19T04:26:32.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:32.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535769+0000", 2024-04-19T04:26:32.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:32.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:32.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535775+0000", 2024-04-19T04:26:32.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2000000000000002e-06 2024-04-19T04:26:32.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:32.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535784+0000", 2024-04-19T04:26:32.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9429999999999995e-06 2024-04-19T04:26:32.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.535793+0000", 2024-04-19T04:26:32.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1110000000000008e-06 2024-04-19T04:26:32.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:32.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.538498+0000", 2024-04-19T04:26:32.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027058960000000002 2024-04-19T04:26:32.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:32.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.538618+0000", 2024-04-19T04:26:32.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119778 2024-04-19T04:26:32.573 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.573 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:32.573 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.573 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:239074 5.0 5:01ae5e05:::benchmark_data_smithi007_19526_object113340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T04:26:32.573 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:32.536438+0000", 2024-04-19T04:26:32.573 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0017750109999999999, 2024-04-19T04:26:32.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024721220000000002, 2024-04-19T04:26:32.573 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:32.573 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:32.573 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:32.573 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:32.573 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:32.573 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 239074 2024-04-19T04:26:32.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.574 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:32.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:32.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.536438+0000", 2024-04-19T04:26:32.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:32.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.536438+0000", 2024-04-19T04:26:32.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:32.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.536437+0000", 2024-04-19T04:26:32.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:32.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:32.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.536443+0000", 2024-04-19T04:26:32.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8349999999999998e-06 2024-04-19T04:26:32.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:32.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.536458+0000", 2024-04-19T04:26:32.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4569999999999999e-05 2024-04-19T04:26:32.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.536467+0000", 2024-04-19T04:26:32.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5550000000000003e-06 2024-04-19T04:26:32.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:32.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.536818+0000", 2024-04-19T04:26:32.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00035188400000000001 2024-04-19T04:26:32.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:32.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.537021+0000", 2024-04-19T04:26:32.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020303500000000001 2024-04-19T04:26:32.577 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.577 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:32.577 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.577 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:239075 5.d e64/29 5:b09ec9bd:::benchmark_data_smithi007_19526_object113341:head v 64'14531, mlcod=64'14529)", 2024-04-19T04:26:32.577 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:32.537710+0000", 2024-04-19T04:26:32.577 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00050262199999999999, 2024-04-19T04:26:32.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012707529999999999, 2024-04-19T04:26:32.578 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:32.578 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:32.578 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:32.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:32.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.537710+0000", 2024-04-19T04:26:32.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:32.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.537710+0000", 2024-04-19T04:26:32.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:32.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:32.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.537709+0000", 2024-04-19T04:26:32.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:32.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:32.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.537722+0000", 2024-04-19T04:26:32.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2689e-05 2024-04-19T04:26:32.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:32.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.537738+0000", 2024-04-19T04:26:32.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6409000000000002e-05 2024-04-19T04:26:32.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:32.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.537746+0000", 2024-04-19T04:26:32.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8529999999999992e-06 2024-04-19T04:26:32.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:32.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.537790+0000", 2024-04-19T04:26:32.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3486999999999999e-05 2024-04-19T04:26:32.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:32.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:32.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:32.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:32.537808+0000", 2024-04-19T04:26:32.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8020999999999999e-05 2024-04-19T04:26:32.580 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.580 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:32.580 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.580 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:32.581 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:26:32.581 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 11 2024-04-19T04:26:32.581 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:32.582 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:32.613 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:32.612+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:32.653 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:32.676 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:32.676 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:32.676 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:32.676 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:32.680 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:32.681 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:32.706 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:32.706 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:32.715 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:32.715 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:32.712+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:32.815 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:32.812+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:32.840 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:32.840 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:32.851 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:32.917 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:32.912+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:32.984 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:32.984 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:32.996 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:33.017 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:33.016+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:33.118 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:33.116+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:33.125 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:33.126 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:33.139 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:33.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~76s 2024-04-19T04:26:33.219 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:33.216+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:33.307 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:33.308 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:33.320 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:33.316+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:33.321 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:33.363 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T04:26:33.421 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:33.420+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:33.448 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:33.448 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:33.459 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:33.522 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:33.520+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:33.582 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:33.583 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:33.595 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:33.623 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:33.620+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:33.726 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:33.726 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:33.727 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:33.724+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:33.736 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:33.828 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:33.824+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:33.872 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:33.872 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:33.885 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:33.929 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:33.928+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:34.014 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:34.015 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:34.025 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:34.030 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:34.028+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:34.130 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:34.128+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:34.149 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:34.149 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:34.161 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:34.232 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:34.228+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:34.286 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:34.287 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:34.299 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:34.333 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:34.328+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:34.363 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2024-04-19T04:26:34.418 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:34.418 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:34.431 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:34.434 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:34.432+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:34.534 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:34.532+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:34.551 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:34.551 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:34.563 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:34.635 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:34.632+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:34.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:26:34.690 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:34.690 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:34.703 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:34.736 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:34.732+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:34.830 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:34.830 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:34.836 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:34.836+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:34.839 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:34.843 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:34.861 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:34.861 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:34.862 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:34.862 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:34.865 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:34.866 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:34.938 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:34.936+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:35.022 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:35.023 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:35.023 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:35.023 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:35.023 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.023 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:35.023 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:35.023 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 100.790234924, 2024-04-19T04:26:35.023 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:35.023 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.023 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.023 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.024 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.024 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.024 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:35.024 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.024 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.024 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.024 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.024 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:35.024 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:35.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:35.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.026 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.026 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.026 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:35.026 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:35.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.026 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.026 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.026 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:35.026 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:35.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.027 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.027 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.027 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:35.027 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:35.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.027 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.027 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.027 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:35.027 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:35.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.027 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.027 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.027 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:35.027 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:35.028 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.028 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.028 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:35.028 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:35.028 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:35.028 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.028 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.028 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.028 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:35.028 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:35.028 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.028 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.028 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:35.029 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:35.029 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:35.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.029 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.029 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:35.029 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:35.029 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:35.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.029 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.029 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.029 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:35.029 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:35.029 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.030 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.030 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.030 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.030 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.030 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:35.030 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:35.030 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 100.786140003, 2024-04-19T04:26:35.030 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:35.030 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.030 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.030 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.030 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.031 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.031 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:35.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.031 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.031 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.031 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.031 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:35.031 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.031 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.032 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.032 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:35.032 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.032 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.032 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.032 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.032 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:35.032 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.032 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.032 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.032 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.032 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:35.033 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:35.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.033 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.033 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.033 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:35.033 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:35.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.033 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.033 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.033 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:35.033 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:35.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.033 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.033 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.033 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:35.034 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:35.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.034 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.034 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.034 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:35.034 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:35.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.034 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.034 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:35.034 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:35.034 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:35.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.034 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.035 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:35.035 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:35.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:35.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.035 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.035 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.035 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:35.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:35.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.035 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.035 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:35.035 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:35.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:35.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.035 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.036 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.036 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:35.036 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:35.036 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.036 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.036 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.036 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.036 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:35.036 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:35.036 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 100.78284881800001, 2024-04-19T04:26:35.036 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:35.036 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.036 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.036 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.037 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.037 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.037 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:35.037 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.037 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.037 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.037 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.037 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:35.037 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.037 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.037 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.037 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.037 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:35.037 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.038 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.038 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.038 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:35.038 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.038 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.038 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.038 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:35.038 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:35.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.038 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.038 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.039 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:35.039 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:35.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.039 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.039 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.039 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:35.039 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:35.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.039 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.039 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.039 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:35.039 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:35.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.039 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.039 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.040 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:35.040 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:35.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.040 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.040 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:35.040 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:35.040 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:35.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.040 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.040 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:35.040 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:35.040 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:35.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.040 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.041 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.041 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:35.041 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:35.041 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.041 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:35.041 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:35.041 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:35.041 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.041 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.041 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:35.041 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:35.041 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.041 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.042 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.042 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.042 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.042 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:35.042 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:35.042 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 79.065459352999994, 2024-04-19T04:26:35.042 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:35.042 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.042 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:35.042 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.042 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.042 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.042 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:35.042 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.043 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.043 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.043 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.043 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:35.043 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.043 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.043 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.043 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:35.043 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.043 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.043 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.043 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:35.044 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.044 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.044 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.044 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:35.044 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:35.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.044 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.044 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.044 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:35.044 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:35.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.044 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.044 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.045 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:35.045 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:35.045 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.045 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.045 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.045 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:35.045 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:35.045 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.045 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.045 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.045 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:35.045 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:35.045 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.045 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.045 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:35.045 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:35.046 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:35.046 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.046 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.046 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.046 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:35.046 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:35.046 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.046 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.046 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.046 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:35.046 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:35.046 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.046 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.046 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:35.047 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:35.047 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:35.047 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.047 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.047 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.047 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:35.047 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:35.047 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.047 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.047 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.047 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:35.047 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:35.047 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.047 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.047 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.048 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.048 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.048 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:35.048 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:35.048 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 79.045228903999998, 2024-04-19T04:26:35.048 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:35.048 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.048 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:35.048 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.048 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.048 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.048 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:35.048 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.048 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.048 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.048 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.049 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:35.049 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.049 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.049 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.049 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.049 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:35.049 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.049 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.049 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.049 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.049 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:35.049 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:35.049 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.049 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.050 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.050 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:35.050 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:35.050 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.050 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.050 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.050 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:35.050 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:35.050 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.050 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.050 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.050 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:35.050 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:35.050 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.050 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.051 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.051 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:35.051 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:35.051 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.051 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.051 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:35.051 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:35.051 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:35.051 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.051 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.051 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.051 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:35.051 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:35.051 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.051 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.052 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.052 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:35.052 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:35.052 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.052 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.052 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.052 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.052 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.052 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:35.052 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:35.052 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 79.045121046999995, 2024-04-19T04:26:35.052 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:35.052 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.053 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:35.053 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.053 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.053 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.053 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:35.053 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.053 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.053 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.053 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.053 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:35.053 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.053 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.053 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.053 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:35.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.054 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.054 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:35.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.054 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.054 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.054 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:35.054 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:35.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.055 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.055 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:35.055 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:35.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.055 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.055 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:35.055 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:35.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.055 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.055 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.055 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:35.055 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:35.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.056 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:35.056 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:35.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:35.056 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.056 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.056 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:35.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:35.056 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.056 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.056 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:35.056 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:35.057 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.057 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.057 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.057 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.057 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:35.057 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:35.057 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 79.043154357999995, 2024-04-19T04:26:35.057 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:35.057 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.057 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.057 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.057 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.057 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.057 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:35.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.058 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.058 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.058 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:35.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.058 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.058 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:35.058 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.058 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.058 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.059 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:35.059 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:35.059 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.059 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.059 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.059 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:35.059 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:35.059 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.059 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.059 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.059 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:35.059 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:35.059 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.060 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.060 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.060 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:35.060 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:35.060 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.060 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.060 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.060 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:35.060 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:35.060 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.060 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.060 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:35.060 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:35.060 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:35.060 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.061 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:35.061 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:35.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.061 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:35.061 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:35.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.061 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.061 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.061 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:35.061 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:35.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:35.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:35.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:35.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.062 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.062 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:35.062 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:35.062 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.062 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.062 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.062 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.062 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:35.063 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:35.063 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 79.039790163000006, 2024-04-19T04:26:35.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:35.063 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.063 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.063 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.063 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.063 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.063 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:35.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.063 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.063 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.063 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:35.063 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.064 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.064 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.064 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.064 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:35.064 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.064 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.064 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.064 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.064 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:35.064 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.064 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.064 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.064 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.064 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:35.065 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:35.065 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.065 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.065 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.065 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:35.065 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:35.065 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.065 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.065 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.065 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:35.065 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:35.065 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.065 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.066 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.066 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:35.066 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:35.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.066 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:35.066 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:35.066 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:35.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.066 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.066 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.066 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:35.066 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:35.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:35.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:35.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:35.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:35.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.067 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.067 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:35.067 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:35.067 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:35.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.068 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.068 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:35.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:35.068 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.068 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.068 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.068 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.068 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:35.068 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:35.068 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 79.035979185000002, 2024-04-19T04:26:35.068 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:35.068 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.068 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.069 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.069 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.069 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.069 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:35.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.069 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:35.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.069 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.069 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.069 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:35.069 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.070 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.070 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:35.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.070 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.070 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:35.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:35.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.070 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.070 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:35.070 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:35.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:35.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:35.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:35.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:35.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.071 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.071 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:35.071 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:35.071 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:35.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:35.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:35.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:35.072 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:35.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.072 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.072 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.072 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:35.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:35.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:35.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:35.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:35.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.073 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.073 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:35.073 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:35.073 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.073 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.073 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.074 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.074 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:35.074 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:35.074 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 65.794116828, 2024-04-19T04:26:35.074 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:35.074 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.074 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.074 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.074 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.074 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.074 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:35.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.074 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:35.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:35.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.075 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.075 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:35.075 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.076 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.076 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:35.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:35.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.076 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.076 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:35.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:35.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.076 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.076 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:35.076 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:35.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.076 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:35.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:35.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:35.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:35.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.077 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.077 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.077 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:35.077 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:35.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:35.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:35.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:35.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.078 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.078 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:35.078 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:35.078 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.078 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.078 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.078 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.079 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:35.079 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:35.079 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 65.793522547999999, 2024-04-19T04:26:35.079 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:35.079 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.079 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.079 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.079 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.079 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.079 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:35.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.079 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.079 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.079 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:35.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:35.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.080 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.080 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:35.080 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.081 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.081 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:35.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:35.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.081 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.081 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.081 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:35.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:35.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.081 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.081 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.081 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:35.081 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:35.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.082 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.082 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.082 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:35.082 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:35.082 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.082 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.082 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.082 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:35.082 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:35.082 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.082 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.082 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:35.082 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:35.083 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:35.084 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.068875389999999, 2024-04-19T04:26:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.086 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.086 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:35.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.086 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.086 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:35.086 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.086 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.086 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:35.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:35.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.087 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:35.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:35.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.087 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:35.087 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:35.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.087 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.087 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.087 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:35.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:35.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:35.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:35.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:35.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:35.088 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:35.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.088 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.088 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:35.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:35.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:35.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:35.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:35.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:35.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:35.089 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:35.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.089 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.089 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.089 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:35.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:35.090 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.090 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.090 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.090 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.090 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:35.090 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:35.090 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.068834974000001, 2024-04-19T04:26:35.090 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:35.090 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.090 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.090 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.090 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.091 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.091 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:35.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.091 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.091 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:35.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.091 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.091 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.091 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:35.091 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.092 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.092 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:35.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.092 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.092 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:35.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:35.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.092 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.092 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.092 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:35.092 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:35.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:35.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:35.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:35.093 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:35.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.093 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.093 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.093 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:35.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:35.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:35.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:35.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:35.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.094 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:35.094 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:35.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.094 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.094 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:35.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:35.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:35.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:35.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:35.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:35.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.095 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.095 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:35.095 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:35.095 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.095 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.095 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.096 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:35.096 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:35.096 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.065138664999999, 2024-04-19T04:26:35.096 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:35.096 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.096 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.096 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.096 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.096 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.096 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:35.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.096 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.096 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:35.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:35.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.097 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.097 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.097 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:35.097 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:35.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:35.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:35.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:35.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.098 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.098 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:35.098 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:35.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:35.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:35.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.099 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.099 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:35.099 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:35.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:35.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:35.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:35.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:35.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:35.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.100 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.100 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:35.100 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:35.100 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:35.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:35.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:35.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:35.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.101 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.101 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:35.101 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:35.101 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.101 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.101 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.102 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:35.102 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:35.102 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.811528191000001, 2024-04-19T04:26:35.102 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:35.102 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.102 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.102 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.102 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.102 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.102 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:35.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.102 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.102 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.102 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:35.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:35.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:35.103 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.103 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.103 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.103 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:35.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:35.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:35.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:35.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.104 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.104 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:35.104 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:35.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:35.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:35.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:35.105 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:35.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.105 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.105 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:35.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:35.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:35.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:35.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:35.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.106 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.106 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.106 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:35.106 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:35.106 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.106 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.106 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.107 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:35.107 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:35.107 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.809234779000001, 2024-04-19T04:26:35.107 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:35.107 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.107 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.107 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.107 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.107 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.107 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:35.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.107 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:35.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:35.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.108 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.108 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:35.108 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:35.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:35.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:35.109 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:35.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.109 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.109 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:35.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:35.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:35.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:35.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.110 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:35.110 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:35.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.110 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:35.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:35.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:35.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:35.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:35.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.111 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.111 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:35.111 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:35.111 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.111 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.112 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.112 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:35.112 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:35.112 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.809188963, 2024-04-19T04:26:35.112 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:35.112 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.112 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.112 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.112 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.112 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.112 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:35.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.113 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.113 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.113 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:35.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.113 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.113 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:35.113 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.113 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.113 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.113 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:35.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:35.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:35.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.114 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:35.114 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:35.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.114 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:35.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:35.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:35.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:35.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.115 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:35.115 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:35.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.115 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:35.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:35.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.116 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:35.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:35.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:35.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.116 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.116 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:35.116 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:35.116 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.116 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.116 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.117 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.117 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174342 5.9 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:35.117 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:35.117 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.124032263, 2024-04-19T04:26:35.117 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068615152999999998, 2024-04-19T04:26:35.117 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.117 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.117 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.117 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.117 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.117 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174342 2024-04-19T04:26:35.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.118 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:35.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:35.118 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.118 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.118 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897726+0000", 2024-04-19T04:26:35.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897731+0000", 2024-04-19T04:26:35.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1449999999999999e-06 2024-04-19T04:26:35.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.119 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897744+0000", 2024-04-19T04:26:35.119 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2833000000000001e-05 2024-04-19T04:26:35.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.119 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.120 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897749+0000", 2024-04-19T04:26:35.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1540000000000001e-06 2024-04-19T04:26:35.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.120 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897810+0000", 2024-04-19T04:26:35.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0724999999999999e-05 2024-04-19T04:26:35.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.120 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897920+0000", 2024-04-19T04:26:35.120 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011024 2024-04-19T04:26:35.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.120 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.120 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:35.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897993+0000", 2024-04-19T04:26:35.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2335000000000005e-05 2024-04-19T04:26:35.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.899597+0000", 2024-04-19T04:26:35.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016048919999999999 2024-04-19T04:26:35.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:35.121 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966230+0000", 2024-04-19T04:26:35.121 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.066632882000000004 2024-04-19T04:26:35.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.121 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:35.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966296+0000", 2024-04-19T04:26:35.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5361e-05 2024-04-19T04:26:35.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.122 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.122 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966342+0000", 2024-04-19T04:26:35.122 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6476e-05 2024-04-19T04:26:35.122 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.122 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.122 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.122 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.122 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174344 5.d 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:35.123 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:35.123 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.123353425000001, 2024-04-19T04:26:35.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068211329000000001, 2024-04-19T04:26:35.123 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.123 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.123 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.123 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.123 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.123 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174344 2024-04-19T04:26:35.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.123 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.123 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.123 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:35.123 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:35.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898405+0000", 2024-04-19T04:26:35.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.124 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.124 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898409+0000", 2024-04-19T04:26:35.124 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5149999999999998e-06 2024-04-19T04:26:35.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.125 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.125 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898415+0000", 2024-04-19T04:26:35.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:26:35.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.125 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.125 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898419+0000", 2024-04-19T04:26:35.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.89e-06 2024-04-19T04:26:35.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.125 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.125 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898459+0000", 2024-04-19T04:26:35.125 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0017e-05 2024-04-19T04:26:35.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898540+0000", 2024-04-19T04:26:35.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1237999999999997e-05 2024-04-19T04:26:35.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:35.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:35.126 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6060000000000001e-05 2024-04-19T04:26:35.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.126 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.126 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.901321+0000", 2024-04-19T04:26:35.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027152109999999999 2024-04-19T04:26:35.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:35.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966512+0000", 2024-04-19T04:26:35.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.065190440000000002 2024-04-19T04:26:35.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:35.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966563+0000", 2024-04-19T04:26:35.127 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1436e-05 2024-04-19T04:26:35.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.127 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.127 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966617+0000", 2024-04-19T04:26:35.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.401e-05 2024-04-19T04:26:35.128 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.128 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.128 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.128 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.128 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174346 5.f 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:35.128 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:35.128 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 30.121567198000001, 2024-04-19T04:26:35.128 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.067185536000000004, 2024-04-19T04:26:35.128 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.128 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.128 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.128 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.128 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.128 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174346 2024-04-19T04:26:35.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.129 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.129 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:35.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.129 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:35.129 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.129 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.129 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900191+0000", 2024-04-19T04:26:35.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900196+0000", 2024-04-19T04:26:35.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3329999999999998e-06 2024-04-19T04:26:35.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.130 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.130 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900206+0000", 2024-04-19T04:26:35.130 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9699999999999994e-06 2024-04-19T04:26:35.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900210+0000", 2024-04-19T04:26:35.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3359999999999997e-06 2024-04-19T04:26:35.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.131 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900243+0000", 2024-04-19T04:26:35.131 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2669999999999997e-05 2024-04-19T04:26:35.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.131 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900365+0000", 2024-04-19T04:26:35.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122648 2024-04-19T04:26:35.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:35.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900559+0000", 2024-04-19T04:26:35.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019358799999999999 2024-04-19T04:26:35.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.903018+0000", 2024-04-19T04:26:35.132 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024592300000000002 2024-04-19T04:26:35.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.132 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:35.132 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967180+0000", 2024-04-19T04:26:35.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.064161587000000006 2024-04-19T04:26:35.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:35.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967293+0000", 2024-04-19T04:26:35.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112921 2024-04-19T04:26:35.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.133 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.133 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:35.133 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967378+0000", 2024-04-19T04:26:35.133 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5000999999999995e-05 2024-04-19T04:26:35.133 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.133 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.133 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.133 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.134 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.134 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:35.135 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:35.136 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:35.132+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:35.235 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:35.232+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:35.265 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:245318 5.8 5:1720db4d:::benchmark_data_smithi007_19526_object119584:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:35.260666+0000", 2024-04-19T04:26:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0049499670000000004, 2024-04-19T04:26:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049678600000000002, 2024-04-19T04:26:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 245318 2024-04-19T04:26:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.260666+0000", 2024-04-19T04:26:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.260666+0000", 2024-04-19T04:26:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.260665+0000", 2024-04-19T04:26:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.260668+0000", 2024-04-19T04:26:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1140000000000002e-06 2024-04-19T04:26:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.260674+0000", 2024-04-19T04:26:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4650000000000002e-06 2024-04-19T04:26:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.260677+0000", 2024-04-19T04:26:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.196e-06 2024-04-19T04:26:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.260706+0000", 2024-04-19T04:26:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9408e-05 2024-04-19T04:26:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.260788+0000", 2024-04-19T04:26:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1710000000000002e-05 2024-04-19T04:26:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:245316 5.9 e65/20 5:9c7c7df6:::benchmark_data_smithi007_19526_object119582:head v 65'15661, mlcod=65'15659)", 2024-04-19T04:26:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:35.261022+0000", 2024-04-19T04:26:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0045942930000000002, 2024-04-19T04:26:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046565460000000001, 2024-04-19T04:26:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.261022+0000", 2024-04-19T04:26:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.261022+0000", 2024-04-19T04:26:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.261021+0000", 2024-04-19T04:26:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.261028+0000", 2024-04-19T04:26:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.261040+0000", 2024-04-19T04:26:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2153999999999999e-05 2024-04-19T04:26:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.261047+0000", 2024-04-19T04:26:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1770000000000003e-06 2024-04-19T04:26:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.261081+0000", 2024-04-19T04:26:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4183999999999997e-05 2024-04-19T04:26:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.261095+0000", 2024-04-19T04:26:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.376e-05 2024-04-19T04:26:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:245321 5.d e65/29 5:b0f0d653:::benchmark_data_smithi007_19526_object119587:head v 65'14947, mlcod=65'14945)", 2024-04-19T04:26:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:35.261444+0000", 2024-04-19T04:26:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0041716100000000001, 2024-04-19T04:26:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0042686850000000004, 2024-04-19T04:26:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.261444+0000", 2024-04-19T04:26:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.261444+0000", 2024-04-19T04:26:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.261444+0000", 2024-04-19T04:26:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.261449+0000", 2024-04-19T04:26:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0799999999999996e-06 2024-04-19T04:26:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.261459+0000", 2024-04-19T04:26:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0264e-05 2024-04-19T04:26:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.261465+0000", 2024-04-19T04:26:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.66e-06 2024-04-19T04:26:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.261516+0000", 2024-04-19T04:26:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0967000000000002e-05 2024-04-19T04:26:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.261542+0000", 2024-04-19T04:26:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6163999999999999e-05 2024-04-19T04:26:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:245325 5.a 5:5503cae0:::benchmark_data_smithi007_19526_object119591:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:35.263669+0000", 2024-04-19T04:26:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0019471600000000001, 2024-04-19T04:26:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021075899999999999, 2024-04-19T04:26:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 245325 2024-04-19T04:26:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.263669+0000", 2024-04-19T04:26:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.263669+0000", 2024-04-19T04:26:35.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.263668+0000", 2024-04-19T04:26:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.263676+0000", 2024-04-19T04:26:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6260000000000001e-06 2024-04-19T04:26:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.263689+0000", 2024-04-19T04:26:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2961e-05 2024-04-19T04:26:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.263696+0000", 2024-04-19T04:26:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8669999999999996e-06 2024-04-19T04:26:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.263739+0000", 2024-04-19T04:26:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3217999999999999e-05 2024-04-19T04:26:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.263826+0000", 2024-04-19T04:26:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6861999999999996e-05 2024-04-19T04:26:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:245326 5.4 5:2af6a10c:::benchmark_data_smithi007_19526_object119592:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:35.263707+0000", 2024-04-19T04:26:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0019083220000000001, 2024-04-19T04:26:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021456019999999999, 2024-04-19T04:26:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 245326 2024-04-19T04:26:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.263707+0000", 2024-04-19T04:26:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.263707+0000", 2024-04-19T04:26:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.263707+0000", 2024-04-19T04:26:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.263710+0000", 2024-04-19T04:26:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5059999999999998e-06 2024-04-19T04:26:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.263714+0000", 2024-04-19T04:26:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7700000000000001e-06 2024-04-19T04:26:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.263718+0000", 2024-04-19T04:26:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.687e-06 2024-04-19T04:26:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.263754+0000", 2024-04-19T04:26:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6335999999999999e-05 2024-04-19T04:26:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.263831+0000", 2024-04-19T04:26:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6287999999999999e-05 2024-04-19T04:26:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:245322 5.f e65/20 5:fb2dc715:::benchmark_data_smithi007_19526_object119588:head v 65'15098, mlcod=65'15096)", 2024-04-19T04:26:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:35.264840+0000", 2024-04-19T04:26:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00077570899999999997, 2024-04-19T04:26:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010820249999999999, 2024-04-19T04:26:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.264840+0000", 2024-04-19T04:26:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.264840+0000", 2024-04-19T04:26:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.264839+0000", 2024-04-19T04:26:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.264846+0000", 2024-04-19T04:26:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.81e-06 2024-04-19T04:26:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.264859+0000", 2024-04-19T04:26:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2326e-05 2024-04-19T04:26:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.264865+0000", 2024-04-19T04:26:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.477e-06 2024-04-19T04:26:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.264919+0000", 2024-04-19T04:26:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4024000000000003e-05 2024-04-19T04:26:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.264942+0000", 2024-04-19T04:26:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2866000000000001e-05 2024-04-19T04:26:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4746.0:245323 5.f e65/20)", 2024-04-19T04:26:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:35.264995+0000", 2024-04-19T04:26:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00062102999999999995, 2024-04-19T04:26:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00098861700000000001, 2024-04-19T04:26:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.264995+0000", 2024-04-19T04:26:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.264995+0000", 2024-04-19T04:26:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.264994+0000", 2024-04-19T04:26:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.264999+0000", 2024-04-19T04:26:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1429999999999997e-06 2024-04-19T04:26:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.265007+0000", 2024-04-19T04:26:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8970000000000008e-06 2024-04-19T04:26:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:35.265013+0000", 2024-04-19T04:26:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.378e-06 2024-04-19T04:26:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:26:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 7 2024-04-19T04:26:35.292 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:35.293 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:35.336 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:35.336+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:35.417 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:35.417 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:35.418 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:35.431 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:35.438 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:35.432+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:35.538 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:35.536+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:35.560 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:35.560 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:35.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:35.561 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:35.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.561 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:35.561 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:35.561 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 79.607847151000001, 2024-04-19T04:26:35.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:35.561 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.561 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:35.561 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.561 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.561 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.561 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:35.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:35.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:35.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:35.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:35.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:35.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:35.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:35.567 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.567 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.567 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.569 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:35.569 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:35.569 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 79.602785505, 2024-04-19T04:26:35.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:35.570 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.570 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:35.570 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.570 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.570 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.570 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:35.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.570 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:35.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:35.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:35.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:35.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:35.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:35.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:35.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:35.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:35.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:35.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:35.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:35.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:35.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:35.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:35.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:35.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:35.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:35.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:35.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:35.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:35.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:35.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:35.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:35.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:35.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:35.575 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.575 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.575 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.575 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:35.575 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:35.575 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 79.602685593000004, 2024-04-19T04:26:35.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:35.575 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.575 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:35.576 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.576 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.576 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.576 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:35.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.576 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:35.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:35.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:35.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:35.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:35.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:35.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:35.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:35.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:35.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:35.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:35.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:35.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:35.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:35.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:35.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:35.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:35.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:35.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:35.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:35.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:35.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:35.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:35.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:35.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:35.581 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.581 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.581 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.581 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:35.581 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:35.581 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 79.602559839999998, 2024-04-19T04:26:35.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:35.581 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.581 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:35.581 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.581 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.582 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.582 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:35.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.582 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:35.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:35.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:35.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:35.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:35.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:35.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:35.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:35.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:35.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:35.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:35.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:35.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:35.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:35.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:35.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:35.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:35.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:35.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:35.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:35.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:35.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:35.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:35.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:35.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:35.586 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.586 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.587 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.587 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:35.587 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:35.587 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 79.598715894999998, 2024-04-19T04:26:35.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:35.587 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.587 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.587 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.587 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.587 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.587 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:35.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.588 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:35.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:35.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:35.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:35.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:35.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:35.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:35.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:35.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:35.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:35.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:35.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:35.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:35.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:35.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:35.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:35.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:35.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:35.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:35.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:35.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:35.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:35.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:35.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:35.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:35.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:35.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:35.592 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.592 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.592 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.593 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:35.593 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:35.593 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 79.591544794000001, 2024-04-19T04:26:35.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:35.593 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.593 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:35.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.593 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:35.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.593 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:35.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:35.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:35.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:35.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:35.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:35.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:35.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:35.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:35.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:35.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:35.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:35.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:35.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:35.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:35.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:35.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:35.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:35.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:35.597 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.597 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.597 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.597 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:35.597 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:35.597 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 79.59137269, 2024-04-19T04:26:35.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:35.597 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.598 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:35.598 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.598 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.598 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.598 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:35.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.598 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:35.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:35.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:35.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:35.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:35.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:35.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:35.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:35.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:35.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:35.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:35.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:35.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:35.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:35.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:35.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:35.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:35.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:35.602 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.602 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.602 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.602 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:35.602 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:35.602 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 79.591309565000003, 2024-04-19T04:26:35.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:35.602 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.602 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.603 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.603 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.603 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.603 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:35.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.603 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:35.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:35.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:35.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:35.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:35.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:35.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:35.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:35.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:35.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:35.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:35.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:35.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:35.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:35.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:35.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:35.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:35.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:35.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:35.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:35.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:35.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:35.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:35.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:35.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:35.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:35.608 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.608 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.608 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.608 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:35.608 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:35.608 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 79.591180968000003, 2024-04-19T04:26:35.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:35.608 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.608 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.609 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.609 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.609 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.609 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:35.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.609 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:35.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:35.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:35.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:35.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:35.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:35.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:35.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:35.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:35.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:35.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:35.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:35.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:35.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:35.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:35.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:35.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:35.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:35.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:35.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:35.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:35.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:35.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:35.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:35.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:35.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:35.613 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.613 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.614 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.614 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:35.614 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:35.614 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 79.591112996999996, 2024-04-19T04:26:35.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:35.614 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.614 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.614 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.614 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.614 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.615 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:35.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.615 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:35.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:35.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:35.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:35.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:35.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:35.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:35.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:35.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:35.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:35.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:35.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:35.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:35.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:35.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:35.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:35.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:35.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:35.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:35.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:35.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:35.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:35.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:35.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:35.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:35.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:35.620 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.620 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.620 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.620 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:35.620 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:35.620 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.671573332000001, 2024-04-19T04:26:35.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078453623, 2024-04-19T04:26:35.620 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.620 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.621 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.621 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.621 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.621 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:35.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.621 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:35.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:35.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:35.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:35.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965893+0000", 2024-04-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.076646455000000002 2024-04-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965956+0000", 2024-04-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3200000000000005e-05 2024-04-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966068+0000", 2024-04-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011194800000000001 2024-04-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.671542335000002, 2024-04-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083782388999999999, 2024-04-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971179+0000", 2024-04-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079349476000000002 2024-04-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971259+0000", 2024-04-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9083000000000002e-05 2024-04-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971428+0000", 2024-04-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169419 2024-04-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.669220814999999, 2024-04-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081686998999999996, 2024-04-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971454+0000", 2024-04-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077525997999999999 2024-04-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971540+0000", 2024-04-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6285000000000005e-05 2024-04-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971654+0000", 2024-04-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114095 2024-04-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.668010432999999, 2024-04-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080734265999999999, 2024-04-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971677+0000", 2024-04-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.073192023999999994 2024-04-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971771+0000", 2024-04-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4235999999999997e-05 2024-04-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971912+0000", 2024-04-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014055099999999999 2024-04-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.667058942000001, 2024-04-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085645857000000006, 2024-04-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977634+0000", 2024-04-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077144335999999994 2024-04-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977699+0000", 2024-04-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4518999999999997e-05 2024-04-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977775+0000", 2024-04-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6219999999999999e-05 2024-04-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.664051363999999, 2024-04-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075403611999999995, 2024-04-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970369+0000", 2024-04-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.074967992999999997 2024-04-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970419+0000", 2024-04-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9700999999999997e-05 2024-04-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970540+0000", 2024-04-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121512 2024-04-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5:78f758ec:::benchmark_data_smithi007_19526_object48602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.663677239999998, 2024-04-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085171609999999995, 2024-04-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966154+0000", 2024-04-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.070613543000000001 2024-04-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966382+0000", 2024-04-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022741800000000001 2024-04-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980581+0000", 2024-04-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014199916999999999 2024-04-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980621+0000", 2024-04-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9685999999999999e-05 2024-04-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980682+0000", 2024-04-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1130000000000006e-05 2024-04-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.663587287999999, 2024-04-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075073230000000005, 2024-04-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970556+0000", 2024-04-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.072076192999999997 2024-04-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970608+0000", 2024-04-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2549000000000001e-05 2024-04-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970674+0000", 2024-04-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5549000000000005e-05 2024-04-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5:70a7bb5e:::benchmark_data_smithi007_19526_object48614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.658500290999999, 2024-04-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080099220999999998, 2024-04-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971978+0000", 2024-04-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.071282358000000004 2024-04-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.972180+0000", 2024-04-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020191100000000001 2024-04-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980701+0000", 2024-04-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085211760000000001 2024-04-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980729+0000", 2024-04-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8068e-05 2024-04-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980787+0000", 2024-04-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7521e-05 2024-04-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174350 5.e 5:7f36609a:::benchmark_data_smithi007_19526_object48616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.656729218999999, 2024-04-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079723622999999993, 2024-04-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174350 2024-04-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902458+0000", 2024-04-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902463+0000", 2024-04-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5889999999999996e-06 2024-04-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965576+0000", 2024-04-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063113328999999996 2024-04-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965614+0000", 2024-04-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8285999999999999e-05 2024-04-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974787+0000", 2024-04-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009172599 2024-04-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974999+0000", 2024-04-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021270999999999999 2024-04-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982086+0000", 2024-04-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070869160000000004 2024-04-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982115+0000", 2024-04-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8603999999999999e-05 2024-04-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982182+0000", 2024-04-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7350999999999999e-05 2024-04-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.673 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:35.673 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:35.673 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:35.674 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:35.672+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:35.674 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:35.775 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:35.772+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:35.806 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:246558 5.9 5:91d8de35:::benchmark_data_smithi007_19526_object120824:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:35.796701+0000", 2024-04-19T04:26:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0081149770000000006, 2024-04-19T04:26:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0081423429999999998, 2024-04-19T04:26:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 246558 2024-04-19T04:26:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.796701+0000", 2024-04-19T04:26:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.796701+0000", 2024-04-19T04:26:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.796700+0000", 2024-04-19T04:26:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.796704+0000", 2024-04-19T04:26:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2930000000000002e-06 2024-04-19T04:26:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.796712+0000", 2024-04-19T04:26:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0399999999999993e-06 2024-04-19T04:26:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.796718+0000", 2024-04-19T04:26:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.879e-06 2024-04-19T04:26:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.800219+0000", 2024-04-19T04:26:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0035004939999999998 2024-04-19T04:26:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.800361+0000", 2024-04-19T04:26:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000142452 2024-04-19T04:26:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.800519+0000", 2024-04-19T04:26:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000157916 2024-04-19T04:26:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:246559 5.1 5:86dff431:::benchmark_data_smithi007_19526_object120825:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:35.798634+0000", 2024-04-19T04:26:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0061819170000000003, 2024-04-19T04:26:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0063036200000000002, 2024-04-19T04:26:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 246559 2024-04-19T04:26:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.798634+0000", 2024-04-19T04:26:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.798634+0000", 2024-04-19T04:26:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.798633+0000", 2024-04-19T04:26:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.798639+0000", 2024-04-19T04:26:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9529999999999996e-06 2024-04-19T04:26:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.798657+0000", 2024-04-19T04:26:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8947e-05 2024-04-19T04:26:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.798667+0000", 2024-04-19T04:26:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0189999999999995e-06 2024-04-19T04:26:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.802540+0000", 2024-04-19T04:26:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038732269999999999 2024-04-19T04:26:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.802638+0000", 2024-04-19T04:26:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8721000000000006e-05 2024-04-19T04:26:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:246561 5.1 5:8638b6d6:::benchmark_data_smithi007_19526_object120827:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:35.798707+0000", 2024-04-19T04:26:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0061086259999999998, 2024-04-19T04:26:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0063036999999999998, 2024-04-19T04:26:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 246561 2024-04-19T04:26:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.798707+0000", 2024-04-19T04:26:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.798707+0000", 2024-04-19T04:26:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.798706+0000", 2024-04-19T04:26:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.798710+0000", 2024-04-19T04:26:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.343e-06 2024-04-19T04:26:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.798718+0000", 2024-04-19T04:26:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2050000000000002e-06 2024-04-19T04:26:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.798724+0000", 2024-04-19T04:26:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0340000000000002e-06 2024-04-19T04:26:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804635+0000", 2024-04-19T04:26:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0059105549999999996 2024-04-19T04:26:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804751+0000", 2024-04-19T04:26:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115992 2024-04-19T04:26:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:246562 5.f 5:ff3b13ac:::benchmark_data_smithi007_19526_object120828:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:35.798730+0000", 2024-04-19T04:26:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0060859850000000004, 2024-04-19T04:26:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0063530449999999999, 2024-04-19T04:26:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 246562 2024-04-19T04:26:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.798730+0000", 2024-04-19T04:26:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.798730+0000", 2024-04-19T04:26:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.798729+0000", 2024-04-19T04:26:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.798732+0000", 2024-04-19T04:26:35.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.3129999999999999e-06 2024-04-19T04:26:35.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.798740+0000", 2024-04-19T04:26:35.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6340000000000001e-06 2024-04-19T04:26:35.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.798746+0000", 2024-04-19T04:26:35.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8769999999999998e-06 2024-04-19T04:26:35.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.800332+0000", 2024-04-19T04:26:35.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001585847 2024-04-19T04:26:35.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.800468+0000", 2024-04-19T04:26:35.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013589099999999999 2024-04-19T04:26:35.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:35.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.800549+0000", 2024-04-19T04:26:35.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1378000000000006e-05 2024-04-19T04:26:35.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803697+0000", 2024-04-19T04:26:35.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031474990000000002 2024-04-19T04:26:35.823 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.823 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.823 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.823 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:246564 5.d 5:be900ee1:::benchmark_data_smithi007_19526_object120830:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:35.823 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:35.800378+0000", 2024-04-19T04:26:35.823 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0044379909999999996, 2024-04-19T04:26:35.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0047911289999999999, 2024-04-19T04:26:35.823 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.823 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:35.824 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.824 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.824 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.824 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 246564 2024-04-19T04:26:35.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.824 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.800378+0000", 2024-04-19T04:26:35.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.800378+0000", 2024-04-19T04:26:35.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.800377+0000", 2024-04-19T04:26:35.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.800383+0000", 2024-04-19T04:26:35.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.959e-06 2024-04-19T04:26:35.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.800393+0000", 2024-04-19T04:26:35.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0084e-05 2024-04-19T04:26:35.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.800400+0000", 2024-04-19T04:26:35.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.007e-06 2024-04-19T04:26:35.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.800694+0000", 2024-04-19T04:26:35.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00029452200000000002 2024-04-19T04:26:35.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.800829+0000", 2024-04-19T04:26:35.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013473399999999999 2024-04-19T04:26:35.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:35.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.800958+0000", 2024-04-19T04:26:35.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012872599999999999 2024-04-19T04:26:35.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:35.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803559+0000", 2024-04-19T04:26:35.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0026009990000000001 2024-04-19T04:26:35.827 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.827 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.827 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.828 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:246568 5.5 5:a9880c83:::benchmark_data_smithi007_19526_object120834:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:35.828 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:35.802685+0000", 2024-04-19T04:26:35.828 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0021301319999999999, 2024-04-19T04:26:35.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0025693510000000001, 2024-04-19T04:26:35.828 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.828 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:35.828 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.828 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.828 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.828 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 246568 2024-04-19T04:26:35.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.828 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.802685+0000", 2024-04-19T04:26:35.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.802685+0000", 2024-04-19T04:26:35.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.802685+0000", 2024-04-19T04:26:35.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.802690+0000", 2024-04-19T04:26:35.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1089999999999997e-06 2024-04-19T04:26:35.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.802696+0000", 2024-04-19T04:26:35.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4099999999999996e-06 2024-04-19T04:26:35.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.830 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.830 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.802700+0000", 2024-04-19T04:26:35.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3590000000000001e-06 2024-04-19T04:26:35.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.802732+0000", 2024-04-19T04:26:35.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1795000000000003e-05 2024-04-19T04:26:35.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.802829+0000", 2024-04-19T04:26:35.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.6693000000000004e-05 2024-04-19T04:26:35.831 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.831 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.831 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.832 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:246569 5.9 5:90fff998:::benchmark_data_smithi007_19526_object120835:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:35.832 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:35.803101+0000", 2024-04-19T04:26:35.832 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0017142329999999999, 2024-04-19T04:26:35.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0022240929999999999, 2024-04-19T04:26:35.832 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.832 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:35.832 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.832 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.832 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.832 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 246569 2024-04-19T04:26:35.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.832 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803101+0000", 2024-04-19T04:26:35.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803101+0000", 2024-04-19T04:26:35.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803100+0000", 2024-04-19T04:26:35.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803108+0000", 2024-04-19T04:26:35.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.17e-06 2024-04-19T04:26:35.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803121+0000", 2024-04-19T04:26:35.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3832000000000001e-05 2024-04-19T04:26:35.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803140+0000", 2024-04-19T04:26:35.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.8813000000000001e-05 2024-04-19T04:26:35.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804715+0000", 2024-04-19T04:26:35.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00157471 2024-04-19T04:26:35.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804824+0000", 2024-04-19T04:26:35.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000109177 2024-04-19T04:26:35.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.836 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:35.836 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804931+0000", 2024-04-19T04:26:35.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000107021 2024-04-19T04:26:35.836 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.836 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.836 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.836 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:246570 5.6 5:6f403a91:::benchmark_data_smithi007_19526_object120836:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:35.837 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:35.803162+0000", 2024-04-19T04:26:35.837 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001653729, 2024-04-19T04:26:35.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0022514670000000001, 2024-04-19T04:26:35.837 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.837 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:35.837 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.837 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.837 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.837 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 246570 2024-04-19T04:26:35.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.837 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803162+0000", 2024-04-19T04:26:35.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803162+0000", 2024-04-19T04:26:35.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803161+0000", 2024-04-19T04:26:35.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803166+0000", 2024-04-19T04:26:35.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2639999999999999e-06 2024-04-19T04:26:35.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803177+0000", 2024-04-19T04:26:35.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0516999999999999e-05 2024-04-19T04:26:35.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803184+0000", 2024-04-19T04:26:35.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.8290000000000002e-06 2024-04-19T04:26:35.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803237+0000", 2024-04-19T04:26:35.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.304e-05 2024-04-19T04:26:35.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803415+0000", 2024-04-19T04:26:35.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000178293 2024-04-19T04:26:35.840 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.840 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.840 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.841 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:246572 5.2 5:4bea80a5:::benchmark_data_smithi007_19526_object120838:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:35.841 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:35.803957+0000", 2024-04-19T04:26:35.841 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00085863900000000002, 2024-04-19T04:26:35.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0015317130000000001, 2024-04-19T04:26:35.841 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.841 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:35.841 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.841 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.841 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.841 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 246572 2024-04-19T04:26:35.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.841 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.841 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803957+0000", 2024-04-19T04:26:35.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803957+0000", 2024-04-19T04:26:35.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803956+0000", 2024-04-19T04:26:35.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803960+0000", 2024-04-19T04:26:35.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2980000000000002e-06 2024-04-19T04:26:35.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803969+0000", 2024-04-19T04:26:35.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0439999999999996e-06 2024-04-19T04:26:35.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.803976+0000", 2024-04-19T04:26:35.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0840000000000003e-06 2024-04-19T04:26:35.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804026+0000", 2024-04-19T04:26:35.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0589e-05 2024-04-19T04:26:35.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:35.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804140+0000", 2024-04-19T04:26:35.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011411 2024-04-19T04:26:35.844 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.844 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.844 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.845 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:246573 5.6 5:6df50abd:::benchmark_data_smithi007_19526_object120839:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:35.845 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:35.804170+0000", 2024-04-19T04:26:35.845 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00064526700000000004, 2024-04-19T04:26:35.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001389141, 2024-04-19T04:26:35.845 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.845 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:35.845 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.845 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.845 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.845 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 246573 2024-04-19T04:26:35.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.845 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804170+0000", 2024-04-19T04:26:35.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804170+0000", 2024-04-19T04:26:35.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804169+0000", 2024-04-19T04:26:35.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804174+0000", 2024-04-19T04:26:35.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6319999999999999e-06 2024-04-19T04:26:35.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804182+0000", 2024-04-19T04:26:35.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0600000000000008e-06 2024-04-19T04:26:35.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804190+0000", 2024-04-19T04:26:35.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9019999999999999e-06 2024-04-19T04:26:35.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:35.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.805524+0000", 2024-04-19T04:26:35.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0013341589999999999 2024-04-19T04:26:35.848 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.848 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.848 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.848 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:246574 5.1 5.e7bc94e1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:35.848 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:35.804209+0000", 2024-04-19T04:26:35.849 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00060665700000000003, 2024-04-19T04:26:35.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014171100000000001, 2024-04-19T04:26:35.849 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.849 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:35.849 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.849 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.849 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.849 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 246574 2024-04-19T04:26:35.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.849 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804209+0000", 2024-04-19T04:26:35.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804209+0000", 2024-04-19T04:26:35.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804208+0000", 2024-04-19T04:26:35.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804212+0000", 2024-04-19T04:26:35.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1300000000000001e-06 2024-04-19T04:26:35.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804218+0000", 2024-04-19T04:26:35.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3160000000000002e-06 2024-04-19T04:26:35.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.851 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.851 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804223+0000", 2024-04-19T04:26:35.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0579999999999997e-06 2024-04-19T04:26:35.851 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.851 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.851 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.851 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:246575 5.1 5.8766f0d1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:35.852 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:35.804633+0000", 2024-04-19T04:26:35.852 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.000182757, 2024-04-19T04:26:35.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001049655, 2024-04-19T04:26:35.852 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.852 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:35.852 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.852 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.852 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.852 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 246575 2024-04-19T04:26:35.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.852 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804633+0000", 2024-04-19T04:26:35.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804633+0000", 2024-04-19T04:26:35.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804632+0000", 2024-04-19T04:26:35.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804638+0000", 2024-04-19T04:26:35.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4799999999999998e-06 2024-04-19T04:26:35.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804650+0000", 2024-04-19T04:26:35.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2135e-05 2024-04-19T04:26:35.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804658+0000", 2024-04-19T04:26:35.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.0819999999999999e-06 2024-04-19T04:26:35.854 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.854 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.854 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.855 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:246576 5.2 5.dc4329b2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:35.855 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:35.804862+0000", 2024-04-19T04:26:35.855 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9999537, 2024-04-19T04:26:35.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00087774599999999999, 2024-04-19T04:26:35.855 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.855 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:35.855 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:35.855 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:35.855 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:35.855 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 246576 2024-04-19T04:26:35.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.855 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804862+0000", 2024-04-19T04:26:35.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804862+0000", 2024-04-19T04:26:35.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804861+0000", 2024-04-19T04:26:35.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:35.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804866+0000", 2024-04-19T04:26:35.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2249999999999999e-06 2024-04-19T04:26:35.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804874+0000", 2024-04-19T04:26:35.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4519999999999997e-06 2024-04-19T04:26:35.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.804879+0000", 2024-04-19T04:26:35.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9880000000000004e-06 2024-04-19T04:26:35.858 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.858 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.858 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.858 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:246562 5.f e65/20)", 2024-04-19T04:26:35.858 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:35.805754+0000", 2024-04-19T04:26:35.858 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9990611, 2024-04-19T04:26:35.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0479999999999999e-05, 2024-04-19T04:26:35.858 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.858 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:35.858 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.805754+0000", 2024-04-19T04:26:35.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.805754+0000", 2024-04-19T04:26:35.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.805754+0000", 2024-04-19T04:26:35.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.805759+0000", 2024-04-19T04:26:35.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1150000000000002e-06 2024-04-19T04:26:35.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.805768+0000", 2024-04-19T04:26:35.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1770000000000004e-06 2024-04-19T04:26:35.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.805774+0000", 2024-04-19T04:26:35.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3080000000000004e-06 2024-04-19T04:26:35.860 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.860 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.860 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.861 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_repop_reply(client.4746.0:246564 5.d e65/29)", 2024-04-19T04:26:35.861 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:35.805792+0000", 2024-04-19T04:26:35.861 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9990234, 2024-04-19T04:26:35.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6155999999999995e-05, 2024-04-19T04:26:35.861 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:35.861 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:35.861 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:35.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:35.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.805792+0000", 2024-04-19T04:26:35.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:35.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.805792+0000", 2024-04-19T04:26:35.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:35.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:35.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.805792+0000", 2024-04-19T04:26:35.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:35.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:35.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.805794+0000", 2024-04-19T04:26:35.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.757e-06 2024-04-19T04:26:35.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.862 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:35.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.805800+0000", 2024-04-19T04:26:35.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1800000000000004e-06 2024-04-19T04:26:35.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:35.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:35.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:35.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:35.805804+0000", 2024-04-19T04:26:35.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3089999999999997e-06 2024-04-19T04:26:35.863 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.863 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:35.863 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.863 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:35.863 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:35.863 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 15 2024-04-19T04:26:35.863 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:35.864 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:35.875 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:35.872+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:35.979 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:35.976+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:35.989 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:35.989 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:35.989 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:35.989 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:35.989 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:36.002 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:36.079 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:36.076+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:36.177 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:36.177 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:36.177 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:36.177 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:36.177 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.177 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:36.178 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:36.178 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 101.943913182, 2024-04-19T04:26:36.178 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:36.178 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.178 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.178 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.178 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.178 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.178 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:36.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.178 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.178 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.178 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.179 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:36.179 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.179 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.181 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:36.181 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.182 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.182 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.182 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.182 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:36.182 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.182 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.182 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.182 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.182 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:36.182 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:36.182 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.182 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.182 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.182 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:36.183 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:36.183 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.183 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.183 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.183 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:36.183 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:36.183 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.183 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.183 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.183 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:36.183 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:36.183 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.183 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:36.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:36.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:36.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:36.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:36.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:36.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.184 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:36.184 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:36.184 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:36.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:36.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:36.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:36.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:36.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:36.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:36.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.185 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.185 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:36.185 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:36.186 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.186 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.186 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.186 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:36.186 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:36.186 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 101.939818261, 2024-04-19T04:26:36.186 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:36.186 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.186 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.186 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.187 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.187 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.187 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:36.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.187 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.187 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.187 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:36.187 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.187 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.187 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:36.187 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.187 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.188 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:36.188 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.188 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.188 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.188 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:36.188 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:36.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.188 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.188 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.188 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:36.188 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:36.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.188 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.188 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.188 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:36.188 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:36.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.189 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.189 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.189 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:36.189 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:36.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.189 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.189 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:36.189 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:36.189 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:36.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.189 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.190 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:36.190 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:36.190 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:36.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.190 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:36.190 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:36.190 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:36.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.190 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:36.190 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:36.190 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:36.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.191 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:36.191 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:36.191 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:36.191 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.191 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.191 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.191 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:36.191 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:36.191 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.191 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.191 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.191 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.191 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.191 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:36.192 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:36.192 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 101.936527076, 2024-04-19T04:26:36.192 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:36.192 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.192 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.192 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.192 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.192 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.192 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:36.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.192 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.192 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.192 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.192 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:36.193 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.193 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.193 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.193 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.193 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:36.193 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.193 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.193 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.193 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.193 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:36.193 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.193 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.193 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.194 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.194 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:36.194 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:36.194 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.194 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.194 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.194 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:36.194 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:36.194 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.194 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.194 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.194 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:36.195 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:36.195 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.195 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.195 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.195 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:36.195 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:36.195 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.195 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.195 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:36.195 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:36.195 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:36.195 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.195 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.195 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:36.196 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:36.196 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:36.196 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.196 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.196 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:36.196 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:36.196 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:36.196 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.196 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.196 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:36.196 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:36.196 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:36.196 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.196 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.196 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:36.197 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:36.197 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:36.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.197 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.197 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.197 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:36.197 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:36.197 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.197 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.197 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.197 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.197 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:36.197 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:36.198 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 80.219137610999994, 2024-04-19T04:26:36.198 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:36.198 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.198 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:36.198 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.198 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.198 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.198 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:36.198 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.198 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.198 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.198 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.198 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:36.199 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.199 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.199 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.199 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.199 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:36.199 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.199 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.199 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.199 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.199 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:36.199 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:36.199 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.199 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.199 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.199 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:36.200 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:36.200 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.200 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.200 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.200 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:36.200 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:36.200 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.200 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.200 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.200 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:36.200 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:36.200 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.200 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.201 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.201 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:36.201 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:36.201 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.201 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.201 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:36.201 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:36.201 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:36.201 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.201 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.201 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:36.201 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:36.201 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:36.201 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.202 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.202 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:36.202 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:36.202 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:36.202 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.202 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.202 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.202 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:36.202 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:36.202 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.202 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.202 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:36.202 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:36.203 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:36.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.203 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.203 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.203 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:36.203 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:36.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.203 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.203 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.203 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:36.203 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:36.203 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.203 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.204 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.204 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.204 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.204 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:36.204 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:36.204 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 80.198907161999998, 2024-04-19T04:26:36.204 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:36.204 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.204 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:36.204 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.204 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.204 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.204 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:36.204 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.205 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.205 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.205 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.205 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:36.205 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.205 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.205 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.205 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.205 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:36.205 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.205 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.205 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.205 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.205 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:36.205 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:36.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.206 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.206 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.206 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:36.206 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:36.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.206 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.206 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.206 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:36.206 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:36.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.206 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.206 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.206 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:36.206 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:36.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.207 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.207 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.207 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:36.207 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:36.207 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.207 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.207 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:36.207 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:36.207 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:36.207 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.207 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.207 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.207 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:36.208 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:36.208 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.208 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.208 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.208 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:36.208 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:36.208 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.208 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.208 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.208 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.208 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.208 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:36.208 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:36.208 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 80.198799304999994, 2024-04-19T04:26:36.209 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:36.209 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.209 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:36.209 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.209 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.209 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.209 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:36.209 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.209 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.209 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.209 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.209 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:36.209 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.210 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.210 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.210 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.210 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:36.210 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.210 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.210 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.210 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.210 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:36.210 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:36.210 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.210 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.210 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.210 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:36.211 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:36.211 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.211 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.211 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.211 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:36.211 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:36.211 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.211 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.211 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.211 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:36.211 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:36.211 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.211 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.211 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.212 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:36.212 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:36.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.212 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.212 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:36.212 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:36.212 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:36.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.212 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.212 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.212 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:36.212 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:36.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.212 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.213 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.213 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:36.213 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:36.213 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.213 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.213 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.213 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.213 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.213 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:36.213 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:36.213 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 80.196832615999995, 2024-04-19T04:26:36.213 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:36.213 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.213 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.214 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.214 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.214 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.214 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:36.214 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.214 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.214 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.214 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.214 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:36.214 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.214 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.214 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.214 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.214 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:36.215 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.215 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.215 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.215 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.215 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:36.215 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:36.215 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.215 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.215 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.215 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:36.215 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:36.215 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.215 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.215 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.216 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:36.216 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:36.216 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.216 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.216 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.216 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:36.216 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:36.216 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.216 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.216 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.216 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:36.216 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:36.216 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.216 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.217 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:36.217 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:36.217 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:36.217 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.217 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.217 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.217 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:36.217 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:36.217 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.217 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.217 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:36.217 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:36.217 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:36.217 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.217 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.217 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:36.218 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:36.218 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:36.218 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.218 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.218 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:36.218 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:36.218 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:36.218 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.218 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.218 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.218 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:36.218 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:36.218 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.218 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.219 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.219 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.219 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.219 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:36.219 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:36.219 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 80.193468421000006, 2024-04-19T04:26:36.219 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:36.219 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.219 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.219 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.219 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.219 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.219 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:36.219 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.219 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.220 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.220 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.220 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:36.220 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.220 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.220 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.220 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.220 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:36.220 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.220 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.220 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.220 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.220 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:36.220 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.221 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.221 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.221 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.221 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:36.221 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:36.221 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.221 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.221 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.221 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:36.221 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:36.221 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.221 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.221 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.221 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:36.222 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:36.222 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.222 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.222 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.222 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:36.222 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:36.222 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.222 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.222 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:36.222 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:36.222 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:36.222 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.222 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.222 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.223 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:36.223 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:36.223 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.223 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.223 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:36.223 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:36.223 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:36.223 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.223 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.223 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:36.223 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:36.223 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:36.223 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.223 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.224 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:36.224 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:36.224 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:36.224 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.224 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.224 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.224 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:36.224 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:36.224 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.224 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.224 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.224 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.224 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.224 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:36.224 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:36.225 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 80.189657443000002, 2024-04-19T04:26:36.225 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:36.225 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.225 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.225 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.225 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.225 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.225 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:36.225 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.225 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.225 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.225 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.225 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:36.225 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.226 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.226 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.226 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.226 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:36.226 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.226 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.226 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.226 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.226 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:36.226 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.226 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.226 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.226 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.226 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:36.227 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:36.227 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.227 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.227 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.227 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:36.227 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:36.227 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.227 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.227 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.227 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:36.227 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:36.227 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.227 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.227 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.227 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:36.228 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:36.228 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.228 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.228 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:36.228 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:36.228 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:36.228 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.228 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.228 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.228 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:36.228 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:36.228 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.228 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.228 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:36.228 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:36.229 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:36.229 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.229 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.229 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:36.229 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:36.229 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:36.229 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.229 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.229 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:36.229 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:36.229 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:36.229 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.229 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.229 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.230 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:36.230 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:36.230 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.230 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.230 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.230 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.230 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.230 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:36.230 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:36.230 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 66.947795085999999, 2024-04-19T04:26:36.230 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:36.230 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.230 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.231 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.231 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.231 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.231 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:36.231 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.231 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.231 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.231 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.231 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:36.231 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.231 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.231 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.231 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.231 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:36.232 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.232 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.232 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.232 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.232 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:36.232 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:36.232 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.232 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.232 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.232 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:36.232 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:36.232 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.232 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.233 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.233 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:36.233 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:36.233 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.233 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.233 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.233 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:36.233 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:36.233 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.233 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.233 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.233 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:36.233 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:36.234 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.234 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.234 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:36.234 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:36.234 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:36.234 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.234 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.234 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:36.234 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:36.234 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:36.234 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.234 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.235 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:36.235 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:36.235 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:36.235 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.235 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.235 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.235 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:36.235 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:36.235 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.235 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.235 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.235 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.235 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.235 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:36.236 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:36.236 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 66.947200805999998, 2024-04-19T04:26:36.236 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:36.236 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.236 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.236 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.236 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.236 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.236 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:36.236 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.236 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.236 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.236 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.236 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:36.236 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.237 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.237 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.237 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.237 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:36.237 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.237 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.237 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.237 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.237 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:36.237 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.237 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.237 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.237 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.237 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:36.238 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:36.238 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.238 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.238 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.238 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:36.238 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:36.238 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.238 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.238 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.238 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:36.238 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:36.238 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.238 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.238 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.239 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:36.239 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:36.239 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.239 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.239 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:36.239 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:36.239 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:36.239 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.239 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.239 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:36.239 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:36.239 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:36.239 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.239 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.240 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:36.240 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:36.240 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:36.240 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.240 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.240 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:36.240 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:36.240 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:36.240 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.240 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.240 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:36.240 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:36.240 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:36.241 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.241 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.241 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.241 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:36.241 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:36.241 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.241 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.241 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.241 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.241 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.241 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:36.241 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:36.241 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 32.222553648000002, 2024-04-19T04:26:36.241 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:36.242 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.242 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.242 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.242 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.242 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.242 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:36.242 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.242 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.242 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.242 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.242 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:36.242 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.242 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.242 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.243 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.243 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:36.243 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.243 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.243 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.243 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.243 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:36.243 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:36.243 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.243 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.243 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.243 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:36.243 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:36.243 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.244 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.244 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.244 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:36.244 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:36.244 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.244 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.244 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.244 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:36.244 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:36.244 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.244 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.244 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.244 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:36.244 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:36.244 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.245 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.245 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:36.245 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:36.245 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:36.245 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.245 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.245 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:36.245 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:36.245 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:36.245 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.245 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.245 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:36.245 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:36.246 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:36.246 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.246 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.246 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:36.246 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:36.246 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:36.246 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.246 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.246 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:36.246 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:36.246 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:36.246 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.246 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.246 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.247 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:36.247 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:36.247 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.247 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.247 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.247 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.247 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.247 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:36.247 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:36.247 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 32.222513231999997, 2024-04-19T04:26:36.247 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:36.247 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.247 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.247 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.248 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.248 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.248 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:36.248 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.248 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.248 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.248 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.248 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:36.248 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.248 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.248 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.248 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.248 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:36.248 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.249 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.249 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.249 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.249 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:36.249 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:36.249 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.249 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.249 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.249 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:36.249 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:36.249 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.249 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.249 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.249 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:36.250 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:36.250 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.250 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.250 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.250 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:36.250 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:36.250 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.250 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.250 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.250 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:36.250 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:36.250 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.250 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.250 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:36.251 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:36.251 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:36.251 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.251 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.251 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:36.251 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:36.251 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:36.251 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.251 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.251 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:36.251 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:36.251 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:36.251 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.251 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.252 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:36.252 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:36.252 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:36.252 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.252 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.252 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:36.252 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:36.252 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:36.252 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.252 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.252 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.252 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:36.252 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:36.252 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.253 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.253 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.253 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.253 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.253 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:36.253 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:36.253 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 32.218816922999999, 2024-04-19T04:26:36.253 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:36.253 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.253 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.253 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.253 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.253 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.253 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:36.254 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.254 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.254 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.254 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.254 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:36.254 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.254 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.254 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.254 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.254 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:36.254 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.254 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.254 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.255 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.255 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:36.255 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.255 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.255 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.255 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.255 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:36.255 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:36.255 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.255 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.255 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.255 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:36.255 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:36.255 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.255 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.256 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.256 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:36.256 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:36.256 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.256 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.256 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.256 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:36.256 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:36.256 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.256 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.256 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:36.256 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:36.256 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:36.256 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.256 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.257 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:36.257 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:36.257 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:36.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.257 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.257 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:36.257 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:36.257 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:36.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.257 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.257 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:36.257 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:36.257 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:36.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.258 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.258 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:36.258 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:36.258 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:36.258 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.258 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.258 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.258 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:36.258 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:36.258 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.258 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.258 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.258 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.259 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.259 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:36.259 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:36.259 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.965206449, 2024-04-19T04:26:36.259 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:36.259 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.259 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.259 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.259 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.259 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.259 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:36.259 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.259 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.259 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.259 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.260 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:36.260 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.260 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.260 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.260 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:36.260 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.260 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.260 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.260 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:36.260 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:36.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.260 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.261 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.261 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:36.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:36.261 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.261 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.261 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.261 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:36.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:36.261 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.261 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.261 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.261 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:36.261 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:36.262 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.262 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.262 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.262 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:36.262 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:36.262 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.262 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.262 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:36.262 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:36.262 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:36.262 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.262 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.262 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:36.263 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:36.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:36.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.263 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.263 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:36.263 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:36.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:36.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.263 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.263 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.263 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:36.263 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:36.263 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.263 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.263 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.264 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:36.264 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:36.264 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.962913037, 2024-04-19T04:26:36.264 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:36.264 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.264 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.264 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.264 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.264 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.264 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:36.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.264 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.264 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:36.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:36.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.265 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.265 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.265 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:36.265 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.266 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:36.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:36.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.266 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:36.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:36.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.266 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.266 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.266 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:36.266 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:36.267 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.267 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.267 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.267 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:36.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:36.267 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.267 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.267 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:36.267 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:36.267 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:36.267 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.267 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.267 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:36.267 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:36.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:36.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.268 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:36.268 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:36.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:36.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.268 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.268 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:36.268 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:36.268 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.268 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.268 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.269 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:36.269 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:36.269 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.962867221, 2024-04-19T04:26:36.269 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:36.269 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.269 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.269 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.269 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.269 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.269 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:36.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.269 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.269 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.269 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:36.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:36.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.270 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.270 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:36.270 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:36.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.270 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:36.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:36.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:36.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:36.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.271 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.271 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:36.271 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:36.271 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.271 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.272 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.272 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:36.272 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:36.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.272 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.272 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:36.272 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:36.272 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:36.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.272 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.272 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:36.272 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:36.272 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:36.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.272 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:36.273 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:36.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:36.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.273 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.273 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:36.273 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:36.273 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.273 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.273 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.273 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.273 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174342 5.9 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:36.273 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:36.274 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.277710520999999, 2024-04-19T04:26:36.274 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068615152999999998, 2024-04-19T04:26:36.274 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.274 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.274 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.274 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.274 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.274 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174342 2024-04-19T04:26:36.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.274 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.274 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.274 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.274 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:36.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:36.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897726+0000", 2024-04-19T04:26:36.275 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.275 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.275 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897731+0000", 2024-04-19T04:26:36.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1449999999999999e-06 2024-04-19T04:26:36.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897744+0000", 2024-04-19T04:26:36.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2833000000000001e-05 2024-04-19T04:26:36.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.276 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897749+0000", 2024-04-19T04:26:36.276 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1540000000000001e-06 2024-04-19T04:26:36.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.276 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.276 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897810+0000", 2024-04-19T04:26:36.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0724999999999999e-05 2024-04-19T04:26:36.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:36.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897920+0000", 2024-04-19T04:26:36.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011024 2024-04-19T04:26:36.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.277 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:36.277 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897993+0000", 2024-04-19T04:26:36.277 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2335000000000005e-05 2024-04-19T04:26:36.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:36.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.899597+0000", 2024-04-19T04:26:36.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016048919999999999 2024-04-19T04:26:36.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:36.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966230+0000", 2024-04-19T04:26:36.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.066632882000000004 2024-04-19T04:26:36.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.278 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:36.278 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966296+0000", 2024-04-19T04:26:36.278 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5361e-05 2024-04-19T04:26:36.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.279 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.279 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966342+0000", 2024-04-19T04:26:36.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6476e-05 2024-04-19T04:26:36.279 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.279 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.279 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.279 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174344 5.d 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:36.279 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:36.279 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.277031683000001, 2024-04-19T04:26:36.279 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068211329000000001, 2024-04-19T04:26:36.279 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.280 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.280 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.280 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.280 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.280 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174344 2024-04-19T04:26:36.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.280 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:36.280 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.280 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.280 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.280 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:36.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898405+0000", 2024-04-19T04:26:36.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:36.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898409+0000", 2024-04-19T04:26:36.281 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5149999999999998e-06 2024-04-19T04:26:36.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.281 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.281 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898415+0000", 2024-04-19T04:26:36.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:26:36.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898419+0000", 2024-04-19T04:26:36.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.89e-06 2024-04-19T04:26:36.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.282 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898459+0000", 2024-04-19T04:26:36.282 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0017e-05 2024-04-19T04:26:36.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.282 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:36.283 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898540+0000", 2024-04-19T04:26:36.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1237999999999997e-05 2024-04-19T04:26:36.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.283 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:36.283 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:36.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6060000000000001e-05 2024-04-19T04:26:36.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.283 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:36.283 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.901321+0000", 2024-04-19T04:26:36.283 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027152109999999999 2024-04-19T04:26:36.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:36.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966512+0000", 2024-04-19T04:26:36.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.065190440000000002 2024-04-19T04:26:36.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:36.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966563+0000", 2024-04-19T04:26:36.284 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1436e-05 2024-04-19T04:26:36.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.284 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.284 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966617+0000", 2024-04-19T04:26:36.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.401e-05 2024-04-19T04:26:36.285 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.285 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.285 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.285 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174346 5.f 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:36.285 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:36.285 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 31.275245456, 2024-04-19T04:26:36.285 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.067185536000000004, 2024-04-19T04:26:36.285 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.285 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.285 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.285 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.285 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.286 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174346 2024-04-19T04:26:36.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.286 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:36.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.286 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.286 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:36.286 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.286 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:36.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900191+0000", 2024-04-19T04:26:36.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:36.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900196+0000", 2024-04-19T04:26:36.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3329999999999998e-06 2024-04-19T04:26:36.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.287 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:36.287 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900206+0000", 2024-04-19T04:26:36.287 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9699999999999994e-06 2024-04-19T04:26:36.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900210+0000", 2024-04-19T04:26:36.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3359999999999997e-06 2024-04-19T04:26:36.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:36.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900243+0000", 2024-04-19T04:26:36.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2669999999999997e-05 2024-04-19T04:26:36.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.288 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:36.288 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900365+0000", 2024-04-19T04:26:36.288 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122648 2024-04-19T04:26:36.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:36.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900559+0000", 2024-04-19T04:26:36.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019358799999999999 2024-04-19T04:26:36.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:36.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.903018+0000", 2024-04-19T04:26:36.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024592300000000002 2024-04-19T04:26:36.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.289 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:36.289 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967180+0000", 2024-04-19T04:26:36.289 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.064161587000000006 2024-04-19T04:26:36.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.290 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:36.290 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967293+0000", 2024-04-19T04:26:36.290 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112921 2024-04-19T04:26:36.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.290 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:36.290 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967378+0000", 2024-04-19T04:26:36.290 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5000999999999995e-05 2024-04-19T04:26:36.290 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.290 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.290 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.290 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:36.291 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:36.291 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:36.292 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:36.293 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:36.292+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:36.378 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T04:26:36.392 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:36.388+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:36.413 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:36.413 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:36.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.414 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:247973 5.8 5:1bc33002:::benchmark_data_smithi007_19526_object122239:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:36.414 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:36.405944+0000", 2024-04-19T04:26:36.414 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0082678769999999999, 2024-04-19T04:26:36.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083189700000000002, 2024-04-19T04:26:36.414 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.414 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:36.414 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.414 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.414 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.414 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 247973 2024-04-19T04:26:36.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.414 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.405944+0000", 2024-04-19T04:26:36.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.405944+0000", 2024-04-19T04:26:36.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.405943+0000", 2024-04-19T04:26:36.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.405948+0000", 2024-04-19T04:26:36.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2519999999999999e-06 2024-04-19T04:26:36.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.405960+0000", 2024-04-19T04:26:36.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.172e-05 2024-04-19T04:26:36.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.405969+0000", 2024-04-19T04:26:36.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8009999999999993e-06 2024-04-19T04:26:36.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.406007+0000", 2024-04-19T04:26:36.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8251999999999999e-05 2024-04-19T04:26:36.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.406105+0000", 2024-04-19T04:26:36.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8597000000000005e-05 2024-04-19T04:26:36.417 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.417 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.417 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.418 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:247974 5.e 5:72516ed0:::benchmark_data_smithi007_19526_object122240:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:36.418 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:36.405990+0000", 2024-04-19T04:26:36.418 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0082221099999999995, 2024-04-19T04:26:36.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00836223, 2024-04-19T04:26:36.418 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.418 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:36.418 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.418 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.418 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.418 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 247974 2024-04-19T04:26:36.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.418 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.405990+0000", 2024-04-19T04:26:36.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.405990+0000", 2024-04-19T04:26:36.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.405989+0000", 2024-04-19T04:26:36.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:36.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.405993+0000", 2024-04-19T04:26:36.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5540000000000002e-06 2024-04-19T04:26:36.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.406008+0000", 2024-04-19T04:26:36.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5517999999999999e-05 2024-04-19T04:26:36.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.406033+0000", 2024-04-19T04:26:36.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4683000000000001e-05 2024-04-19T04:26:36.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.406085+0000", 2024-04-19T04:26:36.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1557000000000001e-05 2024-04-19T04:26:36.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.406217+0000", 2024-04-19T04:26:36.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000132006 2024-04-19T04:26:36.421 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.421 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.421 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.421 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:247975 5.8 5:1fed8cab:::benchmark_data_smithi007_19526_object122241:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:36.422 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:36.406045+0000", 2024-04-19T04:26:36.422 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0081669189999999999, 2024-04-19T04:26:36.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083613390000000006, 2024-04-19T04:26:36.422 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.422 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:36.422 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.422 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.422 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.422 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 247975 2024-04-19T04:26:36.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.422 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.406045+0000", 2024-04-19T04:26:36.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.406045+0000", 2024-04-19T04:26:36.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.406044+0000", 2024-04-19T04:26:36.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:36.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.406048+0000", 2024-04-19T04:26:36.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2950000000000004e-06 2024-04-19T04:26:36.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.406057+0000", 2024-04-19T04:26:36.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.054e-06 2024-04-19T04:26:36.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.406065+0000", 2024-04-19T04:26:36.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8599999999999993e-06 2024-04-19T04:26:36.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.408709+0000", 2024-04-19T04:26:36.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026435149999999999 2024-04-19T04:26:36.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.408804+0000", 2024-04-19T04:26:36.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4765999999999994e-05 2024-04-19T04:26:36.425 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.425 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.425 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.426 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:247980 5.0 5:0e5a1b29:::benchmark_data_smithi007_19526_object122246:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:36.426 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:36.409528+0000", 2024-04-19T04:26:36.426 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0046837700000000003, 2024-04-19T04:26:36.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049287979999999999, 2024-04-19T04:26:36.426 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.426 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:36.426 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.426 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.426 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.426 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 247980 2024-04-19T04:26:36.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.427 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.409528+0000", 2024-04-19T04:26:36.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.409528+0000", 2024-04-19T04:26:36.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.409527+0000", 2024-04-19T04:26:36.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.409533+0000", 2024-04-19T04:26:36.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.285e-06 2024-04-19T04:26:36.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.409542+0000", 2024-04-19T04:26:36.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1499999999999999e-06 2024-04-19T04:26:36.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.409548+0000", 2024-04-19T04:26:36.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7070000000000003e-06 2024-04-19T04:26:36.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.409600+0000", 2024-04-19T04:26:36.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1816e-05 2024-04-19T04:26:36.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.409783+0000", 2024-04-19T04:26:36.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018264600000000001 2024-04-19T04:26:36.429 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.429 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.429 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.429 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:247987 5.0 5:0f752319:::benchmark_data_smithi007_19526_object122253:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:36.430 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:36.412737+0000", 2024-04-19T04:26:36.430 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0014746869999999999, 2024-04-19T04:26:36.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001771068, 2024-04-19T04:26:36.430 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.430 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:36.430 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.430 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.430 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.430 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 247987 2024-04-19T04:26:36.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.430 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.412737+0000", 2024-04-19T04:26:36.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.412737+0000", 2024-04-19T04:26:36.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.412736+0000", 2024-04-19T04:26:36.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.412743+0000", 2024-04-19T04:26:36.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2919999999999998e-06 2024-04-19T04:26:36.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.412754+0000", 2024-04-19T04:26:36.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0421999999999999e-05 2024-04-19T04:26:36.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.412760+0000", 2024-04-19T04:26:36.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5010000000000001e-06 2024-04-19T04:26:36.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.412810+0000", 2024-04-19T04:26:36.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9767e-05 2024-04-19T04:26:36.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.412904+0000", 2024-04-19T04:26:36.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4351000000000005e-05 2024-04-19T04:26:36.433 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.433 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.433 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.434 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:247991 5.e 5:74b61969:::benchmark_data_smithi007_19526_object122257:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:36.434 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:36.412771+0000", 2024-04-19T04:26:36.434 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001440825, 2024-04-19T04:26:36.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001786789, 2024-04-19T04:26:36.434 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.434 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-19T04:26:36.434 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.434 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.434 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.434 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 247991 2024-04-19T04:26:36.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.434 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.412771+0000", 2024-04-19T04:26:36.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.412771+0000", 2024-04-19T04:26:36.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.412770+0000", 2024-04-19T04:26:36.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:36.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.412775+0000", 2024-04-19T04:26:36.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2549999999999999e-06 2024-04-19T04:26:36.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.412781+0000", 2024-04-19T04:26:36.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8469999999999998e-06 2024-04-19T04:26:36.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.412786+0000", 2024-04-19T04:26:36.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.977e-06 2024-04-19T04:26:36.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.412859+0000", 2024-04-19T04:26:36.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2479999999999997e-05 2024-04-19T04:26:36.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:36.412948+0000", 2024-04-19T04:26:36.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8722999999999997e-05 2024-04-19T04:26:36.437 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.437 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.437 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.437 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.437 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-19T04:26:36.438 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 6 2024-04-19T04:26:36.438 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:36.439 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:36.494 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:36.492+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:36.594 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:36.592+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:36.601 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:36.602 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:36.602 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:36.602 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:36.602 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:36.614 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:36.695 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:36.692+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:36.747 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 80.793063787999998, 2024-04-19T04:26:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 80.788002141999996, 2024-04-19T04:26:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 80.78790223, 2024-04-19T04:26:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 80.787776476999994, 2024-04-19T04:26:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 80.783932531999994, 2024-04-19T04:26:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 80.776761430999997, 2024-04-19T04:26:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 80.776589326999996, 2024-04-19T04:26:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 80.776526201999999, 2024-04-19T04:26:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.794 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.794 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:36.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 80.776397605, 2024-04-19T04:26:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 80.776329634000007, 2024-04-19T04:26:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.856789969000001, 2024-04-19T04:26:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078453623, 2024-04-19T04:26:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965893+0000", 2024-04-19T04:26:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.076646455000000002 2024-04-19T04:26:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965956+0000", 2024-04-19T04:26:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3200000000000005e-05 2024-04-19T04:26:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966068+0000", 2024-04-19T04:26:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011194800000000001 2024-04-19T04:26:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.856758972000002, 2024-04-19T04:26:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083782388999999999, 2024-04-19T04:26:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971179+0000", 2024-04-19T04:26:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079349476000000002 2024-04-19T04:26:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971259+0000", 2024-04-19T04:26:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9083000000000002e-05 2024-04-19T04:26:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971428+0000", 2024-04-19T04:26:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169419 2024-04-19T04:26:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.854437451999999, 2024-04-19T04:26:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081686998999999996, 2024-04-19T04:26:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:36.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:36.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:36.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:36.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:36.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:36.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:36.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971454+0000", 2024-04-19T04:26:36.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077525997999999999 2024-04-19T04:26:36.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:36.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971540+0000", 2024-04-19T04:26:36.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6285000000000005e-05 2024-04-19T04:26:36.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971654+0000", 2024-04-19T04:26:36.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114095 2024-04-19T04:26:36.825 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.825 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.825 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.825 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:36.825 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:36.825 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.853227069999999, 2024-04-19T04:26:36.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080734265999999999, 2024-04-19T04:26:36.825 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.826 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.826 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.826 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.826 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.826 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:36.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.826 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:36.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.827 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.827 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:36.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.827 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.827 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:36.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.827 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.827 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:36.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:36.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:36.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:36.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:36.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:36.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:36.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:36.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:36.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:36.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:36.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971677+0000", 2024-04-19T04:26:36.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.073192023999999994 2024-04-19T04:26:36.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:36.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971771+0000", 2024-04-19T04:26:36.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4235999999999997e-05 2024-04-19T04:26:36.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971912+0000", 2024-04-19T04:26:36.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014055099999999999 2024-04-19T04:26:36.830 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.830 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.830 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.830 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:36.830 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:36.831 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.852275579000001, 2024-04-19T04:26:36.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085645857000000006, 2024-04-19T04:26:36.831 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.831 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.831 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.831 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.831 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.831 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:36.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.831 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.831 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:36.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:36.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:36.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:36.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:36.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:36.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:36.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:36.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:36.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:36.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:36.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:36.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:36.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:36.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977634+0000", 2024-04-19T04:26:36.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077144335999999994 2024-04-19T04:26:36.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.835 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:36.835 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977699+0000", 2024-04-19T04:26:36.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4518999999999997e-05 2024-04-19T04:26:36.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.835 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.835 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977775+0000", 2024-04-19T04:26:36.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6219999999999999e-05 2024-04-19T04:26:36.835 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.835 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.836 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.836 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.836 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:36.836 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:36.836 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.849268000999999, 2024-04-19T04:26:36.836 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075403611999999995, 2024-04-19T04:26:36.836 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.836 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.836 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.836 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.837 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.837 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:36.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.837 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:36.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:36.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:36.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:36.839 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:36.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.839 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.839 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.839 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:36.839 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:36.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.839 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.839 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.839 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:36.839 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:36.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.840 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.840 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.840 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:36.840 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:36.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.840 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.840 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.840 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:36.840 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:36.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.840 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.841 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:36.841 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970369+0000", 2024-04-19T04:26:36.841 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.074967992999999997 2024-04-19T04:26:36.841 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.841 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.841 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:36.841 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970419+0000", 2024-04-19T04:26:36.841 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9700999999999997e-05 2024-04-19T04:26:36.841 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.841 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.841 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.841 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970540+0000", 2024-04-19T04:26:36.841 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121512 2024-04-19T04:26:36.842 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.842 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.842 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.842 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.842 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5:78f758ec:::benchmark_data_smithi007_19526_object48602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:36.842 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:36.842 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.848893876999998, 2024-04-19T04:26:36.842 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085171609999999995, 2024-04-19T04:26:36.842 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.842 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.842 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.843 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.843 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.843 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:36.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.843 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.843 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:36.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.843 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:36.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:36.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:36.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:36.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:36.845 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:36.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.845 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:36.845 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:36.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.845 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966154+0000", 2024-04-19T04:26:36.845 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.070613543000000001 2024-04-19T04:26:36.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966382+0000", 2024-04-19T04:26:36.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022741800000000001 2024-04-19T04:26:36.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.846 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.846 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:36.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980581+0000", 2024-04-19T04:26:36.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014199916999999999 2024-04-19T04:26:36.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.846 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.846 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:36.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980621+0000", 2024-04-19T04:26:36.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9685999999999999e-05 2024-04-19T04:26:36.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.847 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.847 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.847 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980682+0000", 2024-04-19T04:26:36.847 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1130000000000006e-05 2024-04-19T04:26:36.847 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.847 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.847 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.847 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.847 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:36.847 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:36.847 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.848803924999999, 2024-04-19T04:26:36.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075073230000000005, 2024-04-19T04:26:36.848 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.848 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.848 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.848 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.848 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.848 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:36.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.848 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:36.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:36.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:36.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.850 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:36.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:36.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.850 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:36.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:36.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:36.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:36.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:36.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:36.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.852 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:36.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:36.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:36.852 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970556+0000", 2024-04-19T04:26:36.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.072076192999999997 2024-04-19T04:26:36.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:36.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970608+0000", 2024-04-19T04:26:36.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2549000000000001e-05 2024-04-19T04:26:36.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970674+0000", 2024-04-19T04:26:36.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5549000000000005e-05 2024-04-19T04:26:36.853 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.853 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.853 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.854 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5:70a7bb5e:::benchmark_data_smithi007_19526_object48614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:36.854 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:36.854 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.843716927999999, 2024-04-19T04:26:36.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080099220999999998, 2024-04-19T04:26:36.854 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.854 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.854 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.854 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.854 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.854 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:36.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.855 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:36.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:36.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:36.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:36.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:36.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:36.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:36.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:36.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:36.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:36.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971978+0000", 2024-04-19T04:26:36.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.071282358000000004 2024-04-19T04:26:36.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.972180+0000", 2024-04-19T04:26:36.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020191100000000001 2024-04-19T04:26:36.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:36.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980701+0000", 2024-04-19T04:26:36.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085211760000000001 2024-04-19T04:26:36.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:36.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980729+0000", 2024-04-19T04:26:36.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8068e-05 2024-04-19T04:26:36.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980787+0000", 2024-04-19T04:26:36.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7521e-05 2024-04-19T04:26:36.859 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.859 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.859 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.859 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174350 5.e 5:7f36609a:::benchmark_data_smithi007_19526_object48616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:36.859 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:36.859 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.841945855999999, 2024-04-19T04:26:36.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079723622999999993, 2024-04-19T04:26:36.859 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:36.860 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:36.860 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:36.860 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:36.860 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.860 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174350 2024-04-19T04:26:36.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.860 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:36.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:36.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:36.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:36.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:36.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:36.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:36.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902458+0000", 2024-04-19T04:26:36.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:36.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:36.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902463+0000", 2024-04-19T04:26:36.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5889999999999996e-06 2024-04-19T04:26:36.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:36.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965576+0000", 2024-04-19T04:26:36.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063113328999999996 2024-04-19T04:26:36.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:36.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965614+0000", 2024-04-19T04:26:36.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8285999999999999e-05 2024-04-19T04:26:36.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:36.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974787+0000", 2024-04-19T04:26:36.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009172599 2024-04-19T04:26:36.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:36.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974999+0000", 2024-04-19T04:26:36.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021270999999999999 2024-04-19T04:26:36.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:36.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982086+0000", 2024-04-19T04:26:36.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070869160000000004 2024-04-19T04:26:36.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:36.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982115+0000", 2024-04-19T04:26:36.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8603999999999999e-05 2024-04-19T04:26:36.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:36.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:36.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:36.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982182+0000", 2024-04-19T04:26:36.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7350999999999999e-05 2024-04-19T04:26:36.864 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.864 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.864 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.864 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:36.864 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:36.865 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:36.866 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:36.864+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:36.866 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:36.867 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:26:36.966 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:36.964+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:36.997 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:36.997 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:36.997 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.997 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:249332 5.1 5:884ed51b:::benchmark_data_smithi007_19526_object123598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:36.998 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:36.994009+0000", 2024-04-19T04:26:36.998 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0033676510000000002, 2024-04-19T04:26:36.998 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0033890679999999999, 2024-04-19T04:26:36.998 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:36.998 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:36.998 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:36.998 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:36.998 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:36.998 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 249332 2024-04-19T04:26:36.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.998 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:36.998 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.999 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:36.999 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994009+0000", 2024-04-19T04:26:36.999 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.999 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:36.999 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994009+0000", 2024-04-19T04:26:36.999 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:36.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:36.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:36.999 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:37.000 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994008+0000", 2024-04-19T04:26:37.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:37.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.000 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:37.000 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994012+0000", 2024-04-19T04:26:37.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.9580000000000001e-06 2024-04-19T04:26:37.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.000 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.000 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:37.000 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994023+0000", 2024-04-19T04:26:37.000 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0715e-05 2024-04-19T04:26:37.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:37.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994028+0000", 2024-04-19T04:26:37.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0130000000000001e-06 2024-04-19T04:26:37.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.001 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:37.001 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994062+0000", 2024-04-19T04:26:37.001 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.3924999999999998e-05 2024-04-19T04:26:37.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.001 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.002 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:37.002 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994152+0000", 2024-04-19T04:26:37.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0593000000000005e-05 2024-04-19T04:26:37.002 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.002 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:37.002 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.002 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.002 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:249333 5.2 5:419be2cd:::benchmark_data_smithi007_19526_object123599:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:37.002 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:36.994045+0000", 2024-04-19T04:26:37.002 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0033317310000000001, 2024-04-19T04:26:37.002 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0034269209999999999, 2024-04-19T04:26:37.003 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:37.003 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:37.003 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:37.003 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:37.003 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:37.003 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 249333 2024-04-19T04:26:37.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.003 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:37.003 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.003 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:37.003 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994045+0000", 2024-04-19T04:26:37.003 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.004 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:37.004 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994045+0000", 2024-04-19T04:26:37.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.004 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.004 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:37.004 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994044+0000", 2024-04-19T04:26:37.004 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:37.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:37.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994048+0000", 2024-04-19T04:26:37.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.8510000000000001e-06 2024-04-19T04:26:37.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:37.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994055+0000", 2024-04-19T04:26:37.005 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.0369999999999997e-06 2024-04-19T04:26:37.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.005 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:37.005 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994060+0000", 2024-04-19T04:26:37.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.237e-06 2024-04-19T04:26:37.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:37.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994107+0000", 2024-04-19T04:26:37.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6764000000000002e-05 2024-04-19T04:26:37.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.006 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:37.006 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994246+0000", 2024-04-19T04:26:37.006 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013917000000000001 2024-04-19T04:26:37.006 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.006 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:37.007 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.007 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:249334 5.5 5:aeefcfd7:::benchmark_data_smithi007_19526_object123600:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:37.007 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:36.994940+0000", 2024-04-19T04:26:37.007 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.002436372, 2024-04-19T04:26:37.007 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002612933, 2024-04-19T04:26:37.007 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:37.007 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:37.007 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:37.007 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:37.007 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:37.007 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 249334 2024-04-19T04:26:37.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.008 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:37.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:37.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994940+0000", 2024-04-19T04:26:37.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:37.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994940+0000", 2024-04-19T04:26:37.008 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.008 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.008 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:37.008 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994939+0000", 2024-04-19T04:26:37.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:37.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:37.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994945+0000", 2024-04-19T04:26:37.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0759999999999999e-06 2024-04-19T04:26:37.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:37.009 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994961+0000", 2024-04-19T04:26:37.009 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5599000000000001e-05 2024-04-19T04:26:37.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.009 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.009 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:37.010 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.994969+0000", 2024-04-19T04:26:37.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5459999999999992e-06 2024-04-19T04:26:37.010 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.010 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.010 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:37.010 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.995016+0000", 2024-04-19T04:26:37.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7187000000000001e-05 2024-04-19T04:26:37.010 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.010 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.010 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:37.010 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.995151+0000", 2024-04-19T04:26:37.010 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013498199999999999 2024-04-19T04:26:37.010 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.010 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:37.010 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.011 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.011 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:249336 5.3 5:c334e875:::benchmark_data_smithi007_19526_object123602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:37.011 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:36.995931+0000", 2024-04-19T04:26:37.011 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.001445565, 2024-04-19T04:26:37.011 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001684039, 2024-04-19T04:26:37.011 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:37.011 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:37.011 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:37.011 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:37.011 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:37.011 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 249336 2024-04-19T04:26:37.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.011 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:37.011 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.012 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:37.012 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.995931+0000", 2024-04-19T04:26:37.012 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.012 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.012 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.012 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:37.012 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.995931+0000", 2024-04-19T04:26:37.012 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.012 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.012 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.012 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:37.012 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.995930+0000", 2024-04-19T04:26:37.012 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:37.012 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.012 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.012 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:37.013 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.995936+0000", 2024-04-19T04:26:37.013 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.66e-06 2024-04-19T04:26:37.013 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.013 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.013 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:37.013 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.995950+0000", 2024-04-19T04:26:37.013 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4306e-05 2024-04-19T04:26:37.013 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.013 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.013 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:37.013 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.995958+0000", 2024-04-19T04:26:37.013 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1329999999999999e-06 2024-04-19T04:26:37.013 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.013 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.013 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:37.014 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.996002+0000", 2024-04-19T04:26:37.014 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4397000000000002e-05 2024-04-19T04:26:37.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.014 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:37.014 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.996097+0000", 2024-04-19T04:26:37.014 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.4086999999999996e-05 2024-04-19T04:26:37.014 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.014 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:37.014 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.014 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:249337 5.7 5:e01b1a09:::benchmark_data_smithi007_19526_object123603:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:37.015 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:36.996456+0000", 2024-04-19T04:26:37.015 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00091993499999999998, 2024-04-19T04:26:37.015 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0012399819999999999, 2024-04-19T04:26:37.015 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:37.015 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:37.015 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:37.015 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:37.015 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:37.015 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 249337 2024-04-19T04:26:37.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.015 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:37.015 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.015 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:37.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.996456+0000", 2024-04-19T04:26:37.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:37.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.996456+0000", 2024-04-19T04:26:37.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.016 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:37.016 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.996456+0000", 2024-04-19T04:26:37.016 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:37.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.016 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.017 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:37.017 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.996461+0000", 2024-04-19T04:26:37.017 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.7030000000000003e-06 2024-04-19T04:26:37.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.017 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.017 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:37.017 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.996476+0000", 2024-04-19T04:26:37.017 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5132e-05 2024-04-19T04:26:37.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.017 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.017 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:37.017 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.996487+0000", 2024-04-19T04:26:37.017 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0234000000000001e-05 2024-04-19T04:26:37.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.018 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.018 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:37.018 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.996538+0000", 2024-04-19T04:26:37.018 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0855e-05 2024-04-19T04:26:37.018 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.018 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.018 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:37.018 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997335+0000", 2024-04-19T04:26:37.018 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00079742699999999997 2024-04-19T04:26:37.018 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.018 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:37.018 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.019 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.019 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:249339 5.d 5:b16b0104:::benchmark_data_smithi007_19526_object123605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:37.019 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:36.997016+0000", 2024-04-19T04:26:37.019 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.00036006900000000002, 2024-04-19T04:26:37.019 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00074690900000000003, 2024-04-19T04:26:37.019 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:37.019 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:37.019 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:37.019 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:37.019 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:37.019 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 249339 2024-04-19T04:26:37.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.020 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:37.020 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.020 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:37.020 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997016+0000", 2024-04-19T04:26:37.020 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.020 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.020 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:37.020 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997016+0000", 2024-04-19T04:26:37.020 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.020 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.020 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:37.020 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997015+0000", 2024-04-19T04:26:37.021 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:37.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.021 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:37.021 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997021+0000", 2024-04-19T04:26:37.021 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1970000000000004e-06 2024-04-19T04:26:37.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.021 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:37.021 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997035+0000", 2024-04-19T04:26:37.021 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4102e-05 2024-04-19T04:26:37.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.021 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.021 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:37.022 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997042+0000", 2024-04-19T04:26:37.022 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:37.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.022 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:37.022 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997087+0000", 2024-04-19T04:26:37.022 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5661999999999998e-05 2024-04-19T04:26:37.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.022 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:37.022 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997282+0000", 2024-04-19T04:26:37.022 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000194737 2024-04-19T04:26:37.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.022 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:37.023 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997396+0000", 2024-04-19T04:26:37.023 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113727 2024-04-19T04:26:37.023 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.023 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:37.023 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.023 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.023 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.023 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:249342 5.3 5.25ec6ca3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:37.023 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:36.997534+0000", 2024-04-19T04:26:37.023 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9998426, 2024-04-19T04:26:37.023 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00029579699999999999, 2024-04-19T04:26:37.023 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:37.023 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:37.023 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:37.023 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:37.023 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:37.024 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 249342 2024-04-19T04:26:37.024 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.024 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:37.024 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.024 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:37.024 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997534+0000", 2024-04-19T04:26:37.024 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.024 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.024 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.024 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:37.024 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997534+0000", 2024-04-19T04:26:37.024 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.024 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:37.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997533+0000", 2024-04-19T04:26:37.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:37.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:37.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997538+0000", 2024-04-19T04:26:37.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0969999999999996e-06 2024-04-19T04:26:37.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.025 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.025 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:37.025 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997548+0000", 2024-04-19T04:26:37.025 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5670000000000001e-06 2024-04-19T04:26:37.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.026 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.026 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:37.026 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997554+0000", 2024-04-19T04:26:37.026 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6769999999999998e-06 2024-04-19T04:26:37.026 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.026 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:37.026 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.026 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.026 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:249344 5.3 5.3c59dc83 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:37.026 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:36.997700+0000", 2024-04-19T04:26:37.026 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9996767, 2024-04-19T04:26:37.026 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189452, 2024-04-19T04:26:37.027 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:37.027 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "queued for pg", 2024-04-19T04:26:37.027 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:37.027 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:37.027 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:37.027 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 249344 2024-04-19T04:26:37.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.027 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:37.027 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.027 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:37.027 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997700+0000", 2024-04-19T04:26:37.027 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.027 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.027 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:37.027 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997700+0000", 2024-04-19T04:26:37.028 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.028 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.028 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.028 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:37.028 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997699+0000", 2024-04-19T04:26:37.028 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:37.028 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.028 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.028 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:37.028 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997703+0000", 2024-04-19T04:26:37.028 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.2220000000000004e-06 2024-04-19T04:26:37.028 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.028 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.028 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:37.028 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997716+0000", 2024-04-19T04:26:37.029 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3281999999999999e-05 2024-04-19T04:26:37.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.029 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.029 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:37.029 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997723+0000", 2024-04-19T04:26:37.029 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4280000000000001e-06 2024-04-19T04:26:37.029 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.029 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:37.029 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.029 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.029 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:249345 5.c 5:3b79bded:::benchmark_data_smithi007_19526_object123611:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:37.029 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:36.997739+0000", 2024-04-19T04:26:37.029 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9996381, 2024-04-19T04:26:37.029 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00021696000000000001, 2024-04-19T04:26:37.030 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:37.030 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:37.030 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:37.030 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:37.030 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:37.030 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 249345 2024-04-19T04:26:37.030 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.030 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:37.030 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.030 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:37.030 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997739+0000", 2024-04-19T04:26:37.030 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.030 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.031 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.031 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:37.031 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997739+0000", 2024-04-19T04:26:37.031 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.031 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.031 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:37.031 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997738+0000", 2024-04-19T04:26:37.031 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:37.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.031 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.031 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:37.032 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997741+0000", 2024-04-19T04:26:37.032 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2380000000000002e-06 2024-04-19T04:26:37.032 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.032 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.032 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:37.032 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997755+0000", 2024-04-19T04:26:37.032 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3963e-05 2024-04-19T04:26:37.032 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.032 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.032 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:37.032 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997761+0000", 2024-04-19T04:26:37.032 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2850000000000002e-06 2024-04-19T04:26:37.032 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.032 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.033 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:37.033 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997807+0000", 2024-04-19T04:26:37.033 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5967000000000002e-05 2024-04-19T04:26:37.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.033 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.033 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:37.033 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997912+0000", 2024-04-19T04:26:37.033 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010586699999999999 2024-04-19T04:26:37.033 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.033 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:37.033 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.033 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.034 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:249346 5.6 5:6cf5e802:::benchmark_data_smithi007_19526_object123612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:37.034 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:36.997929+0000", 2024-04-19T04:26:37.034 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 4294967295.9994469, 2024-04-19T04:26:37.034 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.7326999999999999e-05, 2024-04-19T04:26:37.034 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:37.034 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:37.034 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:37.034 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:37.034 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:37.034 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 249346 2024-04-19T04:26:37.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.035 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:37.035 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.035 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:37.035 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997929+0000", 2024-04-19T04:26:37.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.035 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.035 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:37.035 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997929+0000", 2024-04-19T04:26:37.035 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.035 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.036 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:37.036 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997929+0000", 2024-04-19T04:26:37.036 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:37.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.036 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.036 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:37.036 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997933+0000", 2024-04-19T04:26:37.036 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3470000000000001e-06 2024-04-19T04:26:37.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.036 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.036 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:37.036 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997943+0000", 2024-04-19T04:26:37.036 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7450000000000007e-06 2024-04-19T04:26:37.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.037 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.037 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:37.037 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997949+0000", 2024-04-19T04:26:37.037 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0719999999999996e-06 2024-04-19T04:26:37.037 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.037 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.037 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:37.037 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.997992+0000", 2024-04-19T04:26:37.037 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3146000000000003e-05 2024-04-19T04:26:37.037 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.037 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:37.037 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.037 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.038 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.038 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:249325 5.d 5:b815784b:::benchmark_data_smithi007_19526_object123591:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:37.038 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:36.991040+0000", 2024-04-19T04:26:37.038 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0063367400000000004, 2024-04-19T04:26:37.038 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0070330569999999997, 2024-04-19T04:26:37.038 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:37.038 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "waiting for sub ops", 2024-04-19T04:26:37.038 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:37.038 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:37.038 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:37.038 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 249325 2024-04-19T04:26:37.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.039 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:37.039 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.039 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:37.039 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.991040+0000", 2024-04-19T04:26:37.039 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.039 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.039 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:37.039 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.991040+0000", 2024-04-19T04:26:37.039 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.040 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.040 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:37.040 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.991039+0000", 2024-04-19T04:26:37.040 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:37.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.040 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.040 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:37.040 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.991044+0000", 2024-04-19T04:26:37.040 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5670000000000002e-06 2024-04-19T04:26:37.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.040 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.040 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:37.040 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.991055+0000", 2024-04-19T04:26:37.041 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1106e-05 2024-04-19T04:26:37.041 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.041 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:37.041 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.991068+0000", 2024-04-19T04:26:37.041 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2707e-05 2024-04-19T04:26:37.041 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.041 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:37.041 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.991125+0000", 2024-04-19T04:26:37.041 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6548000000000001e-05 2024-04-19T04:26:37.041 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.041 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.042 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:37.042 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.991295+0000", 2024-04-19T04:26:37.042 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000170027 2024-04-19T04:26:37.042 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.042 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.042 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:37.042 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.991424+0000", 2024-04-19T04:26:37.042 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000129527 2024-04-19T04:26:37.042 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.042 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.042 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:37.042 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.996740+0000", 2024-04-19T04:26:37.042 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0053158909999999997 2024-04-19T04:26:37.042 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.043 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:37.043 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.043 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.043 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:249329 5.7 5:ee24b5e9:::benchmark_data_smithi007_19526_object123595:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T04:26:37.043 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:36.992216+0000", 2024-04-19T04:26:37.043 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0051603329999999996, 2024-04-19T04:26:37.043 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0059273779999999996, 2024-04-19T04:26:37.043 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:37.043 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "started", 2024-04-19T04:26:37.043 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:37.043 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:37.043 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:37.043 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 249329 2024-04-19T04:26:37.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.044 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:37.044 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.044 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:37.044 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.992216+0000", 2024-04-19T04:26:37.044 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.044 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.044 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:37.044 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.992216+0000", 2024-04-19T04:26:37.044 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:37.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.044 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.044 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:37.045 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.992216+0000", 2024-04-19T04:26:37.045 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:37.045 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.045 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.045 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:37.045 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.992218+0000", 2024-04-19T04:26:37.045 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.582e-06 2024-04-19T04:26:37.045 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.045 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.045 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:37.045 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.992224+0000", 2024-04-19T04:26:37.045 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4890000000000003e-06 2024-04-19T04:26:37.045 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.046 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.046 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:37.046 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.992227+0000", 2024-04-19T04:26:37.046 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4290000000000001e-06 2024-04-19T04:26:37.046 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.046 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.046 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:37.046 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.992267+0000", 2024-04-19T04:26:37.046 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0268999999999997e-05 2024-04-19T04:26:37.046 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:37.046 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:37.046 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:37.047 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:36.992433+0000", 2024-04-19T04:26:37.047 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000165193 2024-04-19T04:26:37.047 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.047 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:37.047 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.047 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:37.047 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-04-19T04:26:37.047 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 12 2024-04-19T04:26:37.047 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:37.048 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:37.048 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:37.049 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:37.050 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:37.050 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:37.050 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:37.050 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:37.051 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:37.067 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:37.064+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:37.168 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:37.168+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:37.184 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:37.184 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:37.196 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:37.269 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:37.268+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:37.326 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:37.326 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:37.340 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:37.385 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:37.384+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-04-19T04:26:37.468 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:37.468 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:37.471 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:37.468+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:37.480 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:37.572 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:37.568+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:37.603 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:37.603 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:37.615 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:37.673 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:37.672+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:37.736 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:37.736 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:37.749 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:37.792 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:37.792+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:37.875 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:37.872+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:37.889 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:37.889 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:37.902 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:37.941 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Removed 125731 objects 2024-04-19T04:26:37.942 INFO:tasks.radosbench.radosbench.0.smithi007.stdout:Clean up completed and total clean up time :53.1794 2024-04-19T04:26:37.976 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:37.972+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:38.002 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:38.002 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:38.011 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:38.077 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:38.072+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:38.120 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:38.121 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:38.130 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:38.178 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:38.176+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:38.245 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:38.245 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:38.256 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:38.278 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:38.276+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:38.363 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:38.363 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:38.373 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:38.379 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:38.376+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:38.479 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:38.479 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:38.479 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:38.476+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:38.488 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:38.580 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:38.580+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:38.607 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:38.608 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:38.618 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:38.681 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:38.680+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:38.729 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:38.729 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:38.739 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:38.783 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:38.780+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:38.851 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:38.851 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:38.861 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:38.883 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:38.880+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:38.976 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:38.977 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:38.984 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:38.980+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:38.988 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:39.026 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~82s 2024-04-19T04:26:39.052 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:26:39.085 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:39.080+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:39.090 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:39.090 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:39.099 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:39.185 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:39.180+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:39.208 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:39.208 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:39.208 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:39.218 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:39.234 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:39.234 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:39.234 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:39.234 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:39.238 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:39.242 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:39.287 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:39.284+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:39.332 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:39.332 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:39.332 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 0 2024-04-19T04:26:39.333 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:39.342 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:39.387 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:39.384+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:39.409 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T04:26:39.448 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:39.448 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:39.448 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:39.448 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:39.448 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:39.458 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:39.488 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:39.488+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:39.570 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:39.570 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:39.570 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:39.570 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:39.570 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.570 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:39.570 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:39.570 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 105.335736439, 2024-04-19T04:26:39.570 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:39.571 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.571 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:39.571 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.571 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.571 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.571 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:39.571 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.571 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.571 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.571 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.571 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:39.571 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.571 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.571 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.572 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.572 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:39.572 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.572 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.572 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.572 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.572 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:39.572 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:39.572 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.572 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.572 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.572 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:39.572 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:39.572 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.573 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.573 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.573 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:39.573 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:39.573 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.573 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.573 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.573 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:39.573 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:39.573 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.573 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.573 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.573 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:39.573 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:39.574 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.574 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.574 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:39.574 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:39.574 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:39.574 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.574 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.574 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:39.574 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:39.574 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:39.574 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.574 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.574 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:39.574 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:39.575 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:39.575 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.575 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.575 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:39.575 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:39.575 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:39.575 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.575 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.575 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:39.575 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:39.575 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:39.575 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.575 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.575 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.576 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:39.576 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:39.576 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.576 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.576 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.576 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.576 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.576 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:39.576 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:39.576 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 105.331641518, 2024-04-19T04:26:39.576 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:39.576 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.576 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:39.576 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.577 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.577 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.577 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:39.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.577 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.577 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.577 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.577 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:39.577 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.577 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.577 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.577 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:39.577 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.578 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.578 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.578 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:39.578 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:39.578 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.578 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.578 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.578 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:39.578 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:39.578 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.578 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.578 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.578 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:39.578 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:39.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.579 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.579 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:39.579 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:39.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.579 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.579 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:39.579 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:39.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.579 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:39.579 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:39.580 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:39.580 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.580 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.580 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:39.580 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:39.580 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:39.580 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.580 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.580 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:39.580 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:39.580 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:39.580 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.580 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.580 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:39.580 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:39.581 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:39.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.581 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.581 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:39.581 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:39.581 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:39.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.581 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.581 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.581 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:39.581 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:39.581 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.581 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.581 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.582 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.582 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.582 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:39.582 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:39.582 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 105.328350333, 2024-04-19T04:26:39.582 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:39.582 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.582 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:39.582 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.582 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.582 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.582 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:39.582 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.582 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.583 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.583 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.583 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:39.583 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.583 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.583 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.583 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:39.583 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.583 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.583 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.583 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:39.583 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:39.584 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.584 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.584 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.584 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:39.584 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:39.584 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.584 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.584 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.584 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:39.584 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:39.584 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.584 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.584 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.584 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:39.585 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:39.585 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.585 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.585 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.585 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:39.585 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:39.585 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.585 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.585 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:39.585 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:39.585 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:39.585 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.585 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.585 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:39.586 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:39.586 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:39.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.586 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:39.586 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:39.586 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:39.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.586 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:39.586 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:39.586 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:39.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.587 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:39.587 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:39.587 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:39.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.587 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.587 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.587 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:39.587 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:39.587 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.587 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.587 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.587 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.587 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:39.588 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:39.588 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 83.610960868000006, 2024-04-19T04:26:39.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:39.588 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.588 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:39.588 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.588 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.588 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.588 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:39.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.588 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:39.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.589 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.589 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:39.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.589 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.589 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:39.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:39.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.589 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.590 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:39.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:39.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.590 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.590 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.590 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:39.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:39.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.590 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.590 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.590 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:39.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:39.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.590 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.591 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:39.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:39.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:39.591 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:39.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:39.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:39.591 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:39.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:39.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:39.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:39.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:39.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:39.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:39.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:39.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:39.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:39.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.593 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:39.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:39.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.593 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:39.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:39.593 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.593 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.593 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.594 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:39.594 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:39.594 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 83.590730418999996, 2024-04-19T04:26:39.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:39.594 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.594 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:39.594 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.594 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.594 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.594 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:39.594 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.594 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.594 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.595 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.595 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:39.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.595 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.595 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:39.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.595 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.595 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:39.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:39.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:39.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:39.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:39.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:39.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:39.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:39.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:39.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:39.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:39.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:39.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:39.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:39.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:39.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:39.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:39.598 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.598 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.598 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.598 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:39.598 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:39.598 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 83.590622561999993, 2024-04-19T04:26:39.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:39.599 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.599 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:39.599 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.599 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.599 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.599 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:39.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.599 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.599 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.599 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:39.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:39.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:39.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:39.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:39.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:39.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:39.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:39.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:39.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:39.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:39.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:39.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:39.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:39.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:39.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:39.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:39.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:39.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:39.603 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.603 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.603 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.603 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:39.603 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:39.603 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 83.588655872999993, 2024-04-19T04:26:39.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:39.603 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.603 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:39.603 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.603 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.603 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.604 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:39.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.604 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:39.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:39.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:39.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:39.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:39.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:39.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.605 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:39.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:39.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:39.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:39.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:39.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:39.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:39.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:39.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:39.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:39.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:39.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:39.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:39.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:39.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:39.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:39.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:39.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:39.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:39.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:39.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:39.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:39.608 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.609 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.609 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.609 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:39.609 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:39.609 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 83.585291678000004, 2024-04-19T04:26:39.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:39.609 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.609 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:39.609 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.609 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.609 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.609 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:39.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.610 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:39.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:39.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:39.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:39.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:39.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:39.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:39.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:39.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.612 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.612 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:39.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:39.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.612 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.612 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:39.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:39.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.612 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:39.612 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:39.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:39.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:39.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:39.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:39.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:39.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:39.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:39.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:39.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:39.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:39.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:39.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:39.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:39.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:39.614 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.614 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.614 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.615 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:39.615 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:39.615 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 83.5814807, 2024-04-19T04:26:39.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:39.615 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.615 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:39.615 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.615 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.615 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.615 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:39.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.615 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.616 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:39.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.616 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:39.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.616 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:39.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:39.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:39.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:39.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:39.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:39.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:39.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:39.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:39.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:39.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:39.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:39.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:39.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:39.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:39.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:39.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:39.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:39.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:39.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:39.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:39.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:39.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:39.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:39.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:39.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:39.620 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.620 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.620 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.620 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:39.621 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:39.621 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 70.339618342999998, 2024-04-19T04:26:39.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:39.621 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.621 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:39.621 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.621 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.621 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.621 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:39.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.621 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:39.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:39.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:39.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:39.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:39.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:39.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:39.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:39.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:39.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:39.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:39.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:39.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:39.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:39.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:39.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:39.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:39.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:39.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:39.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:39.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:39.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:39.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:39.625 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.625 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.625 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.625 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:39.625 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:39.626 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 70.339024062999997, 2024-04-19T04:26:39.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:39.626 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.626 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:39.626 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.626 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.626 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.626 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:39.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.626 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:39.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:39.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:39.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:39.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.627 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.627 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:39.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:39.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:39.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:39.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:39.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:39.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:39.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:39.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:39.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:39.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:39.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:39.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:39.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:39.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:39.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:39.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:39.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:39.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:39.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:39.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:39.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:39.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:39.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:39.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:39.631 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.631 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.631 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.631 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:39.631 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:39.631 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.614376905, 2024-04-19T04:26:39.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:39.631 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.631 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:39.631 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.632 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.632 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.632 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:39.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.632 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:39.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:39.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:39.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:39.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:39.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:39.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:39.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:39.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:39.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:39.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:39.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:39.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:39.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:39.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:39.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:39.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:39.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:39.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:39.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:39.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:39.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:39.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:39.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:39.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:39.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:39.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:39.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:39.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:39.636 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.637 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.637 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.637 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:39.637 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:39.637 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.614336489000003, 2024-04-19T04:26:39.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:39.637 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.637 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:39.637 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.637 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.637 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.637 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:39.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.638 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:39.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:39.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:39.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:39.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:39.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:39.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:39.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:39.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:39.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:39.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:39.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:39.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:39.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:39.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:39.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:39.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:39.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:39.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:39.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:39.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:39.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:39.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:39.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.643 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:39.643 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:39.643 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.610640179999997, 2024-04-19T04:26:39.643 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:39.643 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.643 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:39.643 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.643 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.643 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.643 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:39.643 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.643 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.643 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.643 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:39.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:39.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:39.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:39.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:39.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:39.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:39.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:39.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:39.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:39.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:39.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:39.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:39.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:39.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:39.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:39.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:39.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:39.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.647 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:39.647 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:39.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:39.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.647 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:39.647 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:39.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:39.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.647 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:39.647 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:39.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:39.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.648 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.648 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.648 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:39.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:39.648 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.648 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.648 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.648 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.648 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:39.648 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:39.648 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.357029705999999, 2024-04-19T04:26:39.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:39.648 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.649 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:39.649 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.649 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.649 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.649 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:39.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.649 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.649 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.649 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:39.649 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.649 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.649 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:39.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:39.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:39.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:39.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:39.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:39.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:39.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:39.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:39.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:39.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:39.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:39.652 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:39.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:39.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:39.652 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:39.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:39.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:39.652 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:39.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:39.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:39.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:39.653 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.653 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.653 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.653 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:39.653 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:39.653 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.354736293999999, 2024-04-19T04:26:39.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:39.653 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.654 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:39.654 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.654 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.654 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.654 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:39.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.654 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.654 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.654 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:39.654 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:39.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:39.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:39.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:39.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:39.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:39.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:39.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:39.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:39.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:39.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:39.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:39.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:39.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:39.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:39.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:39.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:39.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:39.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:39.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:39.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.658 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:39.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:39.658 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.658 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.658 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.658 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:39.658 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:39.658 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.354690478000002, 2024-04-19T04:26:39.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:39.658 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.659 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:39.659 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.659 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.659 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.659 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:39.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.659 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:39.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:39.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:39.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:39.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:39.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:39.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:39.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:39.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:39.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:39.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:39.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:39.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:39.662 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:39.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:39.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.662 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:39.662 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:39.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:39.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.662 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:39.662 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:39.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:39.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:39.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:39.663 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.663 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.663 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.663 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174342 5.9 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:39.663 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:39.663 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.669533778000002, 2024-04-19T04:26:39.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068615152999999998, 2024-04-19T04:26:39.663 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.663 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:39.663 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.664 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.664 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.664 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174342 2024-04-19T04:26:39.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.664 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:39.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.664 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.664 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:39.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897726+0000", 2024-04-19T04:26:39.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:39.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897731+0000", 2024-04-19T04:26:39.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1449999999999999e-06 2024-04-19T04:26:39.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897744+0000", 2024-04-19T04:26:39.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2833000000000001e-05 2024-04-19T04:26:39.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897749+0000", 2024-04-19T04:26:39.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1540000000000001e-06 2024-04-19T04:26:39.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897810+0000", 2024-04-19T04:26:39.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0724999999999999e-05 2024-04-19T04:26:39.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:39.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897920+0000", 2024-04-19T04:26:39.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011024 2024-04-19T04:26:39.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:39.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897993+0000", 2024-04-19T04:26:39.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2335000000000005e-05 2024-04-19T04:26:39.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:39.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.899597+0000", 2024-04-19T04:26:39.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016048919999999999 2024-04-19T04:26:39.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:39.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966230+0000", 2024-04-19T04:26:39.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.066632882000000004 2024-04-19T04:26:39.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:39.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966296+0000", 2024-04-19T04:26:39.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5361e-05 2024-04-19T04:26:39.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966342+0000", 2024-04-19T04:26:39.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6476e-05 2024-04-19T04:26:39.669 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.669 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.669 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.669 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174344 5.d 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:39.669 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:39.669 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.668854940000003, 2024-04-19T04:26:39.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068211329000000001, 2024-04-19T04:26:39.669 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.669 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:39.669 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.669 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.669 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.670 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174344 2024-04-19T04:26:39.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.670 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:39.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.670 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.670 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:39.670 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898405+0000", 2024-04-19T04:26:39.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:39.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898409+0000", 2024-04-19T04:26:39.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5149999999999998e-06 2024-04-19T04:26:39.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.671 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.671 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898415+0000", 2024-04-19T04:26:39.671 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:26:39.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898419+0000", 2024-04-19T04:26:39.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.89e-06 2024-04-19T04:26:39.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898459+0000", 2024-04-19T04:26:39.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0017e-05 2024-04-19T04:26:39.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.672 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.672 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:39.672 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898540+0000", 2024-04-19T04:26:39.672 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1237999999999997e-05 2024-04-19T04:26:39.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:39.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:39.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6060000000000001e-05 2024-04-19T04:26:39.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:39.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.901321+0000", 2024-04-19T04:26:39.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027152109999999999 2024-04-19T04:26:39.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.673 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:39.673 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966512+0000", 2024-04-19T04:26:39.673 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.065190440000000002 2024-04-19T04:26:39.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.674 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:39.674 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966563+0000", 2024-04-19T04:26:39.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1436e-05 2024-04-19T04:26:39.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.674 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.674 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966617+0000", 2024-04-19T04:26:39.674 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.401e-05 2024-04-19T04:26:39.674 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.674 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.674 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.675 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174346 5.f 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:39.675 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:39.675 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 34.667068712999999, 2024-04-19T04:26:39.675 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.067185536000000004, 2024-04-19T04:26:39.675 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:39.675 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:39.675 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:39.675 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:39.675 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:39.675 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174346 2024-04-19T04:26:39.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.675 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:39.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.675 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:39.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:39.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:39.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:39.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:39.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:39.676 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900191+0000", 2024-04-19T04:26:39.676 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:39.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.676 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.676 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:39.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900196+0000", 2024-04-19T04:26:39.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3329999999999998e-06 2024-04-19T04:26:39.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:39.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900206+0000", 2024-04-19T04:26:39.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9699999999999994e-06 2024-04-19T04:26:39.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:39.677 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900210+0000", 2024-04-19T04:26:39.677 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3359999999999997e-06 2024-04-19T04:26:39.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.677 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:39.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900243+0000", 2024-04-19T04:26:39.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2669999999999997e-05 2024-04-19T04:26:39.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:39.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900365+0000", 2024-04-19T04:26:39.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122648 2024-04-19T04:26:39.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.678 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:39.678 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900559+0000", 2024-04-19T04:26:39.678 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019358799999999999 2024-04-19T04:26:39.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:39.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.903018+0000", 2024-04-19T04:26:39.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024592300000000002 2024-04-19T04:26:39.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:39.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967180+0000", 2024-04-19T04:26:39.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.064161587000000006 2024-04-19T04:26:39.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.679 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:39.679 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967293+0000", 2024-04-19T04:26:39.679 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112921 2024-04-19T04:26:39.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:39.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:39.680 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:39.680 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967378+0000", 2024-04-19T04:26:39.680 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5000999999999995e-05 2024-04-19T04:26:39.680 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.680 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.680 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.680 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:39.680 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:39.680 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:39.682 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:39.682 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:39.680+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:39.782 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:39.780+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:39.801 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:39.801 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:39.801 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 0 2024-04-19T04:26:39.801 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:39.811 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:39.884 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:39.880+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:39.971 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:39.971 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:39.971 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:39.971 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:39.972 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:39.982 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:39.984 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:39.984+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:40.085 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:40.084+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:40.098 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:40.098 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 84.144686484999994, 2024-04-19T04:26:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 84.139624839000007, 2024-04-19T04:26:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 84.139524926999997, 2024-04-19T04:26:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 84.139399174000005, 2024-04-19T04:26:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 84.135555229000005, 2024-04-19T04:26:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 84.128384127999993, 2024-04-19T04:26:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 84.128212024000007, 2024-04-19T04:26:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 84.128148898999996, 2024-04-19T04:26:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 84.128020301999996, 2024-04-19T04:26:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 84.127952331000003, 2024-04-19T04:26:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.208412666000001, 2024-04-19T04:26:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078453623, 2024-04-19T04:26:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965893+0000", 2024-04-19T04:26:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.076646455000000002 2024-04-19T04:26:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965956+0000", 2024-04-19T04:26:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3200000000000005e-05 2024-04-19T04:26:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966068+0000", 2024-04-19T04:26:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011194800000000001 2024-04-19T04:26:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.208381668999998, 2024-04-19T04:26:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083782388999999999, 2024-04-19T04:26:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971179+0000", 2024-04-19T04:26:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079349476000000002 2024-04-19T04:26:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971259+0000", 2024-04-19T04:26:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9083000000000002e-05 2024-04-19T04:26:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971428+0000", 2024-04-19T04:26:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169419 2024-04-19T04:26:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.206060149000002, 2024-04-19T04:26:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081686998999999996, 2024-04-19T04:26:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971454+0000", 2024-04-19T04:26:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077525997999999999 2024-04-19T04:26:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971540+0000", 2024-04-19T04:26:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6285000000000005e-05 2024-04-19T04:26:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971654+0000", 2024-04-19T04:26:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114095 2024-04-19T04:26:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.204849766999999, 2024-04-19T04:26:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080734265999999999, 2024-04-19T04:26:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:40.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:40.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:40.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:40.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:40.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:40.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:40.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:40.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:40.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:40.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:40.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:40.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:40.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:40.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:40.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:40.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971677+0000", 2024-04-19T04:26:40.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.073192023999999994 2024-04-19T04:26:40.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:40.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971771+0000", 2024-04-19T04:26:40.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4235999999999997e-05 2024-04-19T04:26:40.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971912+0000", 2024-04-19T04:26:40.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014055099999999999 2024-04-19T04:26:40.174 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.174 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.174 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.174 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:40.174 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:40.174 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.203898275999997, 2024-04-19T04:26:40.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085645857000000006, 2024-04-19T04:26:40.175 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.175 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.175 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.175 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.175 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.175 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:40.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.175 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:40.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:40.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:40.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:40.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:40.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:40.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:40.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:40.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:40.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:40.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:40.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:40.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:40.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:40.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:40.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:40.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977634+0000", 2024-04-19T04:26:40.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077144335999999994 2024-04-19T04:26:40.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:40.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977699+0000", 2024-04-19T04:26:40.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4518999999999997e-05 2024-04-19T04:26:40.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977775+0000", 2024-04-19T04:26:40.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6219999999999999e-05 2024-04-19T04:26:40.179 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.179 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.179 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.179 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:40.179 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:40.179 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.200890698000002, 2024-04-19T04:26:40.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075403611999999995, 2024-04-19T04:26:40.180 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.180 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.180 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.180 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.180 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.180 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:40.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.180 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:40.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:40.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:40.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:40.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:40.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:40.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:40.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:40.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:40.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:40.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:40.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:40.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:40.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:40.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:40.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:40.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970369+0000", 2024-04-19T04:26:40.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.074967992999999997 2024-04-19T04:26:40.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:40.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970419+0000", 2024-04-19T04:26:40.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9700999999999997e-05 2024-04-19T04:26:40.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970540+0000", 2024-04-19T04:26:40.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121512 2024-04-19T04:26:40.184 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.184 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.184 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.184 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5:78f758ec:::benchmark_data_smithi007_19526_object48602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:40.184 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:40.184 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.200516573999998, 2024-04-19T04:26:40.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085171609999999995, 2024-04-19T04:26:40.184 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.184 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.185 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.185 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.185 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.185 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:40.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.185 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:40.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:40.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:40.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:40.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:40.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:40.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:40.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:40.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:40.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:40.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966154+0000", 2024-04-19T04:26:40.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.070613543000000001 2024-04-19T04:26:40.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:40.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966382+0000", 2024-04-19T04:26:40.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022741800000000001 2024-04-19T04:26:40.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:40.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980581+0000", 2024-04-19T04:26:40.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014199916999999999 2024-04-19T04:26:40.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:40.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980621+0000", 2024-04-19T04:26:40.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9685999999999999e-05 2024-04-19T04:26:40.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980682+0000", 2024-04-19T04:26:40.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1130000000000006e-05 2024-04-19T04:26:40.189 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.189 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.189 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.189 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:40.189 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:40.189 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.200426622000002, 2024-04-19T04:26:40.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075073230000000005, 2024-04-19T04:26:40.189 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.189 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.189 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.190 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.190 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.190 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:40.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.190 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:40.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:40.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:40.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:40.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:40.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:40.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:40.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:40.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:40.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:40.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:40.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:40.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:40.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:40.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:40.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:40.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970556+0000", 2024-04-19T04:26:40.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.072076192999999997 2024-04-19T04:26:40.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:40.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970608+0000", 2024-04-19T04:26:40.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2549000000000001e-05 2024-04-19T04:26:40.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970674+0000", 2024-04-19T04:26:40.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5549000000000005e-05 2024-04-19T04:26:40.194 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.194 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.194 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.194 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5:70a7bb5e:::benchmark_data_smithi007_19526_object48614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:40.194 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:40.194 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.195339625000003, 2024-04-19T04:26:40.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080099220999999998, 2024-04-19T04:26:40.194 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.194 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.194 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.194 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.195 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.195 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:40.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.195 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:40.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:40.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:40.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:40.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:40.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:40.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:40.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:40.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:40.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:40.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971978+0000", 2024-04-19T04:26:40.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.071282358000000004 2024-04-19T04:26:40.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:40.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.972180+0000", 2024-04-19T04:26:40.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020191100000000001 2024-04-19T04:26:40.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:40.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980701+0000", 2024-04-19T04:26:40.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085211760000000001 2024-04-19T04:26:40.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:40.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980729+0000", 2024-04-19T04:26:40.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8068e-05 2024-04-19T04:26:40.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980787+0000", 2024-04-19T04:26:40.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7521e-05 2024-04-19T04:26:40.199 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.199 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.199 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.199 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174350 5.e 5:7f36609a:::benchmark_data_smithi007_19526_object48616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:40.199 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:40.199 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.193568552999999, 2024-04-19T04:26:40.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079723622999999993, 2024-04-19T04:26:40.199 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:40.199 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.199 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:40.199 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:40.200 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.200 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174350 2024-04-19T04:26:40.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.200 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:40.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:40.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:40.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:40.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:40.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:40.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:40.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902458+0000", 2024-04-19T04:26:40.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:40.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:40.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902463+0000", 2024-04-19T04:26:40.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5889999999999996e-06 2024-04-19T04:26:40.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:40.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965576+0000", 2024-04-19T04:26:40.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063113328999999996 2024-04-19T04:26:40.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965614+0000", 2024-04-19T04:26:40.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8285999999999999e-05 2024-04-19T04:26:40.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:40.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974787+0000", 2024-04-19T04:26:40.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009172599 2024-04-19T04:26:40.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:40.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974999+0000", 2024-04-19T04:26:40.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021270999999999999 2024-04-19T04:26:40.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:40.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982086+0000", 2024-04-19T04:26:40.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070869160000000004 2024-04-19T04:26:40.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:40.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982115+0000", 2024-04-19T04:26:40.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8603999999999999e-05 2024-04-19T04:26:40.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:40.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:40.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:40.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982182+0000", 2024-04-19T04:26:40.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7350999999999999e-05 2024-04-19T04:26:40.204 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.204 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.204 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.204 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:40.204 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:40.204 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:40.205 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:40.206 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:40.204+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:40.306 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:40.304+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:40.324 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:40.324 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:40.324 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 0 2024-04-19T04:26:40.324 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:40.334 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:40.399 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-04-19T04:26:40.407 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:40.404+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:40.438 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:40.438 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:40.438 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:40.439 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:40.439 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:40.448 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:40.508 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:40.504+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:40.560 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:40.560 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:40.560 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:40.560 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:40.560 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.560 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:40.560 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:40.560 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 106.32579765, 2024-04-19T04:26:40.560 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:40.561 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.561 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.561 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.561 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.561 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.561 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:40.561 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.561 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.561 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.561 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.561 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:40.561 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.561 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.561 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.561 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.562 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:40.562 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.562 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.562 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.562 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:40.562 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:40.562 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.562 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.562 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:40.562 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:40.562 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:40.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:40.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:40.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:40.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.563 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.563 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:40.563 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:40.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.564 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:40.564 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:40.564 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:40.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.564 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.564 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:40.564 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:40.564 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:40.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.564 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.564 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:40.564 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:40.564 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:40.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.564 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.565 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:40.565 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:40.565 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:40.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.565 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:40.565 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:40.565 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:40.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.565 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.565 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:40.565 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:40.565 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.566 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.566 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.566 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.566 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:40.566 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:40.566 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 106.32170272899999, 2024-04-19T04:26:40.566 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:40.567 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.567 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.567 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.567 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.567 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.567 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:40.567 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.567 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.567 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.567 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.567 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:40.567 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.568 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.568 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.568 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.568 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:40.568 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.568 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.568 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.568 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.568 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:40.568 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:40.568 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.568 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.568 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.568 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:40.569 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:40.569 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.569 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.569 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.569 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:40.569 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:40.569 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.569 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.569 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.569 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:40.569 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:40.569 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.569 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.569 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.569 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:40.570 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:40.570 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.570 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.570 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:40.570 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:40.570 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:40.570 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.570 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.570 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:40.570 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:40.570 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:40.570 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.570 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.570 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:40.571 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:40.571 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:40.571 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.571 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.571 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:40.571 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:40.571 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:40.571 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.571 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.571 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:40.571 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:40.571 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:40.571 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.571 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.572 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.572 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:40.572 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:40.572 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.572 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.572 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.572 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.572 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.572 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:40.572 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:40.572 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 106.318411544, 2024-04-19T04:26:40.572 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:40.572 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.572 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.572 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.572 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.573 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.573 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:40.573 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.573 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.573 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.573 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.573 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:40.573 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.573 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.573 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.573 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.573 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:40.573 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.574 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.574 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.574 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.574 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:40.574 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:40.574 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.574 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.574 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.574 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:40.574 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:40.574 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.574 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.574 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.575 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:40.575 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:40.575 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.575 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.575 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.575 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:40.575 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:40.575 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.575 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.575 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.575 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:40.575 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:40.575 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.576 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.576 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:40.576 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:40.576 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:40.576 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.576 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.576 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:40.576 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:40.576 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:40.576 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.576 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.576 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:40.576 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:40.576 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:40.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.577 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.577 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:40.577 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:40.577 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:40.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.577 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.577 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:40.577 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:40.577 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:40.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.577 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.577 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.577 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:40.578 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:40.578 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.578 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.578 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.578 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.578 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.578 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:40.578 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:40.578 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 84.601022079000003, 2024-04-19T04:26:40.578 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:40.578 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.578 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:40.578 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.578 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.579 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.579 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:40.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.579 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.579 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.579 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:40.579 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.579 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.579 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:40.579 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.580 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.580 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:40.580 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:40.580 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.580 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.580 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.580 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:40.580 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:40.580 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.580 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.580 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.580 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:40.580 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:40.580 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.580 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.581 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.581 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:40.581 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:40.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.581 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.581 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.581 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:40.581 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:40.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.581 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.581 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:40.581 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:40.581 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:40.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.581 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.582 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:40.582 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:40.582 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:40.582 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.582 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.582 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:40.582 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:40.582 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:40.582 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.582 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.582 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.582 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:40.582 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:40.582 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.583 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.583 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:40.583 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:40.583 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:40.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.583 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.583 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.583 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:40.583 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:40.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.583 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.583 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.583 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:40.584 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:40.584 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.584 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.584 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.584 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.584 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.584 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:40.584 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:40.584 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 84.580791629999993, 2024-04-19T04:26:40.584 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:40.584 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.584 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:40.584 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.584 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.585 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.585 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:40.585 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.585 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.585 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.585 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.585 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:40.585 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.585 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.585 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.585 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.585 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:40.585 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.585 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.585 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.586 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.586 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:40.586 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:40.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.586 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.586 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:40.586 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:40.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.586 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.586 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.586 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:40.586 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:40.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.587 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.587 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.587 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:40.587 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:40.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.587 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.587 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.587 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:40.587 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:40.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.587 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.587 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:40.587 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:40.587 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:40.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:40.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:40.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.588 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.588 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:40.588 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:40.588 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.588 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.588 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.589 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:40.589 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:40.589 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 84.580683773000004, 2024-04-19T04:26:40.589 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:40.589 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.589 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:40.589 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.589 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.589 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.589 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:40.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.589 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.589 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.589 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.590 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:40.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.590 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.590 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.590 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:40.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.590 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.590 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.590 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:40.590 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:40.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.590 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.591 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:40.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:40.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.591 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:40.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:40.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.591 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.591 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.591 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:40.591 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:40.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:40.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:40.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:40.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:40.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:40.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.592 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.592 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.592 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:40.592 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:40.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.593 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.593 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:40.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:40.593 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.593 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.593 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.593 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:40.593 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:40.593 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 84.578717084000004, 2024-04-19T04:26:40.593 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:40.593 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.593 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.594 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.594 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.594 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.594 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:40.594 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.594 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.594 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.594 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.594 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:40.594 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.594 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.594 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.594 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.594 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:40.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.595 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.595 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:40.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:40.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.595 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.595 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:40.595 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:40.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.595 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.595 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:40.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:40.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:40.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:40.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.596 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.596 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:40.596 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:40.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.596 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:40.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:40.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:40.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:40.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:40.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.597 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:40.597 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:40.597 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:40.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.597 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:40.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:40.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:40.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:40.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:40.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:40.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.598 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.598 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.598 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:40.598 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:40.599 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.599 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.599 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.599 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:40.599 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:40.599 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 84.575352889000001, 2024-04-19T04:26:40.599 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:40.599 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.599 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.599 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.599 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.599 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.599 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:40.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.600 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:40.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.600 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:40.600 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.600 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.600 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:40.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:40.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:40.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:40.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.601 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:40.601 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:40.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.601 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:40.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:40.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:40.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:40.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.602 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.602 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:40.602 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:40.602 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:40.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:40.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:40.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:40.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:40.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:40.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.603 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.603 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:40.603 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:40.603 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:40.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:40.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:40.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:40.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.604 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.604 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:40.604 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:40.604 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.604 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.604 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.604 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.604 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:40.605 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:40.605 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 84.571541910999997, 2024-04-19T04:26:40.605 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:40.605 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.605 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.605 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.605 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.605 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.605 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:40.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.605 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.605 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.605 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:40.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:40.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.606 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:40.606 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:40.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.606 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:40.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:40.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:40.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:40.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.607 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.607 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:40.607 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:40.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:40.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:40.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:40.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:40.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:40.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.608 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.608 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:40.608 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:40.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.608 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:40.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:40.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:40.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:40.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:40.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:40.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.609 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:40.609 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:40.609 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:40.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.609 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.610 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.610 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:40.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:40.610 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.610 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.610 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.610 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.610 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:40.610 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:40.610 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 71.329679553999995, 2024-04-19T04:26:40.610 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:40.610 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.610 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.611 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.611 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.611 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.611 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:40.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.611 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:40.611 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.611 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.611 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.611 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:40.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.612 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.612 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:40.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:40.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.612 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.612 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.612 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:40.612 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:40.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:40.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:40.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:40.613 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:40.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.613 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.613 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.613 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:40.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:40.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:40.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:40.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:40.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.614 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.614 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:40.614 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:40.614 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:40.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:40.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:40.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:40.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.615 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.615 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:40.615 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:40.615 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.615 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.615 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.615 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.615 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:40.616 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:40.616 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 71.329085273999993, 2024-04-19T04:26:40.616 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:40.616 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.616 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.616 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.616 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.616 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.616 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:40.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.616 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.616 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.616 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:40.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:40.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.617 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:40.617 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:40.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.617 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:40.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:40.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:40.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:40.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.618 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:40.618 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:40.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.618 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.618 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:40.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:40.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:40.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:40.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:40.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.619 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:40.619 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:40.619 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:40.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.619 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:40.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:40.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:40.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:40.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:40.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:40.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.620 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:40.620 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:40.620 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:40.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.620 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.621 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.621 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:40.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:40.621 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.621 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.621 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.621 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.621 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:40.621 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:40.621 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 36.604438115999997, 2024-04-19T04:26:40.621 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:40.621 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.621 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.621 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.622 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.622 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.622 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:40.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.622 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:40.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.622 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.622 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:40.622 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:40.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:40.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:40.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:40.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.623 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.623 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:40.623 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:40.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:40.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:40.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:40.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:40.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.624 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.624 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:40.624 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:40.624 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:40.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:40.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:40.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:40.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:40.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:40.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:40.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.625 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.625 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:40.625 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:40.625 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:40.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:40.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:40.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:40.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.626 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.626 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.626 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:40.626 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:40.626 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.626 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.626 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.627 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:40.627 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:40.627 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 36.6043977, 2024-04-19T04:26:40.627 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:40.627 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.627 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.627 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.627 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.627 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.627 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:40.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.627 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.627 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:40.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:40.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.628 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.628 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.628 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:40.628 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:40.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:40.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:40.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:40.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:40.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.629 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.629 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:40.629 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:40.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:40.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:40.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:40.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:40.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:40.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.630 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.630 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:40.630 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:40.630 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:40.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:40.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:40.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:40.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:40.631 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:40.631 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:40.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.631 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.631 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:40.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:40.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:40.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.632 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.632 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:40.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:40.632 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.632 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.632 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.632 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.632 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:40.632 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:40.632 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 36.600701391000001, 2024-04-19T04:26:40.632 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:40.633 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.633 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.633 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.633 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.633 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.633 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:40.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.633 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:40.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.633 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.633 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.633 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:40.633 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:40.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:40.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:40.634 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:40.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.634 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.634 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.634 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:40.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:40.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:40.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:40.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:40.635 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:40.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.635 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:40.635 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:40.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:40.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:40.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:40.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:40.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:40.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:40.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:40.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.636 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:40.636 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:40.636 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:40.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:40.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:40.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:40.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.637 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.637 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:40.637 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:40.637 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.637 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.637 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.637 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.638 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:40.638 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:40.638 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 36.347090917000003, 2024-04-19T04:26:40.638 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:40.638 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.638 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.638 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.638 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.638 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.638 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:40.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.638 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.638 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.638 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.638 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:40.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:40.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:40.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:40.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.639 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.639 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:40.639 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:40.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:40.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:40.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.640 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:40.640 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:40.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.640 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:40.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:40.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:40.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:40.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:40.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.641 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:40.641 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:40.641 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:40.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.641 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.642 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:40.642 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:40.642 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:40.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.642 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.642 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:40.642 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:40.642 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.642 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.642 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.642 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.642 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:40.642 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:40.643 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 36.344797505000003, 2024-04-19T04:26:40.643 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:40.643 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.643 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.643 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.643 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.643 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.643 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:40.643 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.643 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.643 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.643 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.643 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:40.643 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:40.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.644 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:40.644 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:40.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.644 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.644 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:40.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:40.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:40.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:40.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.645 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.645 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:40.645 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:40.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.645 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:40.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:40.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:40.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:40.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:40.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.646 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:40.646 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:40.646 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:40.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.647 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:40.647 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:40.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:40.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.647 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.647 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:40.647 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:40.647 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.647 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.647 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.647 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.648 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:40.648 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:40.648 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 36.344751688999999, 2024-04-19T04:26:40.648 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:40.648 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.648 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.648 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.648 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.648 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.648 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:40.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.648 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.648 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.648 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.648 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:40.649 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.649 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.649 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:40.649 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.649 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.649 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:40.649 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:40.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.649 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.649 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174342 5.9 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:40.652 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.659594988999999, 2024-04-19T04:26:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068615152999999998, 2024-04-19T04:26:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174342 2024-04-19T04:26:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897726+0000", 2024-04-19T04:26:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.654 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897731+0000", 2024-04-19T04:26:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1449999999999999e-06 2024-04-19T04:26:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897744+0000", 2024-04-19T04:26:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2833000000000001e-05 2024-04-19T04:26:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897749+0000", 2024-04-19T04:26:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1540000000000001e-06 2024-04-19T04:26:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.655 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897810+0000", 2024-04-19T04:26:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0724999999999999e-05 2024-04-19T04:26:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897920+0000", 2024-04-19T04:26:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011024 2024-04-19T04:26:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897993+0000", 2024-04-19T04:26:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2335000000000005e-05 2024-04-19T04:26:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.656 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.899597+0000", 2024-04-19T04:26:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016048919999999999 2024-04-19T04:26:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966230+0000", 2024-04-19T04:26:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.066632882000000004 2024-04-19T04:26:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966296+0000", 2024-04-19T04:26:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5361e-05 2024-04-19T04:26:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.657 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966342+0000", 2024-04-19T04:26:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6476e-05 2024-04-19T04:26:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174344 5.d 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.658916151, 2024-04-19T04:26:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068211329000000001, 2024-04-19T04:26:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.658 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174344 2024-04-19T04:26:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:40.659 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898405+0000", 2024-04-19T04:26:40.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:40.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898409+0000", 2024-04-19T04:26:40.660 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5149999999999998e-06 2024-04-19T04:26:40.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.660 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.660 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.660 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898415+0000", 2024-04-19T04:26:40.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:26:40.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898419+0000", 2024-04-19T04:26:40.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.89e-06 2024-04-19T04:26:40.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.661 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898459+0000", 2024-04-19T04:26:40.661 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0017e-05 2024-04-19T04:26:40.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.661 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:40.662 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898540+0000", 2024-04-19T04:26:40.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1237999999999997e-05 2024-04-19T04:26:40.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.662 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:40.662 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:40.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6060000000000001e-05 2024-04-19T04:26:40.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.662 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:40.662 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.901321+0000", 2024-04-19T04:26:40.662 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027152109999999999 2024-04-19T04:26:40.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:40.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966512+0000", 2024-04-19T04:26:40.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.065190440000000002 2024-04-19T04:26:40.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:40.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966563+0000", 2024-04-19T04:26:40.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1436e-05 2024-04-19T04:26:40.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.663 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.663 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966617+0000", 2024-04-19T04:26:40.663 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.401e-05 2024-04-19T04:26:40.663 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.663 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.664 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.664 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174346 5.f 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:40.664 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:40.664 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 35.657129924000003, 2024-04-19T04:26:40.664 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.067185536000000004, 2024-04-19T04:26:40.664 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:40.664 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:40.664 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:40.664 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:40.664 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:40.664 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174346 2024-04-19T04:26:40.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.664 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:40.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:40.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:40.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:40.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:40.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:40.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.665 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:40.665 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900191+0000", 2024-04-19T04:26:40.665 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:40.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:40.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900196+0000", 2024-04-19T04:26:40.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3329999999999998e-06 2024-04-19T04:26:40.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:40.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900206+0000", 2024-04-19T04:26:40.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9699999999999994e-06 2024-04-19T04:26:40.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.666 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:40.666 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900210+0000", 2024-04-19T04:26:40.666 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3359999999999997e-06 2024-04-19T04:26:40.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:40.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900243+0000", 2024-04-19T04:26:40.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2669999999999997e-05 2024-04-19T04:26:40.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:40.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900365+0000", 2024-04-19T04:26:40.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122648 2024-04-19T04:26:40.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.667 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:40.667 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900559+0000", 2024-04-19T04:26:40.667 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019358799999999999 2024-04-19T04:26:40.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:40.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.903018+0000", 2024-04-19T04:26:40.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024592300000000002 2024-04-19T04:26:40.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:40.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967180+0000", 2024-04-19T04:26:40.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.064161587000000006 2024-04-19T04:26:40.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.668 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:40.668 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967293+0000", 2024-04-19T04:26:40.668 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112921 2024-04-19T04:26:40.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:40.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:40.669 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:40.669 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967378+0000", 2024-04-19T04:26:40.669 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5000999999999995e-05 2024-04-19T04:26:40.669 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.669 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.669 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.669 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:40.669 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:40.669 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:40.671 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:40.671 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:40.668+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:40.772 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:40.768+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:40.788 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:40.788 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:40.788 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 0 2024-04-19T04:26:40.788 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:40.798 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:40.875 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:40.872+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:40.907 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:40.908 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:40.908 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:40.908 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:40.908 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:40.918 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:40.976 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:40.976+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:41.030 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 85.076135768, 2024-04-19T04:26:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 85.071074121999999, 2024-04-19T04:26:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 85.070974210000003, 2024-04-19T04:26:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 85.070848456999997, 2024-04-19T04:26:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.050 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:41.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.050 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:41.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:41.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:41.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:41.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:41.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:41.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:41.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:41.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:41.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:41.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:41.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:41.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 85.067004511999997, 2024-04-19T04:26:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:41.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:41.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:41.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:41.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:41.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:41.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:41.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:41.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:41.061 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.061 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.061 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.061 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:41.061 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:41.061 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 85.059833411, 2024-04-19T04:26:41.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:41.061 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.061 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:41.061 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.061 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.062 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.062 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:41.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.062 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:41.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:41.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:41.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:41.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:41.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:41.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:41.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:41.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:41.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:41.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:41.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:41.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:41.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:41.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:41.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:41.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:41.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:41.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:41.066 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.066 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.066 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.066 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:41.066 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:41.066 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 85.059661306999999, 2024-04-19T04:26:41.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:41.066 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 85.059598182000002, 2024-04-19T04:26:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:41.072 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.072 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:41.072 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.072 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.072 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.072 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:41.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.072 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:41.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:41.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:41.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:41.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:41.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:41.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:41.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:41.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:41.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:41.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 85.059469585000002, 2024-04-19T04:26:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:41.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:41.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:41.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:41.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:41.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:41.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:41.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:41.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:41.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:41.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:41.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 85.059401613999995, 2024-04-19T04:26:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.139861949, 2024-04-19T04:26:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078453623, 2024-04-19T04:26:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965893+0000", 2024-04-19T04:26:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.076646455000000002 2024-04-19T04:26:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965956+0000", 2024-04-19T04:26:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3200000000000005e-05 2024-04-19T04:26:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966068+0000", 2024-04-19T04:26:41.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011194800000000001 2024-04-19T04:26:41.094 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.094 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.094 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.094 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:41.094 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:41.094 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.139830951999997, 2024-04-19T04:26:41.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083782388999999999, 2024-04-19T04:26:41.094 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.094 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971179+0000", 2024-04-19T04:26:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079349476000000002 2024-04-19T04:26:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971259+0000", 2024-04-19T04:26:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9083000000000002e-05 2024-04-19T04:26:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971428+0000", 2024-04-19T04:26:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169419 2024-04-19T04:26:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.137509432000002, 2024-04-19T04:26:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081686998999999996, 2024-04-19T04:26:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:41.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:41.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:41.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:41.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:41.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:41.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:41.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:41.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971454+0000", 2024-04-19T04:26:41.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077525997999999999 2024-04-19T04:26:41.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:41.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971540+0000", 2024-04-19T04:26:41.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6285000000000005e-05 2024-04-19T04:26:41.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971654+0000", 2024-04-19T04:26:41.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114095 2024-04-19T04:26:41.104 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.104 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.104 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.104 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:41.104 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:41.104 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.136299049999998, 2024-04-19T04:26:41.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080734265999999999, 2024-04-19T04:26:41.104 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.104 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:41.105 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.105 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.105 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.105 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:41.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.105 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:41.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:41.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:41.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:41.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:41.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:41.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:41.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:41.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:41.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:41.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:41.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:41.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:41.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:41.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:41.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:41.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971677+0000", 2024-04-19T04:26:41.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.073192023999999994 2024-04-19T04:26:41.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:41.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971771+0000", 2024-04-19T04:26:41.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4235999999999997e-05 2024-04-19T04:26:41.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971912+0000", 2024-04-19T04:26:41.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014055099999999999 2024-04-19T04:26:41.109 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.109 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.110 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.110 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:41.110 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:41.110 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.135347559000003, 2024-04-19T04:26:41.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085645857000000006, 2024-04-19T04:26:41.110 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.110 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:41.110 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.110 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.110 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.110 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:41.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.111 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:41.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:41.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:41.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:41.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:41.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:41.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:41.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:41.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:41.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:41.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:41.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:41.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:41.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:41.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:41.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:41.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977634+0000", 2024-04-19T04:26:41.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077144335999999994 2024-04-19T04:26:41.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:41.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977699+0000", 2024-04-19T04:26:41.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4518999999999997e-05 2024-04-19T04:26:41.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977775+0000", 2024-04-19T04:26:41.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6219999999999999e-05 2024-04-19T04:26:41.115 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.115 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.115 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.115 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:41.115 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:41.115 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.132339981000001, 2024-04-19T04:26:41.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075403611999999995, 2024-04-19T04:26:41.115 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.116 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:41.116 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.116 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.116 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.116 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:41.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.116 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:41.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:41.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:41.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:41.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:41.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:41.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:41.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:41.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:41.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:41.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:41.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:41.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:41.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:41.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:41.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:41.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970369+0000", 2024-04-19T04:26:41.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.074967992999999997 2024-04-19T04:26:41.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:41.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970419+0000", 2024-04-19T04:26:41.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9700999999999997e-05 2024-04-19T04:26:41.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970540+0000", 2024-04-19T04:26:41.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121512 2024-04-19T04:26:41.120 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.120 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.120 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.120 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5:78f758ec:::benchmark_data_smithi007_19526_object48602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:41.121 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:41.121 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.131965856999997, 2024-04-19T04:26:41.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085171609999999995, 2024-04-19T04:26:41.121 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.121 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:41.121 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.121 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.121 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.121 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:41.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.121 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:41.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:41.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:41.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:41.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:41.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:41.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:41.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:41.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:41.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:41.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966154+0000", 2024-04-19T04:26:41.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.070613543000000001 2024-04-19T04:26:41.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:41.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966382+0000", 2024-04-19T04:26:41.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022741800000000001 2024-04-19T04:26:41.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:41.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980581+0000", 2024-04-19T04:26:41.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014199916999999999 2024-04-19T04:26:41.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:41.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980621+0000", 2024-04-19T04:26:41.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9685999999999999e-05 2024-04-19T04:26:41.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980682+0000", 2024-04-19T04:26:41.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1130000000000006e-05 2024-04-19T04:26:41.125 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.125 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.125 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.126 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:41.126 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:41.126 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.131875905000001, 2024-04-19T04:26:41.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075073230000000005, 2024-04-19T04:26:41.126 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.126 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:41.126 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.126 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.126 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.126 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:41.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.126 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:41.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:41.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:41.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:41.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:41.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:41.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:41.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:41.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:41.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:41.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:41.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:41.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:41.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:41.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:41.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:41.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970556+0000", 2024-04-19T04:26:41.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.072076192999999997 2024-04-19T04:26:41.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:41.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970608+0000", 2024-04-19T04:26:41.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2549000000000001e-05 2024-04-19T04:26:41.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970674+0000", 2024-04-19T04:26:41.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5549000000000005e-05 2024-04-19T04:26:41.130 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.131 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.131 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.131 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5:70a7bb5e:::benchmark_data_smithi007_19526_object48614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:41.131 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:41.131 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.126788908000002, 2024-04-19T04:26:41.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080099220999999998, 2024-04-19T04:26:41.131 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.131 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:41.131 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.131 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.131 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.131 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:41.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.132 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:41.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:41.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:41.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:41.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:41.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:41.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:41.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:41.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:41.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:41.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971978+0000", 2024-04-19T04:26:41.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.071282358000000004 2024-04-19T04:26:41.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:41.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.972180+0000", 2024-04-19T04:26:41.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020191100000000001 2024-04-19T04:26:41.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:41.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980701+0000", 2024-04-19T04:26:41.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085211760000000001 2024-04-19T04:26:41.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:41.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980729+0000", 2024-04-19T04:26:41.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8068e-05 2024-04-19T04:26:41.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980787+0000", 2024-04-19T04:26:41.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7521e-05 2024-04-19T04:26:41.136 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.136 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.136 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.136 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174350 5.e 5:7f36609a:::benchmark_data_smithi007_19526_object48616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:41.136 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:41.136 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 36.125017835999998, 2024-04-19T04:26:41.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079723622999999993, 2024-04-19T04:26:41.136 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:41.136 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:41.136 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:41.137 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:41.137 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:41.137 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174350 2024-04-19T04:26:41.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.137 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:41.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:41.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:41.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:41.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:41.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:41.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:41.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902458+0000", 2024-04-19T04:26:41.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:41.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:41.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902463+0000", 2024-04-19T04:26:41.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5889999999999996e-06 2024-04-19T04:26:41.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:41.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965576+0000", 2024-04-19T04:26:41.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063113328999999996 2024-04-19T04:26:41.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:41.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965614+0000", 2024-04-19T04:26:41.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8285999999999999e-05 2024-04-19T04:26:41.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:41.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974787+0000", 2024-04-19T04:26:41.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009172599 2024-04-19T04:26:41.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:41.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974999+0000", 2024-04-19T04:26:41.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021270999999999999 2024-04-19T04:26:41.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:41.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982086+0000", 2024-04-19T04:26:41.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070869160000000004 2024-04-19T04:26:41.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:41.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982115+0000", 2024-04-19T04:26:41.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8603999999999999e-05 2024-04-19T04:26:41.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:41.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:41.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:41.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982182+0000", 2024-04-19T04:26:41.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7350999999999999e-05 2024-04-19T04:26:41.141 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.141 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.141 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.141 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:41.141 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:41.141 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:41.143 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:41.140+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:41.143 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:41.243 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T04:26:41.244 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:41.240+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:41.261 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:41.261 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:41.261 INFO:teuthology.orchestra.run.smithi027.stdout: "num_ops": 0 2024-04-19T04:26:41.261 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:41.271 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:41.345 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:41.340+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:41.378 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:41.378 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:41.378 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:41.378 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:41.378 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:41.388 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:41.403 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:41.433 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:41.433 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:41.433 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:41.433 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:41.436 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:41.437 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:41.445 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:41.444+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:41.498 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:41.498 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:41.508 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:41.547 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:41.544+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:41.623 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:41.623 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:41.633 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:41.648 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:41.644+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:41.738 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:41.738 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:41.747 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:41.749 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:41.748+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:41.851 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:41.848+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:41.972 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:41.972 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:41.972 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:41.973 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:41.968+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:42.073 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:42.072+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:42.088 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:42.088 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:42.103 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:42.174 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:42.172+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:42.217 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:42.218 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:42.228 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:42.274 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:42.272+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:42.333 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:42.333 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:42.344 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:42.390 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:42.388+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:42.414 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T04:26:42.462 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:42.462 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:42.472 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:42.475 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:42.472+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:42.577 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:42.576+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:42.577 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:42.577 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:42.588 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:42.600 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-04-19T04:26:42.601 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-04-19T04:26:42.678 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:42.676+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:42.696 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:42.696 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:42.705 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:42.779 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:42.776+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:42.823 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:42.823 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:42.834 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:42.880 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:42.876+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:42.943 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:42.943 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:42.953 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:42.981 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:42.980+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:43.062 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:43.062 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:43.073 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:43.118 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:43.116+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:43.184 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:43.180+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:43.191 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:43.191 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:43.201 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:43.285 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-04-19T04:26:43.284+0000 7f4fb2c36700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18126) UID: 0 2024-04-19T04:26:43.310 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:43.310 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:43.320 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:43.386 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-19T04:26:43.384+0000 7effb130c700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18248) UID: 0 2024-04-19T04:26:43.423 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:43.423 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:43.425 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'unique_pool_0' removed 2024-04-19T04:26:43.426 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-04-19T04:26:43.433 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T04:26:43.438 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T04:26:43.440 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-19T04:26:43.450 INFO:tasks.thrashosds:joining thrashosds 2024-04-19T04:26:43.563 INFO:teuthology.orchestra.run.smithi027.stdout:ERROR: (22) Invalid argument 2024-04-19T04:26:43.563 INFO:teuthology.orchestra.run.smithi027.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T04:26:43.573 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T04:26:43.576 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-04-19T04:26:43.600 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-04-19T04:26:43.600 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T04:26:43.600 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T04:26:43.600 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T04:26:43.604 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T04:26:43.605 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T04:26:43.695 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:43.695 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [], 2024-04-19T04:26:43.695 INFO:teuthology.orchestra.run.smithi027.stdout: "complaint_time": 30, 2024-04-19T04:26:43.695 INFO:teuthology.orchestra.run.smithi027.stdout: "num_blocked_ops": 0 2024-04-19T04:26:43.696 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:43.707 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T04:26:43.812 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-04-19T04:26:43.812 INFO:teuthology.orchestra.run.smithi027.stdout: "size": 20, 2024-04-19T04:26:43.812 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 600, 2024-04-19T04:26:43.812 INFO:teuthology.orchestra.run.smithi027.stdout: "ops": [ 2024-04-19T04:26:43.812 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.812 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26148 5.9 5:98d1323d:::benchmark_data_smithi007_19526_object26147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:43.813 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:43.813 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 109.57973515099999, 2024-04-19T04:26:43.813 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048728037000000002, 2024-04-19T04:26:43.813 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.813 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:43.813 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.813 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.813 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.813 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26148 2024-04-19T04:26:43.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.813 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.813 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.813 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:43.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231524+0000", 2024-04-19T04:26:43.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.814 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.814 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.814 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231523+0000", 2024-04-19T04:26:43.814 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:43.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231573+0000", 2024-04-19T04:26:43.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9258999999999997e-05 2024-04-19T04:26:43.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231592+0000", 2024-04-19T04:26:43.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.9919e-05 2024-04-19T04:26:43.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.815 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.815 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231605+0000", 2024-04-19T04:26:43.815 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2505e-05 2024-04-19T04:26:43.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.816 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231677+0000", 2024-04-19T04:26:43.816 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2234e-05 2024-04-19T04:26:43.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.816 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:43.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231817+0000", 2024-04-19T04:26:43.816 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000139376 2024-04-19T04:26:43.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.816 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.816 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:43.816 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.231981+0000", 2024-04-19T04:26:43.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00016429300000000001 2024-04-19T04:26:43.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.817 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:43.817 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.234303+0000", 2024-04-19T04:26:43.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023225839999999999 2024-04-19T04:26:43.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.817 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:43.817 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239546+0000", 2024-04-19T04:26:43.817 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.005242633 2024-04-19T04:26:43.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.817 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:43.818 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239602+0000", 2024-04-19T04:26:43.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6424000000000001e-05 2024-04-19T04:26:43.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.818 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.818 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280252+0000", 2024-04-19T04:26:43.818 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040649849000000002 2024-04-19T04:26:43.818 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.818 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.818 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.818 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.818 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26163 5.9 5:9fa38735:::benchmark_data_smithi007_19526_object26162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:43.818 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:43.819 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 109.57564023, 2024-04-19T04:26:43.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048459732999999998, 2024-04-19T04:26:43.819 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.819 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:43.819 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.819 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.819 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.819 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26163 2024-04-19T04:26:43.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.819 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.819 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.819 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.819 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:43.819 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235619+0000", 2024-04-19T04:26:43.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235618+0000", 2024-04-19T04:26:43.820 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:43.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.820 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.820 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.820 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235681+0000", 2024-04-19T04:26:43.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3173e-05 2024-04-19T04:26:43.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235694+0000", 2024-04-19T04:26:43.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2317000000000001e-05 2024-04-19T04:26:43.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.821 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235701+0000", 2024-04-19T04:26:43.821 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.8669999999999994e-06 2024-04-19T04:26:43.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.821 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235764+0000", 2024-04-19T04:26:43.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3026000000000003e-05 2024-04-19T04:26:43.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:43.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.235918+0000", 2024-04-19T04:26:43.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000153759 2024-04-19T04:26:43.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.822 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:43.822 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.236075+0000", 2024-04-19T04:26:43.822 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00015681500000000001 2024-04-19T04:26:43.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:43.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283752+0000", 2024-04-19T04:26:43.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.047676613999999999 2024-04-19T04:26:43.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:43.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.283925+0000", 2024-04-19T04:26:43.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017354299999999999 2024-04-19T04:26:43.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.823 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:43.823 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284003+0000", 2024-04-19T04:26:43.823 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.7712000000000004e-05 2024-04-19T04:26:43.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.824 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.824 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284079+0000", 2024-04-19T04:26:43.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6070999999999997e-05 2024-04-19T04:26:43.824 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.824 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.824 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.824 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:26171 5.9 5:9dd504a6:::benchmark_data_smithi007_19526_object26170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T04:26:43.824 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:43.824 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 109.572349045, 2024-04-19T04:26:43.824 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051795024000000002, 2024-04-19T04:26:43.824 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.824 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:43.825 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.825 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.825 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.825 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 26171 2024-04-19T04:26:43.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.825 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:43.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.825 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.825 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.825 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238910+0000", 2024-04-19T04:26:43.825 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238909+0000", 2024-04-19T04:26:43.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:43.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.826 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.238999+0000", 2024-04-19T04:26:43.826 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0017000000000002e-05 2024-04-19T04:26:43.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.826 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.826 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239013+0000", 2024-04-19T04:26:43.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.38e-05 2024-04-19T04:26:43.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.239021+0000", 2024-04-19T04:26:43.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.5379999999999997e-06 2024-04-19T04:26:43.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.827 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280350+0000", 2024-04-19T04:26:43.827 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041329709999999999 2024-04-19T04:26:43.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.827 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.827 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:43.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.280700+0000", 2024-04-19T04:26:43.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00034924400000000002 2024-04-19T04:26:43.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:43.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.281033+0000", 2024-04-19T04:26:43.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00033348699999999999 2024-04-19T04:26:43.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:43.828 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.284331+0000", 2024-04-19T04:26:43.828 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0032977229999999998 2024-04-19T04:26:43.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.828 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.828 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:43.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290542+0000", 2024-04-19T04:26:43.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0062115319999999996 2024-04-19T04:26:43.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:43.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290634+0000", 2024-04-19T04:26:43.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.1867999999999995e-05 2024-04-19T04:26:43.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.829 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.829 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:24:54.290705+0000", 2024-04-19T04:26:43.829 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1105000000000004e-05 2024-04-19T04:26:43.829 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.829 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.830 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.830 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68135 5.2 5:46d482f5:::benchmark_data_smithi007_19526_object68134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:43.830 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:43.830 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 87.854959579999999, 2024-04-19T04:26:43.830 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.02296148, 2024-04-19T04:26:43.830 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.830 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:43.830 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.830 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.830 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.830 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68135 2024-04-19T04:26:43.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.831 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:43.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956300+0000", 2024-04-19T04:26:43.831 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.831 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.831 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.831 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956299+0000", 2024-04-19T04:26:43.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:43.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956335+0000", 2024-04-19T04:26:43.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5766000000000003e-05 2024-04-19T04:26:43.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.832 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956343+0000", 2024-04-19T04:26:43.832 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3890000000000005e-06 2024-04-19T04:26:43.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.832 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956350+0000", 2024-04-19T04:26:43.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.3169999999999998e-06 2024-04-19T04:26:43.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956394+0000", 2024-04-19T04:26:43.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4447999999999999e-05 2024-04-19T04:26:43.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.833 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:43.833 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956522+0000", 2024-04-19T04:26:43.833 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012827199999999999 2024-04-19T04:26:43.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.833 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:43.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:43.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019118800000000001 2024-04-19T04:26:43.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:43.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.959610+0000", 2024-04-19T04:26:43.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0028968980000000002 2024-04-19T04:26:43.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.834 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.834 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.834 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975019+0000", 2024-04-19T04:26:43.834 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.015408289 2024-04-19T04:26:43.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:43.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.975041+0000", 2024-04-19T04:26:43.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.1889e-05 2024-04-19T04:26:43.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979164+0000", 2024-04-19T04:26:43.835 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.004123331 2024-04-19T04:26:43.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.835 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.835 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.835 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979261+0000", 2024-04-19T04:26:43.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.7379000000000004e-05 2024-04-19T04:26:43.836 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.836 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.836 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.836 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.836 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68131 5.6 5:6ccbb1e4:::benchmark_data_smithi007_19526_object68130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:43.836 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:43.836 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 87.834729131000003, 2024-04-19T04:26:43.836 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0050792150000001, 2024-04-19T04:26:43.836 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.836 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:43.836 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.836 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.837 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.837 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68131 2024-04-19T04:26:43.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.837 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:43.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.837 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.837 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976530+0000", 2024-04-19T04:26:43.837 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.837 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976528+0000", 2024-04-19T04:26:43.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:43.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976593+0000", 2024-04-19T04:26:43.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.4399000000000005e-05 2024-04-19T04:26:43.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.838 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.838 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.838 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976605+0000", 2024-04-19T04:26:43.838 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2621e-05 2024-04-19T04:26:43.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976616+0000", 2024-04-19T04:26:43.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0628000000000001e-05 2024-04-19T04:26:43.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976685+0000", 2024-04-19T04:26:43.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9130999999999999e-05 2024-04-19T04:26:43.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.839 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:43.839 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976694+0000", 2024-04-19T04:26:43.839 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0869999999999996e-06 2024-04-19T04:26:43.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980222+0000", 2024-04-19T04:26:43.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003528279 2024-04-19T04:26:43.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.840 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.840 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.840 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.981610+0000", 2024-04-19T04:26:43.840 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001387056 2024-04-19T04:26:43.840 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.840 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.840 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.841 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68138 5.c 5:33abd4df:::benchmark_data_smithi007_19526_object68137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:43.841 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:43.841 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 87.834621274, 2024-04-19T04:26:43.841 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0029447600000001, 2024-04-19T04:26:43.841 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.841 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "reached pg", 2024-04-19T04:26:43.841 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.841 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.841 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.841 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68138 2024-04-19T04:26:43.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.841 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.841 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:43.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976638+0000", 2024-04-19T04:26:43.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.842 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.842 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.842 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976637+0000", 2024-04-19T04:26:43.842 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:43.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976687+0000", 2024-04-19T04:26:43.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9679999999999999e-05 2024-04-19T04:26:43.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976699+0000", 2024-04-19T04:26:43.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1498000000000001e-05 2024-04-19T04:26:43.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.843 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.843 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.843 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976707+0000", 2024-04-19T04:26:43.843 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.9869999999999999e-06 2024-04-19T04:26:43.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976751+0000", 2024-04-19T04:26:43.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4326999999999998e-05 2024-04-19T04:26:43.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:43.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.976761+0000", 2024-04-19T04:26:43.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0266e-05 2024-04-19T04:26:43.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.844 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.844 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.844 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.978125+0000", 2024-04-19T04:26:43.844 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0013640500000001 2024-04-19T04:26:43.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.845 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.845 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.979583+0000", 2024-04-19T04:26:43.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0014576610000000001 2024-04-19T04:26:43.845 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.845 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.845 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.845 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68148 5.7 5:ee901418:::benchmark_data_smithi007_19526_object68147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:43.845 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:43.845 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 87.832654585, 2024-04-19T04:26:43.845 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0089413970000001, 2024-04-19T04:26:43.845 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.846 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:43.846 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.846 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.846 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.846 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68148 2024-04-19T04:26:43.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.846 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.846 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.846 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:43.846 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978605+0000", 2024-04-19T04:26:43.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978604+0000", 2024-04-19T04:26:43.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:43.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.847 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978655+0000", 2024-04-19T04:26:43.847 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1712999999999998e-05 2024-04-19T04:26:43.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.847 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978669+0000", 2024-04-19T04:26:43.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.3623e-05 2024-04-19T04:26:43.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978680+0000", 2024-04-19T04:26:43.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1248e-05 2024-04-19T04:26:43.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.848 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.848 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978729+0000", 2024-04-19T04:26:43.848 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.8361e-05 2024-04-19T04:26:43.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.848 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:43.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.978737+0000", 2024-04-19T04:26:43.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.3149999999999992e-06 2024-04-19T04:26:43.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980534+0000", 2024-04-19T04:26:43.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0017972289999999 2024-04-19T04:26:43.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.849 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:43.849 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980666+0000", 2024-04-19T04:26:43.849 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00013230300000000001 2024-04-19T04:26:43.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.849 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:43.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987382+0000", 2024-04-19T04:26:43.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0067152949999999996 2024-04-19T04:26:43.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:43.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987438+0000", 2024-04-19T04:26:43.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.6023000000000002e-05 2024-04-19T04:26:43.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.850 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.850 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.850 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.987546+0000", 2024-04-19T04:26:43.850 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000108572 2024-04-19T04:26:43.850 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.850 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.851 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.851 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.851 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68150 5.1 5:8a2f8fe9:::benchmark_data_smithi007_19526_object68149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:43.851 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:43.851 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 87.829290389999997, 2024-04-19T04:26:43.851 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.003984827, 2024-04-19T04:26:43.851 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.851 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:43.851 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.851 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.851 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.851 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68150 2024-04-19T04:26:43.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.851 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:43.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981969+0000", 2024-04-19T04:26:43.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.852 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.852 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.852 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.981968+0000", 2024-04-19T04:26:43.852 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:43.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982040+0000", 2024-04-19T04:26:43.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.1942999999999999e-05 2024-04-19T04:26:43.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982049+0000", 2024-04-19T04:26:43.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.704e-06 2024-04-19T04:26:43.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.853 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.853 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.853 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982054+0000", 2024-04-19T04:26:43.853 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0409999999999997e-06 2024-04-19T04:26:43.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982105+0000", 2024-04-19T04:26:43.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1422000000000003e-05 2024-04-19T04:26:43.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:43.854 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.982111+0000", 2024-04-19T04:26:43.854 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4940000000000003e-06 2024-04-19T04:26:43.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.854 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.854 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980260+0000", 2024-04-19T04:26:43.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99814963400000001 2024-04-19T04:26:43.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:43.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.980368+0000", 2024-04-19T04:26:43.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00010765899999999999 2024-04-19T04:26:43.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:43.855 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985872+0000", 2024-04-19T04:26:43.855 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0055038819999999999 2024-04-19T04:26:43.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.855 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.855 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:43.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985907+0000", 2024-04-19T04:26:43.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5238999999999999e-05 2024-04-19T04:26:43.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.856 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.856 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.985954+0000", 2024-04-19T04:26:43.856 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6894999999999997e-05 2024-04-19T04:26:43.856 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.856 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.856 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.856 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:68152 5.1 5:8075831e:::benchmark_data_smithi007_19526_object68151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:43.856 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:43.857 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 87.825479411999993, 2024-04-19T04:26:43.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.000503717, 2024-04-19T04:26:43.857 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.857 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:43.857 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.857 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.857 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.857 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 68152 2024-04-19T04:26:43.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.857 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.857 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.857 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.857 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:43.857 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985780+0000", 2024-04-19T04:26:43.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985779+0000", 2024-04-19T04:26:43.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:43.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.858 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.858 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985828+0000", 2024-04-19T04:26:43.858 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9060999999999997e-05 2024-04-19T04:26:43.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985839+0000", 2024-04-19T04:26:43.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.1143e-05 2024-04-19T04:26:43.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985853+0000", 2024-04-19T04:26:43.859 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4221e-05 2024-04-19T04:26:43.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.859 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.859 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.859 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985880+0000", 2024-04-19T04:26:43.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.6993000000000001e-05 2024-04-19T04:26:43.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for peered", 2024-04-19T04:26:43.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:15.985885+0000", 2024-04-19T04:26:43.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.4599999999999996e-06 2024-04-19T04:26:43.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.982932+0000", 2024-04-19T04:26:43.860 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.99704712500000003 2024-04-19T04:26:43.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.860 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.860 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:43.860 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.983085+0000", 2024-04-19T04:26:43.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000152559 2024-04-19T04:26:43.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:43.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986211+0000", 2024-04-19T04:26:43.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0031265730000000001 2024-04-19T04:26:43.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:43.861 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986247+0000", 2024-04-19T04:26:43.861 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5408999999999999e-05 2024-04-19T04:26:43.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.861 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.861 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.862 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:16.986284+0000", 2024-04-19T04:26:43.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7185999999999999e-05 2024-04-19T04:26:43.862 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.862 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.862 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.862 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.862 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93737 5.1 5:8c5b34d1:::benchmark_data_smithi007_19526_object93736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:43.862 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:43.862 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 74.583617055000005, 2024-04-19T04:26:43.862 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.048446415, 2024-04-19T04:26:43.862 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.862 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:43.862 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.863 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.863 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.863 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93737 2024-04-19T04:26:43.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.863 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:43.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.863 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.863 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.863 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:43.863 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227642+0000", 2024-04-19T04:26:43.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:43.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227677+0000", 2024-04-19T04:26:43.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.4668000000000001e-05 2024-04-19T04:26:43.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.864 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.864 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227683+0000", 2024-04-19T04:26:43.864 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.9050000000000002e-06 2024-04-19T04:26:43.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.227687+0000", 2024-04-19T04:26:43.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0899999999999998e-06 2024-04-19T04:26:43.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264501+0000", 2024-04-19T04:26:43.865 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.036814274000000001 2024-04-19T04:26:43.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.865 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.865 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:43.865 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264673+0000", 2024-04-19T04:26:43.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000171712 2024-04-19T04:26:43.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:43.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276008+0000", 2024-04-19T04:26:43.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011335299 2024-04-19T04:26:43.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.866 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:43.866 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276034+0000", 2024-04-19T04:26:43.866 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.5740000000000001e-05 2024-04-19T04:26:43.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.866 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.867 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.867 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.276089+0000", 2024-04-19T04:26:43.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.5186999999999999e-05 2024-04-19T04:26:43.867 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.867 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.867 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.867 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.867 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:93738 5.d 5:bfc741e9:::benchmark_data_smithi007_19526_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T04:26:43.867 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:43.867 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 74.583022775000003, 2024-04-19T04:26:43.867 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052153603999999999, 2024-04-19T04:26:43.867 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.867 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:43.868 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.868 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.868 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.868 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 93738 2024-04-19T04:26:43.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.868 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:43.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.868 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.868 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.868 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228237+0000", 2024-04-19T04:26:43.868 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228236+0000", 2024-04-19T04:26:43.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:43.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228351+0000", 2024-04-19T04:26:43.869 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000115098 2024-04-19T04:26:43.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.869 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.869 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.869 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228358+0000", 2024-04-19T04:26:43.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.3139999999999998e-06 2024-04-19T04:26:43.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228363+0000", 2024-04-19T04:26:43.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.0209999999999999e-06 2024-04-19T04:26:43.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.870 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228409+0000", 2024-04-19T04:26:43.870 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.5664999999999997e-05 2024-04-19T04:26:43.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.870 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.870 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:43.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228504+0000", 2024-04-19T04:26:43.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.5336999999999999e-05 2024-04-19T04:26:43.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:43.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.228594+0000", 2024-04-19T04:26:43.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.0098000000000004e-05 2024-04-19T04:26:43.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.871 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.871 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:43.871 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.264288+0000", 2024-04-19T04:26:43.871 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.035693711000000003 2024-04-19T04:26:43.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:43.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280314+0000", 2024-04-19T04:26:43.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.016026186000000001 2024-04-19T04:26:43.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:43.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280361+0000", 2024-04-19T04:26:43.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6486000000000002e-05 2024-04-19T04:26:43.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.872 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.872 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.872 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:25:29.280390+0000", 2024-04-19T04:26:43.872 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9747000000000002e-05 2024-04-19T04:26:43.872 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.873 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.873 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.873 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.873 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172359 5.f 5:f5efa132:::benchmark_data_smithi007_19526_object46625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:43.873 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:43.873 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.858375617, 2024-04-19T04:26:43.873 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.097569430999999998, 2024-04-19T04:26:43.873 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.873 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:43.873 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.873 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.873 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.873 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172359 2024-04-19T04:26:43.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.874 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:43.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.874 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952884+0000", 2024-04-19T04:26:43.874 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.874 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952883+0000", 2024-04-19T04:26:43.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:43.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952886+0000", 2024-04-19T04:26:43.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.678e-06 2024-04-19T04:26:43.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.875 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952892+0000", 2024-04-19T04:26:43.875 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4049999999999999e-06 2024-04-19T04:26:43.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.875 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.875 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952896+0000", 2024-04-19T04:26:43.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3320000000000002e-06 2024-04-19T04:26:43.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952926+0000", 2024-04-19T04:26:43.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9825999999999999e-05 2024-04-19T04:26:43.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:43.876 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953001+0000", 2024-04-19T04:26:43.876 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.4936000000000002e-05 2024-04-19T04:26:43.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.876 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.876 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:43.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.953064+0000", 2024-04-19T04:26:43.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.2996000000000005e-05 2024-04-19T04:26:43.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:43.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955412+0000", 2024-04-19T04:26:43.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0023483129999999999 2024-04-19T04:26:43.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.877 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:43.877 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050242+0000", 2024-04-19T04:26:43.877 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094830347999999995 2024-04-19T04:26:43.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.877 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:43.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050341+0000", 2024-04-19T04:26:43.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.8275000000000004e-05 2024-04-19T04:26:43.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.878 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.878 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.050453+0000", 2024-04-19T04:26:43.878 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011270299999999999 2024-04-19T04:26:43.878 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.878 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.878 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.878 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.878 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172362 5.9 5:948c62da:::benchmark_data_smithi007_19526_object46628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:43.878 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:43.879 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.858335201000003, 2024-04-19T04:26:43.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.100332584, 2024-04-19T04:26:43.879 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.879 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:43.879 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.879 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.879 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.879 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172362 2024-04-19T04:26:43.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.879 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.879 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.879 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.879 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:43.879 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:43.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952924+0000", 2024-04-19T04:26:43.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:43.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.880 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.880 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952927+0000", 2024-04-19T04:26:43.880 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.9749999999999999e-06 2024-04-19T04:26:43.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952934+0000", 2024-04-19T04:26:43.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.9659999999999999e-06 2024-04-19T04:26:43.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.952939+0000", 2024-04-19T04:26:43.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.4709999999999998e-06 2024-04-19T04:26:43.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.881 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.881 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.881 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.954880+0000", 2024-04-19T04:26:43.881 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.001940989 2024-04-19T04:26:43.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:43.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955024+0000", 2024-04-19T04:26:43.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000143738 2024-04-19T04:26:43.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:43.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.955137+0000", 2024-04-19T04:26:43.882 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000113304 2024-04-19T04:26:43.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.882 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.882 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:43.882 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.958997+0000", 2024-04-19T04:26:43.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0038597359999999999 2024-04-19T04:26:43.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:43.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053158+0000", 2024-04-19T04:26:43.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.094161139000000005 2024-04-19T04:26:43.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:43.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053209+0000", 2024-04-19T04:26:43.883 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1433e-05 2024-04-19T04:26:43.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.883 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.883 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.883 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053257+0000", 2024-04-19T04:26:43.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.7429999999999998e-05 2024-04-19T04:26:43.884 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.884 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.884 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.884 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.884 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172364 5.9 5:9b193058:::benchmark_data_smithi007_19526_object46630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T04:26:43.884 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:43.884 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.854638891999997, 2024-04-19T04:26:43.884 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.096917094999999995, 2024-04-19T04:26:43.884 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.884 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:43.884 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.884 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.885 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.885 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172364 2024-04-19T04:26:43.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.885 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:43.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.885 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.885 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956621+0000", 2024-04-19T04:26:43.885 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.886 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.886 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956620+0000", 2024-04-19T04:26:43.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:43.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.886 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.886 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956625+0000", 2024-04-19T04:26:43.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.2739999999999998e-06 2024-04-19T04:26:43.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.886 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.886 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.886 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956635+0000", 2024-04-19T04:26:43.886 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.0526999999999999e-05 2024-04-19T04:26:43.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956641+0000", 2024-04-19T04:26:43.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3530000000000002e-06 2024-04-19T04:26:43.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.956952+0000", 2024-04-19T04:26:43.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00031088099999999999 2024-04-19T04:26:43.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.887 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:43.887 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957141+0000", 2024-04-19T04:26:43.887 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000189672 2024-04-19T04:26:43.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:43.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.957287+0000", 2024-04-19T04:26:43.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000145966 2024-04-19T04:26:43.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:43.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:03.959421+0000", 2024-04-19T04:26:43.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.002133715 2024-04-19T04:26:43.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.888 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.888 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:43.888 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053340+0000", 2024-04-19T04:26:43.888 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.093918752999999994 2024-04-19T04:26:43.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:43.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053417+0000", 2024-04-19T04:26:43.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.6919e-05 2024-04-19T04:26:43.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.889 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.889 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.053538+0000", 2024-04-19T04:26:43.889 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00012092299999999999 2024-04-19T04:26:43.889 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.889 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.889 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.889 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.889 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172762 5.1 5:82acc45b:::benchmark_data_smithi007_19526_object47028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:43.890 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:43.890 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.601028417999999, 2024-04-19T04:26:43.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.052249598000000001, 2024-04-19T04:26:43.890 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.890 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:43.890 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.890 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.890 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.890 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172762 2024-04-19T04:26:43.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.890 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.890 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.890 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.890 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:43.890 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:43.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210231+0000", 2024-04-19T04:26:43.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:43.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.891 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.891 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.891 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210234+0000", 2024-04-19T04:26:43.891 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.754e-06 2024-04-19T04:26:43.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210243+0000", 2024-04-19T04:26:43.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.2309999999999996e-06 2024-04-19T04:26:43.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.210257+0000", 2024-04-19T04:26:43.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.4551e-05 2024-04-19T04:26:43.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.892 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.892 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.892 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251066+0000", 2024-04-19T04:26:43.892 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.040809350000000001 2024-04-19T04:26:43.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.893 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:43.893 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.251217+0000", 2024-04-19T04:26:43.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000150495 2024-04-19T04:26:43.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.893 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:43.893 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262345+0000", 2024-04-19T04:26:43.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.011128008 2024-04-19T04:26:43.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.893 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.893 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:43.893 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262397+0000", 2024-04-19T04:26:43.893 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1569e-05 2024-04-19T04:26:43.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.894 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.894 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.262481+0000", 2024-04-19T04:26:43.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4116000000000006e-05 2024-04-19T04:26:43.894 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.894 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.894 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.894 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172766 5.1 5:89738f4c:::benchmark_data_smithi007_19526_object47032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:43.894 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:43.894 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.598735005999998, 2024-04-19T04:26:43.894 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.05178278, 2024-04-19T04:26:43.895 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.895 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:43.895 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.895 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.895 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.895 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172766 2024-04-19T04:26:43.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.895 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.895 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.895 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:43.895 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:43.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212524+0000", 2024-04-19T04:26:43.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:43.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.896 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.896 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212529+0000", 2024-04-19T04:26:43.896 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.9869999999999999e-06 2024-04-19T04:26:43.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.896 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212537+0000", 2024-04-19T04:26:43.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.4710000000000007e-06 2024-04-19T04:26:43.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212553+0000", 2024-04-19T04:26:43.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.5529999999999999e-05 2024-04-19T04:26:43.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.897 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.897 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.253934+0000", 2024-04-19T04:26:43.897 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.041381392000000003 2024-04-19T04:26:43.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.897 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.898 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:43.898 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.254108+0000", 2024-04-19T04:26:43.898 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00017441000000000001 2024-04-19T04:26:43.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.898 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:43.898 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264217+0000", 2024-04-19T04:26:43.898 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.010108647 2024-04-19T04:26:43.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.898 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:43.898 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264249+0000", 2024-04-19T04:26:43.898 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1990999999999999e-05 2024-04-19T04:26:43.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.899 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.899 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264307+0000", 2024-04-19T04:26:43.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.8254999999999997e-05 2024-04-19T04:26:43.899 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.899 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.899 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.899 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.899 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:172770 5.1 5:82f0c453:::benchmark_data_smithi007_19526_object47036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:43.899 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:43.899 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 39.598689190000002, 2024-04-19T04:26:43.899 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.051824497999999997, 2024-04-19T04:26:43.899 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.899 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:43.900 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.900 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.900 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.900 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 172770 2024-04-19T04:26:43.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.900 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:43.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.900 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.900 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.900 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:43.900 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212570+0000", 2024-04-19T04:26:43.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:43.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212573+0000", 2024-04-19T04:26:43.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.1829999999999998e-06 2024-04-19T04:26:43.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.901 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.901 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.901 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212578+0000", 2024-04-19T04:26:43.901 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.3700000000000003e-06 2024-04-19T04:26:43.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.212582+0000", 2024-04-19T04:26:43.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.7000000000000002e-06 2024-04-19T04:26:43.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257135+0000", 2024-04-19T04:26:43.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.044553293000000001 2024-04-19T04:26:43.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.902 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.902 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:43.902 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.257402+0000", 2024-04-19T04:26:43.902 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00026626800000000001 2024-04-19T04:26:43.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.903 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:43.903 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264316+0000", 2024-04-19T04:26:43.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0069142040000000002 2024-04-19T04:26:43.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.903 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:43.903 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264344+0000", 2024-04-19T04:26:43.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 2.8008e-05 2024-04-19T04:26:43.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.903 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.903 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.903 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.264395+0000", 2024-04-19T04:26:43.903 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.096e-05 2024-04-19T04:26:43.904 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.904 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.904 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.904 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174342 5.9 5:9c8a7ba3:::benchmark_data_smithi007_19526_object48608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:43.904 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:43.904 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 38.913532490000001, 2024-04-19T04:26:43.904 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068615152999999998, 2024-04-19T04:26:43.904 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.904 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:43.904 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.904 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.904 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.904 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174342 2024-04-19T04:26:43.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.905 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:43.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.905 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897727+0000", 2024-04-19T04:26:43.905 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.905 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.905 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897726+0000", 2024-04-19T04:26:43.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:43.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897731+0000", 2024-04-19T04:26:43.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1449999999999999e-06 2024-04-19T04:26:43.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.906 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897744+0000", 2024-04-19T04:26:43.906 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 1.2833000000000001e-05 2024-04-19T04:26:43.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.906 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.906 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897749+0000", 2024-04-19T04:26:43.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1540000000000001e-06 2024-04-19T04:26:43.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897810+0000", 2024-04-19T04:26:43.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0724999999999999e-05 2024-04-19T04:26:43.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:43.907 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897920+0000", 2024-04-19T04:26:43.907 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00011024 2024-04-19T04:26:43.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.907 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.907 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:43.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.897993+0000", 2024-04-19T04:26:43.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 7.2335000000000005e-05 2024-04-19T04:26:43.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:43.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.899597+0000", 2024-04-19T04:26:43.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0016048919999999999 2024-04-19T04:26:43.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:43.908 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966230+0000", 2024-04-19T04:26:43.908 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.066632882000000004 2024-04-19T04:26:43.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.908 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.908 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:43.909 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966296+0000", 2024-04-19T04:26:43.909 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.5361e-05 2024-04-19T04:26:43.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.909 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.909 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966342+0000", 2024-04-19T04:26:43.909 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.6476e-05 2024-04-19T04:26:43.909 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.909 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.909 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.909 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.909 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174344 5.d 5:b06b3311:::benchmark_data_smithi007_19526_object48610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:43.909 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:43.910 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 38.912853652000003, 2024-04-19T04:26:43.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.068211329000000001, 2024-04-19T04:26:43.910 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.910 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:43.910 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.910 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.910 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.910 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174344 2024-04-19T04:26:43.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.910 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.910 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.910 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:43.910 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898406+0000", 2024-04-19T04:26:43.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898405+0000", 2024-04-19T04:26:43.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:43.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.911 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.911 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.911 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898409+0000", 2024-04-19T04:26:43.911 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.5149999999999998e-06 2024-04-19T04:26:43.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898415+0000", 2024-04-19T04:26:43.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.0959999999999997e-06 2024-04-19T04:26:43.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898419+0000", 2024-04-19T04:26:43.912 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.89e-06 2024-04-19T04:26:43.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.912 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.912 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898459+0000", 2024-04-19T04:26:43.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.0017e-05 2024-04-19T04:26:43.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:43.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898540+0000", 2024-04-19T04:26:43.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.1237999999999997e-05 2024-04-19T04:26:43.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:43.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.898606+0000", 2024-04-19T04:26:43.913 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 6.6060000000000001e-05 2024-04-19T04:26:43.913 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.913 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.913 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:43.913 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.901321+0000", 2024-04-19T04:26:43.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0027152109999999999 2024-04-19T04:26:43.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:43.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966512+0000", 2024-04-19T04:26:43.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.065190440000000002 2024-04-19T04:26:43.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.914 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:43.914 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966563+0000", 2024-04-19T04:26:43.914 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.1436e-05 2024-04-19T04:26:43.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.914 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.915 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.915 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.966617+0000", 2024-04-19T04:26:43.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 5.401e-05 2024-04-19T04:26:43.915 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.915 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.915 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.915 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.915 INFO:teuthology.orchestra.run.smithi027.stdout: "description": "osd_op(client.4746.0:174346 5.f 5:fb8fd04f:::benchmark_data_smithi007_19526_object48612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:43.915 INFO:teuthology.orchestra.run.smithi027.stdout: "initiated_at": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:43.915 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 38.911067424999999, 2024-04-19T04:26:43.915 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.067185536000000004, 2024-04-19T04:26:43.915 INFO:teuthology.orchestra.run.smithi027.stdout: "type_data": { 2024-04-19T04:26:43.915 INFO:teuthology.orchestra.run.smithi027.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:43.915 INFO:teuthology.orchestra.run.smithi027.stdout: "client_info": { 2024-04-19T04:26:43.916 INFO:teuthology.orchestra.run.smithi027.stdout: "client": "client.4746", 2024-04-19T04:26:43.916 INFO:teuthology.orchestra.run.smithi027.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:43.916 INFO:teuthology.orchestra.run.smithi027.stdout: "tid": 174346 2024-04-19T04:26:43.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.916 INFO:teuthology.orchestra.run.smithi027.stdout: "events": [ 2024-04-19T04:26:43.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "initiated", 2024-04-19T04:26:43.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:43.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.916 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.916 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "throttled", 2024-04-19T04:26:43.916 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900192+0000", 2024-04-19T04:26:43.916 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0 2024-04-19T04:26:43.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "header_read", 2024-04-19T04:26:43.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900191+0000", 2024-04-19T04:26:43.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4294967295.999999 2024-04-19T04:26:43.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "all_read", 2024-04-19T04:26:43.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900196+0000", 2024-04-19T04:26:43.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3329999999999998e-06 2024-04-19T04:26:43.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.917 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "dispatched", 2024-04-19T04:26:43.917 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900206+0000", 2024-04-19T04:26:43.917 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 9.9699999999999994e-06 2024-04-19T04:26:43.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "queued_for_pg", 2024-04-19T04:26:43.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900210+0000", 2024-04-19T04:26:43.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 4.3359999999999997e-06 2024-04-19T04:26:43.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "reached_pg", 2024-04-19T04:26:43.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900243+0000", 2024-04-19T04:26:43.918 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 3.2669999999999997e-05 2024-04-19T04:26:43.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.918 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "started", 2024-04-19T04:26:43.918 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900365+0000", 2024-04-19T04:26:43.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000122648 2024-04-19T04:26:43.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "waiting for subops from 2", 2024-04-19T04:26:43.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.900559+0000", 2024-04-19T04:26:43.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.00019358799999999999 2024-04-19T04:26:43.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "op_commit", 2024-04-19T04:26:43.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.903018+0000", 2024-04-19T04:26:43.919 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.0024592300000000002 2024-04-19T04:26:43.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.919 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.919 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "sub_op_commit_rec", 2024-04-19T04:26:43.919 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967180+0000", 2024-04-19T04:26:43.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.064161587000000006 2024-04-19T04:26:43.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.920 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "commit_sent", 2024-04-19T04:26:43.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967293+0000", 2024-04-19T04:26:43.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 0.000112921 2024-04-19T04:26:43.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-04-19T04:26:43.920 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-04-19T04:26:43.920 INFO:teuthology.orchestra.run.smithi027.stdout: "event": "done", 2024-04-19T04:26:43.920 INFO:teuthology.orchestra.run.smithi027.stdout: "time": "2024-04-19T04:26:04.967378+0000", 2024-04-19T04:26:43.920 INFO:teuthology.orchestra.run.smithi027.stdout: "duration": 8.5000999999999995e-05 2024-04-19T04:26:43.920 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.920 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.920 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.920 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-04-19T04:26:43.921 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-04-19T04:26:43.921 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-04-19T04:26:43.922 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T04:26:44.041 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:44.041 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:44.041 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 0 2024-04-19T04:26:44.041 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:44.051 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T04:26:44.158 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:44.158 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-19T04:26:44.158 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-19T04:26:44.158 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-19T04:26:44.158 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:44.168 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T04:26:44.278 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-19T04:26:44.278 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-19T04:26:44.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-19T04:26:44.278 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-19T04:26:44.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.279 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68127 5.0 5:081e5006:::benchmark_data_smithi007_19526_object68126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:44.279 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:44.279 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 88.326168120000006, 2024-04-19T04:26:44.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.032400859, 2024-04-19T04:26:44.279 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.279 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:44.279 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.279 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.279 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.279 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68127 2024-04-19T04:26:44.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.280 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:44.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951341+0000", 2024-04-19T04:26:44.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951328+0000", 2024-04-19T04:26:44.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999876 2024-04-19T04:26:44.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951422+0000", 2024-04-19T04:26:44.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3442000000000004e-05 2024-04-19T04:26:44.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951449+0000", 2024-04-19T04:26:44.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7552999999999999e-05 2024-04-19T04:26:44.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951460+0000", 2024-04-19T04:26:44.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0815999999999999e-05 2024-04-19T04:26:44.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951511+0000", 2024-04-19T04:26:44.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0503000000000001e-05 2024-04-19T04:26:44.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:44.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951703+0000", 2024-04-19T04:26:44.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019247099999999999 2024-04-19T04:26:44.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:44.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.951880+0000", 2024-04-19T04:26:44.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017669699999999999 2024-04-19T04:26:44.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:44.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.955656+0000", 2024-04-19T04:26:44.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037765020000000002 2024-04-19T04:26:44.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967156+0000", 2024-04-19T04:26:44.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011499476 2024-04-19T04:26:44.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:44.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967169+0000", 2024-04-19T04:26:44.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3529e-05 2024-04-19T04:26:44.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983659+0000", 2024-04-19T04:26:44.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164896290000001 2024-04-19T04:26:44.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983742+0000", 2024-04-19T04:26:44.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2565000000000007e-05 2024-04-19T04:26:44.284 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.284 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.285 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.285 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68136 5.0 5:0c86492e:::benchmark_data_smithi007_19526_object68135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:44.285 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:44.285 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 88.321106474000004, 2024-04-19T04:26:44.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0309527199999999, 2024-04-19T04:26:44.285 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.285 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:44.285 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.285 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.285 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.285 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68136 2024-04-19T04:26:44.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.286 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:44.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956402+0000", 2024-04-19T04:26:44.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956401+0000", 2024-04-19T04:26:44.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:44.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956464+0000", 2024-04-19T04:26:44.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2570000000000006e-05 2024-04-19T04:26:44.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956479+0000", 2024-04-19T04:26:44.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5681000000000001e-05 2024-04-19T04:26:44.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956487+0000", 2024-04-19T04:26:44.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3699999999999997e-06 2024-04-19T04:26:44.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956542+0000", 2024-04-19T04:26:44.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5000000000000002e-05 2024-04-19T04:26:44.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:44.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956757+0000", 2024-04-19T04:26:44.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021570700000000001 2024-04-19T04:26:44.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:44.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956898+0000", 2024-04-19T04:26:44.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014017700000000001 2024-04-19T04:26:44.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967203+0000", 2024-04-19T04:26:44.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010305022 2024-04-19T04:26:44.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:44.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967211+0000", 2024-04-19T04:26:44.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-19T04:26:44.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984972+0000", 2024-04-19T04:26:44.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017761176 2024-04-19T04:26:44.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.987355+0000", 2024-04-19T04:26:44.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023829620000000002 2024-04-19T04:26:44.290 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.291 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.291 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.291 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68137 5.e 5:77beae44:::benchmark_data_smithi007_19526_object68136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:44.291 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:44.291 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 88.321006561999994, 2024-04-19T04:26:44.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0271145129999999, 2024-04-19T04:26:44.291 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.291 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:44.291 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.291 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.291 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.291 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68137 2024-04-19T04:26:44.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.292 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:44.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:44.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956502+0000", 2024-04-19T04:26:44.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:44.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956545+0000", 2024-04-19T04:26:44.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2925e-05 2024-04-19T04:26:44.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956556+0000", 2024-04-19T04:26:44.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1024e-05 2024-04-19T04:26:44.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956564+0000", 2024-04-19T04:26:44.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0150000000000003e-06 2024-04-19T04:26:44.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957010+0000", 2024-04-19T04:26:44.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044640199999999999 2024-04-19T04:26:44.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:44.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957336+0000", 2024-04-19T04:26:44.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032613899999999998 2024-04-19T04:26:44.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:44.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.957612+0000", 2024-04-19T04:26:44.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027535400000000001 2024-04-19T04:26:44.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970896+0000", 2024-04-19T04:26:44.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013284103 2024-04-19T04:26:44.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:44.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970901+0000", 2024-04-19T04:26:44.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6869999999999999e-06 2024-04-19T04:26:44.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983529+0000", 2024-04-19T04:26:44.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012627253 2024-04-19T04:26:44.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983617+0000", 2024-04-19T04:26:44.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8280000000000002e-05 2024-04-19T04:26:44.297 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.297 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.297 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.297 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68139 5.e 5:77960a36:::benchmark_data_smithi007_19526_object68138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:44.297 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:44.297 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 88.320880809000002, 2024-04-19T04:26:44.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.027228005, 2024-04-19T04:26:44.298 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.298 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:44.298 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.298 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.298 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.298 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68139 2024-04-19T04:26:44.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.298 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:44.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956628+0000", 2024-04-19T04:26:44.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956627+0000", 2024-04-19T04:26:44.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:44.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956692+0000", 2024-04-19T04:26:44.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5102000000000001e-05 2024-04-19T04:26:44.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956714+0000", 2024-04-19T04:26:44.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1370999999999999e-05 2024-04-19T04:26:44.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.956723+0000", 2024-04-19T04:26:44.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4250000000000004e-06 2024-04-19T04:26:44.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962280+0000", 2024-04-19T04:26:44.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055565359999999999 2024-04-19T04:26:44.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:44.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962492+0000", 2024-04-19T04:26:44.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000212826 2024-04-19T04:26:44.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-19T04:26:44.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.962891+0000", 2024-04-19T04:26:44.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039884700000000003 2024-04-19T04:26:44.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970927+0000", 2024-04-19T04:26:44.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080361110000000003 2024-04-19T04:26:44.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:44.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.970931+0000", 2024-04-19T04:26:44.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0759999999999996e-06 2024-04-19T04:26:44.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983776+0000", 2024-04-19T04:26:44.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.012844096 2024-04-19T04:26:44.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983856+0000", 2024-04-19T04:26:44.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999998e-05 2024-04-19T04:26:44.303 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.303 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.303 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.303 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68144 5.b 5:d7ba8e42:::benchmark_data_smithi007_19526_object68143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T04:26:44.303 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:44.304 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 88.317036864000002, 2024-04-19T04:26:44.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0280879860000001, 2024-04-19T04:26:44.304 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.304 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:44.304 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.304 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.304 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.304 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68144 2024-04-19T04:26:44.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.304 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:44.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960472+0000", 2024-04-19T04:26:44.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960471+0000", 2024-04-19T04:26:44.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-19T04:26:44.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960515+0000", 2024-04-19T04:26:44.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4218000000000003e-05 2024-04-19T04:26:44.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960526+0000", 2024-04-19T04:26:44.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1423999999999999e-05 2024-04-19T04:26:44.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.960535+0000", 2024-04-19T04:26:44.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5110000000000003e-06 2024-04-19T04:26:44.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968196+0000", 2024-04-19T04:26:44.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007661195 2024-04-19T04:26:44.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:44.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968201+0000", 2024-04-19T04:26:44.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-19T04:26:44.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983619+0000", 2024-04-19T04:26:44.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.015417633 2024-04-19T04:26:44.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:44.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.983821+0000", 2024-04-19T04:26:44.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210599999999999 2024-04-19T04:26:44.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:44.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988442+0000", 2024-04-19T04:26:44.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046205609999999996 2024-04-19T04:26:44.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:44.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988485+0000", 2024-04-19T04:26:44.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3411000000000002e-05 2024-04-19T04:26:44.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988560+0000", 2024-04-19T04:26:44.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5019999999999997e-05 2024-04-19T04:26:44.309 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.309 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.309 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.309 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68133 5.4 5:28e66a1e:::benchmark_data_smithi007_19526_object68132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:44.309 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:44.309 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 88.309865763000005, 2024-04-19T04:26:44.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016743331, 2024-04-19T04:26:44.310 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.310 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:44.310 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.310 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.310 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.310 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68133 2024-04-19T04:26:44.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.310 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:44.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967643+0000", 2024-04-19T04:26:44.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967641+0000", 2024-04-19T04:26:44.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-19T04:26:44.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967718+0000", 2024-04-19T04:26:44.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6505e-05 2024-04-19T04:26:44.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967790+0000", 2024-04-19T04:26:44.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2494000000000001e-05 2024-04-19T04:26:44.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967805+0000", 2024-04-19T04:26:44.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4908e-05 2024-04-19T04:26:44.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:44.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1490999999999998e-05 2024-04-19T04:26:44.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:44.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967875+0000", 2024-04-19T04:26:44.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4500000000000004e-06 2024-04-19T04:26:44.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984131+0000", 2024-04-19T04:26:44.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0162561139999999 2024-04-19T04:26:44.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984386+0000", 2024-04-19T04:26:44.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025539200000000001 2024-04-19T04:26:44.314 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.314 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.314 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.314 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68140 5.4 5:2fa6dd9e:::benchmark_data_smithi007_19526_object68139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:44.314 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:44.314 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 88.309693659000004, 2024-04-19T04:26:44.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0170543430000001, 2024-04-19T04:26:44.314 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.314 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-19T04:26:44.314 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.314 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.315 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.315 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68140 2024-04-19T04:26:44.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.315 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:44.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:44.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967815+0000", 2024-04-19T04:26:44.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:44.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967857+0000", 2024-04-19T04:26:44.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577000000000002e-05 2024-04-19T04:26:44.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967866+0000", 2024-04-19T04:26:44.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-19T04:26:44.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967872+0000", 2024-04-19T04:26:44.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.336e-06 2024-04-19T04:26:44.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967903+0000", 2024-04-19T04:26:44.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1508999999999999e-05 2024-04-19T04:26:44.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:44.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967910+0000", 2024-04-19T04:26:44.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3350000000000003e-06 2024-04-19T04:26:44.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984798+0000", 2024-04-19T04:26:44.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0168880229999999 2024-04-19T04:26:44.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984870+0000", 2024-04-19T04:26:44.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1822000000000005e-05 2024-04-19T04:26:44.318 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68142 5.4 5:265d165d:::benchmark_data_smithi007_19526_object68141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 88.309630533999993, 2024-04-19T04:26:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0263082210000001, 2024-04-19T04:26:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68142 2024-04-19T04:26:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967878+0000", 2024-04-19T04:26:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967979+0000", 2024-04-19T04:26:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101607 2024-04-19T04:26:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967987+0000", 2024-04-19T04:26:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9829999999999996e-06 2024-04-19T04:26:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.967995+0000", 2024-04-19T04:26:44.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8509999999999999e-06 2024-04-19T04:26:44.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968036+0000", 2024-04-19T04:26:44.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0620000000000001e-05 2024-04-19T04:26:44.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:44.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968043+0000", 2024-04-19T04:26:44.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1899999999999998e-06 2024-04-19T04:26:44.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.984893+0000", 2024-04-19T04:26:44.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.016849449 2024-04-19T04:26:44.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:44.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.985053+0000", 2024-04-19T04:26:44.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016080099999999999 2024-04-19T04:26:44.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:44.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994042+0000", 2024-04-19T04:26:44.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089883719999999997 2024-04-19T04:26:44.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:44.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994104+0000", 2024-04-19T04:26:44.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2428999999999995e-05 2024-04-19T04:26:44.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.994187+0000", 2024-04-19T04:26:44.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2429999999999995e-05 2024-04-19T04:26:44.324 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.324 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.324 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.324 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68143 5.a 5:5a4c278d:::benchmark_data_smithi007_19526_object68142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:44.325 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:44.325 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 88.309501936999993, 2024-04-19T04:26:44.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.02094782, 2024-04-19T04:26:44.325 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.325 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:44.325 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.325 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.325 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.325 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68143 2024-04-19T04:26:44.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.325 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:44.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968007+0000", 2024-04-19T04:26:44.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968006+0000", 2024-04-19T04:26:44.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:44.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968048+0000", 2024-04-19T04:26:44.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1896e-05 2024-04-19T04:26:44.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968056+0000", 2024-04-19T04:26:44.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7149999999999998e-06 2024-04-19T04:26:44.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968063+0000", 2024-04-19T04:26:44.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2620000000000001e-06 2024-04-19T04:26:44.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968110+0000", 2024-04-19T04:26:44.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6921e-05 2024-04-19T04:26:44.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:44.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968117+0000", 2024-04-19T04:26:44.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.109e-06 2024-04-19T04:26:44.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.980925+0000", 2024-04-19T04:26:44.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0128072749999999 2024-04-19T04:26:44.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:44.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.982897+0000", 2024-04-19T04:26:44.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019722139999999999 2024-04-19T04:26:44.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:44.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988818+0000", 2024-04-19T04:26:44.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059212839999999997 2024-04-19T04:26:44.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:44.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988870+0000", 2024-04-19T04:26:44.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1514000000000002e-05 2024-04-19T04:26:44.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.988955+0000", 2024-04-19T04:26:44.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-19T04:26:44.330 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.330 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.330 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.330 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:68145 5.a 5:56fd977b:::benchmark_data_smithi007_19526_object68144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T04:26:44.330 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:44.330 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 88.309433966, 2024-04-19T04:26:44.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.023094967, 2024-04-19T04:26:44.331 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.331 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:44.331 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.331 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.331 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.331 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 68145 2024-04-19T04:26:44.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.331 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:44.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968075+0000", 2024-04-19T04:26:44.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968074+0000", 2024-04-19T04:26:44.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:44.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968111+0000", 2024-04-19T04:26:44.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6443999999999999e-05 2024-04-19T04:26:44.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968119+0000", 2024-04-19T04:26:44.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7759999999999997e-06 2024-04-19T04:26:44.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968125+0000", 2024-04-19T04:26:44.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:44.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968163+0000", 2024-04-19T04:26:44.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7873000000000001e-05 2024-04-19T04:26:44.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-19T04:26:44.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:15.968171+0000", 2024-04-19T04:26:44.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-04-19T04:26:44.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986113+0000", 2024-04-19T04:26:44.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.017942586 2024-04-19T04:26:44.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:44.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.986256+0000", 2024-04-19T04:26:44.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014231899999999999 2024-04-19T04:26:44.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:44.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989355+0000", 2024-04-19T04:26:44.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003099189 2024-04-19T04:26:44.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:44.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.989418+0000", 2024-04-19T04:26:44.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000006e-05 2024-04-19T04:26:44.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:25:16.991170+0000", 2024-04-19T04:26:44.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001752331 2024-04-19T04:26:44.336 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.336 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.336 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.336 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174315 5.e 5:728646f8:::benchmark_data_smithi007_19526_object48581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:44.336 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:44.336 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.389894300999998, 2024-04-19T04:26:44.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078453623, 2024-04-19T04:26:44.336 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.336 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:44.336 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.337 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.337 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.337 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174315 2024-04-19T04:26:44.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.337 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:44.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887615+0000", 2024-04-19T04:26:44.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887614+0000", 2024-04-19T04:26:44.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:44.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887618+0000", 2024-04-19T04:26:44.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-19T04:26:44.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887627+0000", 2024-04-19T04:26:44.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5609999999999999e-06 2024-04-19T04:26:44.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887634+0000", 2024-04-19T04:26:44.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.396e-06 2024-04-19T04:26:44.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889101+0000", 2024-04-19T04:26:44.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001466558 2024-04-19T04:26:44.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:44.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889247+0000", 2024-04-19T04:26:44.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145902 2024-04-19T04:26:44.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:44.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965893+0000", 2024-04-19T04:26:44.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.076646455000000002 2024-04-19T04:26:44.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:44.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965956+0000", 2024-04-19T04:26:44.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3200000000000005e-05 2024-04-19T04:26:44.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966068+0000", 2024-04-19T04:26:44.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011194800000000001 2024-04-19T04:26:44.341 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.341 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.341 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.341 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174316 5.e 5:7702674c:::benchmark_data_smithi007_19526_object48582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:44.341 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:44.341 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.389863304000002, 2024-04-19T04:26:44.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083782388999999999, 2024-04-19T04:26:44.341 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.341 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:44.341 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.342 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.342 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.342 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174316 2024-04-19T04:26:44.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.342 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:44.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887646+0000", 2024-04-19T04:26:44.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887645+0000", 2024-04-19T04:26:44.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:44.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887649+0000", 2024-04-19T04:26:44.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.817e-06 2024-04-19T04:26:44.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887657+0000", 2024-04-19T04:26:44.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6210000000000004e-06 2024-04-19T04:26:44.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.887664+0000", 2024-04-19T04:26:44.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1280000000000002e-06 2024-04-19T04:26:44.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891640+0000", 2024-04-19T04:26:44.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039760000000000004 2024-04-19T04:26:44.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:44.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891830+0000", 2024-04-19T04:26:44.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019033200000000001 2024-04-19T04:26:44.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:44.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971179+0000", 2024-04-19T04:26:44.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079349476000000002 2024-04-19T04:26:44.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:44.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971259+0000", 2024-04-19T04:26:44.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9083000000000002e-05 2024-04-19T04:26:44.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971428+0000", 2024-04-19T04:26:44.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169419 2024-04-19T04:26:44.346 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.346 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.346 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.346 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174323 5.e 5:7a9e43d6:::benchmark_data_smithi007_19526_object48589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:44.349 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:44.349 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.387541784, 2024-04-19T04:26:44.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081686998999999996, 2024-04-19T04:26:44.350 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.350 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:44.350 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.350 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.350 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.350 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174323 2024-04-19T04:26:44.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.350 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:44.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:44.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889967+0000", 2024-04-19T04:26:44.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-19T04:26:44.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889970+0000", 2024-04-19T04:26:44.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3119999999999998e-06 2024-04-19T04:26:44.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889977+0000", 2024-04-19T04:26:44.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7059999999999998e-06 2024-04-19T04:26:44.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.889982+0000", 2024-04-19T04:26:44.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4299999999999997e-06 2024-04-19T04:26:44.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893845+0000", 2024-04-19T04:26:44.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038629139999999998 2024-04-19T04:26:44.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:44.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.893928+0000", 2024-04-19T04:26:44.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2743000000000004e-05 2024-04-19T04:26:44.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:44.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971454+0000", 2024-04-19T04:26:44.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077525997999999999 2024-04-19T04:26:44.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:44.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971540+0000", 2024-04-19T04:26:44.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6285000000000005e-05 2024-04-19T04:26:44.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971654+0000", 2024-04-19T04:26:44.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114095 2024-04-19T04:26:44.354 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.354 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.354 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.355 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174327 5.e 5:770fc931:::benchmark_data_smithi007_19526_object48593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:44.355 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:44.355 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.386331402000003, 2024-04-19T04:26:44.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080734265999999999, 2024-04-19T04:26:44.355 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.355 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:44.355 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.355 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.355 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.356 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174327 2024-04-19T04:26:44.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.356 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:44.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:44.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891177+0000", 2024-04-19T04:26:44.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:44.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891183+0000", 2024-04-19T04:26:44.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-19T04:26:44.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891197+0000", 2024-04-19T04:26:44.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3932e-05 2024-04-19T04:26:44.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.891205+0000", 2024-04-19T04:26:44.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0250000000000002e-06 2024-04-19T04:26:44.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898334+0000", 2024-04-19T04:26:44.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007128728 2024-04-19T04:26:44.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:44.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898485+0000", 2024-04-19T04:26:44.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015119499999999999 2024-04-19T04:26:44.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:44.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971677+0000", 2024-04-19T04:26:44.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.073192023999999994 2024-04-19T04:26:44.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:44.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971771+0000", 2024-04-19T04:26:44.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4235999999999997e-05 2024-04-19T04:26:44.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971912+0000", 2024-04-19T04:26:44.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014055099999999999 2024-04-19T04:26:44.360 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.360 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.360 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.360 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174328 5.e 5:73d99edd:::benchmark_data_smithi007_19526_object48594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:44.360 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:44.360 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.385379911000001, 2024-04-19T04:26:44.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085645857000000006, 2024-04-19T04:26:44.360 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.361 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:44.361 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.361 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.361 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.361 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174328 2024-04-19T04:26:44.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.361 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:44.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892129+0000", 2024-04-19T04:26:44.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892128+0000", 2024-04-19T04:26:44.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:44.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892134+0000", 2024-04-19T04:26:44.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.604e-06 2024-04-19T04:26:44.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892145+0000", 2024-04-19T04:26:44.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1173e-05 2024-04-19T04:26:44.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.892152+0000", 2024-04-19T04:26:44.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7789999999999998e-06 2024-04-19T04:26:44.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900401+0000", 2024-04-19T04:26:44.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082498650000000003 2024-04-19T04:26:44.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:44.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900490+0000", 2024-04-19T04:26:44.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8300000000000005e-05 2024-04-19T04:26:44.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:44.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977634+0000", 2024-04-19T04:26:44.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077144335999999994 2024-04-19T04:26:44.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:44.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977699+0000", 2024-04-19T04:26:44.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4518999999999997e-05 2024-04-19T04:26:44.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.977775+0000", 2024-04-19T04:26:44.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6219999999999999e-05 2024-04-19T04:26:44.365 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.365 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.365 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.365 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174332 5.0 5:090f7750:::benchmark_data_smithi007_19526_object48598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:44.365 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:44.365 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.382372332999999, 2024-04-19T04:26:44.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075403611999999995, 2024-04-19T04:26:44.365 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.365 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:44.366 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.366 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.366 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.366 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174332 2024-04-19T04:26:44.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.366 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:44.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895137+0000", 2024-04-19T04:26:44.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895135+0000", 2024-04-19T04:26:44.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:44.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895142+0000", 2024-04-19T04:26:44.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-19T04:26:44.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895152+0000", 2024-04-19T04:26:44.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0076e-05 2024-04-19T04:26:44.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895159+0000", 2024-04-19T04:26:44.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2790000000000001e-06 2024-04-19T04:26:44.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895271+0000", 2024-04-19T04:26:44.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112112 2024-04-19T04:26:44.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:44.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895401+0000", 2024-04-19T04:26:44.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129663 2024-04-19T04:26:44.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:44.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970369+0000", 2024-04-19T04:26:44.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.074967992999999997 2024-04-19T04:26:44.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:44.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970419+0000", 2024-04-19T04:26:44.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9700999999999997e-05 2024-04-19T04:26:44.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970540+0000", 2024-04-19T04:26:44.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121512 2024-04-19T04:26:44.370 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.370 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.370 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.370 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174336 5.e 5:78f758ec:::benchmark_data_smithi007_19526_object48602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:44.370 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:44.371 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.381998209000002, 2024-04-19T04:26:44.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085171609999999995, 2024-04-19T04:26:44.371 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.371 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:44.371 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.371 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.371 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.371 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174336 2024-04-19T04:26:44.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.371 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:44.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895511+0000", 2024-04-19T04:26:44.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895510+0000", 2024-04-19T04:26:44.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:44.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895517+0000", 2024-04-19T04:26:44.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1219999999999997e-06 2024-04-19T04:26:44.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895529+0000", 2024-04-19T04:26:44.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2801e-05 2024-04-19T04:26:44.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895541+0000", 2024-04-19T04:26:44.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1123e-05 2024-04-19T04:26:44.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966154+0000", 2024-04-19T04:26:44.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.070613543000000001 2024-04-19T04:26:44.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:44.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.966382+0000", 2024-04-19T04:26:44.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022741800000000001 2024-04-19T04:26:44.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:44.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980581+0000", 2024-04-19T04:26:44.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014199916999999999 2024-04-19T04:26:44.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:44.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980621+0000", 2024-04-19T04:26:44.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9685999999999999e-05 2024-04-19T04:26:44.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980682+0000", 2024-04-19T04:26:44.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1130000000000006e-05 2024-04-19T04:26:44.375 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.375 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.375 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.375 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174339 5.8 5:1e2f02d5:::benchmark_data_smithi007_19526_object48605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:44.375 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:44.376 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.381908256999999, 2024-04-19T04:26:44.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.075073230000000005, 2024-04-19T04:26:44.376 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.376 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:44.376 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.376 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.376 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.376 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174339 2024-04-19T04:26:44.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.376 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:44.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895601+0000", 2024-04-19T04:26:44.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895600+0000", 2024-04-19T04:26:44.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:44.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895604+0000", 2024-04-19T04:26:44.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4410000000000003e-06 2024-04-19T04:26:44.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895613+0000", 2024-04-19T04:26:44.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-19T04:26:44.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.895620+0000", 2024-04-19T04:26:44.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6939999999999998e-06 2024-04-19T04:26:44.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898352+0000", 2024-04-19T04:26:44.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027322829999999998 2024-04-19T04:26:44.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:44.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.898480+0000", 2024-04-19T04:26:44.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776000000000001 2024-04-19T04:26:44.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:44.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970556+0000", 2024-04-19T04:26:44.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.072076192999999997 2024-04-19T04:26:44.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:44.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970608+0000", 2024-04-19T04:26:44.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2549000000000001e-05 2024-04-19T04:26:44.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.970674+0000", 2024-04-19T04:26:44.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5549000000000005e-05 2024-04-19T04:26:44.380 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.380 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.380 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.380 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174348 5.e 5:70a7bb5e:::benchmark_data_smithi007_19526_object48614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:44.380 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:44.380 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.37682126, 2024-04-19T04:26:44.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.080099220999999998, 2024-04-19T04:26:44.381 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.381 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:44.381 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.381 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.381 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.381 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174348 2024-04-19T04:26:44.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.381 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:44.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900688+0000", 2024-04-19T04:26:44.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900687+0000", 2024-04-19T04:26:44.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-19T04:26:44.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900689+0000", 2024-04-19T04:26:44.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9039999999999999e-06 2024-04-19T04:26:44.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900693+0000", 2024-04-19T04:26:44.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-19T04:26:44.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.900696+0000", 2024-04-19T04:26:44.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9849999999999998e-06 2024-04-19T04:26:44.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.971978+0000", 2024-04-19T04:26:44.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.071282358000000004 2024-04-19T04:26:44.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:44.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.972180+0000", 2024-04-19T04:26:44.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020191100000000001 2024-04-19T04:26:44.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:44.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980701+0000", 2024-04-19T04:26:44.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085211760000000001 2024-04-19T04:26:44.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:44.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980729+0000", 2024-04-19T04:26:44.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8068e-05 2024-04-19T04:26:44.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.980787+0000", 2024-04-19T04:26:44.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7521e-05 2024-04-19T04:26:44.385 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.385 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.385 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.385 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4746.0:174350 5.e 5:7f36609a:::benchmark_data_smithi007_19526_object48616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T04:26:44.385 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:44.385 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.375050188000003, 2024-04-19T04:26:44.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.079723622999999993, 2024-04-19T04:26:44.385 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-19T04:26:44.386 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T04:26:44.386 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-19T04:26:44.386 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4746", 2024-04-19T04:26:44.386 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.7:0/668027968", 2024-04-19T04:26:44.386 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 174350 2024-04-19T04:26:44.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.386 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-19T04:26:44.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-19T04:26:44.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:44.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-19T04:26:44.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902459+0000", 2024-04-19T04:26:44.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-19T04:26:44.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-19T04:26:44.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902458+0000", 2024-04-19T04:26:44.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-19T04:26:44.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-19T04:26:44.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.902463+0000", 2024-04-19T04:26:44.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5889999999999996e-06 2024-04-19T04:26:44.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-19T04:26:44.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965576+0000", 2024-04-19T04:26:44.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063113328999999996 2024-04-19T04:26:44.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-19T04:26:44.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.965614+0000", 2024-04-19T04:26:44.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8285999999999999e-05 2024-04-19T04:26:44.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-19T04:26:44.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974787+0000", 2024-04-19T04:26:44.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009172599 2024-04-19T04:26:44.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-19T04:26:44.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.974999+0000", 2024-04-19T04:26:44.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021270999999999999 2024-04-19T04:26:44.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-19T04:26:44.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982086+0000", 2024-04-19T04:26:44.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070869160000000004 2024-04-19T04:26:44.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-19T04:26:44.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982115+0000", 2024-04-19T04:26:44.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8603999999999999e-05 2024-04-19T04:26:44.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-19T04:26:44.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-19T04:26:44.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-19T04:26:44.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-19T04:26:04.982182+0000", 2024-04-19T04:26:44.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7350999999999999e-05 2024-04-19T04:26:44.390 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.390 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.390 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.390 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-19T04:26:44.390 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-19T04:26:44.390 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-19T04:26:44.893 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~88s 2024-04-19T04:26:45.438 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T04:26:46.427 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-04-19T04:26:46.440 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T04:26:47.442 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-04-19T04:26:50.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~94s 2024-04-19T04:26:56.509 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~100s 2024-04-19T04:27:02.317 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~105s 2024-04-19T04:27:08.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~111s 2024-04-19T04:27:13.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~117s 2024-04-19T04:27:19.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~123s 2024-04-19T04:27:25.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~129s 2024-04-19T04:27:31.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~135s 2024-04-19T04:27:37.159 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~140s 2024-04-19T04:27:42.967 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~146s 2024-04-19T04:27:48.587 DEBUG:teuthology.orchestra.console.smithi066:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A B6 F8 BD GUID: 00000000 0000 0000 0000 0CC47AA8B484 DHCP.|                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| CLIENT IP: 172.21.15.66 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:b6:f8:bd)... Configuring (net0 0c:c4:7a:b6:f8:bd).... Configuring (net0 0c:c4:7a:b6:f8:bd)..... Configuring (net0 0c:c4:7a:b6:f8:bd)...... ok  GNU GRUB version 2.04   ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     [ 0.000000] microcode: microcode updated early to revision 0x49, date = 2021-08-11 [ 0.000000] Linux version 5.4.0-177-generic (buildd@lcy02-amd64-112) (gcc version 9.4.0 (Ubuntu 9.4.0-1ubuntu1~20.04.2)) #197-Ubuntu SMP Thu Mar 28 22:45:47 UTC 2024 (Ubuntu 5.4.0-177.197-generic 5.4.268) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-177-generic root=UUID=1168b92c-82ac-47e1-87d9-5d77414c7738 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ea2fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f55000-0x000000007986ffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000079870000-0x0000000079d3cfff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d3d000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 3.4 06/05/2021 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.047 MHz processor [ 0.000995] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.001442] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.002000] last_pfn = 0x78ea3 max_arch_pfn = 0x400000000 [ 0.007508] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.007555] check: Scanning 1 areas for low memory corruption [ 0.007559] Using GB pages for direct mapping [ 0.007701] RAMDISK: [mem 0x3157d000-0x34ab5fff] [ 0.007706] ACPI: Early table checksum verification disabled [ 0.007709] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.007712] ACPI: XSDT 0x00000000798700A0 0000C4 (v01 01072009 AMI 00010013) [ 0.007716] ACPI: FACP 0x00000000798A20E0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007720] ACPI: DSDT 0x0000000079870200 031EE0 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.007723] ACPI: FACS 0x0000000079D3BF80 000040 [ 0.007725] ACPI: APIC 0x00000000798A21F0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007727] ACPI: FPDT 0x00000000798A22B8 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007729] ACPI: FIDT 0x00000000798A2300 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007730] ACPI: SPMI 0x00000000798A23A0 000041 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.007732] ACPI: MCFG 0x00000000798A23E8 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.007734] ACPI: UEFI 0x00000000798A2428 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.007736] ACPI: HPET 0x00000000798A2470 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007738] ACPI: NFIT 0x00000000798A24A8 018028 (v01 00000000 00000000) [ 0.007740] ACPI: WDDT 0x00000000798BA4D0 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.007742] ACPI: SSDT 0x00000000798BA510 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.007744] ACPI: NITR 0x00000000798D1690 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007746] ACPI: SSDT 0x00000000798D1708 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.007748] ACPI: SSDT 0x00000000798D3D58 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.007750] ACPI: PRAD 0x00000000798D3DC0 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.007752] ACPI: DMAR 0x00000000798D3EC8 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007754] ACPI: HEST 0x00000000798D3F88 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007756] ACPI: BERT 0x00000000798D4208 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007758] ACPI: ERST 0x00000000798D4238 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007760] ACPI: EINJ 0x00000000798D4468 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007762] ACPI: Reserving FACP table memory at [mem 0x798a20e0-0x798a21eb] [ 0.007763] ACPI: Reserving DSDT table memory at [mem 0x79870200-0x798a20df] [ 0.007763] ACPI: Reserving FACS table memory at [mem 0x79d3bf80-0x79d3bfbf] [ 0.007764] ACPI: Reserving APIC table memory at [mem 0x798a21f0-0x798a22b7] [ 0.007765] ACPI: Reserving FPDT table memory at [mem 0x798a22b8-0x798a22fb] [ 0.007765] ACPI: Reserving FIDT table memory at [mem 0x798a2300-0x798a239b] [ 0.007766] ACPI: Reserving SPMI table memory at [mem 0x798a23a0-0x798a23e0] [ 0.007767] ACPI: Reserving MCFG table memory at [mem 0x798a23e8-0x798a2423] [ 0.007767] ACPI: Reserving UEFI table memory at [mem 0x798a2428-0x798a2469] [ 0.007768] ACPI: Reserving HPET table memory at [mem 0x798a2470-0x798a24a7] [ 0.007769] ACPI: Reserving NFIT table memory at [mem 0x798a24a8-0x798ba4cf] [ 0.007769] ACPI: Reserving WDDT table memory at [mem 0x798ba4d0-0x798ba50f] [ 0.007770] ACPI: Reserving SSDT table memory at [mem 0x798ba510-0x798d168e] [ 0.007771] ACPI: Reserving NITR table memory at [mem 0x798d1690-0x798d1700] [ 0.007771] ACPI: Reserving SSDT table memory at [mem 0x798d1708-0x798d3d53] [ 0.007772] ACPI: Reserving SSDT table memory at [mem 0x798d3d58-0x798d3dbb] [ 0.007773] ACPI: Reserving PRAD table memory at [mem 0x798d3dc0-0x798d3ec1] [ 0.007773] ACPI: Reserving DMAR table memory at [mem 0x798d3ec8-0x798d3f83] [ 0.007774] ACPI: Reserving HEST table memory at [mem 0x798d3f88-0x798d4203] [ 0.007775] ACPI: Reserving BERT table memory at [mem 0x798d4208-0x798d4237] [ 0.007775] ACPI: Reserving ERST table memory at [mem 0x798d4238-0x798d4467] [ 0.007776] ACPI: Reserving EINJ table memory at [mem 0x798d4468-0x798d4597] [ 0.007848] No NUMA configuration found [ 0.007849] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.007858] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.008031] Zone ranges: [ 0.008032] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008033] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008034] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008035] Device empty [ 0.008035] Movable zone start for each node [ 0.008038] Early memory node ranges [ 0.008039] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.008040] node 0: [mem 0x0000000000100000-0x0000000078ea2fff] [ 0.008040] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008308] Zeroed struct page in unavailable ranges: 29140 pages [ 0.008309] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.094494] ACPI: PM-Timer IO Port: 0x408 [ 0.094502] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.094503] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.094504] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.094504] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.094505] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.094505] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.094506] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.094506] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.094516] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.094519] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.094521] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.094522] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.094525] Using ACPI (MADT) for SMP configuration information [ 0.094527] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.094530] TSC deadline timer available [ 0.094531] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.094540] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.094541] PM: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.094542] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.094543] PM: Registered nosave memory: [mem 0x78ea3000-0x78f54fff] [ 0.094544] PM: Registered nosave memory: [mem 0x78f55000-0x7986ffff] [ 0.094544] PM: Registered nosave memory: [mem 0x79870000-0x79d3cfff] [ 0.094545] PM: Registered nosave memory: [mem 0x79d3d000-0x8fffffff] [ 0.094545] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.094546] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.094546] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.094547] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.094548] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.094549] Booting paravirtualized kernel on bare hardware [ 0.094552] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.094556] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.094793] percpu: Embedded 60 pages/cpu s208896 r8192 d28672 u262144 [ 0.094817] Built 1 zonelists, mobility grouping on. Total pages: 8228828 [ 0.094818] Policy zone: Normal [ 0.094819] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-177-generic root=UUID=1168b92c-82ac-47e1-87d9-5d77414c7738 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.097450] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.098810] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.098892] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.176909] Memory: 32692508K/33437872K available (14339K kernel code, 2395K rwdata, 9292K rodata, 2768K init, 17228K bss, 745364K reserved, 0K cma-reserved) [ 0.177126] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.177140] Kernel/User page tables isolation: enabled [ 0.177167] ftrace: allocating 44725 entries in 175 pages [ 0.189897] ftrace: allocated 175 pages with 6 groups [ 0.190009] rcu: Hierarchical RCU implementation. [ 0.190010] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.190011] Tasks RCU enabled. [ 0.190012] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.190013] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.192120] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.192303] random: crng init done [ 0.197165] Console: colour VGA+ 80x25 [ 0.207813] printk: console [tty0] enabled [ 1.169563] printk: console [ttyS1] enabled [ 1.173817] ACPI: Core revision 20190816 [ 1.178015] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.187235] APIC: Switch to symmetric I/O mode setup [ 1.192272] DMAR: Host address width 46 [ 1.196173] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.201554] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap d2078c106f0466 ecap f020de [ 1.209554] DMAR: RMRR base: 0x0000007ba57000 end: 0x0000007ba66fff [ 1.215885] DMAR: ATSR flags: 0x0 [ 1.219267] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.225601] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.232023] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.238445] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.243911] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.243911] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.259040] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.264410] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.270692] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.295233] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32737d98d1a, max_idle_ns: 440795362231 ns [ 1.305833] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.09 BogoMIPS (lpj=14000188) [ 1.309868] mce: CPU0: Thermal monitoring enabled (TM1) [ 1.313878] process: using mwait in idle threads [ 1.317834] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024 [ 1.321832] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4 [ 1.325833] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.329833] Spectre V2 : Mitigation: Retpolines [ 1.333832] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.337832] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.341832] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.345833] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.349832] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.353833] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.357836] MDS: Mitigation: Clear CPU buffers [ 1.361832] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.365837] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.369832] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.373832] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.377833] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.381832] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.385974] Freeing SMP alternatives memory: 40K [ 1.395146] pid_max: default: 32768 minimum: 301 [ 1.397855] LSM: Security Framework initializing [ 1.401839] Yama: becoming mindful. [ 1.405859] AppArmor: AppArmor initialized [ 1.409900] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.413879] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.417842] *** VALIDATE tmpfs *** [ 1.421936] *** VALIDATE proc *** [ 1.425874] *** VALIDATE cgroup1 *** [ 1.429833] *** VALIDATE cgroup2 *** [ 1.434039] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz (family: 0x6, model: 0x3f, stepping: 0x2) [ 1.437899] Performance Events: PEBS fmt2+, Haswell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.441833] ... version: 3 [ 1.445832] ... bit width: 48 [ 1.449832] ... generic registers: 4 [ 1.453832] ... value mask: 0000ffffffffffff [ 1.457832] ... max period: 00007fffffffffff [ 1.461832] ... fixed-purpose events: 3 [ 1.465832] ... event mask: 000000070000000f [ 1.469861] rcu: Hierarchical SRCU implementation. [ 1.474687] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.477900] smp: Bringing up secondary CPUs ... [ 1.481906] x86: Booting SMP configuration: [ 1.485834] .... node #0, CPUs: #1 #2 #3 #4 [ 1.494550] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.501833] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.505941] #5 #6 #7 [ 1.506515] smp: Brought up 1 node, 8 CPUs [ 1.513834] smpboot: Max logical packages: 1 [ 1.517833] smpboot: Total of 8 processors activated (56000.75 BogoMIPS) [ 1.524277] devtmpfs: initialized [ 1.525869] x86/mm: Memory block size: 128MB [ 1.532873] PM: Registering ACPI NVS region [mem 0x79870000-0x79d3cfff] (5033984 bytes) [ 1.533912] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.537846] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.541879] pinctrl core: initialized pinctrl subsystem [ 1.545915] PM: RTC time: 04:27:21, date: 2024-04-19 [ 1.549926] NET: Registered protocol family 16 [ 1.553903] audit: initializing netlink subsys (disabled) [ 1.557840] audit: type=2000 audit(1713500839.328:1): state=initialized audit_enabled=0 res=1 [ 1.557915] EISA bus registered [ 1.565041] cpuidle: using governor ladder [ 1.565835] cpuidle: using governor menu [ 1.569848] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.573833] ACPI: bus type PCI registered [ 1.577833] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.581883] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.585835] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.589843] PCI: Using configuration type 1 for base access [ 1.593857] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 1.599839] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.601835] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.605897] ACPI: Added _OSI(Module Device) [ 1.609834] ACPI: Added _OSI(Processor Device) [ 1.613839] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.617833] ACPI: Added _OSI(Processor Aggregator Device) [ 1.621833] ACPI: Added _OSI(Linux-Dell-Video) [ 1.625832] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.629832] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.677137] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.681244] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.685954] ACPI: Dynamic OEM Table Load: [ 1.714551] ACPI: Interpreter enabled [ 1.717844] ACPI: (supports S0 S4 S5) [ 1.721566] ACPI: Using IOAPIC for interrupt routing [ 1.721855] HEST: Enabling Firmware First mode for corrected errors. [ 1.725923] HEST: Table parsing has been initialized. [ 1.729834] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.734537] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.770660] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.773837] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 1.783885] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR] [ 1.794815] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.801833] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.809868] PCI host bridge to bus 0000:ff [ 1.813835] pci_bus 0000:ff: root bus resource [bus ff] [ 1.821842] pci 0000:ff:0b.0: [8086:2f81] type 00 class 0x088000 [ 1.825892] pci 0000:ff:0b.1: [8086:2f36] type 00 class 0x110100 [ 1.833883] pci 0000:ff:0b.2: [8086:2f37] type 00 class 0x110100 [ 1.837882] pci 0000:ff:0c.0: [8086:2fe0] type 00 class 0x088000 [ 1.845881] pci 0000:ff:0c.1: [8086:2fe1] type 00 class 0x088000 [ 1.849885] pci 0000:ff:0c.2: [8086:2fe2] type 00 class 0x088000 [ 1.857884] pci 0000:ff:0c.3: [8086:2fe3] type 00 class 0x088000 [ 1.861882] pci 0000:ff:0f.0: [8086:2ff8] type 00 class 0x088000 [ 1.869884] pci 0000:ff:0f.1: [8086:2ff9] type 00 class 0x088000 [ 1.873881] pci 0000:ff:0f.4: [8086:2ffc] type 00 class 0x088000 [ 1.881881] pci 0000:ff:0f.5: [8086:2ffd] type 00 class 0x088000 [ 1.885881] pci 0000:ff:0f.6: [8086:2ffe] type 00 class 0x088000 [ 1.893881] pci 0000:ff:10.0: [8086:2f1d] type 00 class 0x088000 [ 1.897881] pci 0000:ff:10.1: [8086:2f34] type 00 class 0x110100 [ 1.905881] pci 0000:ff:10.5: [8086:2f1e] type 00 class 0x088000 [ 1.909880] pci 0000:ff:10.6: [8086:2f7d] type 00 class 0x110100 [ 1.917883] pci 0000:ff:10.7: [8086:2f1f] type 00 class 0x088000 [ 1.925880] pci 0000:ff:12.0: [8086:2fa0] type 00 class 0x088000 [ 1.929883] pci 0000:ff:12.1: [8086:2f30] type 00 class 0x110100 [ 1.937886] pci 0000:ff:13.0: [8086:2fa8] type 00 class 0x088000 [ 1.941884] pci 0000:ff:13.1: [8086:2f71] type 00 class 0x088000 [ 1.949884] pci 0000:ff:13.2: [8086:2faa] type 00 class 0x088000 [ 1.953884] pci 0000:ff:13.3: [8086:2fab] type 00 class 0x088000 [ 1.961888] pci 0000:ff:13.4: [8086:2fac] type 00 class 0x088000 [ 1.965888] pci 0000:ff:13.5: [8086:2fad] type 00 class 0x088000 [ 1.973884] pci 0000:ff:13.6: [8086:2fae] type 00 class 0x088000 [ 1.977882] pci 0000:ff:13.7: [8086:2faf] type 00 class 0x088000 [ 1.985883] pci 0000:ff:14.0: [8086:2fb0] type 00 class 0x088000 [ 1.989885] pci 0000:ff:14.1: [8086:2fb1] type 00 class 0x088000 [ 1.997885] pci 0000:ff:14.2: [8086:2fb2] type 00 class 0x088000 [ 2.001884] pci 0000:ff:14.3: [8086:2fb3] type 00 class 0x088000 [ 2.009884] pci 0000:ff:14.4: [8086:2fbc] type 00 class 0x088000 [ 2.013888] pci 0000:ff:14.5: [8086:2fbd] type 00 class 0x088000 [ 2.021882] pci 0000:ff:14.6: [8086:2fbe] type 00 class 0x088000 [ 2.029882] pci 0000:ff:14.7: [8086:2fbf] type 00 class 0x088000 [ 2.033882] pci 0000:ff:15.0: [8086:2fb4] type 00 class 0x088000 [ 2.041885] pci 0000:ff:15.1: [8086:2fb5] type 00 class 0x088000 [ 2.045885] pci 0000:ff:15.2: [8086:2fb6] type 00 class 0x088000 [ 2.053885] pci 0000:ff:15.3: [8086:2fb7] type 00 class 0x088000 [ 2.057890] pci 0000:ff:16.0: [8086:2f68] type 00 class 0x088000 [ 2.065889] pci 0000:ff:16.6: [8086:2f6e] type 00 class 0x088000 [ 2.069883] pci 0000:ff:16.7: [8086:2f6f] type 00 class 0x088000 [ 2.077883] pci 0000:ff:17.0: [8086:2fd0] type 00 class 0x088000 [ 2.081884] pci 0000:ff:17.4: [8086:2fb8] type 00 class 0x088000 [ 2.089884] pci 0000:ff:17.5: [8086:2fb9] type 00 class 0x088000 [ 2.093883] pci 0000:ff:17.6: [8086:2fba] type 00 class 0x088000 [ 2.101883] pci 0000:ff:17.7: [8086:2fbb] type 00 class 0x088000 [ 2.105886] pci 0000:ff:1e.0: [8086:2f98] type 00 class 0x088000 [ 2.113886] pci 0000:ff:1e.1: [8086:2f99] type 00 class 0x088000 [ 2.117884] pci 0000:ff:1e.2: [8086:2f9a] type 00 class 0x088000 [ 2.125882] pci 0000:ff:1e.3: [8086:2fc0] type 00 class 0x088000 [ 2.133856] pci 0000:ff:1e.4: [8086:2f9c] type 00 class 0x088000 [ 2.137883] pci 0000:ff:1f.0: [8086:2f88] type 00 class 0x088000 [ 2.145883] pci 0000:ff:1f.2: [8086:2f8a] type 00 class 0x088000 [ 2.153725] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.161836] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 2.178144] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR] [ 2.186264] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.193833] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.202103] PCI host bridge to bus 0000:00 [ 2.205834] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.213833] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.217833] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.225833] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.233833] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.241834] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.249833] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.253839] pci 0000:00:00.0: [8086:2f00] type 00 class 0x060000 [ 2.261981] pci 0000:00:01.0: [8086:2f02] type 01 class 0x060400 [ 2.265904] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.273965] pci 0000:00:02.0: [8086:2f04] type 01 class 0x060400 [ 2.281903] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.285957] pci 0000:00:03.0: [8086:2f08] type 01 class 0x060400 [ 2.293903] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.297953] pci 0000:00:04.0: [8086:2f20] type 00 class 0x088000 [ 2.305852] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.313973] pci 0000:00:04.1: [8086:2f21] type 00 class 0x088000 [ 2.317851] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.325969] pci 0000:00:04.2: [8086:2f22] type 00 class 0x088000 [ 2.329851] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.337968] pci 0000:00:04.3: [8086:2f23] type 00 class 0x088000 [ 2.345851] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.349968] pci 0000:00:04.4: [8086:2f24] type 00 class 0x088000 [ 2.357851] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.365970] pci 0000:00:04.5: [8086:2f25] type 00 class 0x088000 [ 2.369852] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.377973] pci 0000:00:04.6: [8086:2f26] type 00 class 0x088000 [ 2.381851] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.389968] pci 0000:00:04.7: [8086:2f27] type 00 class 0x088000 [ 2.397851] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.401967] pci 0000:00:05.0: [8086:2f28] type 00 class 0x088000 [ 2.409951] pci 0000:00:05.1: [8086:2f29] type 00 class 0x088000 [ 2.413971] pci 0000:00:05.2: [8086:2f2a] type 00 class 0x088000 [ 2.421950] pci 0000:00:05.4: [8086:2f2c] type 00 class 0x080020 [ 2.429847] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.433971] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.442056] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.445856] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.453844] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.457844] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.465844] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.469844] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.473844] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.481875] pci 0000:00:11.4: PME# supported from D3hot [ 2.485938] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.493859] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.501906] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.505921] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.513859] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.517910] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.525918] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.529859] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.537910] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.545929] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.549858] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.557935] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.561923] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.569924] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.573933] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.581925] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.589933] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.593924] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.601936] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.605858] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.613935] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.617932] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.626045] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.629854] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.637843] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.641843] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.649843] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.653843] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.657843] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.665869] pci 0000:00:1f.2: PME# supported from D3hot [ 2.669918] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.677857] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.685863] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.690071] acpiphp: Slot [1] registered [ 2.693850] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.697980] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.705855] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.713873] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.717837] pci 0000:02:00.0: enabling Extended Tags [ 2.725929] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.729835] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.737984] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.741856] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.749842] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.753855] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.761842] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.769876] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.773854] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.781834] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.793846] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.801833] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.809968] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.817855] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.825842] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.829854] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.837841] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.845876] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.849850] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.857833] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.869845] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.877833] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.885960] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.889834] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.897834] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.905834] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.913864] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.917891] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.921924] pci 0000:05:00.0: enabling Extended Tags [ 2.929911] pci 0000:05:00.0: supports D1 D2 [ 2.933833] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.937927] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.945835] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.949834] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.957881] pci_bus 0000:06: extended config space not accessible [ 2.965861] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.969862] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.977849] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.981849] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.989951] pci 0000:06:00.0: supports D1 D2 [ 2.993833] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.997937] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.005839] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.009836] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.017911] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 3.025868] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 3.029860] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 3.037847] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 3.041964] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 3.049871] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.057834] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.065859] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.073833] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.085938] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 3.089869] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 3.097860] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 3.101846] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 3.109963] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 3.113870] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.121833] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.133858] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.141833] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.149990] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.153835] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.161834] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.177838] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 3.182725] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 *11 12 14 15) [ 3.189882] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *10 11 12 14 15) [ 3.197879] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15) [ 3.205879] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15) [ 3.213879] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.221879] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.229879] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.237879] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.246058] iommu: Default domain type: Translated [ 3.249966] SCSI subsystem initialized [ 3.253854] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 3.257832] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 3.269833] pci 0000:06:00.0: vgaarb: bridge control possible [ 3.273832] vgaarb: loaded [ 3.276611] ACPI: bus type USB registered [ 3.281843] usbcore: registered new interface driver usbfs [ 3.285838] usbcore: registered new interface driver hub [ 3.293837] usbcore: registered new device driver usb [ 3.297854] pps_core: LinuxPPS API ver. 1 registered [ 3.301832] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 3.313834] PTP clock support registered [ 3.317841] EDAC MC: Ver: 3.0.0 [ 3.321148] PCI: Using ACPI for IRQ routing [ 3.327208] NetLabel: Initializing [ 3.333833] NetLabel: domain hash size = 128 [ 3.337832] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 3.341843] NetLabel: unlabeled traffic allowed by default [ 3.350611] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 3.353834] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 3.363870] clocksource: Switched to clocksource tsc-early [ 3.376698] *** VALIDATE bpf *** [ 3.380044] VFS: Disk quotas dquot_6.6.0 [ 3.384038] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 3.390996] *** VALIDATE ramfs *** [ 3.394464] *** VALIDATE hugetlbfs *** [ 3.398342] AppArmor: AppArmor Filesystem Enabled [ 3.403136] pnp: PnP ACPI init [ 3.406720] system 00:01: [io 0x0500-0x057f] has been reserved [ 3.412703] system 00:01: [io 0x0400-0x047f] has been reserved [ 3.418689] system 00:01: [io 0x0580-0x059f] has been reserved [ 3.424668] system 00:01: [io 0x0600-0x061f] has been reserved [ 3.430648] system 00:01: [io 0x0880-0x0883] has been reserved [ 3.436628] system 00:01: [io 0x0800-0x081f] has been reserved [ 3.442609] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 3.449287] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 3.455967] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 3.462648] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 3.469321] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 3.475994] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 3.482668] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 3.489552] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 3.495536] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 3.501516] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.507496] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.513475] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.520375] pnp: PnP ACPI: found 5 devices [ 3.525478] thermal_sys: Registered thermal governor 'fair_share' [ 3.525479] thermal_sys: Registered thermal governor 'bang_bang' [ 3.531633] thermal_sys: Registered thermal governor 'step_wise' [ 3.537699] thermal_sys: Registered thermal governor 'user_space' [ 3.543765] thermal_sys: Registered thermal governor 'power_allocator' [ 3.554404] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.569978] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.581547] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.589462] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.594505] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.599538] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.606396] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.614049] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.622047] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.629787] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.637874] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.645524] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.653526] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.661263] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.669352] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.677002] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.685004] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.692741] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.700829] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.708480] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.716482] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.724219] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.732305] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.737333] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.743495] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.750350] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.758181] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.763222] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.768248] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.774411] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.781276] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.786561] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.792722] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.799585] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.807415] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.815326] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.823153] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.831064] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.836089] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.842253] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.849107] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.856939] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.863185] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.869424] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.876358] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 3.883293] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 3.890227] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 3.897169] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.903502] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.909134] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.915461] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.922761] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.928392] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.934720] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.940351] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.946679] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.952311] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.958638] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.966065] NET: Registered protocol family 2 [ 3.970679] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.979916] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.988926] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.997347] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 4.004886] TCP: Hash tables configured (established 262144 bind 65536) [ 4.011645] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 4.018668] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 4.026124] NET: Registered protocol family 1 [ 4.030548] NET: Registered protocol family 44 [ 4.035123] pci 0000:00:05.0: disabled boot interrupts on device [8086:2f28] [ 4.065702] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x670 took 22733 usecs [ 4.097697] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x670 took 23923 usecs [ 4.105191] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 4.111706] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 4.120175] Trying to unpack rootfs image as initramfs... [ 4.232074] Freeing initrd memory: 54500K [ 4.261560] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.268068] software IO TLB: mapped [mem 0x74ea3000-0x78ea3000] (64MB) [ 4.282729] check: Scanning for low memory corruption every 60 seconds [ 4.289769] Initialise system trusted keyrings [ 4.294286] Key type blacklist registered [ 4.298381] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 4.305770] zbud: loaded [ 4.308620] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 4.314625] fuse: init (API version 7.31) [ 4.318714] *** VALIDATE fuse *** [ 4.322089] *** VALIDATE fuse *** [ 4.325541] Platform Keyring initialized [ 4.332510] Key type asymmetric registered [ 4.336667] Asymmetric key parser 'x509' registered [ 4.341614] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244) [ 4.349118] io scheduler mq-deadline registered [ 4.354095] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 4.360109] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 4.366119] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 4.372080] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 4.378050] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 4.384014] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 4.389919] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 4.397306] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 4.405763] ACPI: Power Button [PWRB] [ 4.409516] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 4.417021] ACPI: Power Button [PWRF] [ 4.422015] ERST: Error Record Serialization Table (ERST) support is initialized. [ 4.429586] pstore: Registered erst as persistent store backend [ 4.435752] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 4.443332] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 4.470257] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 4.498195] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 4.506634] Linux agpgart interface v0.103 [ 4.641627] loop: module loaded [ 4.645027] tun: Universal TUN/TAP device driver, 1.6 [ 4.650198] PPP generic driver version 2.4.2 [ 4.654590] VFIO - User Level meta-driver version: 0.3 [ 4.659883] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 4.666478] ehci-pci: EHCI PCI platform driver [ 4.671134] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 4.676428] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 4.683913] ehci-pci 0000:00:1a.0: debug port 2 [ 4.692417] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported [ 4.699278] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 4.717623] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 4.723464] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.731808] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.739110] usb usb1: Product: EHCI Host Controller [ 4.744055] usb usb1: Manufacturer: Linux 5.4.0-177-generic ehci_hcd [ 4.750469] usb usb1: SerialNumber: 0000:00:1a.0 [ 4.755239] hub 1-0:1.0: USB hub found [ 4.759060] hub 1-0:1.0: 2 ports detected [ 4.763360] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 4.768656] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 4.776142] ehci-pci 0000:00:1d.0: debug port 2 [ 4.784641] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported [ 4.791495] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.809597] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.815436] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.823786] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.831091] usb usb2: Product: EHCI Host Controller [ 4.836033] usb usb2: Manufacturer: Linux 5.4.0-177-generic ehci_hcd [ 4.842448] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.847212] hub 2-0:1.0: USB hub found [ 4.851028] hub 2-0:1.0: 2 ports detected [ 4.855233] ehci-platform: EHCI generic platform driver [ 4.860529] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.866774] ohci-pci: OHCI PCI platform driver [ 4.871294] ohci-platform: OHCI generic platform driver [ 4.876590] uhci_hcd: USB Universal Host Controller Interface driver [ 4.883145] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.888439] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.896967] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.906189] xhci_hcd 0000:00:14.0: cache line size of 64 is not supported [ 4.913162] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.918456] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.925930] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.932280] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.940632] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.947933] usb usb3: Product: xHCI Host Controller [ 4.952877] usb usb3: Manufacturer: Linux 5.4.0-177-generic xhci-hcd [ 4.959291] usb usb3: SerialNumber: 0000:00:14.0 [ 4.964051] hub 3-0:1.0: USB hub found [ 4.967876] hub 3-0:1.0: 15 ports detected [ 4.972652] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.04 [ 4.981001] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.988303] usb usb4: Product: xHCI Host Controller [ 4.993245] usb usb4: Manufacturer: Linux 5.4.0-177-generic xhci-hcd [ 4.999664] usb usb4: SerialNumber: 0000:00:14.0 [ 5.004426] hub 4-0:1.0: USB hub found [ 5.008248] hub 4-0:1.0: 6 ports detected [ 5.012628] usb: port power management may be unreliable [ 5.018105] i8042: PNP: No PS/2 controller found. [ 5.021564] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 5.022925] mousedev: PS/2 mouse device common for all mice [ 5.035191] rtc_cmos 00:00: RTC can wake from S4 [ 5.040055] rtc_cmos 00:00: registered as rtc0 [ 5.044570] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 5.052311] i2c /dev entries driver [ 5.055890] device-mapper: uevent: version 1.0.3 [ 5.060629] device-mapper: ioctl: 4.41.0-ioctl (2019-09-16) initialised: dm-devel@redhat.com [ 5.069166] platform eisa.0: Probing EISA bus 0 [ 5.073762] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 5.080611] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 5.087117] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 5.093617] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 5.100116] platform eisa0: Cannot allocate resource for EISA slot 4 [ 5.106619] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 5.109563] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 5.113127] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 5.126224] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 5.132730] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 5.139240] platform eisa.0: EISA: Detected 0 cards [ 5.144190] intel_pstate: Intel P-state driver initializing [ 5.150618] ledtrig-cpu: registered to indicate activity on CPUs [ 5.156792] drop_monitor: Initializing network drop monitor service [ 5.163239] NET: Registered protocol family 10 [ 5.172172] Segment Routing with IPv6 [ 5.175911] NET: Registered protocol family 17 [ 5.180481] Key type dns_resolver registered [ 5.185196] RAS: Correctable Errors collector initialized. [ 5.190765] microcode: sig=0x306f2, pf=0x1, revision=0x49 [ 5.194038] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 5.204489] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.204561] microcode: Microcode Update Driver: v2.2. [ 5.211771] *** VALIDATE rdt *** [ 5.211807] hub 1-1:1.0: USB hub found [ 5.216897] resctrl: L3 monitoring detected [ 5.224181] hub 1-1:1.0: 6 ports detected [ 5.228243] IPI shorthand broadcast: enabled [ 5.229563] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.243340] sched_clock: Marking stable (4205790332, 1037534164)->(5564400928, -321076432) [ 5.251764] registered taskstats version 1 [ 5.255937] Loading compiled-in X.509 certificates [ 5.261397] Loaded X.509 cert 'Build time autogenerated kernel key: 1224c9b81ccdd6d5fadad4fbd6b8ad2b6b069117' [ 5.271892] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 5.281911] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 5.282207] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 5.290208] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.300259] blacklist: Loading compiled-in revocation X.509 certificates [ 5.307675] hub 2-1:1.0: USB hub found [ 5.314223] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 5.314242] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 5.314257] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 5.314271] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 5.314293] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 5.314307] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 5.314322] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 5.314338] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 5.314352] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 5.314400] zswap: loaded using pool lzo/zbud [ 5.318160] hub 2-1:1.0: 8 ports detected [ 5.324277] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 5.324325] Key type ._fscrypt registered [ 5.324325] Key type .fscrypt registered [ 5.324413] pstore: Using crash dump compression: deflate [ 5.328314] Key type big_key registered [ 5.330140] Key type encrypted registered [ 5.330142] AppArmor: AppArmor sha1 policy hashing enabled [ 5.330148] ima: No TPM chip found, activating TPM-bypass! [ 5.330150] ima: Allocated hash algorithm: sha1 [ 5.330156] ima: No architecture policies found [ 5.330163] evm: Initialising EVM extended attributes: [ 5.330164] evm: security.selinux [ 5.330164] evm: security.SMACK64 [ 5.330165] evm: security.SMACK64EXEC [ 5.330165] evm: security.SMACK64TRANSMUTE [ 5.330165] evm: security.SMACK64MMAP [ 5.330166] evm: security.apparmor [ 5.330166] evm: security.ima [ 5.330167] evm: security.capability [ 5.330167] evm: HMAC attrs: 0x1 [ 5.330788] PM: Magic number: 4:762:464 [ 5.334182] rtc_cmos 00:00: setting system clock to 2024-04-19T04:27:25 UTC (1713500845) [ 5.377768] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.535557] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.535564] clocksource: Switched to clocksource tsc [ 5.535905] hub 3-12:1.0: USB hub found [ 5.535985] hub 3-12:1.0: 4 ports detected [ 5.556272] Freeing unused decrypted memory: 2040K [ 5.561484] Freeing unused kernel image memory: 2768K [ 5.585649] Write protecting the kernel read-only data: 26624k [ 5.591901] Freeing unused kernel image memory: 2036K [ 5.597168] Freeing unused kernel image memory: 948K [ 5.609218] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.615720] x86/mm: Checking user space page tables [ 5.627306] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.633808] Run /init as init process Loading, please wait... Starting version 245.4-4ubuntu3.17 [ 5.754750] dca service started, version 1.12.1 [ 5.759775] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 5.770415] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 5.770437] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.6.0-k [ 5.778620] ahci 0000:00:11.4: flags: 64bit ncq led clo pio slum part ems apst [ 5.793048] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.798715] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k [ 5.806480] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.822180] scsi host0: ahci [ 5.825244] scsi host1: ahci [ 5.833360] scsi host2: ahci [ 5.841568] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.8487[ 5.854079] a1: SATA max UDMAfb438100 irq 33 [ 5.861559] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 5.869036] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 5.876515] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 5.884482] igb 0000:07:00.0: added PHC on eth0 [ 5.889093] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.896031] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:a8:b4:84 [ 5.903314] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.908514] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.916217] nvme nvme0: pci function 0000:02:00.0 [ 5.921101] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.929358] ahci 0000:00:1f.2: flags: 64bit ncq led clo pio slum part ems apst [ 5.981894] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.990419] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.992715] igb 0000:07:00.1: added PHC on eth1 [ 6.002504] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.009444] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:a8:b4:85 [ 6.016721] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.016725] hidraw: raw HID events driver (C) Jiri Kosina [ 6.021920] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.022216] scsi host4: ahci [ 6.026089] nvme nvme0: 8/0/0 default/read/poll queues [ 6.043262] scsi host5: ahci [ 6.046312] scsi host6: ahci [ 6.049418] scsi host7: ahci [ 6.052449] scsi host8: ahci [ 6.055509] scsi host9: ahci [ 6.058482] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 43 [ 6.065964] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 43 [ 6.073441] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 43 [ 6.080921] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 43 [ 6.088401] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 43 [ 6.095880] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 43 [ 6.196775] ata1: SATA link down (SStatus 0 SControl 300) [ 6.202260] ata4: SATA link down (SStatus 0 SControl 300) [ 6.207734] ata3: SATA link down (SStatus 0 SControl 300) [ 6.213212] ata2: SATA link down (SStatus 0 SControl 300) [ 6.417003] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.423259] ata10: SATA link down (SStatus 0 SControl 300) [ 6.428821] ata6: SATA link down (SStatus 0 SControl 300) [ 6.434298] ata7: SATA link down (SStatus 0 SControl 300) [ 6.439775] ata8: SATA link down (SStatus 0 SControl 300) [ 6.445254] ata9: SATA link down (SStatus 0 SControl 300) [ 6.451084] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN04, max UDMA/133 [ 6.457421] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.465536] ata5.00: configured for UDMA/133 [ 6.469994] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN04 PQ: 0 ANSI: 5 [ 6.478265] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.478314] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.491387] sd 4:0:0:0: [sda] Write Protect is off [ 6.496253] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.525339] sda: sda1 [ 6.541801] sd 4:0:0:0: [sda] Attached SCSI disk [ 6.548014] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.554337] usbcore: registered new interface driver usbhid [ 6.559975] usbhid: USB HID core driver [ 6.566218] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.581623] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.641730] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.653651] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.665440] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 7.049593] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.059960] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.068554] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.074799] ixgbe 0000:03:00.0: 0c:c4:7a:b6:f8:bc [ 7.081579] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.249573] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.259942] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.268542] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.275652] ixgbe 0000:03:00.1: 0c:c4:7a:b6:f8:bd [ 7.283317] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.290741] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 7.313958] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.34 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 8794 (uid=0, gid=0, mode=0100644, size=2954080) /dev/sda1: Clearing orphaned inode 8351 (uid=0, gid=0, mode=0100644, size=30936) /dev/sda1: clean, 303185/61054976 files, 7993486/244190336 blocks done. [ 13.437021] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.159546] systemd[1]: Inserted module 'autofs4' [ 14.206869] systemd[1]: systemd 245.4-4ubuntu3.17 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid) [ 14.249676] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 20.04.4 LTS! [ 14.309940] systemd[1]: Set hostname to . [ 15.531211] systemd[1]: Created slice system-modprobe.slice. [ OK ] Created slice system-modprobe.slice. [ 15.554044] systemd[1]: Created slice system-serial\x2dgetty.slice. [ OK ] Created slice system-serial\x2dgetty.slice. [ 15.577939] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 15.597767] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 15.622052] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 15.649707] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 15.685678] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 15.713694] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 15.741662] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 15.769664] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 15.797659] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 15.825639] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 15.845688] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 15.865730] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 15.889841] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 15.912673] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 15.937741] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 15.957693] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 15.981679] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 16.005799] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 16.025725] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 16.045785] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 16.065781] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 16.085809] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 16.106414] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 16.126484] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 16.150313] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 16.174268] systemd[1]: Mounting RPC Pipe File System... Mounting RPC Pipe File System... [ 16.194483] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 16.214682] systemd[1]: Mounting Kernel Trace File System... Mounting Kerne[ 16.221820] RPC: Registered named UNIX socket transport module. l Trace File Sys[ 16.229268] RPC: Registered udp transport module. tem... [ 16.235410] RPC: Registered tcp transport module. [ 16.241190] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 16.248820] systemd[1]: Starting Journal Service... Starting Journal Service... [ 16.269635] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 16.280119] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 16.302503] systemd[1]: Starting Create list of static device nodes for the current kernel... Starting Create list of st…odes for the current kernel... [ 16.327264] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 16.334493] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 16.362308] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 16.381615] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 16.392169] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped. [ 16.401322] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 16.411521] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 16.430479] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 16.446430] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr [ 16.454616] systemd[1]: Starting udev Coldplug all Devices... [ 16.459620] lp: driver loaded but no devices found Starting udev Coldplug all Devices... [ 16.476741] Loading iSCSI transport class v2.0-870. [ 16.482310] systemd[1]: Starting Uncomplicated firewall... Starting Uncomplicated firewall... [ 16.503005] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted RPC Pipe File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create list of st… nodes for the current kernel. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Finished Uncomplicated firewall. Activating swap /swapfile... Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting pNFS block layout mapping daemon... Starting Flush Journal to Persistent Storage... [ 16.813253] systemd-journald[366]: Received client request to flush runtime journal. [ 16.813570] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished udev Coldplug all Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Reached target Swap. Starting Helper to synchronize boot up for ifupdown... [ 17.043640] systemd-journald[366]: File /var/log/journal/a3be24a71451430bbe7befa8e4390c43/system.journal corrupted or uncleanly shut down, renaming and replacing. [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Preprocess NFS configuration... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting udev Kernel Device Manager... [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Set console font and keymap. [ OK ] Finished Preprocess NFS configuration. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. Starting NFSv4 ID-name mapping service... [ OK ] Reached target NFS client services. [ OK ] Finished Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Finished Create Volatile Files and Directories. Starting RPC bind portmap service... Starting Update UTMP about System Boot/Shutdown... [ OK ] Finished Update UTMP about System Boot/Shutdown. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Started udev Kernel Device Manager. [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. Starting Network Service... [ OK ] Started RPC bind portmap service. [ OK ] Finished Load AppArmor profiles. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API. [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. [ OK ] Started Network Service. [ OK ] Listening on Docker Socket for the API. [ OK ] Found device /dev/ttyS1. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice system-lvm2\x2dpvscan.slice. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK  LTTng session daemon. Starting LVM event activation on device 259:0... Starting Dispatcher daemon for systemd-networkd... [ OK ] Started Set the CPU Frequency Scaling governor. Starting System Logging Service... Starting [0;1;39…g Technology ... Starting Resets System Activity Data Collector... Starting Login Service... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Found device 82599ES 10-Gi…ion (AOC-STGN-I2S [REV 1.01]). [ OK ] Finished Resets System Activity Data Collector. [ OK ] Started ifup for enp3s0f1. [ OK ] Started System Logging Service. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Finished GRUB failed boot detection. [ OK ] Finished Helper to synchronize boot up for ifupdown. Starting Raise network interfaces... [ OK ] Started Login Service. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [* ] (1 of 2) A start job is running for… network interfaces (8s / 5min 4s) M  Stopping Network Name Resolution... [ OK ] Stopped Network Name Resolution. Starting Network Name Resolution... [ OK ] Started Network Name Resolution. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. Starting NFS server and services... [ OK ] Started Network Time Service. [ OK ] Started OpenBSD Secure Shell server. [ OK ] Started (i)SCSI target daemon. [ OK ] Finished NFS server and services. [ OK ] Finished Wait for Network to be Configured. [ OK ] Reached target Network is Online. Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr Starting Ubuntu FAN network setup... ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Finished Map RBD devices. + myips=172.21.15.66 + attempts=1 + sleep 1 + '[' 172.21.15.66 '!=' '' ']' + set -e + '[' -n 172.21.15.66 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.66 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.66 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi066.front.sepia.ceph.com + '[' -n smithi066.front.sepia.ceph.com ']' + hostname smithi066.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi066 + echo smithi066 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.66 smithi066.front.sepia.ceph.com smithi066/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice system-getty.slice. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started LSB: Collectl monitors system performance.. Ubuntu 20.04.4 LTS smithi066.front.sepia.ceph.com ttyS1 2024-04-19T04:27:48.588 DEBUG:teuthology.orchestra.console.smithi066:expect after: smithi066 login: 2024-04-19T04:27:48.640 DEBUG:teuthology.orchestra.console.smithi066:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A B6 F8 BD GUID: 00000000 0000 0000 0000 0CC47AA8B484 DHCP.|                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| CLIENT IP: 172.21.15.66 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:b6:f8:bd)... Configuring (net0 0c:c4:7a:b6:f8:bd).... Configuring (net0 0c:c4:7a:b6:f8:bd)..... Configuring (net0 0c:c4:7a:b6:f8:bd)...... ok  GNU GRUB version 2.04   ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     [ 0.000000] microcode: microcode updated early to revision 0x49, date = 2021-08-11 [ 0.000000] Linux version 5.4.0-177-generic (buildd@lcy02-amd64-112) (gcc version 9.4.0 (Ubuntu 9.4.0-1ubuntu1~20.04.2)) #197-Ubuntu SMP Thu Mar 28 22:45:47 UTC 2024 (Ubuntu 5.4.0-177.197-generic 5.4.268) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-177-generic root=UUID=1168b92c-82ac-47e1-87d9-5d77414c7738 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ea2fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f55000-0x000000007986ffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000079870000-0x0000000079d3cfff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d3d000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 3.4 06/05/2021 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.047 MHz processor [ 0.000995] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.001442] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.002000] last_pfn = 0x78ea3 max_arch_pfn = 0x400000000 [ 0.007508] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.007555] check: Scanning 1 areas for low memory corruption [ 0.007559] Using GB pages for direct mapping [ 0.007701] RAMDISK: [mem 0x3157d000-0x34ab5fff] [ 0.007706] ACPI: Early table checksum verification disabled [ 0.007709] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.007712] ACPI: XSDT 0x00000000798700A0 0000C4 (v01 01072009 AMI 00010013) [ 0.007716] ACPI: FACP 0x00000000798A20E0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007720] ACPI: DSDT 0x0000000079870200 031EE0 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.007723] ACPI: FACS 0x0000000079D3BF80 000040 [ 0.007725] ACPI: APIC 0x00000000798A21F0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007727] ACPI: FPDT 0x00000000798A22B8 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007729] ACPI: FIDT 0x00000000798A2300 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007730] ACPI: SPMI 0x00000000798A23A0 000041 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.007732] ACPI: MCFG 0x00000000798A23E8 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.007734] ACPI: UEFI 0x00000000798A2428 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.007736] ACPI: HPET 0x00000000798A2470 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007738] ACPI: NFIT 0x00000000798A24A8 018028 (v01 00000000 00000000) [ 0.007740] ACPI: WDDT 0x00000000798BA4D0 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.007742] ACPI: SSDT 0x00000000798BA510 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.007744] ACPI: NITR 0x00000000798D1690 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007746] ACPI: SSDT 0x00000000798D1708 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.007748] ACPI: SSDT 0x00000000798D3D58 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.007750] ACPI: PRAD 0x00000000798D3DC0 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.007752] ACPI: DMAR 0x00000000798D3EC8 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007754] ACPI: HEST 0x00000000798D3F88 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007756] ACPI: BERT 0x00000000798D4208 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007758] ACPI: ERST 0x00000000798D4238 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007760] ACPI: EINJ 0x00000000798D4468 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007762] ACPI: Reserving FACP table memory at [mem 0x798a20e0-0x798a21eb] [ 0.007763] ACPI: Reserving DSDT table memory at [mem 0x79870200-0x798a20df] [ 0.007763] ACPI: Reserving FACS table memory at [mem 0x79d3bf80-0x79d3bfbf] [ 0.007764] ACPI: Reserving APIC table memory at [mem 0x798a21f0-0x798a22b7] [ 0.007765] ACPI: Reserving FPDT table memory at [mem 0x798a22b8-0x798a22fb] [ 0.007765] ACPI: Reserving FIDT table memory at [mem 0x798a2300-0x798a239b] [ 0.007766] ACPI: Reserving SPMI table memory at [mem 0x798a23a0-0x798a23e0] [ 0.007767] ACPI: Reserving MCFG table memory at [mem 0x798a23e8-0x798a2423] [ 0.007767] ACPI: Reserving UEFI table memory at [mem 0x798a2428-0x798a2469] [ 0.007768] ACPI: Reserving HPET table memory at [mem 0x798a2470-0x798a24a7] [ 0.007769] ACPI: Reserving NFIT table memory at [mem 0x798a24a8-0x798ba4cf] [ 0.007769] ACPI: Reserving WDDT table memory at [mem 0x798ba4d0-0x798ba50f] [ 0.007770] ACPI: Reserving SSDT table memory at [mem 0x798ba510-0x798d168e] [ 0.007771] ACPI: Reserving NITR table memory at [mem 0x798d1690-0x798d1700] [ 0.007771] ACPI: Reserving SSDT table memory at [mem 0x798d1708-0x798d3d53] [ 0.007772] ACPI: Reserving SSDT table memory at [mem 0x798d3d58-0x798d3dbb] [ 0.007773] ACPI: Reserving PRAD table memory at [mem 0x798d3dc0-0x798d3ec1] [ 0.007773] ACPI: Reserving DMAR table memory at [mem 0x798d3ec8-0x798d3f83] [ 0.007774] ACPI: Reserving HEST table memory at [mem 0x798d3f88-0x798d4203] [ 0.007775] ACPI: Reserving BERT table memory at [mem 0x798d4208-0x798d4237] [ 0.007775] ACPI: Reserving ERST table memory at [mem 0x798d4238-0x798d4467] [ 0.007776] ACPI: Reserving EINJ table memory at [mem 0x798d4468-0x798d4597] [ 0.007848] No NUMA configuration found [ 0.007849] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.007858] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.008031] Zone ranges: [ 0.008032] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008033] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008034] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008035] Device empty [ 0.008035] Movable zone start for each node [ 0.008038] Early memory node ranges [ 0.008039] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.008040] node 0: [mem 0x0000000000100000-0x0000000078ea2fff] [ 0.008040] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008308] Zeroed struct page in unavailable ranges: 29140 pages [ 0.008309] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.094494] ACPI: PM-Timer IO Port: 0x408 [ 0.094502] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.094503] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.094504] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.094504] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.094505] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.094505] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.094506] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.094506] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.094516] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.094519] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.094521] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.094522] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.094525] Using ACPI (MADT) for SMP configuration information [ 0.094527] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.094530] TSC deadline timer available [ 0.094531] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.094540] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.094541] PM: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.094542] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.094543] PM: Registered nosave memory: [mem 0x78ea3000-0x78f54fff] [ 0.094544] PM: Registered nosave memory: [mem 0x78f55000-0x7986ffff] [ 0.094544] PM: Registered nosave memory: [mem 0x79870000-0x79d3cfff] [ 0.094545] PM: Registered nosave memory: [mem 0x79d3d000-0x8fffffff] [ 0.094545] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.094546] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.094546] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.094547] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.094548] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.094549] Booting paravirtualized kernel on bare hardware [ 0.094552] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.094556] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.094793] percpu: Embedded 60 pages/cpu s208896 r8192 d28672 u262144 [ 0.094817] Built 1 zonelists, mobility grouping on. Total pages: 8228828 [ 0.094818] Policy zone: Normal [ 0.094819] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-177-generic root=UUID=1168b92c-82ac-47e1-87d9-5d77414c7738 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.097450] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.098810] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.098892] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.176909] Memory: 32692508K/33437872K available (14339K kernel code, 2395K rwdata, 9292K rodata, 2768K init, 17228K bss, 745364K reserved, 0K cma-reserved) [ 0.177126] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.177140] Kernel/User page tables isolation: enabled [ 0.177167] ftrace: allocating 44725 entries in 175 pages [ 0.189897] ftrace: allocated 175 pages with 6 groups [ 0.190009] rcu: Hierarchical RCU implementation. [ 0.190010] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.190011] Tasks RCU enabled. [ 0.190012] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.190013] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.192120] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.192303] random: crng init done [ 0.197165] Console: colour VGA+ 80x25 [ 0.207813] printk: console [tty0] enabled [ 1.169563] printk: console [ttyS1] enabled [ 1.173817] ACPI: Core revision 20190816 [ 1.178015] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.187235] APIC: Switch to symmetric I/O mode setup [ 1.192272] DMAR: Host address width 46 [ 1.196173] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.201554] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap d2078c106f0466 ecap f020de [ 1.209554] DMAR: RMRR base: 0x0000007ba57000 end: 0x0000007ba66fff [ 1.215885] DMAR: ATSR flags: 0x0 [ 1.219267] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.225601] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.232023] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.238445] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.243911] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.243911] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.259040] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.264410] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.270692] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.295233] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32737d98d1a, max_idle_ns: 440795362231 ns [ 1.305833] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.09 BogoMIPS (lpj=14000188) [ 1.309868] mce: CPU0: Thermal monitoring enabled (TM1) [ 1.313878] process: using mwait in idle threads [ 1.317834] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024 [ 1.321832] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4 [ 1.325833] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.329833] Spectre V2 : Mitigation: Retpolines [ 1.333832] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.337832] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.341832] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.345833] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.349832] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.353833] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.357836] MDS: Mitigation: Clear CPU buffers [ 1.361832] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.365837] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.369832] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.373832] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.377833] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.381832] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.385974] Freeing SMP alternatives memory: 40K [ 1.395146] pid_max: default: 32768 minimum: 301 [ 1.397855] LSM: Security Framework initializing [ 1.401839] Yama: becoming mindful. [ 1.405859] AppArmor: AppArmor initialized [ 1.409900] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.413879] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.417842] *** VALIDATE tmpfs *** [ 1.421936] *** VALIDATE proc *** [ 1.425874] *** VALIDATE cgroup1 *** [ 1.429833] *** VALIDATE cgroup2 *** [ 1.434039] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz (family: 0x6, model: 0x3f, stepping: 0x2) [ 1.437899] Performance Events: PEBS fmt2+, Haswell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.441833] ... version: 3 [ 1.445832] ... bit width: 48 [ 1.449832] ... generic registers: 4 [ 1.453832] ... value mask: 0000ffffffffffff [ 1.457832] ... max period: 00007fffffffffff [ 1.461832] ... fixed-purpose events: 3 [ 1.465832] ... event mask: 000000070000000f [ 1.469861] rcu: Hierarchical SRCU implementation. [ 1.474687] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.477900] smp: Bringing up secondary CPUs ... [ 1.481906] x86: Booting SMP configuration: [ 1.485834] .... node #0, CPUs: #1 #2 #3 #4 [ 1.494550] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.501833] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.505941] #5 #6 #7 [ 1.506515] smp: Brought up 1 node, 8 CPUs [ 1.513834] smpboot: Max logical packages: 1 [ 1.517833] smpboot: Total of 8 processors activated (56000.75 BogoMIPS) [ 1.524277] devtmpfs: initialized [ 1.525869] x86/mm: Memory block size: 128MB [ 1.532873] PM: Registering ACPI NVS region [mem 0x79870000-0x79d3cfff] (5033984 bytes) [ 1.533912] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.537846] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.541879] pinctrl core: initialized pinctrl subsystem [ 1.545915] PM: RTC time: 04:27:21, date: 2024-04-19 [ 1.549926] NET: Registered protocol family 16 [ 1.553903] audit: initializing netlink subsys (disabled) [ 1.557840] audit: type=2000 audit(1713500839.328:1): state=initialized audit_enabled=0 res=1 [ 1.557915] EISA bus registered [ 1.565041] cpuidle: using governor ladder [ 1.565835] cpuidle: using governor menu [ 1.569848] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.573833] ACPI: bus type PCI registered [ 1.577833] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.581883] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.585835] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.589843] PCI: Using configuration type 1 for base access [ 1.593857] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 1.599839] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.601835] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.605897] ACPI: Added _OSI(Module Device) [ 1.609834] ACPI: Added _OSI(Processor Device) [ 1.613839] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.617833] ACPI: Added _OSI(Processor Aggregator Device) [ 1.621833] ACPI: Added _OSI(Linux-Dell-Video) [ 1.625832] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.629832] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.677137] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.681244] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.685954] ACPI: Dynamic OEM Table Load: [ 1.714551] ACPI: Interpreter enabled [ 1.717844] ACPI: (supports S0 S4 S5) [ 1.721566] ACPI: Using IOAPIC for interrupt routing [ 1.721855] HEST: Enabling Firmware First mode for corrected errors. [ 1.725923] HEST: Table parsing has been initialized. [ 1.729834] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.734537] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.770660] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.773837] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 1.783885] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR] [ 1.794815] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.801833] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.809868] PCI host bridge to bus 0000:ff [ 1.813835] pci_bus 0000:ff: root bus resource [bus ff] [ 1.821842] pci 0000:ff:0b.0: [8086:2f81] type 00 class 0x088000 [ 1.825892] pci 0000:ff:0b.1: [8086:2f36] type 00 class 0x110100 [ 1.833883] pci 0000:ff:0b.2: [8086:2f37] type 00 class 0x110100 [ 1.837882] pci 0000:ff:0c.0: [8086:2fe0] type 00 class 0x088000 [ 1.845881] pci 0000:ff:0c.1: [8086:2fe1] type 00 class 0x088000 [ 1.849885] pci 0000:ff:0c.2: [8086:2fe2] type 00 class 0x088000 [ 1.857884] pci 0000:ff:0c.3: [8086:2fe3] type 00 class 0x088000 [ 1.861882] pci 0000:ff:0f.0: [8086:2ff8] type 00 class 0x088000 [ 1.869884] pci 0000:ff:0f.1: [8086:2ff9] type 00 class 0x088000 [ 1.873881] pci 0000:ff:0f.4: [8086:2ffc] type 00 class 0x088000 [ 1.881881] pci 0000:ff:0f.5: [8086:2ffd] type 00 class 0x088000 [ 1.885881] pci 0000:ff:0f.6: [8086:2ffe] type 00 class 0x088000 [ 1.893881] pci 0000:ff:10.0: [8086:2f1d] type 00 class 0x088000 [ 1.897881] pci 0000:ff:10.1: [8086:2f34] type 00 class 0x110100 [ 1.905881] pci 0000:ff:10.5: [8086:2f1e] type 00 class 0x088000 [ 1.909880] pci 0000:ff:10.6: [8086:2f7d] type 00 class 0x110100 [ 1.917883] pci 0000:ff:10.7: [8086:2f1f] type 00 class 0x088000 [ 1.925880] pci 0000:ff:12.0: [8086:2fa0] type 00 class 0x088000 [ 1.929883] pci 0000:ff:12.1: [8086:2f30] type 00 class 0x110100 [ 1.937886] pci 0000:ff:13.0: [8086:2fa8] type 00 class 0x088000 [ 1.941884] pci 0000:ff:13.1: [8086:2f71] type 00 class 0x088000 [ 1.949884] pci 0000:ff:13.2: [8086:2faa] type 00 class 0x088000 [ 1.953884] pci 0000:ff:13.3: [8086:2fab] type 00 class 0x088000 [ 1.961888] pci 0000:ff:13.4: [8086:2fac] type 00 class 0x088000 [ 1.965888] pci 0000:ff:13.5: [8086:2fad] type 00 class 0x088000 [ 1.973884] pci 0000:ff:13.6: [8086:2fae] type 00 class 0x088000 [ 1.977882] pci 0000:ff:13.7: [8086:2faf] type 00 class 0x088000 [ 1.985883] pci 0000:ff:14.0: [8086:2fb0] type 00 class 0x088000 [ 1.989885] pci 0000:ff:14.1: [8086:2fb1] type 00 class 0x088000 [ 1.997885] pci 0000:ff:14.2: [8086:2fb2] type 00 class 0x088000 [ 2.001884] pci 0000:ff:14.3: [8086:2fb3] type 00 class 0x088000 [ 2.009884] pci 0000:ff:14.4: [8086:2fbc] type 00 class 0x088000 [ 2.013888] pci 0000:ff:14.5: [8086:2fbd] type 00 class 0x088000 [ 2.021882] pci 0000:ff:14.6: [8086:2fbe] type 00 class 0x088000 [ 2.029882] pci 0000:ff:14.7: [8086:2fbf] type 00 class 0x088000 [ 2.033882] pci 0000:ff:15.0: [8086:2fb4] type 00 class 0x088000 [ 2.041885] pci 0000:ff:15.1: [8086:2fb5] type 00 class 0x088000 [ 2.045885] pci 0000:ff:15.2: [8086:2fb6] type 00 class 0x088000 [ 2.053885] pci 0000:ff:15.3: [8086:2fb7] type 00 class 0x088000 [ 2.057890] pci 0000:ff:16.0: [8086:2f68] type 00 class 0x088000 [ 2.065889] pci 0000:ff:16.6: [8086:2f6e] type 00 class 0x088000 [ 2.069883] pci 0000:ff:16.7: [8086:2f6f] type 00 class 0x088000 [ 2.077883] pci 0000:ff:17.0: [8086:2fd0] type 00 class 0x088000 [ 2.081884] pci 0000:ff:17.4: [8086:2fb8] type 00 class 0x088000 [ 2.089884] pci 0000:ff:17.5: [8086:2fb9] type 00 class 0x088000 [ 2.093883] pci 0000:ff:17.6: [8086:2fba] type 00 class 0x088000 [ 2.101883] pci 0000:ff:17.7: [8086:2fbb] type 00 class 0x088000 [ 2.105886] pci 0000:ff:1e.0: [8086:2f98] type 00 class 0x088000 [ 2.113886] pci 0000:ff:1e.1: [8086:2f99] type 00 class 0x088000 [ 2.117884] pci 0000:ff:1e.2: [8086:2f9a] type 00 class 0x088000 [ 2.125882] pci 0000:ff:1e.3: [8086:2fc0] type 00 class 0x088000 [ 2.133856] pci 0000:ff:1e.4: [8086:2f9c] type 00 class 0x088000 [ 2.137883] pci 0000:ff:1f.0: [8086:2f88] type 00 class 0x088000 [ 2.145883] pci 0000:ff:1f.2: [8086:2f8a] type 00 class 0x088000 [ 2.153725] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.161836] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 2.178144] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR] [ 2.186264] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.193833] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.202103] PCI host bridge to bus 0000:00 [ 2.205834] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.213833] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.217833] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.225833] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.233833] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.241834] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.249833] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.253839] pci 0000:00:00.0: [8086:2f00] type 00 class 0x060000 [ 2.261981] pci 0000:00:01.0: [8086:2f02] type 01 class 0x060400 [ 2.265904] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.273965] pci 0000:00:02.0: [8086:2f04] type 01 class 0x060400 [ 2.281903] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.285957] pci 0000:00:03.0: [8086:2f08] type 01 class 0x060400 [ 2.293903] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.297953] pci 0000:00:04.0: [8086:2f20] type 00 class 0x088000 [ 2.305852] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.313973] pci 0000:00:04.1: [8086:2f21] type 00 class 0x088000 [ 2.317851] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.325969] pci 0000:00:04.2: [8086:2f22] type 00 class 0x088000 [ 2.329851] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.337968] pci 0000:00:04.3: [8086:2f23] type 00 class 0x088000 [ 2.345851] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.349968] pci 0000:00:04.4: [8086:2f24] type 00 class 0x088000 [ 2.357851] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.365970] pci 0000:00:04.5: [8086:2f25] type 00 class 0x088000 [ 2.369852] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.377973] pci 0000:00:04.6: [8086:2f26] type 00 class 0x088000 [ 2.381851] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.389968] pci 0000:00:04.7: [8086:2f27] type 00 class 0x088000 [ 2.397851] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.401967] pci 0000:00:05.0: [8086:2f28] type 00 class 0x088000 [ 2.409951] pci 0000:00:05.1: [8086:2f29] type 00 class 0x088000 [ 2.413971] pci 0000:00:05.2: [8086:2f2a] type 00 class 0x088000 [ 2.421950] pci 0000:00:05.4: [8086:2f2c] type 00 class 0x080020 [ 2.429847] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.433971] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.442056] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.445856] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.453844] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.457844] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.465844] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.469844] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.473844] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.481875] pci 0000:00:11.4: PME# supported from D3hot [ 2.485938] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.493859] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.501906] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.505921] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.513859] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.517910] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.525918] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.529859] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.537910] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.545929] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.549858] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.557935] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.561923] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.569924] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.573933] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.581925] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.589933] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.593924] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.601936] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.605858] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.613935] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.617932] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.626045] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.629854] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.637843] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.641843] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.649843] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.653843] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.657843] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.665869] pci 0000:00:1f.2: PME# supported from D3hot [ 2.669918] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.677857] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.685863] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.690071] acpiphp: Slot [1] registered [ 2.693850] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.697980] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.705855] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.713873] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.717837] pci 0000:02:00.0: enabling Extended Tags [ 2.725929] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.729835] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.737984] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.741856] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.749842] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.753855] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.761842] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.769876] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.773854] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.781834] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.793846] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.801833] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.809968] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.817855] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.825842] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.829854] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.837841] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.845876] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.849850] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.857833] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.869845] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.877833] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.885960] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.889834] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.897834] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.905834] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.913864] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.917891] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.921924] pci 0000:05:00.0: enabling Extended Tags [ 2.929911] pci 0000:05:00.0: supports D1 D2 [ 2.933833] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.937927] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.945835] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.949834] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.957881] pci_bus 0000:06: extended config space not accessible [ 2.965861] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.969862] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.977849] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.981849] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.989951] pci 0000:06:00.0: supports D1 D2 [ 2.993833] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.997937] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.005839] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.009836] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.017911] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 3.025868] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 3.029860] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 3.037847] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 3.041964] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 3.049871] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.057834] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.065859] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.073833] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.085938] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 3.089869] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 3.097860] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 3.101846] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 3.109963] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 3.113870] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.121833] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.133858] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.141833] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.149990] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.153835] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.161834] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.177838] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 3.182725] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 *11 12 14 15) [ 3.189882] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *10 11 12 14 15) [ 3.197879] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15) [ 3.205879] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15) [ 3.213879] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.221879] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.229879] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.237879] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.246058] iommu: Default domain type: Translated [ 3.249966] SCSI subsystem initialized [ 3.253854] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 3.257832] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 3.269833] pci 0000:06:00.0: vgaarb: bridge control possible [ 3.273832] vgaarb: loaded [ 3.276611] ACPI: bus type USB registered [ 3.281843] usbcore: registered new interface driver usbfs [ 3.285838] usbcore: registered new interface driver hub [ 3.293837] usbcore: registered new device driver usb [ 3.297854] pps_core: LinuxPPS API ver. 1 registered [ 3.301832] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 3.313834] PTP clock support registered [ 3.317841] EDAC MC: Ver: 3.0.0 [ 3.321148] PCI: Using ACPI for IRQ routing [ 3.327208] NetLabel: Initializing [ 3.333833] NetLabel: domain hash size = 128 [ 3.337832] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 3.341843] NetLabel: unlabeled traffic allowed by default [ 3.350611] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 3.353834] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 3.363870] clocksource: Switched to clocksource tsc-early [ 3.376698] *** VALIDATE bpf *** [ 3.380044] VFS: Disk quotas dquot_6.6.0 [ 3.384038] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 3.390996] *** VALIDATE ramfs *** [ 3.394464] *** VALIDATE hugetlbfs *** [ 3.398342] AppArmor: AppArmor Filesystem Enabled [ 3.403136] pnp: PnP ACPI init [ 3.406720] system 00:01: [io 0x0500-0x057f] has been reserved [ 3.412703] system 00:01: [io 0x0400-0x047f] has been reserved [ 3.418689] system 00:01: [io 0x0580-0x059f] has been reserved [ 3.424668] system 00:01: [io 0x0600-0x061f] has been reserved [ 3.430648] system 00:01: [io 0x0880-0x0883] has been reserved [ 3.436628] system 00:01: [io 0x0800-0x081f] has been reserved [ 3.442609] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 3.449287] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 3.455967] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 3.462648] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 3.469321] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 3.475994] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 3.482668] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 3.489552] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 3.495536] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 3.501516] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.507496] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.513475] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.520375] pnp: PnP ACPI: found 5 devices [ 3.525478] thermal_sys: Registered thermal governor 'fair_share' [ 3.525479] thermal_sys: Registered thermal governor 'bang_bang' [ 3.531633] thermal_sys: Registered thermal governor 'step_wise' [ 3.537699] thermal_sys: Registered thermal governor 'user_space' [ 3.543765] thermal_sys: Registered thermal governor 'power_allocator' [ 3.554404] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.569978] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.581547] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.589462] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.594505] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.599538] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.606396] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.614049] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.622047] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.629787] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.637874] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.645524] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.653526] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.661263] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.669352] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.677002] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.685004] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.692741] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.700829] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.708480] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.716482] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.724219] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.732305] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.737333] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.743495] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.750350] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.758181] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.763222] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.768248] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.774411] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.781276] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.786561] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.792722] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.799585] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.807415] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.815326] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.823153] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.831064] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.836089] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.842253] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.849107] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.856939] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.863185] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.869424] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.876358] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 3.883293] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 3.890227] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 3.897169] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.903502] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.909134] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.915461] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.922761] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.928392] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.934720] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.940351] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.946679] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.952311] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.958638] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.966065] NET: Registered protocol family 2 [ 3.970679] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.979916] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.988926] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.997347] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 4.004886] TCP: Hash tables configured (established 262144 bind 65536) [ 4.011645] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 4.018668] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 4.026124] NET: Registered protocol family 1 [ 4.030548] NET: Registered protocol family 44 [ 4.035123] pci 0000:00:05.0: disabled boot interrupts on device [8086:2f28] [ 4.065702] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x670 took 22733 usecs [ 4.097697] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x670 took 23923 usecs [ 4.105191] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 4.111706] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 4.120175] Trying to unpack rootfs image as initramfs... [ 4.232074] Freeing initrd memory: 54500K [ 4.261560] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.268068] software IO TLB: mapped [mem 0x74ea3000-0x78ea3000] (64MB) [ 4.282729] check: Scanning for low memory corruption every 60 seconds [ 4.289769] Initialise system trusted keyrings [ 4.294286] Key type blacklist registered [ 4.298381] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 4.305770] zbud: loaded [ 4.308620] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 4.314625] fuse: init (API version 7.31) [ 4.318714] *** VALIDATE fuse *** [ 4.322089] *** VALIDATE fuse *** [ 4.325541] Platform Keyring initialized [ 4.332510] Key type asymmetric registered [ 4.336667] Asymmetric key parser 'x509' registered [ 4.341614] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244) [ 4.349118] io scheduler mq-deadline registered [ 4.354095] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 4.360109] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 4.366119] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 4.372080] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 4.378050] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 4.384014] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 4.389919] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 4.397306] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 4.405763] ACPI: Power Button [PWRB] [ 4.409516] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 4.417021] ACPI: Power Button [PWRF] [ 4.422015] ERST: Error Record Serialization Table (ERST) support is initialized. [ 4.429586] pstore: Registered erst as persistent store backend [ 4.435752] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 4.443332] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 4.470257] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 4.498195] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 4.506634] Linux agpgart interface v0.103 [ 4.641627] loop: module loaded [ 4.645027] tun: Universal TUN/TAP device driver, 1.6 [ 4.650198] PPP generic driver version 2.4.2 [ 4.654590] VFIO - User Level meta-driver version: 0.3 [ 4.659883] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 4.666478] ehci-pci: EHCI PCI platform driver [ 4.671134] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 4.676428] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 4.683913] ehci-pci 0000:00:1a.0: debug port 2 [ 4.692417] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported [ 4.699278] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 4.717623] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 4.723464] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.731808] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.739110] usb usb1: Product: EHCI Host Controller [ 4.744055] usb usb1: Manufacturer: Linux 5.4.0-177-generic ehci_hcd [ 4.750469] usb usb1: SerialNumber: 0000:00:1a.0 [ 4.755239] hub 1-0:1.0: USB hub found [ 4.759060] hub 1-0:1.0: 2 ports detected [ 4.763360] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 4.768656] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 4.776142] ehci-pci 0000:00:1d.0: debug port 2 [ 4.784641] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported [ 4.791495] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.809597] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.815436] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.823786] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.831091] usb usb2: Product: EHCI Host Controller [ 4.836033] usb usb2: Manufacturer: Linux 5.4.0-177-generic ehci_hcd [ 4.842448] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.847212] hub 2-0:1.0: USB hub found [ 4.851028] hub 2-0:1.0: 2 ports detected [ 4.855233] ehci-platform: EHCI generic platform driver [ 4.860529] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.866774] ohci-pci: OHCI PCI platform driver [ 4.871294] ohci-platform: OHCI generic platform driver [ 4.876590] uhci_hcd: USB Universal Host Controller Interface driver [ 4.883145] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.888439] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.896967] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.906189] xhci_hcd 0000:00:14.0: cache line size of 64 is not supported [ 4.913162] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.918456] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.925930] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.932280] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.940632] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.947933] usb usb3: Product: xHCI Host Controller [ 4.952877] usb usb3: Manufacturer: Linux 5.4.0-177-generic xhci-hcd [ 4.959291] usb usb3: SerialNumber: 0000:00:14.0 [ 4.964051] hub 3-0:1.0: USB hub found [ 4.967876] hub 3-0:1.0: 15 ports detected [ 4.972652] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.04 [ 4.981001] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.988303] usb usb4: Product: xHCI Host Controller [ 4.993245] usb usb4: Manufacturer: Linux 5.4.0-177-generic xhci-hcd [ 4.999664] usb usb4: SerialNumber: 0000:00:14.0 [ 5.004426] hub 4-0:1.0: USB hub found [ 5.008248] hub 4-0:1.0: 6 ports detected [ 5.012628] usb: port power management may be unreliable [ 5.018105] i8042: PNP: No PS/2 controller found. [ 5.021564] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 5.022925] mousedev: PS/2 mouse device common for all mice [ 5.035191] rtc_cmos 00:00: RTC can wake from S4 [ 5.040055] rtc_cmos 00:00: registered as rtc0 [ 5.044570] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 5.052311] i2c /dev entries driver [ 5.055890] device-mapper: uevent: version 1.0.3 [ 5.060629] device-mapper: ioctl: 4.41.0-ioctl (2019-09-16) initialised: dm-devel@redhat.com [ 5.069166] platform eisa.0: Probing EISA bus 0 [ 5.073762] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 5.080611] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 5.087117] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 5.093617] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 5.100116] platform eisa0: Cannot allocate resource for EISA slot 4 [ 5.106619] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 5.109563] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 5.113127] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 5.126224] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 5.132730] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 5.139240] platform eisa.0: EISA: Detected 0 cards [ 5.144190] intel_pstate: Intel P-state driver initializing [ 5.150618] ledtrig-cpu: registered to indicate activity on CPUs [ 5.156792] drop_monitor: Initializing network drop monitor service [ 5.163239] NET: Registered protocol family 10 [ 5.172172] Segment Routing with IPv6 [ 5.175911] NET: Registered protocol family 17 [ 5.180481] Key type dns_resolver registered [ 5.185196] RAS: Correctable Errors collector initialized. [ 5.190765] microcode: sig=0x306f2, pf=0x1, revision=0x49 [ 5.194038] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 5.204489] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.204561] microcode: Microcode Update Driver: v2.2. [ 5.211771] *** VALIDATE rdt *** [ 5.211807] hub 1-1:1.0: USB hub found [ 5.216897] resctrl: L3 monitoring detected [ 5.224181] hub 1-1:1.0: 6 ports detected [ 5.228243] IPI shorthand broadcast: enabled [ 5.229563] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.243340] sched_clock: Marking stable (4205790332, 1037534164)->(5564400928, -321076432) [ 5.251764] registered taskstats version 1 [ 5.255937] Loading compiled-in X.509 certificates [ 5.261397] Loaded X.509 cert 'Build time autogenerated kernel key: 1224c9b81ccdd6d5fadad4fbd6b8ad2b6b069117' [ 5.271892] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 5.281911] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 5.282207] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 5.290208] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.300259] blacklist: Loading compiled-in revocation X.509 certificates [ 5.307675] hub 2-1:1.0: USB hub found [ 5.314223] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 5.314242] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 5.314257] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 5.314271] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 5.314293] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 5.314307] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 5.314322] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 5.314338] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 5.314352] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 5.314400] zswap: loaded using pool lzo/zbud [ 5.318160] hub 2-1:1.0: 8 ports detected [ 5.324277] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 5.324325] Key type ._fscrypt registered [ 5.324325] Key type .fscrypt registered [ 5.324413] pstore: Using crash dump compression: deflate [ 5.328314] Key type big_key registered [ 5.330140] Key type encrypted registered [ 5.330142] AppArmor: AppArmor sha1 policy hashing enabled [ 5.330148] ima: No TPM chip found, activating TPM-bypass! [ 5.330150] ima: Allocated hash algorithm: sha1 [ 5.330156] ima: No architecture policies found [ 5.330163] evm: Initialising EVM extended attributes: [ 5.330164] evm: security.selinux [ 5.330164] evm: security.SMACK64 [ 5.330165] evm: security.SMACK64EXEC [ 5.330165] evm: security.SMACK64TRANSMUTE [ 5.330165] evm: security.SMACK64MMAP [ 5.330166] evm: security.apparmor [ 5.330166] evm: security.ima [ 5.330167] evm: security.capability [ 5.330167] evm: HMAC attrs: 0x1 [ 5.330788] PM: Magic number: 4:762:464 [ 5.334182] rtc_cmos 00:00: setting system clock to 2024-04-19T04:27:25 UTC (1713500845) [ 5.377768] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.535557] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.535564] clocksource: Switched to clocksource tsc [ 5.535905] hub 3-12:1.0: USB hub found [ 5.535985] hub 3-12:1.0: 4 ports detected [ 5.556272] Freeing unused decrypted memory: 2040K [ 5.561484] Freeing unused kernel image memory: 2768K [ 5.585649] Write protecting the kernel read-only data: 26624k [ 5.591901] Freeing unused kernel image memory: 2036K [ 5.597168] Freeing unused kernel image memory: 948K [ 5.609218] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.615720] x86/mm: Checking user space page tables [ 5.627306] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.633808] Run /init as init process Loading, please wait... Starting version 245.4-4ubuntu3.17 [ 5.754750] dca service started, version 1.12.1 [ 5.759775] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 5.770415] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 5.770437] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.6.0-k [ 5.778620] ahci 0000:00:11.4: flags: 64bit ncq led clo pio slum part ems apst [ 5.793048] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.798715] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k [ 5.806480] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.822180] scsi host0: ahci [ 5.825244] scsi host1: ahci [ 5.833360] scsi host2: ahci [ 5.841568] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.8487[ 5.854079] a1: SATA max UDMAfb438100 irq 33 [ 5.861559] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 5.869036] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 5.876515] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 5.884482] igb 0000:07:00.0: added PHC on eth0 [ 5.889093] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.896031] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:a8:b4:84 [ 5.903314] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.908514] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.916217] nvme nvme0: pci function 0000:02:00.0 [ 5.921101] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.929358] ahci 0000:00:1f.2: flags: 64bit ncq led clo pio slum part ems apst [ 5.981894] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.990419] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.992715] igb 0000:07:00.1: added PHC on eth1 [ 6.002504] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.009444] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:a8:b4:85 [ 6.016721] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.016725] hidraw: raw HID events driver (C) Jiri Kosina [ 6.021920] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.022216] scsi host4: ahci [ 6.026089] nvme nvme0: 8/0/0 default/read/poll queues [ 6.043262] scsi host5: ahci [ 6.046312] scsi host6: ahci [ 6.049418] scsi host7: ahci [ 6.052449] scsi host8: ahci [ 6.055509] scsi host9: ahci [ 6.058482] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 43 [ 6.065964] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 43 [ 6.073441] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 43 [ 6.080921] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 43 [ 6.088401] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 43 [ 6.095880] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 43 [ 6.196775] ata1: SATA link down (SStatus 0 SControl 300) [ 6.202260] ata4: SATA link down (SStatus 0 SControl 300) [ 6.207734] ata3: SATA link down (SStatus 0 SControl 300) [ 6.213212] ata2: SATA link down (SStatus 0 SControl 300) [ 6.417003] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.423259] ata10: SATA link down (SStatus 0 SControl 300) [ 6.428821] ata6: SATA link down (SStatus 0 SControl 300) [ 6.434298] ata7: SATA link down (SStatus 0 SControl 300) [ 6.439775] ata8: SATA link down (SStatus 0 SControl 300) [ 6.445254] ata9: SATA link down (SStatus 0 SControl 300) [ 6.451084] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN04, max UDMA/133 [ 6.457421] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.465536] ata5.00: configured for UDMA/133 [ 6.469994] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN04 PQ: 0 ANSI: 5 [ 6.478265] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.478314] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.491387] sd 4:0:0:0: [sda] Write Protect is off [ 6.496253] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.525339] sda: sda1 [ 6.541801] sd 4:0:0:0: [sda] Attached SCSI disk [ 6.548014] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.554337] usbcore: registered new interface driver usbhid [ 6.559975] usbhid: USB HID core driver [ 6.566218] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.581623] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.641730] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.653651] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.665440] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 7.049593] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.059960] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.068554] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.074799] ixgbe 0000:03:00.0: 0c:c4:7a:b6:f8:bc [ 7.081579] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.249573] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.259942] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.268542] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.275652] ixgbe 0000:03:00.1: 0c:c4:7a:b6:f8:bd [ 7.283317] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.290741] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 7.313958] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.34 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 8794 (uid=0, gid=0, mode=0100644, size=2954080) /dev/sda1: Clearing orphaned inode 8351 (uid=0, gid=0, mode=0100644, size=30936) /dev/sda1: clean, 303185/61054976 files, 7993486/244190336 blocks done. [ 13.437021] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.159546] systemd[1]: Inserted module 'autofs4' [ 14.206869] systemd[1]: systemd 245.4-4ubuntu3.17 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid) [ 14.249676] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 20.04.4 LTS! [ 14.309940] systemd[1]: Set hostname to . [ 15.531211] systemd[1]: Created slice system-modprobe.slice. [ OK ] Created slice system-modprobe.slice. [ 15.554044] systemd[1]: Created slice system-serial\x2dgetty.slice. [ OK ] Created slice system-serial\x2dgetty.slice. [ 15.577939] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 15.597767] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 15.622052] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 15.649707] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 15.685678] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 15.713694] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 15.741662] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 15.769664] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 15.797659] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 15.825639] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 15.845688] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 15.865730] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 15.889841] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 15.912673] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 15.937741] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 15.957693] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 15.981679] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 16.005799] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 16.025725] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 16.045785] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 16.065781] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 16.085809] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 16.106414] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 16.126484] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 16.150313] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 16.174268] systemd[1]: Mounting RPC Pipe File System... Mounting RPC Pipe File System... [ 16.194483] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 16.214682] systemd[1]: Mounting Kernel Trace File System... Mounting Kerne[ 16.221820] RPC: Registered named UNIX socket transport module. l Trace File Sys[ 16.229268] RPC: Registered udp transport module. tem... [ 16.235410] RPC: Registered tcp transport module. [ 16.241190] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 16.248820] systemd[1]: Starting Journal Service... Starting Journal Service... [ 16.269635] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 16.280119] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 16.302503] systemd[1]: Starting Create list of static device nodes for the current kernel... Starting Create list of st…odes for the current kernel... [ 16.327264] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 16.334493] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 16.362308] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 16.381615] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 16.392169] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped. [ 16.401322] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 16.411521] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 16.430479] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 16.446430] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr [ 16.454616] systemd[1]: Starting udev Coldplug all Devices... [ 16.459620] lp: driver loaded but no devices found Starting udev Coldplug all Devices... [ 16.476741] Loading iSCSI transport class v2.0-870. [ 16.482310] systemd[1]: Starting Uncomplicated firewall... Starting Uncomplicated firewall... [ 16.503005] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted RPC Pipe File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create list of st… nodes for the current kernel. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Finished Uncomplicated firewall. Activating swap /swapfile... Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting pNFS block layout mapping daemon... Starting Flush Journal to Persistent Storage... [ 16.813253] systemd-journald[366]: Received client request to flush runtime journal. [ 16.813570] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished udev Coldplug all Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Reached target Swap. Starting Helper to synchronize boot up for ifupdown... [ 17.043640] systemd-journald[366]: File /var/log/journal/a3be24a71451430bbe7befa8e4390c43/system.journal corrupted or uncleanly shut down, renaming and replacing. [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Preprocess NFS configuration... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting udev Kernel Device Manager... [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Set console font and keymap. [ OK ] Finished Preprocess NFS configuration. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. Starting NFSv4 ID-name mapping service... [ OK ] Reached target NFS client services. [ OK ] Finished Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Finished Create Volatile Files and Directories. Starting RPC bind portmap service... Starting Update UTMP about System Boot/Shutdown... [ OK ] Finished Update UTMP about System Boot/Shutdown. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Started udev Kernel Device Manager. [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. Starting Network Service... [ OK ] Started RPC bind portmap service. [ OK ] Finished Load AppArmor profiles. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API. [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. [ OK ] Started Network Service. [ OK ] Listening on Docker Socket for the API. [ OK ] Found device /dev/ttyS1. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice system-lvm2\x2dpvscan.slice. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK  LTTng session daemon. Starting LVM event activation on device 259:0... Starting Dispatcher daemon for systemd-networkd... [ OK ] Started Set the CPU Frequency Scaling governor. Starting System Logging Service... Starting [0;1;39…g Technology ... Starting Resets System Activity Data Collector... Starting Login Service... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Found device 82599ES 10-Gi…ion (AOC-STGN-I2S [REV 1.01]). [ OK ] Finished Resets System Activity Data Collector. [ OK ] Started ifup for enp3s0f1. [ OK ] Started System Logging Service. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Finished GRUB failed boot detection. [ OK ] Finished Helper to synchronize boot up for ifupdown. Starting Raise network interfaces... [ OK ] Started Login Service. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [* ] (1 of 2) A start job is running for… network interfaces (8s / 5min 4s) M  Stopping Network Name Resolution... [ OK ] Stopped Network Name Resolution. Starting Network Name Resolution... [ OK ] Started Network Name Resolution. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. Starting NFS server and services... [ OK ] Started Network Time Service. [ OK ] Started OpenBSD Secure Shell server. [ OK ] Started (i)SCSI target daemon. [ OK ] Finished NFS server and services. [ OK ] Finished Wait for Network to be Configured. [ OK ] Reached target Network is Online. Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr Starting Ubuntu FAN network setup... ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Finished Map RBD devices. + myips=172.21.15.66 + attempts=1 + sleep 1 + '[' 172.21.15.66 '!=' '' ']' + set -e + '[' -n 172.21.15.66 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.66 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.66 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi066.front.sepia.ceph.com + '[' -n smithi066.front.sepia.ceph.com ']' + hostname smithi066.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi066 + echo smithi066 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.66 smithi066.front.sepia.ceph.com smithi066/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice system-getty.slice. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started LSB: Collectl monitors system performance.. Ubuntu 20.04.4 LTS smithi066.front.sepia.ceph.com ttyS1 smithi066 login: [disconnect] 2024-04-19T04:27:48.742 INFO:teuthology.misc:Re-opening connections... 2024-04-19T04:27:48.742 INFO:teuthology.misc:trying to connect to ubuntu@smithi066.front.sepia.ceph.com 2024-04-19T04:27:48.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-04-19T04:27:48.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T04:27:48.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~152s 2024-04-19T04:27:49.399 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-04-19T04:27:50.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-04-19T04:27:50.306 DEBUG:teuthology.misc:waited 1.5635662078857422 2024-04-19T04:27:51.307 DEBUG:tasks.ceph_manager:Mounting data for osd.1 on ubuntu@smithi066.front.sepia.ceph.com 2024-04-19T04:27:51.308 INFO:tasks.ceph_manager:Mounting osd.1: dev: ubuntu@smithi066.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-1, type: xfs, options: ['noatime'] 2024-04-19T04:27:51.308 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-19T04:27:51.411 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T04:27:51.436 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-19T04:27:51.436 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-19T04:27:51.439 INFO:tasks.ceph.osd.1:Started 2024-04-19T04:27:51.439 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:27:51.560 INFO:teuthology.orchestra.run.smithi066.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-19T04:27:51.562 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-19T04:27:51.562 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-19T04:27:52.602 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:27:52.808+0000 7f69420fd880 -1 Falling back to public interface 2024-04-19T04:27:54.680 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-19T04:27:56.563 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:27:56.655 INFO:teuthology.orchestra.run.smithi066.stderr:no valid command found; 10 closest matches: 2024-04-19T04:27:56.655 INFO:teuthology.orchestra.run.smithi066.stderr:0 2024-04-19T04:27:56.656 INFO:teuthology.orchestra.run.smithi066.stderr:1 2024-04-19T04:27:56.656 INFO:teuthology.orchestra.run.smithi066.stderr:2 2024-04-19T04:27:56.656 INFO:teuthology.orchestra.run.smithi066.stderr:abort 2024-04-19T04:27:56.656 INFO:teuthology.orchestra.run.smithi066.stderr:assert 2024-04-19T04:27:56.656 INFO:teuthology.orchestra.run.smithi066.stderr:bluefs debug_inject_read_zeros 2024-04-19T04:27:56.656 INFO:teuthology.orchestra.run.smithi066.stderr:bluefs files list 2024-04-19T04:27:56.656 INFO:teuthology.orchestra.run.smithi066.stderr:bluefs stats 2024-04-19T04:27:56.656 INFO:teuthology.orchestra.run.smithi066.stderr:bluestore allocator dump block 2024-04-19T04:27:56.656 INFO:teuthology.orchestra.run.smithi066.stderr:bluestore allocator fragmentation block 2024-04-19T04:27:56.656 INFO:teuthology.orchestra.run.smithi066.stderr:admin_socket: invalid command 2024-04-19T04:27:56.657 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-19T04:27:56.657 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-19T04:27:59.880 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:28:00.088+0000 7f69420fd880 -1 osd.1 37 log_to_monitors true 2024-04-19T04:28:00.653 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-04-19T04:28:00.860+0000 7f69359eb700 -1 osd.1 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T04:28:01.658 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T04:28:01.807 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-04-19T04:28:01.807 INFO:teuthology.orchestra.run.smithi066.stdout: "ops": [], 2024-04-19T04:28:01.807 INFO:teuthology.orchestra.run.smithi066.stdout: "num_ops": 0 2024-04-19T04:28:01.807 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-04-19T04:28:06.820 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-19T04:28:06.968 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a: {} 2024-04-19T04:28:06.980 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b: {} 2024-04-19T04:28:06.997 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c: {} 2024-04-19T04:28:06.999 INFO:teuthology.orchestra.run.smithi007.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T04:28:06.999 INFO:teuthology.orchestra.run.smithi007.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T04:28:07.000 INFO:teuthology.orchestra.run.smithi007.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T04:28:07.016 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-19T04:28:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.0 to 1 (10000) 2024-04-19T04:28:08.064 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-19T04:28:09.053 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-19T04:28:09.066 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-19T04:28:10.066 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.2 to 1 (10000) 2024-04-19T04:28:10.081 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-19T04:28:11.079 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-19T04:28:11.091 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-19T04:28:12.082 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.1 to 1 (10000) 2024-04-19T04:28:12.095 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-19T04:28:13.096 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-19T04:28:13.109 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-19T04:28:13.109 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-19T04:28:13.109 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-19T04:28:13.109 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-19T04:28:13.109 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-19T04:28:13.110 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T04:28:13.414 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:28:13.414 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":79,"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","created":"2024-04-19T04:23:58.837304+0000","modified":"2024-04-19T04:28:13.077866+0000","last_up_change":"2024-04-19T04:28:01.596258+0000","last_in_change":"2024-04-19T04:24:00.437672+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T04:24:08.928860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T04:24:14.725769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T04:24:19.096707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T04:24:19.528844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28ba89d9-eaaf-4fb5-86bc-783b607a4cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":18128},{"type":"v1","addr":"172.21.15.27:6801","nonce":18128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":18128},{"type":"v1","addr":"172.21.15.27:6803","nonce":18128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":18128},{"type":"v1","addr":"172.21.15.27:6807","nonce":18128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":18128},{"type":"v1","addr":"172.21.15.27:6805","nonce":18128}]},"public_addr":"172.21.15.27:6801/18128","cluster_addr":"172.21.15.27:6803/18128","heartbeat_back_addr":"172.21.15.27:6807/18128","heartbeat_front_addr":"172.21.15.27:6805/18128","state":["exists","up"]},{"osd":1,"uuid":"9d5408b5-b74c-4e5e-858c-e0c8b593204e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":37,"up_from":72,"up_thru":72,"down_at":38,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1427},{"type":"v1","addr":"172.21.15.66:6801","nonce":1427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1427},{"type":"v1","addr":"172.21.15.66:6803","nonce":1427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1427},{"type":"v1","addr":"172.21.15.66:6807","nonce":1427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1427},{"type":"v1","addr":"172.21.15.66:6805","nonce":1427}]},"public_addr":"172.21.15.66:6801/1427","cluster_addr":"172.21.15.66:6803/1427","heartbeat_back_addr":"172.21.15.66:6807/1427","heartbeat_front_addr":"172.21.15.66:6805/1427","state":["exists","up"]},{"osd":2,"uuid":"9b600dc4-4425-4873-82d8-5434ca838bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":18250},{"type":"v1","addr":"172.21.15.172:6801","nonce":18250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":18250},{"type":"v1","addr":"172.21.15.172:6803","nonce":18250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":18250},{"type":"v1","addr":"172.21.15.172:6807","nonce":18250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":18250},{"type":"v1","addr":"172.21.15.172:6805","nonce":18250}]},"public_addr":"172.21.15.172:6801/18250","cluster_addr":"172.21.15.172:6803/18250","heartbeat_back_addr":"172.21.15.172:6807/18250","heartbeat_front_addr":"172.21.15.172:6805/18250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.749539+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.573103+0000","dead_epoch":37},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.812945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T04:28:13.429 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-19T04:28:13.430 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T04:28:13.734 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:28:13.734 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":79,"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","created":"2024-04-19T04:23:58.837304+0000","modified":"2024-04-19T04:28:13.077866+0000","last_up_change":"2024-04-19T04:28:01.596258+0000","last_in_change":"2024-04-19T04:24:00.437672+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T04:24:08.928860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T04:24:14.725769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T04:24:19.096707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T04:24:19.528844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28ba89d9-eaaf-4fb5-86bc-783b607a4cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":18128},{"type":"v1","addr":"172.21.15.27:6801","nonce":18128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":18128},{"type":"v1","addr":"172.21.15.27:6803","nonce":18128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":18128},{"type":"v1","addr":"172.21.15.27:6807","nonce":18128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":18128},{"type":"v1","addr":"172.21.15.27:6805","nonce":18128}]},"public_addr":"172.21.15.27:6801/18128","cluster_addr":"172.21.15.27:6803/18128","heartbeat_back_addr":"172.21.15.27:6807/18128","heartbeat_front_addr":"172.21.15.27:6805/18128","state":["exists","up"]},{"osd":1,"uuid":"9d5408b5-b74c-4e5e-858c-e0c8b593204e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":37,"up_from":72,"up_thru":72,"down_at":38,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1427},{"type":"v1","addr":"172.21.15.66:6801","nonce":1427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1427},{"type":"v1","addr":"172.21.15.66:6803","nonce":1427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1427},{"type":"v1","addr":"172.21.15.66:6807","nonce":1427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1427},{"type":"v1","addr":"172.21.15.66:6805","nonce":1427}]},"public_addr":"172.21.15.66:6801/1427","cluster_addr":"172.21.15.66:6803/1427","heartbeat_back_addr":"172.21.15.66:6807/1427","heartbeat_front_addr":"172.21.15.66:6805/1427","state":["exists","up"]},{"osd":2,"uuid":"9b600dc4-4425-4873-82d8-5434ca838bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":18250},{"type":"v1","addr":"172.21.15.172:6801","nonce":18250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":18250},{"type":"v1","addr":"172.21.15.172:6803","nonce":18250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":18250},{"type":"v1","addr":"172.21.15.172:6807","nonce":18250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":18250},{"type":"v1","addr":"172.21.15.172:6805","nonce":18250}]},"public_addr":"172.21.15.172:6801/18250","cluster_addr":"172.21.15.172:6803/18250","heartbeat_back_addr":"172.21.15.172:6807/18250","heartbeat_front_addr":"172.21.15.172:6805/18250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.749539+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.573103+0000","dead_epoch":37},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.812945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T04:28:13.750 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-19T04:28:13.750 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-19T04:28:13.751 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-19T04:28:13.901 INFO:teuthology.orchestra.run.smithi007.stdout:38654705718 2024-04-19T04:28:13.901 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T04:28:13.908 INFO:teuthology.orchestra.run.smithi007.stdout:38654705718 2024-04-19T04:28:13.909 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T04:28:13.915 INFO:teuthology.orchestra.run.smithi007.stdout:309237645316 2024-04-19T04:28:13.916 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T04:28:14.211 INFO:teuthology.orchestra.run.smithi007.stdout:38654705716 2024-04-19T04:28:14.231 INFO:teuthology.orchestra.run.smithi007.stdout:38654705716 2024-04-19T04:28:14.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705718 got 38654705716 for osd.0 2024-04-19T04:28:14.236 INFO:teuthology.orchestra.run.smithi007.stdout:309237645315 2024-04-19T04:28:14.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705718 got 38654705716 for osd.2 2024-04-19T04:28:14.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 309237645316 got 309237645315 for osd.1 2024-04-19T04:28:15.232 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T04:28:15.239 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T04:28:15.252 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T04:28:15.554 INFO:teuthology.orchestra.run.smithi007.stdout:38654705718 2024-04-19T04:28:15.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705718 got 38654705718 for osd.2 2024-04-19T04:28:15.568 DEBUG:teuthology.parallel:result is None 2024-04-19T04:28:15.579 INFO:teuthology.orchestra.run.smithi007.stdout:38654705718 2024-04-19T04:28:15.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705718 got 38654705718 for osd.0 2024-04-19T04:28:15.593 DEBUG:teuthology.parallel:result is None 2024-04-19T04:28:15.618 INFO:teuthology.orchestra.run.smithi007.stdout:309237645316 2024-04-19T04:28:15.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 309237645316 got 309237645316 for osd.1 2024-04-19T04:28:15.636 DEBUG:teuthology.parallel:result is None 2024-04-19T04:28:15.636 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-19T04:28:15.637 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:28:15.948 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:28:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:28:15.962 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-04-19T04:28:14.985465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":563496,"kb_used_data":2680,"kb_used_omap":9,"kb_used_meta":560758,"kb_avail":282552024,"statfs":{"total":289910292480,"available":289333272576,"internally_reserved":0,"allocated":2744320,"data_stored":2177294,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":10068,"internal_metadata":574216364},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.933310"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093601+0000","last_change":"2024-04-19T04:28:12.093601+0000","last_active":"2024-04-19T04:28:12.093601+0000","last_peered":"2024-04-19T04:28:12.093601+0000","last_clean":"2024-04-19T04:28:12.093601+0000","last_became_active":"2024-04-19T04:28:12.093175+0000","last_became_peered":"2024-04-19T04:28:12.093175+0000","last_unstale":"2024-04-19T04:28:12.093601+0000","last_undegraded":"2024-04-19T04:28:12.093601+0000","last_fullsized":"2024-04-19T04:28:12.093601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:53:38.070519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093573+0000","last_change":"2024-04-19T04:28:12.093573+0000","last_active":"2024-04-19T04:28:12.093573+0000","last_peered":"2024-04-19T04:28:12.093573+0000","last_clean":"2024-04-19T04:28:12.093573+0000","last_became_active":"2024-04-19T04:28:12.092819+0000","last_became_peered":"2024-04-19T04:28:12.092819+0000","last_unstale":"2024-04-19T04:28:12.093573+0000","last_undegraded":"2024-04-19T04:28:12.093573+0000","last_fullsized":"2024-04-19T04:28:12.093573+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:14.577765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079707+0000","last_change":"2024-04-19T04:24:20.556199+0000","last_active":"2024-04-19T04:28:12.079707+0000","last_peered":"2024-04-19T04:28:12.079707+0000","last_clean":"2024-04-19T04:28:12.079707+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:28:12.079707+0000","last_undegraded":"2024-04-19T04:28:12.079707+0000","last_fullsized":"2024-04-19T04:28:12.079707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:14.348910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078925+0000","last_change":"2024-04-19T04:28:02.635437+0000","last_active":"2024-04-19T04:28:12.078925+0000","last_peered":"2024-04-19T04:28:12.078925+0000","last_clean":"2024-04-19T04:28:12.078925+0000","last_became_active":"2024-04-19T04:28:02.634355+0000","last_became_peered":"2024-04-19T04:28:02.634355+0000","last_unstale":"2024-04-19T04:28:12.078925+0000","last_undegraded":"2024-04-19T04:28:12.078925+0000","last_fullsized":"2024-04-19T04:28:12.078925+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:39.534000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.090282+0000","last_change":"2024-04-19T04:28:12.090282+0000","last_active":"2024-04-19T04:28:12.090282+0000","last_peered":"2024-04-19T04:28:12.090282+0000","last_clean":"2024-04-19T04:28:12.090282+0000","last_became_active":"2024-04-19T04:28:12.088231+0000","last_became_peered":"2024-04-19T04:28:12.088231+0000","last_unstale":"2024-04-19T04:28:12.090282+0000","last_undegraded":"2024-04-19T04:28:12.090282+0000","last_fullsized":"2024-04-19T04:28:12.090282+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:48:51.512556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078586+0000","last_change":"2024-04-19T04:28:02.637742+0000","last_active":"2024-04-19T04:28:12.078586+0000","last_peered":"2024-04-19T04:28:12.078586+0000","last_clean":"2024-04-19T04:28:12.078586+0000","last_became_active":"2024-04-19T04:28:02.637276+0000","last_became_peered":"2024-04-19T04:28:02.637276+0000","last_unstale":"2024-04-19T04:28:12.078586+0000","last_undegraded":"2024-04-19T04:28:12.078586+0000","last_fullsized":"2024-04-19T04:28:12.078586+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:06.971707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078374+0000","last_change":"2024-04-19T04:28:02.637532+0000","last_active":"2024-04-19T04:28:12.078374+0000","last_peered":"2024-04-19T04:28:12.078374+0000","last_clean":"2024-04-19T04:28:12.078374+0000","last_became_active":"2024-04-19T04:28:02.637086+0000","last_became_peered":"2024-04-19T04:28:02.637086+0000","last_unstale":"2024-04-19T04:28:12.078374+0000","last_undegraded":"2024-04-19T04:28:12.078374+0000","last_fullsized":"2024-04-19T04:28:12.078374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:40:05.423094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.077959+0000","last_change":"2024-04-19T04:28:02.638186+0000","last_active":"2024-04-19T04:28:12.077959+0000","last_peered":"2024-04-19T04:28:12.077959+0000","last_clean":"2024-04-19T04:28:12.077959+0000","last_became_active":"2024-04-19T04:28:02.637746+0000","last_became_peered":"2024-04-19T04:28:02.637746+0000","last_unstale":"2024-04-19T04:28:12.077959+0000","last_undegraded":"2024-04-19T04:28:12.077959+0000","last_fullsized":"2024-04-19T04:28:12.077959+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:50.758441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287710+0000","last_change":"2024-04-19T04:28:02.842455+0000","last_active":"2024-04-19T04:28:12.287710+0000","last_peered":"2024-04-19T04:28:12.287710+0000","last_clean":"2024-04-19T04:28:12.287710+0000","last_became_active":"2024-04-19T04:28:02.839203+0000","last_became_peered":"2024-04-19T04:28:02.839203+0000","last_unstale":"2024-04-19T04:28:12.287710+0000","last_undegraded":"2024-04-19T04:28:12.287710+0000","last_fullsized":"2024-04-19T04:28:12.287710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:18:44.252505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093403+0000","last_change":"2024-04-19T04:28:12.093403+0000","last_active":"2024-04-19T04:28:12.093403+0000","last_peered":"2024-04-19T04:28:12.093403+0000","last_clean":"2024-04-19T04:28:12.093403+0000","last_became_active":"2024-04-19T04:28:12.092924+0000","last_became_peered":"2024-04-19T04:28:12.092924+0000","last_unstale":"2024-04-19T04:28:12.093403+0000","last_undegraded":"2024-04-19T04:28:12.093403+0000","last_fullsized":"2024-04-19T04:28:12.093403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:56.871317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079800+0000","last_change":"2024-04-19T04:28:02.636293+0000","last_active":"2024-04-19T04:28:12.079800+0000","last_peered":"2024-04-19T04:28:12.079800+0000","last_clean":"2024-04-19T04:28:12.079800+0000","last_became_active":"2024-04-19T04:28:02.635946+0000","last_became_peered":"2024-04-19T04:28:02.635946+0000","last_unstale":"2024-04-19T04:28:12.079800+0000","last_undegraded":"2024-04-19T04:28:12.079800+0000","last_fullsized":"2024-04-19T04:28:12.079800+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:42.381196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.100198+0000","last_change":"2024-04-19T04:28:12.095304+0000","last_active":"2024-04-19T04:28:12.100198+0000","last_peered":"2024-04-19T04:28:12.100198+0000","last_clean":"2024-04-19T04:28:12.100198+0000","last_became_active":"2024-04-19T04:28:12.094753+0000","last_became_peered":"2024-04-19T04:28:12.094753+0000","last_unstale":"2024-04-19T04:28:12.100198+0000","last_undegraded":"2024-04-19T04:28:12.100198+0000","last_fullsized":"2024-04-19T04:28:12.100198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:36:03.465294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093953+0000","last_change":"2024-04-19T04:28:12.093953+0000","last_active":"2024-04-19T04:28:12.093953+0000","last_peered":"2024-04-19T04:28:12.093953+0000","last_clean":"2024-04-19T04:28:12.093953+0000","last_became_active":"2024-04-19T04:28:12.093267+0000","last_became_peered":"2024-04-19T04:28:12.093267+0000","last_unstale":"2024-04-19T04:28:12.093953+0000","last_undegraded":"2024-04-19T04:28:12.093953+0000","last_fullsized":"2024-04-19T04:28:12.093953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:14.548542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078930+0000","last_change":"2024-04-19T04:24:20.552690+0000","last_active":"2024-04-19T04:28:12.078930+0000","last_peered":"2024-04-19T04:28:12.078930+0000","last_clean":"2024-04-19T04:28:12.078930+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:28:12.078930+0000","last_undegraded":"2024-04-19T04:28:12.078930+0000","last_fullsized":"2024-04-19T04:28:12.078930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:53:16.890992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078527+0000","last_change":"2024-04-19T04:24:20.551809+0000","last_active":"2024-04-19T04:28:12.078527+0000","last_peered":"2024-04-19T04:28:12.078527+0000","last_clean":"2024-04-19T04:28:12.078527+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:28:12.078527+0000","last_undegraded":"2024-04-19T04:28:12.078527+0000","last_fullsized":"2024-04-19T04:28:12.078527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:43:31.281765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078198+0000","last_change":"2024-04-19T04:28:02.638726+0000","last_active":"2024-04-19T04:28:12.078198+0000","last_peered":"2024-04-19T04:28:12.078198+0000","last_clean":"2024-04-19T04:28:12.078198+0000","last_became_active":"2024-04-19T04:28:02.637920+0000","last_became_peered":"2024-04-19T04:28:02.637920+0000","last_unstale":"2024-04-19T04:28:12.078198+0000","last_undegraded":"2024-04-19T04:28:12.078198+0000","last_fullsized":"2024-04-19T04:28:12.078198+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:23:42.710810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287706+0000","last_change":"2024-04-19T04:28:02.841438+0000","last_active":"2024-04-19T04:28:12.287706+0000","last_peered":"2024-04-19T04:28:12.287706+0000","last_clean":"2024-04-19T04:28:12.287706+0000","last_became_active":"2024-04-19T04:28:02.839071+0000","last_became_peered":"2024-04-19T04:28:02.839071+0000","last_unstale":"2024-04-19T04:28:12.287706+0000","last_undegraded":"2024-04-19T04:28:12.287706+0000","last_fullsized":"2024-04-19T04:28:12.287706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:37:05.846827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":82,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.084946+0000","last_change":"2024-04-19T04:28:02.638587+0000","last_active":"2024-04-19T04:28:11.084946+0000","last_peered":"2024-04-19T04:28:11.084946+0000","last_clean":"2024-04-19T04:28:11.084946+0000","last_became_active":"2024-04-19T04:28:02.638230+0000","last_became_peered":"2024-04-19T04:28:02.638230+0000","last_unstale":"2024-04-19T04:28:11.084946+0000","last_undegraded":"2024-04-19T04:28:11.084946+0000","last_fullsized":"2024-04-19T04:28:11.084946+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:43:23.974591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286685+0000","last_change":"2024-04-19T04:28:02.840423+0000","last_active":"2024-04-19T04:28:12.286685+0000","last_peered":"2024-04-19T04:28:12.286685+0000","last_clean":"2024-04-19T04:28:12.286685+0000","last_became_active":"2024-04-19T04:28:02.839362+0000","last_became_peered":"2024-04-19T04:28:02.839362+0000","last_unstale":"2024-04-19T04:28:12.286685+0000","last_undegraded":"2024-04-19T04:28:12.286685+0000","last_fullsized":"2024-04-19T04:28:12.286685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:24:55.325024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079785+0000","last_change":"2024-04-19T04:28:02.635566+0000","last_active":"2024-04-19T04:28:12.079785+0000","last_peered":"2024-04-19T04:28:12.079785+0000","last_clean":"2024-04-19T04:28:12.079785+0000","last_became_active":"2024-04-19T04:28:02.634835+0000","last_became_peered":"2024-04-19T04:28:02.634835+0000","last_unstale":"2024-04-19T04:28:12.079785+0000","last_undegraded":"2024-04-19T04:28:12.079785+0000","last_fullsized":"2024-04-19T04:28:12.079785+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:04.159997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079199+0000","last_change":"2024-04-19T04:28:02.639259+0000","last_active":"2024-04-19T04:28:12.079199+0000","last_peered":"2024-04-19T04:28:12.079199+0000","last_clean":"2024-04-19T04:28:12.079199+0000","last_became_active":"2024-04-19T04:28:02.638546+0000","last_became_peered":"2024-04-19T04:28:02.638546+0000","last_unstale":"2024-04-19T04:28:12.079199+0000","last_undegraded":"2024-04-19T04:28:12.079199+0000","last_fullsized":"2024-04-19T04:28:12.079199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:47:45.968474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094010+0000","last_change":"2024-04-19T04:28:12.089576+0000","last_active":"2024-04-19T04:28:12.094010+0000","last_peered":"2024-04-19T04:28:12.094010+0000","last_clean":"2024-04-19T04:28:12.094010+0000","last_became_active":"2024-04-19T04:28:12.087571+0000","last_became_peered":"2024-04-19T04:28:12.087571+0000","last_unstale":"2024-04-19T04:28:12.094010+0000","last_undegraded":"2024-04-19T04:28:12.094010+0000","last_fullsized":"2024-04-19T04:28:12.094010+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:42.381196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285546+0000","last_change":"2024-04-19T04:28:02.842994+0000","last_active":"2024-04-19T04:28:12.285546+0000","last_peered":"2024-04-19T04:28:12.285546+0000","last_clean":"2024-04-19T04:28:12.285546+0000","last_became_active":"2024-04-19T04:28:02.840294+0000","last_became_peered":"2024-04-19T04:28:02.840294+0000","last_unstale":"2024-04-19T04:28:12.285546+0000","last_undegraded":"2024-04-19T04:28:12.285546+0000","last_fullsized":"2024-04-19T04:28:12.285546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:26.503064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.090413+0000","last_change":"2024-04-19T04:28:12.090413+0000","last_active":"2024-04-19T04:28:12.090413+0000","last_peered":"2024-04-19T04:28:12.090413+0000","last_clean":"2024-04-19T04:28:12.090413+0000","last_became_active":"2024-04-19T04:28:12.089918+0000","last_became_peered":"2024-04-19T04:28:12.089918+0000","last_unstale":"2024-04-19T04:28:12.090413+0000","last_undegraded":"2024-04-19T04:28:12.090413+0000","last_fullsized":"2024-04-19T04:28:12.090413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:08.501081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095501+0000","last_change":"2024-04-19T04:28:12.092733+0000","last_active":"2024-04-19T04:28:12.095501+0000","last_peered":"2024-04-19T04:28:12.095501+0000","last_clean":"2024-04-19T04:28:12.095501+0000","last_became_active":"2024-04-19T04:28:12.091770+0000","last_became_peered":"2024-04-19T04:28:12.091770+0000","last_unstale":"2024-04-19T04:28:12.095501+0000","last_undegraded":"2024-04-19T04:28:12.095501+0000","last_fullsized":"2024-04-19T04:28:12.095501+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:39:38.261503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287546+0000","last_change":"2024-04-19T04:28:02.846092+0000","last_active":"2024-04-19T04:28:12.287546+0000","last_peered":"2024-04-19T04:28:12.287546+0000","last_clean":"2024-04-19T04:28:12.287546+0000","last_became_active":"2024-04-19T04:28:02.845416+0000","last_became_peered":"2024-04-19T04:28:02.845416+0000","last_unstale":"2024-04-19T04:28:12.287546+0000","last_undegraded":"2024-04-19T04:28:12.287546+0000","last_fullsized":"2024-04-19T04:28:12.287546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:23.517160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079927+0000","last_change":"2024-04-19T04:24:20.554885+0000","last_active":"2024-04-19T04:28:12.079927+0000","last_peered":"2024-04-19T04:28:12.079927+0000","last_clean":"2024-04-19T04:28:12.079927+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:28:12.079927+0000","last_undegraded":"2024-04-19T04:28:12.079927+0000","last_fullsized":"2024-04-19T04:28:12.079927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:44:08.285518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095487+0000","last_change":"2024-04-19T04:28:12.092936+0000","last_active":"2024-04-19T04:28:12.095487+0000","last_peered":"2024-04-19T04:28:12.095487+0000","last_clean":"2024-04-19T04:28:12.095487+0000","last_became_active":"2024-04-19T04:28:12.091969+0000","last_became_peered":"2024-04-19T04:28:12.091969+0000","last_unstale":"2024-04-19T04:28:12.095487+0000","last_undegraded":"2024-04-19T04:28:12.095487+0000","last_fullsized":"2024-04-19T04:28:12.095487+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:20.569368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285809+0000","last_change":"2024-04-19T04:28:02.845150+0000","last_active":"2024-04-19T04:28:12.285809+0000","last_peered":"2024-04-19T04:28:12.285809+0000","last_clean":"2024-04-19T04:28:12.285809+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:28:12.285809+0000","last_undegraded":"2024-04-19T04:28:12.285809+0000","last_fullsized":"2024-04-19T04:28:12.285809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:27:04.257043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":69,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.075220+0000","last_change":"2024-04-19T04:24:20.554847+0000","last_active":"2024-04-19T04:28:11.075220+0000","last_peered":"2024-04-19T04:28:11.075220+0000","last_clean":"2024-04-19T04:28:11.075220+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:28:11.075220+0000","last_undegraded":"2024-04-19T04:28:11.075220+0000","last_fullsized":"2024-04-19T04:28:11.075220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:00.475711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286101+0000","last_change":"2024-04-19T04:28:02.843590+0000","last_active":"2024-04-19T04:28:12.286101+0000","last_peered":"2024-04-19T04:28:12.286101+0000","last_clean":"2024-04-19T04:28:12.286101+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:28:12.286101+0000","last_undegraded":"2024-04-19T04:28:12.286101+0000","last_fullsized":"2024-04-19T04:28:12.286101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:02.147016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078180+0000","last_change":"2024-04-19T04:28:02.635119+0000","last_active":"2024-04-19T04:28:12.078180+0000","last_peered":"2024-04-19T04:28:12.078180+0000","last_clean":"2024-04-19T04:28:12.078180+0000","last_became_active":"2024-04-19T04:28:02.634586+0000","last_became_peered":"2024-04-19T04:28:02.634586+0000","last_unstale":"2024-04-19T04:28:12.078180+0000","last_undegraded":"2024-04-19T04:28:12.078180+0000","last_fullsized":"2024-04-19T04:28:12.078180+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:08.719606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095305+0000","last_change":"2024-04-19T04:28:12.095305+0000","last_active":"2024-04-19T04:28:12.095305+0000","last_peered":"2024-04-19T04:28:12.095305+0000","last_clean":"2024-04-19T04:28:12.095305+0000","last_became_active":"2024-04-19T04:28:12.094558+0000","last_became_peered":"2024-04-19T04:28:12.094558+0000","last_unstale":"2024-04-19T04:28:12.095305+0000","last_undegraded":"2024-04-19T04:28:12.095305+0000","last_fullsized":"2024-04-19T04:28:12.095305+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:44:45.647590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":87,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079450+0000","last_change":"2024-04-19T04:28:02.639581+0000","last_active":"2024-04-19T04:28:12.079450+0000","last_peered":"2024-04-19T04:28:12.079450+0000","last_clean":"2024-04-19T04:28:12.079450+0000","last_became_active":"2024-04-19T04:28:02.638666+0000","last_became_peered":"2024-04-19T04:28:02.638666+0000","last_unstale":"2024-04-19T04:28:12.079450+0000","last_undegraded":"2024-04-19T04:28:12.079450+0000","last_fullsized":"2024-04-19T04:28:12.079450+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:42:54.107998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095631+0000","last_change":"2024-04-19T04:28:12.095631+0000","last_active":"2024-04-19T04:28:12.095631+0000","last_peered":"2024-04-19T04:28:12.095631+0000","last_clean":"2024-04-19T04:28:12.095631+0000","last_became_active":"2024-04-19T04:28:12.094722+0000","last_became_peered":"2024-04-19T04:28:12.094722+0000","last_unstale":"2024-04-19T04:28:12.095631+0000","last_undegraded":"2024-04-19T04:28:12.095631+0000","last_fullsized":"2024-04-19T04:28:12.095631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:31.378691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287127+0000","last_change":"2024-04-19T04:28:02.843299+0000","last_active":"2024-04-19T04:28:12.287127+0000","last_peered":"2024-04-19T04:28:12.287127+0000","last_clean":"2024-04-19T04:28:12.287127+0000","last_became_active":"2024-04-19T04:28:02.842525+0000","last_became_peered":"2024-04-19T04:28:02.842525+0000","last_unstale":"2024-04-19T04:28:12.287127+0000","last_undegraded":"2024-04-19T04:28:12.287127+0000","last_fullsized":"2024-04-19T04:28:12.287127+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:10:33.303473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287136+0000","last_change":"2024-04-19T04:28:02.845685+0000","last_active":"2024-04-19T04:28:12.287136+0000","last_peered":"2024-04-19T04:28:12.287136+0000","last_clean":"2024-04-19T04:28:12.287136+0000","last_became_active":"2024-04-19T04:28:02.843099+0000","last_became_peered":"2024-04-19T04:28:02.843099+0000","last_unstale":"2024-04-19T04:28:12.287136+0000","last_undegraded":"2024-04-19T04:28:12.287136+0000","last_fullsized":"2024-04-19T04:28:12.287136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:25:05.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095287+0000","last_change":"2024-04-19T04:28:12.092744+0000","last_active":"2024-04-19T04:28:12.095287+0000","last_peered":"2024-04-19T04:28:12.095287+0000","last_clean":"2024-04-19T04:28:12.095287+0000","last_became_active":"2024-04-19T04:28:12.091771+0000","last_became_peered":"2024-04-19T04:28:12.091771+0000","last_unstale":"2024-04-19T04:28:12.095287+0000","last_undegraded":"2024-04-19T04:28:12.095287+0000","last_fullsized":"2024-04-19T04:28:12.095287+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:34.728962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287385+0000","last_change":"2024-04-19T04:28:02.837331+0000","last_active":"2024-04-19T04:28:12.287385+0000","last_peered":"2024-04-19T04:28:12.287385+0000","last_clean":"2024-04-19T04:28:12.287385+0000","last_became_active":"2024-04-19T04:28:02.836984+0000","last_became_peered":"2024-04-19T04:28:02.836984+0000","last_unstale":"2024-04-19T04:28:12.287385+0000","last_undegraded":"2024-04-19T04:28:12.287385+0000","last_fullsized":"2024-04-19T04:28:12.287385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:11.858503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":80,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078519+0000","last_change":"2024-04-19T04:24:20.187299+0000","last_active":"2024-04-19T04:28:12.078519+0000","last_peered":"2024-04-19T04:28:12.078519+0000","last_clean":"2024-04-19T04:28:12.078519+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:28:12.078519+0000","last_undegraded":"2024-04-19T04:28:12.078519+0000","last_fullsized":"2024-04-19T04:28:12.078519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:49:37.812125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":73,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080835+0000","last_change":"2024-04-19T04:24:20.186029+0000","last_active":"2024-04-19T04:28:12.080835+0000","last_peered":"2024-04-19T04:28:12.080835+0000","last_clean":"2024-04-19T04:28:12.080835+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:28:12.080835+0000","last_undegraded":"2024-04-19T04:28:12.080835+0000","last_fullsized":"2024-04-19T04:28:12.080835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:49.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095216+0000","last_change":"2024-04-19T04:28:12.092118+0000","last_active":"2024-04-19T04:28:12.095216+0000","last_peered":"2024-04-19T04:28:12.095216+0000","last_clean":"2024-04-19T04:28:12.095216+0000","last_became_active":"2024-04-19T04:28:12.090379+0000","last_became_peered":"2024-04-19T04:28:12.090379+0000","last_unstale":"2024-04-19T04:28:12.095216+0000","last_undegraded":"2024-04-19T04:28:12.095216+0000","last_fullsized":"2024-04-19T04:28:12.095216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:38.494787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094285+0000","last_change":"2024-04-19T04:28:12.090491+0000","last_active":"2024-04-19T04:28:12.094285+0000","last_peered":"2024-04-19T04:28:12.094285+0000","last_clean":"2024-04-19T04:28:12.094285+0000","last_became_active":"2024-04-19T04:28:12.089948+0000","last_became_peered":"2024-04-19T04:28:12.089948+0000","last_unstale":"2024-04-19T04:28:12.094285+0000","last_undegraded":"2024-04-19T04:28:12.094285+0000","last_fullsized":"2024-04-19T04:28:12.094285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:04:35.343697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093574+0000","last_change":"2024-04-19T04:28:12.093574+0000","last_active":"2024-04-19T04:28:12.093574+0000","last_peered":"2024-04-19T04:28:12.093574+0000","last_clean":"2024-04-19T04:28:12.093574+0000","last_became_active":"2024-04-19T04:28:12.093090+0000","last_became_peered":"2024-04-19T04:28:12.093090+0000","last_unstale":"2024-04-19T04:28:12.093574+0000","last_undegraded":"2024-04-19T04:28:12.093574+0000","last_fullsized":"2024-04-19T04:28:12.093574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:32:01.796620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":73,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080387+0000","last_change":"2024-04-19T04:24:20.186044+0000","last_active":"2024-04-19T04:28:12.080387+0000","last_peered":"2024-04-19T04:28:12.080387+0000","last_clean":"2024-04-19T04:28:12.080387+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:28:12.080387+0000","last_undegraded":"2024-04-19T04:28:12.080387+0000","last_fullsized":"2024-04-19T04:28:12.080387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.432692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079351+0000","last_change":"2024-04-19T04:28:02.636589+0000","last_active":"2024-04-19T04:28:12.079351+0000","last_peered":"2024-04-19T04:28:12.079351+0000","last_clean":"2024-04-19T04:28:12.079351+0000","last_became_active":"2024-04-19T04:28:02.636231+0000","last_became_peered":"2024-04-19T04:28:02.636231+0000","last_unstale":"2024-04-19T04:28:12.079351+0000","last_undegraded":"2024-04-19T04:28:12.079351+0000","last_fullsized":"2024-04-19T04:28:12.079351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:25:32.636485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080045+0000","last_change":"2024-04-19T04:28:02.635650+0000","last_active":"2024-04-19T04:28:12.080045+0000","last_peered":"2024-04-19T04:28:12.080045+0000","last_clean":"2024-04-19T04:28:12.080045+0000","last_became_active":"2024-04-19T04:28:02.634823+0000","last_became_peered":"2024-04-19T04:28:02.634823+0000","last_unstale":"2024-04-19T04:28:12.080045+0000","last_undegraded":"2024-04-19T04:28:12.080045+0000","last_fullsized":"2024-04-19T04:28:12.080045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:37.205733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287721+0000","last_change":"2024-04-19T04:28:02.845805+0000","last_active":"2024-04-19T04:28:12.287721+0000","last_peered":"2024-04-19T04:28:12.287721+0000","last_clean":"2024-04-19T04:28:12.287721+0000","last_became_active":"2024-04-19T04:28:02.845461+0000","last_became_peered":"2024-04-19T04:28:02.845461+0000","last_unstale":"2024-04-19T04:28:12.287721+0000","last_undegraded":"2024-04-19T04:28:12.287721+0000","last_fullsized":"2024-04-19T04:28:12.287721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:57:44.161931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287443+0000","last_change":"2024-04-19T04:28:02.845613+0000","last_active":"2024-04-19T04:28:12.287443+0000","last_peered":"2024-04-19T04:28:12.287443+0000","last_clean":"2024-04-19T04:28:12.287443+0000","last_became_active":"2024-04-19T04:28:02.844927+0000","last_became_peered":"2024-04-19T04:28:02.844927+0000","last_unstale":"2024-04-19T04:28:12.287443+0000","last_undegraded":"2024-04-19T04:28:12.287443+0000","last_fullsized":"2024-04-19T04:28:12.287443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:59.219663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079185+0000","last_change":"2024-04-19T04:28:02.635751+0000","last_active":"2024-04-19T04:28:12.079185+0000","last_peered":"2024-04-19T04:28:12.079185+0000","last_clean":"2024-04-19T04:28:12.079185+0000","last_became_active":"2024-04-19T04:28:02.635238+0000","last_became_peered":"2024-04-19T04:28:02.635238+0000","last_unstale":"2024-04-19T04:28:12.079185+0000","last_undegraded":"2024-04-19T04:28:12.079185+0000","last_fullsized":"2024-04-19T04:28:12.079185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:24:14.292299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079943+0000","last_change":"2024-04-19T04:28:02.638055+0000","last_active":"2024-04-19T04:28:12.079943+0000","last_peered":"2024-04-19T04:28:12.079943+0000","last_clean":"2024-04-19T04:28:12.079943+0000","last_became_active":"2024-04-19T04:28:02.637651+0000","last_became_peered":"2024-04-19T04:28:02.637651+0000","last_unstale":"2024-04-19T04:28:12.079943+0000","last_undegraded":"2024-04-19T04:28:12.079943+0000","last_fullsized":"2024-04-19T04:28:12.079943+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:25:55.832256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080143+0000","last_change":"2024-04-19T04:24:20.555922+0000","last_active":"2024-04-19T04:28:12.080143+0000","last_peered":"2024-04-19T04:28:12.080143+0000","last_clean":"2024-04-19T04:28:12.080143+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:28:12.080143+0000","last_undegraded":"2024-04-19T04:28:12.080143+0000","last_fullsized":"2024-04-19T04:28:12.080143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:06:53.595149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":70,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.078809+0000","last_change":"2024-04-19T04:24:20.183944+0000","last_active":"2024-04-19T04:28:11.078809+0000","last_peered":"2024-04-19T04:28:11.078809+0000","last_clean":"2024-04-19T04:28:11.078809+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:28:11.078809+0000","last_undegraded":"2024-04-19T04:28:11.078809+0000","last_fullsized":"2024-04-19T04:28:11.078809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:42.018487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079773+0000","last_change":"2024-04-19T04:24:20.553085+0000","last_active":"2024-04-19T04:28:12.079773+0000","last_peered":"2024-04-19T04:28:12.079773+0000","last_clean":"2024-04-19T04:28:12.079773+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:28:12.079773+0000","last_undegraded":"2024-04-19T04:28:12.079773+0000","last_fullsized":"2024-04-19T04:28:12.079773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:07:21.467758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":67,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.089659+0000","last_change":"2024-04-19T04:28:12.089659+0000","last_active":"2024-04-19T04:28:12.089659+0000","last_peered":"2024-04-19T04:28:12.089659+0000","last_clean":"2024-04-19T04:28:12.089659+0000","last_became_active":"2024-04-19T04:28:12.088043+0000","last_became_peered":"2024-04-19T04:28:12.088043+0000","last_unstale":"2024-04-19T04:28:12.089659+0000","last_undegraded":"2024-04-19T04:28:12.089659+0000","last_fullsized":"2024-04-19T04:28:12.089659+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:02:42.873134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288226+0000","last_change":"2024-04-19T04:28:02.844467+0000","last_active":"2024-04-19T04:28:12.288226+0000","last_peered":"2024-04-19T04:28:12.288226+0000","last_clean":"2024-04-19T04:28:12.288226+0000","last_became_active":"2024-04-19T04:28:02.843639+0000","last_became_peered":"2024-04-19T04:28:02.843639+0000","last_unstale":"2024-04-19T04:28:12.288226+0000","last_undegraded":"2024-04-19T04:28:12.288226+0000","last_fullsized":"2024-04-19T04:28:12.288226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:24.660145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":275,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094355+0000","last_change":"2024-04-19T04:24:10.106278+0000","last_active":"2024-04-19T04:28:13.094355+0000","last_peered":"2024-04-19T04:28:13.094355+0000","last_clean":"2024-04-19T04:28:13.094355+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:28:13.094355+0000","last_undegraded":"2024-04-19T04:28:13.094355+0000","last_fullsized":"2024-04-19T04:28:13.094355+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_clean_scrub_stamp":"2024-04-19T04:24:09.083488+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":88,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079654+0000","last_change":"2024-04-19T04:28:02.639632+0000","last_active":"2024-04-19T04:28:12.079654+0000","last_peered":"2024-04-19T04:28:12.079654+0000","last_clean":"2024-04-19T04:28:12.079654+0000","last_became_active":"2024-04-19T04:28:02.639240+0000","last_became_peered":"2024-04-19T04:28:02.639240+0000","last_unstale":"2024-04-19T04:28:12.079654+0000","last_undegraded":"2024-04-19T04:28:12.079654+0000","last_fullsized":"2024-04-19T04:28:12.079654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:54.035030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287535+0000","last_change":"2024-04-19T04:28:02.842437+0000","last_active":"2024-04-19T04:28:12.287535+0000","last_peered":"2024-04-19T04:28:12.287535+0000","last_clean":"2024-04-19T04:28:12.287535+0000","last_became_active":"2024-04-19T04:28:02.841053+0000","last_became_peered":"2024-04-19T04:28:02.841053+0000","last_unstale":"2024-04-19T04:28:12.287535+0000","last_undegraded":"2024-04-19T04:28:12.287535+0000","last_fullsized":"2024-04-19T04:28:12.287535+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:45.323344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080363+0000","last_change":"2024-04-19T04:24:20.553999+0000","last_active":"2024-04-19T04:28:12.080363+0000","last_peered":"2024-04-19T04:28:12.080363+0000","last_clean":"2024-04-19T04:28:12.080363+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:28:12.080363+0000","last_undegraded":"2024-04-19T04:28:12.080363+0000","last_fullsized":"2024-04-19T04:28:12.080363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:13:53.306369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078665+0000","last_change":"2024-04-19T04:24:16.144482+0000","last_active":"2024-04-19T04:28:12.078665+0000","last_peered":"2024-04-19T04:28:12.078665+0000","last_clean":"2024-04-19T04:28:12.078665+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:28:12.078665+0000","last_undegraded":"2024-04-19T04:28:12.078665+0000","last_fullsized":"2024-04-19T04:28:12.078665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:15.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285234+0000","last_change":"2024-04-19T04:28:02.842303+0000","last_active":"2024-04-19T04:28:12.285234+0000","last_peered":"2024-04-19T04:28:12.285234+0000","last_clean":"2024-04-19T04:28:12.285234+0000","last_became_active":"2024-04-19T04:28:02.839926+0000","last_became_peered":"2024-04-19T04:28:02.839926+0000","last_unstale":"2024-04-19T04:28:12.285234+0000","last_undegraded":"2024-04-19T04:28:12.285234+0000","last_fullsized":"2024-04-19T04:28:12.285234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:13.266751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":82,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.082938+0000","last_change":"2024-04-19T04:28:02.638370+0000","last_active":"2024-04-19T04:28:11.082938+0000","last_peered":"2024-04-19T04:28:11.082938+0000","last_clean":"2024-04-19T04:28:11.082938+0000","last_became_active":"2024-04-19T04:28:02.638095+0000","last_became_peered":"2024-04-19T04:28:02.638095+0000","last_unstale":"2024-04-19T04:28:11.082938+0000","last_undegraded":"2024-04-19T04:28:11.082938+0000","last_fullsized":"2024-04-19T04:28:11.082938+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:16:46.463514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285839+0000","last_change":"2024-04-19T04:28:02.843324+0000","last_active":"2024-04-19T04:28:12.285839+0000","last_peered":"2024-04-19T04:28:12.285839+0000","last_clean":"2024-04-19T04:28:12.285839+0000","last_became_active":"2024-04-19T04:28:02.840328+0000","last_became_peered":"2024-04-19T04:28:02.840328+0000","last_unstale":"2024-04-19T04:28:12.285839+0000","last_undegraded":"2024-04-19T04:28:12.285839+0000","last_fullsized":"2024-04-19T04:28:12.285839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:58:19.389865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.092725+0000","last_change":"2024-04-19T04:28:12.088382+0000","last_active":"2024-04-19T04:28:12.092725+0000","last_peered":"2024-04-19T04:28:12.092725+0000","last_clean":"2024-04-19T04:28:12.092725+0000","last_became_active":"2024-04-19T04:28:12.087575+0000","last_became_peered":"2024-04-19T04:28:12.087575+0000","last_unstale":"2024-04-19T04:28:12.092725+0000","last_undegraded":"2024-04-19T04:28:12.092725+0000","last_fullsized":"2024-04-19T04:28:12.092725+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:13.034157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288155+0000","last_change":"2024-04-19T04:28:02.844076+0000","last_active":"2024-04-19T04:28:12.288155+0000","last_peered":"2024-04-19T04:28:12.288155+0000","last_clean":"2024-04-19T04:28:12.288155+0000","last_became_active":"2024-04-19T04:28:02.840839+0000","last_became_peered":"2024-04-19T04:28:02.840839+0000","last_unstale":"2024-04-19T04:28:12.288155+0000","last_undegraded":"2024-04-19T04:28:12.288155+0000","last_fullsized":"2024-04-19T04:28:12.288155+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:31.891080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":88,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080149+0000","last_change":"2024-04-19T04:28:02.635123+0000","last_active":"2024-04-19T04:28:12.080149+0000","last_peered":"2024-04-19T04:28:12.080149+0000","last_clean":"2024-04-19T04:28:12.080149+0000","last_became_active":"2024-04-19T04:28:02.634633+0000","last_became_peered":"2024-04-19T04:28:02.634633+0000","last_unstale":"2024-04-19T04:28:12.080149+0000","last_undegraded":"2024-04-19T04:28:12.080149+0000","last_fullsized":"2024-04-19T04:28:12.080149+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:47:35.387548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079490+0000","last_change":"2024-04-19T04:28:02.638250+0000","last_active":"2024-04-19T04:28:12.079490+0000","last_peered":"2024-04-19T04:28:12.079490+0000","last_clean":"2024-04-19T04:28:12.079490+0000","last_became_active":"2024-04-19T04:28:02.637233+0000","last_became_peered":"2024-04-19T04:28:02.637233+0000","last_unstale":"2024-04-19T04:28:12.079490+0000","last_undegraded":"2024-04-19T04:28:12.079490+0000","last_fullsized":"2024-04-19T04:28:12.079490+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:53:27.253209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286825+0000","last_change":"2024-04-19T04:28:02.838255+0000","last_active":"2024-04-19T04:28:12.286825+0000","last_peered":"2024-04-19T04:28:12.286825+0000","last_clean":"2024-04-19T04:28:12.286825+0000","last_became_active":"2024-04-19T04:28:02.837829+0000","last_became_peered":"2024-04-19T04:28:02.837829+0000","last_unstale":"2024-04-19T04:28:12.286825+0000","last_undegraded":"2024-04-19T04:28:12.286825+0000","last_fullsized":"2024-04-19T04:28:12.286825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:11:30.005510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080527+0000","last_change":"2024-04-19T04:28:02.636097+0000","last_active":"2024-04-19T04:28:12.080527+0000","last_peered":"2024-04-19T04:28:12.080527+0000","last_clean":"2024-04-19T04:28:12.080527+0000","last_became_active":"2024-04-19T04:28:02.634103+0000","last_became_peered":"2024-04-19T04:28:02.634103+0000","last_unstale":"2024-04-19T04:28:12.080527+0000","last_undegraded":"2024-04-19T04:28:12.080527+0000","last_fullsized":"2024-04-19T04:28:12.080527+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:37.486856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285930+0000","last_change":"2024-04-19T04:28:02.835876+0000","last_active":"2024-04-19T04:28:12.285930+0000","last_peered":"2024-04-19T04:28:12.285930+0000","last_clean":"2024-04-19T04:28:12.285930+0000","last_became_active":"2024-04-19T04:28:02.835057+0000","last_became_peered":"2024-04-19T04:28:02.835057+0000","last_unstale":"2024-04-19T04:28:12.285930+0000","last_undegraded":"2024-04-19T04:28:12.285930+0000","last_fullsized":"2024-04-19T04:28:12.285930+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:18.104384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":69,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.074987+0000","last_change":"2024-04-19T04:24:20.555116+0000","last_active":"2024-04-19T04:28:11.074987+0000","last_peered":"2024-04-19T04:28:11.074987+0000","last_clean":"2024-04-19T04:28:11.074987+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:28:11.074987+0000","last_undegraded":"2024-04-19T04:28:11.074987+0000","last_fullsized":"2024-04-19T04:28:11.074987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:21.734428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286409+0000","last_change":"2024-04-19T04:28:02.840145+0000","last_active":"2024-04-19T04:28:12.286409+0000","last_peered":"2024-04-19T04:28:12.286409+0000","last_clean":"2024-04-19T04:28:12.286409+0000","last_became_active":"2024-04-19T04:28:02.838918+0000","last_became_peered":"2024-04-19T04:28:02.838918+0000","last_unstale":"2024-04-19T04:28:12.286409+0000","last_undegraded":"2024-04-19T04:28:12.286409+0000","last_fullsized":"2024-04-19T04:28:12.286409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:27.667000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.092906+0000","last_change":"2024-04-19T04:28:12.092906+0000","last_active":"2024-04-19T04:28:12.092906+0000","last_peered":"2024-04-19T04:28:12.092906+0000","last_clean":"2024-04-19T04:28:12.092906+0000","last_became_active":"2024-04-19T04:28:12.091609+0000","last_became_peered":"2024-04-19T04:28:12.091609+0000","last_unstale":"2024-04-19T04:28:12.092906+0000","last_undegraded":"2024-04-19T04:28:12.092906+0000","last_fullsized":"2024-04-19T04:28:12.092906+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:42:50.079444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095641+0000","last_change":"2024-04-19T04:28:12.092944+0000","last_active":"2024-04-19T04:28:12.095641+0000","last_peered":"2024-04-19T04:28:12.095641+0000","last_clean":"2024-04-19T04:28:12.095641+0000","last_became_active":"2024-04-19T04:28:12.091335+0000","last_became_peered":"2024-04-19T04:28:12.091335+0000","last_unstale":"2024-04-19T04:28:12.095641+0000","last_undegraded":"2024-04-19T04:28:12.095641+0000","last_fullsized":"2024-04-19T04:28:12.095641+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:39:57.870227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287403+0000","last_change":"2024-04-19T04:28:02.843341+0000","last_active":"2024-04-19T04:28:12.287403+0000","last_peered":"2024-04-19T04:28:12.287403+0000","last_clean":"2024-04-19T04:28:12.287403+0000","last_became_active":"2024-04-19T04:28:02.839883+0000","last_became_peered":"2024-04-19T04:28:02.839883+0000","last_unstale":"2024-04-19T04:28:12.287403+0000","last_undegraded":"2024-04-19T04:28:12.287403+0000","last_fullsized":"2024-04-19T04:28:12.287403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:39:33.503440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286657+0000","last_change":"2024-04-19T04:28:02.845957+0000","last_active":"2024-04-19T04:28:12.286657+0000","last_peered":"2024-04-19T04:28:12.286657+0000","last_clean":"2024-04-19T04:28:12.286657+0000","last_became_active":"2024-04-19T04:28:02.845256+0000","last_became_peered":"2024-04-19T04:28:02.845256+0000","last_unstale":"2024-04-19T04:28:12.286657+0000","last_undegraded":"2024-04-19T04:28:12.286657+0000","last_fullsized":"2024-04-19T04:28:12.286657+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:28:34.674877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285602+0000","last_change":"2024-04-19T04:28:02.845275+0000","last_active":"2024-04-19T04:28:12.285602+0000","last_peered":"2024-04-19T04:28:12.285602+0000","last_clean":"2024-04-19T04:28:12.285602+0000","last_became_active":"2024-04-19T04:28:02.844128+0000","last_became_peered":"2024-04-19T04:28:02.844128+0000","last_unstale":"2024-04-19T04:28:12.285602+0000","last_undegraded":"2024-04-19T04:28:12.285602+0000","last_fullsized":"2024-04-19T04:28:12.285602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:08:59.450805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286896+0000","last_change":"2024-04-19T04:28:02.845918+0000","last_active":"2024-04-19T04:28:12.286896+0000","last_peered":"2024-04-19T04:28:12.286896+0000","last_clean":"2024-04-19T04:28:12.286896+0000","last_became_active":"2024-04-19T04:28:02.844483+0000","last_became_peered":"2024-04-19T04:28:02.844483+0000","last_unstale":"2024-04-19T04:28:12.286896+0000","last_undegraded":"2024-04-19T04:28:12.286896+0000","last_fullsized":"2024-04-19T04:28:12.286896+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:33:18.588838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080894+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:28:12.080894+0000","last_peered":"2024-04-19T04:28:12.080894+0000","last_clean":"2024-04-19T04:28:12.080894+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:28:12.080894+0000","last_undegraded":"2024-04-19T04:28:12.080894+0000","last_fullsized":"2024-04-19T04:28:12.080894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:45.574813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094276+0000","last_change":"2024-04-19T04:28:12.091443+0000","last_active":"2024-04-19T04:28:12.094276+0000","last_peered":"2024-04-19T04:28:12.094276+0000","last_clean":"2024-04-19T04:28:12.094276+0000","last_became_active":"2024-04-19T04:28:12.088123+0000","last_became_peered":"2024-04-19T04:28:12.088123+0000","last_unstale":"2024-04-19T04:28:12.094276+0000","last_undegraded":"2024-04-19T04:28:12.094276+0000","last_fullsized":"2024-04-19T04:28:12.094276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:46.736712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079124+0000","last_change":"2024-04-19T04:24:20.555406+0000","last_active":"2024-04-19T04:28:12.079124+0000","last_peered":"2024-04-19T04:28:12.079124+0000","last_clean":"2024-04-19T04:28:12.079124+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:28:12.079124+0000","last_undegraded":"2024-04-19T04:28:12.079124+0000","last_fullsized":"2024-04-19T04:28:12.079124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:10.453970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079781+0000","last_change":"2024-04-19T04:24:20.185978+0000","last_active":"2024-04-19T04:28:12.079781+0000","last_peered":"2024-04-19T04:28:12.079781+0000","last_clean":"2024-04-19T04:28:12.079781+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:28:12.079781+0000","last_undegraded":"2024-04-19T04:28:12.079781+0000","last_fullsized":"2024-04-19T04:28:12.079781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:48.158805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286910+0000","last_change":"2024-04-19T04:28:02.842249+0000","last_active":"2024-04-19T04:28:12.286910+0000","last_peered":"2024-04-19T04:28:12.286910+0000","last_clean":"2024-04-19T04:28:12.286910+0000","last_became_active":"2024-04-19T04:28:02.841373+0000","last_became_peered":"2024-04-19T04:28:02.841373+0000","last_unstale":"2024-04-19T04:28:12.286910+0000","last_undegraded":"2024-04-19T04:28:12.286910+0000","last_fullsized":"2024-04-19T04:28:12.286910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.571164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.097713+0000","last_change":"2024-04-19T04:28:12.094542+0000","last_active":"2024-04-19T04:28:12.097713+0000","last_peered":"2024-04-19T04:28:12.097713+0000","last_clean":"2024-04-19T04:28:12.097713+0000","last_became_active":"2024-04-19T04:28:12.092784+0000","last_became_peered":"2024-04-19T04:28:12.092784+0000","last_unstale":"2024-04-19T04:28:12.097713+0000","last_undegraded":"2024-04-19T04:28:12.097713+0000","last_fullsized":"2024-04-19T04:28:12.097713+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:49.750510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080472+0000","last_change":"2024-04-19T04:28:02.638882+0000","last_active":"2024-04-19T04:28:12.080472+0000","last_peered":"2024-04-19T04:28:12.080472+0000","last_clean":"2024-04-19T04:28:12.080472+0000","last_became_active":"2024-04-19T04:28:02.638431+0000","last_became_peered":"2024-04-19T04:28:02.638431+0000","last_unstale":"2024-04-19T04:28:12.080472+0000","last_undegraded":"2024-04-19T04:28:12.080472+0000","last_fullsized":"2024-04-19T04:28:12.080472+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:32.548608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285755+0000","last_change":"2024-04-19T04:28:02.841112+0000","last_active":"2024-04-19T04:28:12.285755+0000","last_peered":"2024-04-19T04:28:12.285755+0000","last_clean":"2024-04-19T04:28:12.285755+0000","last_became_active":"2024-04-19T04:28:02.838354+0000","last_became_peered":"2024-04-19T04:28:02.838354+0000","last_unstale":"2024-04-19T04:28:12.285755+0000","last_undegraded":"2024-04-19T04:28:12.285755+0000","last_fullsized":"2024-04-19T04:28:12.285755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:44:35.127227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287919+0000","last_change":"2024-04-19T04:28:02.838446+0000","last_active":"2024-04-19T04:28:12.287919+0000","last_peered":"2024-04-19T04:28:12.287919+0000","last_clean":"2024-04-19T04:28:12.287919+0000","last_became_active":"2024-04-19T04:28:02.837994+0000","last_became_peered":"2024-04-19T04:28:02.837994+0000","last_unstale":"2024-04-19T04:28:12.287919+0000","last_undegraded":"2024-04-19T04:28:12.287919+0000","last_fullsized":"2024-04-19T04:28:12.287919+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:01:07.160911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285381+0000","last_change":"2024-04-19T04:28:02.837195+0000","last_active":"2024-04-19T04:28:12.285381+0000","last_peered":"2024-04-19T04:28:12.285381+0000","last_clean":"2024-04-19T04:28:12.285381+0000","last_became_active":"2024-04-19T04:28:02.836818+0000","last_became_peered":"2024-04-19T04:28:02.836818+0000","last_unstale":"2024-04-19T04:28:12.285381+0000","last_undegraded":"2024-04-19T04:28:12.285381+0000","last_fullsized":"2024-04-19T04:28:12.285381+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:10:12.924030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":69,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.085505+0000","last_change":"2024-04-19T04:24:20.552644+0000","last_active":"2024-04-19T04:28:11.085505+0000","last_peered":"2024-04-19T04:28:11.085505+0000","last_clean":"2024-04-19T04:28:11.085505+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:28:11.085505+0000","last_undegraded":"2024-04-19T04:28:11.085505+0000","last_fullsized":"2024-04-19T04:28:11.085505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285114+0000","last_change":"2024-04-19T04:28:02.839065+0000","last_active":"2024-04-19T04:28:12.285114+0000","last_peered":"2024-04-19T04:28:12.285114+0000","last_clean":"2024-04-19T04:28:12.285114+0000","last_became_active":"2024-04-19T04:28:02.837400+0000","last_became_peered":"2024-04-19T04:28:02.837400+0000","last_unstale":"2024-04-19T04:28:12.285114+0000","last_undegraded":"2024-04-19T04:28:12.285114+0000","last_fullsized":"2024-04-19T04:28:12.285114+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:05:54.339418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287287+0000","last_change":"2024-04-19T04:28:02.845777+0000","last_active":"2024-04-19T04:28:12.287287+0000","last_peered":"2024-04-19T04:28:12.287287+0000","last_clean":"2024-04-19T04:28:12.287287+0000","last_became_active":"2024-04-19T04:28:02.844057+0000","last_became_peered":"2024-04-19T04:28:02.844057+0000","last_unstale":"2024-04-19T04:28:12.287287+0000","last_undegraded":"2024-04-19T04:28:12.287287+0000","last_fullsized":"2024-04-19T04:28:12.287287+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:47:53.420459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285255+0000","last_change":"2024-04-19T04:28:02.837131+0000","last_active":"2024-04-19T04:28:12.285255+0000","last_peered":"2024-04-19T04:28:12.285255+0000","last_clean":"2024-04-19T04:28:12.285255+0000","last_became_active":"2024-04-19T04:28:02.836492+0000","last_became_peered":"2024-04-19T04:28:02.836492+0000","last_unstale":"2024-04-19T04:28:12.285255+0000","last_undegraded":"2024-04-19T04:28:12.285255+0000","last_fullsized":"2024-04-19T04:28:12.285255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:02.952851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.100279+0000","last_change":"2024-04-19T04:28:12.095836+0000","last_active":"2024-04-19T04:28:12.100279+0000","last_peered":"2024-04-19T04:28:12.100279+0000","last_clean":"2024-04-19T04:28:12.100279+0000","last_became_active":"2024-04-19T04:28:12.095332+0000","last_became_peered":"2024-04-19T04:28:12.095332+0000","last_unstale":"2024-04-19T04:28:12.100279+0000","last_undegraded":"2024-04-19T04:28:12.100279+0000","last_fullsized":"2024-04-19T04:28:12.100279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:43:51.926940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.092977+0000","last_change":"2024-04-19T04:28:12.092977+0000","last_active":"2024-04-19T04:28:12.092977+0000","last_peered":"2024-04-19T04:28:12.092977+0000","last_clean":"2024-04-19T04:28:12.092977+0000","last_became_active":"2024-04-19T04:28:12.090262+0000","last_became_peered":"2024-04-19T04:28:12.090262+0000","last_unstale":"2024-04-19T04:28:12.092977+0000","last_undegraded":"2024-04-19T04:28:12.092977+0000","last_fullsized":"2024-04-19T04:28:12.092977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:39.131554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093601+0000","last_change":"2024-04-19T04:28:12.093601+0000","last_active":"2024-04-19T04:28:12.093601+0000","last_peered":"2024-04-19T04:28:12.093601+0000","last_clean":"2024-04-19T04:28:12.093601+0000","last_became_active":"2024-04-19T04:28:12.092979+0000","last_became_peered":"2024-04-19T04:28:12.092979+0000","last_unstale":"2024-04-19T04:28:12.093601+0000","last_undegraded":"2024-04-19T04:28:12.093601+0000","last_fullsized":"2024-04-19T04:28:12.093601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:28:58.381121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.097695+0000","last_change":"2024-04-19T04:28:12.094560+0000","last_active":"2024-04-19T04:28:12.097695+0000","last_peered":"2024-04-19T04:28:12.097695+0000","last_clean":"2024-04-19T04:28:12.097695+0000","last_became_active":"2024-04-19T04:28:12.093915+0000","last_became_peered":"2024-04-19T04:28:12.093915+0000","last_unstale":"2024-04-19T04:28:12.097695+0000","last_undegraded":"2024-04-19T04:28:12.097695+0000","last_fullsized":"2024-04-19T04:28:12.097695+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:11:26.070147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078961+0000","last_change":"2024-04-19T04:28:02.639054+0000","last_active":"2024-04-19T04:28:12.078961+0000","last_peered":"2024-04-19T04:28:12.078961+0000","last_clean":"2024-04-19T04:28:12.078961+0000","last_became_active":"2024-04-19T04:28:02.637952+0000","last_became_peered":"2024-04-19T04:28:02.637952+0000","last_unstale":"2024-04-19T04:28:12.078961+0000","last_undegraded":"2024-04-19T04:28:12.078961+0000","last_fullsized":"2024-04-19T04:28:12.078961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:00:22.017021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":87,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079496+0000","last_change":"2024-04-19T04:28:02.635226+0000","last_active":"2024-04-19T04:28:12.079496+0000","last_peered":"2024-04-19T04:28:12.079496+0000","last_clean":"2024-04-19T04:28:12.079496+0000","last_became_active":"2024-04-19T04:28:02.634226+0000","last_became_peered":"2024-04-19T04:28:02.634226+0000","last_unstale":"2024-04-19T04:28:12.079496+0000","last_undegraded":"2024-04-19T04:28:12.079496+0000","last_fullsized":"2024-04-19T04:28:12.079496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:07.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079565+0000","last_change":"2024-04-19T04:28:02.636657+0000","last_active":"2024-04-19T04:28:12.079565+0000","last_peered":"2024-04-19T04:28:12.079565+0000","last_clean":"2024-04-19T04:28:12.079565+0000","last_became_active":"2024-04-19T04:28:02.636266+0000","last_became_peered":"2024-04-19T04:28:02.636266+0000","last_unstale":"2024-04-19T04:28:12.079565+0000","last_undegraded":"2024-04-19T04:28:12.079565+0000","last_fullsized":"2024-04-19T04:28:12.079565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:20:16.458945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.100268+0000","last_change":"2024-04-19T04:28:12.095797+0000","last_active":"2024-04-19T04:28:12.100268+0000","last_peered":"2024-04-19T04:28:12.100268+0000","last_clean":"2024-04-19T04:28:12.100268+0000","last_became_active":"2024-04-19T04:28:12.095199+0000","last_became_peered":"2024-04-19T04:28:12.095199+0000","last_unstale":"2024-04-19T04:28:12.100268+0000","last_undegraded":"2024-04-19T04:28:12.100268+0000","last_fullsized":"2024-04-19T04:28:12.100268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:28.634271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.091303+0000","last_change":"2024-04-19T04:28:12.091303+0000","last_active":"2024-04-19T04:28:12.091303+0000","last_peered":"2024-04-19T04:28:12.091303+0000","last_clean":"2024-04-19T04:28:12.091303+0000","last_became_active":"2024-04-19T04:28:12.087884+0000","last_became_peered":"2024-04-19T04:28:12.087884+0000","last_unstale":"2024-04-19T04:28:12.091303+0000","last_undegraded":"2024-04-19T04:28:12.091303+0000","last_fullsized":"2024-04-19T04:28:12.091303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:01:12.373663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288082+0000","last_change":"2024-04-19T04:28:02.846538+0000","last_active":"2024-04-19T04:28:12.288082+0000","last_peered":"2024-04-19T04:28:12.288082+0000","last_clean":"2024-04-19T04:28:12.288082+0000","last_became_active":"2024-04-19T04:28:02.846234+0000","last_became_peered":"2024-04-19T04:28:02.846234+0000","last_unstale":"2024-04-19T04:28:12.288082+0000","last_undegraded":"2024-04-19T04:28:12.288082+0000","last_fullsized":"2024-04-19T04:28:12.288082+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:08.165785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078454+0000","last_change":"2024-04-19T04:28:02.635122+0000","last_active":"2024-04-19T04:28:12.078454+0000","last_peered":"2024-04-19T04:28:12.078454+0000","last_clean":"2024-04-19T04:28:12.078454+0000","last_became_active":"2024-04-19T04:28:02.634433+0000","last_became_peered":"2024-04-19T04:28:02.634433+0000","last_unstale":"2024-04-19T04:28:12.078454+0000","last_undegraded":"2024-04-19T04:28:12.078454+0000","last_fullsized":"2024-04-19T04:28:12.078454+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:40.139486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288286+0000","last_change":"2024-04-19T04:28:02.844897+0000","last_active":"2024-04-19T04:28:12.288286+0000","last_peered":"2024-04-19T04:28:12.288286+0000","last_clean":"2024-04-19T04:28:12.288286+0000","last_became_active":"2024-04-19T04:28:02.844276+0000","last_became_peered":"2024-04-19T04:28:02.844276+0000","last_unstale":"2024-04-19T04:28:12.288286+0000","last_undegraded":"2024-04-19T04:28:12.288286+0000","last_fullsized":"2024-04-19T04:28:12.288286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:45.100544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705718,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220712,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151128,"statfs":{"total":96636764160,"available":96410755072,"internally_reserved":0,"allocated":937984,"data_stored":922026,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 04:27:10 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.65400000000000003,"15min":0.76500000000000001},"min":{"1min":0.218,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.82599999999999996,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.55500000000000005,"15min":0.59099999999999997},"min":{"1min":0.26000000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.81599999999999995,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.77600000000000002}]},{"osd":1,"last update":"Fri Apr 19 04:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":5.1989999999999998,"5min":5.1989999999999998,"15min":5.1989999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":0.85199999999999998}]}]},{"osd":1,"up_from":72,"seq":309237645316,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44116,"kb_used_data":836,"kb_used_omap":6,"kb_used_meta":43257,"kb_avail":94327724,"statfs":{"total":96636764160,"available":96591589376,"internally_reserved":0,"allocated":856064,"data_stored":330528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6880,"internal_metadata":44295456},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705718,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298668,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297726,"kb_avail":94073172,"statfs":{"total":96636764160,"available":96330928128,"internally_reserved":0,"allocated":950272,"data_stored":924740,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":304871878},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 04:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.68799999999999994}]},{"osd":2,"last update":"Fri Apr 19 04:27:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.23899999999999999,"5min":0.223,"15min":0.223},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.69999999999999996,"15min":0.80300000000000005},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.81799999999999995,"5min":4.5,"15min":4.5},"last":0.77900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:28:15.967 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:28:16.285 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:28:16.288 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:28:16.305 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-04-19T04:28:14.985465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":563496,"kb_used_data":2680,"kb_used_omap":9,"kb_used_meta":560758,"kb_avail":282552024,"statfs":{"total":289910292480,"available":289333272576,"internally_reserved":0,"allocated":2744320,"data_stored":2177294,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":10068,"internal_metadata":574216364},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.933310"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093601+0000","last_change":"2024-04-19T04:28:12.093601+0000","last_active":"2024-04-19T04:28:12.093601+0000","last_peered":"2024-04-19T04:28:12.093601+0000","last_clean":"2024-04-19T04:28:12.093601+0000","last_became_active":"2024-04-19T04:28:12.093175+0000","last_became_peered":"2024-04-19T04:28:12.093175+0000","last_unstale":"2024-04-19T04:28:12.093601+0000","last_undegraded":"2024-04-19T04:28:12.093601+0000","last_fullsized":"2024-04-19T04:28:12.093601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:53:38.070519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093573+0000","last_change":"2024-04-19T04:28:12.093573+0000","last_active":"2024-04-19T04:28:12.093573+0000","last_peered":"2024-04-19T04:28:12.093573+0000","last_clean":"2024-04-19T04:28:12.093573+0000","last_became_active":"2024-04-19T04:28:12.092819+0000","last_became_peered":"2024-04-19T04:28:12.092819+0000","last_unstale":"2024-04-19T04:28:12.093573+0000","last_undegraded":"2024-04-19T04:28:12.093573+0000","last_fullsized":"2024-04-19T04:28:12.093573+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:14.577765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079707+0000","last_change":"2024-04-19T04:24:20.556199+0000","last_active":"2024-04-19T04:28:12.079707+0000","last_peered":"2024-04-19T04:28:12.079707+0000","last_clean":"2024-04-19T04:28:12.079707+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:28:12.079707+0000","last_undegraded":"2024-04-19T04:28:12.079707+0000","last_fullsized":"2024-04-19T04:28:12.079707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:14.348910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078925+0000","last_change":"2024-04-19T04:28:02.635437+0000","last_active":"2024-04-19T04:28:12.078925+0000","last_peered":"2024-04-19T04:28:12.078925+0000","last_clean":"2024-04-19T04:28:12.078925+0000","last_became_active":"2024-04-19T04:28:02.634355+0000","last_became_peered":"2024-04-19T04:28:02.634355+0000","last_unstale":"2024-04-19T04:28:12.078925+0000","last_undegraded":"2024-04-19T04:28:12.078925+0000","last_fullsized":"2024-04-19T04:28:12.078925+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:39.534000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.090282+0000","last_change":"2024-04-19T04:28:12.090282+0000","last_active":"2024-04-19T04:28:12.090282+0000","last_peered":"2024-04-19T04:28:12.090282+0000","last_clean":"2024-04-19T04:28:12.090282+0000","last_became_active":"2024-04-19T04:28:12.088231+0000","last_became_peered":"2024-04-19T04:28:12.088231+0000","last_unstale":"2024-04-19T04:28:12.090282+0000","last_undegraded":"2024-04-19T04:28:12.090282+0000","last_fullsized":"2024-04-19T04:28:12.090282+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:48:51.512556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078586+0000","last_change":"2024-04-19T04:28:02.637742+0000","last_active":"2024-04-19T04:28:12.078586+0000","last_peered":"2024-04-19T04:28:12.078586+0000","last_clean":"2024-04-19T04:28:12.078586+0000","last_became_active":"2024-04-19T04:28:02.637276+0000","last_became_peered":"2024-04-19T04:28:02.637276+0000","last_unstale":"2024-04-19T04:28:12.078586+0000","last_undegraded":"2024-04-19T04:28:12.078586+0000","last_fullsized":"2024-04-19T04:28:12.078586+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:06.971707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078374+0000","last_change":"2024-04-19T04:28:02.637532+0000","last_active":"2024-04-19T04:28:12.078374+0000","last_peered":"2024-04-19T04:28:12.078374+0000","last_clean":"2024-04-19T04:28:12.078374+0000","last_became_active":"2024-04-19T04:28:02.637086+0000","last_became_peered":"2024-04-19T04:28:02.637086+0000","last_unstale":"2024-04-19T04:28:12.078374+0000","last_undegraded":"2024-04-19T04:28:12.078374+0000","last_fullsized":"2024-04-19T04:28:12.078374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:40:05.423094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.077959+0000","last_change":"2024-04-19T04:28:02.638186+0000","last_active":"2024-04-19T04:28:12.077959+0000","last_peered":"2024-04-19T04:28:12.077959+0000","last_clean":"2024-04-19T04:28:12.077959+0000","last_became_active":"2024-04-19T04:28:02.637746+0000","last_became_peered":"2024-04-19T04:28:02.637746+0000","last_unstale":"2024-04-19T04:28:12.077959+0000","last_undegraded":"2024-04-19T04:28:12.077959+0000","last_fullsized":"2024-04-19T04:28:12.077959+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:50.758441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287710+0000","last_change":"2024-04-19T04:28:02.842455+0000","last_active":"2024-04-19T04:28:12.287710+0000","last_peered":"2024-04-19T04:28:12.287710+0000","last_clean":"2024-04-19T04:28:12.287710+0000","last_became_active":"2024-04-19T04:28:02.839203+0000","last_became_peered":"2024-04-19T04:28:02.839203+0000","last_unstale":"2024-04-19T04:28:12.287710+0000","last_undegraded":"2024-04-19T04:28:12.287710+0000","last_fullsized":"2024-04-19T04:28:12.287710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:18:44.252505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093403+0000","last_change":"2024-04-19T04:28:12.093403+0000","last_active":"2024-04-19T04:28:12.093403+0000","last_peered":"2024-04-19T04:28:12.093403+0000","last_clean":"2024-04-19T04:28:12.093403+0000","last_became_active":"2024-04-19T04:28:12.092924+0000","last_became_peered":"2024-04-19T04:28:12.092924+0000","last_unstale":"2024-04-19T04:28:12.093403+0000","last_undegraded":"2024-04-19T04:28:12.093403+0000","last_fullsized":"2024-04-19T04:28:12.093403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:56.871317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079800+0000","last_change":"2024-04-19T04:28:02.636293+0000","last_active":"2024-04-19T04:28:12.079800+0000","last_peered":"2024-04-19T04:28:12.079800+0000","last_clean":"2024-04-19T04:28:12.079800+0000","last_became_active":"2024-04-19T04:28:02.635946+0000","last_became_peered":"2024-04-19T04:28:02.635946+0000","last_unstale":"2024-04-19T04:28:12.079800+0000","last_undegraded":"2024-04-19T04:28:12.079800+0000","last_fullsized":"2024-04-19T04:28:12.079800+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:42.381196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.100198+0000","last_change":"2024-04-19T04:28:12.095304+0000","last_active":"2024-04-19T04:28:12.100198+0000","last_peered":"2024-04-19T04:28:12.100198+0000","last_clean":"2024-04-19T04:28:12.100198+0000","last_became_active":"2024-04-19T04:28:12.094753+0000","last_became_peered":"2024-04-19T04:28:12.094753+0000","last_unstale":"2024-04-19T04:28:12.100198+0000","last_undegraded":"2024-04-19T04:28:12.100198+0000","last_fullsized":"2024-04-19T04:28:12.100198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:36:03.465294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093953+0000","last_change":"2024-04-19T04:28:12.093953+0000","last_active":"2024-04-19T04:28:12.093953+0000","last_peered":"2024-04-19T04:28:12.093953+0000","last_clean":"2024-04-19T04:28:12.093953+0000","last_became_active":"2024-04-19T04:28:12.093267+0000","last_became_peered":"2024-04-19T04:28:12.093267+0000","last_unstale":"2024-04-19T04:28:12.093953+0000","last_undegraded":"2024-04-19T04:28:12.093953+0000","last_fullsized":"2024-04-19T04:28:12.093953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:14.548542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078930+0000","last_change":"2024-04-19T04:24:20.552690+0000","last_active":"2024-04-19T04:28:12.078930+0000","last_peered":"2024-04-19T04:28:12.078930+0000","last_clean":"2024-04-19T04:28:12.078930+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:28:12.078930+0000","last_undegraded":"2024-04-19T04:28:12.078930+0000","last_fullsized":"2024-04-19T04:28:12.078930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:53:16.890992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078527+0000","last_change":"2024-04-19T04:24:20.551809+0000","last_active":"2024-04-19T04:28:12.078527+0000","last_peered":"2024-04-19T04:28:12.078527+0000","last_clean":"2024-04-19T04:28:12.078527+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:28:12.078527+0000","last_undegraded":"2024-04-19T04:28:12.078527+0000","last_fullsized":"2024-04-19T04:28:12.078527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:43:31.281765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078198+0000","last_change":"2024-04-19T04:28:02.638726+0000","last_active":"2024-04-19T04:28:12.078198+0000","last_peered":"2024-04-19T04:28:12.078198+0000","last_clean":"2024-04-19T04:28:12.078198+0000","last_became_active":"2024-04-19T04:28:02.637920+0000","last_became_peered":"2024-04-19T04:28:02.637920+0000","last_unstale":"2024-04-19T04:28:12.078198+0000","last_undegraded":"2024-04-19T04:28:12.078198+0000","last_fullsized":"2024-04-19T04:28:12.078198+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:23:42.710810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287706+0000","last_change":"2024-04-19T04:28:02.841438+0000","last_active":"2024-04-19T04:28:12.287706+0000","last_peered":"2024-04-19T04:28:12.287706+0000","last_clean":"2024-04-19T04:28:12.287706+0000","last_became_active":"2024-04-19T04:28:02.839071+0000","last_became_peered":"2024-04-19T04:28:02.839071+0000","last_unstale":"2024-04-19T04:28:12.287706+0000","last_undegraded":"2024-04-19T04:28:12.287706+0000","last_fullsized":"2024-04-19T04:28:12.287706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:37:05.846827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":82,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.084946+0000","last_change":"2024-04-19T04:28:02.638587+0000","last_active":"2024-04-19T04:28:11.084946+0000","last_peered":"2024-04-19T04:28:11.084946+0000","last_clean":"2024-04-19T04:28:11.084946+0000","last_became_active":"2024-04-19T04:28:02.638230+0000","last_became_peered":"2024-04-19T04:28:02.638230+0000","last_unstale":"2024-04-19T04:28:11.084946+0000","last_undegraded":"2024-04-19T04:28:11.084946+0000","last_fullsized":"2024-04-19T04:28:11.084946+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:43:23.974591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286685+0000","last_change":"2024-04-19T04:28:02.840423+0000","last_active":"2024-04-19T04:28:12.286685+0000","last_peered":"2024-04-19T04:28:12.286685+0000","last_clean":"2024-04-19T04:28:12.286685+0000","last_became_active":"2024-04-19T04:28:02.839362+0000","last_became_peered":"2024-04-19T04:28:02.839362+0000","last_unstale":"2024-04-19T04:28:12.286685+0000","last_undegraded":"2024-04-19T04:28:12.286685+0000","last_fullsized":"2024-04-19T04:28:12.286685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:24:55.325024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079785+0000","last_change":"2024-04-19T04:28:02.635566+0000","last_active":"2024-04-19T04:28:12.079785+0000","last_peered":"2024-04-19T04:28:12.079785+0000","last_clean":"2024-04-19T04:28:12.079785+0000","last_became_active":"2024-04-19T04:28:02.634835+0000","last_became_peered":"2024-04-19T04:28:02.634835+0000","last_unstale":"2024-04-19T04:28:12.079785+0000","last_undegraded":"2024-04-19T04:28:12.079785+0000","last_fullsized":"2024-04-19T04:28:12.079785+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:04.159997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079199+0000","last_change":"2024-04-19T04:28:02.639259+0000","last_active":"2024-04-19T04:28:12.079199+0000","last_peered":"2024-04-19T04:28:12.079199+0000","last_clean":"2024-04-19T04:28:12.079199+0000","last_became_active":"2024-04-19T04:28:02.638546+0000","last_became_peered":"2024-04-19T04:28:02.638546+0000","last_unstale":"2024-04-19T04:28:12.079199+0000","last_undegraded":"2024-04-19T04:28:12.079199+0000","last_fullsized":"2024-04-19T04:28:12.079199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:47:45.968474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094010+0000","last_change":"2024-04-19T04:28:12.089576+0000","last_active":"2024-04-19T04:28:12.094010+0000","last_peered":"2024-04-19T04:28:12.094010+0000","last_clean":"2024-04-19T04:28:12.094010+0000","last_became_active":"2024-04-19T04:28:12.087571+0000","last_became_peered":"2024-04-19T04:28:12.087571+0000","last_unstale":"2024-04-19T04:28:12.094010+0000","last_undegraded":"2024-04-19T04:28:12.094010+0000","last_fullsized":"2024-04-19T04:28:12.094010+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:42.381196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285546+0000","last_change":"2024-04-19T04:28:02.842994+0000","last_active":"2024-04-19T04:28:12.285546+0000","last_peered":"2024-04-19T04:28:12.285546+0000","last_clean":"2024-04-19T04:28:12.285546+0000","last_became_active":"2024-04-19T04:28:02.840294+0000","last_became_peered":"2024-04-19T04:28:02.840294+0000","last_unstale":"2024-04-19T04:28:12.285546+0000","last_undegraded":"2024-04-19T04:28:12.285546+0000","last_fullsized":"2024-04-19T04:28:12.285546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:26.503064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.090413+0000","last_change":"2024-04-19T04:28:12.090413+0000","last_active":"2024-04-19T04:28:12.090413+0000","last_peered":"2024-04-19T04:28:12.090413+0000","last_clean":"2024-04-19T04:28:12.090413+0000","last_became_active":"2024-04-19T04:28:12.089918+0000","last_became_peered":"2024-04-19T04:28:12.089918+0000","last_unstale":"2024-04-19T04:28:12.090413+0000","last_undegraded":"2024-04-19T04:28:12.090413+0000","last_fullsized":"2024-04-19T04:28:12.090413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:08.501081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095501+0000","last_change":"2024-04-19T04:28:12.092733+0000","last_active":"2024-04-19T04:28:12.095501+0000","last_peered":"2024-04-19T04:28:12.095501+0000","last_clean":"2024-04-19T04:28:12.095501+0000","last_became_active":"2024-04-19T04:28:12.091770+0000","last_became_peered":"2024-04-19T04:28:12.091770+0000","last_unstale":"2024-04-19T04:28:12.095501+0000","last_undegraded":"2024-04-19T04:28:12.095501+0000","last_fullsized":"2024-04-19T04:28:12.095501+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:39:38.261503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287546+0000","last_change":"2024-04-19T04:28:02.846092+0000","last_active":"2024-04-19T04:28:12.287546+0000","last_peered":"2024-04-19T04:28:12.287546+0000","last_clean":"2024-04-19T04:28:12.287546+0000","last_became_active":"2024-04-19T04:28:02.845416+0000","last_became_peered":"2024-04-19T04:28:02.845416+0000","last_unstale":"2024-04-19T04:28:12.287546+0000","last_undegraded":"2024-04-19T04:28:12.287546+0000","last_fullsized":"2024-04-19T04:28:12.287546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:23.517160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079927+0000","last_change":"2024-04-19T04:24:20.554885+0000","last_active":"2024-04-19T04:28:12.079927+0000","last_peered":"2024-04-19T04:28:12.079927+0000","last_clean":"2024-04-19T04:28:12.079927+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:28:12.079927+0000","last_undegraded":"2024-04-19T04:28:12.079927+0000","last_fullsized":"2024-04-19T04:28:12.079927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:44:08.285518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095487+0000","last_change":"2024-04-19T04:28:12.092936+0000","last_active":"2024-04-19T04:28:12.095487+0000","last_peered":"2024-04-19T04:28:12.095487+0000","last_clean":"2024-04-19T04:28:12.095487+0000","last_became_active":"2024-04-19T04:28:12.091969+0000","last_became_peered":"2024-04-19T04:28:12.091969+0000","last_unstale":"2024-04-19T04:28:12.095487+0000","last_undegraded":"2024-04-19T04:28:12.095487+0000","last_fullsized":"2024-04-19T04:28:12.095487+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:20.569368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285809+0000","last_change":"2024-04-19T04:28:02.845150+0000","last_active":"2024-04-19T04:28:12.285809+0000","last_peered":"2024-04-19T04:28:12.285809+0000","last_clean":"2024-04-19T04:28:12.285809+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:28:12.285809+0000","last_undegraded":"2024-04-19T04:28:12.285809+0000","last_fullsized":"2024-04-19T04:28:12.285809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:27:04.257043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":69,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.075220+0000","last_change":"2024-04-19T04:24:20.554847+0000","last_active":"2024-04-19T04:28:11.075220+0000","last_peered":"2024-04-19T04:28:11.075220+0000","last_clean":"2024-04-19T04:28:11.075220+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:28:11.075220+0000","last_undegraded":"2024-04-19T04:28:11.075220+0000","last_fullsized":"2024-04-19T04:28:11.075220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:00.475711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286101+0000","last_change":"2024-04-19T04:28:02.843590+0000","last_active":"2024-04-19T04:28:12.286101+0000","last_peered":"2024-04-19T04:28:12.286101+0000","last_clean":"2024-04-19T04:28:12.286101+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:28:12.286101+0000","last_undegraded":"2024-04-19T04:28:12.286101+0000","last_fullsized":"2024-04-19T04:28:12.286101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:02.147016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078180+0000","last_change":"2024-04-19T04:28:02.635119+0000","last_active":"2024-04-19T04:28:12.078180+0000","last_peered":"2024-04-19T04:28:12.078180+0000","last_clean":"2024-04-19T04:28:12.078180+0000","last_became_active":"2024-04-19T04:28:02.634586+0000","last_became_peered":"2024-04-19T04:28:02.634586+0000","last_unstale":"2024-04-19T04:28:12.078180+0000","last_undegraded":"2024-04-19T04:28:12.078180+0000","last_fullsized":"2024-04-19T04:28:12.078180+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:08.719606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095305+0000","last_change":"2024-04-19T04:28:12.095305+0000","last_active":"2024-04-19T04:28:12.095305+0000","last_peered":"2024-04-19T04:28:12.095305+0000","last_clean":"2024-04-19T04:28:12.095305+0000","last_became_active":"2024-04-19T04:28:12.094558+0000","last_became_peered":"2024-04-19T04:28:12.094558+0000","last_unstale":"2024-04-19T04:28:12.095305+0000","last_undegraded":"2024-04-19T04:28:12.095305+0000","last_fullsized":"2024-04-19T04:28:12.095305+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:44:45.647590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":87,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079450+0000","last_change":"2024-04-19T04:28:02.639581+0000","last_active":"2024-04-19T04:28:12.079450+0000","last_peered":"2024-04-19T04:28:12.079450+0000","last_clean":"2024-04-19T04:28:12.079450+0000","last_became_active":"2024-04-19T04:28:02.638666+0000","last_became_peered":"2024-04-19T04:28:02.638666+0000","last_unstale":"2024-04-19T04:28:12.079450+0000","last_undegraded":"2024-04-19T04:28:12.079450+0000","last_fullsized":"2024-04-19T04:28:12.079450+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:42:54.107998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095631+0000","last_change":"2024-04-19T04:28:12.095631+0000","last_active":"2024-04-19T04:28:12.095631+0000","last_peered":"2024-04-19T04:28:12.095631+0000","last_clean":"2024-04-19T04:28:12.095631+0000","last_became_active":"2024-04-19T04:28:12.094722+0000","last_became_peered":"2024-04-19T04:28:12.094722+0000","last_unstale":"2024-04-19T04:28:12.095631+0000","last_undegraded":"2024-04-19T04:28:12.095631+0000","last_fullsized":"2024-04-19T04:28:12.095631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:31.378691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287127+0000","last_change":"2024-04-19T04:28:02.843299+0000","last_active":"2024-04-19T04:28:12.287127+0000","last_peered":"2024-04-19T04:28:12.287127+0000","last_clean":"2024-04-19T04:28:12.287127+0000","last_became_active":"2024-04-19T04:28:02.842525+0000","last_became_peered":"2024-04-19T04:28:02.842525+0000","last_unstale":"2024-04-19T04:28:12.287127+0000","last_undegraded":"2024-04-19T04:28:12.287127+0000","last_fullsized":"2024-04-19T04:28:12.287127+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:10:33.303473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287136+0000","last_change":"2024-04-19T04:28:02.845685+0000","last_active":"2024-04-19T04:28:12.287136+0000","last_peered":"2024-04-19T04:28:12.287136+0000","last_clean":"2024-04-19T04:28:12.287136+0000","last_became_active":"2024-04-19T04:28:02.843099+0000","last_became_peered":"2024-04-19T04:28:02.843099+0000","last_unstale":"2024-04-19T04:28:12.287136+0000","last_undegraded":"2024-04-19T04:28:12.287136+0000","last_fullsized":"2024-04-19T04:28:12.287136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:25:05.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095287+0000","last_change":"2024-04-19T04:28:12.092744+0000","last_active":"2024-04-19T04:28:12.095287+0000","last_peered":"2024-04-19T04:28:12.095287+0000","last_clean":"2024-04-19T04:28:12.095287+0000","last_became_active":"2024-04-19T04:28:12.091771+0000","last_became_peered":"2024-04-19T04:28:12.091771+0000","last_unstale":"2024-04-19T04:28:12.095287+0000","last_undegraded":"2024-04-19T04:28:12.095287+0000","last_fullsized":"2024-04-19T04:28:12.095287+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:34.728962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287385+0000","last_change":"2024-04-19T04:28:02.837331+0000","last_active":"2024-04-19T04:28:12.287385+0000","last_peered":"2024-04-19T04:28:12.287385+0000","last_clean":"2024-04-19T04:28:12.287385+0000","last_became_active":"2024-04-19T04:28:02.836984+0000","last_became_peered":"2024-04-19T04:28:02.836984+0000","last_unstale":"2024-04-19T04:28:12.287385+0000","last_undegraded":"2024-04-19T04:28:12.287385+0000","last_fullsized":"2024-04-19T04:28:12.287385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:11.858503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":80,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078519+0000","last_change":"2024-04-19T04:24:20.187299+0000","last_active":"2024-04-19T04:28:12.078519+0000","last_peered":"2024-04-19T04:28:12.078519+0000","last_clean":"2024-04-19T04:28:12.078519+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:28:12.078519+0000","last_undegraded":"2024-04-19T04:28:12.078519+0000","last_fullsized":"2024-04-19T04:28:12.078519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:49:37.812125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":73,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080835+0000","last_change":"2024-04-19T04:24:20.186029+0000","last_active":"2024-04-19T04:28:12.080835+0000","last_peered":"2024-04-19T04:28:12.080835+0000","last_clean":"2024-04-19T04:28:12.080835+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:28:12.080835+0000","last_undegraded":"2024-04-19T04:28:12.080835+0000","last_fullsized":"2024-04-19T04:28:12.080835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:49.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095216+0000","last_change":"2024-04-19T04:28:12.092118+0000","last_active":"2024-04-19T04:28:12.095216+0000","last_peered":"2024-04-19T04:28:12.095216+0000","last_clean":"2024-04-19T04:28:12.095216+0000","last_became_active":"2024-04-19T04:28:12.090379+0000","last_became_peered":"2024-04-19T04:28:12.090379+0000","last_unstale":"2024-04-19T04:28:12.095216+0000","last_undegraded":"2024-04-19T04:28:12.095216+0000","last_fullsized":"2024-04-19T04:28:12.095216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:38.494787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094285+0000","last_change":"2024-04-19T04:28:12.090491+0000","last_active":"2024-04-19T04:28:12.094285+0000","last_peered":"2024-04-19T04:28:12.094285+0000","last_clean":"2024-04-19T04:28:12.094285+0000","last_became_active":"2024-04-19T04:28:12.089948+0000","last_became_peered":"2024-04-19T04:28:12.089948+0000","last_unstale":"2024-04-19T04:28:12.094285+0000","last_undegraded":"2024-04-19T04:28:12.094285+0000","last_fullsized":"2024-04-19T04:28:12.094285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:04:35.343697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093574+0000","last_change":"2024-04-19T04:28:12.093574+0000","last_active":"2024-04-19T04:28:12.093574+0000","last_peered":"2024-04-19T04:28:12.093574+0000","last_clean":"2024-04-19T04:28:12.093574+0000","last_became_active":"2024-04-19T04:28:12.093090+0000","last_became_peered":"2024-04-19T04:28:12.093090+0000","last_unstale":"2024-04-19T04:28:12.093574+0000","last_undegraded":"2024-04-19T04:28:12.093574+0000","last_fullsized":"2024-04-19T04:28:12.093574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:32:01.796620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":73,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080387+0000","last_change":"2024-04-19T04:24:20.186044+0000","last_active":"2024-04-19T04:28:12.080387+0000","last_peered":"2024-04-19T04:28:12.080387+0000","last_clean":"2024-04-19T04:28:12.080387+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:28:12.080387+0000","last_undegraded":"2024-04-19T04:28:12.080387+0000","last_fullsized":"2024-04-19T04:28:12.080387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.432692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079351+0000","last_change":"2024-04-19T04:28:02.636589+0000","last_active":"2024-04-19T04:28:12.079351+0000","last_peered":"2024-04-19T04:28:12.079351+0000","last_clean":"2024-04-19T04:28:12.079351+0000","last_became_active":"2024-04-19T04:28:02.636231+0000","last_became_peered":"2024-04-19T04:28:02.636231+0000","last_unstale":"2024-04-19T04:28:12.079351+0000","last_undegraded":"2024-04-19T04:28:12.079351+0000","last_fullsized":"2024-04-19T04:28:12.079351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:25:32.636485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080045+0000","last_change":"2024-04-19T04:28:02.635650+0000","last_active":"2024-04-19T04:28:12.080045+0000","last_peered":"2024-04-19T04:28:12.080045+0000","last_clean":"2024-04-19T04:28:12.080045+0000","last_became_active":"2024-04-19T04:28:02.634823+0000","last_became_peered":"2024-04-19T04:28:02.634823+0000","last_unstale":"2024-04-19T04:28:12.080045+0000","last_undegraded":"2024-04-19T04:28:12.080045+0000","last_fullsized":"2024-04-19T04:28:12.080045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:37.205733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287721+0000","last_change":"2024-04-19T04:28:02.845805+0000","last_active":"2024-04-19T04:28:12.287721+0000","last_peered":"2024-04-19T04:28:12.287721+0000","last_clean":"2024-04-19T04:28:12.287721+0000","last_became_active":"2024-04-19T04:28:02.845461+0000","last_became_peered":"2024-04-19T04:28:02.845461+0000","last_unstale":"2024-04-19T04:28:12.287721+0000","last_undegraded":"2024-04-19T04:28:12.287721+0000","last_fullsized":"2024-04-19T04:28:12.287721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:57:44.161931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287443+0000","last_change":"2024-04-19T04:28:02.845613+0000","last_active":"2024-04-19T04:28:12.287443+0000","last_peered":"2024-04-19T04:28:12.287443+0000","last_clean":"2024-04-19T04:28:12.287443+0000","last_became_active":"2024-04-19T04:28:02.844927+0000","last_became_peered":"2024-04-19T04:28:02.844927+0000","last_unstale":"2024-04-19T04:28:12.287443+0000","last_undegraded":"2024-04-19T04:28:12.287443+0000","last_fullsized":"2024-04-19T04:28:12.287443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:59.219663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079185+0000","last_change":"2024-04-19T04:28:02.635751+0000","last_active":"2024-04-19T04:28:12.079185+0000","last_peered":"2024-04-19T04:28:12.079185+0000","last_clean":"2024-04-19T04:28:12.079185+0000","last_became_active":"2024-04-19T04:28:02.635238+0000","last_became_peered":"2024-04-19T04:28:02.635238+0000","last_unstale":"2024-04-19T04:28:12.079185+0000","last_undegraded":"2024-04-19T04:28:12.079185+0000","last_fullsized":"2024-04-19T04:28:12.079185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:24:14.292299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079943+0000","last_change":"2024-04-19T04:28:02.638055+0000","last_active":"2024-04-19T04:28:12.079943+0000","last_peered":"2024-04-19T04:28:12.079943+0000","last_clean":"2024-04-19T04:28:12.079943+0000","last_became_active":"2024-04-19T04:28:02.637651+0000","last_became_peered":"2024-04-19T04:28:02.637651+0000","last_unstale":"2024-04-19T04:28:12.079943+0000","last_undegraded":"2024-04-19T04:28:12.079943+0000","last_fullsized":"2024-04-19T04:28:12.079943+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:25:55.832256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080143+0000","last_change":"2024-04-19T04:24:20.555922+0000","last_active":"2024-04-19T04:28:12.080143+0000","last_peered":"2024-04-19T04:28:12.080143+0000","last_clean":"2024-04-19T04:28:12.080143+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:28:12.080143+0000","last_undegraded":"2024-04-19T04:28:12.080143+0000","last_fullsized":"2024-04-19T04:28:12.080143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:06:53.595149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":70,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.078809+0000","last_change":"2024-04-19T04:24:20.183944+0000","last_active":"2024-04-19T04:28:11.078809+0000","last_peered":"2024-04-19T04:28:11.078809+0000","last_clean":"2024-04-19T04:28:11.078809+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:28:11.078809+0000","last_undegraded":"2024-04-19T04:28:11.078809+0000","last_fullsized":"2024-04-19T04:28:11.078809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:42.018487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079773+0000","last_change":"2024-04-19T04:24:20.553085+0000","last_active":"2024-04-19T04:28:12.079773+0000","last_peered":"2024-04-19T04:28:12.079773+0000","last_clean":"2024-04-19T04:28:12.079773+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:28:12.079773+0000","last_undegraded":"2024-04-19T04:28:12.079773+0000","last_fullsized":"2024-04-19T04:28:12.079773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:07:21.467758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":67,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.089659+0000","last_change":"2024-04-19T04:28:12.089659+0000","last_active":"2024-04-19T04:28:12.089659+0000","last_peered":"2024-04-19T04:28:12.089659+0000","last_clean":"2024-04-19T04:28:12.089659+0000","last_became_active":"2024-04-19T04:28:12.088043+0000","last_became_peered":"2024-04-19T04:28:12.088043+0000","last_unstale":"2024-04-19T04:28:12.089659+0000","last_undegraded":"2024-04-19T04:28:12.089659+0000","last_fullsized":"2024-04-19T04:28:12.089659+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:02:42.873134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288226+0000","last_change":"2024-04-19T04:28:02.844467+0000","last_active":"2024-04-19T04:28:12.288226+0000","last_peered":"2024-04-19T04:28:12.288226+0000","last_clean":"2024-04-19T04:28:12.288226+0000","last_became_active":"2024-04-19T04:28:02.843639+0000","last_became_peered":"2024-04-19T04:28:02.843639+0000","last_unstale":"2024-04-19T04:28:12.288226+0000","last_undegraded":"2024-04-19T04:28:12.288226+0000","last_fullsized":"2024-04-19T04:28:12.288226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:24.660145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":275,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094355+0000","last_change":"2024-04-19T04:24:10.106278+0000","last_active":"2024-04-19T04:28:13.094355+0000","last_peered":"2024-04-19T04:28:13.094355+0000","last_clean":"2024-04-19T04:28:13.094355+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:28:13.094355+0000","last_undegraded":"2024-04-19T04:28:13.094355+0000","last_fullsized":"2024-04-19T04:28:13.094355+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_clean_scrub_stamp":"2024-04-19T04:24:09.083488+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":88,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079654+0000","last_change":"2024-04-19T04:28:02.639632+0000","last_active":"2024-04-19T04:28:12.079654+0000","last_peered":"2024-04-19T04:28:12.079654+0000","last_clean":"2024-04-19T04:28:12.079654+0000","last_became_active":"2024-04-19T04:28:02.639240+0000","last_became_peered":"2024-04-19T04:28:02.639240+0000","last_unstale":"2024-04-19T04:28:12.079654+0000","last_undegraded":"2024-04-19T04:28:12.079654+0000","last_fullsized":"2024-04-19T04:28:12.079654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:54.035030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287535+0000","last_change":"2024-04-19T04:28:02.842437+0000","last_active":"2024-04-19T04:28:12.287535+0000","last_peered":"2024-04-19T04:28:12.287535+0000","last_clean":"2024-04-19T04:28:12.287535+0000","last_became_active":"2024-04-19T04:28:02.841053+0000","last_became_peered":"2024-04-19T04:28:02.841053+0000","last_unstale":"2024-04-19T04:28:12.287535+0000","last_undegraded":"2024-04-19T04:28:12.287535+0000","last_fullsized":"2024-04-19T04:28:12.287535+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:45.323344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080363+0000","last_change":"2024-04-19T04:24:20.553999+0000","last_active":"2024-04-19T04:28:12.080363+0000","last_peered":"2024-04-19T04:28:12.080363+0000","last_clean":"2024-04-19T04:28:12.080363+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:28:12.080363+0000","last_undegraded":"2024-04-19T04:28:12.080363+0000","last_fullsized":"2024-04-19T04:28:12.080363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:13:53.306369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078665+0000","last_change":"2024-04-19T04:24:16.144482+0000","last_active":"2024-04-19T04:28:12.078665+0000","last_peered":"2024-04-19T04:28:12.078665+0000","last_clean":"2024-04-19T04:28:12.078665+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:28:12.078665+0000","last_undegraded":"2024-04-19T04:28:12.078665+0000","last_fullsized":"2024-04-19T04:28:12.078665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:15.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285234+0000","last_change":"2024-04-19T04:28:02.842303+0000","last_active":"2024-04-19T04:28:12.285234+0000","last_peered":"2024-04-19T04:28:12.285234+0000","last_clean":"2024-04-19T04:28:12.285234+0000","last_became_active":"2024-04-19T04:28:02.839926+0000","last_became_peered":"2024-04-19T04:28:02.839926+0000","last_unstale":"2024-04-19T04:28:12.285234+0000","last_undegraded":"2024-04-19T04:28:12.285234+0000","last_fullsized":"2024-04-19T04:28:12.285234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:13.266751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":82,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.082938+0000","last_change":"2024-04-19T04:28:02.638370+0000","last_active":"2024-04-19T04:28:11.082938+0000","last_peered":"2024-04-19T04:28:11.082938+0000","last_clean":"2024-04-19T04:28:11.082938+0000","last_became_active":"2024-04-19T04:28:02.638095+0000","last_became_peered":"2024-04-19T04:28:02.638095+0000","last_unstale":"2024-04-19T04:28:11.082938+0000","last_undegraded":"2024-04-19T04:28:11.082938+0000","last_fullsized":"2024-04-19T04:28:11.082938+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:16:46.463514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285839+0000","last_change":"2024-04-19T04:28:02.843324+0000","last_active":"2024-04-19T04:28:12.285839+0000","last_peered":"2024-04-19T04:28:12.285839+0000","last_clean":"2024-04-19T04:28:12.285839+0000","last_became_active":"2024-04-19T04:28:02.840328+0000","last_became_peered":"2024-04-19T04:28:02.840328+0000","last_unstale":"2024-04-19T04:28:12.285839+0000","last_undegraded":"2024-04-19T04:28:12.285839+0000","last_fullsized":"2024-04-19T04:28:12.285839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:58:19.389865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.092725+0000","last_change":"2024-04-19T04:28:12.088382+0000","last_active":"2024-04-19T04:28:12.092725+0000","last_peered":"2024-04-19T04:28:12.092725+0000","last_clean":"2024-04-19T04:28:12.092725+0000","last_became_active":"2024-04-19T04:28:12.087575+0000","last_became_peered":"2024-04-19T04:28:12.087575+0000","last_unstale":"2024-04-19T04:28:12.092725+0000","last_undegraded":"2024-04-19T04:28:12.092725+0000","last_fullsized":"2024-04-19T04:28:12.092725+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:13.034157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288155+0000","last_change":"2024-04-19T04:28:02.844076+0000","last_active":"2024-04-19T04:28:12.288155+0000","last_peered":"2024-04-19T04:28:12.288155+0000","last_clean":"2024-04-19T04:28:12.288155+0000","last_became_active":"2024-04-19T04:28:02.840839+0000","last_became_peered":"2024-04-19T04:28:02.840839+0000","last_unstale":"2024-04-19T04:28:12.288155+0000","last_undegraded":"2024-04-19T04:28:12.288155+0000","last_fullsized":"2024-04-19T04:28:12.288155+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:31.891080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":88,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080149+0000","last_change":"2024-04-19T04:28:02.635123+0000","last_active":"2024-04-19T04:28:12.080149+0000","last_peered":"2024-04-19T04:28:12.080149+0000","last_clean":"2024-04-19T04:28:12.080149+0000","last_became_active":"2024-04-19T04:28:02.634633+0000","last_became_peered":"2024-04-19T04:28:02.634633+0000","last_unstale":"2024-04-19T04:28:12.080149+0000","last_undegraded":"2024-04-19T04:28:12.080149+0000","last_fullsized":"2024-04-19T04:28:12.080149+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:47:35.387548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079490+0000","last_change":"2024-04-19T04:28:02.638250+0000","last_active":"2024-04-19T04:28:12.079490+0000","last_peered":"2024-04-19T04:28:12.079490+0000","last_clean":"2024-04-19T04:28:12.079490+0000","last_became_active":"2024-04-19T04:28:02.637233+0000","last_became_peered":"2024-04-19T04:28:02.637233+0000","last_unstale":"2024-04-19T04:28:12.079490+0000","last_undegraded":"2024-04-19T04:28:12.079490+0000","last_fullsized":"2024-04-19T04:28:12.079490+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:53:27.253209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286825+0000","last_change":"2024-04-19T04:28:02.838255+0000","last_active":"2024-04-19T04:28:12.286825+0000","last_peered":"2024-04-19T04:28:12.286825+0000","last_clean":"2024-04-19T04:28:12.286825+0000","last_became_active":"2024-04-19T04:28:02.837829+0000","last_became_peered":"2024-04-19T04:28:02.837829+0000","last_unstale":"2024-04-19T04:28:12.286825+0000","last_undegraded":"2024-04-19T04:28:12.286825+0000","last_fullsized":"2024-04-19T04:28:12.286825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:11:30.005510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080527+0000","last_change":"2024-04-19T04:28:02.636097+0000","last_active":"2024-04-19T04:28:12.080527+0000","last_peered":"2024-04-19T04:28:12.080527+0000","last_clean":"2024-04-19T04:28:12.080527+0000","last_became_active":"2024-04-19T04:28:02.634103+0000","last_became_peered":"2024-04-19T04:28:02.634103+0000","last_unstale":"2024-04-19T04:28:12.080527+0000","last_undegraded":"2024-04-19T04:28:12.080527+0000","last_fullsized":"2024-04-19T04:28:12.080527+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:37.486856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285930+0000","last_change":"2024-04-19T04:28:02.835876+0000","last_active":"2024-04-19T04:28:12.285930+0000","last_peered":"2024-04-19T04:28:12.285930+0000","last_clean":"2024-04-19T04:28:12.285930+0000","last_became_active":"2024-04-19T04:28:02.835057+0000","last_became_peered":"2024-04-19T04:28:02.835057+0000","last_unstale":"2024-04-19T04:28:12.285930+0000","last_undegraded":"2024-04-19T04:28:12.285930+0000","last_fullsized":"2024-04-19T04:28:12.285930+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:18.104384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":69,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.074987+0000","last_change":"2024-04-19T04:24:20.555116+0000","last_active":"2024-04-19T04:28:11.074987+0000","last_peered":"2024-04-19T04:28:11.074987+0000","last_clean":"2024-04-19T04:28:11.074987+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:28:11.074987+0000","last_undegraded":"2024-04-19T04:28:11.074987+0000","last_fullsized":"2024-04-19T04:28:11.074987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:21.734428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286409+0000","last_change":"2024-04-19T04:28:02.840145+0000","last_active":"2024-04-19T04:28:12.286409+0000","last_peered":"2024-04-19T04:28:12.286409+0000","last_clean":"2024-04-19T04:28:12.286409+0000","last_became_active":"2024-04-19T04:28:02.838918+0000","last_became_peered":"2024-04-19T04:28:02.838918+0000","last_unstale":"2024-04-19T04:28:12.286409+0000","last_undegraded":"2024-04-19T04:28:12.286409+0000","last_fullsized":"2024-04-19T04:28:12.286409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:27.667000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.092906+0000","last_change":"2024-04-19T04:28:12.092906+0000","last_active":"2024-04-19T04:28:12.092906+0000","last_peered":"2024-04-19T04:28:12.092906+0000","last_clean":"2024-04-19T04:28:12.092906+0000","last_became_active":"2024-04-19T04:28:12.091609+0000","last_became_peered":"2024-04-19T04:28:12.091609+0000","last_unstale":"2024-04-19T04:28:12.092906+0000","last_undegraded":"2024-04-19T04:28:12.092906+0000","last_fullsized":"2024-04-19T04:28:12.092906+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:42:50.079444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095641+0000","last_change":"2024-04-19T04:28:12.092944+0000","last_active":"2024-04-19T04:28:12.095641+0000","last_peered":"2024-04-19T04:28:12.095641+0000","last_clean":"2024-04-19T04:28:12.095641+0000","last_became_active":"2024-04-19T04:28:12.091335+0000","last_became_peered":"2024-04-19T04:28:12.091335+0000","last_unstale":"2024-04-19T04:28:12.095641+0000","last_undegraded":"2024-04-19T04:28:12.095641+0000","last_fullsized":"2024-04-19T04:28:12.095641+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:39:57.870227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287403+0000","last_change":"2024-04-19T04:28:02.843341+0000","last_active":"2024-04-19T04:28:12.287403+0000","last_peered":"2024-04-19T04:28:12.287403+0000","last_clean":"2024-04-19T04:28:12.287403+0000","last_became_active":"2024-04-19T04:28:02.839883+0000","last_became_peered":"2024-04-19T04:28:02.839883+0000","last_unstale":"2024-04-19T04:28:12.287403+0000","last_undegraded":"2024-04-19T04:28:12.287403+0000","last_fullsized":"2024-04-19T04:28:12.287403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:39:33.503440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286657+0000","last_change":"2024-04-19T04:28:02.845957+0000","last_active":"2024-04-19T04:28:12.286657+0000","last_peered":"2024-04-19T04:28:12.286657+0000","last_clean":"2024-04-19T04:28:12.286657+0000","last_became_active":"2024-04-19T04:28:02.845256+0000","last_became_peered":"2024-04-19T04:28:02.845256+0000","last_unstale":"2024-04-19T04:28:12.286657+0000","last_undegraded":"2024-04-19T04:28:12.286657+0000","last_fullsized":"2024-04-19T04:28:12.286657+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:28:34.674877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285602+0000","last_change":"2024-04-19T04:28:02.845275+0000","last_active":"2024-04-19T04:28:12.285602+0000","last_peered":"2024-04-19T04:28:12.285602+0000","last_clean":"2024-04-19T04:28:12.285602+0000","last_became_active":"2024-04-19T04:28:02.844128+0000","last_became_peered":"2024-04-19T04:28:02.844128+0000","last_unstale":"2024-04-19T04:28:12.285602+0000","last_undegraded":"2024-04-19T04:28:12.285602+0000","last_fullsized":"2024-04-19T04:28:12.285602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:08:59.450805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286896+0000","last_change":"2024-04-19T04:28:02.845918+0000","last_active":"2024-04-19T04:28:12.286896+0000","last_peered":"2024-04-19T04:28:12.286896+0000","last_clean":"2024-04-19T04:28:12.286896+0000","last_became_active":"2024-04-19T04:28:02.844483+0000","last_became_peered":"2024-04-19T04:28:02.844483+0000","last_unstale":"2024-04-19T04:28:12.286896+0000","last_undegraded":"2024-04-19T04:28:12.286896+0000","last_fullsized":"2024-04-19T04:28:12.286896+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:33:18.588838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080894+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:28:12.080894+0000","last_peered":"2024-04-19T04:28:12.080894+0000","last_clean":"2024-04-19T04:28:12.080894+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:28:12.080894+0000","last_undegraded":"2024-04-19T04:28:12.080894+0000","last_fullsized":"2024-04-19T04:28:12.080894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:45.574813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094276+0000","last_change":"2024-04-19T04:28:12.091443+0000","last_active":"2024-04-19T04:28:12.094276+0000","last_peered":"2024-04-19T04:28:12.094276+0000","last_clean":"2024-04-19T04:28:12.094276+0000","last_became_active":"2024-04-19T04:28:12.088123+0000","last_became_peered":"2024-04-19T04:28:12.088123+0000","last_unstale":"2024-04-19T04:28:12.094276+0000","last_undegraded":"2024-04-19T04:28:12.094276+0000","last_fullsized":"2024-04-19T04:28:12.094276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:46.736712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079124+0000","last_change":"2024-04-19T04:24:20.555406+0000","last_active":"2024-04-19T04:28:12.079124+0000","last_peered":"2024-04-19T04:28:12.079124+0000","last_clean":"2024-04-19T04:28:12.079124+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:28:12.079124+0000","last_undegraded":"2024-04-19T04:28:12.079124+0000","last_fullsized":"2024-04-19T04:28:12.079124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:10.453970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079781+0000","last_change":"2024-04-19T04:24:20.185978+0000","last_active":"2024-04-19T04:28:12.079781+0000","last_peered":"2024-04-19T04:28:12.079781+0000","last_clean":"2024-04-19T04:28:12.079781+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:28:12.079781+0000","last_undegraded":"2024-04-19T04:28:12.079781+0000","last_fullsized":"2024-04-19T04:28:12.079781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:48.158805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286910+0000","last_change":"2024-04-19T04:28:02.842249+0000","last_active":"2024-04-19T04:28:12.286910+0000","last_peered":"2024-04-19T04:28:12.286910+0000","last_clean":"2024-04-19T04:28:12.286910+0000","last_became_active":"2024-04-19T04:28:02.841373+0000","last_became_peered":"2024-04-19T04:28:02.841373+0000","last_unstale":"2024-04-19T04:28:12.286910+0000","last_undegraded":"2024-04-19T04:28:12.286910+0000","last_fullsized":"2024-04-19T04:28:12.286910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.571164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.097713+0000","last_change":"2024-04-19T04:28:12.094542+0000","last_active":"2024-04-19T04:28:12.097713+0000","last_peered":"2024-04-19T04:28:12.097713+0000","last_clean":"2024-04-19T04:28:12.097713+0000","last_became_active":"2024-04-19T04:28:12.092784+0000","last_became_peered":"2024-04-19T04:28:12.092784+0000","last_unstale":"2024-04-19T04:28:12.097713+0000","last_undegraded":"2024-04-19T04:28:12.097713+0000","last_fullsized":"2024-04-19T04:28:12.097713+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:49.750510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080472+0000","last_change":"2024-04-19T04:28:02.638882+0000","last_active":"2024-04-19T04:28:12.080472+0000","last_peered":"2024-04-19T04:28:12.080472+0000","last_clean":"2024-04-19T04:28:12.080472+0000","last_became_active":"2024-04-19T04:28:02.638431+0000","last_became_peered":"2024-04-19T04:28:02.638431+0000","last_unstale":"2024-04-19T04:28:12.080472+0000","last_undegraded":"2024-04-19T04:28:12.080472+0000","last_fullsized":"2024-04-19T04:28:12.080472+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:32.548608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285755+0000","last_change":"2024-04-19T04:28:02.841112+0000","last_active":"2024-04-19T04:28:12.285755+0000","last_peered":"2024-04-19T04:28:12.285755+0000","last_clean":"2024-04-19T04:28:12.285755+0000","last_became_active":"2024-04-19T04:28:02.838354+0000","last_became_peered":"2024-04-19T04:28:02.838354+0000","last_unstale":"2024-04-19T04:28:12.285755+0000","last_undegraded":"2024-04-19T04:28:12.285755+0000","last_fullsized":"2024-04-19T04:28:12.285755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:44:35.127227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287919+0000","last_change":"2024-04-19T04:28:02.838446+0000","last_active":"2024-04-19T04:28:12.287919+0000","last_peered":"2024-04-19T04:28:12.287919+0000","last_clean":"2024-04-19T04:28:12.287919+0000","last_became_active":"2024-04-19T04:28:02.837994+0000","last_became_peered":"2024-04-19T04:28:02.837994+0000","last_unstale":"2024-04-19T04:28:12.287919+0000","last_undegraded":"2024-04-19T04:28:12.287919+0000","last_fullsized":"2024-04-19T04:28:12.287919+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:01:07.160911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285381+0000","last_change":"2024-04-19T04:28:02.837195+0000","last_active":"2024-04-19T04:28:12.285381+0000","last_peered":"2024-04-19T04:28:12.285381+0000","last_clean":"2024-04-19T04:28:12.285381+0000","last_became_active":"2024-04-19T04:28:02.836818+0000","last_became_peered":"2024-04-19T04:28:02.836818+0000","last_unstale":"2024-04-19T04:28:12.285381+0000","last_undegraded":"2024-04-19T04:28:12.285381+0000","last_fullsized":"2024-04-19T04:28:12.285381+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:10:12.924030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":69,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.085505+0000","last_change":"2024-04-19T04:24:20.552644+0000","last_active":"2024-04-19T04:28:11.085505+0000","last_peered":"2024-04-19T04:28:11.085505+0000","last_clean":"2024-04-19T04:28:11.085505+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:28:11.085505+0000","last_undegraded":"2024-04-19T04:28:11.085505+0000","last_fullsized":"2024-04-19T04:28:11.085505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285114+0000","last_change":"2024-04-19T04:28:02.839065+0000","last_active":"2024-04-19T04:28:12.285114+0000","last_peered":"2024-04-19T04:28:12.285114+0000","last_clean":"2024-04-19T04:28:12.285114+0000","last_became_active":"2024-04-19T04:28:02.837400+0000","last_became_peered":"2024-04-19T04:28:02.837400+0000","last_unstale":"2024-04-19T04:28:12.285114+0000","last_undegraded":"2024-04-19T04:28:12.285114+0000","last_fullsized":"2024-04-19T04:28:12.285114+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:05:54.339418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287287+0000","last_change":"2024-04-19T04:28:02.845777+0000","last_active":"2024-04-19T04:28:12.287287+0000","last_peered":"2024-04-19T04:28:12.287287+0000","last_clean":"2024-04-19T04:28:12.287287+0000","last_became_active":"2024-04-19T04:28:02.844057+0000","last_became_peered":"2024-04-19T04:28:02.844057+0000","last_unstale":"2024-04-19T04:28:12.287287+0000","last_undegraded":"2024-04-19T04:28:12.287287+0000","last_fullsized":"2024-04-19T04:28:12.287287+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:47:53.420459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285255+0000","last_change":"2024-04-19T04:28:02.837131+0000","last_active":"2024-04-19T04:28:12.285255+0000","last_peered":"2024-04-19T04:28:12.285255+0000","last_clean":"2024-04-19T04:28:12.285255+0000","last_became_active":"2024-04-19T04:28:02.836492+0000","last_became_peered":"2024-04-19T04:28:02.836492+0000","last_unstale":"2024-04-19T04:28:12.285255+0000","last_undegraded":"2024-04-19T04:28:12.285255+0000","last_fullsized":"2024-04-19T04:28:12.285255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:02.952851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.100279+0000","last_change":"2024-04-19T04:28:12.095836+0000","last_active":"2024-04-19T04:28:12.100279+0000","last_peered":"2024-04-19T04:28:12.100279+0000","last_clean":"2024-04-19T04:28:12.100279+0000","last_became_active":"2024-04-19T04:28:12.095332+0000","last_became_peered":"2024-04-19T04:28:12.095332+0000","last_unstale":"2024-04-19T04:28:12.100279+0000","last_undegraded":"2024-04-19T04:28:12.100279+0000","last_fullsized":"2024-04-19T04:28:12.100279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:43:51.926940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.092977+0000","last_change":"2024-04-19T04:28:12.092977+0000","last_active":"2024-04-19T04:28:12.092977+0000","last_peered":"2024-04-19T04:28:12.092977+0000","last_clean":"2024-04-19T04:28:12.092977+0000","last_became_active":"2024-04-19T04:28:12.090262+0000","last_became_peered":"2024-04-19T04:28:12.090262+0000","last_unstale":"2024-04-19T04:28:12.092977+0000","last_undegraded":"2024-04-19T04:28:12.092977+0000","last_fullsized":"2024-04-19T04:28:12.092977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:39.131554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093601+0000","last_change":"2024-04-19T04:28:12.093601+0000","last_active":"2024-04-19T04:28:12.093601+0000","last_peered":"2024-04-19T04:28:12.093601+0000","last_clean":"2024-04-19T04:28:12.093601+0000","last_became_active":"2024-04-19T04:28:12.092979+0000","last_became_peered":"2024-04-19T04:28:12.092979+0000","last_unstale":"2024-04-19T04:28:12.093601+0000","last_undegraded":"2024-04-19T04:28:12.093601+0000","last_fullsized":"2024-04-19T04:28:12.093601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:28:58.381121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.097695+0000","last_change":"2024-04-19T04:28:12.094560+0000","last_active":"2024-04-19T04:28:12.097695+0000","last_peered":"2024-04-19T04:28:12.097695+0000","last_clean":"2024-04-19T04:28:12.097695+0000","last_became_active":"2024-04-19T04:28:12.093915+0000","last_became_peered":"2024-04-19T04:28:12.093915+0000","last_unstale":"2024-04-19T04:28:12.097695+0000","last_undegraded":"2024-04-19T04:28:12.097695+0000","last_fullsized":"2024-04-19T04:28:12.097695+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:11:26.070147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078961+0000","last_change":"2024-04-19T04:28:02.639054+0000","last_active":"2024-04-19T04:28:12.078961+0000","last_peered":"2024-04-19T04:28:12.078961+0000","last_clean":"2024-04-19T04:28:12.078961+0000","last_became_active":"2024-04-19T04:28:02.637952+0000","last_became_peered":"2024-04-19T04:28:02.637952+0000","last_unstale":"2024-04-19T04:28:12.078961+0000","last_undegraded":"2024-04-19T04:28:12.078961+0000","last_fullsized":"2024-04-19T04:28:12.078961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:00:22.017021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":87,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079496+0000","last_change":"2024-04-19T04:28:02.635226+0000","last_active":"2024-04-19T04:28:12.079496+0000","last_peered":"2024-04-19T04:28:12.079496+0000","last_clean":"2024-04-19T04:28:12.079496+0000","last_became_active":"2024-04-19T04:28:02.634226+0000","last_became_peered":"2024-04-19T04:28:02.634226+0000","last_unstale":"2024-04-19T04:28:12.079496+0000","last_undegraded":"2024-04-19T04:28:12.079496+0000","last_fullsized":"2024-04-19T04:28:12.079496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:07.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079565+0000","last_change":"2024-04-19T04:28:02.636657+0000","last_active":"2024-04-19T04:28:12.079565+0000","last_peered":"2024-04-19T04:28:12.079565+0000","last_clean":"2024-04-19T04:28:12.079565+0000","last_became_active":"2024-04-19T04:28:02.636266+0000","last_became_peered":"2024-04-19T04:28:02.636266+0000","last_unstale":"2024-04-19T04:28:12.079565+0000","last_undegraded":"2024-04-19T04:28:12.079565+0000","last_fullsized":"2024-04-19T04:28:12.079565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:20:16.458945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.100268+0000","last_change":"2024-04-19T04:28:12.095797+0000","last_active":"2024-04-19T04:28:12.100268+0000","last_peered":"2024-04-19T04:28:12.100268+0000","last_clean":"2024-04-19T04:28:12.100268+0000","last_became_active":"2024-04-19T04:28:12.095199+0000","last_became_peered":"2024-04-19T04:28:12.095199+0000","last_unstale":"2024-04-19T04:28:12.100268+0000","last_undegraded":"2024-04-19T04:28:12.100268+0000","last_fullsized":"2024-04-19T04:28:12.100268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:28.634271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.091303+0000","last_change":"2024-04-19T04:28:12.091303+0000","last_active":"2024-04-19T04:28:12.091303+0000","last_peered":"2024-04-19T04:28:12.091303+0000","last_clean":"2024-04-19T04:28:12.091303+0000","last_became_active":"2024-04-19T04:28:12.087884+0000","last_became_peered":"2024-04-19T04:28:12.087884+0000","last_unstale":"2024-04-19T04:28:12.091303+0000","last_undegraded":"2024-04-19T04:28:12.091303+0000","last_fullsized":"2024-04-19T04:28:12.091303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:01:12.373663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288082+0000","last_change":"2024-04-19T04:28:02.846538+0000","last_active":"2024-04-19T04:28:12.288082+0000","last_peered":"2024-04-19T04:28:12.288082+0000","last_clean":"2024-04-19T04:28:12.288082+0000","last_became_active":"2024-04-19T04:28:02.846234+0000","last_became_peered":"2024-04-19T04:28:02.846234+0000","last_unstale":"2024-04-19T04:28:12.288082+0000","last_undegraded":"2024-04-19T04:28:12.288082+0000","last_fullsized":"2024-04-19T04:28:12.288082+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:08.165785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078454+0000","last_change":"2024-04-19T04:28:02.635122+0000","last_active":"2024-04-19T04:28:12.078454+0000","last_peered":"2024-04-19T04:28:12.078454+0000","last_clean":"2024-04-19T04:28:12.078454+0000","last_became_active":"2024-04-19T04:28:02.634433+0000","last_became_peered":"2024-04-19T04:28:02.634433+0000","last_unstale":"2024-04-19T04:28:12.078454+0000","last_undegraded":"2024-04-19T04:28:12.078454+0000","last_fullsized":"2024-04-19T04:28:12.078454+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:40.139486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288286+0000","last_change":"2024-04-19T04:28:02.844897+0000","last_active":"2024-04-19T04:28:12.288286+0000","last_peered":"2024-04-19T04:28:12.288286+0000","last_clean":"2024-04-19T04:28:12.288286+0000","last_became_active":"2024-04-19T04:28:02.844276+0000","last_became_peered":"2024-04-19T04:28:02.844276+0000","last_unstale":"2024-04-19T04:28:12.288286+0000","last_undegraded":"2024-04-19T04:28:12.288286+0000","last_fullsized":"2024-04-19T04:28:12.288286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:45.100544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705718,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220712,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151128,"statfs":{"total":96636764160,"available":96410755072,"internally_reserved":0,"allocated":937984,"data_stored":922026,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 04:27:10 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.65400000000000003,"15min":0.76500000000000001},"min":{"1min":0.218,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.82599999999999996,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.55500000000000005,"15min":0.59099999999999997},"min":{"1min":0.26000000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.81599999999999995,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.77600000000000002}]},{"osd":1,"last update":"Fri Apr 19 04:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":5.1989999999999998,"5min":5.1989999999999998,"15min":5.1989999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":0.85199999999999998}]}]},{"osd":1,"up_from":72,"seq":309237645316,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44116,"kb_used_data":836,"kb_used_omap":6,"kb_used_meta":43257,"kb_avail":94327724,"statfs":{"total":96636764160,"available":96591589376,"internally_reserved":0,"allocated":856064,"data_stored":330528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6880,"internal_metadata":44295456},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705718,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298668,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297726,"kb_avail":94073172,"statfs":{"total":96636764160,"available":96330928128,"internally_reserved":0,"allocated":950272,"data_stored":924740,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":304871878},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 04:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.68799999999999994}]},{"osd":2,"last update":"Fri Apr 19 04:27:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.23899999999999999,"5min":0.223,"15min":0.223},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.69999999999999996,"15min":0.80300000000000005},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.81799999999999995,"5min":4.5,"15min":4.5},"last":0.77900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:28:16.309 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-19T04:28:16.310 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-19T04:28:16.633 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-19T04:28:16.644 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-19T04:28:16.644 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:28:16.958 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:28:16.962 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:28:16.976 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-04-19T04:28:14.985465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":563496,"kb_used_data":2680,"kb_used_omap":9,"kb_used_meta":560758,"kb_avail":282552024,"statfs":{"total":289910292480,"available":289333272576,"internally_reserved":0,"allocated":2744320,"data_stored":2177294,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":10068,"internal_metadata":574216364},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.933310"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093601+0000","last_change":"2024-04-19T04:28:12.093601+0000","last_active":"2024-04-19T04:28:12.093601+0000","last_peered":"2024-04-19T04:28:12.093601+0000","last_clean":"2024-04-19T04:28:12.093601+0000","last_became_active":"2024-04-19T04:28:12.093175+0000","last_became_peered":"2024-04-19T04:28:12.093175+0000","last_unstale":"2024-04-19T04:28:12.093601+0000","last_undegraded":"2024-04-19T04:28:12.093601+0000","last_fullsized":"2024-04-19T04:28:12.093601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:53:38.070519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093573+0000","last_change":"2024-04-19T04:28:12.093573+0000","last_active":"2024-04-19T04:28:12.093573+0000","last_peered":"2024-04-19T04:28:12.093573+0000","last_clean":"2024-04-19T04:28:12.093573+0000","last_became_active":"2024-04-19T04:28:12.092819+0000","last_became_peered":"2024-04-19T04:28:12.092819+0000","last_unstale":"2024-04-19T04:28:12.093573+0000","last_undegraded":"2024-04-19T04:28:12.093573+0000","last_fullsized":"2024-04-19T04:28:12.093573+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:14.577765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079707+0000","last_change":"2024-04-19T04:24:20.556199+0000","last_active":"2024-04-19T04:28:12.079707+0000","last_peered":"2024-04-19T04:28:12.079707+0000","last_clean":"2024-04-19T04:28:12.079707+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:28:12.079707+0000","last_undegraded":"2024-04-19T04:28:12.079707+0000","last_fullsized":"2024-04-19T04:28:12.079707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:14.348910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078925+0000","last_change":"2024-04-19T04:28:02.635437+0000","last_active":"2024-04-19T04:28:12.078925+0000","last_peered":"2024-04-19T04:28:12.078925+0000","last_clean":"2024-04-19T04:28:12.078925+0000","last_became_active":"2024-04-19T04:28:02.634355+0000","last_became_peered":"2024-04-19T04:28:02.634355+0000","last_unstale":"2024-04-19T04:28:12.078925+0000","last_undegraded":"2024-04-19T04:28:12.078925+0000","last_fullsized":"2024-04-19T04:28:12.078925+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:39.534000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.090282+0000","last_change":"2024-04-19T04:28:12.090282+0000","last_active":"2024-04-19T04:28:12.090282+0000","last_peered":"2024-04-19T04:28:12.090282+0000","last_clean":"2024-04-19T04:28:12.090282+0000","last_became_active":"2024-04-19T04:28:12.088231+0000","last_became_peered":"2024-04-19T04:28:12.088231+0000","last_unstale":"2024-04-19T04:28:12.090282+0000","last_undegraded":"2024-04-19T04:28:12.090282+0000","last_fullsized":"2024-04-19T04:28:12.090282+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:48:51.512556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078586+0000","last_change":"2024-04-19T04:28:02.637742+0000","last_active":"2024-04-19T04:28:12.078586+0000","last_peered":"2024-04-19T04:28:12.078586+0000","last_clean":"2024-04-19T04:28:12.078586+0000","last_became_active":"2024-04-19T04:28:02.637276+0000","last_became_peered":"2024-04-19T04:28:02.637276+0000","last_unstale":"2024-04-19T04:28:12.078586+0000","last_undegraded":"2024-04-19T04:28:12.078586+0000","last_fullsized":"2024-04-19T04:28:12.078586+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:06.971707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078374+0000","last_change":"2024-04-19T04:28:02.637532+0000","last_active":"2024-04-19T04:28:12.078374+0000","last_peered":"2024-04-19T04:28:12.078374+0000","last_clean":"2024-04-19T04:28:12.078374+0000","last_became_active":"2024-04-19T04:28:02.637086+0000","last_became_peered":"2024-04-19T04:28:02.637086+0000","last_unstale":"2024-04-19T04:28:12.078374+0000","last_undegraded":"2024-04-19T04:28:12.078374+0000","last_fullsized":"2024-04-19T04:28:12.078374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:40:05.423094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.077959+0000","last_change":"2024-04-19T04:28:02.638186+0000","last_active":"2024-04-19T04:28:12.077959+0000","last_peered":"2024-04-19T04:28:12.077959+0000","last_clean":"2024-04-19T04:28:12.077959+0000","last_became_active":"2024-04-19T04:28:02.637746+0000","last_became_peered":"2024-04-19T04:28:02.637746+0000","last_unstale":"2024-04-19T04:28:12.077959+0000","last_undegraded":"2024-04-19T04:28:12.077959+0000","last_fullsized":"2024-04-19T04:28:12.077959+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:50.758441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287710+0000","last_change":"2024-04-19T04:28:02.842455+0000","last_active":"2024-04-19T04:28:12.287710+0000","last_peered":"2024-04-19T04:28:12.287710+0000","last_clean":"2024-04-19T04:28:12.287710+0000","last_became_active":"2024-04-19T04:28:02.839203+0000","last_became_peered":"2024-04-19T04:28:02.839203+0000","last_unstale":"2024-04-19T04:28:12.287710+0000","last_undegraded":"2024-04-19T04:28:12.287710+0000","last_fullsized":"2024-04-19T04:28:12.287710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:18:44.252505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093403+0000","last_change":"2024-04-19T04:28:12.093403+0000","last_active":"2024-04-19T04:28:12.093403+0000","last_peered":"2024-04-19T04:28:12.093403+0000","last_clean":"2024-04-19T04:28:12.093403+0000","last_became_active":"2024-04-19T04:28:12.092924+0000","last_became_peered":"2024-04-19T04:28:12.092924+0000","last_unstale":"2024-04-19T04:28:12.093403+0000","last_undegraded":"2024-04-19T04:28:12.093403+0000","last_fullsized":"2024-04-19T04:28:12.093403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:56.871317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079800+0000","last_change":"2024-04-19T04:28:02.636293+0000","last_active":"2024-04-19T04:28:12.079800+0000","last_peered":"2024-04-19T04:28:12.079800+0000","last_clean":"2024-04-19T04:28:12.079800+0000","last_became_active":"2024-04-19T04:28:02.635946+0000","last_became_peered":"2024-04-19T04:28:02.635946+0000","last_unstale":"2024-04-19T04:28:12.079800+0000","last_undegraded":"2024-04-19T04:28:12.079800+0000","last_fullsized":"2024-04-19T04:28:12.079800+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:42.381196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.100198+0000","last_change":"2024-04-19T04:28:12.095304+0000","last_active":"2024-04-19T04:28:12.100198+0000","last_peered":"2024-04-19T04:28:12.100198+0000","last_clean":"2024-04-19T04:28:12.100198+0000","last_became_active":"2024-04-19T04:28:12.094753+0000","last_became_peered":"2024-04-19T04:28:12.094753+0000","last_unstale":"2024-04-19T04:28:12.100198+0000","last_undegraded":"2024-04-19T04:28:12.100198+0000","last_fullsized":"2024-04-19T04:28:12.100198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:36:03.465294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093953+0000","last_change":"2024-04-19T04:28:12.093953+0000","last_active":"2024-04-19T04:28:12.093953+0000","last_peered":"2024-04-19T04:28:12.093953+0000","last_clean":"2024-04-19T04:28:12.093953+0000","last_became_active":"2024-04-19T04:28:12.093267+0000","last_became_peered":"2024-04-19T04:28:12.093267+0000","last_unstale":"2024-04-19T04:28:12.093953+0000","last_undegraded":"2024-04-19T04:28:12.093953+0000","last_fullsized":"2024-04-19T04:28:12.093953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:14.548542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078930+0000","last_change":"2024-04-19T04:24:20.552690+0000","last_active":"2024-04-19T04:28:12.078930+0000","last_peered":"2024-04-19T04:28:12.078930+0000","last_clean":"2024-04-19T04:28:12.078930+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:28:12.078930+0000","last_undegraded":"2024-04-19T04:28:12.078930+0000","last_fullsized":"2024-04-19T04:28:12.078930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:53:16.890992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078527+0000","last_change":"2024-04-19T04:24:20.551809+0000","last_active":"2024-04-19T04:28:12.078527+0000","last_peered":"2024-04-19T04:28:12.078527+0000","last_clean":"2024-04-19T04:28:12.078527+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:28:12.078527+0000","last_undegraded":"2024-04-19T04:28:12.078527+0000","last_fullsized":"2024-04-19T04:28:12.078527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:43:31.281765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078198+0000","last_change":"2024-04-19T04:28:02.638726+0000","last_active":"2024-04-19T04:28:12.078198+0000","last_peered":"2024-04-19T04:28:12.078198+0000","last_clean":"2024-04-19T04:28:12.078198+0000","last_became_active":"2024-04-19T04:28:02.637920+0000","last_became_peered":"2024-04-19T04:28:02.637920+0000","last_unstale":"2024-04-19T04:28:12.078198+0000","last_undegraded":"2024-04-19T04:28:12.078198+0000","last_fullsized":"2024-04-19T04:28:12.078198+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:23:42.710810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287706+0000","last_change":"2024-04-19T04:28:02.841438+0000","last_active":"2024-04-19T04:28:12.287706+0000","last_peered":"2024-04-19T04:28:12.287706+0000","last_clean":"2024-04-19T04:28:12.287706+0000","last_became_active":"2024-04-19T04:28:02.839071+0000","last_became_peered":"2024-04-19T04:28:02.839071+0000","last_unstale":"2024-04-19T04:28:12.287706+0000","last_undegraded":"2024-04-19T04:28:12.287706+0000","last_fullsized":"2024-04-19T04:28:12.287706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:37:05.846827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":82,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.084946+0000","last_change":"2024-04-19T04:28:02.638587+0000","last_active":"2024-04-19T04:28:11.084946+0000","last_peered":"2024-04-19T04:28:11.084946+0000","last_clean":"2024-04-19T04:28:11.084946+0000","last_became_active":"2024-04-19T04:28:02.638230+0000","last_became_peered":"2024-04-19T04:28:02.638230+0000","last_unstale":"2024-04-19T04:28:11.084946+0000","last_undegraded":"2024-04-19T04:28:11.084946+0000","last_fullsized":"2024-04-19T04:28:11.084946+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:43:23.974591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286685+0000","last_change":"2024-04-19T04:28:02.840423+0000","last_active":"2024-04-19T04:28:12.286685+0000","last_peered":"2024-04-19T04:28:12.286685+0000","last_clean":"2024-04-19T04:28:12.286685+0000","last_became_active":"2024-04-19T04:28:02.839362+0000","last_became_peered":"2024-04-19T04:28:02.839362+0000","last_unstale":"2024-04-19T04:28:12.286685+0000","last_undegraded":"2024-04-19T04:28:12.286685+0000","last_fullsized":"2024-04-19T04:28:12.286685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:24:55.325024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079785+0000","last_change":"2024-04-19T04:28:02.635566+0000","last_active":"2024-04-19T04:28:12.079785+0000","last_peered":"2024-04-19T04:28:12.079785+0000","last_clean":"2024-04-19T04:28:12.079785+0000","last_became_active":"2024-04-19T04:28:02.634835+0000","last_became_peered":"2024-04-19T04:28:02.634835+0000","last_unstale":"2024-04-19T04:28:12.079785+0000","last_undegraded":"2024-04-19T04:28:12.079785+0000","last_fullsized":"2024-04-19T04:28:12.079785+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:04.159997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079199+0000","last_change":"2024-04-19T04:28:02.639259+0000","last_active":"2024-04-19T04:28:12.079199+0000","last_peered":"2024-04-19T04:28:12.079199+0000","last_clean":"2024-04-19T04:28:12.079199+0000","last_became_active":"2024-04-19T04:28:02.638546+0000","last_became_peered":"2024-04-19T04:28:02.638546+0000","last_unstale":"2024-04-19T04:28:12.079199+0000","last_undegraded":"2024-04-19T04:28:12.079199+0000","last_fullsized":"2024-04-19T04:28:12.079199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:47:45.968474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094010+0000","last_change":"2024-04-19T04:28:12.089576+0000","last_active":"2024-04-19T04:28:12.094010+0000","last_peered":"2024-04-19T04:28:12.094010+0000","last_clean":"2024-04-19T04:28:12.094010+0000","last_became_active":"2024-04-19T04:28:12.087571+0000","last_became_peered":"2024-04-19T04:28:12.087571+0000","last_unstale":"2024-04-19T04:28:12.094010+0000","last_undegraded":"2024-04-19T04:28:12.094010+0000","last_fullsized":"2024-04-19T04:28:12.094010+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:42.381196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285546+0000","last_change":"2024-04-19T04:28:02.842994+0000","last_active":"2024-04-19T04:28:12.285546+0000","last_peered":"2024-04-19T04:28:12.285546+0000","last_clean":"2024-04-19T04:28:12.285546+0000","last_became_active":"2024-04-19T04:28:02.840294+0000","last_became_peered":"2024-04-19T04:28:02.840294+0000","last_unstale":"2024-04-19T04:28:12.285546+0000","last_undegraded":"2024-04-19T04:28:12.285546+0000","last_fullsized":"2024-04-19T04:28:12.285546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:26.503064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.090413+0000","last_change":"2024-04-19T04:28:12.090413+0000","last_active":"2024-04-19T04:28:12.090413+0000","last_peered":"2024-04-19T04:28:12.090413+0000","last_clean":"2024-04-19T04:28:12.090413+0000","last_became_active":"2024-04-19T04:28:12.089918+0000","last_became_peered":"2024-04-19T04:28:12.089918+0000","last_unstale":"2024-04-19T04:28:12.090413+0000","last_undegraded":"2024-04-19T04:28:12.090413+0000","last_fullsized":"2024-04-19T04:28:12.090413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:08.501081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095501+0000","last_change":"2024-04-19T04:28:12.092733+0000","last_active":"2024-04-19T04:28:12.095501+0000","last_peered":"2024-04-19T04:28:12.095501+0000","last_clean":"2024-04-19T04:28:12.095501+0000","last_became_active":"2024-04-19T04:28:12.091770+0000","last_became_peered":"2024-04-19T04:28:12.091770+0000","last_unstale":"2024-04-19T04:28:12.095501+0000","last_undegraded":"2024-04-19T04:28:12.095501+0000","last_fullsized":"2024-04-19T04:28:12.095501+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:39:38.261503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287546+0000","last_change":"2024-04-19T04:28:02.846092+0000","last_active":"2024-04-19T04:28:12.287546+0000","last_peered":"2024-04-19T04:28:12.287546+0000","last_clean":"2024-04-19T04:28:12.287546+0000","last_became_active":"2024-04-19T04:28:02.845416+0000","last_became_peered":"2024-04-19T04:28:02.845416+0000","last_unstale":"2024-04-19T04:28:12.287546+0000","last_undegraded":"2024-04-19T04:28:12.287546+0000","last_fullsized":"2024-04-19T04:28:12.287546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:23.517160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079927+0000","last_change":"2024-04-19T04:24:20.554885+0000","last_active":"2024-04-19T04:28:12.079927+0000","last_peered":"2024-04-19T04:28:12.079927+0000","last_clean":"2024-04-19T04:28:12.079927+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:28:12.079927+0000","last_undegraded":"2024-04-19T04:28:12.079927+0000","last_fullsized":"2024-04-19T04:28:12.079927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:44:08.285518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095487+0000","last_change":"2024-04-19T04:28:12.092936+0000","last_active":"2024-04-19T04:28:12.095487+0000","last_peered":"2024-04-19T04:28:12.095487+0000","last_clean":"2024-04-19T04:28:12.095487+0000","last_became_active":"2024-04-19T04:28:12.091969+0000","last_became_peered":"2024-04-19T04:28:12.091969+0000","last_unstale":"2024-04-19T04:28:12.095487+0000","last_undegraded":"2024-04-19T04:28:12.095487+0000","last_fullsized":"2024-04-19T04:28:12.095487+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:20.569368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285809+0000","last_change":"2024-04-19T04:28:02.845150+0000","last_active":"2024-04-19T04:28:12.285809+0000","last_peered":"2024-04-19T04:28:12.285809+0000","last_clean":"2024-04-19T04:28:12.285809+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:28:12.285809+0000","last_undegraded":"2024-04-19T04:28:12.285809+0000","last_fullsized":"2024-04-19T04:28:12.285809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:27:04.257043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":69,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.075220+0000","last_change":"2024-04-19T04:24:20.554847+0000","last_active":"2024-04-19T04:28:11.075220+0000","last_peered":"2024-04-19T04:28:11.075220+0000","last_clean":"2024-04-19T04:28:11.075220+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:28:11.075220+0000","last_undegraded":"2024-04-19T04:28:11.075220+0000","last_fullsized":"2024-04-19T04:28:11.075220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:00.475711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286101+0000","last_change":"2024-04-19T04:28:02.843590+0000","last_active":"2024-04-19T04:28:12.286101+0000","last_peered":"2024-04-19T04:28:12.286101+0000","last_clean":"2024-04-19T04:28:12.286101+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:28:12.286101+0000","last_undegraded":"2024-04-19T04:28:12.286101+0000","last_fullsized":"2024-04-19T04:28:12.286101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:02.147016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078180+0000","last_change":"2024-04-19T04:28:02.635119+0000","last_active":"2024-04-19T04:28:12.078180+0000","last_peered":"2024-04-19T04:28:12.078180+0000","last_clean":"2024-04-19T04:28:12.078180+0000","last_became_active":"2024-04-19T04:28:02.634586+0000","last_became_peered":"2024-04-19T04:28:02.634586+0000","last_unstale":"2024-04-19T04:28:12.078180+0000","last_undegraded":"2024-04-19T04:28:12.078180+0000","last_fullsized":"2024-04-19T04:28:12.078180+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:08.719606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095305+0000","last_change":"2024-04-19T04:28:12.095305+0000","last_active":"2024-04-19T04:28:12.095305+0000","last_peered":"2024-04-19T04:28:12.095305+0000","last_clean":"2024-04-19T04:28:12.095305+0000","last_became_active":"2024-04-19T04:28:12.094558+0000","last_became_peered":"2024-04-19T04:28:12.094558+0000","last_unstale":"2024-04-19T04:28:12.095305+0000","last_undegraded":"2024-04-19T04:28:12.095305+0000","last_fullsized":"2024-04-19T04:28:12.095305+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:44:45.647590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":87,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079450+0000","last_change":"2024-04-19T04:28:02.639581+0000","last_active":"2024-04-19T04:28:12.079450+0000","last_peered":"2024-04-19T04:28:12.079450+0000","last_clean":"2024-04-19T04:28:12.079450+0000","last_became_active":"2024-04-19T04:28:02.638666+0000","last_became_peered":"2024-04-19T04:28:02.638666+0000","last_unstale":"2024-04-19T04:28:12.079450+0000","last_undegraded":"2024-04-19T04:28:12.079450+0000","last_fullsized":"2024-04-19T04:28:12.079450+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:42:54.107998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095631+0000","last_change":"2024-04-19T04:28:12.095631+0000","last_active":"2024-04-19T04:28:12.095631+0000","last_peered":"2024-04-19T04:28:12.095631+0000","last_clean":"2024-04-19T04:28:12.095631+0000","last_became_active":"2024-04-19T04:28:12.094722+0000","last_became_peered":"2024-04-19T04:28:12.094722+0000","last_unstale":"2024-04-19T04:28:12.095631+0000","last_undegraded":"2024-04-19T04:28:12.095631+0000","last_fullsized":"2024-04-19T04:28:12.095631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:31.378691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287127+0000","last_change":"2024-04-19T04:28:02.843299+0000","last_active":"2024-04-19T04:28:12.287127+0000","last_peered":"2024-04-19T04:28:12.287127+0000","last_clean":"2024-04-19T04:28:12.287127+0000","last_became_active":"2024-04-19T04:28:02.842525+0000","last_became_peered":"2024-04-19T04:28:02.842525+0000","last_unstale":"2024-04-19T04:28:12.287127+0000","last_undegraded":"2024-04-19T04:28:12.287127+0000","last_fullsized":"2024-04-19T04:28:12.287127+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:10:33.303473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287136+0000","last_change":"2024-04-19T04:28:02.845685+0000","last_active":"2024-04-19T04:28:12.287136+0000","last_peered":"2024-04-19T04:28:12.287136+0000","last_clean":"2024-04-19T04:28:12.287136+0000","last_became_active":"2024-04-19T04:28:02.843099+0000","last_became_peered":"2024-04-19T04:28:02.843099+0000","last_unstale":"2024-04-19T04:28:12.287136+0000","last_undegraded":"2024-04-19T04:28:12.287136+0000","last_fullsized":"2024-04-19T04:28:12.287136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:25:05.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095287+0000","last_change":"2024-04-19T04:28:12.092744+0000","last_active":"2024-04-19T04:28:12.095287+0000","last_peered":"2024-04-19T04:28:12.095287+0000","last_clean":"2024-04-19T04:28:12.095287+0000","last_became_active":"2024-04-19T04:28:12.091771+0000","last_became_peered":"2024-04-19T04:28:12.091771+0000","last_unstale":"2024-04-19T04:28:12.095287+0000","last_undegraded":"2024-04-19T04:28:12.095287+0000","last_fullsized":"2024-04-19T04:28:12.095287+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:34.728962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287385+0000","last_change":"2024-04-19T04:28:02.837331+0000","last_active":"2024-04-19T04:28:12.287385+0000","last_peered":"2024-04-19T04:28:12.287385+0000","last_clean":"2024-04-19T04:28:12.287385+0000","last_became_active":"2024-04-19T04:28:02.836984+0000","last_became_peered":"2024-04-19T04:28:02.836984+0000","last_unstale":"2024-04-19T04:28:12.287385+0000","last_undegraded":"2024-04-19T04:28:12.287385+0000","last_fullsized":"2024-04-19T04:28:12.287385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:11.858503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":80,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078519+0000","last_change":"2024-04-19T04:24:20.187299+0000","last_active":"2024-04-19T04:28:12.078519+0000","last_peered":"2024-04-19T04:28:12.078519+0000","last_clean":"2024-04-19T04:28:12.078519+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:28:12.078519+0000","last_undegraded":"2024-04-19T04:28:12.078519+0000","last_fullsized":"2024-04-19T04:28:12.078519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:49:37.812125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":73,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080835+0000","last_change":"2024-04-19T04:24:20.186029+0000","last_active":"2024-04-19T04:28:12.080835+0000","last_peered":"2024-04-19T04:28:12.080835+0000","last_clean":"2024-04-19T04:28:12.080835+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:28:12.080835+0000","last_undegraded":"2024-04-19T04:28:12.080835+0000","last_fullsized":"2024-04-19T04:28:12.080835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:49.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095216+0000","last_change":"2024-04-19T04:28:12.092118+0000","last_active":"2024-04-19T04:28:12.095216+0000","last_peered":"2024-04-19T04:28:12.095216+0000","last_clean":"2024-04-19T04:28:12.095216+0000","last_became_active":"2024-04-19T04:28:12.090379+0000","last_became_peered":"2024-04-19T04:28:12.090379+0000","last_unstale":"2024-04-19T04:28:12.095216+0000","last_undegraded":"2024-04-19T04:28:12.095216+0000","last_fullsized":"2024-04-19T04:28:12.095216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:38.494787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094285+0000","last_change":"2024-04-19T04:28:12.090491+0000","last_active":"2024-04-19T04:28:12.094285+0000","last_peered":"2024-04-19T04:28:12.094285+0000","last_clean":"2024-04-19T04:28:12.094285+0000","last_became_active":"2024-04-19T04:28:12.089948+0000","last_became_peered":"2024-04-19T04:28:12.089948+0000","last_unstale":"2024-04-19T04:28:12.094285+0000","last_undegraded":"2024-04-19T04:28:12.094285+0000","last_fullsized":"2024-04-19T04:28:12.094285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:04:35.343697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093574+0000","last_change":"2024-04-19T04:28:12.093574+0000","last_active":"2024-04-19T04:28:12.093574+0000","last_peered":"2024-04-19T04:28:12.093574+0000","last_clean":"2024-04-19T04:28:12.093574+0000","last_became_active":"2024-04-19T04:28:12.093090+0000","last_became_peered":"2024-04-19T04:28:12.093090+0000","last_unstale":"2024-04-19T04:28:12.093574+0000","last_undegraded":"2024-04-19T04:28:12.093574+0000","last_fullsized":"2024-04-19T04:28:12.093574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:32:01.796620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":73,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080387+0000","last_change":"2024-04-19T04:24:20.186044+0000","last_active":"2024-04-19T04:28:12.080387+0000","last_peered":"2024-04-19T04:28:12.080387+0000","last_clean":"2024-04-19T04:28:12.080387+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:28:12.080387+0000","last_undegraded":"2024-04-19T04:28:12.080387+0000","last_fullsized":"2024-04-19T04:28:12.080387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.432692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079351+0000","last_change":"2024-04-19T04:28:02.636589+0000","last_active":"2024-04-19T04:28:12.079351+0000","last_peered":"2024-04-19T04:28:12.079351+0000","last_clean":"2024-04-19T04:28:12.079351+0000","last_became_active":"2024-04-19T04:28:02.636231+0000","last_became_peered":"2024-04-19T04:28:02.636231+0000","last_unstale":"2024-04-19T04:28:12.079351+0000","last_undegraded":"2024-04-19T04:28:12.079351+0000","last_fullsized":"2024-04-19T04:28:12.079351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:25:32.636485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080045+0000","last_change":"2024-04-19T04:28:02.635650+0000","last_active":"2024-04-19T04:28:12.080045+0000","last_peered":"2024-04-19T04:28:12.080045+0000","last_clean":"2024-04-19T04:28:12.080045+0000","last_became_active":"2024-04-19T04:28:02.634823+0000","last_became_peered":"2024-04-19T04:28:02.634823+0000","last_unstale":"2024-04-19T04:28:12.080045+0000","last_undegraded":"2024-04-19T04:28:12.080045+0000","last_fullsized":"2024-04-19T04:28:12.080045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:37.205733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287721+0000","last_change":"2024-04-19T04:28:02.845805+0000","last_active":"2024-04-19T04:28:12.287721+0000","last_peered":"2024-04-19T04:28:12.287721+0000","last_clean":"2024-04-19T04:28:12.287721+0000","last_became_active":"2024-04-19T04:28:02.845461+0000","last_became_peered":"2024-04-19T04:28:02.845461+0000","last_unstale":"2024-04-19T04:28:12.287721+0000","last_undegraded":"2024-04-19T04:28:12.287721+0000","last_fullsized":"2024-04-19T04:28:12.287721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:57:44.161931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287443+0000","last_change":"2024-04-19T04:28:02.845613+0000","last_active":"2024-04-19T04:28:12.287443+0000","last_peered":"2024-04-19T04:28:12.287443+0000","last_clean":"2024-04-19T04:28:12.287443+0000","last_became_active":"2024-04-19T04:28:02.844927+0000","last_became_peered":"2024-04-19T04:28:02.844927+0000","last_unstale":"2024-04-19T04:28:12.287443+0000","last_undegraded":"2024-04-19T04:28:12.287443+0000","last_fullsized":"2024-04-19T04:28:12.287443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:59.219663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079185+0000","last_change":"2024-04-19T04:28:02.635751+0000","last_active":"2024-04-19T04:28:12.079185+0000","last_peered":"2024-04-19T04:28:12.079185+0000","last_clean":"2024-04-19T04:28:12.079185+0000","last_became_active":"2024-04-19T04:28:02.635238+0000","last_became_peered":"2024-04-19T04:28:02.635238+0000","last_unstale":"2024-04-19T04:28:12.079185+0000","last_undegraded":"2024-04-19T04:28:12.079185+0000","last_fullsized":"2024-04-19T04:28:12.079185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:24:14.292299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079943+0000","last_change":"2024-04-19T04:28:02.638055+0000","last_active":"2024-04-19T04:28:12.079943+0000","last_peered":"2024-04-19T04:28:12.079943+0000","last_clean":"2024-04-19T04:28:12.079943+0000","last_became_active":"2024-04-19T04:28:02.637651+0000","last_became_peered":"2024-04-19T04:28:02.637651+0000","last_unstale":"2024-04-19T04:28:12.079943+0000","last_undegraded":"2024-04-19T04:28:12.079943+0000","last_fullsized":"2024-04-19T04:28:12.079943+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:25:55.832256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080143+0000","last_change":"2024-04-19T04:24:20.555922+0000","last_active":"2024-04-19T04:28:12.080143+0000","last_peered":"2024-04-19T04:28:12.080143+0000","last_clean":"2024-04-19T04:28:12.080143+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:28:12.080143+0000","last_undegraded":"2024-04-19T04:28:12.080143+0000","last_fullsized":"2024-04-19T04:28:12.080143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:06:53.595149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":70,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.078809+0000","last_change":"2024-04-19T04:24:20.183944+0000","last_active":"2024-04-19T04:28:11.078809+0000","last_peered":"2024-04-19T04:28:11.078809+0000","last_clean":"2024-04-19T04:28:11.078809+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:28:11.078809+0000","last_undegraded":"2024-04-19T04:28:11.078809+0000","last_fullsized":"2024-04-19T04:28:11.078809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:42.018487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079773+0000","last_change":"2024-04-19T04:24:20.553085+0000","last_active":"2024-04-19T04:28:12.079773+0000","last_peered":"2024-04-19T04:28:12.079773+0000","last_clean":"2024-04-19T04:28:12.079773+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:28:12.079773+0000","last_undegraded":"2024-04-19T04:28:12.079773+0000","last_fullsized":"2024-04-19T04:28:12.079773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:07:21.467758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":67,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.089659+0000","last_change":"2024-04-19T04:28:12.089659+0000","last_active":"2024-04-19T04:28:12.089659+0000","last_peered":"2024-04-19T04:28:12.089659+0000","last_clean":"2024-04-19T04:28:12.089659+0000","last_became_active":"2024-04-19T04:28:12.088043+0000","last_became_peered":"2024-04-19T04:28:12.088043+0000","last_unstale":"2024-04-19T04:28:12.089659+0000","last_undegraded":"2024-04-19T04:28:12.089659+0000","last_fullsized":"2024-04-19T04:28:12.089659+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:02:42.873134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288226+0000","last_change":"2024-04-19T04:28:02.844467+0000","last_active":"2024-04-19T04:28:12.288226+0000","last_peered":"2024-04-19T04:28:12.288226+0000","last_clean":"2024-04-19T04:28:12.288226+0000","last_became_active":"2024-04-19T04:28:02.843639+0000","last_became_peered":"2024-04-19T04:28:02.843639+0000","last_unstale":"2024-04-19T04:28:12.288226+0000","last_undegraded":"2024-04-19T04:28:12.288226+0000","last_fullsized":"2024-04-19T04:28:12.288226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:24.660145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":275,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094355+0000","last_change":"2024-04-19T04:24:10.106278+0000","last_active":"2024-04-19T04:28:13.094355+0000","last_peered":"2024-04-19T04:28:13.094355+0000","last_clean":"2024-04-19T04:28:13.094355+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:28:13.094355+0000","last_undegraded":"2024-04-19T04:28:13.094355+0000","last_fullsized":"2024-04-19T04:28:13.094355+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_clean_scrub_stamp":"2024-04-19T04:24:09.083488+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":88,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079654+0000","last_change":"2024-04-19T04:28:02.639632+0000","last_active":"2024-04-19T04:28:12.079654+0000","last_peered":"2024-04-19T04:28:12.079654+0000","last_clean":"2024-04-19T04:28:12.079654+0000","last_became_active":"2024-04-19T04:28:02.639240+0000","last_became_peered":"2024-04-19T04:28:02.639240+0000","last_unstale":"2024-04-19T04:28:12.079654+0000","last_undegraded":"2024-04-19T04:28:12.079654+0000","last_fullsized":"2024-04-19T04:28:12.079654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:54.035030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287535+0000","last_change":"2024-04-19T04:28:02.842437+0000","last_active":"2024-04-19T04:28:12.287535+0000","last_peered":"2024-04-19T04:28:12.287535+0000","last_clean":"2024-04-19T04:28:12.287535+0000","last_became_active":"2024-04-19T04:28:02.841053+0000","last_became_peered":"2024-04-19T04:28:02.841053+0000","last_unstale":"2024-04-19T04:28:12.287535+0000","last_undegraded":"2024-04-19T04:28:12.287535+0000","last_fullsized":"2024-04-19T04:28:12.287535+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:45.323344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080363+0000","last_change":"2024-04-19T04:24:20.553999+0000","last_active":"2024-04-19T04:28:12.080363+0000","last_peered":"2024-04-19T04:28:12.080363+0000","last_clean":"2024-04-19T04:28:12.080363+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:28:12.080363+0000","last_undegraded":"2024-04-19T04:28:12.080363+0000","last_fullsized":"2024-04-19T04:28:12.080363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:13:53.306369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078665+0000","last_change":"2024-04-19T04:24:16.144482+0000","last_active":"2024-04-19T04:28:12.078665+0000","last_peered":"2024-04-19T04:28:12.078665+0000","last_clean":"2024-04-19T04:28:12.078665+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:28:12.078665+0000","last_undegraded":"2024-04-19T04:28:12.078665+0000","last_fullsized":"2024-04-19T04:28:12.078665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:15.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285234+0000","last_change":"2024-04-19T04:28:02.842303+0000","last_active":"2024-04-19T04:28:12.285234+0000","last_peered":"2024-04-19T04:28:12.285234+0000","last_clean":"2024-04-19T04:28:12.285234+0000","last_became_active":"2024-04-19T04:28:02.839926+0000","last_became_peered":"2024-04-19T04:28:02.839926+0000","last_unstale":"2024-04-19T04:28:12.285234+0000","last_undegraded":"2024-04-19T04:28:12.285234+0000","last_fullsized":"2024-04-19T04:28:12.285234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:13.266751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":82,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.082938+0000","last_change":"2024-04-19T04:28:02.638370+0000","last_active":"2024-04-19T04:28:11.082938+0000","last_peered":"2024-04-19T04:28:11.082938+0000","last_clean":"2024-04-19T04:28:11.082938+0000","last_became_active":"2024-04-19T04:28:02.638095+0000","last_became_peered":"2024-04-19T04:28:02.638095+0000","last_unstale":"2024-04-19T04:28:11.082938+0000","last_undegraded":"2024-04-19T04:28:11.082938+0000","last_fullsized":"2024-04-19T04:28:11.082938+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:16:46.463514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285839+0000","last_change":"2024-04-19T04:28:02.843324+0000","last_active":"2024-04-19T04:28:12.285839+0000","last_peered":"2024-04-19T04:28:12.285839+0000","last_clean":"2024-04-19T04:28:12.285839+0000","last_became_active":"2024-04-19T04:28:02.840328+0000","last_became_peered":"2024-04-19T04:28:02.840328+0000","last_unstale":"2024-04-19T04:28:12.285839+0000","last_undegraded":"2024-04-19T04:28:12.285839+0000","last_fullsized":"2024-04-19T04:28:12.285839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:58:19.389865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.092725+0000","last_change":"2024-04-19T04:28:12.088382+0000","last_active":"2024-04-19T04:28:12.092725+0000","last_peered":"2024-04-19T04:28:12.092725+0000","last_clean":"2024-04-19T04:28:12.092725+0000","last_became_active":"2024-04-19T04:28:12.087575+0000","last_became_peered":"2024-04-19T04:28:12.087575+0000","last_unstale":"2024-04-19T04:28:12.092725+0000","last_undegraded":"2024-04-19T04:28:12.092725+0000","last_fullsized":"2024-04-19T04:28:12.092725+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:13.034157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288155+0000","last_change":"2024-04-19T04:28:02.844076+0000","last_active":"2024-04-19T04:28:12.288155+0000","last_peered":"2024-04-19T04:28:12.288155+0000","last_clean":"2024-04-19T04:28:12.288155+0000","last_became_active":"2024-04-19T04:28:02.840839+0000","last_became_peered":"2024-04-19T04:28:02.840839+0000","last_unstale":"2024-04-19T04:28:12.288155+0000","last_undegraded":"2024-04-19T04:28:12.288155+0000","last_fullsized":"2024-04-19T04:28:12.288155+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:31.891080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":88,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080149+0000","last_change":"2024-04-19T04:28:02.635123+0000","last_active":"2024-04-19T04:28:12.080149+0000","last_peered":"2024-04-19T04:28:12.080149+0000","last_clean":"2024-04-19T04:28:12.080149+0000","last_became_active":"2024-04-19T04:28:02.634633+0000","last_became_peered":"2024-04-19T04:28:02.634633+0000","last_unstale":"2024-04-19T04:28:12.080149+0000","last_undegraded":"2024-04-19T04:28:12.080149+0000","last_fullsized":"2024-04-19T04:28:12.080149+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:47:35.387548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079490+0000","last_change":"2024-04-19T04:28:02.638250+0000","last_active":"2024-04-19T04:28:12.079490+0000","last_peered":"2024-04-19T04:28:12.079490+0000","last_clean":"2024-04-19T04:28:12.079490+0000","last_became_active":"2024-04-19T04:28:02.637233+0000","last_became_peered":"2024-04-19T04:28:02.637233+0000","last_unstale":"2024-04-19T04:28:12.079490+0000","last_undegraded":"2024-04-19T04:28:12.079490+0000","last_fullsized":"2024-04-19T04:28:12.079490+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:53:27.253209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286825+0000","last_change":"2024-04-19T04:28:02.838255+0000","last_active":"2024-04-19T04:28:12.286825+0000","last_peered":"2024-04-19T04:28:12.286825+0000","last_clean":"2024-04-19T04:28:12.286825+0000","last_became_active":"2024-04-19T04:28:02.837829+0000","last_became_peered":"2024-04-19T04:28:02.837829+0000","last_unstale":"2024-04-19T04:28:12.286825+0000","last_undegraded":"2024-04-19T04:28:12.286825+0000","last_fullsized":"2024-04-19T04:28:12.286825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:11:30.005510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080527+0000","last_change":"2024-04-19T04:28:02.636097+0000","last_active":"2024-04-19T04:28:12.080527+0000","last_peered":"2024-04-19T04:28:12.080527+0000","last_clean":"2024-04-19T04:28:12.080527+0000","last_became_active":"2024-04-19T04:28:02.634103+0000","last_became_peered":"2024-04-19T04:28:02.634103+0000","last_unstale":"2024-04-19T04:28:12.080527+0000","last_undegraded":"2024-04-19T04:28:12.080527+0000","last_fullsized":"2024-04-19T04:28:12.080527+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:37.486856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285930+0000","last_change":"2024-04-19T04:28:02.835876+0000","last_active":"2024-04-19T04:28:12.285930+0000","last_peered":"2024-04-19T04:28:12.285930+0000","last_clean":"2024-04-19T04:28:12.285930+0000","last_became_active":"2024-04-19T04:28:02.835057+0000","last_became_peered":"2024-04-19T04:28:02.835057+0000","last_unstale":"2024-04-19T04:28:12.285930+0000","last_undegraded":"2024-04-19T04:28:12.285930+0000","last_fullsized":"2024-04-19T04:28:12.285930+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:18.104384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":69,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.074987+0000","last_change":"2024-04-19T04:24:20.555116+0000","last_active":"2024-04-19T04:28:11.074987+0000","last_peered":"2024-04-19T04:28:11.074987+0000","last_clean":"2024-04-19T04:28:11.074987+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:28:11.074987+0000","last_undegraded":"2024-04-19T04:28:11.074987+0000","last_fullsized":"2024-04-19T04:28:11.074987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:21.734428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286409+0000","last_change":"2024-04-19T04:28:02.840145+0000","last_active":"2024-04-19T04:28:12.286409+0000","last_peered":"2024-04-19T04:28:12.286409+0000","last_clean":"2024-04-19T04:28:12.286409+0000","last_became_active":"2024-04-19T04:28:02.838918+0000","last_became_peered":"2024-04-19T04:28:02.838918+0000","last_unstale":"2024-04-19T04:28:12.286409+0000","last_undegraded":"2024-04-19T04:28:12.286409+0000","last_fullsized":"2024-04-19T04:28:12.286409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:27.667000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.092906+0000","last_change":"2024-04-19T04:28:12.092906+0000","last_active":"2024-04-19T04:28:12.092906+0000","last_peered":"2024-04-19T04:28:12.092906+0000","last_clean":"2024-04-19T04:28:12.092906+0000","last_became_active":"2024-04-19T04:28:12.091609+0000","last_became_peered":"2024-04-19T04:28:12.091609+0000","last_unstale":"2024-04-19T04:28:12.092906+0000","last_undegraded":"2024-04-19T04:28:12.092906+0000","last_fullsized":"2024-04-19T04:28:12.092906+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:42:50.079444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095641+0000","last_change":"2024-04-19T04:28:12.092944+0000","last_active":"2024-04-19T04:28:12.095641+0000","last_peered":"2024-04-19T04:28:12.095641+0000","last_clean":"2024-04-19T04:28:12.095641+0000","last_became_active":"2024-04-19T04:28:12.091335+0000","last_became_peered":"2024-04-19T04:28:12.091335+0000","last_unstale":"2024-04-19T04:28:12.095641+0000","last_undegraded":"2024-04-19T04:28:12.095641+0000","last_fullsized":"2024-04-19T04:28:12.095641+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:39:57.870227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287403+0000","last_change":"2024-04-19T04:28:02.843341+0000","last_active":"2024-04-19T04:28:12.287403+0000","last_peered":"2024-04-19T04:28:12.287403+0000","last_clean":"2024-04-19T04:28:12.287403+0000","last_became_active":"2024-04-19T04:28:02.839883+0000","last_became_peered":"2024-04-19T04:28:02.839883+0000","last_unstale":"2024-04-19T04:28:12.287403+0000","last_undegraded":"2024-04-19T04:28:12.287403+0000","last_fullsized":"2024-04-19T04:28:12.287403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:39:33.503440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286657+0000","last_change":"2024-04-19T04:28:02.845957+0000","last_active":"2024-04-19T04:28:12.286657+0000","last_peered":"2024-04-19T04:28:12.286657+0000","last_clean":"2024-04-19T04:28:12.286657+0000","last_became_active":"2024-04-19T04:28:02.845256+0000","last_became_peered":"2024-04-19T04:28:02.845256+0000","last_unstale":"2024-04-19T04:28:12.286657+0000","last_undegraded":"2024-04-19T04:28:12.286657+0000","last_fullsized":"2024-04-19T04:28:12.286657+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:28:34.674877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285602+0000","last_change":"2024-04-19T04:28:02.845275+0000","last_active":"2024-04-19T04:28:12.285602+0000","last_peered":"2024-04-19T04:28:12.285602+0000","last_clean":"2024-04-19T04:28:12.285602+0000","last_became_active":"2024-04-19T04:28:02.844128+0000","last_became_peered":"2024-04-19T04:28:02.844128+0000","last_unstale":"2024-04-19T04:28:12.285602+0000","last_undegraded":"2024-04-19T04:28:12.285602+0000","last_fullsized":"2024-04-19T04:28:12.285602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:08:59.450805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286896+0000","last_change":"2024-04-19T04:28:02.845918+0000","last_active":"2024-04-19T04:28:12.286896+0000","last_peered":"2024-04-19T04:28:12.286896+0000","last_clean":"2024-04-19T04:28:12.286896+0000","last_became_active":"2024-04-19T04:28:02.844483+0000","last_became_peered":"2024-04-19T04:28:02.844483+0000","last_unstale":"2024-04-19T04:28:12.286896+0000","last_undegraded":"2024-04-19T04:28:12.286896+0000","last_fullsized":"2024-04-19T04:28:12.286896+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:33:18.588838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080894+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:28:12.080894+0000","last_peered":"2024-04-19T04:28:12.080894+0000","last_clean":"2024-04-19T04:28:12.080894+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:28:12.080894+0000","last_undegraded":"2024-04-19T04:28:12.080894+0000","last_fullsized":"2024-04-19T04:28:12.080894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:45.574813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094276+0000","last_change":"2024-04-19T04:28:12.091443+0000","last_active":"2024-04-19T04:28:12.094276+0000","last_peered":"2024-04-19T04:28:12.094276+0000","last_clean":"2024-04-19T04:28:12.094276+0000","last_became_active":"2024-04-19T04:28:12.088123+0000","last_became_peered":"2024-04-19T04:28:12.088123+0000","last_unstale":"2024-04-19T04:28:12.094276+0000","last_undegraded":"2024-04-19T04:28:12.094276+0000","last_fullsized":"2024-04-19T04:28:12.094276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:46.736712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079124+0000","last_change":"2024-04-19T04:24:20.555406+0000","last_active":"2024-04-19T04:28:12.079124+0000","last_peered":"2024-04-19T04:28:12.079124+0000","last_clean":"2024-04-19T04:28:12.079124+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:28:12.079124+0000","last_undegraded":"2024-04-19T04:28:12.079124+0000","last_fullsized":"2024-04-19T04:28:12.079124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:10.453970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079781+0000","last_change":"2024-04-19T04:24:20.185978+0000","last_active":"2024-04-19T04:28:12.079781+0000","last_peered":"2024-04-19T04:28:12.079781+0000","last_clean":"2024-04-19T04:28:12.079781+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:28:12.079781+0000","last_undegraded":"2024-04-19T04:28:12.079781+0000","last_fullsized":"2024-04-19T04:28:12.079781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:48.158805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286910+0000","last_change":"2024-04-19T04:28:02.842249+0000","last_active":"2024-04-19T04:28:12.286910+0000","last_peered":"2024-04-19T04:28:12.286910+0000","last_clean":"2024-04-19T04:28:12.286910+0000","last_became_active":"2024-04-19T04:28:02.841373+0000","last_became_peered":"2024-04-19T04:28:02.841373+0000","last_unstale":"2024-04-19T04:28:12.286910+0000","last_undegraded":"2024-04-19T04:28:12.286910+0000","last_fullsized":"2024-04-19T04:28:12.286910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.571164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.097713+0000","last_change":"2024-04-19T04:28:12.094542+0000","last_active":"2024-04-19T04:28:12.097713+0000","last_peered":"2024-04-19T04:28:12.097713+0000","last_clean":"2024-04-19T04:28:12.097713+0000","last_became_active":"2024-04-19T04:28:12.092784+0000","last_became_peered":"2024-04-19T04:28:12.092784+0000","last_unstale":"2024-04-19T04:28:12.097713+0000","last_undegraded":"2024-04-19T04:28:12.097713+0000","last_fullsized":"2024-04-19T04:28:12.097713+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:49.750510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080472+0000","last_change":"2024-04-19T04:28:02.638882+0000","last_active":"2024-04-19T04:28:12.080472+0000","last_peered":"2024-04-19T04:28:12.080472+0000","last_clean":"2024-04-19T04:28:12.080472+0000","last_became_active":"2024-04-19T04:28:02.638431+0000","last_became_peered":"2024-04-19T04:28:02.638431+0000","last_unstale":"2024-04-19T04:28:12.080472+0000","last_undegraded":"2024-04-19T04:28:12.080472+0000","last_fullsized":"2024-04-19T04:28:12.080472+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:32.548608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285755+0000","last_change":"2024-04-19T04:28:02.841112+0000","last_active":"2024-04-19T04:28:12.285755+0000","last_peered":"2024-04-19T04:28:12.285755+0000","last_clean":"2024-04-19T04:28:12.285755+0000","last_became_active":"2024-04-19T04:28:02.838354+0000","last_became_peered":"2024-04-19T04:28:02.838354+0000","last_unstale":"2024-04-19T04:28:12.285755+0000","last_undegraded":"2024-04-19T04:28:12.285755+0000","last_fullsized":"2024-04-19T04:28:12.285755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:44:35.127227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287919+0000","last_change":"2024-04-19T04:28:02.838446+0000","last_active":"2024-04-19T04:28:12.287919+0000","last_peered":"2024-04-19T04:28:12.287919+0000","last_clean":"2024-04-19T04:28:12.287919+0000","last_became_active":"2024-04-19T04:28:02.837994+0000","last_became_peered":"2024-04-19T04:28:02.837994+0000","last_unstale":"2024-04-19T04:28:12.287919+0000","last_undegraded":"2024-04-19T04:28:12.287919+0000","last_fullsized":"2024-04-19T04:28:12.287919+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:01:07.160911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285381+0000","last_change":"2024-04-19T04:28:02.837195+0000","last_active":"2024-04-19T04:28:12.285381+0000","last_peered":"2024-04-19T04:28:12.285381+0000","last_clean":"2024-04-19T04:28:12.285381+0000","last_became_active":"2024-04-19T04:28:02.836818+0000","last_became_peered":"2024-04-19T04:28:02.836818+0000","last_unstale":"2024-04-19T04:28:12.285381+0000","last_undegraded":"2024-04-19T04:28:12.285381+0000","last_fullsized":"2024-04-19T04:28:12.285381+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:10:12.924030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":69,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.085505+0000","last_change":"2024-04-19T04:24:20.552644+0000","last_active":"2024-04-19T04:28:11.085505+0000","last_peered":"2024-04-19T04:28:11.085505+0000","last_clean":"2024-04-19T04:28:11.085505+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:28:11.085505+0000","last_undegraded":"2024-04-19T04:28:11.085505+0000","last_fullsized":"2024-04-19T04:28:11.085505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285114+0000","last_change":"2024-04-19T04:28:02.839065+0000","last_active":"2024-04-19T04:28:12.285114+0000","last_peered":"2024-04-19T04:28:12.285114+0000","last_clean":"2024-04-19T04:28:12.285114+0000","last_became_active":"2024-04-19T04:28:02.837400+0000","last_became_peered":"2024-04-19T04:28:02.837400+0000","last_unstale":"2024-04-19T04:28:12.285114+0000","last_undegraded":"2024-04-19T04:28:12.285114+0000","last_fullsized":"2024-04-19T04:28:12.285114+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:05:54.339418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287287+0000","last_change":"2024-04-19T04:28:02.845777+0000","last_active":"2024-04-19T04:28:12.287287+0000","last_peered":"2024-04-19T04:28:12.287287+0000","last_clean":"2024-04-19T04:28:12.287287+0000","last_became_active":"2024-04-19T04:28:02.844057+0000","last_became_peered":"2024-04-19T04:28:02.844057+0000","last_unstale":"2024-04-19T04:28:12.287287+0000","last_undegraded":"2024-04-19T04:28:12.287287+0000","last_fullsized":"2024-04-19T04:28:12.287287+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:47:53.420459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285255+0000","last_change":"2024-04-19T04:28:02.837131+0000","last_active":"2024-04-19T04:28:12.285255+0000","last_peered":"2024-04-19T04:28:12.285255+0000","last_clean":"2024-04-19T04:28:12.285255+0000","last_became_active":"2024-04-19T04:28:02.836492+0000","last_became_peered":"2024-04-19T04:28:02.836492+0000","last_unstale":"2024-04-19T04:28:12.285255+0000","last_undegraded":"2024-04-19T04:28:12.285255+0000","last_fullsized":"2024-04-19T04:28:12.285255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:02.952851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.100279+0000","last_change":"2024-04-19T04:28:12.095836+0000","last_active":"2024-04-19T04:28:12.100279+0000","last_peered":"2024-04-19T04:28:12.100279+0000","last_clean":"2024-04-19T04:28:12.100279+0000","last_became_active":"2024-04-19T04:28:12.095332+0000","last_became_peered":"2024-04-19T04:28:12.095332+0000","last_unstale":"2024-04-19T04:28:12.100279+0000","last_undegraded":"2024-04-19T04:28:12.100279+0000","last_fullsized":"2024-04-19T04:28:12.100279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:43:51.926940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.092977+0000","last_change":"2024-04-19T04:28:12.092977+0000","last_active":"2024-04-19T04:28:12.092977+0000","last_peered":"2024-04-19T04:28:12.092977+0000","last_clean":"2024-04-19T04:28:12.092977+0000","last_became_active":"2024-04-19T04:28:12.090262+0000","last_became_peered":"2024-04-19T04:28:12.090262+0000","last_unstale":"2024-04-19T04:28:12.092977+0000","last_undegraded":"2024-04-19T04:28:12.092977+0000","last_fullsized":"2024-04-19T04:28:12.092977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:39.131554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093601+0000","last_change":"2024-04-19T04:28:12.093601+0000","last_active":"2024-04-19T04:28:12.093601+0000","last_peered":"2024-04-19T04:28:12.093601+0000","last_clean":"2024-04-19T04:28:12.093601+0000","last_became_active":"2024-04-19T04:28:12.092979+0000","last_became_peered":"2024-04-19T04:28:12.092979+0000","last_unstale":"2024-04-19T04:28:12.093601+0000","last_undegraded":"2024-04-19T04:28:12.093601+0000","last_fullsized":"2024-04-19T04:28:12.093601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:28:58.381121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.097695+0000","last_change":"2024-04-19T04:28:12.094560+0000","last_active":"2024-04-19T04:28:12.097695+0000","last_peered":"2024-04-19T04:28:12.097695+0000","last_clean":"2024-04-19T04:28:12.097695+0000","last_became_active":"2024-04-19T04:28:12.093915+0000","last_became_peered":"2024-04-19T04:28:12.093915+0000","last_unstale":"2024-04-19T04:28:12.097695+0000","last_undegraded":"2024-04-19T04:28:12.097695+0000","last_fullsized":"2024-04-19T04:28:12.097695+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:11:26.070147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078961+0000","last_change":"2024-04-19T04:28:02.639054+0000","last_active":"2024-04-19T04:28:12.078961+0000","last_peered":"2024-04-19T04:28:12.078961+0000","last_clean":"2024-04-19T04:28:12.078961+0000","last_became_active":"2024-04-19T04:28:02.637952+0000","last_became_peered":"2024-04-19T04:28:02.637952+0000","last_unstale":"2024-04-19T04:28:12.078961+0000","last_undegraded":"2024-04-19T04:28:12.078961+0000","last_fullsized":"2024-04-19T04:28:12.078961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:00:22.017021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":87,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079496+0000","last_change":"2024-04-19T04:28:02.635226+0000","last_active":"2024-04-19T04:28:12.079496+0000","last_peered":"2024-04-19T04:28:12.079496+0000","last_clean":"2024-04-19T04:28:12.079496+0000","last_became_active":"2024-04-19T04:28:02.634226+0000","last_became_peered":"2024-04-19T04:28:02.634226+0000","last_unstale":"2024-04-19T04:28:12.079496+0000","last_undegraded":"2024-04-19T04:28:12.079496+0000","last_fullsized":"2024-04-19T04:28:12.079496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:07.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079565+0000","last_change":"2024-04-19T04:28:02.636657+0000","last_active":"2024-04-19T04:28:12.079565+0000","last_peered":"2024-04-19T04:28:12.079565+0000","last_clean":"2024-04-19T04:28:12.079565+0000","last_became_active":"2024-04-19T04:28:02.636266+0000","last_became_peered":"2024-04-19T04:28:02.636266+0000","last_unstale":"2024-04-19T04:28:12.079565+0000","last_undegraded":"2024-04-19T04:28:12.079565+0000","last_fullsized":"2024-04-19T04:28:12.079565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:20:16.458945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.100268+0000","last_change":"2024-04-19T04:28:12.095797+0000","last_active":"2024-04-19T04:28:12.100268+0000","last_peered":"2024-04-19T04:28:12.100268+0000","last_clean":"2024-04-19T04:28:12.100268+0000","last_became_active":"2024-04-19T04:28:12.095199+0000","last_became_peered":"2024-04-19T04:28:12.095199+0000","last_unstale":"2024-04-19T04:28:12.100268+0000","last_undegraded":"2024-04-19T04:28:12.100268+0000","last_fullsized":"2024-04-19T04:28:12.100268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:28.634271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.091303+0000","last_change":"2024-04-19T04:28:12.091303+0000","last_active":"2024-04-19T04:28:12.091303+0000","last_peered":"2024-04-19T04:28:12.091303+0000","last_clean":"2024-04-19T04:28:12.091303+0000","last_became_active":"2024-04-19T04:28:12.087884+0000","last_became_peered":"2024-04-19T04:28:12.087884+0000","last_unstale":"2024-04-19T04:28:12.091303+0000","last_undegraded":"2024-04-19T04:28:12.091303+0000","last_fullsized":"2024-04-19T04:28:12.091303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:01:12.373663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288082+0000","last_change":"2024-04-19T04:28:02.846538+0000","last_active":"2024-04-19T04:28:12.288082+0000","last_peered":"2024-04-19T04:28:12.288082+0000","last_clean":"2024-04-19T04:28:12.288082+0000","last_became_active":"2024-04-19T04:28:02.846234+0000","last_became_peered":"2024-04-19T04:28:02.846234+0000","last_unstale":"2024-04-19T04:28:12.288082+0000","last_undegraded":"2024-04-19T04:28:12.288082+0000","last_fullsized":"2024-04-19T04:28:12.288082+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:08.165785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078454+0000","last_change":"2024-04-19T04:28:02.635122+0000","last_active":"2024-04-19T04:28:12.078454+0000","last_peered":"2024-04-19T04:28:12.078454+0000","last_clean":"2024-04-19T04:28:12.078454+0000","last_became_active":"2024-04-19T04:28:02.634433+0000","last_became_peered":"2024-04-19T04:28:02.634433+0000","last_unstale":"2024-04-19T04:28:12.078454+0000","last_undegraded":"2024-04-19T04:28:12.078454+0000","last_fullsized":"2024-04-19T04:28:12.078454+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:40.139486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288286+0000","last_change":"2024-04-19T04:28:02.844897+0000","last_active":"2024-04-19T04:28:12.288286+0000","last_peered":"2024-04-19T04:28:12.288286+0000","last_clean":"2024-04-19T04:28:12.288286+0000","last_became_active":"2024-04-19T04:28:02.844276+0000","last_became_peered":"2024-04-19T04:28:02.844276+0000","last_unstale":"2024-04-19T04:28:12.288286+0000","last_undegraded":"2024-04-19T04:28:12.288286+0000","last_fullsized":"2024-04-19T04:28:12.288286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:45.100544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705718,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220712,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151128,"statfs":{"total":96636764160,"available":96410755072,"internally_reserved":0,"allocated":937984,"data_stored":922026,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 04:27:10 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.65400000000000003,"15min":0.76500000000000001},"min":{"1min":0.218,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.82599999999999996,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.55500000000000005,"15min":0.59099999999999997},"min":{"1min":0.26000000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.81599999999999995,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.77600000000000002}]},{"osd":1,"last update":"Fri Apr 19 04:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":5.1989999999999998,"5min":5.1989999999999998,"15min":5.1989999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":0.85199999999999998}]}]},{"osd":1,"up_from":72,"seq":309237645316,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44116,"kb_used_data":836,"kb_used_omap":6,"kb_used_meta":43257,"kb_avail":94327724,"statfs":{"total":96636764160,"available":96591589376,"internally_reserved":0,"allocated":856064,"data_stored":330528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6880,"internal_metadata":44295456},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705718,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298668,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297726,"kb_avail":94073172,"statfs":{"total":96636764160,"available":96330928128,"internally_reserved":0,"allocated":950272,"data_stored":924740,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":304871878},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 04:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.68799999999999994}]},{"osd":2,"last update":"Fri Apr 19 04:27:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.23899999999999999,"5min":0.223,"15min":0.223},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.69999999999999996,"15min":0.80300000000000005},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.81799999999999995,"5min":4.5,"15min":4.5},"last":0.77900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:28:16.981 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:28:17.290 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:28:17.292 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:28:17.304 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-04-19T04:28:16.986496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":563508,"kb_used_data":2688,"kb_used_omap":9,"kb_used_meta":560758,"kb_avail":282552012,"statfs":{"total":289910292480,"available":289333260288,"internally_reserved":0,"allocated":2752512,"data_stored":2181526,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":10068,"internal_metadata":574216364},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002347"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093601+0000","last_change":"2024-04-19T04:28:12.093601+0000","last_active":"2024-04-19T04:28:12.093601+0000","last_peered":"2024-04-19T04:28:12.093601+0000","last_clean":"2024-04-19T04:28:12.093601+0000","last_became_active":"2024-04-19T04:28:12.093175+0000","last_became_peered":"2024-04-19T04:28:12.093175+0000","last_unstale":"2024-04-19T04:28:12.093601+0000","last_undegraded":"2024-04-19T04:28:12.093601+0000","last_fullsized":"2024-04-19T04:28:12.093601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:53:38.070519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093573+0000","last_change":"2024-04-19T04:28:12.093573+0000","last_active":"2024-04-19T04:28:12.093573+0000","last_peered":"2024-04-19T04:28:12.093573+0000","last_clean":"2024-04-19T04:28:12.093573+0000","last_became_active":"2024-04-19T04:28:12.092819+0000","last_became_peered":"2024-04-19T04:28:12.092819+0000","last_unstale":"2024-04-19T04:28:12.093573+0000","last_undegraded":"2024-04-19T04:28:12.093573+0000","last_fullsized":"2024-04-19T04:28:12.093573+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:14.577765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079707+0000","last_change":"2024-04-19T04:24:20.556199+0000","last_active":"2024-04-19T04:28:12.079707+0000","last_peered":"2024-04-19T04:28:12.079707+0000","last_clean":"2024-04-19T04:28:12.079707+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:28:12.079707+0000","last_undegraded":"2024-04-19T04:28:12.079707+0000","last_fullsized":"2024-04-19T04:28:12.079707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:14.348910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078925+0000","last_change":"2024-04-19T04:28:02.635437+0000","last_active":"2024-04-19T04:28:12.078925+0000","last_peered":"2024-04-19T04:28:12.078925+0000","last_clean":"2024-04-19T04:28:12.078925+0000","last_became_active":"2024-04-19T04:28:02.634355+0000","last_became_peered":"2024-04-19T04:28:02.634355+0000","last_unstale":"2024-04-19T04:28:12.078925+0000","last_undegraded":"2024-04-19T04:28:12.078925+0000","last_fullsized":"2024-04-19T04:28:12.078925+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:39.534000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.090282+0000","last_change":"2024-04-19T04:28:12.090282+0000","last_active":"2024-04-19T04:28:12.090282+0000","last_peered":"2024-04-19T04:28:12.090282+0000","last_clean":"2024-04-19T04:28:12.090282+0000","last_became_active":"2024-04-19T04:28:12.088231+0000","last_became_peered":"2024-04-19T04:28:12.088231+0000","last_unstale":"2024-04-19T04:28:12.090282+0000","last_undegraded":"2024-04-19T04:28:12.090282+0000","last_fullsized":"2024-04-19T04:28:12.090282+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:48:51.512556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078586+0000","last_change":"2024-04-19T04:28:02.637742+0000","last_active":"2024-04-19T04:28:12.078586+0000","last_peered":"2024-04-19T04:28:12.078586+0000","last_clean":"2024-04-19T04:28:12.078586+0000","last_became_active":"2024-04-19T04:28:02.637276+0000","last_became_peered":"2024-04-19T04:28:02.637276+0000","last_unstale":"2024-04-19T04:28:12.078586+0000","last_undegraded":"2024-04-19T04:28:12.078586+0000","last_fullsized":"2024-04-19T04:28:12.078586+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:06.971707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078374+0000","last_change":"2024-04-19T04:28:02.637532+0000","last_active":"2024-04-19T04:28:12.078374+0000","last_peered":"2024-04-19T04:28:12.078374+0000","last_clean":"2024-04-19T04:28:12.078374+0000","last_became_active":"2024-04-19T04:28:02.637086+0000","last_became_peered":"2024-04-19T04:28:02.637086+0000","last_unstale":"2024-04-19T04:28:12.078374+0000","last_undegraded":"2024-04-19T04:28:12.078374+0000","last_fullsized":"2024-04-19T04:28:12.078374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:40:05.423094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.077959+0000","last_change":"2024-04-19T04:28:02.638186+0000","last_active":"2024-04-19T04:28:12.077959+0000","last_peered":"2024-04-19T04:28:12.077959+0000","last_clean":"2024-04-19T04:28:12.077959+0000","last_became_active":"2024-04-19T04:28:02.637746+0000","last_became_peered":"2024-04-19T04:28:02.637746+0000","last_unstale":"2024-04-19T04:28:12.077959+0000","last_undegraded":"2024-04-19T04:28:12.077959+0000","last_fullsized":"2024-04-19T04:28:12.077959+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:50.758441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287710+0000","last_change":"2024-04-19T04:28:02.842455+0000","last_active":"2024-04-19T04:28:12.287710+0000","last_peered":"2024-04-19T04:28:12.287710+0000","last_clean":"2024-04-19T04:28:12.287710+0000","last_became_active":"2024-04-19T04:28:02.839203+0000","last_became_peered":"2024-04-19T04:28:02.839203+0000","last_unstale":"2024-04-19T04:28:12.287710+0000","last_undegraded":"2024-04-19T04:28:12.287710+0000","last_fullsized":"2024-04-19T04:28:12.287710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:18:44.252505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093403+0000","last_change":"2024-04-19T04:28:12.093403+0000","last_active":"2024-04-19T04:28:12.093403+0000","last_peered":"2024-04-19T04:28:12.093403+0000","last_clean":"2024-04-19T04:28:12.093403+0000","last_became_active":"2024-04-19T04:28:12.092924+0000","last_became_peered":"2024-04-19T04:28:12.092924+0000","last_unstale":"2024-04-19T04:28:12.093403+0000","last_undegraded":"2024-04-19T04:28:12.093403+0000","last_fullsized":"2024-04-19T04:28:12.093403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:56.871317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079800+0000","last_change":"2024-04-19T04:28:02.636293+0000","last_active":"2024-04-19T04:28:12.079800+0000","last_peered":"2024-04-19T04:28:12.079800+0000","last_clean":"2024-04-19T04:28:12.079800+0000","last_became_active":"2024-04-19T04:28:02.635946+0000","last_became_peered":"2024-04-19T04:28:02.635946+0000","last_unstale":"2024-04-19T04:28:12.079800+0000","last_undegraded":"2024-04-19T04:28:12.079800+0000","last_fullsized":"2024-04-19T04:28:12.079800+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:42.381196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.100198+0000","last_change":"2024-04-19T04:28:12.095304+0000","last_active":"2024-04-19T04:28:12.100198+0000","last_peered":"2024-04-19T04:28:12.100198+0000","last_clean":"2024-04-19T04:28:12.100198+0000","last_became_active":"2024-04-19T04:28:12.094753+0000","last_became_peered":"2024-04-19T04:28:12.094753+0000","last_unstale":"2024-04-19T04:28:12.100198+0000","last_undegraded":"2024-04-19T04:28:12.100198+0000","last_fullsized":"2024-04-19T04:28:12.100198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:36:03.465294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093953+0000","last_change":"2024-04-19T04:28:12.093953+0000","last_active":"2024-04-19T04:28:12.093953+0000","last_peered":"2024-04-19T04:28:12.093953+0000","last_clean":"2024-04-19T04:28:12.093953+0000","last_became_active":"2024-04-19T04:28:12.093267+0000","last_became_peered":"2024-04-19T04:28:12.093267+0000","last_unstale":"2024-04-19T04:28:12.093953+0000","last_undegraded":"2024-04-19T04:28:12.093953+0000","last_fullsized":"2024-04-19T04:28:12.093953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:14.548542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078930+0000","last_change":"2024-04-19T04:24:20.552690+0000","last_active":"2024-04-19T04:28:12.078930+0000","last_peered":"2024-04-19T04:28:12.078930+0000","last_clean":"2024-04-19T04:28:12.078930+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:28:12.078930+0000","last_undegraded":"2024-04-19T04:28:12.078930+0000","last_fullsized":"2024-04-19T04:28:12.078930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:53:16.890992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078527+0000","last_change":"2024-04-19T04:24:20.551809+0000","last_active":"2024-04-19T04:28:12.078527+0000","last_peered":"2024-04-19T04:28:12.078527+0000","last_clean":"2024-04-19T04:28:12.078527+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:28:12.078527+0000","last_undegraded":"2024-04-19T04:28:12.078527+0000","last_fullsized":"2024-04-19T04:28:12.078527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:43:31.281765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078198+0000","last_change":"2024-04-19T04:28:02.638726+0000","last_active":"2024-04-19T04:28:12.078198+0000","last_peered":"2024-04-19T04:28:12.078198+0000","last_clean":"2024-04-19T04:28:12.078198+0000","last_became_active":"2024-04-19T04:28:02.637920+0000","last_became_peered":"2024-04-19T04:28:02.637920+0000","last_unstale":"2024-04-19T04:28:12.078198+0000","last_undegraded":"2024-04-19T04:28:12.078198+0000","last_fullsized":"2024-04-19T04:28:12.078198+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:23:42.710810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287706+0000","last_change":"2024-04-19T04:28:02.841438+0000","last_active":"2024-04-19T04:28:12.287706+0000","last_peered":"2024-04-19T04:28:12.287706+0000","last_clean":"2024-04-19T04:28:12.287706+0000","last_became_active":"2024-04-19T04:28:02.839071+0000","last_became_peered":"2024-04-19T04:28:02.839071+0000","last_unstale":"2024-04-19T04:28:12.287706+0000","last_undegraded":"2024-04-19T04:28:12.287706+0000","last_fullsized":"2024-04-19T04:28:12.287706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:37:05.846827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":82,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.084946+0000","last_change":"2024-04-19T04:28:02.638587+0000","last_active":"2024-04-19T04:28:11.084946+0000","last_peered":"2024-04-19T04:28:11.084946+0000","last_clean":"2024-04-19T04:28:11.084946+0000","last_became_active":"2024-04-19T04:28:02.638230+0000","last_became_peered":"2024-04-19T04:28:02.638230+0000","last_unstale":"2024-04-19T04:28:11.084946+0000","last_undegraded":"2024-04-19T04:28:11.084946+0000","last_fullsized":"2024-04-19T04:28:11.084946+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:43:23.974591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286685+0000","last_change":"2024-04-19T04:28:02.840423+0000","last_active":"2024-04-19T04:28:12.286685+0000","last_peered":"2024-04-19T04:28:12.286685+0000","last_clean":"2024-04-19T04:28:12.286685+0000","last_became_active":"2024-04-19T04:28:02.839362+0000","last_became_peered":"2024-04-19T04:28:02.839362+0000","last_unstale":"2024-04-19T04:28:12.286685+0000","last_undegraded":"2024-04-19T04:28:12.286685+0000","last_fullsized":"2024-04-19T04:28:12.286685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:24:55.325024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079785+0000","last_change":"2024-04-19T04:28:02.635566+0000","last_active":"2024-04-19T04:28:12.079785+0000","last_peered":"2024-04-19T04:28:12.079785+0000","last_clean":"2024-04-19T04:28:12.079785+0000","last_became_active":"2024-04-19T04:28:02.634835+0000","last_became_peered":"2024-04-19T04:28:02.634835+0000","last_unstale":"2024-04-19T04:28:12.079785+0000","last_undegraded":"2024-04-19T04:28:12.079785+0000","last_fullsized":"2024-04-19T04:28:12.079785+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:04.159997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079199+0000","last_change":"2024-04-19T04:28:02.639259+0000","last_active":"2024-04-19T04:28:12.079199+0000","last_peered":"2024-04-19T04:28:12.079199+0000","last_clean":"2024-04-19T04:28:12.079199+0000","last_became_active":"2024-04-19T04:28:02.638546+0000","last_became_peered":"2024-04-19T04:28:02.638546+0000","last_unstale":"2024-04-19T04:28:12.079199+0000","last_undegraded":"2024-04-19T04:28:12.079199+0000","last_fullsized":"2024-04-19T04:28:12.079199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:47:45.968474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094010+0000","last_change":"2024-04-19T04:28:12.089576+0000","last_active":"2024-04-19T04:28:12.094010+0000","last_peered":"2024-04-19T04:28:12.094010+0000","last_clean":"2024-04-19T04:28:12.094010+0000","last_became_active":"2024-04-19T04:28:12.087571+0000","last_became_peered":"2024-04-19T04:28:12.087571+0000","last_unstale":"2024-04-19T04:28:12.094010+0000","last_undegraded":"2024-04-19T04:28:12.094010+0000","last_fullsized":"2024-04-19T04:28:12.094010+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:42.381196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285546+0000","last_change":"2024-04-19T04:28:02.842994+0000","last_active":"2024-04-19T04:28:12.285546+0000","last_peered":"2024-04-19T04:28:12.285546+0000","last_clean":"2024-04-19T04:28:12.285546+0000","last_became_active":"2024-04-19T04:28:02.840294+0000","last_became_peered":"2024-04-19T04:28:02.840294+0000","last_unstale":"2024-04-19T04:28:12.285546+0000","last_undegraded":"2024-04-19T04:28:12.285546+0000","last_fullsized":"2024-04-19T04:28:12.285546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:26.503064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.090413+0000","last_change":"2024-04-19T04:28:12.090413+0000","last_active":"2024-04-19T04:28:12.090413+0000","last_peered":"2024-04-19T04:28:12.090413+0000","last_clean":"2024-04-19T04:28:12.090413+0000","last_became_active":"2024-04-19T04:28:12.089918+0000","last_became_peered":"2024-04-19T04:28:12.089918+0000","last_unstale":"2024-04-19T04:28:12.090413+0000","last_undegraded":"2024-04-19T04:28:12.090413+0000","last_fullsized":"2024-04-19T04:28:12.090413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:08.501081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095501+0000","last_change":"2024-04-19T04:28:12.092733+0000","last_active":"2024-04-19T04:28:12.095501+0000","last_peered":"2024-04-19T04:28:12.095501+0000","last_clean":"2024-04-19T04:28:12.095501+0000","last_became_active":"2024-04-19T04:28:12.091770+0000","last_became_peered":"2024-04-19T04:28:12.091770+0000","last_unstale":"2024-04-19T04:28:12.095501+0000","last_undegraded":"2024-04-19T04:28:12.095501+0000","last_fullsized":"2024-04-19T04:28:12.095501+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:39:38.261503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287546+0000","last_change":"2024-04-19T04:28:02.846092+0000","last_active":"2024-04-19T04:28:12.287546+0000","last_peered":"2024-04-19T04:28:12.287546+0000","last_clean":"2024-04-19T04:28:12.287546+0000","last_became_active":"2024-04-19T04:28:02.845416+0000","last_became_peered":"2024-04-19T04:28:02.845416+0000","last_unstale":"2024-04-19T04:28:12.287546+0000","last_undegraded":"2024-04-19T04:28:12.287546+0000","last_fullsized":"2024-04-19T04:28:12.287546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:23.517160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079927+0000","last_change":"2024-04-19T04:24:20.554885+0000","last_active":"2024-04-19T04:28:12.079927+0000","last_peered":"2024-04-19T04:28:12.079927+0000","last_clean":"2024-04-19T04:28:12.079927+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:28:12.079927+0000","last_undegraded":"2024-04-19T04:28:12.079927+0000","last_fullsized":"2024-04-19T04:28:12.079927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:44:08.285518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095487+0000","last_change":"2024-04-19T04:28:12.092936+0000","last_active":"2024-04-19T04:28:12.095487+0000","last_peered":"2024-04-19T04:28:12.095487+0000","last_clean":"2024-04-19T04:28:12.095487+0000","last_became_active":"2024-04-19T04:28:12.091969+0000","last_became_peered":"2024-04-19T04:28:12.091969+0000","last_unstale":"2024-04-19T04:28:12.095487+0000","last_undegraded":"2024-04-19T04:28:12.095487+0000","last_fullsized":"2024-04-19T04:28:12.095487+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:20.569368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285809+0000","last_change":"2024-04-19T04:28:02.845150+0000","last_active":"2024-04-19T04:28:12.285809+0000","last_peered":"2024-04-19T04:28:12.285809+0000","last_clean":"2024-04-19T04:28:12.285809+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:28:12.285809+0000","last_undegraded":"2024-04-19T04:28:12.285809+0000","last_fullsized":"2024-04-19T04:28:12.285809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:27:04.257043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":69,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.075220+0000","last_change":"2024-04-19T04:24:20.554847+0000","last_active":"2024-04-19T04:28:11.075220+0000","last_peered":"2024-04-19T04:28:11.075220+0000","last_clean":"2024-04-19T04:28:11.075220+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:28:11.075220+0000","last_undegraded":"2024-04-19T04:28:11.075220+0000","last_fullsized":"2024-04-19T04:28:11.075220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:00.475711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286101+0000","last_change":"2024-04-19T04:28:02.843590+0000","last_active":"2024-04-19T04:28:12.286101+0000","last_peered":"2024-04-19T04:28:12.286101+0000","last_clean":"2024-04-19T04:28:12.286101+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:28:12.286101+0000","last_undegraded":"2024-04-19T04:28:12.286101+0000","last_fullsized":"2024-04-19T04:28:12.286101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:02.147016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078180+0000","last_change":"2024-04-19T04:28:02.635119+0000","last_active":"2024-04-19T04:28:12.078180+0000","last_peered":"2024-04-19T04:28:12.078180+0000","last_clean":"2024-04-19T04:28:12.078180+0000","last_became_active":"2024-04-19T04:28:02.634586+0000","last_became_peered":"2024-04-19T04:28:02.634586+0000","last_unstale":"2024-04-19T04:28:12.078180+0000","last_undegraded":"2024-04-19T04:28:12.078180+0000","last_fullsized":"2024-04-19T04:28:12.078180+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:08.719606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095305+0000","last_change":"2024-04-19T04:28:12.095305+0000","last_active":"2024-04-19T04:28:12.095305+0000","last_peered":"2024-04-19T04:28:12.095305+0000","last_clean":"2024-04-19T04:28:12.095305+0000","last_became_active":"2024-04-19T04:28:12.094558+0000","last_became_peered":"2024-04-19T04:28:12.094558+0000","last_unstale":"2024-04-19T04:28:12.095305+0000","last_undegraded":"2024-04-19T04:28:12.095305+0000","last_fullsized":"2024-04-19T04:28:12.095305+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:44:45.647590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":87,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079450+0000","last_change":"2024-04-19T04:28:02.639581+0000","last_active":"2024-04-19T04:28:12.079450+0000","last_peered":"2024-04-19T04:28:12.079450+0000","last_clean":"2024-04-19T04:28:12.079450+0000","last_became_active":"2024-04-19T04:28:02.638666+0000","last_became_peered":"2024-04-19T04:28:02.638666+0000","last_unstale":"2024-04-19T04:28:12.079450+0000","last_undegraded":"2024-04-19T04:28:12.079450+0000","last_fullsized":"2024-04-19T04:28:12.079450+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:42:54.107998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095631+0000","last_change":"2024-04-19T04:28:12.095631+0000","last_active":"2024-04-19T04:28:12.095631+0000","last_peered":"2024-04-19T04:28:12.095631+0000","last_clean":"2024-04-19T04:28:12.095631+0000","last_became_active":"2024-04-19T04:28:12.094722+0000","last_became_peered":"2024-04-19T04:28:12.094722+0000","last_unstale":"2024-04-19T04:28:12.095631+0000","last_undegraded":"2024-04-19T04:28:12.095631+0000","last_fullsized":"2024-04-19T04:28:12.095631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:31.378691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287127+0000","last_change":"2024-04-19T04:28:02.843299+0000","last_active":"2024-04-19T04:28:12.287127+0000","last_peered":"2024-04-19T04:28:12.287127+0000","last_clean":"2024-04-19T04:28:12.287127+0000","last_became_active":"2024-04-19T04:28:02.842525+0000","last_became_peered":"2024-04-19T04:28:02.842525+0000","last_unstale":"2024-04-19T04:28:12.287127+0000","last_undegraded":"2024-04-19T04:28:12.287127+0000","last_fullsized":"2024-04-19T04:28:12.287127+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:10:33.303473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287136+0000","last_change":"2024-04-19T04:28:02.845685+0000","last_active":"2024-04-19T04:28:12.287136+0000","last_peered":"2024-04-19T04:28:12.287136+0000","last_clean":"2024-04-19T04:28:12.287136+0000","last_became_active":"2024-04-19T04:28:02.843099+0000","last_became_peered":"2024-04-19T04:28:02.843099+0000","last_unstale":"2024-04-19T04:28:12.287136+0000","last_undegraded":"2024-04-19T04:28:12.287136+0000","last_fullsized":"2024-04-19T04:28:12.287136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:25:05.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095287+0000","last_change":"2024-04-19T04:28:12.092744+0000","last_active":"2024-04-19T04:28:12.095287+0000","last_peered":"2024-04-19T04:28:12.095287+0000","last_clean":"2024-04-19T04:28:12.095287+0000","last_became_active":"2024-04-19T04:28:12.091771+0000","last_became_peered":"2024-04-19T04:28:12.091771+0000","last_unstale":"2024-04-19T04:28:12.095287+0000","last_undegraded":"2024-04-19T04:28:12.095287+0000","last_fullsized":"2024-04-19T04:28:12.095287+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:34.728962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287385+0000","last_change":"2024-04-19T04:28:02.837331+0000","last_active":"2024-04-19T04:28:12.287385+0000","last_peered":"2024-04-19T04:28:12.287385+0000","last_clean":"2024-04-19T04:28:12.287385+0000","last_became_active":"2024-04-19T04:28:02.836984+0000","last_became_peered":"2024-04-19T04:28:02.836984+0000","last_unstale":"2024-04-19T04:28:12.287385+0000","last_undegraded":"2024-04-19T04:28:12.287385+0000","last_fullsized":"2024-04-19T04:28:12.287385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:11.858503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":80,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078519+0000","last_change":"2024-04-19T04:24:20.187299+0000","last_active":"2024-04-19T04:28:12.078519+0000","last_peered":"2024-04-19T04:28:12.078519+0000","last_clean":"2024-04-19T04:28:12.078519+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:28:12.078519+0000","last_undegraded":"2024-04-19T04:28:12.078519+0000","last_fullsized":"2024-04-19T04:28:12.078519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:49:37.812125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":73,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080835+0000","last_change":"2024-04-19T04:24:20.186029+0000","last_active":"2024-04-19T04:28:12.080835+0000","last_peered":"2024-04-19T04:28:12.080835+0000","last_clean":"2024-04-19T04:28:12.080835+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:28:12.080835+0000","last_undegraded":"2024-04-19T04:28:12.080835+0000","last_fullsized":"2024-04-19T04:28:12.080835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:49.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095216+0000","last_change":"2024-04-19T04:28:12.092118+0000","last_active":"2024-04-19T04:28:12.095216+0000","last_peered":"2024-04-19T04:28:12.095216+0000","last_clean":"2024-04-19T04:28:12.095216+0000","last_became_active":"2024-04-19T04:28:12.090379+0000","last_became_peered":"2024-04-19T04:28:12.090379+0000","last_unstale":"2024-04-19T04:28:12.095216+0000","last_undegraded":"2024-04-19T04:28:12.095216+0000","last_fullsized":"2024-04-19T04:28:12.095216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:38.494787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094285+0000","last_change":"2024-04-19T04:28:12.090491+0000","last_active":"2024-04-19T04:28:12.094285+0000","last_peered":"2024-04-19T04:28:12.094285+0000","last_clean":"2024-04-19T04:28:12.094285+0000","last_became_active":"2024-04-19T04:28:12.089948+0000","last_became_peered":"2024-04-19T04:28:12.089948+0000","last_unstale":"2024-04-19T04:28:12.094285+0000","last_undegraded":"2024-04-19T04:28:12.094285+0000","last_fullsized":"2024-04-19T04:28:12.094285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:04:35.343697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093574+0000","last_change":"2024-04-19T04:28:12.093574+0000","last_active":"2024-04-19T04:28:12.093574+0000","last_peered":"2024-04-19T04:28:12.093574+0000","last_clean":"2024-04-19T04:28:12.093574+0000","last_became_active":"2024-04-19T04:28:12.093090+0000","last_became_peered":"2024-04-19T04:28:12.093090+0000","last_unstale":"2024-04-19T04:28:12.093574+0000","last_undegraded":"2024-04-19T04:28:12.093574+0000","last_fullsized":"2024-04-19T04:28:12.093574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:32:01.796620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":73,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080387+0000","last_change":"2024-04-19T04:24:20.186044+0000","last_active":"2024-04-19T04:28:12.080387+0000","last_peered":"2024-04-19T04:28:12.080387+0000","last_clean":"2024-04-19T04:28:12.080387+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:28:12.080387+0000","last_undegraded":"2024-04-19T04:28:12.080387+0000","last_fullsized":"2024-04-19T04:28:12.080387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.432692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079351+0000","last_change":"2024-04-19T04:28:02.636589+0000","last_active":"2024-04-19T04:28:12.079351+0000","last_peered":"2024-04-19T04:28:12.079351+0000","last_clean":"2024-04-19T04:28:12.079351+0000","last_became_active":"2024-04-19T04:28:02.636231+0000","last_became_peered":"2024-04-19T04:28:02.636231+0000","last_unstale":"2024-04-19T04:28:12.079351+0000","last_undegraded":"2024-04-19T04:28:12.079351+0000","last_fullsized":"2024-04-19T04:28:12.079351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:25:32.636485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080045+0000","last_change":"2024-04-19T04:28:02.635650+0000","last_active":"2024-04-19T04:28:12.080045+0000","last_peered":"2024-04-19T04:28:12.080045+0000","last_clean":"2024-04-19T04:28:12.080045+0000","last_became_active":"2024-04-19T04:28:02.634823+0000","last_became_peered":"2024-04-19T04:28:02.634823+0000","last_unstale":"2024-04-19T04:28:12.080045+0000","last_undegraded":"2024-04-19T04:28:12.080045+0000","last_fullsized":"2024-04-19T04:28:12.080045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:37.205733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287721+0000","last_change":"2024-04-19T04:28:02.845805+0000","last_active":"2024-04-19T04:28:12.287721+0000","last_peered":"2024-04-19T04:28:12.287721+0000","last_clean":"2024-04-19T04:28:12.287721+0000","last_became_active":"2024-04-19T04:28:02.845461+0000","last_became_peered":"2024-04-19T04:28:02.845461+0000","last_unstale":"2024-04-19T04:28:12.287721+0000","last_undegraded":"2024-04-19T04:28:12.287721+0000","last_fullsized":"2024-04-19T04:28:12.287721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:57:44.161931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287443+0000","last_change":"2024-04-19T04:28:02.845613+0000","last_active":"2024-04-19T04:28:12.287443+0000","last_peered":"2024-04-19T04:28:12.287443+0000","last_clean":"2024-04-19T04:28:12.287443+0000","last_became_active":"2024-04-19T04:28:02.844927+0000","last_became_peered":"2024-04-19T04:28:02.844927+0000","last_unstale":"2024-04-19T04:28:12.287443+0000","last_undegraded":"2024-04-19T04:28:12.287443+0000","last_fullsized":"2024-04-19T04:28:12.287443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:59.219663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079185+0000","last_change":"2024-04-19T04:28:02.635751+0000","last_active":"2024-04-19T04:28:12.079185+0000","last_peered":"2024-04-19T04:28:12.079185+0000","last_clean":"2024-04-19T04:28:12.079185+0000","last_became_active":"2024-04-19T04:28:02.635238+0000","last_became_peered":"2024-04-19T04:28:02.635238+0000","last_unstale":"2024-04-19T04:28:12.079185+0000","last_undegraded":"2024-04-19T04:28:12.079185+0000","last_fullsized":"2024-04-19T04:28:12.079185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:24:14.292299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079943+0000","last_change":"2024-04-19T04:28:02.638055+0000","last_active":"2024-04-19T04:28:12.079943+0000","last_peered":"2024-04-19T04:28:12.079943+0000","last_clean":"2024-04-19T04:28:12.079943+0000","last_became_active":"2024-04-19T04:28:02.637651+0000","last_became_peered":"2024-04-19T04:28:02.637651+0000","last_unstale":"2024-04-19T04:28:12.079943+0000","last_undegraded":"2024-04-19T04:28:12.079943+0000","last_fullsized":"2024-04-19T04:28:12.079943+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:25:55.832256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080143+0000","last_change":"2024-04-19T04:24:20.555922+0000","last_active":"2024-04-19T04:28:12.080143+0000","last_peered":"2024-04-19T04:28:12.080143+0000","last_clean":"2024-04-19T04:28:12.080143+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:28:12.080143+0000","last_undegraded":"2024-04-19T04:28:12.080143+0000","last_fullsized":"2024-04-19T04:28:12.080143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:06:53.595149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":70,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.078809+0000","last_change":"2024-04-19T04:24:20.183944+0000","last_active":"2024-04-19T04:28:11.078809+0000","last_peered":"2024-04-19T04:28:11.078809+0000","last_clean":"2024-04-19T04:28:11.078809+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:28:11.078809+0000","last_undegraded":"2024-04-19T04:28:11.078809+0000","last_fullsized":"2024-04-19T04:28:11.078809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:42.018487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079773+0000","last_change":"2024-04-19T04:24:20.553085+0000","last_active":"2024-04-19T04:28:12.079773+0000","last_peered":"2024-04-19T04:28:12.079773+0000","last_clean":"2024-04-19T04:28:12.079773+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:28:12.079773+0000","last_undegraded":"2024-04-19T04:28:12.079773+0000","last_fullsized":"2024-04-19T04:28:12.079773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:07:21.467758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":67,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.089659+0000","last_change":"2024-04-19T04:28:12.089659+0000","last_active":"2024-04-19T04:28:12.089659+0000","last_peered":"2024-04-19T04:28:12.089659+0000","last_clean":"2024-04-19T04:28:12.089659+0000","last_became_active":"2024-04-19T04:28:12.088043+0000","last_became_peered":"2024-04-19T04:28:12.088043+0000","last_unstale":"2024-04-19T04:28:12.089659+0000","last_undegraded":"2024-04-19T04:28:12.089659+0000","last_fullsized":"2024-04-19T04:28:12.089659+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:02:42.873134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288226+0000","last_change":"2024-04-19T04:28:02.844467+0000","last_active":"2024-04-19T04:28:12.288226+0000","last_peered":"2024-04-19T04:28:12.288226+0000","last_clean":"2024-04-19T04:28:12.288226+0000","last_became_active":"2024-04-19T04:28:02.843639+0000","last_became_peered":"2024-04-19T04:28:02.843639+0000","last_unstale":"2024-04-19T04:28:12.288226+0000","last_undegraded":"2024-04-19T04:28:12.288226+0000","last_fullsized":"2024-04-19T04:28:12.288226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:24.660145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":275,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094355+0000","last_change":"2024-04-19T04:24:10.106278+0000","last_active":"2024-04-19T04:28:13.094355+0000","last_peered":"2024-04-19T04:28:13.094355+0000","last_clean":"2024-04-19T04:28:13.094355+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:28:13.094355+0000","last_undegraded":"2024-04-19T04:28:13.094355+0000","last_fullsized":"2024-04-19T04:28:13.094355+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_clean_scrub_stamp":"2024-04-19T04:24:09.083488+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":88,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079654+0000","last_change":"2024-04-19T04:28:02.639632+0000","last_active":"2024-04-19T04:28:12.079654+0000","last_peered":"2024-04-19T04:28:12.079654+0000","last_clean":"2024-04-19T04:28:12.079654+0000","last_became_active":"2024-04-19T04:28:02.639240+0000","last_became_peered":"2024-04-19T04:28:02.639240+0000","last_unstale":"2024-04-19T04:28:12.079654+0000","last_undegraded":"2024-04-19T04:28:12.079654+0000","last_fullsized":"2024-04-19T04:28:12.079654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:54.035030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287535+0000","last_change":"2024-04-19T04:28:02.842437+0000","last_active":"2024-04-19T04:28:12.287535+0000","last_peered":"2024-04-19T04:28:12.287535+0000","last_clean":"2024-04-19T04:28:12.287535+0000","last_became_active":"2024-04-19T04:28:02.841053+0000","last_became_peered":"2024-04-19T04:28:02.841053+0000","last_unstale":"2024-04-19T04:28:12.287535+0000","last_undegraded":"2024-04-19T04:28:12.287535+0000","last_fullsized":"2024-04-19T04:28:12.287535+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:45.323344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080363+0000","last_change":"2024-04-19T04:24:20.553999+0000","last_active":"2024-04-19T04:28:12.080363+0000","last_peered":"2024-04-19T04:28:12.080363+0000","last_clean":"2024-04-19T04:28:12.080363+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:28:12.080363+0000","last_undegraded":"2024-04-19T04:28:12.080363+0000","last_fullsized":"2024-04-19T04:28:12.080363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:13:53.306369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078665+0000","last_change":"2024-04-19T04:24:16.144482+0000","last_active":"2024-04-19T04:28:12.078665+0000","last_peered":"2024-04-19T04:28:12.078665+0000","last_clean":"2024-04-19T04:28:12.078665+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:28:12.078665+0000","last_undegraded":"2024-04-19T04:28:12.078665+0000","last_fullsized":"2024-04-19T04:28:12.078665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:15.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285234+0000","last_change":"2024-04-19T04:28:02.842303+0000","last_active":"2024-04-19T04:28:12.285234+0000","last_peered":"2024-04-19T04:28:12.285234+0000","last_clean":"2024-04-19T04:28:12.285234+0000","last_became_active":"2024-04-19T04:28:02.839926+0000","last_became_peered":"2024-04-19T04:28:02.839926+0000","last_unstale":"2024-04-19T04:28:12.285234+0000","last_undegraded":"2024-04-19T04:28:12.285234+0000","last_fullsized":"2024-04-19T04:28:12.285234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:13.266751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":82,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.082938+0000","last_change":"2024-04-19T04:28:02.638370+0000","last_active":"2024-04-19T04:28:11.082938+0000","last_peered":"2024-04-19T04:28:11.082938+0000","last_clean":"2024-04-19T04:28:11.082938+0000","last_became_active":"2024-04-19T04:28:02.638095+0000","last_became_peered":"2024-04-19T04:28:02.638095+0000","last_unstale":"2024-04-19T04:28:11.082938+0000","last_undegraded":"2024-04-19T04:28:11.082938+0000","last_fullsized":"2024-04-19T04:28:11.082938+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:16:46.463514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285839+0000","last_change":"2024-04-19T04:28:02.843324+0000","last_active":"2024-04-19T04:28:12.285839+0000","last_peered":"2024-04-19T04:28:12.285839+0000","last_clean":"2024-04-19T04:28:12.285839+0000","last_became_active":"2024-04-19T04:28:02.840328+0000","last_became_peered":"2024-04-19T04:28:02.840328+0000","last_unstale":"2024-04-19T04:28:12.285839+0000","last_undegraded":"2024-04-19T04:28:12.285839+0000","last_fullsized":"2024-04-19T04:28:12.285839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:58:19.389865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.092725+0000","last_change":"2024-04-19T04:28:12.088382+0000","last_active":"2024-04-19T04:28:12.092725+0000","last_peered":"2024-04-19T04:28:12.092725+0000","last_clean":"2024-04-19T04:28:12.092725+0000","last_became_active":"2024-04-19T04:28:12.087575+0000","last_became_peered":"2024-04-19T04:28:12.087575+0000","last_unstale":"2024-04-19T04:28:12.092725+0000","last_undegraded":"2024-04-19T04:28:12.092725+0000","last_fullsized":"2024-04-19T04:28:12.092725+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:13.034157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288155+0000","last_change":"2024-04-19T04:28:02.844076+0000","last_active":"2024-04-19T04:28:12.288155+0000","last_peered":"2024-04-19T04:28:12.288155+0000","last_clean":"2024-04-19T04:28:12.288155+0000","last_became_active":"2024-04-19T04:28:02.840839+0000","last_became_peered":"2024-04-19T04:28:02.840839+0000","last_unstale":"2024-04-19T04:28:12.288155+0000","last_undegraded":"2024-04-19T04:28:12.288155+0000","last_fullsized":"2024-04-19T04:28:12.288155+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:31.891080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":88,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080149+0000","last_change":"2024-04-19T04:28:02.635123+0000","last_active":"2024-04-19T04:28:12.080149+0000","last_peered":"2024-04-19T04:28:12.080149+0000","last_clean":"2024-04-19T04:28:12.080149+0000","last_became_active":"2024-04-19T04:28:02.634633+0000","last_became_peered":"2024-04-19T04:28:02.634633+0000","last_unstale":"2024-04-19T04:28:12.080149+0000","last_undegraded":"2024-04-19T04:28:12.080149+0000","last_fullsized":"2024-04-19T04:28:12.080149+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:47:35.387548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079490+0000","last_change":"2024-04-19T04:28:02.638250+0000","last_active":"2024-04-19T04:28:12.079490+0000","last_peered":"2024-04-19T04:28:12.079490+0000","last_clean":"2024-04-19T04:28:12.079490+0000","last_became_active":"2024-04-19T04:28:02.637233+0000","last_became_peered":"2024-04-19T04:28:02.637233+0000","last_unstale":"2024-04-19T04:28:12.079490+0000","last_undegraded":"2024-04-19T04:28:12.079490+0000","last_fullsized":"2024-04-19T04:28:12.079490+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:53:27.253209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286825+0000","last_change":"2024-04-19T04:28:02.838255+0000","last_active":"2024-04-19T04:28:12.286825+0000","last_peered":"2024-04-19T04:28:12.286825+0000","last_clean":"2024-04-19T04:28:12.286825+0000","last_became_active":"2024-04-19T04:28:02.837829+0000","last_became_peered":"2024-04-19T04:28:02.837829+0000","last_unstale":"2024-04-19T04:28:12.286825+0000","last_undegraded":"2024-04-19T04:28:12.286825+0000","last_fullsized":"2024-04-19T04:28:12.286825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:11:30.005510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080527+0000","last_change":"2024-04-19T04:28:02.636097+0000","last_active":"2024-04-19T04:28:12.080527+0000","last_peered":"2024-04-19T04:28:12.080527+0000","last_clean":"2024-04-19T04:28:12.080527+0000","last_became_active":"2024-04-19T04:28:02.634103+0000","last_became_peered":"2024-04-19T04:28:02.634103+0000","last_unstale":"2024-04-19T04:28:12.080527+0000","last_undegraded":"2024-04-19T04:28:12.080527+0000","last_fullsized":"2024-04-19T04:28:12.080527+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:37.486856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285930+0000","last_change":"2024-04-19T04:28:02.835876+0000","last_active":"2024-04-19T04:28:12.285930+0000","last_peered":"2024-04-19T04:28:12.285930+0000","last_clean":"2024-04-19T04:28:12.285930+0000","last_became_active":"2024-04-19T04:28:02.835057+0000","last_became_peered":"2024-04-19T04:28:02.835057+0000","last_unstale":"2024-04-19T04:28:12.285930+0000","last_undegraded":"2024-04-19T04:28:12.285930+0000","last_fullsized":"2024-04-19T04:28:12.285930+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:18.104384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":69,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.074987+0000","last_change":"2024-04-19T04:24:20.555116+0000","last_active":"2024-04-19T04:28:11.074987+0000","last_peered":"2024-04-19T04:28:11.074987+0000","last_clean":"2024-04-19T04:28:11.074987+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:28:11.074987+0000","last_undegraded":"2024-04-19T04:28:11.074987+0000","last_fullsized":"2024-04-19T04:28:11.074987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:21.734428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286409+0000","last_change":"2024-04-19T04:28:02.840145+0000","last_active":"2024-04-19T04:28:12.286409+0000","last_peered":"2024-04-19T04:28:12.286409+0000","last_clean":"2024-04-19T04:28:12.286409+0000","last_became_active":"2024-04-19T04:28:02.838918+0000","last_became_peered":"2024-04-19T04:28:02.838918+0000","last_unstale":"2024-04-19T04:28:12.286409+0000","last_undegraded":"2024-04-19T04:28:12.286409+0000","last_fullsized":"2024-04-19T04:28:12.286409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:27.667000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.092906+0000","last_change":"2024-04-19T04:28:12.092906+0000","last_active":"2024-04-19T04:28:12.092906+0000","last_peered":"2024-04-19T04:28:12.092906+0000","last_clean":"2024-04-19T04:28:12.092906+0000","last_became_active":"2024-04-19T04:28:12.091609+0000","last_became_peered":"2024-04-19T04:28:12.091609+0000","last_unstale":"2024-04-19T04:28:12.092906+0000","last_undegraded":"2024-04-19T04:28:12.092906+0000","last_fullsized":"2024-04-19T04:28:12.092906+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:42:50.079444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095641+0000","last_change":"2024-04-19T04:28:12.092944+0000","last_active":"2024-04-19T04:28:12.095641+0000","last_peered":"2024-04-19T04:28:12.095641+0000","last_clean":"2024-04-19T04:28:12.095641+0000","last_became_active":"2024-04-19T04:28:12.091335+0000","last_became_peered":"2024-04-19T04:28:12.091335+0000","last_unstale":"2024-04-19T04:28:12.095641+0000","last_undegraded":"2024-04-19T04:28:12.095641+0000","last_fullsized":"2024-04-19T04:28:12.095641+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:39:57.870227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287403+0000","last_change":"2024-04-19T04:28:02.843341+0000","last_active":"2024-04-19T04:28:12.287403+0000","last_peered":"2024-04-19T04:28:12.287403+0000","last_clean":"2024-04-19T04:28:12.287403+0000","last_became_active":"2024-04-19T04:28:02.839883+0000","last_became_peered":"2024-04-19T04:28:02.839883+0000","last_unstale":"2024-04-19T04:28:12.287403+0000","last_undegraded":"2024-04-19T04:28:12.287403+0000","last_fullsized":"2024-04-19T04:28:12.287403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:39:33.503440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286657+0000","last_change":"2024-04-19T04:28:02.845957+0000","last_active":"2024-04-19T04:28:12.286657+0000","last_peered":"2024-04-19T04:28:12.286657+0000","last_clean":"2024-04-19T04:28:12.286657+0000","last_became_active":"2024-04-19T04:28:02.845256+0000","last_became_peered":"2024-04-19T04:28:02.845256+0000","last_unstale":"2024-04-19T04:28:12.286657+0000","last_undegraded":"2024-04-19T04:28:12.286657+0000","last_fullsized":"2024-04-19T04:28:12.286657+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:28:34.674877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285602+0000","last_change":"2024-04-19T04:28:02.845275+0000","last_active":"2024-04-19T04:28:12.285602+0000","last_peered":"2024-04-19T04:28:12.285602+0000","last_clean":"2024-04-19T04:28:12.285602+0000","last_became_active":"2024-04-19T04:28:02.844128+0000","last_became_peered":"2024-04-19T04:28:02.844128+0000","last_unstale":"2024-04-19T04:28:12.285602+0000","last_undegraded":"2024-04-19T04:28:12.285602+0000","last_fullsized":"2024-04-19T04:28:12.285602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:08:59.450805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286896+0000","last_change":"2024-04-19T04:28:02.845918+0000","last_active":"2024-04-19T04:28:12.286896+0000","last_peered":"2024-04-19T04:28:12.286896+0000","last_clean":"2024-04-19T04:28:12.286896+0000","last_became_active":"2024-04-19T04:28:02.844483+0000","last_became_peered":"2024-04-19T04:28:02.844483+0000","last_unstale":"2024-04-19T04:28:12.286896+0000","last_undegraded":"2024-04-19T04:28:12.286896+0000","last_fullsized":"2024-04-19T04:28:12.286896+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:33:18.588838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080894+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:28:12.080894+0000","last_peered":"2024-04-19T04:28:12.080894+0000","last_clean":"2024-04-19T04:28:12.080894+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:28:12.080894+0000","last_undegraded":"2024-04-19T04:28:12.080894+0000","last_fullsized":"2024-04-19T04:28:12.080894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:45.574813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094276+0000","last_change":"2024-04-19T04:28:12.091443+0000","last_active":"2024-04-19T04:28:12.094276+0000","last_peered":"2024-04-19T04:28:12.094276+0000","last_clean":"2024-04-19T04:28:12.094276+0000","last_became_active":"2024-04-19T04:28:12.088123+0000","last_became_peered":"2024-04-19T04:28:12.088123+0000","last_unstale":"2024-04-19T04:28:12.094276+0000","last_undegraded":"2024-04-19T04:28:12.094276+0000","last_fullsized":"2024-04-19T04:28:12.094276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:46.736712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079124+0000","last_change":"2024-04-19T04:24:20.555406+0000","last_active":"2024-04-19T04:28:12.079124+0000","last_peered":"2024-04-19T04:28:12.079124+0000","last_clean":"2024-04-19T04:28:12.079124+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:28:12.079124+0000","last_undegraded":"2024-04-19T04:28:12.079124+0000","last_fullsized":"2024-04-19T04:28:12.079124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:10.453970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079781+0000","last_change":"2024-04-19T04:24:20.185978+0000","last_active":"2024-04-19T04:28:12.079781+0000","last_peered":"2024-04-19T04:28:12.079781+0000","last_clean":"2024-04-19T04:28:12.079781+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:28:12.079781+0000","last_undegraded":"2024-04-19T04:28:12.079781+0000","last_fullsized":"2024-04-19T04:28:12.079781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:48.158805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286910+0000","last_change":"2024-04-19T04:28:02.842249+0000","last_active":"2024-04-19T04:28:12.286910+0000","last_peered":"2024-04-19T04:28:12.286910+0000","last_clean":"2024-04-19T04:28:12.286910+0000","last_became_active":"2024-04-19T04:28:02.841373+0000","last_became_peered":"2024-04-19T04:28:02.841373+0000","last_unstale":"2024-04-19T04:28:12.286910+0000","last_undegraded":"2024-04-19T04:28:12.286910+0000","last_fullsized":"2024-04-19T04:28:12.286910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.571164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.097713+0000","last_change":"2024-04-19T04:28:12.094542+0000","last_active":"2024-04-19T04:28:12.097713+0000","last_peered":"2024-04-19T04:28:12.097713+0000","last_clean":"2024-04-19T04:28:12.097713+0000","last_became_active":"2024-04-19T04:28:12.092784+0000","last_became_peered":"2024-04-19T04:28:12.092784+0000","last_unstale":"2024-04-19T04:28:12.097713+0000","last_undegraded":"2024-04-19T04:28:12.097713+0000","last_fullsized":"2024-04-19T04:28:12.097713+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:49.750510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080472+0000","last_change":"2024-04-19T04:28:02.638882+0000","last_active":"2024-04-19T04:28:12.080472+0000","last_peered":"2024-04-19T04:28:12.080472+0000","last_clean":"2024-04-19T04:28:12.080472+0000","last_became_active":"2024-04-19T04:28:02.638431+0000","last_became_peered":"2024-04-19T04:28:02.638431+0000","last_unstale":"2024-04-19T04:28:12.080472+0000","last_undegraded":"2024-04-19T04:28:12.080472+0000","last_fullsized":"2024-04-19T04:28:12.080472+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:32.548608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285755+0000","last_change":"2024-04-19T04:28:02.841112+0000","last_active":"2024-04-19T04:28:12.285755+0000","last_peered":"2024-04-19T04:28:12.285755+0000","last_clean":"2024-04-19T04:28:12.285755+0000","last_became_active":"2024-04-19T04:28:02.838354+0000","last_became_peered":"2024-04-19T04:28:02.838354+0000","last_unstale":"2024-04-19T04:28:12.285755+0000","last_undegraded":"2024-04-19T04:28:12.285755+0000","last_fullsized":"2024-04-19T04:28:12.285755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:44:35.127227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287919+0000","last_change":"2024-04-19T04:28:02.838446+0000","last_active":"2024-04-19T04:28:12.287919+0000","last_peered":"2024-04-19T04:28:12.287919+0000","last_clean":"2024-04-19T04:28:12.287919+0000","last_became_active":"2024-04-19T04:28:02.837994+0000","last_became_peered":"2024-04-19T04:28:02.837994+0000","last_unstale":"2024-04-19T04:28:12.287919+0000","last_undegraded":"2024-04-19T04:28:12.287919+0000","last_fullsized":"2024-04-19T04:28:12.287919+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:01:07.160911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285381+0000","last_change":"2024-04-19T04:28:02.837195+0000","last_active":"2024-04-19T04:28:12.285381+0000","last_peered":"2024-04-19T04:28:12.285381+0000","last_clean":"2024-04-19T04:28:12.285381+0000","last_became_active":"2024-04-19T04:28:02.836818+0000","last_became_peered":"2024-04-19T04:28:02.836818+0000","last_unstale":"2024-04-19T04:28:12.285381+0000","last_undegraded":"2024-04-19T04:28:12.285381+0000","last_fullsized":"2024-04-19T04:28:12.285381+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:10:12.924030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":69,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.085505+0000","last_change":"2024-04-19T04:24:20.552644+0000","last_active":"2024-04-19T04:28:11.085505+0000","last_peered":"2024-04-19T04:28:11.085505+0000","last_clean":"2024-04-19T04:28:11.085505+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:28:11.085505+0000","last_undegraded":"2024-04-19T04:28:11.085505+0000","last_fullsized":"2024-04-19T04:28:11.085505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285114+0000","last_change":"2024-04-19T04:28:02.839065+0000","last_active":"2024-04-19T04:28:12.285114+0000","last_peered":"2024-04-19T04:28:12.285114+0000","last_clean":"2024-04-19T04:28:12.285114+0000","last_became_active":"2024-04-19T04:28:02.837400+0000","last_became_peered":"2024-04-19T04:28:02.837400+0000","last_unstale":"2024-04-19T04:28:12.285114+0000","last_undegraded":"2024-04-19T04:28:12.285114+0000","last_fullsized":"2024-04-19T04:28:12.285114+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:05:54.339418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287287+0000","last_change":"2024-04-19T04:28:02.845777+0000","last_active":"2024-04-19T04:28:12.287287+0000","last_peered":"2024-04-19T04:28:12.287287+0000","last_clean":"2024-04-19T04:28:12.287287+0000","last_became_active":"2024-04-19T04:28:02.844057+0000","last_became_peered":"2024-04-19T04:28:02.844057+0000","last_unstale":"2024-04-19T04:28:12.287287+0000","last_undegraded":"2024-04-19T04:28:12.287287+0000","last_fullsized":"2024-04-19T04:28:12.287287+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:47:53.420459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285255+0000","last_change":"2024-04-19T04:28:02.837131+0000","last_active":"2024-04-19T04:28:12.285255+0000","last_peered":"2024-04-19T04:28:12.285255+0000","last_clean":"2024-04-19T04:28:12.285255+0000","last_became_active":"2024-04-19T04:28:02.836492+0000","last_became_peered":"2024-04-19T04:28:02.836492+0000","last_unstale":"2024-04-19T04:28:12.285255+0000","last_undegraded":"2024-04-19T04:28:12.285255+0000","last_fullsized":"2024-04-19T04:28:12.285255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:02.952851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.100279+0000","last_change":"2024-04-19T04:28:12.095836+0000","last_active":"2024-04-19T04:28:12.100279+0000","last_peered":"2024-04-19T04:28:12.100279+0000","last_clean":"2024-04-19T04:28:12.100279+0000","last_became_active":"2024-04-19T04:28:12.095332+0000","last_became_peered":"2024-04-19T04:28:12.095332+0000","last_unstale":"2024-04-19T04:28:12.100279+0000","last_undegraded":"2024-04-19T04:28:12.100279+0000","last_fullsized":"2024-04-19T04:28:12.100279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:43:51.926940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.092977+0000","last_change":"2024-04-19T04:28:12.092977+0000","last_active":"2024-04-19T04:28:12.092977+0000","last_peered":"2024-04-19T04:28:12.092977+0000","last_clean":"2024-04-19T04:28:12.092977+0000","last_became_active":"2024-04-19T04:28:12.090262+0000","last_became_peered":"2024-04-19T04:28:12.090262+0000","last_unstale":"2024-04-19T04:28:12.092977+0000","last_undegraded":"2024-04-19T04:28:12.092977+0000","last_fullsized":"2024-04-19T04:28:12.092977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:39.131554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093601+0000","last_change":"2024-04-19T04:28:12.093601+0000","last_active":"2024-04-19T04:28:12.093601+0000","last_peered":"2024-04-19T04:28:12.093601+0000","last_clean":"2024-04-19T04:28:12.093601+0000","last_became_active":"2024-04-19T04:28:12.092979+0000","last_became_peered":"2024-04-19T04:28:12.092979+0000","last_unstale":"2024-04-19T04:28:12.093601+0000","last_undegraded":"2024-04-19T04:28:12.093601+0000","last_fullsized":"2024-04-19T04:28:12.093601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:28:58.381121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.097695+0000","last_change":"2024-04-19T04:28:12.094560+0000","last_active":"2024-04-19T04:28:12.097695+0000","last_peered":"2024-04-19T04:28:12.097695+0000","last_clean":"2024-04-19T04:28:12.097695+0000","last_became_active":"2024-04-19T04:28:12.093915+0000","last_became_peered":"2024-04-19T04:28:12.093915+0000","last_unstale":"2024-04-19T04:28:12.097695+0000","last_undegraded":"2024-04-19T04:28:12.097695+0000","last_fullsized":"2024-04-19T04:28:12.097695+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:11:26.070147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078961+0000","last_change":"2024-04-19T04:28:02.639054+0000","last_active":"2024-04-19T04:28:12.078961+0000","last_peered":"2024-04-19T04:28:12.078961+0000","last_clean":"2024-04-19T04:28:12.078961+0000","last_became_active":"2024-04-19T04:28:02.637952+0000","last_became_peered":"2024-04-19T04:28:02.637952+0000","last_unstale":"2024-04-19T04:28:12.078961+0000","last_undegraded":"2024-04-19T04:28:12.078961+0000","last_fullsized":"2024-04-19T04:28:12.078961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:00:22.017021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":87,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079496+0000","last_change":"2024-04-19T04:28:02.635226+0000","last_active":"2024-04-19T04:28:12.079496+0000","last_peered":"2024-04-19T04:28:12.079496+0000","last_clean":"2024-04-19T04:28:12.079496+0000","last_became_active":"2024-04-19T04:28:02.634226+0000","last_became_peered":"2024-04-19T04:28:02.634226+0000","last_unstale":"2024-04-19T04:28:12.079496+0000","last_undegraded":"2024-04-19T04:28:12.079496+0000","last_fullsized":"2024-04-19T04:28:12.079496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:07.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079565+0000","last_change":"2024-04-19T04:28:02.636657+0000","last_active":"2024-04-19T04:28:12.079565+0000","last_peered":"2024-04-19T04:28:12.079565+0000","last_clean":"2024-04-19T04:28:12.079565+0000","last_became_active":"2024-04-19T04:28:02.636266+0000","last_became_peered":"2024-04-19T04:28:02.636266+0000","last_unstale":"2024-04-19T04:28:12.079565+0000","last_undegraded":"2024-04-19T04:28:12.079565+0000","last_fullsized":"2024-04-19T04:28:12.079565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:20:16.458945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.100268+0000","last_change":"2024-04-19T04:28:12.095797+0000","last_active":"2024-04-19T04:28:12.100268+0000","last_peered":"2024-04-19T04:28:12.100268+0000","last_clean":"2024-04-19T04:28:12.100268+0000","last_became_active":"2024-04-19T04:28:12.095199+0000","last_became_peered":"2024-04-19T04:28:12.095199+0000","last_unstale":"2024-04-19T04:28:12.100268+0000","last_undegraded":"2024-04-19T04:28:12.100268+0000","last_fullsized":"2024-04-19T04:28:12.100268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:28.634271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.091303+0000","last_change":"2024-04-19T04:28:12.091303+0000","last_active":"2024-04-19T04:28:12.091303+0000","last_peered":"2024-04-19T04:28:12.091303+0000","last_clean":"2024-04-19T04:28:12.091303+0000","last_became_active":"2024-04-19T04:28:12.087884+0000","last_became_peered":"2024-04-19T04:28:12.087884+0000","last_unstale":"2024-04-19T04:28:12.091303+0000","last_undegraded":"2024-04-19T04:28:12.091303+0000","last_fullsized":"2024-04-19T04:28:12.091303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:01:12.373663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288082+0000","last_change":"2024-04-19T04:28:02.846538+0000","last_active":"2024-04-19T04:28:12.288082+0000","last_peered":"2024-04-19T04:28:12.288082+0000","last_clean":"2024-04-19T04:28:12.288082+0000","last_became_active":"2024-04-19T04:28:02.846234+0000","last_became_peered":"2024-04-19T04:28:02.846234+0000","last_unstale":"2024-04-19T04:28:12.288082+0000","last_undegraded":"2024-04-19T04:28:12.288082+0000","last_fullsized":"2024-04-19T04:28:12.288082+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:08.165785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078454+0000","last_change":"2024-04-19T04:28:02.635122+0000","last_active":"2024-04-19T04:28:12.078454+0000","last_peered":"2024-04-19T04:28:12.078454+0000","last_clean":"2024-04-19T04:28:12.078454+0000","last_became_active":"2024-04-19T04:28:02.634433+0000","last_became_peered":"2024-04-19T04:28:02.634433+0000","last_unstale":"2024-04-19T04:28:12.078454+0000","last_undegraded":"2024-04-19T04:28:12.078454+0000","last_fullsized":"2024-04-19T04:28:12.078454+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:40.139486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288286+0000","last_change":"2024-04-19T04:28:02.844897+0000","last_active":"2024-04-19T04:28:12.288286+0000","last_peered":"2024-04-19T04:28:12.288286+0000","last_clean":"2024-04-19T04:28:12.288286+0000","last_became_active":"2024-04-19T04:28:02.844276+0000","last_became_peered":"2024-04-19T04:28:02.844276+0000","last_unstale":"2024-04-19T04:28:12.288286+0000","last_undegraded":"2024-04-19T04:28:12.288286+0000","last_fullsized":"2024-04-19T04:28:12.288286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:45.100544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705718,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220712,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151128,"statfs":{"total":96636764160,"available":96410755072,"internally_reserved":0,"allocated":937984,"data_stored":922026,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 04:27:10 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.65400000000000003,"15min":0.76500000000000001},"min":{"1min":0.218,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.82599999999999996,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.55500000000000005,"15min":0.59099999999999997},"min":{"1min":0.26000000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.81599999999999995,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.77600000000000002}]},{"osd":1,"last update":"Fri Apr 19 04:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":5.1989999999999998,"5min":5.1989999999999998,"15min":5.1989999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":0.85199999999999998}]}]},{"osd":1,"up_from":72,"seq":309237645317,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44128,"kb_used_data":844,"kb_used_omap":6,"kb_used_meta":43257,"kb_avail":94327712,"statfs":{"total":96636764160,"available":96591577088,"internally_reserved":0,"allocated":864256,"data_stored":334760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6880,"internal_metadata":44295456},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705718,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298668,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297726,"kb_avail":94073172,"statfs":{"total":96636764160,"available":96330928128,"internally_reserved":0,"allocated":950272,"data_stored":924740,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":304871878},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 04:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.68799999999999994}]},{"osd":2,"last update":"Fri Apr 19 04:27:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.23899999999999999,"5min":0.223,"15min":0.223},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.69999999999999996,"15min":0.80300000000000005},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.81799999999999995,"5min":4.5,"15min":4.5},"last":0.77900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:28:17.308 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-19T04:28:17.309 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:28:17.623 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:28:17.625 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:28:17.637 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-04-19T04:28:16.986496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":563508,"kb_used_data":2688,"kb_used_omap":9,"kb_used_meta":560758,"kb_avail":282552012,"statfs":{"total":289910292480,"available":289333260288,"internally_reserved":0,"allocated":2752512,"data_stored":2181526,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":10068,"internal_metadata":574216364},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002347"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093601+0000","last_change":"2024-04-19T04:28:12.093601+0000","last_active":"2024-04-19T04:28:12.093601+0000","last_peered":"2024-04-19T04:28:12.093601+0000","last_clean":"2024-04-19T04:28:12.093601+0000","last_became_active":"2024-04-19T04:28:12.093175+0000","last_became_peered":"2024-04-19T04:28:12.093175+0000","last_unstale":"2024-04-19T04:28:12.093601+0000","last_undegraded":"2024-04-19T04:28:12.093601+0000","last_fullsized":"2024-04-19T04:28:12.093601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:53:38.070519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093573+0000","last_change":"2024-04-19T04:28:12.093573+0000","last_active":"2024-04-19T04:28:12.093573+0000","last_peered":"2024-04-19T04:28:12.093573+0000","last_clean":"2024-04-19T04:28:12.093573+0000","last_became_active":"2024-04-19T04:28:12.092819+0000","last_became_peered":"2024-04-19T04:28:12.092819+0000","last_unstale":"2024-04-19T04:28:12.093573+0000","last_undegraded":"2024-04-19T04:28:12.093573+0000","last_fullsized":"2024-04-19T04:28:12.093573+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:14.577765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079707+0000","last_change":"2024-04-19T04:24:20.556199+0000","last_active":"2024-04-19T04:28:12.079707+0000","last_peered":"2024-04-19T04:28:12.079707+0000","last_clean":"2024-04-19T04:28:12.079707+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:28:12.079707+0000","last_undegraded":"2024-04-19T04:28:12.079707+0000","last_fullsized":"2024-04-19T04:28:12.079707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:14.348910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078925+0000","last_change":"2024-04-19T04:28:02.635437+0000","last_active":"2024-04-19T04:28:12.078925+0000","last_peered":"2024-04-19T04:28:12.078925+0000","last_clean":"2024-04-19T04:28:12.078925+0000","last_became_active":"2024-04-19T04:28:02.634355+0000","last_became_peered":"2024-04-19T04:28:02.634355+0000","last_unstale":"2024-04-19T04:28:12.078925+0000","last_undegraded":"2024-04-19T04:28:12.078925+0000","last_fullsized":"2024-04-19T04:28:12.078925+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:39.534000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.090282+0000","last_change":"2024-04-19T04:28:12.090282+0000","last_active":"2024-04-19T04:28:12.090282+0000","last_peered":"2024-04-19T04:28:12.090282+0000","last_clean":"2024-04-19T04:28:12.090282+0000","last_became_active":"2024-04-19T04:28:12.088231+0000","last_became_peered":"2024-04-19T04:28:12.088231+0000","last_unstale":"2024-04-19T04:28:12.090282+0000","last_undegraded":"2024-04-19T04:28:12.090282+0000","last_fullsized":"2024-04-19T04:28:12.090282+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:48:51.512556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078586+0000","last_change":"2024-04-19T04:28:02.637742+0000","last_active":"2024-04-19T04:28:12.078586+0000","last_peered":"2024-04-19T04:28:12.078586+0000","last_clean":"2024-04-19T04:28:12.078586+0000","last_became_active":"2024-04-19T04:28:02.637276+0000","last_became_peered":"2024-04-19T04:28:02.637276+0000","last_unstale":"2024-04-19T04:28:12.078586+0000","last_undegraded":"2024-04-19T04:28:12.078586+0000","last_fullsized":"2024-04-19T04:28:12.078586+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:06.971707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078374+0000","last_change":"2024-04-19T04:28:02.637532+0000","last_active":"2024-04-19T04:28:12.078374+0000","last_peered":"2024-04-19T04:28:12.078374+0000","last_clean":"2024-04-19T04:28:12.078374+0000","last_became_active":"2024-04-19T04:28:02.637086+0000","last_became_peered":"2024-04-19T04:28:02.637086+0000","last_unstale":"2024-04-19T04:28:12.078374+0000","last_undegraded":"2024-04-19T04:28:12.078374+0000","last_fullsized":"2024-04-19T04:28:12.078374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:40:05.423094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.077959+0000","last_change":"2024-04-19T04:28:02.638186+0000","last_active":"2024-04-19T04:28:12.077959+0000","last_peered":"2024-04-19T04:28:12.077959+0000","last_clean":"2024-04-19T04:28:12.077959+0000","last_became_active":"2024-04-19T04:28:02.637746+0000","last_became_peered":"2024-04-19T04:28:02.637746+0000","last_unstale":"2024-04-19T04:28:12.077959+0000","last_undegraded":"2024-04-19T04:28:12.077959+0000","last_fullsized":"2024-04-19T04:28:12.077959+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:50.758441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287710+0000","last_change":"2024-04-19T04:28:02.842455+0000","last_active":"2024-04-19T04:28:12.287710+0000","last_peered":"2024-04-19T04:28:12.287710+0000","last_clean":"2024-04-19T04:28:12.287710+0000","last_became_active":"2024-04-19T04:28:02.839203+0000","last_became_peered":"2024-04-19T04:28:02.839203+0000","last_unstale":"2024-04-19T04:28:12.287710+0000","last_undegraded":"2024-04-19T04:28:12.287710+0000","last_fullsized":"2024-04-19T04:28:12.287710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:18:44.252505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093403+0000","last_change":"2024-04-19T04:28:12.093403+0000","last_active":"2024-04-19T04:28:12.093403+0000","last_peered":"2024-04-19T04:28:12.093403+0000","last_clean":"2024-04-19T04:28:12.093403+0000","last_became_active":"2024-04-19T04:28:12.092924+0000","last_became_peered":"2024-04-19T04:28:12.092924+0000","last_unstale":"2024-04-19T04:28:12.093403+0000","last_undegraded":"2024-04-19T04:28:12.093403+0000","last_fullsized":"2024-04-19T04:28:12.093403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:56.871317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079800+0000","last_change":"2024-04-19T04:28:02.636293+0000","last_active":"2024-04-19T04:28:12.079800+0000","last_peered":"2024-04-19T04:28:12.079800+0000","last_clean":"2024-04-19T04:28:12.079800+0000","last_became_active":"2024-04-19T04:28:02.635946+0000","last_became_peered":"2024-04-19T04:28:02.635946+0000","last_unstale":"2024-04-19T04:28:12.079800+0000","last_undegraded":"2024-04-19T04:28:12.079800+0000","last_fullsized":"2024-04-19T04:28:12.079800+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:42.381196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.100198+0000","last_change":"2024-04-19T04:28:12.095304+0000","last_active":"2024-04-19T04:28:12.100198+0000","last_peered":"2024-04-19T04:28:12.100198+0000","last_clean":"2024-04-19T04:28:12.100198+0000","last_became_active":"2024-04-19T04:28:12.094753+0000","last_became_peered":"2024-04-19T04:28:12.094753+0000","last_unstale":"2024-04-19T04:28:12.100198+0000","last_undegraded":"2024-04-19T04:28:12.100198+0000","last_fullsized":"2024-04-19T04:28:12.100198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:36:03.465294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093953+0000","last_change":"2024-04-19T04:28:12.093953+0000","last_active":"2024-04-19T04:28:12.093953+0000","last_peered":"2024-04-19T04:28:12.093953+0000","last_clean":"2024-04-19T04:28:12.093953+0000","last_became_active":"2024-04-19T04:28:12.093267+0000","last_became_peered":"2024-04-19T04:28:12.093267+0000","last_unstale":"2024-04-19T04:28:12.093953+0000","last_undegraded":"2024-04-19T04:28:12.093953+0000","last_fullsized":"2024-04-19T04:28:12.093953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:14.548542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078930+0000","last_change":"2024-04-19T04:24:20.552690+0000","last_active":"2024-04-19T04:28:12.078930+0000","last_peered":"2024-04-19T04:28:12.078930+0000","last_clean":"2024-04-19T04:28:12.078930+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:28:12.078930+0000","last_undegraded":"2024-04-19T04:28:12.078930+0000","last_fullsized":"2024-04-19T04:28:12.078930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:53:16.890992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078527+0000","last_change":"2024-04-19T04:24:20.551809+0000","last_active":"2024-04-19T04:28:12.078527+0000","last_peered":"2024-04-19T04:28:12.078527+0000","last_clean":"2024-04-19T04:28:12.078527+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:28:12.078527+0000","last_undegraded":"2024-04-19T04:28:12.078527+0000","last_fullsized":"2024-04-19T04:28:12.078527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:43:31.281765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078198+0000","last_change":"2024-04-19T04:28:02.638726+0000","last_active":"2024-04-19T04:28:12.078198+0000","last_peered":"2024-04-19T04:28:12.078198+0000","last_clean":"2024-04-19T04:28:12.078198+0000","last_became_active":"2024-04-19T04:28:02.637920+0000","last_became_peered":"2024-04-19T04:28:02.637920+0000","last_unstale":"2024-04-19T04:28:12.078198+0000","last_undegraded":"2024-04-19T04:28:12.078198+0000","last_fullsized":"2024-04-19T04:28:12.078198+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:23:42.710810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287706+0000","last_change":"2024-04-19T04:28:02.841438+0000","last_active":"2024-04-19T04:28:12.287706+0000","last_peered":"2024-04-19T04:28:12.287706+0000","last_clean":"2024-04-19T04:28:12.287706+0000","last_became_active":"2024-04-19T04:28:02.839071+0000","last_became_peered":"2024-04-19T04:28:02.839071+0000","last_unstale":"2024-04-19T04:28:12.287706+0000","last_undegraded":"2024-04-19T04:28:12.287706+0000","last_fullsized":"2024-04-19T04:28:12.287706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:37:05.846827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":82,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.084946+0000","last_change":"2024-04-19T04:28:02.638587+0000","last_active":"2024-04-19T04:28:11.084946+0000","last_peered":"2024-04-19T04:28:11.084946+0000","last_clean":"2024-04-19T04:28:11.084946+0000","last_became_active":"2024-04-19T04:28:02.638230+0000","last_became_peered":"2024-04-19T04:28:02.638230+0000","last_unstale":"2024-04-19T04:28:11.084946+0000","last_undegraded":"2024-04-19T04:28:11.084946+0000","last_fullsized":"2024-04-19T04:28:11.084946+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:43:23.974591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286685+0000","last_change":"2024-04-19T04:28:02.840423+0000","last_active":"2024-04-19T04:28:12.286685+0000","last_peered":"2024-04-19T04:28:12.286685+0000","last_clean":"2024-04-19T04:28:12.286685+0000","last_became_active":"2024-04-19T04:28:02.839362+0000","last_became_peered":"2024-04-19T04:28:02.839362+0000","last_unstale":"2024-04-19T04:28:12.286685+0000","last_undegraded":"2024-04-19T04:28:12.286685+0000","last_fullsized":"2024-04-19T04:28:12.286685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:24:55.325024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079785+0000","last_change":"2024-04-19T04:28:02.635566+0000","last_active":"2024-04-19T04:28:12.079785+0000","last_peered":"2024-04-19T04:28:12.079785+0000","last_clean":"2024-04-19T04:28:12.079785+0000","last_became_active":"2024-04-19T04:28:02.634835+0000","last_became_peered":"2024-04-19T04:28:02.634835+0000","last_unstale":"2024-04-19T04:28:12.079785+0000","last_undegraded":"2024-04-19T04:28:12.079785+0000","last_fullsized":"2024-04-19T04:28:12.079785+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:04.159997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079199+0000","last_change":"2024-04-19T04:28:02.639259+0000","last_active":"2024-04-19T04:28:12.079199+0000","last_peered":"2024-04-19T04:28:12.079199+0000","last_clean":"2024-04-19T04:28:12.079199+0000","last_became_active":"2024-04-19T04:28:02.638546+0000","last_became_peered":"2024-04-19T04:28:02.638546+0000","last_unstale":"2024-04-19T04:28:12.079199+0000","last_undegraded":"2024-04-19T04:28:12.079199+0000","last_fullsized":"2024-04-19T04:28:12.079199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:47:45.968474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094010+0000","last_change":"2024-04-19T04:28:12.089576+0000","last_active":"2024-04-19T04:28:12.094010+0000","last_peered":"2024-04-19T04:28:12.094010+0000","last_clean":"2024-04-19T04:28:12.094010+0000","last_became_active":"2024-04-19T04:28:12.087571+0000","last_became_peered":"2024-04-19T04:28:12.087571+0000","last_unstale":"2024-04-19T04:28:12.094010+0000","last_undegraded":"2024-04-19T04:28:12.094010+0000","last_fullsized":"2024-04-19T04:28:12.094010+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:42.381196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285546+0000","last_change":"2024-04-19T04:28:02.842994+0000","last_active":"2024-04-19T04:28:12.285546+0000","last_peered":"2024-04-19T04:28:12.285546+0000","last_clean":"2024-04-19T04:28:12.285546+0000","last_became_active":"2024-04-19T04:28:02.840294+0000","last_became_peered":"2024-04-19T04:28:02.840294+0000","last_unstale":"2024-04-19T04:28:12.285546+0000","last_undegraded":"2024-04-19T04:28:12.285546+0000","last_fullsized":"2024-04-19T04:28:12.285546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:26.503064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.090413+0000","last_change":"2024-04-19T04:28:12.090413+0000","last_active":"2024-04-19T04:28:12.090413+0000","last_peered":"2024-04-19T04:28:12.090413+0000","last_clean":"2024-04-19T04:28:12.090413+0000","last_became_active":"2024-04-19T04:28:12.089918+0000","last_became_peered":"2024-04-19T04:28:12.089918+0000","last_unstale":"2024-04-19T04:28:12.090413+0000","last_undegraded":"2024-04-19T04:28:12.090413+0000","last_fullsized":"2024-04-19T04:28:12.090413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:08.501081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095501+0000","last_change":"2024-04-19T04:28:12.092733+0000","last_active":"2024-04-19T04:28:12.095501+0000","last_peered":"2024-04-19T04:28:12.095501+0000","last_clean":"2024-04-19T04:28:12.095501+0000","last_became_active":"2024-04-19T04:28:12.091770+0000","last_became_peered":"2024-04-19T04:28:12.091770+0000","last_unstale":"2024-04-19T04:28:12.095501+0000","last_undegraded":"2024-04-19T04:28:12.095501+0000","last_fullsized":"2024-04-19T04:28:12.095501+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:39:38.261503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287546+0000","last_change":"2024-04-19T04:28:02.846092+0000","last_active":"2024-04-19T04:28:12.287546+0000","last_peered":"2024-04-19T04:28:12.287546+0000","last_clean":"2024-04-19T04:28:12.287546+0000","last_became_active":"2024-04-19T04:28:02.845416+0000","last_became_peered":"2024-04-19T04:28:02.845416+0000","last_unstale":"2024-04-19T04:28:12.287546+0000","last_undegraded":"2024-04-19T04:28:12.287546+0000","last_fullsized":"2024-04-19T04:28:12.287546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:23.517160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079927+0000","last_change":"2024-04-19T04:24:20.554885+0000","last_active":"2024-04-19T04:28:12.079927+0000","last_peered":"2024-04-19T04:28:12.079927+0000","last_clean":"2024-04-19T04:28:12.079927+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:28:12.079927+0000","last_undegraded":"2024-04-19T04:28:12.079927+0000","last_fullsized":"2024-04-19T04:28:12.079927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:44:08.285518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095487+0000","last_change":"2024-04-19T04:28:12.092936+0000","last_active":"2024-04-19T04:28:12.095487+0000","last_peered":"2024-04-19T04:28:12.095487+0000","last_clean":"2024-04-19T04:28:12.095487+0000","last_became_active":"2024-04-19T04:28:12.091969+0000","last_became_peered":"2024-04-19T04:28:12.091969+0000","last_unstale":"2024-04-19T04:28:12.095487+0000","last_undegraded":"2024-04-19T04:28:12.095487+0000","last_fullsized":"2024-04-19T04:28:12.095487+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:20.569368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285809+0000","last_change":"2024-04-19T04:28:02.845150+0000","last_active":"2024-04-19T04:28:12.285809+0000","last_peered":"2024-04-19T04:28:12.285809+0000","last_clean":"2024-04-19T04:28:12.285809+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:28:12.285809+0000","last_undegraded":"2024-04-19T04:28:12.285809+0000","last_fullsized":"2024-04-19T04:28:12.285809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:27:04.257043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":69,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.075220+0000","last_change":"2024-04-19T04:24:20.554847+0000","last_active":"2024-04-19T04:28:11.075220+0000","last_peered":"2024-04-19T04:28:11.075220+0000","last_clean":"2024-04-19T04:28:11.075220+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:28:11.075220+0000","last_undegraded":"2024-04-19T04:28:11.075220+0000","last_fullsized":"2024-04-19T04:28:11.075220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:00.475711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286101+0000","last_change":"2024-04-19T04:28:02.843590+0000","last_active":"2024-04-19T04:28:12.286101+0000","last_peered":"2024-04-19T04:28:12.286101+0000","last_clean":"2024-04-19T04:28:12.286101+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:28:12.286101+0000","last_undegraded":"2024-04-19T04:28:12.286101+0000","last_fullsized":"2024-04-19T04:28:12.286101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:02.147016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078180+0000","last_change":"2024-04-19T04:28:02.635119+0000","last_active":"2024-04-19T04:28:12.078180+0000","last_peered":"2024-04-19T04:28:12.078180+0000","last_clean":"2024-04-19T04:28:12.078180+0000","last_became_active":"2024-04-19T04:28:02.634586+0000","last_became_peered":"2024-04-19T04:28:02.634586+0000","last_unstale":"2024-04-19T04:28:12.078180+0000","last_undegraded":"2024-04-19T04:28:12.078180+0000","last_fullsized":"2024-04-19T04:28:12.078180+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:08.719606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095305+0000","last_change":"2024-04-19T04:28:12.095305+0000","last_active":"2024-04-19T04:28:12.095305+0000","last_peered":"2024-04-19T04:28:12.095305+0000","last_clean":"2024-04-19T04:28:12.095305+0000","last_became_active":"2024-04-19T04:28:12.094558+0000","last_became_peered":"2024-04-19T04:28:12.094558+0000","last_unstale":"2024-04-19T04:28:12.095305+0000","last_undegraded":"2024-04-19T04:28:12.095305+0000","last_fullsized":"2024-04-19T04:28:12.095305+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:44:45.647590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":87,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079450+0000","last_change":"2024-04-19T04:28:02.639581+0000","last_active":"2024-04-19T04:28:12.079450+0000","last_peered":"2024-04-19T04:28:12.079450+0000","last_clean":"2024-04-19T04:28:12.079450+0000","last_became_active":"2024-04-19T04:28:02.638666+0000","last_became_peered":"2024-04-19T04:28:02.638666+0000","last_unstale":"2024-04-19T04:28:12.079450+0000","last_undegraded":"2024-04-19T04:28:12.079450+0000","last_fullsized":"2024-04-19T04:28:12.079450+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:42:54.107998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095631+0000","last_change":"2024-04-19T04:28:12.095631+0000","last_active":"2024-04-19T04:28:12.095631+0000","last_peered":"2024-04-19T04:28:12.095631+0000","last_clean":"2024-04-19T04:28:12.095631+0000","last_became_active":"2024-04-19T04:28:12.094722+0000","last_became_peered":"2024-04-19T04:28:12.094722+0000","last_unstale":"2024-04-19T04:28:12.095631+0000","last_undegraded":"2024-04-19T04:28:12.095631+0000","last_fullsized":"2024-04-19T04:28:12.095631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:31.378691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287127+0000","last_change":"2024-04-19T04:28:02.843299+0000","last_active":"2024-04-19T04:28:12.287127+0000","last_peered":"2024-04-19T04:28:12.287127+0000","last_clean":"2024-04-19T04:28:12.287127+0000","last_became_active":"2024-04-19T04:28:02.842525+0000","last_became_peered":"2024-04-19T04:28:02.842525+0000","last_unstale":"2024-04-19T04:28:12.287127+0000","last_undegraded":"2024-04-19T04:28:12.287127+0000","last_fullsized":"2024-04-19T04:28:12.287127+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:10:33.303473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287136+0000","last_change":"2024-04-19T04:28:02.845685+0000","last_active":"2024-04-19T04:28:12.287136+0000","last_peered":"2024-04-19T04:28:12.287136+0000","last_clean":"2024-04-19T04:28:12.287136+0000","last_became_active":"2024-04-19T04:28:02.843099+0000","last_became_peered":"2024-04-19T04:28:02.843099+0000","last_unstale":"2024-04-19T04:28:12.287136+0000","last_undegraded":"2024-04-19T04:28:12.287136+0000","last_fullsized":"2024-04-19T04:28:12.287136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:25:05.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095287+0000","last_change":"2024-04-19T04:28:12.092744+0000","last_active":"2024-04-19T04:28:12.095287+0000","last_peered":"2024-04-19T04:28:12.095287+0000","last_clean":"2024-04-19T04:28:12.095287+0000","last_became_active":"2024-04-19T04:28:12.091771+0000","last_became_peered":"2024-04-19T04:28:12.091771+0000","last_unstale":"2024-04-19T04:28:12.095287+0000","last_undegraded":"2024-04-19T04:28:12.095287+0000","last_fullsized":"2024-04-19T04:28:12.095287+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:34.728962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287385+0000","last_change":"2024-04-19T04:28:02.837331+0000","last_active":"2024-04-19T04:28:12.287385+0000","last_peered":"2024-04-19T04:28:12.287385+0000","last_clean":"2024-04-19T04:28:12.287385+0000","last_became_active":"2024-04-19T04:28:02.836984+0000","last_became_peered":"2024-04-19T04:28:02.836984+0000","last_unstale":"2024-04-19T04:28:12.287385+0000","last_undegraded":"2024-04-19T04:28:12.287385+0000","last_fullsized":"2024-04-19T04:28:12.287385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:11.858503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":80,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078519+0000","last_change":"2024-04-19T04:24:20.187299+0000","last_active":"2024-04-19T04:28:12.078519+0000","last_peered":"2024-04-19T04:28:12.078519+0000","last_clean":"2024-04-19T04:28:12.078519+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:28:12.078519+0000","last_undegraded":"2024-04-19T04:28:12.078519+0000","last_fullsized":"2024-04-19T04:28:12.078519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:49:37.812125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":73,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080835+0000","last_change":"2024-04-19T04:24:20.186029+0000","last_active":"2024-04-19T04:28:12.080835+0000","last_peered":"2024-04-19T04:28:12.080835+0000","last_clean":"2024-04-19T04:28:12.080835+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:28:12.080835+0000","last_undegraded":"2024-04-19T04:28:12.080835+0000","last_fullsized":"2024-04-19T04:28:12.080835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:49.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095216+0000","last_change":"2024-04-19T04:28:12.092118+0000","last_active":"2024-04-19T04:28:12.095216+0000","last_peered":"2024-04-19T04:28:12.095216+0000","last_clean":"2024-04-19T04:28:12.095216+0000","last_became_active":"2024-04-19T04:28:12.090379+0000","last_became_peered":"2024-04-19T04:28:12.090379+0000","last_unstale":"2024-04-19T04:28:12.095216+0000","last_undegraded":"2024-04-19T04:28:12.095216+0000","last_fullsized":"2024-04-19T04:28:12.095216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:38.494787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094285+0000","last_change":"2024-04-19T04:28:12.090491+0000","last_active":"2024-04-19T04:28:12.094285+0000","last_peered":"2024-04-19T04:28:12.094285+0000","last_clean":"2024-04-19T04:28:12.094285+0000","last_became_active":"2024-04-19T04:28:12.089948+0000","last_became_peered":"2024-04-19T04:28:12.089948+0000","last_unstale":"2024-04-19T04:28:12.094285+0000","last_undegraded":"2024-04-19T04:28:12.094285+0000","last_fullsized":"2024-04-19T04:28:12.094285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:04:35.343697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093574+0000","last_change":"2024-04-19T04:28:12.093574+0000","last_active":"2024-04-19T04:28:12.093574+0000","last_peered":"2024-04-19T04:28:12.093574+0000","last_clean":"2024-04-19T04:28:12.093574+0000","last_became_active":"2024-04-19T04:28:12.093090+0000","last_became_peered":"2024-04-19T04:28:12.093090+0000","last_unstale":"2024-04-19T04:28:12.093574+0000","last_undegraded":"2024-04-19T04:28:12.093574+0000","last_fullsized":"2024-04-19T04:28:12.093574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:32:01.796620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":73,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080387+0000","last_change":"2024-04-19T04:24:20.186044+0000","last_active":"2024-04-19T04:28:12.080387+0000","last_peered":"2024-04-19T04:28:12.080387+0000","last_clean":"2024-04-19T04:28:12.080387+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:28:12.080387+0000","last_undegraded":"2024-04-19T04:28:12.080387+0000","last_fullsized":"2024-04-19T04:28:12.080387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.432692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079351+0000","last_change":"2024-04-19T04:28:02.636589+0000","last_active":"2024-04-19T04:28:12.079351+0000","last_peered":"2024-04-19T04:28:12.079351+0000","last_clean":"2024-04-19T04:28:12.079351+0000","last_became_active":"2024-04-19T04:28:02.636231+0000","last_became_peered":"2024-04-19T04:28:02.636231+0000","last_unstale":"2024-04-19T04:28:12.079351+0000","last_undegraded":"2024-04-19T04:28:12.079351+0000","last_fullsized":"2024-04-19T04:28:12.079351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:25:32.636485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080045+0000","last_change":"2024-04-19T04:28:02.635650+0000","last_active":"2024-04-19T04:28:12.080045+0000","last_peered":"2024-04-19T04:28:12.080045+0000","last_clean":"2024-04-19T04:28:12.080045+0000","last_became_active":"2024-04-19T04:28:02.634823+0000","last_became_peered":"2024-04-19T04:28:02.634823+0000","last_unstale":"2024-04-19T04:28:12.080045+0000","last_undegraded":"2024-04-19T04:28:12.080045+0000","last_fullsized":"2024-04-19T04:28:12.080045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:37.205733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287721+0000","last_change":"2024-04-19T04:28:02.845805+0000","last_active":"2024-04-19T04:28:12.287721+0000","last_peered":"2024-04-19T04:28:12.287721+0000","last_clean":"2024-04-19T04:28:12.287721+0000","last_became_active":"2024-04-19T04:28:02.845461+0000","last_became_peered":"2024-04-19T04:28:02.845461+0000","last_unstale":"2024-04-19T04:28:12.287721+0000","last_undegraded":"2024-04-19T04:28:12.287721+0000","last_fullsized":"2024-04-19T04:28:12.287721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:57:44.161931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287443+0000","last_change":"2024-04-19T04:28:02.845613+0000","last_active":"2024-04-19T04:28:12.287443+0000","last_peered":"2024-04-19T04:28:12.287443+0000","last_clean":"2024-04-19T04:28:12.287443+0000","last_became_active":"2024-04-19T04:28:02.844927+0000","last_became_peered":"2024-04-19T04:28:02.844927+0000","last_unstale":"2024-04-19T04:28:12.287443+0000","last_undegraded":"2024-04-19T04:28:12.287443+0000","last_fullsized":"2024-04-19T04:28:12.287443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:59.219663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079185+0000","last_change":"2024-04-19T04:28:02.635751+0000","last_active":"2024-04-19T04:28:12.079185+0000","last_peered":"2024-04-19T04:28:12.079185+0000","last_clean":"2024-04-19T04:28:12.079185+0000","last_became_active":"2024-04-19T04:28:02.635238+0000","last_became_peered":"2024-04-19T04:28:02.635238+0000","last_unstale":"2024-04-19T04:28:12.079185+0000","last_undegraded":"2024-04-19T04:28:12.079185+0000","last_fullsized":"2024-04-19T04:28:12.079185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:24:14.292299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079943+0000","last_change":"2024-04-19T04:28:02.638055+0000","last_active":"2024-04-19T04:28:12.079943+0000","last_peered":"2024-04-19T04:28:12.079943+0000","last_clean":"2024-04-19T04:28:12.079943+0000","last_became_active":"2024-04-19T04:28:02.637651+0000","last_became_peered":"2024-04-19T04:28:02.637651+0000","last_unstale":"2024-04-19T04:28:12.079943+0000","last_undegraded":"2024-04-19T04:28:12.079943+0000","last_fullsized":"2024-04-19T04:28:12.079943+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:25:55.832256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080143+0000","last_change":"2024-04-19T04:24:20.555922+0000","last_active":"2024-04-19T04:28:12.080143+0000","last_peered":"2024-04-19T04:28:12.080143+0000","last_clean":"2024-04-19T04:28:12.080143+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:28:12.080143+0000","last_undegraded":"2024-04-19T04:28:12.080143+0000","last_fullsized":"2024-04-19T04:28:12.080143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:06:53.595149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":70,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.078809+0000","last_change":"2024-04-19T04:24:20.183944+0000","last_active":"2024-04-19T04:28:11.078809+0000","last_peered":"2024-04-19T04:28:11.078809+0000","last_clean":"2024-04-19T04:28:11.078809+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:28:11.078809+0000","last_undegraded":"2024-04-19T04:28:11.078809+0000","last_fullsized":"2024-04-19T04:28:11.078809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:42.018487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079773+0000","last_change":"2024-04-19T04:24:20.553085+0000","last_active":"2024-04-19T04:28:12.079773+0000","last_peered":"2024-04-19T04:28:12.079773+0000","last_clean":"2024-04-19T04:28:12.079773+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:28:12.079773+0000","last_undegraded":"2024-04-19T04:28:12.079773+0000","last_fullsized":"2024-04-19T04:28:12.079773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:07:21.467758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":67,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.089659+0000","last_change":"2024-04-19T04:28:12.089659+0000","last_active":"2024-04-19T04:28:12.089659+0000","last_peered":"2024-04-19T04:28:12.089659+0000","last_clean":"2024-04-19T04:28:12.089659+0000","last_became_active":"2024-04-19T04:28:12.088043+0000","last_became_peered":"2024-04-19T04:28:12.088043+0000","last_unstale":"2024-04-19T04:28:12.089659+0000","last_undegraded":"2024-04-19T04:28:12.089659+0000","last_fullsized":"2024-04-19T04:28:12.089659+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:02:42.873134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288226+0000","last_change":"2024-04-19T04:28:02.844467+0000","last_active":"2024-04-19T04:28:12.288226+0000","last_peered":"2024-04-19T04:28:12.288226+0000","last_clean":"2024-04-19T04:28:12.288226+0000","last_became_active":"2024-04-19T04:28:02.843639+0000","last_became_peered":"2024-04-19T04:28:02.843639+0000","last_unstale":"2024-04-19T04:28:12.288226+0000","last_undegraded":"2024-04-19T04:28:12.288226+0000","last_fullsized":"2024-04-19T04:28:12.288226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:24.660145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":275,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094355+0000","last_change":"2024-04-19T04:24:10.106278+0000","last_active":"2024-04-19T04:28:13.094355+0000","last_peered":"2024-04-19T04:28:13.094355+0000","last_clean":"2024-04-19T04:28:13.094355+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:28:13.094355+0000","last_undegraded":"2024-04-19T04:28:13.094355+0000","last_fullsized":"2024-04-19T04:28:13.094355+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_clean_scrub_stamp":"2024-04-19T04:24:09.083488+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":88,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079654+0000","last_change":"2024-04-19T04:28:02.639632+0000","last_active":"2024-04-19T04:28:12.079654+0000","last_peered":"2024-04-19T04:28:12.079654+0000","last_clean":"2024-04-19T04:28:12.079654+0000","last_became_active":"2024-04-19T04:28:02.639240+0000","last_became_peered":"2024-04-19T04:28:02.639240+0000","last_unstale":"2024-04-19T04:28:12.079654+0000","last_undegraded":"2024-04-19T04:28:12.079654+0000","last_fullsized":"2024-04-19T04:28:12.079654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:54.035030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287535+0000","last_change":"2024-04-19T04:28:02.842437+0000","last_active":"2024-04-19T04:28:12.287535+0000","last_peered":"2024-04-19T04:28:12.287535+0000","last_clean":"2024-04-19T04:28:12.287535+0000","last_became_active":"2024-04-19T04:28:02.841053+0000","last_became_peered":"2024-04-19T04:28:02.841053+0000","last_unstale":"2024-04-19T04:28:12.287535+0000","last_undegraded":"2024-04-19T04:28:12.287535+0000","last_fullsized":"2024-04-19T04:28:12.287535+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:45.323344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080363+0000","last_change":"2024-04-19T04:24:20.553999+0000","last_active":"2024-04-19T04:28:12.080363+0000","last_peered":"2024-04-19T04:28:12.080363+0000","last_clean":"2024-04-19T04:28:12.080363+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:28:12.080363+0000","last_undegraded":"2024-04-19T04:28:12.080363+0000","last_fullsized":"2024-04-19T04:28:12.080363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:13:53.306369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078665+0000","last_change":"2024-04-19T04:24:16.144482+0000","last_active":"2024-04-19T04:28:12.078665+0000","last_peered":"2024-04-19T04:28:12.078665+0000","last_clean":"2024-04-19T04:28:12.078665+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:28:12.078665+0000","last_undegraded":"2024-04-19T04:28:12.078665+0000","last_fullsized":"2024-04-19T04:28:12.078665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:15.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285234+0000","last_change":"2024-04-19T04:28:02.842303+0000","last_active":"2024-04-19T04:28:12.285234+0000","last_peered":"2024-04-19T04:28:12.285234+0000","last_clean":"2024-04-19T04:28:12.285234+0000","last_became_active":"2024-04-19T04:28:02.839926+0000","last_became_peered":"2024-04-19T04:28:02.839926+0000","last_unstale":"2024-04-19T04:28:12.285234+0000","last_undegraded":"2024-04-19T04:28:12.285234+0000","last_fullsized":"2024-04-19T04:28:12.285234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:13.266751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":82,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.082938+0000","last_change":"2024-04-19T04:28:02.638370+0000","last_active":"2024-04-19T04:28:11.082938+0000","last_peered":"2024-04-19T04:28:11.082938+0000","last_clean":"2024-04-19T04:28:11.082938+0000","last_became_active":"2024-04-19T04:28:02.638095+0000","last_became_peered":"2024-04-19T04:28:02.638095+0000","last_unstale":"2024-04-19T04:28:11.082938+0000","last_undegraded":"2024-04-19T04:28:11.082938+0000","last_fullsized":"2024-04-19T04:28:11.082938+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:16:46.463514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285839+0000","last_change":"2024-04-19T04:28:02.843324+0000","last_active":"2024-04-19T04:28:12.285839+0000","last_peered":"2024-04-19T04:28:12.285839+0000","last_clean":"2024-04-19T04:28:12.285839+0000","last_became_active":"2024-04-19T04:28:02.840328+0000","last_became_peered":"2024-04-19T04:28:02.840328+0000","last_unstale":"2024-04-19T04:28:12.285839+0000","last_undegraded":"2024-04-19T04:28:12.285839+0000","last_fullsized":"2024-04-19T04:28:12.285839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:58:19.389865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.092725+0000","last_change":"2024-04-19T04:28:12.088382+0000","last_active":"2024-04-19T04:28:12.092725+0000","last_peered":"2024-04-19T04:28:12.092725+0000","last_clean":"2024-04-19T04:28:12.092725+0000","last_became_active":"2024-04-19T04:28:12.087575+0000","last_became_peered":"2024-04-19T04:28:12.087575+0000","last_unstale":"2024-04-19T04:28:12.092725+0000","last_undegraded":"2024-04-19T04:28:12.092725+0000","last_fullsized":"2024-04-19T04:28:12.092725+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:13.034157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288155+0000","last_change":"2024-04-19T04:28:02.844076+0000","last_active":"2024-04-19T04:28:12.288155+0000","last_peered":"2024-04-19T04:28:12.288155+0000","last_clean":"2024-04-19T04:28:12.288155+0000","last_became_active":"2024-04-19T04:28:02.840839+0000","last_became_peered":"2024-04-19T04:28:02.840839+0000","last_unstale":"2024-04-19T04:28:12.288155+0000","last_undegraded":"2024-04-19T04:28:12.288155+0000","last_fullsized":"2024-04-19T04:28:12.288155+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:31.891080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":88,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080149+0000","last_change":"2024-04-19T04:28:02.635123+0000","last_active":"2024-04-19T04:28:12.080149+0000","last_peered":"2024-04-19T04:28:12.080149+0000","last_clean":"2024-04-19T04:28:12.080149+0000","last_became_active":"2024-04-19T04:28:02.634633+0000","last_became_peered":"2024-04-19T04:28:02.634633+0000","last_unstale":"2024-04-19T04:28:12.080149+0000","last_undegraded":"2024-04-19T04:28:12.080149+0000","last_fullsized":"2024-04-19T04:28:12.080149+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:47:35.387548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079490+0000","last_change":"2024-04-19T04:28:02.638250+0000","last_active":"2024-04-19T04:28:12.079490+0000","last_peered":"2024-04-19T04:28:12.079490+0000","last_clean":"2024-04-19T04:28:12.079490+0000","last_became_active":"2024-04-19T04:28:02.637233+0000","last_became_peered":"2024-04-19T04:28:02.637233+0000","last_unstale":"2024-04-19T04:28:12.079490+0000","last_undegraded":"2024-04-19T04:28:12.079490+0000","last_fullsized":"2024-04-19T04:28:12.079490+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:53:27.253209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286825+0000","last_change":"2024-04-19T04:28:02.838255+0000","last_active":"2024-04-19T04:28:12.286825+0000","last_peered":"2024-04-19T04:28:12.286825+0000","last_clean":"2024-04-19T04:28:12.286825+0000","last_became_active":"2024-04-19T04:28:02.837829+0000","last_became_peered":"2024-04-19T04:28:02.837829+0000","last_unstale":"2024-04-19T04:28:12.286825+0000","last_undegraded":"2024-04-19T04:28:12.286825+0000","last_fullsized":"2024-04-19T04:28:12.286825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:11:30.005510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080527+0000","last_change":"2024-04-19T04:28:02.636097+0000","last_active":"2024-04-19T04:28:12.080527+0000","last_peered":"2024-04-19T04:28:12.080527+0000","last_clean":"2024-04-19T04:28:12.080527+0000","last_became_active":"2024-04-19T04:28:02.634103+0000","last_became_peered":"2024-04-19T04:28:02.634103+0000","last_unstale":"2024-04-19T04:28:12.080527+0000","last_undegraded":"2024-04-19T04:28:12.080527+0000","last_fullsized":"2024-04-19T04:28:12.080527+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:37.486856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285930+0000","last_change":"2024-04-19T04:28:02.835876+0000","last_active":"2024-04-19T04:28:12.285930+0000","last_peered":"2024-04-19T04:28:12.285930+0000","last_clean":"2024-04-19T04:28:12.285930+0000","last_became_active":"2024-04-19T04:28:02.835057+0000","last_became_peered":"2024-04-19T04:28:02.835057+0000","last_unstale":"2024-04-19T04:28:12.285930+0000","last_undegraded":"2024-04-19T04:28:12.285930+0000","last_fullsized":"2024-04-19T04:28:12.285930+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:18.104384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":69,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.074987+0000","last_change":"2024-04-19T04:24:20.555116+0000","last_active":"2024-04-19T04:28:11.074987+0000","last_peered":"2024-04-19T04:28:11.074987+0000","last_clean":"2024-04-19T04:28:11.074987+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:28:11.074987+0000","last_undegraded":"2024-04-19T04:28:11.074987+0000","last_fullsized":"2024-04-19T04:28:11.074987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:21.734428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286409+0000","last_change":"2024-04-19T04:28:02.840145+0000","last_active":"2024-04-19T04:28:12.286409+0000","last_peered":"2024-04-19T04:28:12.286409+0000","last_clean":"2024-04-19T04:28:12.286409+0000","last_became_active":"2024-04-19T04:28:02.838918+0000","last_became_peered":"2024-04-19T04:28:02.838918+0000","last_unstale":"2024-04-19T04:28:12.286409+0000","last_undegraded":"2024-04-19T04:28:12.286409+0000","last_fullsized":"2024-04-19T04:28:12.286409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:27.667000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.092906+0000","last_change":"2024-04-19T04:28:12.092906+0000","last_active":"2024-04-19T04:28:12.092906+0000","last_peered":"2024-04-19T04:28:12.092906+0000","last_clean":"2024-04-19T04:28:12.092906+0000","last_became_active":"2024-04-19T04:28:12.091609+0000","last_became_peered":"2024-04-19T04:28:12.091609+0000","last_unstale":"2024-04-19T04:28:12.092906+0000","last_undegraded":"2024-04-19T04:28:12.092906+0000","last_fullsized":"2024-04-19T04:28:12.092906+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:42:50.079444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095641+0000","last_change":"2024-04-19T04:28:12.092944+0000","last_active":"2024-04-19T04:28:12.095641+0000","last_peered":"2024-04-19T04:28:12.095641+0000","last_clean":"2024-04-19T04:28:12.095641+0000","last_became_active":"2024-04-19T04:28:12.091335+0000","last_became_peered":"2024-04-19T04:28:12.091335+0000","last_unstale":"2024-04-19T04:28:12.095641+0000","last_undegraded":"2024-04-19T04:28:12.095641+0000","last_fullsized":"2024-04-19T04:28:12.095641+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:39:57.870227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287403+0000","last_change":"2024-04-19T04:28:02.843341+0000","last_active":"2024-04-19T04:28:12.287403+0000","last_peered":"2024-04-19T04:28:12.287403+0000","last_clean":"2024-04-19T04:28:12.287403+0000","last_became_active":"2024-04-19T04:28:02.839883+0000","last_became_peered":"2024-04-19T04:28:02.839883+0000","last_unstale":"2024-04-19T04:28:12.287403+0000","last_undegraded":"2024-04-19T04:28:12.287403+0000","last_fullsized":"2024-04-19T04:28:12.287403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:39:33.503440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286657+0000","last_change":"2024-04-19T04:28:02.845957+0000","last_active":"2024-04-19T04:28:12.286657+0000","last_peered":"2024-04-19T04:28:12.286657+0000","last_clean":"2024-04-19T04:28:12.286657+0000","last_became_active":"2024-04-19T04:28:02.845256+0000","last_became_peered":"2024-04-19T04:28:02.845256+0000","last_unstale":"2024-04-19T04:28:12.286657+0000","last_undegraded":"2024-04-19T04:28:12.286657+0000","last_fullsized":"2024-04-19T04:28:12.286657+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:28:34.674877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285602+0000","last_change":"2024-04-19T04:28:02.845275+0000","last_active":"2024-04-19T04:28:12.285602+0000","last_peered":"2024-04-19T04:28:12.285602+0000","last_clean":"2024-04-19T04:28:12.285602+0000","last_became_active":"2024-04-19T04:28:02.844128+0000","last_became_peered":"2024-04-19T04:28:02.844128+0000","last_unstale":"2024-04-19T04:28:12.285602+0000","last_undegraded":"2024-04-19T04:28:12.285602+0000","last_fullsized":"2024-04-19T04:28:12.285602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:08:59.450805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286896+0000","last_change":"2024-04-19T04:28:02.845918+0000","last_active":"2024-04-19T04:28:12.286896+0000","last_peered":"2024-04-19T04:28:12.286896+0000","last_clean":"2024-04-19T04:28:12.286896+0000","last_became_active":"2024-04-19T04:28:02.844483+0000","last_became_peered":"2024-04-19T04:28:02.844483+0000","last_unstale":"2024-04-19T04:28:12.286896+0000","last_undegraded":"2024-04-19T04:28:12.286896+0000","last_fullsized":"2024-04-19T04:28:12.286896+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:33:18.588838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080894+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:28:12.080894+0000","last_peered":"2024-04-19T04:28:12.080894+0000","last_clean":"2024-04-19T04:28:12.080894+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:28:12.080894+0000","last_undegraded":"2024-04-19T04:28:12.080894+0000","last_fullsized":"2024-04-19T04:28:12.080894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:45.574813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094276+0000","last_change":"2024-04-19T04:28:12.091443+0000","last_active":"2024-04-19T04:28:12.094276+0000","last_peered":"2024-04-19T04:28:12.094276+0000","last_clean":"2024-04-19T04:28:12.094276+0000","last_became_active":"2024-04-19T04:28:12.088123+0000","last_became_peered":"2024-04-19T04:28:12.088123+0000","last_unstale":"2024-04-19T04:28:12.094276+0000","last_undegraded":"2024-04-19T04:28:12.094276+0000","last_fullsized":"2024-04-19T04:28:12.094276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:46.736712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079124+0000","last_change":"2024-04-19T04:24:20.555406+0000","last_active":"2024-04-19T04:28:12.079124+0000","last_peered":"2024-04-19T04:28:12.079124+0000","last_clean":"2024-04-19T04:28:12.079124+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:28:12.079124+0000","last_undegraded":"2024-04-19T04:28:12.079124+0000","last_fullsized":"2024-04-19T04:28:12.079124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:10.453970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079781+0000","last_change":"2024-04-19T04:24:20.185978+0000","last_active":"2024-04-19T04:28:12.079781+0000","last_peered":"2024-04-19T04:28:12.079781+0000","last_clean":"2024-04-19T04:28:12.079781+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:28:12.079781+0000","last_undegraded":"2024-04-19T04:28:12.079781+0000","last_fullsized":"2024-04-19T04:28:12.079781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:48.158805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286910+0000","last_change":"2024-04-19T04:28:02.842249+0000","last_active":"2024-04-19T04:28:12.286910+0000","last_peered":"2024-04-19T04:28:12.286910+0000","last_clean":"2024-04-19T04:28:12.286910+0000","last_became_active":"2024-04-19T04:28:02.841373+0000","last_became_peered":"2024-04-19T04:28:02.841373+0000","last_unstale":"2024-04-19T04:28:12.286910+0000","last_undegraded":"2024-04-19T04:28:12.286910+0000","last_fullsized":"2024-04-19T04:28:12.286910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.571164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.097713+0000","last_change":"2024-04-19T04:28:12.094542+0000","last_active":"2024-04-19T04:28:12.097713+0000","last_peered":"2024-04-19T04:28:12.097713+0000","last_clean":"2024-04-19T04:28:12.097713+0000","last_became_active":"2024-04-19T04:28:12.092784+0000","last_became_peered":"2024-04-19T04:28:12.092784+0000","last_unstale":"2024-04-19T04:28:12.097713+0000","last_undegraded":"2024-04-19T04:28:12.097713+0000","last_fullsized":"2024-04-19T04:28:12.097713+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:49.750510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080472+0000","last_change":"2024-04-19T04:28:02.638882+0000","last_active":"2024-04-19T04:28:12.080472+0000","last_peered":"2024-04-19T04:28:12.080472+0000","last_clean":"2024-04-19T04:28:12.080472+0000","last_became_active":"2024-04-19T04:28:02.638431+0000","last_became_peered":"2024-04-19T04:28:02.638431+0000","last_unstale":"2024-04-19T04:28:12.080472+0000","last_undegraded":"2024-04-19T04:28:12.080472+0000","last_fullsized":"2024-04-19T04:28:12.080472+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:32.548608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285755+0000","last_change":"2024-04-19T04:28:02.841112+0000","last_active":"2024-04-19T04:28:12.285755+0000","last_peered":"2024-04-19T04:28:12.285755+0000","last_clean":"2024-04-19T04:28:12.285755+0000","last_became_active":"2024-04-19T04:28:02.838354+0000","last_became_peered":"2024-04-19T04:28:02.838354+0000","last_unstale":"2024-04-19T04:28:12.285755+0000","last_undegraded":"2024-04-19T04:28:12.285755+0000","last_fullsized":"2024-04-19T04:28:12.285755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:44:35.127227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287919+0000","last_change":"2024-04-19T04:28:02.838446+0000","last_active":"2024-04-19T04:28:12.287919+0000","last_peered":"2024-04-19T04:28:12.287919+0000","last_clean":"2024-04-19T04:28:12.287919+0000","last_became_active":"2024-04-19T04:28:02.837994+0000","last_became_peered":"2024-04-19T04:28:02.837994+0000","last_unstale":"2024-04-19T04:28:12.287919+0000","last_undegraded":"2024-04-19T04:28:12.287919+0000","last_fullsized":"2024-04-19T04:28:12.287919+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:01:07.160911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285381+0000","last_change":"2024-04-19T04:28:02.837195+0000","last_active":"2024-04-19T04:28:12.285381+0000","last_peered":"2024-04-19T04:28:12.285381+0000","last_clean":"2024-04-19T04:28:12.285381+0000","last_became_active":"2024-04-19T04:28:02.836818+0000","last_became_peered":"2024-04-19T04:28:02.836818+0000","last_unstale":"2024-04-19T04:28:12.285381+0000","last_undegraded":"2024-04-19T04:28:12.285381+0000","last_fullsized":"2024-04-19T04:28:12.285381+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:10:12.924030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":69,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-19T04:28:11.085505+0000","last_change":"2024-04-19T04:24:20.552644+0000","last_active":"2024-04-19T04:28:11.085505+0000","last_peered":"2024-04-19T04:28:11.085505+0000","last_clean":"2024-04-19T04:28:11.085505+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:28:11.085505+0000","last_undegraded":"2024-04-19T04:28:11.085505+0000","last_fullsized":"2024-04-19T04:28:11.085505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285114+0000","last_change":"2024-04-19T04:28:02.839065+0000","last_active":"2024-04-19T04:28:12.285114+0000","last_peered":"2024-04-19T04:28:12.285114+0000","last_clean":"2024-04-19T04:28:12.285114+0000","last_became_active":"2024-04-19T04:28:02.837400+0000","last_became_peered":"2024-04-19T04:28:02.837400+0000","last_unstale":"2024-04-19T04:28:12.285114+0000","last_undegraded":"2024-04-19T04:28:12.285114+0000","last_fullsized":"2024-04-19T04:28:12.285114+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:05:54.339418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287287+0000","last_change":"2024-04-19T04:28:02.845777+0000","last_active":"2024-04-19T04:28:12.287287+0000","last_peered":"2024-04-19T04:28:12.287287+0000","last_clean":"2024-04-19T04:28:12.287287+0000","last_became_active":"2024-04-19T04:28:02.844057+0000","last_became_peered":"2024-04-19T04:28:02.844057+0000","last_unstale":"2024-04-19T04:28:12.287287+0000","last_undegraded":"2024-04-19T04:28:12.287287+0000","last_fullsized":"2024-04-19T04:28:12.287287+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:47:53.420459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285255+0000","last_change":"2024-04-19T04:28:02.837131+0000","last_active":"2024-04-19T04:28:12.285255+0000","last_peered":"2024-04-19T04:28:12.285255+0000","last_clean":"2024-04-19T04:28:12.285255+0000","last_became_active":"2024-04-19T04:28:02.836492+0000","last_became_peered":"2024-04-19T04:28:02.836492+0000","last_unstale":"2024-04-19T04:28:12.285255+0000","last_undegraded":"2024-04-19T04:28:12.285255+0000","last_fullsized":"2024-04-19T04:28:12.285255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:02.952851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.100279+0000","last_change":"2024-04-19T04:28:12.095836+0000","last_active":"2024-04-19T04:28:12.100279+0000","last_peered":"2024-04-19T04:28:12.100279+0000","last_clean":"2024-04-19T04:28:12.100279+0000","last_became_active":"2024-04-19T04:28:12.095332+0000","last_became_peered":"2024-04-19T04:28:12.095332+0000","last_unstale":"2024-04-19T04:28:12.100279+0000","last_undegraded":"2024-04-19T04:28:12.100279+0000","last_fullsized":"2024-04-19T04:28:12.100279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:43:51.926940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.092977+0000","last_change":"2024-04-19T04:28:12.092977+0000","last_active":"2024-04-19T04:28:12.092977+0000","last_peered":"2024-04-19T04:28:12.092977+0000","last_clean":"2024-04-19T04:28:12.092977+0000","last_became_active":"2024-04-19T04:28:12.090262+0000","last_became_peered":"2024-04-19T04:28:12.090262+0000","last_unstale":"2024-04-19T04:28:12.092977+0000","last_undegraded":"2024-04-19T04:28:12.092977+0000","last_fullsized":"2024-04-19T04:28:12.092977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:39.131554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.093601+0000","last_change":"2024-04-19T04:28:12.093601+0000","last_active":"2024-04-19T04:28:12.093601+0000","last_peered":"2024-04-19T04:28:12.093601+0000","last_clean":"2024-04-19T04:28:12.093601+0000","last_became_active":"2024-04-19T04:28:12.092979+0000","last_became_peered":"2024-04-19T04:28:12.092979+0000","last_unstale":"2024-04-19T04:28:12.093601+0000","last_undegraded":"2024-04-19T04:28:12.093601+0000","last_fullsized":"2024-04-19T04:28:12.093601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:28:58.381121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.097695+0000","last_change":"2024-04-19T04:28:12.094560+0000","last_active":"2024-04-19T04:28:12.097695+0000","last_peered":"2024-04-19T04:28:12.097695+0000","last_clean":"2024-04-19T04:28:12.097695+0000","last_became_active":"2024-04-19T04:28:12.093915+0000","last_became_peered":"2024-04-19T04:28:12.093915+0000","last_unstale":"2024-04-19T04:28:12.097695+0000","last_undegraded":"2024-04-19T04:28:12.097695+0000","last_fullsized":"2024-04-19T04:28:12.097695+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:11:26.070147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078961+0000","last_change":"2024-04-19T04:28:02.639054+0000","last_active":"2024-04-19T04:28:12.078961+0000","last_peered":"2024-04-19T04:28:12.078961+0000","last_clean":"2024-04-19T04:28:12.078961+0000","last_became_active":"2024-04-19T04:28:02.637952+0000","last_became_peered":"2024-04-19T04:28:02.637952+0000","last_unstale":"2024-04-19T04:28:12.078961+0000","last_undegraded":"2024-04-19T04:28:12.078961+0000","last_fullsized":"2024-04-19T04:28:12.078961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:00:22.017021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":87,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079496+0000","last_change":"2024-04-19T04:28:02.635226+0000","last_active":"2024-04-19T04:28:12.079496+0000","last_peered":"2024-04-19T04:28:12.079496+0000","last_clean":"2024-04-19T04:28:12.079496+0000","last_became_active":"2024-04-19T04:28:02.634226+0000","last_became_peered":"2024-04-19T04:28:02.634226+0000","last_unstale":"2024-04-19T04:28:12.079496+0000","last_undegraded":"2024-04-19T04:28:12.079496+0000","last_fullsized":"2024-04-19T04:28:12.079496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:07.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079565+0000","last_change":"2024-04-19T04:28:02.636657+0000","last_active":"2024-04-19T04:28:12.079565+0000","last_peered":"2024-04-19T04:28:12.079565+0000","last_clean":"2024-04-19T04:28:12.079565+0000","last_became_active":"2024-04-19T04:28:02.636266+0000","last_became_peered":"2024-04-19T04:28:02.636266+0000","last_unstale":"2024-04-19T04:28:12.079565+0000","last_undegraded":"2024-04-19T04:28:12.079565+0000","last_fullsized":"2024-04-19T04:28:12.079565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:20:16.458945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.100268+0000","last_change":"2024-04-19T04:28:12.095797+0000","last_active":"2024-04-19T04:28:12.100268+0000","last_peered":"2024-04-19T04:28:12.100268+0000","last_clean":"2024-04-19T04:28:12.100268+0000","last_became_active":"2024-04-19T04:28:12.095199+0000","last_became_peered":"2024-04-19T04:28:12.095199+0000","last_unstale":"2024-04-19T04:28:12.100268+0000","last_undegraded":"2024-04-19T04:28:12.100268+0000","last_fullsized":"2024-04-19T04:28:12.100268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:28.634271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":66,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.091303+0000","last_change":"2024-04-19T04:28:12.091303+0000","last_active":"2024-04-19T04:28:12.091303+0000","last_peered":"2024-04-19T04:28:12.091303+0000","last_clean":"2024-04-19T04:28:12.091303+0000","last_became_active":"2024-04-19T04:28:12.087884+0000","last_became_peered":"2024-04-19T04:28:12.087884+0000","last_unstale":"2024-04-19T04:28:12.091303+0000","last_undegraded":"2024-04-19T04:28:12.091303+0000","last_fullsized":"2024-04-19T04:28:12.091303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:01:12.373663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288082+0000","last_change":"2024-04-19T04:28:02.846538+0000","last_active":"2024-04-19T04:28:12.288082+0000","last_peered":"2024-04-19T04:28:12.288082+0000","last_clean":"2024-04-19T04:28:12.288082+0000","last_became_active":"2024-04-19T04:28:02.846234+0000","last_became_peered":"2024-04-19T04:28:02.846234+0000","last_unstale":"2024-04-19T04:28:12.288082+0000","last_undegraded":"2024-04-19T04:28:12.288082+0000","last_fullsized":"2024-04-19T04:28:12.288082+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:08.165785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078454+0000","last_change":"2024-04-19T04:28:02.635122+0000","last_active":"2024-04-19T04:28:12.078454+0000","last_peered":"2024-04-19T04:28:12.078454+0000","last_clean":"2024-04-19T04:28:12.078454+0000","last_became_active":"2024-04-19T04:28:02.634433+0000","last_became_peered":"2024-04-19T04:28:02.634433+0000","last_unstale":"2024-04-19T04:28:12.078454+0000","last_undegraded":"2024-04-19T04:28:12.078454+0000","last_fullsized":"2024-04-19T04:28:12.078454+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:40.139486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288286+0000","last_change":"2024-04-19T04:28:02.844897+0000","last_active":"2024-04-19T04:28:12.288286+0000","last_peered":"2024-04-19T04:28:12.288286+0000","last_clean":"2024-04-19T04:28:12.288286+0000","last_became_active":"2024-04-19T04:28:02.844276+0000","last_became_peered":"2024-04-19T04:28:02.844276+0000","last_unstale":"2024-04-19T04:28:12.288286+0000","last_undegraded":"2024-04-19T04:28:12.288286+0000","last_fullsized":"2024-04-19T04:28:12.288286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:45.100544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705718,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220712,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151128,"statfs":{"total":96636764160,"available":96410755072,"internally_reserved":0,"allocated":937984,"data_stored":922026,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 04:27:10 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.65400000000000003,"15min":0.76500000000000001},"min":{"1min":0.218,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.82599999999999996,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.55500000000000005,"15min":0.59099999999999997},"min":{"1min":0.26000000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.81599999999999995,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.77600000000000002}]},{"osd":1,"last update":"Fri Apr 19 04:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":5.1989999999999998,"5min":5.1989999999999998,"15min":5.1989999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":0.85199999999999998}]}]},{"osd":1,"up_from":72,"seq":309237645317,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44128,"kb_used_data":844,"kb_used_omap":6,"kb_used_meta":43257,"kb_avail":94327712,"statfs":{"total":96636764160,"available":96591577088,"internally_reserved":0,"allocated":864256,"data_stored":334760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6880,"internal_metadata":44295456},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705718,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298668,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297726,"kb_avail":94073172,"statfs":{"total":96636764160,"available":96330928128,"internally_reserved":0,"allocated":950272,"data_stored":924740,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":304871878},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 04:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.68799999999999994}]},{"osd":2,"last update":"Fri Apr 19 04:27:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.23899999999999999,"5min":0.223,"15min":0.223},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.69999999999999996,"15min":0.80300000000000005},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.81799999999999995,"5min":4.5,"15min":4.5},"last":0.77900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:28:17.641 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T04:28:17.982 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:28:17.983 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":79,"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","created":"2024-04-19T04:23:58.837304+0000","modified":"2024-04-19T04:28:13.077866+0000","last_up_change":"2024-04-19T04:28:01.596258+0000","last_in_change":"2024-04-19T04:24:00.437672+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T04:24:08.928860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T04:24:14.725769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T04:24:19.096707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T04:24:19.528844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28ba89d9-eaaf-4fb5-86bc-783b607a4cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":18128},{"type":"v1","addr":"172.21.15.27:6801","nonce":18128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":18128},{"type":"v1","addr":"172.21.15.27:6803","nonce":18128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":18128},{"type":"v1","addr":"172.21.15.27:6807","nonce":18128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":18128},{"type":"v1","addr":"172.21.15.27:6805","nonce":18128}]},"public_addr":"172.21.15.27:6801/18128","cluster_addr":"172.21.15.27:6803/18128","heartbeat_back_addr":"172.21.15.27:6807/18128","heartbeat_front_addr":"172.21.15.27:6805/18128","state":["exists","up"]},{"osd":1,"uuid":"9d5408b5-b74c-4e5e-858c-e0c8b593204e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":37,"up_from":72,"up_thru":72,"down_at":38,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1427},{"type":"v1","addr":"172.21.15.66:6801","nonce":1427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1427},{"type":"v1","addr":"172.21.15.66:6803","nonce":1427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1427},{"type":"v1","addr":"172.21.15.66:6807","nonce":1427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1427},{"type":"v1","addr":"172.21.15.66:6805","nonce":1427}]},"public_addr":"172.21.15.66:6801/1427","cluster_addr":"172.21.15.66:6803/1427","heartbeat_back_addr":"172.21.15.66:6807/1427","heartbeat_front_addr":"172.21.15.66:6805/1427","state":["exists","up"]},{"osd":2,"uuid":"9b600dc4-4425-4873-82d8-5434ca838bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":18250},{"type":"v1","addr":"172.21.15.172:6801","nonce":18250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":18250},{"type":"v1","addr":"172.21.15.172:6803","nonce":18250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":18250},{"type":"v1","addr":"172.21.15.172:6807","nonce":18250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":18250},{"type":"v1","addr":"172.21.15.172:6805","nonce":18250}]},"public_addr":"172.21.15.172:6801/18250","cluster_addr":"172.21.15.172:6803/18250","heartbeat_back_addr":"172.21.15.172:6807/18250","heartbeat_front_addr":"172.21.15.172:6805/18250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.749539+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.573103+0000","dead_epoch":37},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.812945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T04:28:18.999 INFO:tasks.ceph:Scrubbing osd.0 2024-04-19T04:28:18.999 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-19T04:28:19.161 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-19T04:28:19.161 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-19T04:28:19.161 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-19T04:28:19.180 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-19T04:28:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 0 to deep-scrub 2024-04-19T04:28:19.492 INFO:tasks.ceph:Scrubbing osd.1 2024-04-19T04:28:19.492 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-19T04:28:19.652 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-19T04:28:19.653 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-19T04:28:19.653 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-19T04:28:19.665 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-19T04:28:19.977 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 1 to deep-scrub 2024-04-19T04:28:19.988 INFO:tasks.ceph:Scrubbing osd.2 2024-04-19T04:28:19.988 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-19T04:28:20.138 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-19T04:28:20.138 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-19T04:28:20.138 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-19T04:28:20.151 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-19T04:28:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 2 to deep-scrub 2024-04-19T04:28:20.483 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:28:20.802 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:28:20.805 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:28:20.818 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2024-04-19T04:28:18.987108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":563508,"kb_used_data":2696,"kb_used_omap":9,"kb_used_meta":560758,"kb_avail":282552012,"statfs":{"total":289910292480,"available":289333260288,"internally_reserved":0,"allocated":2760704,"data_stored":2185758,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":10068,"internal_metadata":574216364},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.918653"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":67,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.097630+0000","last_change":"2024-04-19T04:28:12.093601+0000","last_active":"2024-04-19T04:28:12.097630+0000","last_peered":"2024-04-19T04:28:12.097630+0000","last_clean":"2024-04-19T04:28:12.097630+0000","last_became_active":"2024-04-19T04:28:12.093175+0000","last_became_peered":"2024-04-19T04:28:12.093175+0000","last_unstale":"2024-04-19T04:28:12.097630+0000","last_undegraded":"2024-04-19T04:28:12.097630+0000","last_fullsized":"2024-04-19T04:28:12.097630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:53:38.070519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":67,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.097571+0000","last_change":"2024-04-19T04:28:12.093573+0000","last_active":"2024-04-19T04:28:12.097571+0000","last_peered":"2024-04-19T04:28:12.097571+0000","last_clean":"2024-04-19T04:28:12.097571+0000","last_became_active":"2024-04-19T04:28:12.092819+0000","last_became_peered":"2024-04-19T04:28:12.092819+0000","last_unstale":"2024-04-19T04:28:12.097571+0000","last_undegraded":"2024-04-19T04:28:12.097571+0000","last_fullsized":"2024-04-19T04:28:12.097571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:14.577765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079707+0000","last_change":"2024-04-19T04:24:20.556199+0000","last_active":"2024-04-19T04:28:12.079707+0000","last_peered":"2024-04-19T04:28:12.079707+0000","last_clean":"2024-04-19T04:28:12.079707+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:28:12.079707+0000","last_undegraded":"2024-04-19T04:28:12.079707+0000","last_fullsized":"2024-04-19T04:28:12.079707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:14.348910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078925+0000","last_change":"2024-04-19T04:28:02.635437+0000","last_active":"2024-04-19T04:28:12.078925+0000","last_peered":"2024-04-19T04:28:12.078925+0000","last_clean":"2024-04-19T04:28:12.078925+0000","last_became_active":"2024-04-19T04:28:02.634355+0000","last_became_peered":"2024-04-19T04:28:02.634355+0000","last_unstale":"2024-04-19T04:28:12.078925+0000","last_undegraded":"2024-04-19T04:28:12.078925+0000","last_fullsized":"2024-04-19T04:28:12.078925+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:39.534000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":67,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094687+0000","last_change":"2024-04-19T04:28:12.090282+0000","last_active":"2024-04-19T04:28:12.094687+0000","last_peered":"2024-04-19T04:28:12.094687+0000","last_clean":"2024-04-19T04:28:12.094687+0000","last_became_active":"2024-04-19T04:28:12.088231+0000","last_became_peered":"2024-04-19T04:28:12.088231+0000","last_unstale":"2024-04-19T04:28:12.094687+0000","last_undegraded":"2024-04-19T04:28:12.094687+0000","last_fullsized":"2024-04-19T04:28:12.094687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:48:51.512556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078586+0000","last_change":"2024-04-19T04:28:02.637742+0000","last_active":"2024-04-19T04:28:12.078586+0000","last_peered":"2024-04-19T04:28:12.078586+0000","last_clean":"2024-04-19T04:28:12.078586+0000","last_became_active":"2024-04-19T04:28:02.637276+0000","last_became_peered":"2024-04-19T04:28:02.637276+0000","last_unstale":"2024-04-19T04:28:12.078586+0000","last_undegraded":"2024-04-19T04:28:12.078586+0000","last_fullsized":"2024-04-19T04:28:12.078586+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:06.971707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078374+0000","last_change":"2024-04-19T04:28:02.637532+0000","last_active":"2024-04-19T04:28:12.078374+0000","last_peered":"2024-04-19T04:28:12.078374+0000","last_clean":"2024-04-19T04:28:12.078374+0000","last_became_active":"2024-04-19T04:28:02.637086+0000","last_became_peered":"2024-04-19T04:28:02.637086+0000","last_unstale":"2024-04-19T04:28:12.078374+0000","last_undegraded":"2024-04-19T04:28:12.078374+0000","last_fullsized":"2024-04-19T04:28:12.078374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:40:05.423094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.077959+0000","last_change":"2024-04-19T04:28:02.638186+0000","last_active":"2024-04-19T04:28:12.077959+0000","last_peered":"2024-04-19T04:28:12.077959+0000","last_clean":"2024-04-19T04:28:12.077959+0000","last_became_active":"2024-04-19T04:28:02.637746+0000","last_became_peered":"2024-04-19T04:28:02.637746+0000","last_unstale":"2024-04-19T04:28:12.077959+0000","last_undegraded":"2024-04-19T04:28:12.077959+0000","last_fullsized":"2024-04-19T04:28:12.077959+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:50.758441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287710+0000","last_change":"2024-04-19T04:28:02.842455+0000","last_active":"2024-04-19T04:28:12.287710+0000","last_peered":"2024-04-19T04:28:12.287710+0000","last_clean":"2024-04-19T04:28:12.287710+0000","last_became_active":"2024-04-19T04:28:02.839203+0000","last_became_peered":"2024-04-19T04:28:02.839203+0000","last_unstale":"2024-04-19T04:28:12.287710+0000","last_undegraded":"2024-04-19T04:28:12.287710+0000","last_fullsized":"2024-04-19T04:28:12.287710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:18:44.252505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":67,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.097628+0000","last_change":"2024-04-19T04:28:12.093403+0000","last_active":"2024-04-19T04:28:12.097628+0000","last_peered":"2024-04-19T04:28:12.097628+0000","last_clean":"2024-04-19T04:28:12.097628+0000","last_became_active":"2024-04-19T04:28:12.092924+0000","last_became_peered":"2024-04-19T04:28:12.092924+0000","last_unstale":"2024-04-19T04:28:12.097628+0000","last_undegraded":"2024-04-19T04:28:12.097628+0000","last_fullsized":"2024-04-19T04:28:12.097628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:56.871317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079800+0000","last_change":"2024-04-19T04:28:02.636293+0000","last_active":"2024-04-19T04:28:12.079800+0000","last_peered":"2024-04-19T04:28:12.079800+0000","last_clean":"2024-04-19T04:28:12.079800+0000","last_became_active":"2024-04-19T04:28:02.635946+0000","last_became_peered":"2024-04-19T04:28:02.635946+0000","last_unstale":"2024-04-19T04:28:12.079800+0000","last_undegraded":"2024-04-19T04:28:12.079800+0000","last_fullsized":"2024-04-19T04:28:12.079800+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:42.381196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.770326+0000","last_change":"2024-04-19T04:28:12.095304+0000","last_active":"2024-04-19T04:28:13.770326+0000","last_peered":"2024-04-19T04:28:13.770326+0000","last_clean":"2024-04-19T04:28:13.770326+0000","last_became_active":"2024-04-19T04:28:12.094753+0000","last_became_peered":"2024-04-19T04:28:12.094753+0000","last_unstale":"2024-04-19T04:28:13.770326+0000","last_undegraded":"2024-04-19T04:28:13.770326+0000","last_fullsized":"2024-04-19T04:28:13.770326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:36:03.465294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":67,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.097681+0000","last_change":"2024-04-19T04:28:12.093953+0000","last_active":"2024-04-19T04:28:12.097681+0000","last_peered":"2024-04-19T04:28:12.097681+0000","last_clean":"2024-04-19T04:28:12.097681+0000","last_became_active":"2024-04-19T04:28:12.093267+0000","last_became_peered":"2024-04-19T04:28:12.093267+0000","last_unstale":"2024-04-19T04:28:12.097681+0000","last_undegraded":"2024-04-19T04:28:12.097681+0000","last_fullsized":"2024-04-19T04:28:12.097681+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:14.548542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078930+0000","last_change":"2024-04-19T04:24:20.552690+0000","last_active":"2024-04-19T04:28:12.078930+0000","last_peered":"2024-04-19T04:28:12.078930+0000","last_clean":"2024-04-19T04:28:12.078930+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:28:12.078930+0000","last_undegraded":"2024-04-19T04:28:12.078930+0000","last_fullsized":"2024-04-19T04:28:12.078930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:53:16.890992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078527+0000","last_change":"2024-04-19T04:24:20.551809+0000","last_active":"2024-04-19T04:28:12.078527+0000","last_peered":"2024-04-19T04:28:12.078527+0000","last_clean":"2024-04-19T04:28:12.078527+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:28:12.078527+0000","last_undegraded":"2024-04-19T04:28:12.078527+0000","last_fullsized":"2024-04-19T04:28:12.078527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:43:31.281765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078198+0000","last_change":"2024-04-19T04:28:02.638726+0000","last_active":"2024-04-19T04:28:12.078198+0000","last_peered":"2024-04-19T04:28:12.078198+0000","last_clean":"2024-04-19T04:28:12.078198+0000","last_became_active":"2024-04-19T04:28:02.637920+0000","last_became_peered":"2024-04-19T04:28:02.637920+0000","last_unstale":"2024-04-19T04:28:12.078198+0000","last_undegraded":"2024-04-19T04:28:12.078198+0000","last_fullsized":"2024-04-19T04:28:12.078198+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:23:42.710810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287706+0000","last_change":"2024-04-19T04:28:02.841438+0000","last_active":"2024-04-19T04:28:12.287706+0000","last_peered":"2024-04-19T04:28:12.287706+0000","last_clean":"2024-04-19T04:28:12.287706+0000","last_became_active":"2024-04-19T04:28:02.839071+0000","last_became_peered":"2024-04-19T04:28:02.839071+0000","last_unstale":"2024-04-19T04:28:12.287706+0000","last_undegraded":"2024-04-19T04:28:12.287706+0000","last_fullsized":"2024-04-19T04:28:12.287706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:37:05.846827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":83,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.087077+0000","last_change":"2024-04-19T04:28:02.638587+0000","last_active":"2024-04-19T04:28:12.087077+0000","last_peered":"2024-04-19T04:28:12.087077+0000","last_clean":"2024-04-19T04:28:12.087077+0000","last_became_active":"2024-04-19T04:28:02.638230+0000","last_became_peered":"2024-04-19T04:28:02.638230+0000","last_unstale":"2024-04-19T04:28:12.087077+0000","last_undegraded":"2024-04-19T04:28:12.087077+0000","last_fullsized":"2024-04-19T04:28:12.087077+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:43:23.974591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286685+0000","last_change":"2024-04-19T04:28:02.840423+0000","last_active":"2024-04-19T04:28:12.286685+0000","last_peered":"2024-04-19T04:28:12.286685+0000","last_clean":"2024-04-19T04:28:12.286685+0000","last_became_active":"2024-04-19T04:28:02.839362+0000","last_became_peered":"2024-04-19T04:28:02.839362+0000","last_unstale":"2024-04-19T04:28:12.286685+0000","last_undegraded":"2024-04-19T04:28:12.286685+0000","last_fullsized":"2024-04-19T04:28:12.286685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:24:55.325024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079785+0000","last_change":"2024-04-19T04:28:02.635566+0000","last_active":"2024-04-19T04:28:12.079785+0000","last_peered":"2024-04-19T04:28:12.079785+0000","last_clean":"2024-04-19T04:28:12.079785+0000","last_became_active":"2024-04-19T04:28:02.634835+0000","last_became_peered":"2024-04-19T04:28:02.634835+0000","last_unstale":"2024-04-19T04:28:12.079785+0000","last_undegraded":"2024-04-19T04:28:12.079785+0000","last_fullsized":"2024-04-19T04:28:12.079785+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:04.159997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079199+0000","last_change":"2024-04-19T04:28:02.639259+0000","last_active":"2024-04-19T04:28:12.079199+0000","last_peered":"2024-04-19T04:28:12.079199+0000","last_clean":"2024-04-19T04:28:12.079199+0000","last_became_active":"2024-04-19T04:28:02.638546+0000","last_became_peered":"2024-04-19T04:28:02.638546+0000","last_unstale":"2024-04-19T04:28:12.079199+0000","last_undegraded":"2024-04-19T04:28:12.079199+0000","last_fullsized":"2024-04-19T04:28:12.079199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:47:45.968474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.770200+0000","last_change":"2024-04-19T04:28:12.089576+0000","last_active":"2024-04-19T04:28:13.770200+0000","last_peered":"2024-04-19T04:28:13.770200+0000","last_clean":"2024-04-19T04:28:13.770200+0000","last_became_active":"2024-04-19T04:28:12.087571+0000","last_became_peered":"2024-04-19T04:28:12.087571+0000","last_unstale":"2024-04-19T04:28:13.770200+0000","last_undegraded":"2024-04-19T04:28:13.770200+0000","last_fullsized":"2024-04-19T04:28:13.770200+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:42.381196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285546+0000","last_change":"2024-04-19T04:28:02.842994+0000","last_active":"2024-04-19T04:28:12.285546+0000","last_peered":"2024-04-19T04:28:12.285546+0000","last_clean":"2024-04-19T04:28:12.285546+0000","last_became_active":"2024-04-19T04:28:02.840294+0000","last_became_peered":"2024-04-19T04:28:02.840294+0000","last_unstale":"2024-04-19T04:28:12.285546+0000","last_undegraded":"2024-04-19T04:28:12.285546+0000","last_fullsized":"2024-04-19T04:28:12.285546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:26.503064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":67,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094166+0000","last_change":"2024-04-19T04:28:12.090413+0000","last_active":"2024-04-19T04:28:12.094166+0000","last_peered":"2024-04-19T04:28:12.094166+0000","last_clean":"2024-04-19T04:28:12.094166+0000","last_became_active":"2024-04-19T04:28:12.089918+0000","last_became_peered":"2024-04-19T04:28:12.089918+0000","last_unstale":"2024-04-19T04:28:12.094166+0000","last_undegraded":"2024-04-19T04:28:12.094166+0000","last_fullsized":"2024-04-19T04:28:12.094166+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:08.501081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.770557+0000","last_change":"2024-04-19T04:28:12.092733+0000","last_active":"2024-04-19T04:28:13.770557+0000","last_peered":"2024-04-19T04:28:13.770557+0000","last_clean":"2024-04-19T04:28:13.770557+0000","last_became_active":"2024-04-19T04:28:12.091770+0000","last_became_peered":"2024-04-19T04:28:12.091770+0000","last_unstale":"2024-04-19T04:28:13.770557+0000","last_undegraded":"2024-04-19T04:28:13.770557+0000","last_fullsized":"2024-04-19T04:28:13.770557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:39:38.261503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287546+0000","last_change":"2024-04-19T04:28:02.846092+0000","last_active":"2024-04-19T04:28:12.287546+0000","last_peered":"2024-04-19T04:28:12.287546+0000","last_clean":"2024-04-19T04:28:12.287546+0000","last_became_active":"2024-04-19T04:28:02.845416+0000","last_became_peered":"2024-04-19T04:28:02.845416+0000","last_unstale":"2024-04-19T04:28:12.287546+0000","last_undegraded":"2024-04-19T04:28:12.287546+0000","last_fullsized":"2024-04-19T04:28:12.287546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:23.517160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079927+0000","last_change":"2024-04-19T04:24:20.554885+0000","last_active":"2024-04-19T04:28:12.079927+0000","last_peered":"2024-04-19T04:28:12.079927+0000","last_clean":"2024-04-19T04:28:12.079927+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:28:12.079927+0000","last_undegraded":"2024-04-19T04:28:12.079927+0000","last_fullsized":"2024-04-19T04:28:12.079927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:44:08.285518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.770371+0000","last_change":"2024-04-19T04:28:12.092936+0000","last_active":"2024-04-19T04:28:13.770371+0000","last_peered":"2024-04-19T04:28:13.770371+0000","last_clean":"2024-04-19T04:28:13.770371+0000","last_became_active":"2024-04-19T04:28:12.091969+0000","last_became_peered":"2024-04-19T04:28:12.091969+0000","last_unstale":"2024-04-19T04:28:13.770371+0000","last_undegraded":"2024-04-19T04:28:13.770371+0000","last_fullsized":"2024-04-19T04:28:13.770371+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:20.569368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285809+0000","last_change":"2024-04-19T04:28:02.845150+0000","last_active":"2024-04-19T04:28:12.285809+0000","last_peered":"2024-04-19T04:28:12.285809+0000","last_clean":"2024-04-19T04:28:12.285809+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:28:12.285809+0000","last_undegraded":"2024-04-19T04:28:12.285809+0000","last_fullsized":"2024-04-19T04:28:12.285809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:27:04.257043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.084868+0000","last_change":"2024-04-19T04:24:20.554847+0000","last_active":"2024-04-19T04:28:12.084868+0000","last_peered":"2024-04-19T04:28:12.084868+0000","last_clean":"2024-04-19T04:28:12.084868+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:28:12.084868+0000","last_undegraded":"2024-04-19T04:28:12.084868+0000","last_fullsized":"2024-04-19T04:28:12.084868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:00.475711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286101+0000","last_change":"2024-04-19T04:28:02.843590+0000","last_active":"2024-04-19T04:28:12.286101+0000","last_peered":"2024-04-19T04:28:12.286101+0000","last_clean":"2024-04-19T04:28:12.286101+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:28:12.286101+0000","last_undegraded":"2024-04-19T04:28:12.286101+0000","last_fullsized":"2024-04-19T04:28:12.286101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:02.147016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078180+0000","last_change":"2024-04-19T04:28:02.635119+0000","last_active":"2024-04-19T04:28:12.078180+0000","last_peered":"2024-04-19T04:28:12.078180+0000","last_clean":"2024-04-19T04:28:12.078180+0000","last_became_active":"2024-04-19T04:28:02.634586+0000","last_became_peered":"2024-04-19T04:28:02.634586+0000","last_unstale":"2024-04-19T04:28:12.078180+0000","last_undegraded":"2024-04-19T04:28:12.078180+0000","last_fullsized":"2024-04-19T04:28:12.078180+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:08.719606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":67,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.100240+0000","last_change":"2024-04-19T04:28:12.095305+0000","last_active":"2024-04-19T04:28:12.100240+0000","last_peered":"2024-04-19T04:28:12.100240+0000","last_clean":"2024-04-19T04:28:12.100240+0000","last_became_active":"2024-04-19T04:28:12.094558+0000","last_became_peered":"2024-04-19T04:28:12.094558+0000","last_unstale":"2024-04-19T04:28:12.100240+0000","last_undegraded":"2024-04-19T04:28:12.100240+0000","last_fullsized":"2024-04-19T04:28:12.100240+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:44:45.647590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":87,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079450+0000","last_change":"2024-04-19T04:28:02.639581+0000","last_active":"2024-04-19T04:28:12.079450+0000","last_peered":"2024-04-19T04:28:12.079450+0000","last_clean":"2024-04-19T04:28:12.079450+0000","last_became_active":"2024-04-19T04:28:02.638666+0000","last_became_peered":"2024-04-19T04:28:02.638666+0000","last_unstale":"2024-04-19T04:28:12.079450+0000","last_undegraded":"2024-04-19T04:28:12.079450+0000","last_fullsized":"2024-04-19T04:28:12.079450+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:42:54.107998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":67,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.100254+0000","last_change":"2024-04-19T04:28:12.095631+0000","last_active":"2024-04-19T04:28:12.100254+0000","last_peered":"2024-04-19T04:28:12.100254+0000","last_clean":"2024-04-19T04:28:12.100254+0000","last_became_active":"2024-04-19T04:28:12.094722+0000","last_became_peered":"2024-04-19T04:28:12.094722+0000","last_unstale":"2024-04-19T04:28:12.100254+0000","last_undegraded":"2024-04-19T04:28:12.100254+0000","last_fullsized":"2024-04-19T04:28:12.100254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:31.378691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287127+0000","last_change":"2024-04-19T04:28:02.843299+0000","last_active":"2024-04-19T04:28:12.287127+0000","last_peered":"2024-04-19T04:28:12.287127+0000","last_clean":"2024-04-19T04:28:12.287127+0000","last_became_active":"2024-04-19T04:28:02.842525+0000","last_became_peered":"2024-04-19T04:28:02.842525+0000","last_unstale":"2024-04-19T04:28:12.287127+0000","last_undegraded":"2024-04-19T04:28:12.287127+0000","last_fullsized":"2024-04-19T04:28:12.287127+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:10:33.303473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287136+0000","last_change":"2024-04-19T04:28:02.845685+0000","last_active":"2024-04-19T04:28:12.287136+0000","last_peered":"2024-04-19T04:28:12.287136+0000","last_clean":"2024-04-19T04:28:12.287136+0000","last_became_active":"2024-04-19T04:28:02.843099+0000","last_became_peered":"2024-04-19T04:28:02.843099+0000","last_unstale":"2024-04-19T04:28:12.287136+0000","last_undegraded":"2024-04-19T04:28:12.287136+0000","last_fullsized":"2024-04-19T04:28:12.287136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:25:05.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.770153+0000","last_change":"2024-04-19T04:28:12.092744+0000","last_active":"2024-04-19T04:28:13.770153+0000","last_peered":"2024-04-19T04:28:13.770153+0000","last_clean":"2024-04-19T04:28:13.770153+0000","last_became_active":"2024-04-19T04:28:12.091771+0000","last_became_peered":"2024-04-19T04:28:12.091771+0000","last_unstale":"2024-04-19T04:28:13.770153+0000","last_undegraded":"2024-04-19T04:28:13.770153+0000","last_fullsized":"2024-04-19T04:28:13.770153+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:34.728962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287385+0000","last_change":"2024-04-19T04:28:02.837331+0000","last_active":"2024-04-19T04:28:12.287385+0000","last_peered":"2024-04-19T04:28:12.287385+0000","last_clean":"2024-04-19T04:28:12.287385+0000","last_became_active":"2024-04-19T04:28:02.836984+0000","last_became_peered":"2024-04-19T04:28:02.836984+0000","last_unstale":"2024-04-19T04:28:12.287385+0000","last_undegraded":"2024-04-19T04:28:12.287385+0000","last_fullsized":"2024-04-19T04:28:12.287385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:11.858503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":80,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078519+0000","last_change":"2024-04-19T04:24:20.187299+0000","last_active":"2024-04-19T04:28:12.078519+0000","last_peered":"2024-04-19T04:28:12.078519+0000","last_clean":"2024-04-19T04:28:12.078519+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:28:12.078519+0000","last_undegraded":"2024-04-19T04:28:12.078519+0000","last_fullsized":"2024-04-19T04:28:12.078519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:49:37.812125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":73,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080835+0000","last_change":"2024-04-19T04:24:20.186029+0000","last_active":"2024-04-19T04:28:12.080835+0000","last_peered":"2024-04-19T04:28:12.080835+0000","last_clean":"2024-04-19T04:28:12.080835+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:28:12.080835+0000","last_undegraded":"2024-04-19T04:28:12.080835+0000","last_fullsized":"2024-04-19T04:28:12.080835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:49.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.770045+0000","last_change":"2024-04-19T04:28:12.092118+0000","last_active":"2024-04-19T04:28:13.770045+0000","last_peered":"2024-04-19T04:28:13.770045+0000","last_clean":"2024-04-19T04:28:13.770045+0000","last_became_active":"2024-04-19T04:28:12.090379+0000","last_became_peered":"2024-04-19T04:28:12.090379+0000","last_unstale":"2024-04-19T04:28:13.770045+0000","last_undegraded":"2024-04-19T04:28:13.770045+0000","last_fullsized":"2024-04-19T04:28:13.770045+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:38.494787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.770526+0000","last_change":"2024-04-19T04:28:12.090491+0000","last_active":"2024-04-19T04:28:13.770526+0000","last_peered":"2024-04-19T04:28:13.770526+0000","last_clean":"2024-04-19T04:28:13.770526+0000","last_became_active":"2024-04-19T04:28:12.089948+0000","last_became_peered":"2024-04-19T04:28:12.089948+0000","last_unstale":"2024-04-19T04:28:13.770526+0000","last_undegraded":"2024-04-19T04:28:13.770526+0000","last_fullsized":"2024-04-19T04:28:13.770526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:04:35.343697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":67,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.097654+0000","last_change":"2024-04-19T04:28:12.093574+0000","last_active":"2024-04-19T04:28:12.097654+0000","last_peered":"2024-04-19T04:28:12.097654+0000","last_clean":"2024-04-19T04:28:12.097654+0000","last_became_active":"2024-04-19T04:28:12.093090+0000","last_became_peered":"2024-04-19T04:28:12.093090+0000","last_unstale":"2024-04-19T04:28:12.097654+0000","last_undegraded":"2024-04-19T04:28:12.097654+0000","last_fullsized":"2024-04-19T04:28:12.097654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:32:01.796620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":73,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080387+0000","last_change":"2024-04-19T04:24:20.186044+0000","last_active":"2024-04-19T04:28:12.080387+0000","last_peered":"2024-04-19T04:28:12.080387+0000","last_clean":"2024-04-19T04:28:12.080387+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:28:12.080387+0000","last_undegraded":"2024-04-19T04:28:12.080387+0000","last_fullsized":"2024-04-19T04:28:12.080387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.432692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079351+0000","last_change":"2024-04-19T04:28:02.636589+0000","last_active":"2024-04-19T04:28:12.079351+0000","last_peered":"2024-04-19T04:28:12.079351+0000","last_clean":"2024-04-19T04:28:12.079351+0000","last_became_active":"2024-04-19T04:28:02.636231+0000","last_became_peered":"2024-04-19T04:28:02.636231+0000","last_unstale":"2024-04-19T04:28:12.079351+0000","last_undegraded":"2024-04-19T04:28:12.079351+0000","last_fullsized":"2024-04-19T04:28:12.079351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:25:32.636485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080045+0000","last_change":"2024-04-19T04:28:02.635650+0000","last_active":"2024-04-19T04:28:12.080045+0000","last_peered":"2024-04-19T04:28:12.080045+0000","last_clean":"2024-04-19T04:28:12.080045+0000","last_became_active":"2024-04-19T04:28:02.634823+0000","last_became_peered":"2024-04-19T04:28:02.634823+0000","last_unstale":"2024-04-19T04:28:12.080045+0000","last_undegraded":"2024-04-19T04:28:12.080045+0000","last_fullsized":"2024-04-19T04:28:12.080045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:37.205733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287721+0000","last_change":"2024-04-19T04:28:02.845805+0000","last_active":"2024-04-19T04:28:12.287721+0000","last_peered":"2024-04-19T04:28:12.287721+0000","last_clean":"2024-04-19T04:28:12.287721+0000","last_became_active":"2024-04-19T04:28:02.845461+0000","last_became_peered":"2024-04-19T04:28:02.845461+0000","last_unstale":"2024-04-19T04:28:12.287721+0000","last_undegraded":"2024-04-19T04:28:12.287721+0000","last_fullsized":"2024-04-19T04:28:12.287721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:57:44.161931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287443+0000","last_change":"2024-04-19T04:28:02.845613+0000","last_active":"2024-04-19T04:28:12.287443+0000","last_peered":"2024-04-19T04:28:12.287443+0000","last_clean":"2024-04-19T04:28:12.287443+0000","last_became_active":"2024-04-19T04:28:02.844927+0000","last_became_peered":"2024-04-19T04:28:02.844927+0000","last_unstale":"2024-04-19T04:28:12.287443+0000","last_undegraded":"2024-04-19T04:28:12.287443+0000","last_fullsized":"2024-04-19T04:28:12.287443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:59.219663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079185+0000","last_change":"2024-04-19T04:28:02.635751+0000","last_active":"2024-04-19T04:28:12.079185+0000","last_peered":"2024-04-19T04:28:12.079185+0000","last_clean":"2024-04-19T04:28:12.079185+0000","last_became_active":"2024-04-19T04:28:02.635238+0000","last_became_peered":"2024-04-19T04:28:02.635238+0000","last_unstale":"2024-04-19T04:28:12.079185+0000","last_undegraded":"2024-04-19T04:28:12.079185+0000","last_fullsized":"2024-04-19T04:28:12.079185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:24:14.292299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079943+0000","last_change":"2024-04-19T04:28:02.638055+0000","last_active":"2024-04-19T04:28:12.079943+0000","last_peered":"2024-04-19T04:28:12.079943+0000","last_clean":"2024-04-19T04:28:12.079943+0000","last_became_active":"2024-04-19T04:28:02.637651+0000","last_became_peered":"2024-04-19T04:28:02.637651+0000","last_unstale":"2024-04-19T04:28:12.079943+0000","last_undegraded":"2024-04-19T04:28:12.079943+0000","last_fullsized":"2024-04-19T04:28:12.079943+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:25:55.832256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080143+0000","last_change":"2024-04-19T04:24:20.555922+0000","last_active":"2024-04-19T04:28:12.080143+0000","last_peered":"2024-04-19T04:28:12.080143+0000","last_clean":"2024-04-19T04:28:12.080143+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:28:12.080143+0000","last_undegraded":"2024-04-19T04:28:12.080143+0000","last_fullsized":"2024-04-19T04:28:12.080143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:06:53.595149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.087416+0000","last_change":"2024-04-19T04:24:20.183944+0000","last_active":"2024-04-19T04:28:12.087416+0000","last_peered":"2024-04-19T04:28:12.087416+0000","last_clean":"2024-04-19T04:28:12.087416+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:28:12.087416+0000","last_undegraded":"2024-04-19T04:28:12.087416+0000","last_fullsized":"2024-04-19T04:28:12.087416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:42.018487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079773+0000","last_change":"2024-04-19T04:24:20.553085+0000","last_active":"2024-04-19T04:28:12.079773+0000","last_peered":"2024-04-19T04:28:12.079773+0000","last_clean":"2024-04-19T04:28:12.079773+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:28:12.079773+0000","last_undegraded":"2024-04-19T04:28:12.079773+0000","last_fullsized":"2024-04-19T04:28:12.079773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:07:21.467758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094069+0000","last_change":"2024-04-19T04:28:12.089659+0000","last_active":"2024-04-19T04:28:12.094069+0000","last_peered":"2024-04-19T04:28:12.094069+0000","last_clean":"2024-04-19T04:28:12.094069+0000","last_became_active":"2024-04-19T04:28:12.088043+0000","last_became_peered":"2024-04-19T04:28:12.088043+0000","last_unstale":"2024-04-19T04:28:12.094069+0000","last_undegraded":"2024-04-19T04:28:12.094069+0000","last_fullsized":"2024-04-19T04:28:12.094069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:02:42.873134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288226+0000","last_change":"2024-04-19T04:28:02.844467+0000","last_active":"2024-04-19T04:28:12.288226+0000","last_peered":"2024-04-19T04:28:12.288226+0000","last_clean":"2024-04-19T04:28:12.288226+0000","last_became_active":"2024-04-19T04:28:02.843639+0000","last_became_peered":"2024-04-19T04:28:02.843639+0000","last_unstale":"2024-04-19T04:28:12.288226+0000","last_undegraded":"2024-04-19T04:28:12.288226+0000","last_fullsized":"2024-04-19T04:28:12.288226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:24.660145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":275,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094355+0000","last_change":"2024-04-19T04:24:10.106278+0000","last_active":"2024-04-19T04:28:13.094355+0000","last_peered":"2024-04-19T04:28:13.094355+0000","last_clean":"2024-04-19T04:28:13.094355+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:28:13.094355+0000","last_undegraded":"2024-04-19T04:28:13.094355+0000","last_fullsized":"2024-04-19T04:28:13.094355+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_clean_scrub_stamp":"2024-04-19T04:24:09.083488+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":88,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079654+0000","last_change":"2024-04-19T04:28:02.639632+0000","last_active":"2024-04-19T04:28:12.079654+0000","last_peered":"2024-04-19T04:28:12.079654+0000","last_clean":"2024-04-19T04:28:12.079654+0000","last_became_active":"2024-04-19T04:28:02.639240+0000","last_became_peered":"2024-04-19T04:28:02.639240+0000","last_unstale":"2024-04-19T04:28:12.079654+0000","last_undegraded":"2024-04-19T04:28:12.079654+0000","last_fullsized":"2024-04-19T04:28:12.079654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:54.035030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287535+0000","last_change":"2024-04-19T04:28:02.842437+0000","last_active":"2024-04-19T04:28:12.287535+0000","last_peered":"2024-04-19T04:28:12.287535+0000","last_clean":"2024-04-19T04:28:12.287535+0000","last_became_active":"2024-04-19T04:28:02.841053+0000","last_became_peered":"2024-04-19T04:28:02.841053+0000","last_unstale":"2024-04-19T04:28:12.287535+0000","last_undegraded":"2024-04-19T04:28:12.287535+0000","last_fullsized":"2024-04-19T04:28:12.287535+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:45.323344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080363+0000","last_change":"2024-04-19T04:24:20.553999+0000","last_active":"2024-04-19T04:28:12.080363+0000","last_peered":"2024-04-19T04:28:12.080363+0000","last_clean":"2024-04-19T04:28:12.080363+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:28:12.080363+0000","last_undegraded":"2024-04-19T04:28:12.080363+0000","last_fullsized":"2024-04-19T04:28:12.080363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:13:53.306369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094272+0000","last_change":"2024-04-19T04:24:16.144482+0000","last_active":"2024-04-19T04:28:13.094272+0000","last_peered":"2024-04-19T04:28:13.094272+0000","last_clean":"2024-04-19T04:28:13.094272+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:28:13.094272+0000","last_undegraded":"2024-04-19T04:28:13.094272+0000","last_fullsized":"2024-04-19T04:28:13.094272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:15.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285234+0000","last_change":"2024-04-19T04:28:02.842303+0000","last_active":"2024-04-19T04:28:12.285234+0000","last_peered":"2024-04-19T04:28:12.285234+0000","last_clean":"2024-04-19T04:28:12.285234+0000","last_became_active":"2024-04-19T04:28:02.839926+0000","last_became_peered":"2024-04-19T04:28:02.839926+0000","last_unstale":"2024-04-19T04:28:12.285234+0000","last_undegraded":"2024-04-19T04:28:12.285234+0000","last_fullsized":"2024-04-19T04:28:12.285234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:13.266751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":83,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.085517+0000","last_change":"2024-04-19T04:28:02.638370+0000","last_active":"2024-04-19T04:28:12.085517+0000","last_peered":"2024-04-19T04:28:12.085517+0000","last_clean":"2024-04-19T04:28:12.085517+0000","last_became_active":"2024-04-19T04:28:02.638095+0000","last_became_peered":"2024-04-19T04:28:02.638095+0000","last_unstale":"2024-04-19T04:28:12.085517+0000","last_undegraded":"2024-04-19T04:28:12.085517+0000","last_fullsized":"2024-04-19T04:28:12.085517+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:16:46.463514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285839+0000","last_change":"2024-04-19T04:28:02.843324+0000","last_active":"2024-04-19T04:28:12.285839+0000","last_peered":"2024-04-19T04:28:12.285839+0000","last_clean":"2024-04-19T04:28:12.285839+0000","last_became_active":"2024-04-19T04:28:02.840328+0000","last_became_peered":"2024-04-19T04:28:02.840328+0000","last_unstale":"2024-04-19T04:28:12.285839+0000","last_undegraded":"2024-04-19T04:28:12.285839+0000","last_fullsized":"2024-04-19T04:28:12.285839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:58:19.389865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.770082+0000","last_change":"2024-04-19T04:28:12.088382+0000","last_active":"2024-04-19T04:28:13.770082+0000","last_peered":"2024-04-19T04:28:13.770082+0000","last_clean":"2024-04-19T04:28:13.770082+0000","last_became_active":"2024-04-19T04:28:12.087575+0000","last_became_peered":"2024-04-19T04:28:12.087575+0000","last_unstale":"2024-04-19T04:28:13.770082+0000","last_undegraded":"2024-04-19T04:28:13.770082+0000","last_fullsized":"2024-04-19T04:28:13.770082+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:13.034157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288155+0000","last_change":"2024-04-19T04:28:02.844076+0000","last_active":"2024-04-19T04:28:12.288155+0000","last_peered":"2024-04-19T04:28:12.288155+0000","last_clean":"2024-04-19T04:28:12.288155+0000","last_became_active":"2024-04-19T04:28:02.840839+0000","last_became_peered":"2024-04-19T04:28:02.840839+0000","last_unstale":"2024-04-19T04:28:12.288155+0000","last_undegraded":"2024-04-19T04:28:12.288155+0000","last_fullsized":"2024-04-19T04:28:12.288155+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:31.891080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":88,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080149+0000","last_change":"2024-04-19T04:28:02.635123+0000","last_active":"2024-04-19T04:28:12.080149+0000","last_peered":"2024-04-19T04:28:12.080149+0000","last_clean":"2024-04-19T04:28:12.080149+0000","last_became_active":"2024-04-19T04:28:02.634633+0000","last_became_peered":"2024-04-19T04:28:02.634633+0000","last_unstale":"2024-04-19T04:28:12.080149+0000","last_undegraded":"2024-04-19T04:28:12.080149+0000","last_fullsized":"2024-04-19T04:28:12.080149+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:47:35.387548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079490+0000","last_change":"2024-04-19T04:28:02.638250+0000","last_active":"2024-04-19T04:28:12.079490+0000","last_peered":"2024-04-19T04:28:12.079490+0000","last_clean":"2024-04-19T04:28:12.079490+0000","last_became_active":"2024-04-19T04:28:02.637233+0000","last_became_peered":"2024-04-19T04:28:02.637233+0000","last_unstale":"2024-04-19T04:28:12.079490+0000","last_undegraded":"2024-04-19T04:28:12.079490+0000","last_fullsized":"2024-04-19T04:28:12.079490+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:53:27.253209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286825+0000","last_change":"2024-04-19T04:28:02.838255+0000","last_active":"2024-04-19T04:28:12.286825+0000","last_peered":"2024-04-19T04:28:12.286825+0000","last_clean":"2024-04-19T04:28:12.286825+0000","last_became_active":"2024-04-19T04:28:02.837829+0000","last_became_peered":"2024-04-19T04:28:02.837829+0000","last_unstale":"2024-04-19T04:28:12.286825+0000","last_undegraded":"2024-04-19T04:28:12.286825+0000","last_fullsized":"2024-04-19T04:28:12.286825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:11:30.005510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080527+0000","last_change":"2024-04-19T04:28:02.636097+0000","last_active":"2024-04-19T04:28:12.080527+0000","last_peered":"2024-04-19T04:28:12.080527+0000","last_clean":"2024-04-19T04:28:12.080527+0000","last_became_active":"2024-04-19T04:28:02.634103+0000","last_became_peered":"2024-04-19T04:28:02.634103+0000","last_unstale":"2024-04-19T04:28:12.080527+0000","last_undegraded":"2024-04-19T04:28:12.080527+0000","last_fullsized":"2024-04-19T04:28:12.080527+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:37.486856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285930+0000","last_change":"2024-04-19T04:28:02.835876+0000","last_active":"2024-04-19T04:28:12.285930+0000","last_peered":"2024-04-19T04:28:12.285930+0000","last_clean":"2024-04-19T04:28:12.285930+0000","last_became_active":"2024-04-19T04:28:02.835057+0000","last_became_peered":"2024-04-19T04:28:02.835057+0000","last_unstale":"2024-04-19T04:28:12.285930+0000","last_undegraded":"2024-04-19T04:28:12.285930+0000","last_fullsized":"2024-04-19T04:28:12.285930+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:18.104384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.084665+0000","last_change":"2024-04-19T04:24:20.555116+0000","last_active":"2024-04-19T04:28:12.084665+0000","last_peered":"2024-04-19T04:28:12.084665+0000","last_clean":"2024-04-19T04:28:12.084665+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:28:12.084665+0000","last_undegraded":"2024-04-19T04:28:12.084665+0000","last_fullsized":"2024-04-19T04:28:12.084665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:21.734428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286409+0000","last_change":"2024-04-19T04:28:02.840145+0000","last_active":"2024-04-19T04:28:12.286409+0000","last_peered":"2024-04-19T04:28:12.286409+0000","last_clean":"2024-04-19T04:28:12.286409+0000","last_became_active":"2024-04-19T04:28:02.838918+0000","last_became_peered":"2024-04-19T04:28:02.838918+0000","last_unstale":"2024-04-19T04:28:12.286409+0000","last_undegraded":"2024-04-19T04:28:12.286409+0000","last_fullsized":"2024-04-19T04:28:12.286409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:27.667000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095749+0000","last_change":"2024-04-19T04:28:12.092906+0000","last_active":"2024-04-19T04:28:12.095749+0000","last_peered":"2024-04-19T04:28:12.095749+0000","last_clean":"2024-04-19T04:28:12.095749+0000","last_became_active":"2024-04-19T04:28:12.091609+0000","last_became_peered":"2024-04-19T04:28:12.091609+0000","last_unstale":"2024-04-19T04:28:12.095749+0000","last_undegraded":"2024-04-19T04:28:12.095749+0000","last_fullsized":"2024-04-19T04:28:12.095749+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:42:50.079444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.770267+0000","last_change":"2024-04-19T04:28:12.092944+0000","last_active":"2024-04-19T04:28:13.770267+0000","last_peered":"2024-04-19T04:28:13.770267+0000","last_clean":"2024-04-19T04:28:13.770267+0000","last_became_active":"2024-04-19T04:28:12.091335+0000","last_became_peered":"2024-04-19T04:28:12.091335+0000","last_unstale":"2024-04-19T04:28:13.770267+0000","last_undegraded":"2024-04-19T04:28:13.770267+0000","last_fullsized":"2024-04-19T04:28:13.770267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:39:57.870227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287403+0000","last_change":"2024-04-19T04:28:02.843341+0000","last_active":"2024-04-19T04:28:12.287403+0000","last_peered":"2024-04-19T04:28:12.287403+0000","last_clean":"2024-04-19T04:28:12.287403+0000","last_became_active":"2024-04-19T04:28:02.839883+0000","last_became_peered":"2024-04-19T04:28:02.839883+0000","last_unstale":"2024-04-19T04:28:12.287403+0000","last_undegraded":"2024-04-19T04:28:12.287403+0000","last_fullsized":"2024-04-19T04:28:12.287403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:39:33.503440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286657+0000","last_change":"2024-04-19T04:28:02.845957+0000","last_active":"2024-04-19T04:28:12.286657+0000","last_peered":"2024-04-19T04:28:12.286657+0000","last_clean":"2024-04-19T04:28:12.286657+0000","last_became_active":"2024-04-19T04:28:02.845256+0000","last_became_peered":"2024-04-19T04:28:02.845256+0000","last_unstale":"2024-04-19T04:28:12.286657+0000","last_undegraded":"2024-04-19T04:28:12.286657+0000","last_fullsized":"2024-04-19T04:28:12.286657+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:28:34.674877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285602+0000","last_change":"2024-04-19T04:28:02.845275+0000","last_active":"2024-04-19T04:28:12.285602+0000","last_peered":"2024-04-19T04:28:12.285602+0000","last_clean":"2024-04-19T04:28:12.285602+0000","last_became_active":"2024-04-19T04:28:02.844128+0000","last_became_peered":"2024-04-19T04:28:02.844128+0000","last_unstale":"2024-04-19T04:28:12.285602+0000","last_undegraded":"2024-04-19T04:28:12.285602+0000","last_fullsized":"2024-04-19T04:28:12.285602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T16:08:59.450805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286896+0000","last_change":"2024-04-19T04:28:02.845918+0000","last_active":"2024-04-19T04:28:12.286896+0000","last_peered":"2024-04-19T04:28:12.286896+0000","last_clean":"2024-04-19T04:28:12.286896+0000","last_became_active":"2024-04-19T04:28:02.844483+0000","last_became_peered":"2024-04-19T04:28:02.844483+0000","last_unstale":"2024-04-19T04:28:12.286896+0000","last_undegraded":"2024-04-19T04:28:12.286896+0000","last_fullsized":"2024-04-19T04:28:12.286896+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:33:18.588838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080894+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:28:12.080894+0000","last_peered":"2024-04-19T04:28:12.080894+0000","last_clean":"2024-04-19T04:28:12.080894+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:28:12.080894+0000","last_undegraded":"2024-04-19T04:28:12.080894+0000","last_fullsized":"2024-04-19T04:28:12.080894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:45.574813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.770133+0000","last_change":"2024-04-19T04:28:12.091443+0000","last_active":"2024-04-19T04:28:13.770133+0000","last_peered":"2024-04-19T04:28:13.770133+0000","last_clean":"2024-04-19T04:28:13.770133+0000","last_became_active":"2024-04-19T04:28:12.088123+0000","last_became_peered":"2024-04-19T04:28:12.088123+0000","last_unstale":"2024-04-19T04:28:13.770133+0000","last_undegraded":"2024-04-19T04:28:13.770133+0000","last_fullsized":"2024-04-19T04:28:13.770133+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:46.736712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":71,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079124+0000","last_change":"2024-04-19T04:24:20.555406+0000","last_active":"2024-04-19T04:28:12.079124+0000","last_peered":"2024-04-19T04:28:12.079124+0000","last_clean":"2024-04-19T04:28:12.079124+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:28:12.079124+0000","last_undegraded":"2024-04-19T04:28:12.079124+0000","last_fullsized":"2024-04-19T04:28:12.079124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:10.453970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079781+0000","last_change":"2024-04-19T04:24:20.185978+0000","last_active":"2024-04-19T04:28:12.079781+0000","last_peered":"2024-04-19T04:28:12.079781+0000","last_clean":"2024-04-19T04:28:12.079781+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:28:12.079781+0000","last_undegraded":"2024-04-19T04:28:12.079781+0000","last_fullsized":"2024-04-19T04:28:12.079781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:48.158805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.286910+0000","last_change":"2024-04-19T04:28:02.842249+0000","last_active":"2024-04-19T04:28:12.286910+0000","last_peered":"2024-04-19T04:28:12.286910+0000","last_clean":"2024-04-19T04:28:12.286910+0000","last_became_active":"2024-04-19T04:28:02.841373+0000","last_became_peered":"2024-04-19T04:28:02.841373+0000","last_unstale":"2024-04-19T04:28:12.286910+0000","last_undegraded":"2024-04-19T04:28:12.286910+0000","last_fullsized":"2024-04-19T04:28:12.286910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.571164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.770448+0000","last_change":"2024-04-19T04:28:12.094542+0000","last_active":"2024-04-19T04:28:13.770448+0000","last_peered":"2024-04-19T04:28:13.770448+0000","last_clean":"2024-04-19T04:28:13.770448+0000","last_became_active":"2024-04-19T04:28:12.092784+0000","last_became_peered":"2024-04-19T04:28:12.092784+0000","last_unstale":"2024-04-19T04:28:13.770448+0000","last_undegraded":"2024-04-19T04:28:13.770448+0000","last_fullsized":"2024-04-19T04:28:13.770448+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:49.750510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.080472+0000","last_change":"2024-04-19T04:28:02.638882+0000","last_active":"2024-04-19T04:28:12.080472+0000","last_peered":"2024-04-19T04:28:12.080472+0000","last_clean":"2024-04-19T04:28:12.080472+0000","last_became_active":"2024-04-19T04:28:02.638431+0000","last_became_peered":"2024-04-19T04:28:02.638431+0000","last_unstale":"2024-04-19T04:28:12.080472+0000","last_undegraded":"2024-04-19T04:28:12.080472+0000","last_fullsized":"2024-04-19T04:28:12.080472+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:32.548608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285755+0000","last_change":"2024-04-19T04:28:02.841112+0000","last_active":"2024-04-19T04:28:12.285755+0000","last_peered":"2024-04-19T04:28:12.285755+0000","last_clean":"2024-04-19T04:28:12.285755+0000","last_became_active":"2024-04-19T04:28:02.838354+0000","last_became_peered":"2024-04-19T04:28:02.838354+0000","last_unstale":"2024-04-19T04:28:12.285755+0000","last_undegraded":"2024-04-19T04:28:12.285755+0000","last_fullsized":"2024-04-19T04:28:12.285755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:44:35.127227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287919+0000","last_change":"2024-04-19T04:28:02.838446+0000","last_active":"2024-04-19T04:28:12.287919+0000","last_peered":"2024-04-19T04:28:12.287919+0000","last_clean":"2024-04-19T04:28:12.287919+0000","last_became_active":"2024-04-19T04:28:02.837994+0000","last_became_peered":"2024-04-19T04:28:02.837994+0000","last_unstale":"2024-04-19T04:28:12.287919+0000","last_undegraded":"2024-04-19T04:28:12.287919+0000","last_fullsized":"2024-04-19T04:28:12.287919+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:01:07.160911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285381+0000","last_change":"2024-04-19T04:28:02.837195+0000","last_active":"2024-04-19T04:28:12.285381+0000","last_peered":"2024-04-19T04:28:12.285381+0000","last_clean":"2024-04-19T04:28:12.285381+0000","last_became_active":"2024-04-19T04:28:02.836818+0000","last_became_peered":"2024-04-19T04:28:02.836818+0000","last_unstale":"2024-04-19T04:28:12.285381+0000","last_undegraded":"2024-04-19T04:28:12.285381+0000","last_fullsized":"2024-04-19T04:28:12.285381+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:10:12.924030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.088190+0000","last_change":"2024-04-19T04:24:20.552644+0000","last_active":"2024-04-19T04:28:12.088190+0000","last_peered":"2024-04-19T04:28:12.088190+0000","last_clean":"2024-04-19T04:28:12.088190+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:28:12.088190+0000","last_undegraded":"2024-04-19T04:28:12.088190+0000","last_fullsized":"2024-04-19T04:28:12.088190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:22.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285114+0000","last_change":"2024-04-19T04:28:02.839065+0000","last_active":"2024-04-19T04:28:12.285114+0000","last_peered":"2024-04-19T04:28:12.285114+0000","last_clean":"2024-04-19T04:28:12.285114+0000","last_became_active":"2024-04-19T04:28:02.837400+0000","last_became_peered":"2024-04-19T04:28:02.837400+0000","last_unstale":"2024-04-19T04:28:12.285114+0000","last_undegraded":"2024-04-19T04:28:12.285114+0000","last_fullsized":"2024-04-19T04:28:12.285114+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:05:54.339418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.287287+0000","last_change":"2024-04-19T04:28:02.845777+0000","last_active":"2024-04-19T04:28:12.287287+0000","last_peered":"2024-04-19T04:28:12.287287+0000","last_clean":"2024-04-19T04:28:12.287287+0000","last_became_active":"2024-04-19T04:28:02.844057+0000","last_became_peered":"2024-04-19T04:28:02.844057+0000","last_unstale":"2024-04-19T04:28:12.287287+0000","last_undegraded":"2024-04-19T04:28:12.287287+0000","last_fullsized":"2024-04-19T04:28:12.287287+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:47:53.420459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.285255+0000","last_change":"2024-04-19T04:28:02.837131+0000","last_active":"2024-04-19T04:28:12.285255+0000","last_peered":"2024-04-19T04:28:12.285255+0000","last_clean":"2024-04-19T04:28:12.285255+0000","last_became_active":"2024-04-19T04:28:02.836492+0000","last_became_peered":"2024-04-19T04:28:02.836492+0000","last_unstale":"2024-04-19T04:28:12.285255+0000","last_undegraded":"2024-04-19T04:28:12.285255+0000","last_fullsized":"2024-04-19T04:28:12.285255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:02.952851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.770390+0000","last_change":"2024-04-19T04:28:12.095836+0000","last_active":"2024-04-19T04:28:13.770390+0000","last_peered":"2024-04-19T04:28:13.770390+0000","last_clean":"2024-04-19T04:28:13.770390+0000","last_became_active":"2024-04-19T04:28:12.095332+0000","last_became_peered":"2024-04-19T04:28:12.095332+0000","last_unstale":"2024-04-19T04:28:13.770390+0000","last_undegraded":"2024-04-19T04:28:13.770390+0000","last_fullsized":"2024-04-19T04:28:13.770390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:43:51.926940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":69,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.095389+0000","last_change":"2024-04-19T04:28:12.092977+0000","last_active":"2024-04-19T04:28:12.095389+0000","last_peered":"2024-04-19T04:28:12.095389+0000","last_clean":"2024-04-19T04:28:12.095389+0000","last_became_active":"2024-04-19T04:28:12.090262+0000","last_became_peered":"2024-04-19T04:28:12.090262+0000","last_unstale":"2024-04-19T04:28:12.095389+0000","last_undegraded":"2024-04-19T04:28:12.095389+0000","last_fullsized":"2024-04-19T04:28:12.095389+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:39.131554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":67,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.097597+0000","last_change":"2024-04-19T04:28:12.093601+0000","last_active":"2024-04-19T04:28:12.097597+0000","last_peered":"2024-04-19T04:28:12.097597+0000","last_clean":"2024-04-19T04:28:12.097597+0000","last_became_active":"2024-04-19T04:28:12.092979+0000","last_became_peered":"2024-04-19T04:28:12.092979+0000","last_unstale":"2024-04-19T04:28:12.097597+0000","last_undegraded":"2024-04-19T04:28:12.097597+0000","last_fullsized":"2024-04-19T04:28:12.097597+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:28:58.381121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.770304+0000","last_change":"2024-04-19T04:28:12.094560+0000","last_active":"2024-04-19T04:28:13.770304+0000","last_peered":"2024-04-19T04:28:13.770304+0000","last_clean":"2024-04-19T04:28:13.770304+0000","last_became_active":"2024-04-19T04:28:12.093915+0000","last_became_peered":"2024-04-19T04:28:12.093915+0000","last_unstale":"2024-04-19T04:28:13.770304+0000","last_undegraded":"2024-04-19T04:28:13.770304+0000","last_fullsized":"2024-04-19T04:28:13.770304+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:11:26.070147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078961+0000","last_change":"2024-04-19T04:28:02.639054+0000","last_active":"2024-04-19T04:28:12.078961+0000","last_peered":"2024-04-19T04:28:12.078961+0000","last_clean":"2024-04-19T04:28:12.078961+0000","last_became_active":"2024-04-19T04:28:02.637952+0000","last_became_peered":"2024-04-19T04:28:02.637952+0000","last_unstale":"2024-04-19T04:28:12.078961+0000","last_undegraded":"2024-04-19T04:28:12.078961+0000","last_fullsized":"2024-04-19T04:28:12.078961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:00:22.017021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":87,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079496+0000","last_change":"2024-04-19T04:28:02.635226+0000","last_active":"2024-04-19T04:28:12.079496+0000","last_peered":"2024-04-19T04:28:12.079496+0000","last_clean":"2024-04-19T04:28:12.079496+0000","last_became_active":"2024-04-19T04:28:02.634226+0000","last_became_peered":"2024-04-19T04:28:02.634226+0000","last_unstale":"2024-04-19T04:28:12.079496+0000","last_undegraded":"2024-04-19T04:28:12.079496+0000","last_fullsized":"2024-04-19T04:28:12.079496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:07.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.079565+0000","last_change":"2024-04-19T04:28:02.636657+0000","last_active":"2024-04-19T04:28:12.079565+0000","last_peered":"2024-04-19T04:28:12.079565+0000","last_clean":"2024-04-19T04:28:12.079565+0000","last_became_active":"2024-04-19T04:28:02.636266+0000","last_became_peered":"2024-04-19T04:28:02.636266+0000","last_unstale":"2024-04-19T04:28:12.079565+0000","last_undegraded":"2024-04-19T04:28:12.079565+0000","last_fullsized":"2024-04-19T04:28:12.079565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:20:16.458945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.770424+0000","last_change":"2024-04-19T04:28:12.095797+0000","last_active":"2024-04-19T04:28:13.770424+0000","last_peered":"2024-04-19T04:28:13.770424+0000","last_clean":"2024-04-19T04:28:13.770424+0000","last_became_active":"2024-04-19T04:28:12.095199+0000","last_became_peered":"2024-04-19T04:28:12.095199+0000","last_unstale":"2024-04-19T04:28:13.770424+0000","last_undegraded":"2024-04-19T04:28:13.770424+0000","last_fullsized":"2024-04-19T04:28:13.770424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:28.634271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":67,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.094231+0000","last_change":"2024-04-19T04:28:12.091303+0000","last_active":"2024-04-19T04:28:12.094231+0000","last_peered":"2024-04-19T04:28:12.094231+0000","last_clean":"2024-04-19T04:28:12.094231+0000","last_became_active":"2024-04-19T04:28:12.087884+0000","last_became_peered":"2024-04-19T04:28:12.087884+0000","last_unstale":"2024-04-19T04:28:12.094231+0000","last_undegraded":"2024-04-19T04:28:12.094231+0000","last_fullsized":"2024-04-19T04:28:12.094231+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:01:12.373663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288082+0000","last_change":"2024-04-19T04:28:02.846538+0000","last_active":"2024-04-19T04:28:12.288082+0000","last_peered":"2024-04-19T04:28:12.288082+0000","last_clean":"2024-04-19T04:28:12.288082+0000","last_became_active":"2024-04-19T04:28:02.846234+0000","last_became_peered":"2024-04-19T04:28:02.846234+0000","last_unstale":"2024-04-19T04:28:12.288082+0000","last_undegraded":"2024-04-19T04:28:12.288082+0000","last_fullsized":"2024-04-19T04:28:12.288082+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:08.165785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.078454+0000","last_change":"2024-04-19T04:28:02.635122+0000","last_active":"2024-04-19T04:28:12.078454+0000","last_peered":"2024-04-19T04:28:12.078454+0000","last_clean":"2024-04-19T04:28:12.078454+0000","last_became_active":"2024-04-19T04:28:02.634433+0000","last_became_peered":"2024-04-19T04:28:02.634433+0000","last_unstale":"2024-04-19T04:28:12.078454+0000","last_undegraded":"2024-04-19T04:28:12.078454+0000","last_fullsized":"2024-04-19T04:28:12.078454+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:40.139486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T04:28:12.288286+0000","last_change":"2024-04-19T04:28:02.844897+0000","last_active":"2024-04-19T04:28:12.288286+0000","last_peered":"2024-04-19T04:28:12.288286+0000","last_clean":"2024-04-19T04:28:12.288286+0000","last_became_active":"2024-04-19T04:28:02.844276+0000","last_became_peered":"2024-04-19T04:28:02.844276+0000","last_unstale":"2024-04-19T04:28:12.288286+0000","last_undegraded":"2024-04-19T04:28:12.288286+0000","last_fullsized":"2024-04-19T04:28:12.288286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:45.100544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705719,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220712,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151128,"statfs":{"total":96636764160,"available":96410755072,"internally_reserved":0,"allocated":946176,"data_stored":926258,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 04:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.624,"15min":0.755},"min":{"1min":0.51700000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.85099999999999998,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.67400000000000004,"5min":0.248,"15min":0.248},"max":{"1min":1.087,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.087}]},{"osd":1,"last update":"Fri Apr 19 04:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":5.1989999999999998,"5min":5.1989999999999998,"15min":5.1989999999999998},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":0.90200000000000002}]}]},{"osd":1,"up_from":72,"seq":309237645317,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44128,"kb_used_data":844,"kb_used_omap":6,"kb_used_meta":43257,"kb_avail":94327712,"statfs":{"total":96636764160,"available":96591577088,"internally_reserved":0,"allocated":864256,"data_stored":334760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6880,"internal_metadata":44295456},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298668,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297726,"kb_avail":94073172,"statfs":{"total":96636764160,"available":96330928128,"internally_reserved":0,"allocated":950272,"data_stored":924740,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":304871878},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 04:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.61899999999999999}]},{"osd":2,"last update":"Fri Apr 19 04:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.56899999999999995,"5min":0.223,"15min":0.223},"max":{"1min":0.75900000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65700000000000003,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.77900000000000003,"5min":4.5,"15min":4.5},"last":0.73999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:28:20.831 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.832 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.832 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.832 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.832 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.832 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.833 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.833 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.833 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.833 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.834 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.834 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.834 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.835 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.835 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.835 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.835 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.835 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.835 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.836 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.836 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.836 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.836 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.836 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.836 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.837 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.837 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.837 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.837 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.837 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.838 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.838 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.838 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.839 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.839 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.839 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.839 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.839 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.839 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.840 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.840 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.840 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.840 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.840 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.840 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.841 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.841 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.841 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.841 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.841 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.841 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.842 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.842 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.842 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.842 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.843 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.843 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T04:24:09.083488+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.843 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.843 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.843 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.843 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.844 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.844 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.844 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.844 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.844 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.844 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.845 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.845 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.845 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.845 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.845 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.846 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.846 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.846 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.846 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.847 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.847 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.847 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.847 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.847 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.848 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.848 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.848 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.848 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.848 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.848 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.849 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.849 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.849 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.849 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.849 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.850 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.850 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.850 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.850 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.850 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.850 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.851 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.851 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.851 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.851 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.851 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.851 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.851 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:20.851 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T04:28:40.853 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:28:41.178 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:28:41.180 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:28:41.195 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-04-19T04:28:40.995428+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":563488,"kb_used_data":2696,"kb_used_omap":9,"kb_used_meta":560758,"kb_avail":282552032,"statfs":{"total":289910292480,"available":289333280768,"internally_reserved":0,"allocated":2760704,"data_stored":2185758,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":10068,"internal_metadata":574216364},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004599"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:24.524670+0000","last_change":"2024-04-19T04:28:24.524670+0000","last_active":"2024-04-19T04:28:24.524670+0000","last_peered":"2024-04-19T04:28:24.524670+0000","last_clean":"2024-04-19T04:28:24.524670+0000","last_became_active":"2024-04-19T04:28:12.093175+0000","last_became_peered":"2024-04-19T04:28:12.093175+0000","last_unstale":"2024-04-19T04:28:24.524670+0000","last_undegraded":"2024-04-19T04:28:24.524670+0000","last_fullsized":"2024-04-19T04:28:24.524670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:24.524536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:24.524536+0000","last_clean_scrub_stamp":"2024-04-19T04:28:24.524536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:34:39.154898+0000","scrub_duration":0.080942869000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:25.440827+0000","last_change":"2024-04-19T04:28:25.440827+0000","last_active":"2024-04-19T04:28:25.440827+0000","last_peered":"2024-04-19T04:28:25.440827+0000","last_clean":"2024-04-19T04:28:25.440827+0000","last_became_active":"2024-04-19T04:28:12.092819+0000","last_became_peered":"2024-04-19T04:28:12.092819+0000","last_unstale":"2024-04-19T04:28:25.440827+0000","last_undegraded":"2024-04-19T04:28:25.440827+0000","last_fullsized":"2024-04-19T04:28:25.440827+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:25.440548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:25.440548+0000","last_clean_scrub_stamp":"2024-04-19T04:28:25.440548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:40.485315+0000","scrub_duration":0.0035723539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481982+0000","last_change":"2024-04-19T04:24:20.556199+0000","last_active":"2024-04-19T04:28:19.481982+0000","last_peered":"2024-04-19T04:28:19.481982+0000","last_clean":"2024-04-19T04:28:19.481982+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:28:19.481982+0000","last_undegraded":"2024-04-19T04:28:19.481982+0000","last_fullsized":"2024-04-19T04:28:19.481982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481947+0000","last_change":"2024-04-19T04:28:02.635437+0000","last_active":"2024-04-19T04:28:19.481947+0000","last_peered":"2024-04-19T04:28:19.481947+0000","last_clean":"2024-04-19T04:28:19.481947+0000","last_became_active":"2024-04-19T04:28:02.634355+0000","last_became_peered":"2024-04-19T04:28:02.634355+0000","last_unstale":"2024-04-19T04:28:19.481947+0000","last_undegraded":"2024-04-19T04:28:19.481947+0000","last_fullsized":"2024-04-19T04:28:19.481947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:34.504737+0000","last_change":"2024-04-19T04:28:34.505005+0000","last_active":"2024-04-19T04:28:34.504737+0000","last_peered":"2024-04-19T04:28:34.504737+0000","last_clean":"2024-04-19T04:28:34.504737+0000","last_became_active":"2024-04-19T04:28:12.088231+0000","last_became_peered":"2024-04-19T04:28:12.088231+0000","last_unstale":"2024-04-19T04:28:34.504737+0000","last_undegraded":"2024-04-19T04:28:34.504737+0000","last_fullsized":"2024-04-19T04:28:34.504737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:34.504692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:34.504692+0000","last_clean_scrub_stamp":"2024-04-19T04:28:34.504692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:54:14.305698+0000","scrub_duration":0.021028397000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094332+0000","last_change":"2024-04-19T04:28:02.637742+0000","last_active":"2024-04-19T04:28:13.094332+0000","last_peered":"2024-04-19T04:28:13.094332+0000","last_clean":"2024-04-19T04:28:13.094332+0000","last_became_active":"2024-04-19T04:28:02.637276+0000","last_became_peered":"2024-04-19T04:28:02.637276+0000","last_unstale":"2024-04-19T04:28:13.094332+0000","last_undegraded":"2024-04-19T04:28:13.094332+0000","last_fullsized":"2024-04-19T04:28:13.094332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094312+0000","last_change":"2024-04-19T04:28:02.637532+0000","last_active":"2024-04-19T04:28:13.094312+0000","last_peered":"2024-04-19T04:28:13.094312+0000","last_clean":"2024-04-19T04:28:13.094312+0000","last_became_active":"2024-04-19T04:28:02.637086+0000","last_became_peered":"2024-04-19T04:28:02.637086+0000","last_unstale":"2024-04-19T04:28:13.094312+0000","last_undegraded":"2024-04-19T04:28:13.094312+0000","last_fullsized":"2024-04-19T04:28:13.094312+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.093753+0000","last_change":"2024-04-19T04:28:02.638186+0000","last_active":"2024-04-19T04:28:13.093753+0000","last_peered":"2024-04-19T04:28:13.093753+0000","last_clean":"2024-04-19T04:28:13.093753+0000","last_became_active":"2024-04-19T04:28:02.637746+0000","last_became_peered":"2024-04-19T04:28:02.637746+0000","last_unstale":"2024-04-19T04:28:13.093753+0000","last_undegraded":"2024-04-19T04:28:13.093753+0000","last_fullsized":"2024-04-19T04:28:13.093753+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303296+0000","last_change":"2024-04-19T04:28:02.842455+0000","last_active":"2024-04-19T04:28:13.303296+0000","last_peered":"2024-04-19T04:28:13.303296+0000","last_clean":"2024-04-19T04:28:13.303296+0000","last_became_active":"2024-04-19T04:28:02.839203+0000","last_became_peered":"2024-04-19T04:28:02.839203+0000","last_unstale":"2024-04-19T04:28:13.303296+0000","last_undegraded":"2024-04-19T04:28:13.303296+0000","last_fullsized":"2024-04-19T04:28:13.303296+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.256903+0000","last_change":"2024-04-19T04:28:12.093403+0000","last_active":"2024-04-19T04:28:15.256903+0000","last_peered":"2024-04-19T04:28:15.256903+0000","last_clean":"2024-04-19T04:28:15.256903+0000","last_became_active":"2024-04-19T04:28:12.092924+0000","last_became_peered":"2024-04-19T04:28:12.092924+0000","last_unstale":"2024-04-19T04:28:15.256903+0000","last_undegraded":"2024-04-19T04:28:15.256903+0000","last_fullsized":"2024-04-19T04:28:15.256903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.095339+0000","last_change":"2024-04-19T04:28:02.636293+0000","last_active":"2024-04-19T04:28:13.095339+0000","last_peered":"2024-04-19T04:28:13.095339+0000","last_clean":"2024-04-19T04:28:13.095339+0000","last_became_active":"2024-04-19T04:28:02.635946+0000","last_became_peered":"2024-04-19T04:28:02.635946+0000","last_unstale":"2024-04-19T04:28:13.095339+0000","last_undegraded":"2024-04-19T04:28:13.095339+0000","last_fullsized":"2024-04-19T04:28:13.095339+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:35.526927+0000","last_change":"2024-04-19T04:28:35.527163+0000","last_active":"2024-04-19T04:28:35.526927+0000","last_peered":"2024-04-19T04:28:35.526927+0000","last_clean":"2024-04-19T04:28:35.526927+0000","last_became_active":"2024-04-19T04:28:12.094753+0000","last_became_peered":"2024-04-19T04:28:12.094753+0000","last_unstale":"2024-04-19T04:28:35.526927+0000","last_undegraded":"2024-04-19T04:28:35.526927+0000","last_fullsized":"2024-04-19T04:28:35.526927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:35.526884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:35.526884+0000","last_clean_scrub_stamp":"2024-04-19T04:28:35.526884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:06:35.618252+0000","scrub_duration":0.0031760289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.256177+0000","last_change":"2024-04-19T04:28:12.093953+0000","last_active":"2024-04-19T04:28:15.256177+0000","last_peered":"2024-04-19T04:28:15.256177+0000","last_clean":"2024-04-19T04:28:15.256177+0000","last_became_active":"2024-04-19T04:28:12.093267+0000","last_became_peered":"2024-04-19T04:28:12.093267+0000","last_unstale":"2024-04-19T04:28:15.256177+0000","last_undegraded":"2024-04-19T04:28:15.256177+0000","last_fullsized":"2024-04-19T04:28:15.256177+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:23.449546+0000","last_change":"2024-04-19T04:28:23.449786+0000","last_active":"2024-04-19T04:28:23.449546+0000","last_peered":"2024-04-19T04:28:23.449546+0000","last_clean":"2024-04-19T04:28:23.449546+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:28:23.449546+0000","last_undegraded":"2024-04-19T04:28:23.449546+0000","last_fullsized":"2024-04-19T04:28:23.449546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:23.449500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:23.449500+0000","last_clean_scrub_stamp":"2024-04-19T04:28:23.449500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:20.102454+0000","scrub_duration":0.0033193469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094619+0000","last_change":"2024-04-19T04:24:20.551809+0000","last_active":"2024-04-19T04:28:13.094619+0000","last_peered":"2024-04-19T04:28:13.094619+0000","last_clean":"2024-04-19T04:28:13.094619+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:28:13.094619+0000","last_undegraded":"2024-04-19T04:28:13.094619+0000","last_fullsized":"2024-04-19T04:28:13.094619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:33.597517+0000","last_change":"2024-04-19T04:28:33.597905+0000","last_active":"2024-04-19T04:28:33.597517+0000","last_peered":"2024-04-19T04:28:33.597517+0000","last_clean":"2024-04-19T04:28:33.597517+0000","last_became_active":"2024-04-19T04:28:02.637920+0000","last_became_peered":"2024-04-19T04:28:02.637920+0000","last_unstale":"2024-04-19T04:28:33.597517+0000","last_undegraded":"2024-04-19T04:28:33.597517+0000","last_fullsized":"2024-04-19T04:28:33.597517+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:33.597411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:33.597411+0000","last_clean_scrub_stamp":"2024-04-19T04:28:33.597411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:50.250390+0000","scrub_duration":0.0037610339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303284+0000","last_change":"2024-04-19T04:28:02.841438+0000","last_active":"2024-04-19T04:28:13.303284+0000","last_peered":"2024-04-19T04:28:13.303284+0000","last_clean":"2024-04-19T04:28:13.303284+0000","last_became_active":"2024-04-19T04:28:02.839071+0000","last_became_peered":"2024-04-19T04:28:02.839071+0000","last_unstale":"2024-04-19T04:28:13.303284+0000","last_undegraded":"2024-04-19T04:28:13.303284+0000","last_fullsized":"2024-04-19T04:28:13.303284+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.257184+0000","last_change":"2024-04-19T04:28:02.638587+0000","last_active":"2024-04-19T04:28:15.257184+0000","last_peered":"2024-04-19T04:28:15.257184+0000","last_clean":"2024-04-19T04:28:15.257184+0000","last_became_active":"2024-04-19T04:28:02.638230+0000","last_became_peered":"2024-04-19T04:28:02.638230+0000","last_unstale":"2024-04-19T04:28:15.257184+0000","last_undegraded":"2024-04-19T04:28:15.257184+0000","last_fullsized":"2024-04-19T04:28:15.257184+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:31.226313+0000","last_change":"2024-04-19T04:28:31.226446+0000","last_active":"2024-04-19T04:28:31.226313+0000","last_peered":"2024-04-19T04:28:31.226313+0000","last_clean":"2024-04-19T04:28:31.226313+0000","last_became_active":"2024-04-19T04:28:02.839362+0000","last_became_peered":"2024-04-19T04:28:02.839362+0000","last_unstale":"2024-04-19T04:28:31.226313+0000","last_undegraded":"2024-04-19T04:28:31.226313+0000","last_fullsized":"2024-04-19T04:28:31.226313+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:31.226291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:31.226291+0000","last_clean_scrub_stamp":"2024-04-19T04:28:31.226291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:43:05.235533+0000","scrub_duration":0.029412667999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:28.515827+0000","last_change":"2024-04-19T04:28:28.516191+0000","last_active":"2024-04-19T04:28:28.515827+0000","last_peered":"2024-04-19T04:28:28.515827+0000","last_clean":"2024-04-19T04:28:28.515827+0000","last_became_active":"2024-04-19T04:28:02.634835+0000","last_became_peered":"2024-04-19T04:28:02.634835+0000","last_unstale":"2024-04-19T04:28:28.515827+0000","last_undegraded":"2024-04-19T04:28:28.515827+0000","last_fullsized":"2024-04-19T04:28:28.515827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:28.515710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:28.515710+0000","last_clean_scrub_stamp":"2024-04-19T04:28:28.515710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:46.923636+0000","scrub_duration":0.0034446709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.095028+0000","last_change":"2024-04-19T04:28:02.639259+0000","last_active":"2024-04-19T04:28:13.095028+0000","last_peered":"2024-04-19T04:28:13.095028+0000","last_clean":"2024-04-19T04:28:13.095028+0000","last_became_active":"2024-04-19T04:28:02.638546+0000","last_became_peered":"2024-04-19T04:28:02.638546+0000","last_unstale":"2024-04-19T04:28:13.095028+0000","last_undegraded":"2024-04-19T04:28:13.095028+0000","last_fullsized":"2024-04-19T04:28:13.095028+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.256153+0000","last_change":"2024-04-19T04:28:12.089576+0000","last_active":"2024-04-19T04:28:15.256153+0000","last_peered":"2024-04-19T04:28:15.256153+0000","last_clean":"2024-04-19T04:28:15.256153+0000","last_became_active":"2024-04-19T04:28:12.087571+0000","last_became_peered":"2024-04-19T04:28:12.087571+0000","last_unstale":"2024-04-19T04:28:15.256153+0000","last_undegraded":"2024-04-19T04:28:15.256153+0000","last_fullsized":"2024-04-19T04:28:15.256153+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:34.194332+0000","last_change":"2024-04-19T04:28:34.194663+0000","last_active":"2024-04-19T04:28:34.194332+0000","last_peered":"2024-04-19T04:28:34.194332+0000","last_clean":"2024-04-19T04:28:34.194332+0000","last_became_active":"2024-04-19T04:28:02.840294+0000","last_became_peered":"2024-04-19T04:28:02.840294+0000","last_unstale":"2024-04-19T04:28:34.194332+0000","last_undegraded":"2024-04-19T04:28:34.194332+0000","last_fullsized":"2024-04-19T04:28:34.194332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:34.194285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:34.194285+0000","last_clean_scrub_stamp":"2024-04-19T04:28:34.194285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:53:04.918350+0000","scrub_duration":0.0033717299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.255403+0000","last_change":"2024-04-19T04:28:12.090413+0000","last_active":"2024-04-19T04:28:15.255403+0000","last_peered":"2024-04-19T04:28:15.255403+0000","last_clean":"2024-04-19T04:28:15.255403+0000","last_became_active":"2024-04-19T04:28:12.089918+0000","last_became_peered":"2024-04-19T04:28:12.089918+0000","last_unstale":"2024-04-19T04:28:15.255403+0000","last_undegraded":"2024-04-19T04:28:15.255403+0000","last_fullsized":"2024-04-19T04:28:15.255403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.257493+0000","last_change":"2024-04-19T04:28:12.092733+0000","last_active":"2024-04-19T04:28:15.257493+0000","last_peered":"2024-04-19T04:28:15.257493+0000","last_clean":"2024-04-19T04:28:15.257493+0000","last_became_active":"2024-04-19T04:28:12.091770+0000","last_became_peered":"2024-04-19T04:28:12.091770+0000","last_unstale":"2024-04-19T04:28:15.257493+0000","last_undegraded":"2024-04-19T04:28:15.257493+0000","last_fullsized":"2024-04-19T04:28:15.257493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303363+0000","last_change":"2024-04-19T04:28:02.846092+0000","last_active":"2024-04-19T04:28:13.303363+0000","last_peered":"2024-04-19T04:28:13.303363+0000","last_clean":"2024-04-19T04:28:13.303363+0000","last_became_active":"2024-04-19T04:28:02.845416+0000","last_became_peered":"2024-04-19T04:28:02.845416+0000","last_unstale":"2024-04-19T04:28:13.303363+0000","last_undegraded":"2024-04-19T04:28:13.303363+0000","last_fullsized":"2024-04-19T04:28:13.303363+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.096067+0000","last_change":"2024-04-19T04:24:20.554885+0000","last_active":"2024-04-19T04:28:13.096067+0000","last_peered":"2024-04-19T04:28:13.096067+0000","last_clean":"2024-04-19T04:28:13.096067+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:28:13.096067+0000","last_undegraded":"2024-04-19T04:28:13.096067+0000","last_fullsized":"2024-04-19T04:28:13.096067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.257086+0000","last_change":"2024-04-19T04:28:12.092936+0000","last_active":"2024-04-19T04:28:15.257086+0000","last_peered":"2024-04-19T04:28:15.257086+0000","last_clean":"2024-04-19T04:28:15.257086+0000","last_became_active":"2024-04-19T04:28:12.091969+0000","last_became_peered":"2024-04-19T04:28:12.091969+0000","last_unstale":"2024-04-19T04:28:15.257086+0000","last_undegraded":"2024-04-19T04:28:15.257086+0000","last_fullsized":"2024-04-19T04:28:15.257086+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.301593+0000","last_change":"2024-04-19T04:28:02.845150+0000","last_active":"2024-04-19T04:28:13.301593+0000","last_peered":"2024-04-19T04:28:13.301593+0000","last_clean":"2024-04-19T04:28:13.301593+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:28:13.301593+0000","last_undegraded":"2024-04-19T04:28:13.301593+0000","last_fullsized":"2024-04-19T04:28:13.301593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:20.465854+0000","last_change":"2024-04-19T04:24:20.554847+0000","last_active":"2024-04-19T04:28:20.465854+0000","last_peered":"2024-04-19T04:28:20.465854+0000","last_clean":"2024-04-19T04:28:20.465854+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:28:20.465854+0000","last_undegraded":"2024-04-19T04:28:20.465854+0000","last_fullsized":"2024-04-19T04:28:20.465854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302725+0000","last_change":"2024-04-19T04:28:02.843590+0000","last_active":"2024-04-19T04:28:13.302725+0000","last_peered":"2024-04-19T04:28:13.302725+0000","last_clean":"2024-04-19T04:28:13.302725+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:28:13.302725+0000","last_undegraded":"2024-04-19T04:28:13.302725+0000","last_fullsized":"2024-04-19T04:28:13.302725+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481710+0000","last_change":"2024-04-19T04:28:02.635119+0000","last_active":"2024-04-19T04:28:19.481710+0000","last_peered":"2024-04-19T04:28:19.481710+0000","last_clean":"2024-04-19T04:28:19.481710+0000","last_became_active":"2024-04-19T04:28:02.634586+0000","last_became_peered":"2024-04-19T04:28:02.634586+0000","last_unstale":"2024-04-19T04:28:19.481710+0000","last_undegraded":"2024-04-19T04:28:19.481710+0000","last_fullsized":"2024-04-19T04:28:19.481710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.256810+0000","last_change":"2024-04-19T04:28:12.095305+0000","last_active":"2024-04-19T04:28:15.256810+0000","last_peered":"2024-04-19T04:28:15.256810+0000","last_clean":"2024-04-19T04:28:15.256810+0000","last_became_active":"2024-04-19T04:28:12.094558+0000","last_became_peered":"2024-04-19T04:28:12.094558+0000","last_unstale":"2024-04-19T04:28:15.256810+0000","last_undegraded":"2024-04-19T04:28:15.256810+0000","last_fullsized":"2024-04-19T04:28:15.256810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.095264+0000","last_change":"2024-04-19T04:28:02.639581+0000","last_active":"2024-04-19T04:28:13.095264+0000","last_peered":"2024-04-19T04:28:13.095264+0000","last_clean":"2024-04-19T04:28:13.095264+0000","last_became_active":"2024-04-19T04:28:02.638666+0000","last_became_peered":"2024-04-19T04:28:02.638666+0000","last_unstale":"2024-04-19T04:28:13.095264+0000","last_undegraded":"2024-04-19T04:28:13.095264+0000","last_fullsized":"2024-04-19T04:28:13.095264+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.256930+0000","last_change":"2024-04-19T04:28:12.095631+0000","last_active":"2024-04-19T04:28:15.256930+0000","last_peered":"2024-04-19T04:28:15.256930+0000","last_clean":"2024-04-19T04:28:15.256930+0000","last_became_active":"2024-04-19T04:28:12.094722+0000","last_became_peered":"2024-04-19T04:28:12.094722+0000","last_unstale":"2024-04-19T04:28:15.256930+0000","last_undegraded":"2024-04-19T04:28:15.256930+0000","last_fullsized":"2024-04-19T04:28:15.256930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.301761+0000","last_change":"2024-04-19T04:28:02.843299+0000","last_active":"2024-04-19T04:28:13.301761+0000","last_peered":"2024-04-19T04:28:13.301761+0000","last_clean":"2024-04-19T04:28:13.301761+0000","last_became_active":"2024-04-19T04:28:02.842525+0000","last_became_peered":"2024-04-19T04:28:02.842525+0000","last_unstale":"2024-04-19T04:28:13.301761+0000","last_undegraded":"2024-04-19T04:28:13.301761+0000","last_fullsized":"2024-04-19T04:28:13.301761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.151861+0000","last_change":"2024-04-19T04:28:40.152096+0000","last_active":"2024-04-19T04:28:40.151861+0000","last_peered":"2024-04-19T04:28:40.151861+0000","last_clean":"2024-04-19T04:28:40.151861+0000","last_became_active":"2024-04-19T04:28:02.843099+0000","last_became_peered":"2024-04-19T04:28:02.843099+0000","last_unstale":"2024-04-19T04:28:40.151861+0000","last_undegraded":"2024-04-19T04:28:40.151861+0000","last_fullsized":"2024-04-19T04:28:40.151861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.151812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.151812+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.151812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:19.753268+0000","scrub_duration":0.0030712460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:29.541159+0000","last_change":"2024-04-19T04:28:29.541420+0000","last_active":"2024-04-19T04:28:29.541159+0000","last_peered":"2024-04-19T04:28:29.541159+0000","last_clean":"2024-04-19T04:28:29.541159+0000","last_became_active":"2024-04-19T04:28:12.091771+0000","last_became_peered":"2024-04-19T04:28:12.091771+0000","last_unstale":"2024-04-19T04:28:29.541159+0000","last_undegraded":"2024-04-19T04:28:29.541159+0000","last_fullsized":"2024-04-19T04:28:29.541159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:29.541116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:29.541116+0000","last_clean_scrub_stamp":"2024-04-19T04:28:29.541116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:42.022636+0000","scrub_duration":0.0033350189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302998+0000","last_change":"2024-04-19T04:28:02.837331+0000","last_active":"2024-04-19T04:28:13.302998+0000","last_peered":"2024-04-19T04:28:13.302998+0000","last_clean":"2024-04-19T04:28:13.302998+0000","last_became_active":"2024-04-19T04:28:02.836984+0000","last_became_peered":"2024-04-19T04:28:02.836984+0000","last_unstale":"2024-04-19T04:28:13.302998+0000","last_undegraded":"2024-04-19T04:28:13.302998+0000","last_fullsized":"2024-04-19T04:28:13.302998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094065+0000","last_change":"2024-04-19T04:24:20.187299+0000","last_active":"2024-04-19T04:28:13.094065+0000","last_peered":"2024-04-19T04:28:13.094065+0000","last_clean":"2024-04-19T04:28:13.094065+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:28:13.094065+0000","last_undegraded":"2024-04-19T04:28:13.094065+0000","last_fullsized":"2024-04-19T04:28:13.094065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.096261+0000","last_change":"2024-04-19T04:24:20.186029+0000","last_active":"2024-04-19T04:28:13.096261+0000","last_peered":"2024-04-19T04:28:13.096261+0000","last_clean":"2024-04-19T04:28:13.096261+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:28:13.096261+0000","last_undegraded":"2024-04-19T04:28:13.096261+0000","last_fullsized":"2024-04-19T04:28:13.096261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.255466+0000","last_change":"2024-04-19T04:28:12.092118+0000","last_active":"2024-04-19T04:28:15.255466+0000","last_peered":"2024-04-19T04:28:15.255466+0000","last_clean":"2024-04-19T04:28:15.255466+0000","last_became_active":"2024-04-19T04:28:12.090379+0000","last_became_peered":"2024-04-19T04:28:12.090379+0000","last_unstale":"2024-04-19T04:28:15.255466+0000","last_undegraded":"2024-04-19T04:28:15.255466+0000","last_fullsized":"2024-04-19T04:28:15.255466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.257285+0000","last_change":"2024-04-19T04:28:12.090491+0000","last_active":"2024-04-19T04:28:15.257285+0000","last_peered":"2024-04-19T04:28:15.257285+0000","last_clean":"2024-04-19T04:28:15.257285+0000","last_became_active":"2024-04-19T04:28:12.089948+0000","last_became_peered":"2024-04-19T04:28:12.089948+0000","last_unstale":"2024-04-19T04:28:15.257285+0000","last_undegraded":"2024-04-19T04:28:15.257285+0000","last_fullsized":"2024-04-19T04:28:15.257285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.255632+0000","last_change":"2024-04-19T04:28:12.093574+0000","last_active":"2024-04-19T04:28:15.255632+0000","last_peered":"2024-04-19T04:28:15.255632+0000","last_clean":"2024-04-19T04:28:15.255632+0000","last_became_active":"2024-04-19T04:28:12.093090+0000","last_became_peered":"2024-04-19T04:28:12.093090+0000","last_unstale":"2024-04-19T04:28:15.255632+0000","last_undegraded":"2024-04-19T04:28:15.255632+0000","last_fullsized":"2024-04-19T04:28:15.255632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.096307+0000","last_change":"2024-04-19T04:24:20.186044+0000","last_active":"2024-04-19T04:28:13.096307+0000","last_peered":"2024-04-19T04:28:13.096307+0000","last_clean":"2024-04-19T04:28:13.096307+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:28:13.096307+0000","last_undegraded":"2024-04-19T04:28:13.096307+0000","last_fullsized":"2024-04-19T04:28:13.096307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094548+0000","last_change":"2024-04-19T04:28:02.636589+0000","last_active":"2024-04-19T04:28:13.094548+0000","last_peered":"2024-04-19T04:28:13.094548+0000","last_clean":"2024-04-19T04:28:13.094548+0000","last_became_active":"2024-04-19T04:28:02.636231+0000","last_became_peered":"2024-04-19T04:28:02.636231+0000","last_unstale":"2024-04-19T04:28:13.094548+0000","last_undegraded":"2024-04-19T04:28:13.094548+0000","last_fullsized":"2024-04-19T04:28:13.094548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.095555+0000","last_change":"2024-04-19T04:28:02.635650+0000","last_active":"2024-04-19T04:28:13.095555+0000","last_peered":"2024-04-19T04:28:13.095555+0000","last_clean":"2024-04-19T04:28:13.095555+0000","last_became_active":"2024-04-19T04:28:02.634823+0000","last_became_peered":"2024-04-19T04:28:02.634823+0000","last_unstale":"2024-04-19T04:28:13.095555+0000","last_undegraded":"2024-04-19T04:28:13.095555+0000","last_fullsized":"2024-04-19T04:28:13.095555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302492+0000","last_change":"2024-04-19T04:28:02.845805+0000","last_active":"2024-04-19T04:28:13.302492+0000","last_peered":"2024-04-19T04:28:13.302492+0000","last_clean":"2024-04-19T04:28:13.302492+0000","last_became_active":"2024-04-19T04:28:02.845461+0000","last_became_peered":"2024-04-19T04:28:02.845461+0000","last_unstale":"2024-04-19T04:28:13.302492+0000","last_undegraded":"2024-04-19T04:28:13.302492+0000","last_fullsized":"2024-04-19T04:28:13.302492+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302118+0000","last_change":"2024-04-19T04:28:02.845613+0000","last_active":"2024-04-19T04:28:13.302118+0000","last_peered":"2024-04-19T04:28:13.302118+0000","last_clean":"2024-04-19T04:28:13.302118+0000","last_became_active":"2024-04-19T04:28:02.844927+0000","last_became_peered":"2024-04-19T04:28:02.844927+0000","last_unstale":"2024-04-19T04:28:13.302118+0000","last_undegraded":"2024-04-19T04:28:13.302118+0000","last_fullsized":"2024-04-19T04:28:13.302118+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.095253+0000","last_change":"2024-04-19T04:28:02.635751+0000","last_active":"2024-04-19T04:28:13.095253+0000","last_peered":"2024-04-19T04:28:13.095253+0000","last_clean":"2024-04-19T04:28:13.095253+0000","last_became_active":"2024-04-19T04:28:02.635238+0000","last_became_peered":"2024-04-19T04:28:02.635238+0000","last_unstale":"2024-04-19T04:28:13.095253+0000","last_undegraded":"2024-04-19T04:28:13.095253+0000","last_fullsized":"2024-04-19T04:28:13.095253+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094957+0000","last_change":"2024-04-19T04:28:02.638055+0000","last_active":"2024-04-19T04:28:13.094957+0000","last_peered":"2024-04-19T04:28:13.094957+0000","last_clean":"2024-04-19T04:28:13.094957+0000","last_became_active":"2024-04-19T04:28:02.637651+0000","last_became_peered":"2024-04-19T04:28:02.637651+0000","last_unstale":"2024-04-19T04:28:13.094957+0000","last_undegraded":"2024-04-19T04:28:13.094957+0000","last_fullsized":"2024-04-19T04:28:13.094957+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.096043+0000","last_change":"2024-04-19T04:24:20.555922+0000","last_active":"2024-04-19T04:28:13.096043+0000","last_peered":"2024-04-19T04:28:13.096043+0000","last_clean":"2024-04-19T04:28:13.096043+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:28:13.096043+0000","last_undegraded":"2024-04-19T04:28:13.096043+0000","last_fullsized":"2024-04-19T04:28:13.096043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.256101+0000","last_change":"2024-04-19T04:24:20.183944+0000","last_active":"2024-04-19T04:28:15.256101+0000","last_peered":"2024-04-19T04:28:15.256101+0000","last_clean":"2024-04-19T04:28:15.256101+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:28:15.256101+0000","last_undegraded":"2024-04-19T04:28:15.256101+0000","last_fullsized":"2024-04-19T04:28:15.256101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.095558+0000","last_change":"2024-04-19T04:24:20.553085+0000","last_active":"2024-04-19T04:28:13.095558+0000","last_peered":"2024-04-19T04:28:13.095558+0000","last_clean":"2024-04-19T04:28:13.095558+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:28:13.095558+0000","last_undegraded":"2024-04-19T04:28:13.095558+0000","last_fullsized":"2024-04-19T04:28:13.095558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":69,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.255636+0000","last_change":"2024-04-19T04:28:12.089659+0000","last_active":"2024-04-19T04:28:15.255636+0000","last_peered":"2024-04-19T04:28:15.255636+0000","last_clean":"2024-04-19T04:28:15.255636+0000","last_became_active":"2024-04-19T04:28:12.088043+0000","last_became_peered":"2024-04-19T04:28:12.088043+0000","last_unstale":"2024-04-19T04:28:15.255636+0000","last_undegraded":"2024-04-19T04:28:15.255636+0000","last_fullsized":"2024-04-19T04:28:15.255636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303706+0000","last_change":"2024-04-19T04:28:02.844467+0000","last_active":"2024-04-19T04:28:13.303706+0000","last_peered":"2024-04-19T04:28:13.303706+0000","last_clean":"2024-04-19T04:28:13.303706+0000","last_became_active":"2024-04-19T04:28:02.843639+0000","last_became_peered":"2024-04-19T04:28:02.843639+0000","last_unstale":"2024-04-19T04:28:13.303706+0000","last_undegraded":"2024-04-19T04:28:13.303706+0000","last_fullsized":"2024-04-19T04:28:13.303706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.892679+0000","last_change":"2024-04-19T04:24:10.106278+0000","last_active":"2024-04-19T04:28:13.892679+0000","last_peered":"2024-04-19T04:28:13.892679+0000","last_clean":"2024-04-19T04:28:13.892679+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:28:13.892679+0000","last_undegraded":"2024-04-19T04:28:13.892679+0000","last_fullsized":"2024-04-19T04:28:13.892679+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_clean_scrub_stamp":"2024-04-19T04:24:09.083488+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481030+0000","last_change":"2024-04-19T04:28:02.639632+0000","last_active":"2024-04-19T04:28:19.481030+0000","last_peered":"2024-04-19T04:28:19.481030+0000","last_clean":"2024-04-19T04:28:19.481030+0000","last_became_active":"2024-04-19T04:28:02.639240+0000","last_became_peered":"2024-04-19T04:28:02.639240+0000","last_unstale":"2024-04-19T04:28:19.481030+0000","last_undegraded":"2024-04-19T04:28:19.481030+0000","last_fullsized":"2024-04-19T04:28:19.481030+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302143+0000","last_change":"2024-04-19T04:28:02.842437+0000","last_active":"2024-04-19T04:28:13.302143+0000","last_peered":"2024-04-19T04:28:13.302143+0000","last_clean":"2024-04-19T04:28:13.302143+0000","last_became_active":"2024-04-19T04:28:02.841053+0000","last_became_peered":"2024-04-19T04:28:02.841053+0000","last_unstale":"2024-04-19T04:28:13.302143+0000","last_undegraded":"2024-04-19T04:28:13.302143+0000","last_fullsized":"2024-04-19T04:28:13.302143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481593+0000","last_change":"2024-04-19T04:24:20.553999+0000","last_active":"2024-04-19T04:28:19.481593+0000","last_peered":"2024-04-19T04:28:19.481593+0000","last_clean":"2024-04-19T04:28:19.481593+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:28:19.481593+0000","last_undegraded":"2024-04-19T04:28:19.481593+0000","last_fullsized":"2024-04-19T04:28:19.481593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:18.893871+0000","last_change":"2024-04-19T04:24:16.144482+0000","last_active":"2024-04-19T04:28:18.893871+0000","last_peered":"2024-04-19T04:28:18.893871+0000","last_clean":"2024-04-19T04:28:18.893871+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:28:18.893871+0000","last_undegraded":"2024-04-19T04:28:18.893871+0000","last_fullsized":"2024-04-19T04:28:18.893871+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.301091+0000","last_change":"2024-04-19T04:28:02.842303+0000","last_active":"2024-04-19T04:28:13.301091+0000","last_peered":"2024-04-19T04:28:13.301091+0000","last_clean":"2024-04-19T04:28:13.301091+0000","last_became_active":"2024-04-19T04:28:02.839926+0000","last_became_peered":"2024-04-19T04:28:02.839926+0000","last_unstale":"2024-04-19T04:28:13.301091+0000","last_undegraded":"2024-04-19T04:28:13.301091+0000","last_fullsized":"2024-04-19T04:28:13.301091+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.256854+0000","last_change":"2024-04-19T04:28:02.638370+0000","last_active":"2024-04-19T04:28:15.256854+0000","last_peered":"2024-04-19T04:28:15.256854+0000","last_clean":"2024-04-19T04:28:15.256854+0000","last_became_active":"2024-04-19T04:28:02.638095+0000","last_became_peered":"2024-04-19T04:28:02.638095+0000","last_unstale":"2024-04-19T04:28:15.256854+0000","last_undegraded":"2024-04-19T04:28:15.256854+0000","last_fullsized":"2024-04-19T04:28:15.256854+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:21.148937+0000","last_change":"2024-04-19T04:28:21.158508+0000","last_active":"2024-04-19T04:28:21.148937+0000","last_peered":"2024-04-19T04:28:21.148937+0000","last_clean":"2024-04-19T04:28:21.148937+0000","last_became_active":"2024-04-19T04:28:02.840328+0000","last_became_peered":"2024-04-19T04:28:02.840328+0000","last_unstale":"2024-04-19T04:28:21.148937+0000","last_undegraded":"2024-04-19T04:28:21.148937+0000","last_fullsized":"2024-04-19T04:28:21.148937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:21.148887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:21.148887+0000","last_clean_scrub_stamp":"2024-04-19T04:28:21.148887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:44:55.928928+0000","scrub_duration":0.0038294929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.255688+0000","last_change":"2024-04-19T04:28:12.088382+0000","last_active":"2024-04-19T04:28:15.255688+0000","last_peered":"2024-04-19T04:28:15.255688+0000","last_clean":"2024-04-19T04:28:15.255688+0000","last_became_active":"2024-04-19T04:28:12.087575+0000","last_became_peered":"2024-04-19T04:28:12.087575+0000","last_unstale":"2024-04-19T04:28:15.255688+0000","last_undegraded":"2024-04-19T04:28:15.255688+0000","last_fullsized":"2024-04-19T04:28:15.255688+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303673+0000","last_change":"2024-04-19T04:28:02.844076+0000","last_active":"2024-04-19T04:28:13.303673+0000","last_peered":"2024-04-19T04:28:13.303673+0000","last_clean":"2024-04-19T04:28:13.303673+0000","last_became_active":"2024-04-19T04:28:02.840839+0000","last_became_peered":"2024-04-19T04:28:02.840839+0000","last_unstale":"2024-04-19T04:28:13.303673+0000","last_undegraded":"2024-04-19T04:28:13.303673+0000","last_fullsized":"2024-04-19T04:28:13.303673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481032+0000","last_change":"2024-04-19T04:28:02.635123+0000","last_active":"2024-04-19T04:28:19.481032+0000","last_peered":"2024-04-19T04:28:19.481032+0000","last_clean":"2024-04-19T04:28:19.481032+0000","last_became_active":"2024-04-19T04:28:02.634633+0000","last_became_peered":"2024-04-19T04:28:02.634633+0000","last_unstale":"2024-04-19T04:28:19.481032+0000","last_undegraded":"2024-04-19T04:28:19.481032+0000","last_fullsized":"2024-04-19T04:28:19.481032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481074+0000","last_change":"2024-04-19T04:28:02.638250+0000","last_active":"2024-04-19T04:28:19.481074+0000","last_peered":"2024-04-19T04:28:19.481074+0000","last_clean":"2024-04-19T04:28:19.481074+0000","last_became_active":"2024-04-19T04:28:02.637233+0000","last_became_peered":"2024-04-19T04:28:02.637233+0000","last_unstale":"2024-04-19T04:28:19.481074+0000","last_undegraded":"2024-04-19T04:28:19.481074+0000","last_fullsized":"2024-04-19T04:28:19.481074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302274+0000","last_change":"2024-04-19T04:28:02.838255+0000","last_active":"2024-04-19T04:28:13.302274+0000","last_peered":"2024-04-19T04:28:13.302274+0000","last_clean":"2024-04-19T04:28:13.302274+0000","last_became_active":"2024-04-19T04:28:02.837829+0000","last_became_peered":"2024-04-19T04:28:02.837829+0000","last_unstale":"2024-04-19T04:28:13.302274+0000","last_undegraded":"2024-04-19T04:28:13.302274+0000","last_fullsized":"2024-04-19T04:28:13.302274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481066+0000","last_change":"2024-04-19T04:28:02.636097+0000","last_active":"2024-04-19T04:28:19.481066+0000","last_peered":"2024-04-19T04:28:19.481066+0000","last_clean":"2024-04-19T04:28:19.481066+0000","last_became_active":"2024-04-19T04:28:02.634103+0000","last_became_peered":"2024-04-19T04:28:02.634103+0000","last_unstale":"2024-04-19T04:28:19.481066+0000","last_undegraded":"2024-04-19T04:28:19.481066+0000","last_fullsized":"2024-04-19T04:28:19.481066+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.301845+0000","last_change":"2024-04-19T04:28:02.835876+0000","last_active":"2024-04-19T04:28:13.301845+0000","last_peered":"2024-04-19T04:28:13.301845+0000","last_clean":"2024-04-19T04:28:13.301845+0000","last_became_active":"2024-04-19T04:28:02.835057+0000","last_became_peered":"2024-04-19T04:28:02.835057+0000","last_unstale":"2024-04-19T04:28:13.301845+0000","last_undegraded":"2024-04-19T04:28:13.301845+0000","last_fullsized":"2024-04-19T04:28:13.301845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:20.465699+0000","last_change":"2024-04-19T04:24:20.555116+0000","last_active":"2024-04-19T04:28:20.465699+0000","last_peered":"2024-04-19T04:28:20.465699+0000","last_clean":"2024-04-19T04:28:20.465699+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:28:20.465699+0000","last_undegraded":"2024-04-19T04:28:20.465699+0000","last_fullsized":"2024-04-19T04:28:20.465699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302509+0000","last_change":"2024-04-19T04:28:02.840145+0000","last_active":"2024-04-19T04:28:13.302509+0000","last_peered":"2024-04-19T04:28:13.302509+0000","last_clean":"2024-04-19T04:28:13.302509+0000","last_became_active":"2024-04-19T04:28:02.838918+0000","last_became_peered":"2024-04-19T04:28:02.838918+0000","last_unstale":"2024-04-19T04:28:13.302509+0000","last_undegraded":"2024-04-19T04:28:13.302509+0000","last_fullsized":"2024-04-19T04:28:13.302509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:20.465976+0000","last_change":"2024-04-19T04:28:12.092906+0000","last_active":"2024-04-19T04:28:20.465976+0000","last_peered":"2024-04-19T04:28:20.465976+0000","last_clean":"2024-04-19T04:28:20.465976+0000","last_became_active":"2024-04-19T04:28:12.091609+0000","last_became_peered":"2024-04-19T04:28:12.091609+0000","last_unstale":"2024-04-19T04:28:20.465976+0000","last_undegraded":"2024-04-19T04:28:20.465976+0000","last_fullsized":"2024-04-19T04:28:20.465976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.256734+0000","last_change":"2024-04-19T04:28:12.092944+0000","last_active":"2024-04-19T04:28:15.256734+0000","last_peered":"2024-04-19T04:28:15.256734+0000","last_clean":"2024-04-19T04:28:15.256734+0000","last_became_active":"2024-04-19T04:28:12.091335+0000","last_became_peered":"2024-04-19T04:28:12.091335+0000","last_unstale":"2024-04-19T04:28:15.256734+0000","last_undegraded":"2024-04-19T04:28:15.256734+0000","last_fullsized":"2024-04-19T04:28:15.256734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303073+0000","last_change":"2024-04-19T04:28:02.843341+0000","last_active":"2024-04-19T04:28:13.303073+0000","last_peered":"2024-04-19T04:28:13.303073+0000","last_clean":"2024-04-19T04:28:13.303073+0000","last_became_active":"2024-04-19T04:28:02.839883+0000","last_became_peered":"2024-04-19T04:28:02.839883+0000","last_unstale":"2024-04-19T04:28:13.303073+0000","last_undegraded":"2024-04-19T04:28:13.303073+0000","last_fullsized":"2024-04-19T04:28:13.303073+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302721+0000","last_change":"2024-04-19T04:28:02.845957+0000","last_active":"2024-04-19T04:28:13.302721+0000","last_peered":"2024-04-19T04:28:13.302721+0000","last_clean":"2024-04-19T04:28:13.302721+0000","last_became_active":"2024-04-19T04:28:02.845256+0000","last_became_peered":"2024-04-19T04:28:02.845256+0000","last_unstale":"2024-04-19T04:28:13.302721+0000","last_undegraded":"2024-04-19T04:28:13.302721+0000","last_fullsized":"2024-04-19T04:28:13.302721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:35.232642+0000","last_change":"2024-04-19T04:28:35.232894+0000","last_active":"2024-04-19T04:28:35.232642+0000","last_peered":"2024-04-19T04:28:35.232642+0000","last_clean":"2024-04-19T04:28:35.232642+0000","last_became_active":"2024-04-19T04:28:02.844128+0000","last_became_peered":"2024-04-19T04:28:02.844128+0000","last_unstale":"2024-04-19T04:28:35.232642+0000","last_undegraded":"2024-04-19T04:28:35.232642+0000","last_fullsized":"2024-04-19T04:28:35.232642+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:35.232595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:35.232595+0000","last_clean_scrub_stamp":"2024-04-19T04:28:35.232595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:17:35.552236+0000","scrub_duration":0.0033160400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302792+0000","last_change":"2024-04-19T04:28:02.845918+0000","last_active":"2024-04-19T04:28:13.302792+0000","last_peered":"2024-04-19T04:28:13.302792+0000","last_clean":"2024-04-19T04:28:13.302792+0000","last_became_active":"2024-04-19T04:28:02.844483+0000","last_became_peered":"2024-04-19T04:28:02.844483+0000","last_unstale":"2024-04-19T04:28:13.302792+0000","last_undegraded":"2024-04-19T04:28:13.302792+0000","last_fullsized":"2024-04-19T04:28:13.302792+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.480965+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:28:19.480965+0000","last_peered":"2024-04-19T04:28:19.480965+0000","last_clean":"2024-04-19T04:28:19.480965+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:28:19.480965+0000","last_undegraded":"2024-04-19T04:28:19.480965+0000","last_fullsized":"2024-04-19T04:28:19.480965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.255678+0000","last_change":"2024-04-19T04:28:12.091443+0000","last_active":"2024-04-19T04:28:15.255678+0000","last_peered":"2024-04-19T04:28:15.255678+0000","last_clean":"2024-04-19T04:28:15.255678+0000","last_became_active":"2024-04-19T04:28:12.088123+0000","last_became_peered":"2024-04-19T04:28:12.088123+0000","last_unstale":"2024-04-19T04:28:15.255678+0000","last_undegraded":"2024-04-19T04:28:15.255678+0000","last_fullsized":"2024-04-19T04:28:15.255678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:36.624667+0000","last_change":"2024-04-19T04:28:36.624976+0000","last_active":"2024-04-19T04:28:36.624667+0000","last_peered":"2024-04-19T04:28:36.624667+0000","last_clean":"2024-04-19T04:28:36.624667+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:28:36.624667+0000","last_undegraded":"2024-04-19T04:28:36.624667+0000","last_fullsized":"2024-04-19T04:28:36.624667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:36.624618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:36.624618+0000","last_clean_scrub_stamp":"2024-04-19T04:28:36.624618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:45.570664+0000","scrub_duration":0.0035750109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.095552+0000","last_change":"2024-04-19T04:24:20.185978+0000","last_active":"2024-04-19T04:28:13.095552+0000","last_peered":"2024-04-19T04:28:13.095552+0000","last_clean":"2024-04-19T04:28:13.095552+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:28:13.095552+0000","last_undegraded":"2024-04-19T04:28:13.095552+0000","last_fullsized":"2024-04-19T04:28:13.095552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:23.193351+0000","last_change":"2024-04-19T04:28:23.193584+0000","last_active":"2024-04-19T04:28:23.193351+0000","last_peered":"2024-04-19T04:28:23.193351+0000","last_clean":"2024-04-19T04:28:23.193351+0000","last_became_active":"2024-04-19T04:28:02.841373+0000","last_became_peered":"2024-04-19T04:28:02.841373+0000","last_unstale":"2024-04-19T04:28:23.193351+0000","last_undegraded":"2024-04-19T04:28:23.193351+0000","last_fullsized":"2024-04-19T04:28:23.193351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:23.193301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:23.193301+0000","last_clean_scrub_stamp":"2024-04-19T04:28:23.193301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:26.999877+0000","scrub_duration":0.0032212959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.257608+0000","last_change":"2024-04-19T04:28:12.094542+0000","last_active":"2024-04-19T04:28:15.257608+0000","last_peered":"2024-04-19T04:28:15.257608+0000","last_clean":"2024-04-19T04:28:15.257608+0000","last_became_active":"2024-04-19T04:28:12.092784+0000","last_became_peered":"2024-04-19T04:28:12.092784+0000","last_unstale":"2024-04-19T04:28:15.257608+0000","last_undegraded":"2024-04-19T04:28:15.257608+0000","last_fullsized":"2024-04-19T04:28:15.257608+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.095968+0000","last_change":"2024-04-19T04:28:02.638882+0000","last_active":"2024-04-19T04:28:13.095968+0000","last_peered":"2024-04-19T04:28:13.095968+0000","last_clean":"2024-04-19T04:28:13.095968+0000","last_became_active":"2024-04-19T04:28:02.638431+0000","last_became_peered":"2024-04-19T04:28:02.638431+0000","last_unstale":"2024-04-19T04:28:13.095968+0000","last_undegraded":"2024-04-19T04:28:13.095968+0000","last_fullsized":"2024-04-19T04:28:13.095968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:27.190673+0000","last_change":"2024-04-19T04:28:27.190910+0000","last_active":"2024-04-19T04:28:27.190673+0000","last_peered":"2024-04-19T04:28:27.190673+0000","last_clean":"2024-04-19T04:28:27.190673+0000","last_became_active":"2024-04-19T04:28:02.838354+0000","last_became_peered":"2024-04-19T04:28:02.838354+0000","last_unstale":"2024-04-19T04:28:27.190673+0000","last_undegraded":"2024-04-19T04:28:27.190673+0000","last_fullsized":"2024-04-19T04:28:27.190673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:27.190624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:27.190624+0000","last_clean_scrub_stamp":"2024-04-19T04:28:27.190624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:58:16.070118+0000","scrub_duration":0.003493987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303518+0000","last_change":"2024-04-19T04:28:02.838446+0000","last_active":"2024-04-19T04:28:13.303518+0000","last_peered":"2024-04-19T04:28:13.303518+0000","last_clean":"2024-04-19T04:28:13.303518+0000","last_became_active":"2024-04-19T04:28:02.837994+0000","last_became_peered":"2024-04-19T04:28:02.837994+0000","last_unstale":"2024-04-19T04:28:13.303518+0000","last_undegraded":"2024-04-19T04:28:13.303518+0000","last_fullsized":"2024-04-19T04:28:13.303518+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.301093+0000","last_change":"2024-04-19T04:28:02.837195+0000","last_active":"2024-04-19T04:28:13.301093+0000","last_peered":"2024-04-19T04:28:13.301093+0000","last_clean":"2024-04-19T04:28:13.301093+0000","last_became_active":"2024-04-19T04:28:02.836818+0000","last_became_peered":"2024-04-19T04:28:02.836818+0000","last_unstale":"2024-04-19T04:28:13.301093+0000","last_undegraded":"2024-04-19T04:28:13.301093+0000","last_fullsized":"2024-04-19T04:28:13.301093+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:20.465904+0000","last_change":"2024-04-19T04:24:20.552644+0000","last_active":"2024-04-19T04:28:20.465904+0000","last_peered":"2024-04-19T04:28:20.465904+0000","last_clean":"2024-04-19T04:28:20.465904+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:28:20.465904+0000","last_undegraded":"2024-04-19T04:28:20.465904+0000","last_fullsized":"2024-04-19T04:28:20.465904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.300821+0000","last_change":"2024-04-19T04:28:02.839065+0000","last_active":"2024-04-19T04:28:13.300821+0000","last_peered":"2024-04-19T04:28:13.300821+0000","last_clean":"2024-04-19T04:28:13.300821+0000","last_became_active":"2024-04-19T04:28:02.837400+0000","last_became_peered":"2024-04-19T04:28:02.837400+0000","last_unstale":"2024-04-19T04:28:13.300821+0000","last_undegraded":"2024-04-19T04:28:13.300821+0000","last_fullsized":"2024-04-19T04:28:13.300821+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303158+0000","last_change":"2024-04-19T04:28:02.845777+0000","last_active":"2024-04-19T04:28:13.303158+0000","last_peered":"2024-04-19T04:28:13.303158+0000","last_clean":"2024-04-19T04:28:13.303158+0000","last_became_active":"2024-04-19T04:28:02.844057+0000","last_became_peered":"2024-04-19T04:28:02.844057+0000","last_unstale":"2024-04-19T04:28:13.303158+0000","last_undegraded":"2024-04-19T04:28:13.303158+0000","last_fullsized":"2024-04-19T04:28:13.303158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.301067+0000","last_change":"2024-04-19T04:28:02.837131+0000","last_active":"2024-04-19T04:28:13.301067+0000","last_peered":"2024-04-19T04:28:13.301067+0000","last_clean":"2024-04-19T04:28:13.301067+0000","last_became_active":"2024-04-19T04:28:02.836492+0000","last_became_peered":"2024-04-19T04:28:02.836492+0000","last_unstale":"2024-04-19T04:28:13.301067+0000","last_undegraded":"2024-04-19T04:28:13.301067+0000","last_fullsized":"2024-04-19T04:28:13.301067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.257343+0000","last_change":"2024-04-19T04:28:12.095836+0000","last_active":"2024-04-19T04:28:15.257343+0000","last_peered":"2024-04-19T04:28:15.257343+0000","last_clean":"2024-04-19T04:28:15.257343+0000","last_became_active":"2024-04-19T04:28:12.095332+0000","last_became_peered":"2024-04-19T04:28:12.095332+0000","last_unstale":"2024-04-19T04:28:15.257343+0000","last_undegraded":"2024-04-19T04:28:15.257343+0000","last_fullsized":"2024-04-19T04:28:15.257343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:37.501444+0000","last_change":"2024-04-19T04:28:37.501685+0000","last_active":"2024-04-19T04:28:37.501444+0000","last_peered":"2024-04-19T04:28:37.501444+0000","last_clean":"2024-04-19T04:28:37.501444+0000","last_became_active":"2024-04-19T04:28:12.090262+0000","last_became_peered":"2024-04-19T04:28:12.090262+0000","last_unstale":"2024-04-19T04:28:37.501444+0000","last_undegraded":"2024-04-19T04:28:37.501444+0000","last_fullsized":"2024-04-19T04:28:37.501444+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-19T04:28:37.501393+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-19T04:28:37.501393+0000","last_clean_scrub_stamp":"2024-04-19T04:28:37.501393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:00:31.892502+0000","scrub_duration":0.0035120720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:33.511406+0000","last_change":"2024-04-19T04:28:33.511683+0000","last_active":"2024-04-19T04:28:33.511406+0000","last_peered":"2024-04-19T04:28:33.511406+0000","last_clean":"2024-04-19T04:28:33.511406+0000","last_became_active":"2024-04-19T04:28:12.092979+0000","last_became_peered":"2024-04-19T04:28:12.092979+0000","last_unstale":"2024-04-19T04:28:33.511406+0000","last_undegraded":"2024-04-19T04:28:33.511406+0000","last_fullsized":"2024-04-19T04:28:33.511406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:33.511357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:33.511357+0000","last_clean_scrub_stamp":"2024-04-19T04:28:33.511357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:09:11.578221+0000","scrub_duration":0.0033778150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":44,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:36.522753+0000","last_change":"2024-04-19T04:28:36.523143+0000","last_active":"2024-04-19T04:28:36.522753+0000","last_peered":"2024-04-19T04:28:36.522753+0000","last_clean":"2024-04-19T04:28:36.522753+0000","last_became_active":"2024-04-19T04:28:12.093915+0000","last_became_peered":"2024-04-19T04:28:12.093915+0000","last_unstale":"2024-04-19T04:28:36.522753+0000","last_undegraded":"2024-04-19T04:28:36.522753+0000","last_fullsized":"2024-04-19T04:28:36.522753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-19T04:28:36.522650+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-19T04:28:36.522650+0000","last_clean_scrub_stamp":"2024-04-19T04:28:36.522650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:16.283397+0000","scrub_duration":0.0035824300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094707+0000","last_change":"2024-04-19T04:28:02.639054+0000","last_active":"2024-04-19T04:28:13.094707+0000","last_peered":"2024-04-19T04:28:13.094707+0000","last_clean":"2024-04-19T04:28:13.094707+0000","last_became_active":"2024-04-19T04:28:02.637952+0000","last_became_peered":"2024-04-19T04:28:02.637952+0000","last_unstale":"2024-04-19T04:28:13.094707+0000","last_undegraded":"2024-04-19T04:28:13.094707+0000","last_fullsized":"2024-04-19T04:28:13.094707+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.095345+0000","last_change":"2024-04-19T04:28:02.635226+0000","last_active":"2024-04-19T04:28:13.095345+0000","last_peered":"2024-04-19T04:28:13.095345+0000","last_clean":"2024-04-19T04:28:13.095345+0000","last_became_active":"2024-04-19T04:28:02.634226+0000","last_became_peered":"2024-04-19T04:28:02.634226+0000","last_unstale":"2024-04-19T04:28:13.095345+0000","last_undegraded":"2024-04-19T04:28:13.095345+0000","last_fullsized":"2024-04-19T04:28:13.095345+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094710+0000","last_change":"2024-04-19T04:28:02.636657+0000","last_active":"2024-04-19T04:28:13.094710+0000","last_peered":"2024-04-19T04:28:13.094710+0000","last_clean":"2024-04-19T04:28:13.094710+0000","last_became_active":"2024-04-19T04:28:02.636266+0000","last_became_peered":"2024-04-19T04:28:02.636266+0000","last_unstale":"2024-04-19T04:28:13.094710+0000","last_undegraded":"2024-04-19T04:28:13.094710+0000","last_fullsized":"2024-04-19T04:28:13.094710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.257183+0000","last_change":"2024-04-19T04:28:12.095797+0000","last_active":"2024-04-19T04:28:15.257183+0000","last_peered":"2024-04-19T04:28:15.257183+0000","last_clean":"2024-04-19T04:28:15.257183+0000","last_became_active":"2024-04-19T04:28:12.095199+0000","last_became_peered":"2024-04-19T04:28:12.095199+0000","last_unstale":"2024-04-19T04:28:15.257183+0000","last_undegraded":"2024-04-19T04:28:15.257183+0000","last_fullsized":"2024-04-19T04:28:15.257183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.256312+0000","last_change":"2024-04-19T04:28:12.091303+0000","last_active":"2024-04-19T04:28:15.256312+0000","last_peered":"2024-04-19T04:28:15.256312+0000","last_clean":"2024-04-19T04:28:15.256312+0000","last_became_active":"2024-04-19T04:28:12.087884+0000","last_became_peered":"2024-04-19T04:28:12.087884+0000","last_unstale":"2024-04-19T04:28:15.256312+0000","last_undegraded":"2024-04-19T04:28:15.256312+0000","last_fullsized":"2024-04-19T04:28:15.256312+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303600+0000","last_change":"2024-04-19T04:28:02.846538+0000","last_active":"2024-04-19T04:28:13.303600+0000","last_peered":"2024-04-19T04:28:13.303600+0000","last_clean":"2024-04-19T04:28:13.303600+0000","last_became_active":"2024-04-19T04:28:02.846234+0000","last_became_peered":"2024-04-19T04:28:02.846234+0000","last_unstale":"2024-04-19T04:28:13.303600+0000","last_undegraded":"2024-04-19T04:28:13.303600+0000","last_fullsized":"2024-04-19T04:28:13.303600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094118+0000","last_change":"2024-04-19T04:28:02.635122+0000","last_active":"2024-04-19T04:28:13.094118+0000","last_peered":"2024-04-19T04:28:13.094118+0000","last_clean":"2024-04-19T04:28:13.094118+0000","last_became_active":"2024-04-19T04:28:02.634433+0000","last_became_peered":"2024-04-19T04:28:02.634433+0000","last_unstale":"2024-04-19T04:28:13.094118+0000","last_undegraded":"2024-04-19T04:28:13.094118+0000","last_fullsized":"2024-04-19T04:28:13.094118+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303822+0000","last_change":"2024-04-19T04:28:02.844897+0000","last_active":"2024-04-19T04:28:13.303822+0000","last_peered":"2024-04-19T04:28:13.303822+0000","last_clean":"2024-04-19T04:28:13.303822+0000","last_became_active":"2024-04-19T04:28:02.844276+0000","last_became_peered":"2024-04-19T04:28:02.844276+0000","last_unstale":"2024-04-19T04:28:13.303822+0000","last_undegraded":"2024-04-19T04:28:13.303822+0000","last_fullsized":"2024-04-19T04:28:13.303822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705723,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220708,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151132,"statfs":{"total":96636764160,"available":96410759168,"internally_reserved":0,"allocated":946176,"data_stored":926258,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 04:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.624,"15min":0.755},"min":{"1min":0.51700000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.85099999999999998,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.67400000000000004,"5min":0.248,"15min":0.248},"max":{"1min":1.087,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.70699999999999996}]},{"osd":1,"last update":"Fri Apr 19 04:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":5.1989999999999998,"5min":5.1989999999999998,"15min":5.1989999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":0.65000000000000002}]}]},{"osd":1,"up_from":72,"seq":309237645322,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44116,"kb_used_data":844,"kb_used_omap":6,"kb_used_meta":43257,"kb_avail":94327724,"statfs":{"total":96636764160,"available":96591589376,"internally_reserved":0,"allocated":864256,"data_stored":334760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6880,"internal_metadata":44295456},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298664,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297726,"kb_avail":94073176,"statfs":{"total":96636764160,"available":96330932224,"internally_reserved":0,"allocated":950272,"data_stored":924740,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":304871878},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 04:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri Apr 19 04:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.56899999999999995,"5min":0.223,"15min":0.223},"max":{"1min":0.75900000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65700000000000003,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.77900000000000003,"5min":4.5,"15min":4.5},"last":0.57699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:28:41.200 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.200 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.200 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.200 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.200 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.201 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.201 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.201 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.201 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.201 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.201 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.201 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.201 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.201 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.202 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.202 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.202 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.202 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.202 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.202 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.202 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.202 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.202 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.203 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.203 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.203 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.203 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.203 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.203 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.203 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.203 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.203 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.203 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.204 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.204 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.204 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.204 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.204 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.204 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.204 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.204 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.204 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.205 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.205 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.205 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.205 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T04:24:09.083488+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.205 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.205 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.205 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.205 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.205 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.206 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.206 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.206 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.206 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.206 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.206 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.206 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.206 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.206 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.206 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.207 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.207 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.207 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.207 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.207 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.207 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.207 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.207 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.207 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.208 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.208 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.208 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.208 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.208 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.208 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.208 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.208 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.208 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.209 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.209 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.209 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.209 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.209 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.209 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.209 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:28:41.209 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T04:29:01.210 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:29:01.542 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:29:01.544 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:29:01.557 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-04-19T04:29:01.003067+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":563488,"kb_used_data":2696,"kb_used_omap":9,"kb_used_meta":560758,"kb_avail":282552032,"statfs":{"total":289910292480,"available":289333280768,"internally_reserved":0,"allocated":2760704,"data_stored":2185758,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":10068,"internal_metadata":574216364},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004811"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:24.524670+0000","last_change":"2024-04-19T04:28:24.524670+0000","last_active":"2024-04-19T04:28:24.524670+0000","last_peered":"2024-04-19T04:28:24.524670+0000","last_clean":"2024-04-19T04:28:24.524670+0000","last_became_active":"2024-04-19T04:28:12.093175+0000","last_became_peered":"2024-04-19T04:28:12.093175+0000","last_unstale":"2024-04-19T04:28:24.524670+0000","last_undegraded":"2024-04-19T04:28:24.524670+0000","last_fullsized":"2024-04-19T04:28:24.524670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:24.524536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:24.524536+0000","last_clean_scrub_stamp":"2024-04-19T04:28:24.524536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:34:39.154898+0000","scrub_duration":0.080942869000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:25.440827+0000","last_change":"2024-04-19T04:28:25.440827+0000","last_active":"2024-04-19T04:28:25.440827+0000","last_peered":"2024-04-19T04:28:25.440827+0000","last_clean":"2024-04-19T04:28:25.440827+0000","last_became_active":"2024-04-19T04:28:12.092819+0000","last_became_peered":"2024-04-19T04:28:12.092819+0000","last_unstale":"2024-04-19T04:28:25.440827+0000","last_undegraded":"2024-04-19T04:28:25.440827+0000","last_fullsized":"2024-04-19T04:28:25.440827+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:25.440548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:25.440548+0000","last_clean_scrub_stamp":"2024-04-19T04:28:25.440548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:40.485315+0000","scrub_duration":0.0035723539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481982+0000","last_change":"2024-04-19T04:24:20.556199+0000","last_active":"2024-04-19T04:28:19.481982+0000","last_peered":"2024-04-19T04:28:19.481982+0000","last_clean":"2024-04-19T04:28:19.481982+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:28:19.481982+0000","last_undegraded":"2024-04-19T04:28:19.481982+0000","last_fullsized":"2024-04-19T04:28:19.481982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481947+0000","last_change":"2024-04-19T04:28:02.635437+0000","last_active":"2024-04-19T04:28:19.481947+0000","last_peered":"2024-04-19T04:28:19.481947+0000","last_clean":"2024-04-19T04:28:19.481947+0000","last_became_active":"2024-04-19T04:28:02.634355+0000","last_became_peered":"2024-04-19T04:28:02.634355+0000","last_unstale":"2024-04-19T04:28:19.481947+0000","last_undegraded":"2024-04-19T04:28:19.481947+0000","last_fullsized":"2024-04-19T04:28:19.481947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:34.504737+0000","last_change":"2024-04-19T04:28:34.505005+0000","last_active":"2024-04-19T04:28:34.504737+0000","last_peered":"2024-04-19T04:28:34.504737+0000","last_clean":"2024-04-19T04:28:34.504737+0000","last_became_active":"2024-04-19T04:28:12.088231+0000","last_became_peered":"2024-04-19T04:28:12.088231+0000","last_unstale":"2024-04-19T04:28:34.504737+0000","last_undegraded":"2024-04-19T04:28:34.504737+0000","last_fullsized":"2024-04-19T04:28:34.504737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:34.504692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:34.504692+0000","last_clean_scrub_stamp":"2024-04-19T04:28:34.504692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:54:14.305698+0000","scrub_duration":0.021028397000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094332+0000","last_change":"2024-04-19T04:28:02.637742+0000","last_active":"2024-04-19T04:28:13.094332+0000","last_peered":"2024-04-19T04:28:13.094332+0000","last_clean":"2024-04-19T04:28:13.094332+0000","last_became_active":"2024-04-19T04:28:02.637276+0000","last_became_peered":"2024-04-19T04:28:02.637276+0000","last_unstale":"2024-04-19T04:28:13.094332+0000","last_undegraded":"2024-04-19T04:28:13.094332+0000","last_fullsized":"2024-04-19T04:28:13.094332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:39.760633+0000","last_change":"2024-04-19T04:28:39.760873+0000","last_active":"2024-04-19T04:28:39.760633+0000","last_peered":"2024-04-19T04:28:39.760633+0000","last_clean":"2024-04-19T04:28:39.760633+0000","last_became_active":"2024-04-19T04:28:02.637086+0000","last_became_peered":"2024-04-19T04:28:02.637086+0000","last_unstale":"2024-04-19T04:28:39.760633+0000","last_undegraded":"2024-04-19T04:28:39.760633+0000","last_fullsized":"2024-04-19T04:28:39.760633+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:39.760588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:39.760588+0000","last_clean_scrub_stamp":"2024-04-19T04:28:39.760588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:47:43.003181+0000","scrub_duration":0.020879537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.093753+0000","last_change":"2024-04-19T04:28:02.638186+0000","last_active":"2024-04-19T04:28:13.093753+0000","last_peered":"2024-04-19T04:28:13.093753+0000","last_clean":"2024-04-19T04:28:13.093753+0000","last_became_active":"2024-04-19T04:28:02.637746+0000","last_became_peered":"2024-04-19T04:28:02.637746+0000","last_unstale":"2024-04-19T04:28:13.093753+0000","last_undegraded":"2024-04-19T04:28:13.093753+0000","last_fullsized":"2024-04-19T04:28:13.093753+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303296+0000","last_change":"2024-04-19T04:28:02.842455+0000","last_active":"2024-04-19T04:28:13.303296+0000","last_peered":"2024-04-19T04:28:13.303296+0000","last_clean":"2024-04-19T04:28:13.303296+0000","last_became_active":"2024-04-19T04:28:02.839203+0000","last_became_peered":"2024-04-19T04:28:02.839203+0000","last_unstale":"2024-04-19T04:28:13.303296+0000","last_undegraded":"2024-04-19T04:28:13.303296+0000","last_fullsized":"2024-04-19T04:28:13.303296+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.256903+0000","last_change":"2024-04-19T04:28:12.093403+0000","last_active":"2024-04-19T04:28:15.256903+0000","last_peered":"2024-04-19T04:28:15.256903+0000","last_clean":"2024-04-19T04:28:15.256903+0000","last_became_active":"2024-04-19T04:28:12.092924+0000","last_became_peered":"2024-04-19T04:28:12.092924+0000","last_unstale":"2024-04-19T04:28:15.256903+0000","last_undegraded":"2024-04-19T04:28:15.256903+0000","last_fullsized":"2024-04-19T04:28:15.256903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.095339+0000","last_change":"2024-04-19T04:28:02.636293+0000","last_active":"2024-04-19T04:28:13.095339+0000","last_peered":"2024-04-19T04:28:13.095339+0000","last_clean":"2024-04-19T04:28:13.095339+0000","last_became_active":"2024-04-19T04:28:02.635946+0000","last_became_peered":"2024-04-19T04:28:02.635946+0000","last_unstale":"2024-04-19T04:28:13.095339+0000","last_undegraded":"2024-04-19T04:28:13.095339+0000","last_fullsized":"2024-04-19T04:28:13.095339+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:35.526927+0000","last_change":"2024-04-19T04:28:35.527163+0000","last_active":"2024-04-19T04:28:35.526927+0000","last_peered":"2024-04-19T04:28:35.526927+0000","last_clean":"2024-04-19T04:28:35.526927+0000","last_became_active":"2024-04-19T04:28:12.094753+0000","last_became_peered":"2024-04-19T04:28:12.094753+0000","last_unstale":"2024-04-19T04:28:35.526927+0000","last_undegraded":"2024-04-19T04:28:35.526927+0000","last_fullsized":"2024-04-19T04:28:35.526927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:35.526884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:35.526884+0000","last_clean_scrub_stamp":"2024-04-19T04:28:35.526884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:06:35.618252+0000","scrub_duration":0.0031760289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:47.475667+0000","last_change":"2024-04-19T04:28:47.475887+0000","last_active":"2024-04-19T04:28:47.475667+0000","last_peered":"2024-04-19T04:28:47.475667+0000","last_clean":"2024-04-19T04:28:47.475667+0000","last_became_active":"2024-04-19T04:28:12.093267+0000","last_became_peered":"2024-04-19T04:28:12.093267+0000","last_unstale":"2024-04-19T04:28:47.475667+0000","last_undegraded":"2024-04-19T04:28:47.475667+0000","last_fullsized":"2024-04-19T04:28:47.475667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:47.475618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:47.475618+0000","last_clean_scrub_stamp":"2024-04-19T04:28:47.475618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:37.519624+0000","scrub_duration":0.022523944000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:23.449546+0000","last_change":"2024-04-19T04:28:23.449786+0000","last_active":"2024-04-19T04:28:23.449546+0000","last_peered":"2024-04-19T04:28:23.449546+0000","last_clean":"2024-04-19T04:28:23.449546+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:28:23.449546+0000","last_undegraded":"2024-04-19T04:28:23.449546+0000","last_fullsized":"2024-04-19T04:28:23.449546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:23.449500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:23.449500+0000","last_clean_scrub_stamp":"2024-04-19T04:28:23.449500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:20.102454+0000","scrub_duration":0.0033193469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094619+0000","last_change":"2024-04-19T04:24:20.551809+0000","last_active":"2024-04-19T04:28:13.094619+0000","last_peered":"2024-04-19T04:28:13.094619+0000","last_clean":"2024-04-19T04:28:13.094619+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:28:13.094619+0000","last_undegraded":"2024-04-19T04:28:13.094619+0000","last_fullsized":"2024-04-19T04:28:13.094619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:33.597517+0000","last_change":"2024-04-19T04:28:33.597905+0000","last_active":"2024-04-19T04:28:33.597517+0000","last_peered":"2024-04-19T04:28:33.597517+0000","last_clean":"2024-04-19T04:28:33.597517+0000","last_became_active":"2024-04-19T04:28:02.637920+0000","last_became_peered":"2024-04-19T04:28:02.637920+0000","last_unstale":"2024-04-19T04:28:33.597517+0000","last_undegraded":"2024-04-19T04:28:33.597517+0000","last_fullsized":"2024-04-19T04:28:33.597517+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:33.597411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:33.597411+0000","last_clean_scrub_stamp":"2024-04-19T04:28:33.597411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:50.250390+0000","scrub_duration":0.0037610339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:42.236628+0000","last_change":"2024-04-19T04:28:42.236755+0000","last_active":"2024-04-19T04:28:42.236628+0000","last_peered":"2024-04-19T04:28:42.236628+0000","last_clean":"2024-04-19T04:28:42.236628+0000","last_became_active":"2024-04-19T04:28:02.839071+0000","last_became_peered":"2024-04-19T04:28:02.839071+0000","last_unstale":"2024-04-19T04:28:42.236628+0000","last_undegraded":"2024-04-19T04:28:42.236628+0000","last_fullsized":"2024-04-19T04:28:42.236628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:42.236604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:42.236604+0000","last_clean_scrub_stamp":"2024-04-19T04:28:42.236604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:47:48.663058+0000","scrub_duration":0.070531359000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.257184+0000","last_change":"2024-04-19T04:28:02.638587+0000","last_active":"2024-04-19T04:28:15.257184+0000","last_peered":"2024-04-19T04:28:15.257184+0000","last_clean":"2024-04-19T04:28:15.257184+0000","last_became_active":"2024-04-19T04:28:02.638230+0000","last_became_peered":"2024-04-19T04:28:02.638230+0000","last_unstale":"2024-04-19T04:28:15.257184+0000","last_undegraded":"2024-04-19T04:28:15.257184+0000","last_fullsized":"2024-04-19T04:28:15.257184+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:31.226313+0000","last_change":"2024-04-19T04:28:31.226446+0000","last_active":"2024-04-19T04:28:31.226313+0000","last_peered":"2024-04-19T04:28:31.226313+0000","last_clean":"2024-04-19T04:28:31.226313+0000","last_became_active":"2024-04-19T04:28:02.839362+0000","last_became_peered":"2024-04-19T04:28:02.839362+0000","last_unstale":"2024-04-19T04:28:31.226313+0000","last_undegraded":"2024-04-19T04:28:31.226313+0000","last_fullsized":"2024-04-19T04:28:31.226313+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:31.226291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:31.226291+0000","last_clean_scrub_stamp":"2024-04-19T04:28:31.226291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:43:05.235533+0000","scrub_duration":0.029412667999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:28.516191+0000","last_change":"2024-04-19T04:28:28.516191+0000","last_active":"2024-04-19T04:28:28.516191+0000","last_peered":"2024-04-19T04:28:28.516191+0000","last_clean":"2024-04-19T04:28:28.516191+0000","last_became_active":"2024-04-19T04:28:02.634835+0000","last_became_peered":"2024-04-19T04:28:02.634835+0000","last_unstale":"2024-04-19T04:28:28.516191+0000","last_undegraded":"2024-04-19T04:28:28.516191+0000","last_fullsized":"2024-04-19T04:28:28.516191+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:28.515710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:28.515710+0000","last_clean_scrub_stamp":"2024-04-19T04:28:28.515710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:46.923636+0000","scrub_duration":0.0034446709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481594+0000","last_change":"2024-04-19T04:28:02.639259+0000","last_active":"2024-04-19T04:28:19.481594+0000","last_peered":"2024-04-19T04:28:19.481594+0000","last_clean":"2024-04-19T04:28:19.481594+0000","last_became_active":"2024-04-19T04:28:02.638546+0000","last_became_peered":"2024-04-19T04:28:02.638546+0000","last_unstale":"2024-04-19T04:28:19.481594+0000","last_undegraded":"2024-04-19T04:28:19.481594+0000","last_fullsized":"2024-04-19T04:28:19.481594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:49.435023+0000","last_change":"2024-04-19T04:28:49.435301+0000","last_active":"2024-04-19T04:28:49.435023+0000","last_peered":"2024-04-19T04:28:49.435023+0000","last_clean":"2024-04-19T04:28:49.435023+0000","last_became_active":"2024-04-19T04:28:12.087571+0000","last_became_peered":"2024-04-19T04:28:12.087571+0000","last_unstale":"2024-04-19T04:28:49.435023+0000","last_undegraded":"2024-04-19T04:28:49.435023+0000","last_fullsized":"2024-04-19T04:28:49.435023+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:49.434979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:49.434979+0000","last_clean_scrub_stamp":"2024-04-19T04:28:49.434979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:46.111742+0000","scrub_duration":0.003316786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:34.194332+0000","last_change":"2024-04-19T04:28:34.194663+0000","last_active":"2024-04-19T04:28:34.194332+0000","last_peered":"2024-04-19T04:28:34.194332+0000","last_clean":"2024-04-19T04:28:34.194332+0000","last_became_active":"2024-04-19T04:28:02.840294+0000","last_became_peered":"2024-04-19T04:28:02.840294+0000","last_unstale":"2024-04-19T04:28:34.194332+0000","last_undegraded":"2024-04-19T04:28:34.194332+0000","last_fullsized":"2024-04-19T04:28:34.194332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:34.194285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:34.194285+0000","last_clean_scrub_stamp":"2024-04-19T04:28:34.194285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:53:04.918350+0000","scrub_duration":0.0033717299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":69,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:20.466037+0000","last_change":"2024-04-19T04:28:12.090413+0000","last_active":"2024-04-19T04:28:20.466037+0000","last_peered":"2024-04-19T04:28:20.466037+0000","last_clean":"2024-04-19T04:28:20.466037+0000","last_became_active":"2024-04-19T04:28:12.089918+0000","last_became_peered":"2024-04-19T04:28:12.089918+0000","last_unstale":"2024-04-19T04:28:20.466037+0000","last_undegraded":"2024-04-19T04:28:20.466037+0000","last_fullsized":"2024-04-19T04:28:20.466037+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.257493+0000","last_change":"2024-04-19T04:28:12.092733+0000","last_active":"2024-04-19T04:28:15.257493+0000","last_peered":"2024-04-19T04:28:15.257493+0000","last_clean":"2024-04-19T04:28:15.257493+0000","last_became_active":"2024-04-19T04:28:12.091770+0000","last_became_peered":"2024-04-19T04:28:12.091770+0000","last_unstale":"2024-04-19T04:28:15.257493+0000","last_undegraded":"2024-04-19T04:28:15.257493+0000","last_fullsized":"2024-04-19T04:28:15.257493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303363+0000","last_change":"2024-04-19T04:28:02.846092+0000","last_active":"2024-04-19T04:28:13.303363+0000","last_peered":"2024-04-19T04:28:13.303363+0000","last_clean":"2024-04-19T04:28:13.303363+0000","last_became_active":"2024-04-19T04:28:02.845416+0000","last_became_peered":"2024-04-19T04:28:02.845416+0000","last_unstale":"2024-04-19T04:28:13.303363+0000","last_undegraded":"2024-04-19T04:28:13.303363+0000","last_fullsized":"2024-04-19T04:28:13.303363+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481739+0000","last_change":"2024-04-19T04:24:20.554885+0000","last_active":"2024-04-19T04:28:19.481739+0000","last_peered":"2024-04-19T04:28:19.481739+0000","last_clean":"2024-04-19T04:28:19.481739+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:28:19.481739+0000","last_undegraded":"2024-04-19T04:28:19.481739+0000","last_fullsized":"2024-04-19T04:28:19.481739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.257086+0000","last_change":"2024-04-19T04:28:12.092936+0000","last_active":"2024-04-19T04:28:15.257086+0000","last_peered":"2024-04-19T04:28:15.257086+0000","last_clean":"2024-04-19T04:28:15.257086+0000","last_became_active":"2024-04-19T04:28:12.091969+0000","last_became_peered":"2024-04-19T04:28:12.091969+0000","last_unstale":"2024-04-19T04:28:15.257086+0000","last_undegraded":"2024-04-19T04:28:15.257086+0000","last_fullsized":"2024-04-19T04:28:15.257086+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.301593+0000","last_change":"2024-04-19T04:28:02.845150+0000","last_active":"2024-04-19T04:28:13.301593+0000","last_peered":"2024-04-19T04:28:13.301593+0000","last_clean":"2024-04-19T04:28:13.301593+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:28:13.301593+0000","last_undegraded":"2024-04-19T04:28:13.301593+0000","last_fullsized":"2024-04-19T04:28:13.301593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:20.465854+0000","last_change":"2024-04-19T04:24:20.554847+0000","last_active":"2024-04-19T04:28:20.465854+0000","last_peered":"2024-04-19T04:28:20.465854+0000","last_clean":"2024-04-19T04:28:20.465854+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:28:20.465854+0000","last_undegraded":"2024-04-19T04:28:20.465854+0000","last_fullsized":"2024-04-19T04:28:20.465854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302725+0000","last_change":"2024-04-19T04:28:02.843590+0000","last_active":"2024-04-19T04:28:13.302725+0000","last_peered":"2024-04-19T04:28:13.302725+0000","last_clean":"2024-04-19T04:28:13.302725+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:28:13.302725+0000","last_undegraded":"2024-04-19T04:28:13.302725+0000","last_fullsized":"2024-04-19T04:28:13.302725+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481710+0000","last_change":"2024-04-19T04:28:02.635119+0000","last_active":"2024-04-19T04:28:19.481710+0000","last_peered":"2024-04-19T04:28:19.481710+0000","last_clean":"2024-04-19T04:28:19.481710+0000","last_became_active":"2024-04-19T04:28:02.634586+0000","last_became_peered":"2024-04-19T04:28:02.634586+0000","last_unstale":"2024-04-19T04:28:19.481710+0000","last_undegraded":"2024-04-19T04:28:19.481710+0000","last_fullsized":"2024-04-19T04:28:19.481710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:48.474862+0000","last_change":"2024-04-19T04:28:48.475080+0000","last_active":"2024-04-19T04:28:48.474862+0000","last_peered":"2024-04-19T04:28:48.474862+0000","last_clean":"2024-04-19T04:28:48.474862+0000","last_became_active":"2024-04-19T04:28:12.094558+0000","last_became_peered":"2024-04-19T04:28:12.094558+0000","last_unstale":"2024-04-19T04:28:48.474862+0000","last_undegraded":"2024-04-19T04:28:48.474862+0000","last_fullsized":"2024-04-19T04:28:48.474862+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:48.474816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:48.474816+0000","last_clean_scrub_stamp":"2024-04-19T04:28:48.474816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:45.127770+0000","scrub_duration":0.003339912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.095264+0000","last_change":"2024-04-19T04:28:02.639581+0000","last_active":"2024-04-19T04:28:13.095264+0000","last_peered":"2024-04-19T04:28:13.095264+0000","last_clean":"2024-04-19T04:28:13.095264+0000","last_became_active":"2024-04-19T04:28:02.638666+0000","last_became_peered":"2024-04-19T04:28:02.638666+0000","last_unstale":"2024-04-19T04:28:13.095264+0000","last_undegraded":"2024-04-19T04:28:13.095264+0000","last_fullsized":"2024-04-19T04:28:13.095264+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.256930+0000","last_change":"2024-04-19T04:28:12.095631+0000","last_active":"2024-04-19T04:28:15.256930+0000","last_peered":"2024-04-19T04:28:15.256930+0000","last_clean":"2024-04-19T04:28:15.256930+0000","last_became_active":"2024-04-19T04:28:12.094722+0000","last_became_peered":"2024-04-19T04:28:12.094722+0000","last_unstale":"2024-04-19T04:28:15.256930+0000","last_undegraded":"2024-04-19T04:28:15.256930+0000","last_fullsized":"2024-04-19T04:28:15.256930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.301761+0000","last_change":"2024-04-19T04:28:02.843299+0000","last_active":"2024-04-19T04:28:13.301761+0000","last_peered":"2024-04-19T04:28:13.301761+0000","last_clean":"2024-04-19T04:28:13.301761+0000","last_became_active":"2024-04-19T04:28:02.842525+0000","last_became_peered":"2024-04-19T04:28:02.842525+0000","last_unstale":"2024-04-19T04:28:13.301761+0000","last_undegraded":"2024-04-19T04:28:13.301761+0000","last_fullsized":"2024-04-19T04:28:13.301761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.151861+0000","last_change":"2024-04-19T04:28:40.152096+0000","last_active":"2024-04-19T04:28:40.151861+0000","last_peered":"2024-04-19T04:28:40.151861+0000","last_clean":"2024-04-19T04:28:40.151861+0000","last_became_active":"2024-04-19T04:28:02.843099+0000","last_became_peered":"2024-04-19T04:28:02.843099+0000","last_unstale":"2024-04-19T04:28:40.151861+0000","last_undegraded":"2024-04-19T04:28:40.151861+0000","last_fullsized":"2024-04-19T04:28:40.151861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.151812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.151812+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.151812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:19.753268+0000","scrub_duration":0.0030712460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:29.541159+0000","last_change":"2024-04-19T04:28:29.541420+0000","last_active":"2024-04-19T04:28:29.541159+0000","last_peered":"2024-04-19T04:28:29.541159+0000","last_clean":"2024-04-19T04:28:29.541159+0000","last_became_active":"2024-04-19T04:28:12.091771+0000","last_became_peered":"2024-04-19T04:28:12.091771+0000","last_unstale":"2024-04-19T04:28:29.541159+0000","last_undegraded":"2024-04-19T04:28:29.541159+0000","last_fullsized":"2024-04-19T04:28:29.541159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:29.541116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:29.541116+0000","last_clean_scrub_stamp":"2024-04-19T04:28:29.541116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:42.022636+0000","scrub_duration":0.0033350189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302998+0000","last_change":"2024-04-19T04:28:02.837331+0000","last_active":"2024-04-19T04:28:13.302998+0000","last_peered":"2024-04-19T04:28:13.302998+0000","last_clean":"2024-04-19T04:28:13.302998+0000","last_became_active":"2024-04-19T04:28:02.836984+0000","last_became_peered":"2024-04-19T04:28:02.836984+0000","last_unstale":"2024-04-19T04:28:13.302998+0000","last_undegraded":"2024-04-19T04:28:13.302998+0000","last_fullsized":"2024-04-19T04:28:13.302998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094065+0000","last_change":"2024-04-19T04:24:20.187299+0000","last_active":"2024-04-19T04:28:13.094065+0000","last_peered":"2024-04-19T04:28:13.094065+0000","last_clean":"2024-04-19T04:28:13.094065+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:28:13.094065+0000","last_undegraded":"2024-04-19T04:28:13.094065+0000","last_fullsized":"2024-04-19T04:28:13.094065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":75,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481244+0000","last_change":"2024-04-19T04:24:20.186029+0000","last_active":"2024-04-19T04:28:19.481244+0000","last_peered":"2024-04-19T04:28:19.481244+0000","last_clean":"2024-04-19T04:28:19.481244+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:28:19.481244+0000","last_undegraded":"2024-04-19T04:28:19.481244+0000","last_fullsized":"2024-04-19T04:28:19.481244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.255466+0000","last_change":"2024-04-19T04:28:12.092118+0000","last_active":"2024-04-19T04:28:15.255466+0000","last_peered":"2024-04-19T04:28:15.255466+0000","last_clean":"2024-04-19T04:28:15.255466+0000","last_became_active":"2024-04-19T04:28:12.090379+0000","last_became_peered":"2024-04-19T04:28:12.090379+0000","last_unstale":"2024-04-19T04:28:15.255466+0000","last_undegraded":"2024-04-19T04:28:15.255466+0000","last_fullsized":"2024-04-19T04:28:15.255466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.257285+0000","last_change":"2024-04-19T04:28:12.090491+0000","last_active":"2024-04-19T04:28:15.257285+0000","last_peered":"2024-04-19T04:28:15.257285+0000","last_clean":"2024-04-19T04:28:15.257285+0000","last_became_active":"2024-04-19T04:28:12.089948+0000","last_became_peered":"2024-04-19T04:28:12.089948+0000","last_unstale":"2024-04-19T04:28:15.257285+0000","last_undegraded":"2024-04-19T04:28:15.257285+0000","last_fullsized":"2024-04-19T04:28:15.257285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:57.409585+0000","last_change":"2024-04-19T04:28:57.409839+0000","last_active":"2024-04-19T04:28:57.409585+0000","last_peered":"2024-04-19T04:28:57.409585+0000","last_clean":"2024-04-19T04:28:57.409585+0000","last_became_active":"2024-04-19T04:28:12.093090+0000","last_became_peered":"2024-04-19T04:28:12.093090+0000","last_unstale":"2024-04-19T04:28:57.409585+0000","last_undegraded":"2024-04-19T04:28:57.409585+0000","last_fullsized":"2024-04-19T04:28:57.409585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:57.409536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:57.409536+0000","last_clean_scrub_stamp":"2024-04-19T04:28:57.409536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:58:14.062514+0000","scrub_duration":0.0034988459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"79'2","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:51.726306+0000","last_change":"2024-04-19T04:28:51.726306+0000","last_active":"2024-04-19T04:28:51.726306+0000","last_peered":"2024-04-19T04:28:51.726306+0000","last_clean":"2024-04-19T04:28:51.726306+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:28:51.726306+0000","last_undegraded":"2024-04-19T04:28:51.726306+0000","last_fullsized":"2024-04-19T04:28:51.726306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-19T04:28:51.725876+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-19T04:28:51.725876+0000","last_clean_scrub_stamp":"2024-04-19T04:28:51.725876+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:17.429863+0000","scrub_duration":0.0062414059999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481660+0000","last_change":"2024-04-19T04:28:02.636589+0000","last_active":"2024-04-19T04:28:19.481660+0000","last_peered":"2024-04-19T04:28:19.481660+0000","last_clean":"2024-04-19T04:28:19.481660+0000","last_became_active":"2024-04-19T04:28:02.636231+0000","last_became_peered":"2024-04-19T04:28:02.636231+0000","last_unstale":"2024-04-19T04:28:19.481660+0000","last_undegraded":"2024-04-19T04:28:19.481660+0000","last_fullsized":"2024-04-19T04:28:19.481660+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481187+0000","last_change":"2024-04-19T04:28:02.635650+0000","last_active":"2024-04-19T04:28:19.481187+0000","last_peered":"2024-04-19T04:28:19.481187+0000","last_clean":"2024-04-19T04:28:19.481187+0000","last_became_active":"2024-04-19T04:28:02.634823+0000","last_became_peered":"2024-04-19T04:28:02.634823+0000","last_unstale":"2024-04-19T04:28:19.481187+0000","last_undegraded":"2024-04-19T04:28:19.481187+0000","last_fullsized":"2024-04-19T04:28:19.481187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:56.250577+0000","last_change":"2024-04-19T04:28:56.250708+0000","last_active":"2024-04-19T04:28:56.250577+0000","last_peered":"2024-04-19T04:28:56.250577+0000","last_clean":"2024-04-19T04:28:56.250577+0000","last_became_active":"2024-04-19T04:28:02.845461+0000","last_became_peered":"2024-04-19T04:28:02.845461+0000","last_unstale":"2024-04-19T04:28:56.250577+0000","last_undegraded":"2024-04-19T04:28:56.250577+0000","last_fullsized":"2024-04-19T04:28:56.250577+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:56.250557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:56.250557+0000","last_clean_scrub_stamp":"2024-04-19T04:28:56.250557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:56.014220+0000","scrub_duration":0.029538265000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:46.246893+0000","last_change":"2024-04-19T04:28:46.247247+0000","last_active":"2024-04-19T04:28:46.246893+0000","last_peered":"2024-04-19T04:28:46.246893+0000","last_clean":"2024-04-19T04:28:46.246893+0000","last_became_active":"2024-04-19T04:28:02.844927+0000","last_became_peered":"2024-04-19T04:28:02.844927+0000","last_unstale":"2024-04-19T04:28:46.246893+0000","last_undegraded":"2024-04-19T04:28:46.246893+0000","last_fullsized":"2024-04-19T04:28:46.246893+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:28:46.246777+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:28:46.246777+0000","last_clean_scrub_stamp":"2024-04-19T04:28:46.246777+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:37:56.201762+0000","scrub_duration":0.006831213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:58.824983+0000","last_change":"2024-04-19T04:28:58.825209+0000","last_active":"2024-04-19T04:28:58.824983+0000","last_peered":"2024-04-19T04:28:58.824983+0000","last_clean":"2024-04-19T04:28:58.824983+0000","last_became_active":"2024-04-19T04:28:02.635238+0000","last_became_peered":"2024-04-19T04:28:02.635238+0000","last_unstale":"2024-04-19T04:28:58.824983+0000","last_undegraded":"2024-04-19T04:28:58.824983+0000","last_fullsized":"2024-04-19T04:28:58.824983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:58.824931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:58.824931+0000","last_clean_scrub_stamp":"2024-04-19T04:28:58.824931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:33.364138+0000","scrub_duration":0.0033677389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481737+0000","last_change":"2024-04-19T04:28:02.638055+0000","last_active":"2024-04-19T04:28:19.481737+0000","last_peered":"2024-04-19T04:28:19.481737+0000","last_clean":"2024-04-19T04:28:19.481737+0000","last_became_active":"2024-04-19T04:28:02.637651+0000","last_became_peered":"2024-04-19T04:28:02.637651+0000","last_unstale":"2024-04-19T04:28:19.481737+0000","last_undegraded":"2024-04-19T04:28:19.481737+0000","last_fullsized":"2024-04-19T04:28:19.481737+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.710088+0000","last_change":"2024-04-19T04:28:40.710088+0000","last_active":"2024-04-19T04:28:40.710088+0000","last_peered":"2024-04-19T04:28:40.710088+0000","last_clean":"2024-04-19T04:28:40.710088+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:28:40.710088+0000","last_undegraded":"2024-04-19T04:28:40.710088+0000","last_fullsized":"2024-04-19T04:28:40.710088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.709702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.709702+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.709702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:24.831215+0000","scrub_duration":0.0033854829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:20.465496+0000","last_change":"2024-04-19T04:24:20.183944+0000","last_active":"2024-04-19T04:28:20.465496+0000","last_peered":"2024-04-19T04:28:20.465496+0000","last_clean":"2024-04-19T04:28:20.465496+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:28:20.465496+0000","last_undegraded":"2024-04-19T04:28:20.465496+0000","last_fullsized":"2024-04-19T04:28:20.465496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481501+0000","last_change":"2024-04-19T04:24:20.553085+0000","last_active":"2024-04-19T04:28:19.481501+0000","last_peered":"2024-04-19T04:28:19.481501+0000","last_clean":"2024-04-19T04:28:19.481501+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:28:19.481501+0000","last_undegraded":"2024-04-19T04:28:19.481501+0000","last_fullsized":"2024-04-19T04:28:19.481501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.494052+0000","last_change":"2024-04-19T04:28:40.494052+0000","last_active":"2024-04-19T04:28:40.494052+0000","last_peered":"2024-04-19T04:28:40.494052+0000","last_clean":"2024-04-19T04:28:40.494052+0000","last_became_active":"2024-04-19T04:28:12.088043+0000","last_became_peered":"2024-04-19T04:28:12.088043+0000","last_unstale":"2024-04-19T04:28:40.494052+0000","last_undegraded":"2024-04-19T04:28:40.494052+0000","last_fullsized":"2024-04-19T04:28:40.494052+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.493585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.493585+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.493585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:22:36.746203+0000","scrub_duration":0.0035336780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303706+0000","last_change":"2024-04-19T04:28:02.844467+0000","last_active":"2024-04-19T04:28:13.303706+0000","last_peered":"2024-04-19T04:28:13.303706+0000","last_clean":"2024-04-19T04:28:13.303706+0000","last_became_active":"2024-04-19T04:28:02.843639+0000","last_became_peered":"2024-04-19T04:28:02.843639+0000","last_unstale":"2024-04-19T04:28:13.303706+0000","last_undegraded":"2024-04-19T04:28:13.303706+0000","last_fullsized":"2024-04-19T04:28:13.303706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.892679+0000","last_change":"2024-04-19T04:24:10.106278+0000","last_active":"2024-04-19T04:28:13.892679+0000","last_peered":"2024-04-19T04:28:13.892679+0000","last_clean":"2024-04-19T04:28:13.892679+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:28:13.892679+0000","last_undegraded":"2024-04-19T04:28:13.892679+0000","last_fullsized":"2024-04-19T04:28:13.892679+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_clean_scrub_stamp":"2024-04-19T04:24:09.083488+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481030+0000","last_change":"2024-04-19T04:28:02.639632+0000","last_active":"2024-04-19T04:28:19.481030+0000","last_peered":"2024-04-19T04:28:19.481030+0000","last_clean":"2024-04-19T04:28:19.481030+0000","last_became_active":"2024-04-19T04:28:02.639240+0000","last_became_peered":"2024-04-19T04:28:02.639240+0000","last_unstale":"2024-04-19T04:28:19.481030+0000","last_undegraded":"2024-04-19T04:28:19.481030+0000","last_fullsized":"2024-04-19T04:28:19.481030+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302143+0000","last_change":"2024-04-19T04:28:02.842437+0000","last_active":"2024-04-19T04:28:13.302143+0000","last_peered":"2024-04-19T04:28:13.302143+0000","last_clean":"2024-04-19T04:28:13.302143+0000","last_became_active":"2024-04-19T04:28:02.841053+0000","last_became_peered":"2024-04-19T04:28:02.841053+0000","last_unstale":"2024-04-19T04:28:13.302143+0000","last_undegraded":"2024-04-19T04:28:13.302143+0000","last_fullsized":"2024-04-19T04:28:13.302143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:43.759501+0000","last_change":"2024-04-19T04:28:43.759738+0000","last_active":"2024-04-19T04:28:43.759501+0000","last_peered":"2024-04-19T04:28:43.759501+0000","last_clean":"2024-04-19T04:28:43.759501+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:28:43.759501+0000","last_undegraded":"2024-04-19T04:28:43.759501+0000","last_fullsized":"2024-04-19T04:28:43.759501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:43.759455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:43.759455+0000","last_clean_scrub_stamp":"2024-04-19T04:28:43.759455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:10.518057+0000","scrub_duration":0.0032782050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:18.893871+0000","last_change":"2024-04-19T04:24:16.144482+0000","last_active":"2024-04-19T04:28:18.893871+0000","last_peered":"2024-04-19T04:28:18.893871+0000","last_clean":"2024-04-19T04:28:18.893871+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:28:18.893871+0000","last_undegraded":"2024-04-19T04:28:18.893871+0000","last_fullsized":"2024-04-19T04:28:18.893871+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.301091+0000","last_change":"2024-04-19T04:28:02.842303+0000","last_active":"2024-04-19T04:28:13.301091+0000","last_peered":"2024-04-19T04:28:13.301091+0000","last_clean":"2024-04-19T04:28:13.301091+0000","last_became_active":"2024-04-19T04:28:02.839926+0000","last_became_peered":"2024-04-19T04:28:02.839926+0000","last_unstale":"2024-04-19T04:28:13.301091+0000","last_undegraded":"2024-04-19T04:28:13.301091+0000","last_fullsized":"2024-04-19T04:28:13.301091+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:20.465716+0000","last_change":"2024-04-19T04:28:02.638370+0000","last_active":"2024-04-19T04:28:20.465716+0000","last_peered":"2024-04-19T04:28:20.465716+0000","last_clean":"2024-04-19T04:28:20.465716+0000","last_became_active":"2024-04-19T04:28:02.638095+0000","last_became_peered":"2024-04-19T04:28:02.638095+0000","last_unstale":"2024-04-19T04:28:20.465716+0000","last_undegraded":"2024-04-19T04:28:20.465716+0000","last_fullsized":"2024-04-19T04:28:20.465716+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:21.148937+0000","last_change":"2024-04-19T04:28:21.158508+0000","last_active":"2024-04-19T04:28:21.148937+0000","last_peered":"2024-04-19T04:28:21.148937+0000","last_clean":"2024-04-19T04:28:21.148937+0000","last_became_active":"2024-04-19T04:28:02.840328+0000","last_became_peered":"2024-04-19T04:28:02.840328+0000","last_unstale":"2024-04-19T04:28:21.148937+0000","last_undegraded":"2024-04-19T04:28:21.148937+0000","last_fullsized":"2024-04-19T04:28:21.148937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:21.148887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:21.148887+0000","last_clean_scrub_stamp":"2024-04-19T04:28:21.148887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:44:55.928928+0000","scrub_duration":0.0038294929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:46.483321+0000","last_change":"2024-04-19T04:28:46.483620+0000","last_active":"2024-04-19T04:28:46.483321+0000","last_peered":"2024-04-19T04:28:46.483321+0000","last_clean":"2024-04-19T04:28:46.483321+0000","last_became_active":"2024-04-19T04:28:12.087575+0000","last_became_peered":"2024-04-19T04:28:12.087575+0000","last_unstale":"2024-04-19T04:28:46.483321+0000","last_undegraded":"2024-04-19T04:28:46.483321+0000","last_fullsized":"2024-04-19T04:28:46.483321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:46.483271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:46.483271+0000","last_clean_scrub_stamp":"2024-04-19T04:28:46.483271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:13.971451+0000","scrub_duration":0.0034840449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303673+0000","last_change":"2024-04-19T04:28:02.844076+0000","last_active":"2024-04-19T04:28:13.303673+0000","last_peered":"2024-04-19T04:28:13.303673+0000","last_clean":"2024-04-19T04:28:13.303673+0000","last_became_active":"2024-04-19T04:28:02.840839+0000","last_became_peered":"2024-04-19T04:28:02.840839+0000","last_unstale":"2024-04-19T04:28:13.303673+0000","last_undegraded":"2024-04-19T04:28:13.303673+0000","last_fullsized":"2024-04-19T04:28:13.303673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481032+0000","last_change":"2024-04-19T04:28:02.635123+0000","last_active":"2024-04-19T04:28:19.481032+0000","last_peered":"2024-04-19T04:28:19.481032+0000","last_clean":"2024-04-19T04:28:19.481032+0000","last_became_active":"2024-04-19T04:28:02.634633+0000","last_became_peered":"2024-04-19T04:28:02.634633+0000","last_unstale":"2024-04-19T04:28:19.481032+0000","last_undegraded":"2024-04-19T04:28:19.481032+0000","last_fullsized":"2024-04-19T04:28:19.481032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481074+0000","last_change":"2024-04-19T04:28:02.638250+0000","last_active":"2024-04-19T04:28:19.481074+0000","last_peered":"2024-04-19T04:28:19.481074+0000","last_clean":"2024-04-19T04:28:19.481074+0000","last_became_active":"2024-04-19T04:28:02.637233+0000","last_became_peered":"2024-04-19T04:28:02.637233+0000","last_unstale":"2024-04-19T04:28:19.481074+0000","last_undegraded":"2024-04-19T04:28:19.481074+0000","last_fullsized":"2024-04-19T04:28:19.481074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:53.216978+0000","last_change":"2024-04-19T04:28:53.217334+0000","last_active":"2024-04-19T04:28:53.216978+0000","last_peered":"2024-04-19T04:28:53.216978+0000","last_clean":"2024-04-19T04:28:53.216978+0000","last_became_active":"2024-04-19T04:28:02.837829+0000","last_became_peered":"2024-04-19T04:28:02.837829+0000","last_unstale":"2024-04-19T04:28:53.216978+0000","last_undegraded":"2024-04-19T04:28:53.216978+0000","last_fullsized":"2024-04-19T04:28:53.216978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:53.216932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:53.216932+0000","last_clean_scrub_stamp":"2024-04-19T04:28:53.216932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:28:52.742878+0000","scrub_duration":0.0032988420000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481066+0000","last_change":"2024-04-19T04:28:02.636097+0000","last_active":"2024-04-19T04:28:19.481066+0000","last_peered":"2024-04-19T04:28:19.481066+0000","last_clean":"2024-04-19T04:28:19.481066+0000","last_became_active":"2024-04-19T04:28:02.634103+0000","last_became_peered":"2024-04-19T04:28:02.634103+0000","last_unstale":"2024-04-19T04:28:19.481066+0000","last_undegraded":"2024-04-19T04:28:19.481066+0000","last_fullsized":"2024-04-19T04:28:19.481066+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.301845+0000","last_change":"2024-04-19T04:28:02.835876+0000","last_active":"2024-04-19T04:28:13.301845+0000","last_peered":"2024-04-19T04:28:13.301845+0000","last_clean":"2024-04-19T04:28:13.301845+0000","last_became_active":"2024-04-19T04:28:02.835057+0000","last_became_peered":"2024-04-19T04:28:02.835057+0000","last_unstale":"2024-04-19T04:28:13.301845+0000","last_undegraded":"2024-04-19T04:28:13.301845+0000","last_fullsized":"2024-04-19T04:28:13.301845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:20.465699+0000","last_change":"2024-04-19T04:24:20.555116+0000","last_active":"2024-04-19T04:28:20.465699+0000","last_peered":"2024-04-19T04:28:20.465699+0000","last_clean":"2024-04-19T04:28:20.465699+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:28:20.465699+0000","last_undegraded":"2024-04-19T04:28:20.465699+0000","last_fullsized":"2024-04-19T04:28:20.465699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302509+0000","last_change":"2024-04-19T04:28:02.840145+0000","last_active":"2024-04-19T04:28:13.302509+0000","last_peered":"2024-04-19T04:28:13.302509+0000","last_clean":"2024-04-19T04:28:13.302509+0000","last_became_active":"2024-04-19T04:28:02.838918+0000","last_became_peered":"2024-04-19T04:28:02.838918+0000","last_unstale":"2024-04-19T04:28:13.302509+0000","last_undegraded":"2024-04-19T04:28:13.302509+0000","last_fullsized":"2024-04-19T04:28:13.302509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:20.465976+0000","last_change":"2024-04-19T04:28:12.092906+0000","last_active":"2024-04-19T04:28:20.465976+0000","last_peered":"2024-04-19T04:28:20.465976+0000","last_clean":"2024-04-19T04:28:20.465976+0000","last_became_active":"2024-04-19T04:28:12.091609+0000","last_became_peered":"2024-04-19T04:28:12.091609+0000","last_unstale":"2024-04-19T04:28:20.465976+0000","last_undegraded":"2024-04-19T04:28:20.465976+0000","last_fullsized":"2024-04-19T04:28:20.465976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:43.453357+0000","last_change":"2024-04-19T04:28:43.453593+0000","last_active":"2024-04-19T04:28:43.453357+0000","last_peered":"2024-04-19T04:28:43.453357+0000","last_clean":"2024-04-19T04:28:43.453357+0000","last_became_active":"2024-04-19T04:28:12.091335+0000","last_became_peered":"2024-04-19T04:28:12.091335+0000","last_unstale":"2024-04-19T04:28:43.453357+0000","last_undegraded":"2024-04-19T04:28:43.453357+0000","last_fullsized":"2024-04-19T04:28:43.453357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:43.453308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:43.453308+0000","last_clean_scrub_stamp":"2024-04-19T04:28:43.453308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:37:50.638133+0000","scrub_duration":0.0032802869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:45.236169+0000","last_change":"2024-04-19T04:28:45.236529+0000","last_active":"2024-04-19T04:28:45.236169+0000","last_peered":"2024-04-19T04:28:45.236169+0000","last_clean":"2024-04-19T04:28:45.236169+0000","last_became_active":"2024-04-19T04:28:02.839883+0000","last_became_peered":"2024-04-19T04:28:02.839883+0000","last_unstale":"2024-04-19T04:28:45.236169+0000","last_undegraded":"2024-04-19T04:28:45.236169+0000","last_fullsized":"2024-04-19T04:28:45.236169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:28:45.236116+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:28:45.236116+0000","last_clean_scrub_stamp":"2024-04-19T04:28:45.236116+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:21.181858+0000","scrub_duration":0.0065909519999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302721+0000","last_change":"2024-04-19T04:28:02.845957+0000","last_active":"2024-04-19T04:28:13.302721+0000","last_peered":"2024-04-19T04:28:13.302721+0000","last_clean":"2024-04-19T04:28:13.302721+0000","last_became_active":"2024-04-19T04:28:02.845256+0000","last_became_peered":"2024-04-19T04:28:02.845256+0000","last_unstale":"2024-04-19T04:28:13.302721+0000","last_undegraded":"2024-04-19T04:28:13.302721+0000","last_fullsized":"2024-04-19T04:28:13.302721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:35.232642+0000","last_change":"2024-04-19T04:28:35.232894+0000","last_active":"2024-04-19T04:28:35.232642+0000","last_peered":"2024-04-19T04:28:35.232642+0000","last_clean":"2024-04-19T04:28:35.232642+0000","last_became_active":"2024-04-19T04:28:02.844128+0000","last_became_peered":"2024-04-19T04:28:02.844128+0000","last_unstale":"2024-04-19T04:28:35.232642+0000","last_undegraded":"2024-04-19T04:28:35.232642+0000","last_fullsized":"2024-04-19T04:28:35.232642+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:35.232595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:35.232595+0000","last_clean_scrub_stamp":"2024-04-19T04:28:35.232595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:17:35.552236+0000","scrub_duration":0.0033160400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302792+0000","last_change":"2024-04-19T04:28:02.845918+0000","last_active":"2024-04-19T04:28:13.302792+0000","last_peered":"2024-04-19T04:28:13.302792+0000","last_clean":"2024-04-19T04:28:13.302792+0000","last_became_active":"2024-04-19T04:28:02.844483+0000","last_became_peered":"2024-04-19T04:28:02.844483+0000","last_unstale":"2024-04-19T04:28:13.302792+0000","last_undegraded":"2024-04-19T04:28:13.302792+0000","last_fullsized":"2024-04-19T04:28:13.302792+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.480965+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:28:19.480965+0000","last_peered":"2024-04-19T04:28:19.480965+0000","last_clean":"2024-04-19T04:28:19.480965+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:28:19.480965+0000","last_undegraded":"2024-04-19T04:28:19.480965+0000","last_fullsized":"2024-04-19T04:28:19.480965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.255678+0000","last_change":"2024-04-19T04:28:12.091443+0000","last_active":"2024-04-19T04:28:15.255678+0000","last_peered":"2024-04-19T04:28:15.255678+0000","last_clean":"2024-04-19T04:28:15.255678+0000","last_became_active":"2024-04-19T04:28:12.088123+0000","last_became_peered":"2024-04-19T04:28:12.088123+0000","last_unstale":"2024-04-19T04:28:15.255678+0000","last_undegraded":"2024-04-19T04:28:15.255678+0000","last_fullsized":"2024-04-19T04:28:15.255678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:36.624667+0000","last_change":"2024-04-19T04:28:36.624976+0000","last_active":"2024-04-19T04:28:36.624667+0000","last_peered":"2024-04-19T04:28:36.624667+0000","last_clean":"2024-04-19T04:28:36.624667+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:28:36.624667+0000","last_undegraded":"2024-04-19T04:28:36.624667+0000","last_fullsized":"2024-04-19T04:28:36.624667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:36.624618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:36.624618+0000","last_clean_scrub_stamp":"2024-04-19T04:28:36.624618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:45.570664+0000","scrub_duration":0.0035750109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"79'10","reported_seq":94,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:56.749774+0000","last_change":"2024-04-19T04:28:56.750060+0000","last_active":"2024-04-19T04:28:56.749774+0000","last_peered":"2024-04-19T04:28:56.749774+0000","last_clean":"2024-04-19T04:28:56.749774+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:28:56.749774+0000","last_undegraded":"2024-04-19T04:28:56.749774+0000","last_fullsized":"2024-04-19T04:28:56.749774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-04-19T04:28:56.749717+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-04-19T04:28:56.749717+0000","last_clean_scrub_stamp":"2024-04-19T04:28:56.749717+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:09:09.583526+0000","scrub_duration":0.010036193000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:23.193351+0000","last_change":"2024-04-19T04:28:23.193584+0000","last_active":"2024-04-19T04:28:23.193351+0000","last_peered":"2024-04-19T04:28:23.193351+0000","last_clean":"2024-04-19T04:28:23.193351+0000","last_became_active":"2024-04-19T04:28:02.841373+0000","last_became_peered":"2024-04-19T04:28:02.841373+0000","last_unstale":"2024-04-19T04:28:23.193351+0000","last_undegraded":"2024-04-19T04:28:23.193351+0000","last_fullsized":"2024-04-19T04:28:23.193351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:23.193301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:23.193301+0000","last_clean_scrub_stamp":"2024-04-19T04:28:23.193301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:26.999877+0000","scrub_duration":0.0032212959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.257608+0000","last_change":"2024-04-19T04:28:12.094542+0000","last_active":"2024-04-19T04:28:15.257608+0000","last_peered":"2024-04-19T04:28:15.257608+0000","last_clean":"2024-04-19T04:28:15.257608+0000","last_became_active":"2024-04-19T04:28:12.092784+0000","last_became_peered":"2024-04-19T04:28:12.092784+0000","last_unstale":"2024-04-19T04:28:15.257608+0000","last_undegraded":"2024-04-19T04:28:15.257608+0000","last_fullsized":"2024-04-19T04:28:15.257608+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.095968+0000","last_change":"2024-04-19T04:28:02.638882+0000","last_active":"2024-04-19T04:28:13.095968+0000","last_peered":"2024-04-19T04:28:13.095968+0000","last_clean":"2024-04-19T04:28:13.095968+0000","last_became_active":"2024-04-19T04:28:02.638431+0000","last_became_peered":"2024-04-19T04:28:02.638431+0000","last_unstale":"2024-04-19T04:28:13.095968+0000","last_undegraded":"2024-04-19T04:28:13.095968+0000","last_fullsized":"2024-04-19T04:28:13.095968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:27.190673+0000","last_change":"2024-04-19T04:28:27.190910+0000","last_active":"2024-04-19T04:28:27.190673+0000","last_peered":"2024-04-19T04:28:27.190673+0000","last_clean":"2024-04-19T04:28:27.190673+0000","last_became_active":"2024-04-19T04:28:02.838354+0000","last_became_peered":"2024-04-19T04:28:02.838354+0000","last_unstale":"2024-04-19T04:28:27.190673+0000","last_undegraded":"2024-04-19T04:28:27.190673+0000","last_fullsized":"2024-04-19T04:28:27.190673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:27.190624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:27.190624+0000","last_clean_scrub_stamp":"2024-04-19T04:28:27.190624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:58:16.070118+0000","scrub_duration":0.003493987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303518+0000","last_change":"2024-04-19T04:28:02.838446+0000","last_active":"2024-04-19T04:28:13.303518+0000","last_peered":"2024-04-19T04:28:13.303518+0000","last_clean":"2024-04-19T04:28:13.303518+0000","last_became_active":"2024-04-19T04:28:02.837994+0000","last_became_peered":"2024-04-19T04:28:02.837994+0000","last_unstale":"2024-04-19T04:28:13.303518+0000","last_undegraded":"2024-04-19T04:28:13.303518+0000","last_fullsized":"2024-04-19T04:28:13.303518+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.301093+0000","last_change":"2024-04-19T04:28:02.837195+0000","last_active":"2024-04-19T04:28:13.301093+0000","last_peered":"2024-04-19T04:28:13.301093+0000","last_clean":"2024-04-19T04:28:13.301093+0000","last_became_active":"2024-04-19T04:28:02.836818+0000","last_became_peered":"2024-04-19T04:28:02.836818+0000","last_unstale":"2024-04-19T04:28:13.301093+0000","last_undegraded":"2024-04-19T04:28:13.301093+0000","last_fullsized":"2024-04-19T04:28:13.301093+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:20.465904+0000","last_change":"2024-04-19T04:24:20.552644+0000","last_active":"2024-04-19T04:28:20.465904+0000","last_peered":"2024-04-19T04:28:20.465904+0000","last_clean":"2024-04-19T04:28:20.465904+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:28:20.465904+0000","last_undegraded":"2024-04-19T04:28:20.465904+0000","last_fullsized":"2024-04-19T04:28:20.465904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.300821+0000","last_change":"2024-04-19T04:28:02.839065+0000","last_active":"2024-04-19T04:28:13.300821+0000","last_peered":"2024-04-19T04:28:13.300821+0000","last_clean":"2024-04-19T04:28:13.300821+0000","last_became_active":"2024-04-19T04:28:02.837400+0000","last_became_peered":"2024-04-19T04:28:02.837400+0000","last_unstale":"2024-04-19T04:28:13.300821+0000","last_undegraded":"2024-04-19T04:28:13.300821+0000","last_fullsized":"2024-04-19T04:28:13.300821+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:51.216552+0000","last_change":"2024-04-19T04:28:51.216788+0000","last_active":"2024-04-19T04:28:51.216552+0000","last_peered":"2024-04-19T04:28:51.216552+0000","last_clean":"2024-04-19T04:28:51.216552+0000","last_became_active":"2024-04-19T04:28:02.844057+0000","last_became_peered":"2024-04-19T04:28:02.844057+0000","last_unstale":"2024-04-19T04:28:51.216552+0000","last_undegraded":"2024-04-19T04:28:51.216552+0000","last_fullsized":"2024-04-19T04:28:51.216552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:51.216503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:51.216503+0000","last_clean_scrub_stamp":"2024-04-19T04:28:51.216503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:47:11.830384+0000","scrub_duration":0.003421365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:47.243501+0000","last_change":"2024-04-19T04:28:47.243752+0000","last_active":"2024-04-19T04:28:47.243501+0000","last_peered":"2024-04-19T04:28:47.243501+0000","last_clean":"2024-04-19T04:28:47.243501+0000","last_became_active":"2024-04-19T04:28:02.836492+0000","last_became_peered":"2024-04-19T04:28:02.836492+0000","last_unstale":"2024-04-19T04:28:47.243501+0000","last_undegraded":"2024-04-19T04:28:47.243501+0000","last_fullsized":"2024-04-19T04:28:47.243501+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:47.243453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:47.243453+0000","last_clean_scrub_stamp":"2024-04-19T04:28:47.243453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:57:57.196537+0000","scrub_duration":0.003301942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:52.410116+0000","last_change":"2024-04-19T04:28:52.410331+0000","last_active":"2024-04-19T04:28:52.410116+0000","last_peered":"2024-04-19T04:28:52.410116+0000","last_clean":"2024-04-19T04:28:52.410116+0000","last_became_active":"2024-04-19T04:28:12.095332+0000","last_became_peered":"2024-04-19T04:28:12.095332+0000","last_unstale":"2024-04-19T04:28:52.410116+0000","last_undegraded":"2024-04-19T04:28:52.410116+0000","last_fullsized":"2024-04-19T04:28:52.410116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:52.410070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:52.410070+0000","last_clean_scrub_stamp":"2024-04-19T04:28:52.410070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:41.851489+0000","scrub_duration":0.003375528,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:37.501444+0000","last_change":"2024-04-19T04:28:37.501685+0000","last_active":"2024-04-19T04:28:37.501444+0000","last_peered":"2024-04-19T04:28:37.501444+0000","last_clean":"2024-04-19T04:28:37.501444+0000","last_became_active":"2024-04-19T04:28:12.090262+0000","last_became_peered":"2024-04-19T04:28:12.090262+0000","last_unstale":"2024-04-19T04:28:37.501444+0000","last_undegraded":"2024-04-19T04:28:37.501444+0000","last_fullsized":"2024-04-19T04:28:37.501444+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-19T04:28:37.501393+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-19T04:28:37.501393+0000","last_clean_scrub_stamp":"2024-04-19T04:28:37.501393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:00:31.892502+0000","scrub_duration":0.0035120720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:33.511406+0000","last_change":"2024-04-19T04:28:33.511683+0000","last_active":"2024-04-19T04:28:33.511406+0000","last_peered":"2024-04-19T04:28:33.511406+0000","last_clean":"2024-04-19T04:28:33.511406+0000","last_became_active":"2024-04-19T04:28:12.092979+0000","last_became_peered":"2024-04-19T04:28:12.092979+0000","last_unstale":"2024-04-19T04:28:33.511406+0000","last_undegraded":"2024-04-19T04:28:33.511406+0000","last_fullsized":"2024-04-19T04:28:33.511406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:33.511357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:33.511357+0000","last_clean_scrub_stamp":"2024-04-19T04:28:33.511357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:09:11.578221+0000","scrub_duration":0.0033778150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":44,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:36.522753+0000","last_change":"2024-04-19T04:28:36.523143+0000","last_active":"2024-04-19T04:28:36.522753+0000","last_peered":"2024-04-19T04:28:36.522753+0000","last_clean":"2024-04-19T04:28:36.522753+0000","last_became_active":"2024-04-19T04:28:12.093915+0000","last_became_peered":"2024-04-19T04:28:12.093915+0000","last_unstale":"2024-04-19T04:28:36.522753+0000","last_undegraded":"2024-04-19T04:28:36.522753+0000","last_fullsized":"2024-04-19T04:28:36.522753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-19T04:28:36.522650+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-19T04:28:36.522650+0000","last_clean_scrub_stamp":"2024-04-19T04:28:36.522650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:16.283397+0000","scrub_duration":0.0035824300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094707+0000","last_change":"2024-04-19T04:28:02.639054+0000","last_active":"2024-04-19T04:28:13.094707+0000","last_peered":"2024-04-19T04:28:13.094707+0000","last_clean":"2024-04-19T04:28:13.094707+0000","last_became_active":"2024-04-19T04:28:02.637952+0000","last_became_peered":"2024-04-19T04:28:02.637952+0000","last_unstale":"2024-04-19T04:28:13.094707+0000","last_undegraded":"2024-04-19T04:28:13.094707+0000","last_fullsized":"2024-04-19T04:28:13.094707+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"79'3","reported_seq":100,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:42.732840+0000","last_change":"2024-04-19T04:28:42.733097+0000","last_active":"2024-04-19T04:28:42.732840+0000","last_peered":"2024-04-19T04:28:42.732840+0000","last_clean":"2024-04-19T04:28:42.732840+0000","last_became_active":"2024-04-19T04:28:02.634226+0000","last_became_peered":"2024-04-19T04:28:02.634226+0000","last_unstale":"2024-04-19T04:28:42.732840+0000","last_undegraded":"2024-04-19T04:28:42.732840+0000","last_fullsized":"2024-04-19T04:28:42.732840+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:28:42.732789+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:28:42.732789+0000","last_clean_scrub_stamp":"2024-04-19T04:28:42.732789+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:39.702938+0000","scrub_duration":0.0066219249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:52.772097+0000","last_change":"2024-04-19T04:28:52.772390+0000","last_active":"2024-04-19T04:28:52.772097+0000","last_peered":"2024-04-19T04:28:52.772097+0000","last_clean":"2024-04-19T04:28:52.772097+0000","last_became_active":"2024-04-19T04:28:02.636266+0000","last_became_peered":"2024-04-19T04:28:02.636266+0000","last_unstale":"2024-04-19T04:28:52.772097+0000","last_undegraded":"2024-04-19T04:28:52.772097+0000","last_fullsized":"2024-04-19T04:28:52.772097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:52.772052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:52.772052+0000","last_clean_scrub_stamp":"2024-04-19T04:28:52.772052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:04.600653+0000","scrub_duration":0.0038532319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.257183+0000","last_change":"2024-04-19T04:28:12.095797+0000","last_active":"2024-04-19T04:28:15.257183+0000","last_peered":"2024-04-19T04:28:15.257183+0000","last_clean":"2024-04-19T04:28:15.257183+0000","last_became_active":"2024-04-19T04:28:12.095199+0000","last_became_peered":"2024-04-19T04:28:12.095199+0000","last_unstale":"2024-04-19T04:28:15.257183+0000","last_undegraded":"2024-04-19T04:28:15.257183+0000","last_fullsized":"2024-04-19T04:28:15.257183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.256312+0000","last_change":"2024-04-19T04:28:12.091303+0000","last_active":"2024-04-19T04:28:15.256312+0000","last_peered":"2024-04-19T04:28:15.256312+0000","last_clean":"2024-04-19T04:28:15.256312+0000","last_became_active":"2024-04-19T04:28:12.087884+0000","last_became_peered":"2024-04-19T04:28:12.087884+0000","last_unstale":"2024-04-19T04:28:15.256312+0000","last_undegraded":"2024-04-19T04:28:15.256312+0000","last_fullsized":"2024-04-19T04:28:15.256312+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303600+0000","last_change":"2024-04-19T04:28:02.846538+0000","last_active":"2024-04-19T04:28:13.303600+0000","last_peered":"2024-04-19T04:28:13.303600+0000","last_clean":"2024-04-19T04:28:13.303600+0000","last_became_active":"2024-04-19T04:28:02.846234+0000","last_became_peered":"2024-04-19T04:28:02.846234+0000","last_unstale":"2024-04-19T04:28:13.303600+0000","last_undegraded":"2024-04-19T04:28:13.303600+0000","last_fullsized":"2024-04-19T04:28:13.303600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:41.739005+0000","last_change":"2024-04-19T04:28:41.739248+0000","last_active":"2024-04-19T04:28:41.739005+0000","last_peered":"2024-04-19T04:28:41.739005+0000","last_clean":"2024-04-19T04:28:41.739005+0000","last_became_active":"2024-04-19T04:28:02.634433+0000","last_became_peered":"2024-04-19T04:28:02.634433+0000","last_unstale":"2024-04-19T04:28:41.739005+0000","last_undegraded":"2024-04-19T04:28:41.739005+0000","last_fullsized":"2024-04-19T04:28:41.739005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:41.738950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:41.738950+0000","last_clean_scrub_stamp":"2024-04-19T04:28:41.738950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:20.301173+0000","scrub_duration":0.0033981039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303822+0000","last_change":"2024-04-19T04:28:02.844897+0000","last_active":"2024-04-19T04:28:13.303822+0000","last_peered":"2024-04-19T04:28:13.303822+0000","last_clean":"2024-04-19T04:28:13.303822+0000","last_became_active":"2024-04-19T04:28:02.844276+0000","last_became_peered":"2024-04-19T04:28:02.844276+0000","last_unstale":"2024-04-19T04:28:13.303822+0000","last_undegraded":"2024-04-19T04:28:13.303822+0000","last_fullsized":"2024-04-19T04:28:13.303822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},"log_size":47,"ondisk_log_size":47,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705727,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220708,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151132,"statfs":{"total":96636764160,"available":96410759168,"internally_reserved":0,"allocated":946176,"data_stored":926258,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 04:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.624,"15min":0.755},"min":{"1min":0.51700000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.85099999999999998,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.67400000000000004,"5min":0.248,"15min":0.248},"max":{"1min":1.087,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.67100000000000004}]},{"osd":1,"last update":"Fri Apr 19 04:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":5.1989999999999998,"5min":5.1989999999999998,"15min":5.1989999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":0.61399999999999999}]}]},{"osd":1,"up_from":72,"seq":309237645326,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44116,"kb_used_data":844,"kb_used_omap":6,"kb_used_meta":43257,"kb_avail":94327724,"statfs":{"total":96636764160,"available":96591589376,"internally_reserved":0,"allocated":864256,"data_stored":334760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6880,"internal_metadata":44295456},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298664,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297726,"kb_avail":94073176,"statfs":{"total":96636764160,"available":96330932224,"internally_reserved":0,"allocated":950272,"data_stored":924740,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":304871878},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 04:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.746},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Apr 19 04:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.56899999999999995,"5min":0.223,"15min":0.223},"max":{"1min":0.75900000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65700000000000003,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.77900000000000003,"5min":4.5,"15min":4.5},"last":0.79200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:29:01.562 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.562 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.562 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.562 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.562 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.562 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.563 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.563 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.563 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.563 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.563 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.563 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.563 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.563 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.564 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.564 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.564 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.564 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.564 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.564 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.564 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.564 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.564 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.565 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.565 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.565 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.565 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.565 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.565 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.565 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.565 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.565 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.566 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.566 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T04:24:09.083488+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.566 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.566 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.566 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.566 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.566 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.566 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.566 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.567 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.567 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.567 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.567 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.567 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.567 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.567 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.567 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.567 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.568 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.568 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.568 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.568 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.568 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.568 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.568 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.568 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.569 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.569 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.569 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.569 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:01.569 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T04:29:21.570 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:29:21.901 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:29:21.904 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:29:21.916 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-04-19T04:29:21.010394+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":563488,"kb_used_data":2696,"kb_used_omap":9,"kb_used_meta":560758,"kb_avail":282552032,"statfs":{"total":289910292480,"available":289333280768,"internally_reserved":0,"allocated":2760704,"data_stored":2185758,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":10068,"internal_metadata":574216364},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004427"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:24.524670+0000","last_change":"2024-04-19T04:28:24.524670+0000","last_active":"2024-04-19T04:28:24.524670+0000","last_peered":"2024-04-19T04:28:24.524670+0000","last_clean":"2024-04-19T04:28:24.524670+0000","last_became_active":"2024-04-19T04:28:12.093175+0000","last_became_peered":"2024-04-19T04:28:12.093175+0000","last_unstale":"2024-04-19T04:28:24.524670+0000","last_undegraded":"2024-04-19T04:28:24.524670+0000","last_fullsized":"2024-04-19T04:28:24.524670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:24.524536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:24.524536+0000","last_clean_scrub_stamp":"2024-04-19T04:28:24.524536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:34:39.154898+0000","scrub_duration":0.080942869000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:25.440827+0000","last_change":"2024-04-19T04:28:25.440827+0000","last_active":"2024-04-19T04:28:25.440827+0000","last_peered":"2024-04-19T04:28:25.440827+0000","last_clean":"2024-04-19T04:28:25.440827+0000","last_became_active":"2024-04-19T04:28:12.092819+0000","last_became_peered":"2024-04-19T04:28:12.092819+0000","last_unstale":"2024-04-19T04:28:25.440827+0000","last_undegraded":"2024-04-19T04:28:25.440827+0000","last_fullsized":"2024-04-19T04:28:25.440827+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:25.440548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:25.440548+0000","last_clean_scrub_stamp":"2024-04-19T04:28:25.440548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:40.485315+0000","scrub_duration":0.0035723539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481982+0000","last_change":"2024-04-19T04:24:20.556199+0000","last_active":"2024-04-19T04:28:19.481982+0000","last_peered":"2024-04-19T04:28:19.481982+0000","last_clean":"2024-04-19T04:28:19.481982+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:28:19.481982+0000","last_undegraded":"2024-04-19T04:28:19.481982+0000","last_fullsized":"2024-04-19T04:28:19.481982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481947+0000","last_change":"2024-04-19T04:28:02.635437+0000","last_active":"2024-04-19T04:28:19.481947+0000","last_peered":"2024-04-19T04:28:19.481947+0000","last_clean":"2024-04-19T04:28:19.481947+0000","last_became_active":"2024-04-19T04:28:02.634355+0000","last_became_peered":"2024-04-19T04:28:02.634355+0000","last_unstale":"2024-04-19T04:28:19.481947+0000","last_undegraded":"2024-04-19T04:28:19.481947+0000","last_fullsized":"2024-04-19T04:28:19.481947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:34.504737+0000","last_change":"2024-04-19T04:28:34.505005+0000","last_active":"2024-04-19T04:28:34.504737+0000","last_peered":"2024-04-19T04:28:34.504737+0000","last_clean":"2024-04-19T04:28:34.504737+0000","last_became_active":"2024-04-19T04:28:12.088231+0000","last_became_peered":"2024-04-19T04:28:12.088231+0000","last_unstale":"2024-04-19T04:28:34.504737+0000","last_undegraded":"2024-04-19T04:28:34.504737+0000","last_fullsized":"2024-04-19T04:28:34.504737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:34.504692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:34.504692+0000","last_clean_scrub_stamp":"2024-04-19T04:28:34.504692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:54:14.305698+0000","scrub_duration":0.021028397000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094332+0000","last_change":"2024-04-19T04:28:02.637742+0000","last_active":"2024-04-19T04:28:13.094332+0000","last_peered":"2024-04-19T04:28:13.094332+0000","last_clean":"2024-04-19T04:28:13.094332+0000","last_became_active":"2024-04-19T04:28:02.637276+0000","last_became_peered":"2024-04-19T04:28:02.637276+0000","last_unstale":"2024-04-19T04:28:13.094332+0000","last_undegraded":"2024-04-19T04:28:13.094332+0000","last_fullsized":"2024-04-19T04:28:13.094332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:39.760633+0000","last_change":"2024-04-19T04:28:39.760873+0000","last_active":"2024-04-19T04:28:39.760633+0000","last_peered":"2024-04-19T04:28:39.760633+0000","last_clean":"2024-04-19T04:28:39.760633+0000","last_became_active":"2024-04-19T04:28:02.637086+0000","last_became_peered":"2024-04-19T04:28:02.637086+0000","last_unstale":"2024-04-19T04:28:39.760633+0000","last_undegraded":"2024-04-19T04:28:39.760633+0000","last_fullsized":"2024-04-19T04:28:39.760633+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:39.760588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:39.760588+0000","last_clean_scrub_stamp":"2024-04-19T04:28:39.760588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:47:43.003181+0000","scrub_duration":0.020879537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.093753+0000","last_change":"2024-04-19T04:28:02.638186+0000","last_active":"2024-04-19T04:28:13.093753+0000","last_peered":"2024-04-19T04:28:13.093753+0000","last_clean":"2024-04-19T04:28:13.093753+0000","last_became_active":"2024-04-19T04:28:02.637746+0000","last_became_peered":"2024-04-19T04:28:02.637746+0000","last_unstale":"2024-04-19T04:28:13.093753+0000","last_undegraded":"2024-04-19T04:28:13.093753+0000","last_fullsized":"2024-04-19T04:28:13.093753+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303296+0000","last_change":"2024-04-19T04:28:02.842455+0000","last_active":"2024-04-19T04:28:13.303296+0000","last_peered":"2024-04-19T04:28:13.303296+0000","last_clean":"2024-04-19T04:28:13.303296+0000","last_became_active":"2024-04-19T04:28:02.839203+0000","last_became_peered":"2024-04-19T04:28:02.839203+0000","last_unstale":"2024-04-19T04:28:13.303296+0000","last_undegraded":"2024-04-19T04:28:13.303296+0000","last_fullsized":"2024-04-19T04:28:13.303296+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":69,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:20.466238+0000","last_change":"2024-04-19T04:28:12.093403+0000","last_active":"2024-04-19T04:28:20.466238+0000","last_peered":"2024-04-19T04:28:20.466238+0000","last_clean":"2024-04-19T04:28:20.466238+0000","last_became_active":"2024-04-19T04:28:12.092924+0000","last_became_peered":"2024-04-19T04:28:12.092924+0000","last_unstale":"2024-04-19T04:28:20.466238+0000","last_undegraded":"2024-04-19T04:28:20.466238+0000","last_fullsized":"2024-04-19T04:28:20.466238+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481896+0000","last_change":"2024-04-19T04:28:02.636293+0000","last_active":"2024-04-19T04:28:19.481896+0000","last_peered":"2024-04-19T04:28:19.481896+0000","last_clean":"2024-04-19T04:28:19.481896+0000","last_became_active":"2024-04-19T04:28:02.635946+0000","last_became_peered":"2024-04-19T04:28:02.635946+0000","last_unstale":"2024-04-19T04:28:19.481896+0000","last_undegraded":"2024-04-19T04:28:19.481896+0000","last_fullsized":"2024-04-19T04:28:19.481896+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:35.526927+0000","last_change":"2024-04-19T04:28:35.527163+0000","last_active":"2024-04-19T04:28:35.526927+0000","last_peered":"2024-04-19T04:28:35.526927+0000","last_clean":"2024-04-19T04:28:35.526927+0000","last_became_active":"2024-04-19T04:28:12.094753+0000","last_became_peered":"2024-04-19T04:28:12.094753+0000","last_unstale":"2024-04-19T04:28:35.526927+0000","last_undegraded":"2024-04-19T04:28:35.526927+0000","last_fullsized":"2024-04-19T04:28:35.526927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:35.526884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:35.526884+0000","last_clean_scrub_stamp":"2024-04-19T04:28:35.526884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:06:35.618252+0000","scrub_duration":0.0031760289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:47.475887+0000","last_change":"2024-04-19T04:28:47.475887+0000","last_active":"2024-04-19T04:28:47.475887+0000","last_peered":"2024-04-19T04:28:47.475887+0000","last_clean":"2024-04-19T04:28:47.475887+0000","last_became_active":"2024-04-19T04:28:12.093267+0000","last_became_peered":"2024-04-19T04:28:12.093267+0000","last_unstale":"2024-04-19T04:28:47.475887+0000","last_undegraded":"2024-04-19T04:28:47.475887+0000","last_fullsized":"2024-04-19T04:28:47.475887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:47.475618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:47.475618+0000","last_clean_scrub_stamp":"2024-04-19T04:28:47.475618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:37.519624+0000","scrub_duration":0.022523944000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:23.449786+0000","last_change":"2024-04-19T04:28:23.449786+0000","last_active":"2024-04-19T04:28:23.449786+0000","last_peered":"2024-04-19T04:28:23.449786+0000","last_clean":"2024-04-19T04:28:23.449786+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:28:23.449786+0000","last_undegraded":"2024-04-19T04:28:23.449786+0000","last_fullsized":"2024-04-19T04:28:23.449786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:23.449500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:23.449500+0000","last_clean_scrub_stamp":"2024-04-19T04:28:23.449500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:20.102454+0000","scrub_duration":0.0033193469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481810+0000","last_change":"2024-04-19T04:24:20.551809+0000","last_active":"2024-04-19T04:28:19.481810+0000","last_peered":"2024-04-19T04:28:19.481810+0000","last_clean":"2024-04-19T04:28:19.481810+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:28:19.481810+0000","last_undegraded":"2024-04-19T04:28:19.481810+0000","last_fullsized":"2024-04-19T04:28:19.481810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:33.597905+0000","last_change":"2024-04-19T04:28:33.597905+0000","last_active":"2024-04-19T04:28:33.597905+0000","last_peered":"2024-04-19T04:28:33.597905+0000","last_clean":"2024-04-19T04:28:33.597905+0000","last_became_active":"2024-04-19T04:28:02.637920+0000","last_became_peered":"2024-04-19T04:28:02.637920+0000","last_unstale":"2024-04-19T04:28:33.597905+0000","last_undegraded":"2024-04-19T04:28:33.597905+0000","last_fullsized":"2024-04-19T04:28:33.597905+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:33.597411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:33.597411+0000","last_clean_scrub_stamp":"2024-04-19T04:28:33.597411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:50.250390+0000","scrub_duration":0.0037610339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:42.236628+0000","last_change":"2024-04-19T04:28:42.236755+0000","last_active":"2024-04-19T04:28:42.236628+0000","last_peered":"2024-04-19T04:28:42.236628+0000","last_clean":"2024-04-19T04:28:42.236628+0000","last_became_active":"2024-04-19T04:28:02.839071+0000","last_became_peered":"2024-04-19T04:28:02.839071+0000","last_unstale":"2024-04-19T04:28:42.236628+0000","last_undegraded":"2024-04-19T04:28:42.236628+0000","last_fullsized":"2024-04-19T04:28:42.236628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:42.236604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:42.236604+0000","last_clean_scrub_stamp":"2024-04-19T04:28:42.236604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:47:48.663058+0000","scrub_duration":0.070531359000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:06.456011+0000","last_change":"2024-04-19T04:29:06.456366+0000","last_active":"2024-04-19T04:29:06.456011+0000","last_peered":"2024-04-19T04:29:06.456011+0000","last_clean":"2024-04-19T04:29:06.456011+0000","last_became_active":"2024-04-19T04:28:02.638230+0000","last_became_peered":"2024-04-19T04:28:02.638230+0000","last_unstale":"2024-04-19T04:29:06.456011+0000","last_undegraded":"2024-04-19T04:29:06.456011+0000","last_fullsized":"2024-04-19T04:29:06.456011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:06.455968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:06.455968+0000","last_clean_scrub_stamp":"2024-04-19T04:29:06.455968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:03.426117+0000","scrub_duration":0.0030903710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:31.226313+0000","last_change":"2024-04-19T04:28:31.226446+0000","last_active":"2024-04-19T04:28:31.226313+0000","last_peered":"2024-04-19T04:28:31.226313+0000","last_clean":"2024-04-19T04:28:31.226313+0000","last_became_active":"2024-04-19T04:28:02.839362+0000","last_became_peered":"2024-04-19T04:28:02.839362+0000","last_unstale":"2024-04-19T04:28:31.226313+0000","last_undegraded":"2024-04-19T04:28:31.226313+0000","last_fullsized":"2024-04-19T04:28:31.226313+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:31.226291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:31.226291+0000","last_clean_scrub_stamp":"2024-04-19T04:28:31.226291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:43:05.235533+0000","scrub_duration":0.029412667999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:28.516191+0000","last_change":"2024-04-19T04:28:28.516191+0000","last_active":"2024-04-19T04:28:28.516191+0000","last_peered":"2024-04-19T04:28:28.516191+0000","last_clean":"2024-04-19T04:28:28.516191+0000","last_became_active":"2024-04-19T04:28:02.634835+0000","last_became_peered":"2024-04-19T04:28:02.634835+0000","last_unstale":"2024-04-19T04:28:28.516191+0000","last_undegraded":"2024-04-19T04:28:28.516191+0000","last_fullsized":"2024-04-19T04:28:28.516191+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:28.515710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:28.515710+0000","last_clean_scrub_stamp":"2024-04-19T04:28:28.515710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:46.923636+0000","scrub_duration":0.0034446709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:10.768430+0000","last_change":"2024-04-19T04:29:10.768757+0000","last_active":"2024-04-19T04:29:10.768430+0000","last_peered":"2024-04-19T04:29:10.768430+0000","last_clean":"2024-04-19T04:29:10.768430+0000","last_became_active":"2024-04-19T04:28:02.638546+0000","last_became_peered":"2024-04-19T04:28:02.638546+0000","last_unstale":"2024-04-19T04:29:10.768430+0000","last_undegraded":"2024-04-19T04:29:10.768430+0000","last_fullsized":"2024-04-19T04:29:10.768430+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:10.768364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:10.768364+0000","last_clean_scrub_stamp":"2024-04-19T04:29:10.768364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:36.009796+0000","scrub_duration":0.042629556999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:49.435023+0000","last_change":"2024-04-19T04:28:49.435301+0000","last_active":"2024-04-19T04:28:49.435023+0000","last_peered":"2024-04-19T04:28:49.435023+0000","last_clean":"2024-04-19T04:28:49.435023+0000","last_became_active":"2024-04-19T04:28:12.087571+0000","last_became_peered":"2024-04-19T04:28:12.087571+0000","last_unstale":"2024-04-19T04:28:49.435023+0000","last_undegraded":"2024-04-19T04:28:49.435023+0000","last_fullsized":"2024-04-19T04:28:49.435023+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:49.434979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:49.434979+0000","last_clean_scrub_stamp":"2024-04-19T04:28:49.434979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:46.111742+0000","scrub_duration":0.003316786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:34.194332+0000","last_change":"2024-04-19T04:28:34.194663+0000","last_active":"2024-04-19T04:28:34.194332+0000","last_peered":"2024-04-19T04:28:34.194332+0000","last_clean":"2024-04-19T04:28:34.194332+0000","last_became_active":"2024-04-19T04:28:02.840294+0000","last_became_peered":"2024-04-19T04:28:02.840294+0000","last_unstale":"2024-04-19T04:28:34.194332+0000","last_undegraded":"2024-04-19T04:28:34.194332+0000","last_fullsized":"2024-04-19T04:28:34.194332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:34.194285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:34.194285+0000","last_clean_scrub_stamp":"2024-04-19T04:28:34.194285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:53:04.918350+0000","scrub_duration":0.0033717299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:18.460467+0000","last_change":"2024-04-19T04:29:18.460690+0000","last_active":"2024-04-19T04:29:18.460467+0000","last_peered":"2024-04-19T04:29:18.460467+0000","last_clean":"2024-04-19T04:29:18.460467+0000","last_became_active":"2024-04-19T04:28:12.089918+0000","last_became_peered":"2024-04-19T04:28:12.089918+0000","last_unstale":"2024-04-19T04:29:18.460467+0000","last_undegraded":"2024-04-19T04:29:18.460467+0000","last_fullsized":"2024-04-19T04:29:18.460467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:18.460425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:18.460425+0000","last_clean_scrub_stamp":"2024-04-19T04:29:18.460425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:09:31.294234+0000","scrub_duration":0.0033207029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.257493+0000","last_change":"2024-04-19T04:28:12.092733+0000","last_active":"2024-04-19T04:28:15.257493+0000","last_peered":"2024-04-19T04:28:15.257493+0000","last_clean":"2024-04-19T04:28:15.257493+0000","last_became_active":"2024-04-19T04:28:12.091770+0000","last_became_peered":"2024-04-19T04:28:12.091770+0000","last_unstale":"2024-04-19T04:28:15.257493+0000","last_undegraded":"2024-04-19T04:28:15.257493+0000","last_fullsized":"2024-04-19T04:28:15.257493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303363+0000","last_change":"2024-04-19T04:28:02.846092+0000","last_active":"2024-04-19T04:28:13.303363+0000","last_peered":"2024-04-19T04:28:13.303363+0000","last_clean":"2024-04-19T04:28:13.303363+0000","last_became_active":"2024-04-19T04:28:02.845416+0000","last_became_peered":"2024-04-19T04:28:02.845416+0000","last_unstale":"2024-04-19T04:28:13.303363+0000","last_undegraded":"2024-04-19T04:28:13.303363+0000","last_fullsized":"2024-04-19T04:28:13.303363+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481739+0000","last_change":"2024-04-19T04:24:20.554885+0000","last_active":"2024-04-19T04:28:19.481739+0000","last_peered":"2024-04-19T04:28:19.481739+0000","last_clean":"2024-04-19T04:28:19.481739+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:28:19.481739+0000","last_undegraded":"2024-04-19T04:28:19.481739+0000","last_fullsized":"2024-04-19T04:28:19.481739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:00.393690+0000","last_change":"2024-04-19T04:29:00.393991+0000","last_active":"2024-04-19T04:29:00.393690+0000","last_peered":"2024-04-19T04:29:00.393690+0000","last_clean":"2024-04-19T04:29:00.393690+0000","last_became_active":"2024-04-19T04:28:12.091969+0000","last_became_peered":"2024-04-19T04:28:12.091969+0000","last_unstale":"2024-04-19T04:29:00.393690+0000","last_undegraded":"2024-04-19T04:29:00.393690+0000","last_fullsized":"2024-04-19T04:29:00.393690+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:00.393643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:00.393643+0000","last_clean_scrub_stamp":"2024-04-19T04:29:00.393643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:43:09.339689+0000","scrub_duration":0.0029687910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:19.135747+0000","last_change":"2024-04-19T04:29:19.135893+0000","last_active":"2024-04-19T04:29:19.135747+0000","last_peered":"2024-04-19T04:29:19.135747+0000","last_clean":"2024-04-19T04:29:19.135747+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:29:19.135747+0000","last_undegraded":"2024-04-19T04:29:19.135747+0000","last_fullsized":"2024-04-19T04:29:19.135747+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:19.135719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:19.135719+0000","last_clean_scrub_stamp":"2024-04-19T04:29:19.135719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:18:22.526783+0000","scrub_duration":0.029313573999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:05.491064+0000","last_change":"2024-04-19T04:29:05.491373+0000","last_active":"2024-04-19T04:29:05.491064+0000","last_peered":"2024-04-19T04:29:05.491064+0000","last_clean":"2024-04-19T04:29:05.491064+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:29:05.491064+0000","last_undegraded":"2024-04-19T04:29:05.491064+0000","last_fullsized":"2024-04-19T04:29:05.491064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:05.491021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:05.491021+0000","last_clean_scrub_stamp":"2024-04-19T04:29:05.491021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:44.053244+0000","scrub_duration":0.0032047590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:13.152396+0000","last_change":"2024-04-19T04:29:13.152726+0000","last_active":"2024-04-19T04:29:13.152396+0000","last_peered":"2024-04-19T04:29:13.152396+0000","last_clean":"2024-04-19T04:29:13.152396+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:29:13.152396+0000","last_undegraded":"2024-04-19T04:29:13.152396+0000","last_fullsized":"2024-04-19T04:29:13.152396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:13.152340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:13.152340+0000","last_clean_scrub_stamp":"2024-04-19T04:29:13.152340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:11:50.888946+0000","scrub_duration":0.0034040730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:16.704532+0000","last_change":"2024-04-19T04:29:16.704756+0000","last_active":"2024-04-19T04:29:16.704532+0000","last_peered":"2024-04-19T04:29:16.704532+0000","last_clean":"2024-04-19T04:29:16.704532+0000","last_became_active":"2024-04-19T04:28:02.634586+0000","last_became_peered":"2024-04-19T04:28:02.634586+0000","last_unstale":"2024-04-19T04:29:16.704532+0000","last_undegraded":"2024-04-19T04:29:16.704532+0000","last_fullsized":"2024-04-19T04:29:16.704532+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:16.704476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:16.704476+0000","last_clean_scrub_stamp":"2024-04-19T04:29:16.704476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:05.468791+0000","scrub_duration":0.0032163460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:48.475080+0000","last_change":"2024-04-19T04:28:48.475080+0000","last_active":"2024-04-19T04:28:48.475080+0000","last_peered":"2024-04-19T04:28:48.475080+0000","last_clean":"2024-04-19T04:28:48.475080+0000","last_became_active":"2024-04-19T04:28:12.094558+0000","last_became_peered":"2024-04-19T04:28:12.094558+0000","last_unstale":"2024-04-19T04:28:48.475080+0000","last_undegraded":"2024-04-19T04:28:48.475080+0000","last_fullsized":"2024-04-19T04:28:48.475080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:48.474816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:48.474816+0000","last_clean_scrub_stamp":"2024-04-19T04:28:48.474816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:45.127770+0000","scrub_duration":0.003339912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"79'4","reported_seq":102,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:59.874932+0000","last_change":"2024-04-19T04:28:59.874932+0000","last_active":"2024-04-19T04:28:59.874932+0000","last_peered":"2024-04-19T04:28:59.874932+0000","last_clean":"2024-04-19T04:28:59.874932+0000","last_became_active":"2024-04-19T04:28:02.638666+0000","last_became_peered":"2024-04-19T04:28:02.638666+0000","last_unstale":"2024-04-19T04:28:59.874932+0000","last_undegraded":"2024-04-19T04:28:59.874932+0000","last_fullsized":"2024-04-19T04:28:59.874932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-04-19T04:28:59.874627+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-04-19T04:28:59.874627+0000","last_clean_scrub_stamp":"2024-04-19T04:28:59.874627+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:20:56.884252+0000","scrub_duration":0.0061750349999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":69,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:20.466128+0000","last_change":"2024-04-19T04:28:12.095631+0000","last_active":"2024-04-19T04:28:20.466128+0000","last_peered":"2024-04-19T04:28:20.466128+0000","last_clean":"2024-04-19T04:28:20.466128+0000","last_became_active":"2024-04-19T04:28:12.094722+0000","last_became_peered":"2024-04-19T04:28:12.094722+0000","last_unstale":"2024-04-19T04:28:20.466128+0000","last_undegraded":"2024-04-19T04:28:20.466128+0000","last_fullsized":"2024-04-19T04:28:20.466128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.301761+0000","last_change":"2024-04-19T04:28:02.843299+0000","last_active":"2024-04-19T04:28:13.301761+0000","last_peered":"2024-04-19T04:28:13.301761+0000","last_clean":"2024-04-19T04:28:13.301761+0000","last_became_active":"2024-04-19T04:28:02.842525+0000","last_became_peered":"2024-04-19T04:28:02.842525+0000","last_unstale":"2024-04-19T04:28:13.301761+0000","last_undegraded":"2024-04-19T04:28:13.301761+0000","last_fullsized":"2024-04-19T04:28:13.301761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.151861+0000","last_change":"2024-04-19T04:28:40.152096+0000","last_active":"2024-04-19T04:28:40.151861+0000","last_peered":"2024-04-19T04:28:40.151861+0000","last_clean":"2024-04-19T04:28:40.151861+0000","last_became_active":"2024-04-19T04:28:02.843099+0000","last_became_peered":"2024-04-19T04:28:02.843099+0000","last_unstale":"2024-04-19T04:28:40.151861+0000","last_undegraded":"2024-04-19T04:28:40.151861+0000","last_fullsized":"2024-04-19T04:28:40.151861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.151812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.151812+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.151812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:19.753268+0000","scrub_duration":0.0030712460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:29.541159+0000","last_change":"2024-04-19T04:28:29.541420+0000","last_active":"2024-04-19T04:28:29.541159+0000","last_peered":"2024-04-19T04:28:29.541159+0000","last_clean":"2024-04-19T04:28:29.541159+0000","last_became_active":"2024-04-19T04:28:12.091771+0000","last_became_peered":"2024-04-19T04:28:12.091771+0000","last_unstale":"2024-04-19T04:28:29.541159+0000","last_undegraded":"2024-04-19T04:28:29.541159+0000","last_fullsized":"2024-04-19T04:28:29.541159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:29.541116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:29.541116+0000","last_clean_scrub_stamp":"2024-04-19T04:28:29.541116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:42.022636+0000","scrub_duration":0.0033350189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302998+0000","last_change":"2024-04-19T04:28:02.837331+0000","last_active":"2024-04-19T04:28:13.302998+0000","last_peered":"2024-04-19T04:28:13.302998+0000","last_clean":"2024-04-19T04:28:13.302998+0000","last_became_active":"2024-04-19T04:28:02.836984+0000","last_became_peered":"2024-04-19T04:28:02.836984+0000","last_unstale":"2024-04-19T04:28:13.302998+0000","last_undegraded":"2024-04-19T04:28:13.302998+0000","last_fullsized":"2024-04-19T04:28:13.302998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":82,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481303+0000","last_change":"2024-04-19T04:24:20.187299+0000","last_active":"2024-04-19T04:28:19.481303+0000","last_peered":"2024-04-19T04:28:19.481303+0000","last_clean":"2024-04-19T04:28:19.481303+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:28:19.481303+0000","last_undegraded":"2024-04-19T04:28:19.481303+0000","last_fullsized":"2024-04-19T04:28:19.481303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"79'2","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:14.682747+0000","last_change":"2024-04-19T04:29:14.683190+0000","last_active":"2024-04-19T04:29:14.682747+0000","last_peered":"2024-04-19T04:29:14.682747+0000","last_clean":"2024-04-19T04:29:14.682747+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:29:14.682747+0000","last_undegraded":"2024-04-19T04:29:14.682747+0000","last_fullsized":"2024-04-19T04:29:14.682747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-19T04:29:14.682697+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-19T04:29:14.682697+0000","last_clean_scrub_stamp":"2024-04-19T04:29:14.682697+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:35.626266+0000","scrub_duration":0.006337891,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:15.540432+0000","last_change":"2024-04-19T04:29:15.540650+0000","last_active":"2024-04-19T04:29:15.540432+0000","last_peered":"2024-04-19T04:29:15.540432+0000","last_clean":"2024-04-19T04:29:15.540432+0000","last_became_active":"2024-04-19T04:28:12.090379+0000","last_became_peered":"2024-04-19T04:28:12.090379+0000","last_unstale":"2024-04-19T04:29:15.540432+0000","last_undegraded":"2024-04-19T04:29:15.540432+0000","last_fullsized":"2024-04-19T04:29:15.540432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:15.540388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:15.540388+0000","last_clean_scrub_stamp":"2024-04-19T04:29:15.540388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:58:31.906342+0000","scrub_duration":0.0035449280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.257285+0000","last_change":"2024-04-19T04:28:12.090491+0000","last_active":"2024-04-19T04:28:15.257285+0000","last_peered":"2024-04-19T04:28:15.257285+0000","last_clean":"2024-04-19T04:28:15.257285+0000","last_became_active":"2024-04-19T04:28:12.089948+0000","last_became_peered":"2024-04-19T04:28:12.089948+0000","last_unstale":"2024-04-19T04:28:15.257285+0000","last_undegraded":"2024-04-19T04:28:15.257285+0000","last_fullsized":"2024-04-19T04:28:15.257285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:57.409585+0000","last_change":"2024-04-19T04:28:57.409839+0000","last_active":"2024-04-19T04:28:57.409585+0000","last_peered":"2024-04-19T04:28:57.409585+0000","last_clean":"2024-04-19T04:28:57.409585+0000","last_became_active":"2024-04-19T04:28:12.093090+0000","last_became_peered":"2024-04-19T04:28:12.093090+0000","last_unstale":"2024-04-19T04:28:57.409585+0000","last_undegraded":"2024-04-19T04:28:57.409585+0000","last_fullsized":"2024-04-19T04:28:57.409585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:57.409536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:57.409536+0000","last_clean_scrub_stamp":"2024-04-19T04:28:57.409536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:58:14.062514+0000","scrub_duration":0.0034988459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"79'2","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:51.726306+0000","last_change":"2024-04-19T04:28:51.726306+0000","last_active":"2024-04-19T04:28:51.726306+0000","last_peered":"2024-04-19T04:28:51.726306+0000","last_clean":"2024-04-19T04:28:51.726306+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:28:51.726306+0000","last_undegraded":"2024-04-19T04:28:51.726306+0000","last_fullsized":"2024-04-19T04:28:51.726306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-19T04:28:51.725876+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-19T04:28:51.725876+0000","last_clean_scrub_stamp":"2024-04-19T04:28:51.725876+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:17.429863+0000","scrub_duration":0.0062414059999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:13.724370+0000","last_change":"2024-04-19T04:29:13.724590+0000","last_active":"2024-04-19T04:29:13.724370+0000","last_peered":"2024-04-19T04:29:13.724370+0000","last_clean":"2024-04-19T04:29:13.724370+0000","last_became_active":"2024-04-19T04:28:02.636231+0000","last_became_peered":"2024-04-19T04:28:02.636231+0000","last_unstale":"2024-04-19T04:29:13.724370+0000","last_undegraded":"2024-04-19T04:29:13.724370+0000","last_fullsized":"2024-04-19T04:29:13.724370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:13.724320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:13.724320+0000","last_clean_scrub_stamp":"2024-04-19T04:29:13.724320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:30:36.014677+0000","scrub_duration":0.0034525440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481187+0000","last_change":"2024-04-19T04:28:02.635650+0000","last_active":"2024-04-19T04:28:19.481187+0000","last_peered":"2024-04-19T04:28:19.481187+0000","last_clean":"2024-04-19T04:28:19.481187+0000","last_became_active":"2024-04-19T04:28:02.634823+0000","last_became_peered":"2024-04-19T04:28:02.634823+0000","last_unstale":"2024-04-19T04:28:19.481187+0000","last_undegraded":"2024-04-19T04:28:19.481187+0000","last_fullsized":"2024-04-19T04:28:19.481187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:56.250577+0000","last_change":"2024-04-19T04:28:56.250708+0000","last_active":"2024-04-19T04:28:56.250577+0000","last_peered":"2024-04-19T04:28:56.250577+0000","last_clean":"2024-04-19T04:28:56.250577+0000","last_became_active":"2024-04-19T04:28:02.845461+0000","last_became_peered":"2024-04-19T04:28:02.845461+0000","last_unstale":"2024-04-19T04:28:56.250577+0000","last_undegraded":"2024-04-19T04:28:56.250577+0000","last_fullsized":"2024-04-19T04:28:56.250577+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:56.250557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:56.250557+0000","last_clean_scrub_stamp":"2024-04-19T04:28:56.250557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:56.014220+0000","scrub_duration":0.029538265000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:46.246893+0000","last_change":"2024-04-19T04:28:46.247247+0000","last_active":"2024-04-19T04:28:46.246893+0000","last_peered":"2024-04-19T04:28:46.246893+0000","last_clean":"2024-04-19T04:28:46.246893+0000","last_became_active":"2024-04-19T04:28:02.844927+0000","last_became_peered":"2024-04-19T04:28:02.844927+0000","last_unstale":"2024-04-19T04:28:46.246893+0000","last_undegraded":"2024-04-19T04:28:46.246893+0000","last_fullsized":"2024-04-19T04:28:46.246893+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:28:46.246777+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:28:46.246777+0000","last_clean_scrub_stamp":"2024-04-19T04:28:46.246777+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:37:56.201762+0000","scrub_duration":0.006831213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:58.824983+0000","last_change":"2024-04-19T04:28:58.825209+0000","last_active":"2024-04-19T04:28:58.824983+0000","last_peered":"2024-04-19T04:28:58.824983+0000","last_clean":"2024-04-19T04:28:58.824983+0000","last_became_active":"2024-04-19T04:28:02.635238+0000","last_became_peered":"2024-04-19T04:28:02.635238+0000","last_unstale":"2024-04-19T04:28:58.824983+0000","last_undegraded":"2024-04-19T04:28:58.824983+0000","last_fullsized":"2024-04-19T04:28:58.824983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:58.824931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:58.824931+0000","last_clean_scrub_stamp":"2024-04-19T04:28:58.824931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:33.364138+0000","scrub_duration":0.0033677389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481737+0000","last_change":"2024-04-19T04:28:02.638055+0000","last_active":"2024-04-19T04:28:19.481737+0000","last_peered":"2024-04-19T04:28:19.481737+0000","last_clean":"2024-04-19T04:28:19.481737+0000","last_became_active":"2024-04-19T04:28:02.637651+0000","last_became_peered":"2024-04-19T04:28:02.637651+0000","last_unstale":"2024-04-19T04:28:19.481737+0000","last_undegraded":"2024-04-19T04:28:19.481737+0000","last_fullsized":"2024-04-19T04:28:19.481737+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.710088+0000","last_change":"2024-04-19T04:28:40.710088+0000","last_active":"2024-04-19T04:28:40.710088+0000","last_peered":"2024-04-19T04:28:40.710088+0000","last_clean":"2024-04-19T04:28:40.710088+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:28:40.710088+0000","last_undegraded":"2024-04-19T04:28:40.710088+0000","last_fullsized":"2024-04-19T04:28:40.710088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.709702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.709702+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.709702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:24.831215+0000","scrub_duration":0.0033854829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:04.490301+0000","last_change":"2024-04-19T04:29:04.490555+0000","last_active":"2024-04-19T04:29:04.490301+0000","last_peered":"2024-04-19T04:29:04.490301+0000","last_clean":"2024-04-19T04:29:04.490301+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:29:04.490301+0000","last_undegraded":"2024-04-19T04:29:04.490301+0000","last_fullsized":"2024-04-19T04:29:04.490301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:04.490250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:04.490250+0000","last_clean_scrub_stamp":"2024-04-19T04:29:04.490250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:48.611763+0000","scrub_duration":0.003278235,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:06.705490+0000","last_change":"2024-04-19T04:29:06.705866+0000","last_active":"2024-04-19T04:29:06.705490+0000","last_peered":"2024-04-19T04:29:06.705490+0000","last_clean":"2024-04-19T04:29:06.705490+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:29:06.705490+0000","last_undegraded":"2024-04-19T04:29:06.705490+0000","last_fullsized":"2024-04-19T04:29:06.705490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:06.705384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:06.705384+0000","last_clean_scrub_stamp":"2024-04-19T04:29:06.705384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:57.321888+0000","scrub_duration":0.003745515,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.494052+0000","last_change":"2024-04-19T04:28:40.494052+0000","last_active":"2024-04-19T04:28:40.494052+0000","last_peered":"2024-04-19T04:28:40.494052+0000","last_clean":"2024-04-19T04:28:40.494052+0000","last_became_active":"2024-04-19T04:28:12.088043+0000","last_became_peered":"2024-04-19T04:28:12.088043+0000","last_unstale":"2024-04-19T04:28:40.494052+0000","last_undegraded":"2024-04-19T04:28:40.494052+0000","last_fullsized":"2024-04-19T04:28:40.494052+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.493585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.493585+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.493585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:22:36.746203+0000","scrub_duration":0.0035336780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303706+0000","last_change":"2024-04-19T04:28:02.844467+0000","last_active":"2024-04-19T04:28:13.303706+0000","last_peered":"2024-04-19T04:28:13.303706+0000","last_clean":"2024-04-19T04:28:13.303706+0000","last_became_active":"2024-04-19T04:28:02.843639+0000","last_became_peered":"2024-04-19T04:28:02.843639+0000","last_unstale":"2024-04-19T04:28:13.303706+0000","last_undegraded":"2024-04-19T04:28:13.303706+0000","last_fullsized":"2024-04-19T04:28:13.303706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.892679+0000","last_change":"2024-04-19T04:24:10.106278+0000","last_active":"2024-04-19T04:28:13.892679+0000","last_peered":"2024-04-19T04:28:13.892679+0000","last_clean":"2024-04-19T04:28:13.892679+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:28:13.892679+0000","last_undegraded":"2024-04-19T04:28:13.892679+0000","last_fullsized":"2024-04-19T04:28:13.892679+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:09.083488+0000","last_clean_scrub_stamp":"2024-04-19T04:24:09.083488+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481030+0000","last_change":"2024-04-19T04:28:02.639632+0000","last_active":"2024-04-19T04:28:19.481030+0000","last_peered":"2024-04-19T04:28:19.481030+0000","last_clean":"2024-04-19T04:28:19.481030+0000","last_became_active":"2024-04-19T04:28:02.639240+0000","last_became_peered":"2024-04-19T04:28:02.639240+0000","last_unstale":"2024-04-19T04:28:19.481030+0000","last_undegraded":"2024-04-19T04:28:19.481030+0000","last_fullsized":"2024-04-19T04:28:19.481030+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302143+0000","last_change":"2024-04-19T04:28:02.842437+0000","last_active":"2024-04-19T04:28:13.302143+0000","last_peered":"2024-04-19T04:28:13.302143+0000","last_clean":"2024-04-19T04:28:13.302143+0000","last_became_active":"2024-04-19T04:28:02.841053+0000","last_became_peered":"2024-04-19T04:28:02.841053+0000","last_unstale":"2024-04-19T04:28:13.302143+0000","last_undegraded":"2024-04-19T04:28:13.302143+0000","last_fullsized":"2024-04-19T04:28:13.302143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:43.759501+0000","last_change":"2024-04-19T04:28:43.759738+0000","last_active":"2024-04-19T04:28:43.759501+0000","last_peered":"2024-04-19T04:28:43.759501+0000","last_clean":"2024-04-19T04:28:43.759501+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:28:43.759501+0000","last_undegraded":"2024-04-19T04:28:43.759501+0000","last_fullsized":"2024-04-19T04:28:43.759501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:43.759455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:43.759455+0000","last_clean_scrub_stamp":"2024-04-19T04:28:43.759455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:10.518057+0000","scrub_duration":0.0032782050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:18.893871+0000","last_change":"2024-04-19T04:24:16.144482+0000","last_active":"2024-04-19T04:28:18.893871+0000","last_peered":"2024-04-19T04:28:18.893871+0000","last_clean":"2024-04-19T04:28:18.893871+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:28:18.893871+0000","last_undegraded":"2024-04-19T04:28:18.893871+0000","last_fullsized":"2024-04-19T04:28:18.893871+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.301091+0000","last_change":"2024-04-19T04:28:02.842303+0000","last_active":"2024-04-19T04:28:13.301091+0000","last_peered":"2024-04-19T04:28:13.301091+0000","last_clean":"2024-04-19T04:28:13.301091+0000","last_became_active":"2024-04-19T04:28:02.839926+0000","last_became_peered":"2024-04-19T04:28:02.839926+0000","last_unstale":"2024-04-19T04:28:13.301091+0000","last_undegraded":"2024-04-19T04:28:13.301091+0000","last_fullsized":"2024-04-19T04:28:13.301091+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:14.506307+0000","last_change":"2024-04-19T04:29:14.506535+0000","last_active":"2024-04-19T04:29:14.506307+0000","last_peered":"2024-04-19T04:29:14.506307+0000","last_clean":"2024-04-19T04:29:14.506307+0000","last_became_active":"2024-04-19T04:28:02.638095+0000","last_became_peered":"2024-04-19T04:28:02.638095+0000","last_unstale":"2024-04-19T04:29:14.506307+0000","last_undegraded":"2024-04-19T04:29:14.506307+0000","last_fullsized":"2024-04-19T04:29:14.506307+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:14.506264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:14.506264+0000","last_clean_scrub_stamp":"2024-04-19T04:29:14.506264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:39:27.629645+0000","scrub_duration":0.003222464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:21.148937+0000","last_change":"2024-04-19T04:28:21.158508+0000","last_active":"2024-04-19T04:28:21.148937+0000","last_peered":"2024-04-19T04:28:21.148937+0000","last_clean":"2024-04-19T04:28:21.148937+0000","last_became_active":"2024-04-19T04:28:02.840328+0000","last_became_peered":"2024-04-19T04:28:02.840328+0000","last_unstale":"2024-04-19T04:28:21.148937+0000","last_undegraded":"2024-04-19T04:28:21.148937+0000","last_fullsized":"2024-04-19T04:28:21.148937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:21.148887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:21.148887+0000","last_clean_scrub_stamp":"2024-04-19T04:28:21.148887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:44:55.928928+0000","scrub_duration":0.0038294929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:46.483321+0000","last_change":"2024-04-19T04:28:46.483620+0000","last_active":"2024-04-19T04:28:46.483321+0000","last_peered":"2024-04-19T04:28:46.483321+0000","last_clean":"2024-04-19T04:28:46.483321+0000","last_became_active":"2024-04-19T04:28:12.087575+0000","last_became_peered":"2024-04-19T04:28:12.087575+0000","last_unstale":"2024-04-19T04:28:46.483321+0000","last_undegraded":"2024-04-19T04:28:46.483321+0000","last_fullsized":"2024-04-19T04:28:46.483321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:46.483271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:46.483271+0000","last_clean_scrub_stamp":"2024-04-19T04:28:46.483271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:13.971451+0000","scrub_duration":0.0034840449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:12.204141+0000","last_change":"2024-04-19T04:29:12.204263+0000","last_active":"2024-04-19T04:29:12.204141+0000","last_peered":"2024-04-19T04:29:12.204141+0000","last_clean":"2024-04-19T04:29:12.204141+0000","last_became_active":"2024-04-19T04:28:02.840839+0000","last_became_peered":"2024-04-19T04:28:02.840839+0000","last_unstale":"2024-04-19T04:29:12.204141+0000","last_undegraded":"2024-04-19T04:29:12.204141+0000","last_fullsized":"2024-04-19T04:29:12.204141+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:12.204121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:12.204121+0000","last_clean_scrub_stamp":"2024-04-19T04:29:12.204121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:20:20.194187+0000","scrub_duration":0.035589924000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481032+0000","last_change":"2024-04-19T04:28:02.635123+0000","last_active":"2024-04-19T04:28:19.481032+0000","last_peered":"2024-04-19T04:28:19.481032+0000","last_clean":"2024-04-19T04:28:19.481032+0000","last_became_active":"2024-04-19T04:28:02.634633+0000","last_became_peered":"2024-04-19T04:28:02.634633+0000","last_unstale":"2024-04-19T04:28:19.481032+0000","last_undegraded":"2024-04-19T04:28:19.481032+0000","last_fullsized":"2024-04-19T04:28:19.481032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481074+0000","last_change":"2024-04-19T04:28:02.638250+0000","last_active":"2024-04-19T04:28:19.481074+0000","last_peered":"2024-04-19T04:28:19.481074+0000","last_clean":"2024-04-19T04:28:19.481074+0000","last_became_active":"2024-04-19T04:28:02.637233+0000","last_became_peered":"2024-04-19T04:28:02.637233+0000","last_unstale":"2024-04-19T04:28:19.481074+0000","last_undegraded":"2024-04-19T04:28:19.481074+0000","last_fullsized":"2024-04-19T04:28:19.481074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:53.216978+0000","last_change":"2024-04-19T04:28:53.217334+0000","last_active":"2024-04-19T04:28:53.216978+0000","last_peered":"2024-04-19T04:28:53.216978+0000","last_clean":"2024-04-19T04:28:53.216978+0000","last_became_active":"2024-04-19T04:28:02.837829+0000","last_became_peered":"2024-04-19T04:28:02.837829+0000","last_unstale":"2024-04-19T04:28:53.216978+0000","last_undegraded":"2024-04-19T04:28:53.216978+0000","last_fullsized":"2024-04-19T04:28:53.216978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:53.216932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:53.216932+0000","last_clean_scrub_stamp":"2024-04-19T04:28:53.216932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:28:52.742878+0000","scrub_duration":0.0032988420000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:12.751225+0000","last_change":"2024-04-19T04:29:12.751447+0000","last_active":"2024-04-19T04:29:12.751225+0000","last_peered":"2024-04-19T04:29:12.751225+0000","last_clean":"2024-04-19T04:29:12.751225+0000","last_became_active":"2024-04-19T04:28:02.634103+0000","last_became_peered":"2024-04-19T04:28:02.634103+0000","last_unstale":"2024-04-19T04:29:12.751225+0000","last_undegraded":"2024-04-19T04:29:12.751225+0000","last_fullsized":"2024-04-19T04:29:12.751225+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:12.751168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:12.751168+0000","last_clean_scrub_stamp":"2024-04-19T04:29:12.751168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:41:03.146894+0000","scrub_duration":0.0031427569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.301845+0000","last_change":"2024-04-19T04:28:02.835876+0000","last_active":"2024-04-19T04:28:13.301845+0000","last_peered":"2024-04-19T04:28:13.301845+0000","last_clean":"2024-04-19T04:28:13.301845+0000","last_became_active":"2024-04-19T04:28:02.835057+0000","last_became_peered":"2024-04-19T04:28:02.835057+0000","last_unstale":"2024-04-19T04:28:13.301845+0000","last_undegraded":"2024-04-19T04:28:13.301845+0000","last_fullsized":"2024-04-19T04:28:13.301845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:12.560395+0000","last_change":"2024-04-19T04:29:12.560617+0000","last_active":"2024-04-19T04:29:12.560395+0000","last_peered":"2024-04-19T04:29:12.560395+0000","last_clean":"2024-04-19T04:29:12.560395+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:29:12.560395+0000","last_undegraded":"2024-04-19T04:29:12.560395+0000","last_fullsized":"2024-04-19T04:29:12.560395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:12.560352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:12.560352+0000","last_clean_scrub_stamp":"2024-04-19T04:29:12.560352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:21.470493+0000","scrub_duration":0.0033970480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:03.073729+0000","last_change":"2024-04-19T04:29:03.074082+0000","last_active":"2024-04-19T04:29:03.073729+0000","last_peered":"2024-04-19T04:29:03.073729+0000","last_clean":"2024-04-19T04:29:03.073729+0000","last_became_active":"2024-04-19T04:28:02.838918+0000","last_became_peered":"2024-04-19T04:28:02.838918+0000","last_unstale":"2024-04-19T04:29:03.073729+0000","last_undegraded":"2024-04-19T04:29:03.073729+0000","last_fullsized":"2024-04-19T04:29:03.073729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:03.073680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:03.073680+0000","last_clean_scrub_stamp":"2024-04-19T04:29:03.073680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:34:04.411572+0000","scrub_duration":0.0031316450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:20.465976+0000","last_change":"2024-04-19T04:28:12.092906+0000","last_active":"2024-04-19T04:28:20.465976+0000","last_peered":"2024-04-19T04:28:20.465976+0000","last_clean":"2024-04-19T04:28:20.465976+0000","last_became_active":"2024-04-19T04:28:12.091609+0000","last_became_peered":"2024-04-19T04:28:12.091609+0000","last_unstale":"2024-04-19T04:28:20.465976+0000","last_undegraded":"2024-04-19T04:28:20.465976+0000","last_fullsized":"2024-04-19T04:28:20.465976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:43.453357+0000","last_change":"2024-04-19T04:28:43.453593+0000","last_active":"2024-04-19T04:28:43.453357+0000","last_peered":"2024-04-19T04:28:43.453357+0000","last_clean":"2024-04-19T04:28:43.453357+0000","last_became_active":"2024-04-19T04:28:12.091335+0000","last_became_peered":"2024-04-19T04:28:12.091335+0000","last_unstale":"2024-04-19T04:28:43.453357+0000","last_undegraded":"2024-04-19T04:28:43.453357+0000","last_fullsized":"2024-04-19T04:28:43.453357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:43.453308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:43.453308+0000","last_clean_scrub_stamp":"2024-04-19T04:28:43.453308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:37:50.638133+0000","scrub_duration":0.0032802869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:45.236169+0000","last_change":"2024-04-19T04:28:45.236529+0000","last_active":"2024-04-19T04:28:45.236169+0000","last_peered":"2024-04-19T04:28:45.236169+0000","last_clean":"2024-04-19T04:28:45.236169+0000","last_became_active":"2024-04-19T04:28:02.839883+0000","last_became_peered":"2024-04-19T04:28:02.839883+0000","last_unstale":"2024-04-19T04:28:45.236169+0000","last_undegraded":"2024-04-19T04:28:45.236169+0000","last_fullsized":"2024-04-19T04:28:45.236169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:28:45.236116+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:28:45.236116+0000","last_clean_scrub_stamp":"2024-04-19T04:28:45.236116+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:21.181858+0000","scrub_duration":0.0065909519999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302721+0000","last_change":"2024-04-19T04:28:02.845957+0000","last_active":"2024-04-19T04:28:13.302721+0000","last_peered":"2024-04-19T04:28:13.302721+0000","last_clean":"2024-04-19T04:28:13.302721+0000","last_became_active":"2024-04-19T04:28:02.845256+0000","last_became_peered":"2024-04-19T04:28:02.845256+0000","last_unstale":"2024-04-19T04:28:13.302721+0000","last_undegraded":"2024-04-19T04:28:13.302721+0000","last_fullsized":"2024-04-19T04:28:13.302721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:35.232642+0000","last_change":"2024-04-19T04:28:35.232894+0000","last_active":"2024-04-19T04:28:35.232642+0000","last_peered":"2024-04-19T04:28:35.232642+0000","last_clean":"2024-04-19T04:28:35.232642+0000","last_became_active":"2024-04-19T04:28:02.844128+0000","last_became_peered":"2024-04-19T04:28:02.844128+0000","last_unstale":"2024-04-19T04:28:35.232642+0000","last_undegraded":"2024-04-19T04:28:35.232642+0000","last_fullsized":"2024-04-19T04:28:35.232642+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:35.232595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:35.232595+0000","last_clean_scrub_stamp":"2024-04-19T04:28:35.232595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:17:35.552236+0000","scrub_duration":0.0033160400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"79'2","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:02.113554+0000","last_change":"2024-04-19T04:29:02.113900+0000","last_active":"2024-04-19T04:29:02.113554+0000","last_peered":"2024-04-19T04:29:02.113554+0000","last_clean":"2024-04-19T04:29:02.113554+0000","last_became_active":"2024-04-19T04:28:02.844483+0000","last_became_peered":"2024-04-19T04:28:02.844483+0000","last_unstale":"2024-04-19T04:29:02.113554+0000","last_undegraded":"2024-04-19T04:29:02.113554+0000","last_fullsized":"2024-04-19T04:29:02.113554+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-19T04:29:02.113502+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-19T04:29:02.113502+0000","last_clean_scrub_stamp":"2024-04-19T04:29:02.113502+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:57:58.962870+0000","scrub_duration":0.0066382589999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.480965+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:28:19.480965+0000","last_peered":"2024-04-19T04:28:19.480965+0000","last_clean":"2024-04-19T04:28:19.480965+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:28:19.480965+0000","last_undegraded":"2024-04-19T04:28:19.480965+0000","last_fullsized":"2024-04-19T04:28:19.480965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:03.475770+0000","last_change":"2024-04-19T04:29:03.476086+0000","last_active":"2024-04-19T04:29:03.475770+0000","last_peered":"2024-04-19T04:29:03.475770+0000","last_clean":"2024-04-19T04:29:03.475770+0000","last_became_active":"2024-04-19T04:28:12.088123+0000","last_became_peered":"2024-04-19T04:28:12.088123+0000","last_unstale":"2024-04-19T04:29:03.475770+0000","last_undegraded":"2024-04-19T04:29:03.475770+0000","last_fullsized":"2024-04-19T04:29:03.475770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:03.475686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:03.475686+0000","last_clean_scrub_stamp":"2024-04-19T04:29:03.475686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:48:06.718278+0000","scrub_duration":0.0036698009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:36.624976+0000","last_change":"2024-04-19T04:28:36.624976+0000","last_active":"2024-04-19T04:28:36.624976+0000","last_peered":"2024-04-19T04:28:36.624976+0000","last_clean":"2024-04-19T04:28:36.624976+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:28:36.624976+0000","last_undegraded":"2024-04-19T04:28:36.624976+0000","last_fullsized":"2024-04-19T04:28:36.624976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:36.624618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:36.624618+0000","last_clean_scrub_stamp":"2024-04-19T04:28:36.624618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:45.570664+0000","scrub_duration":0.0035750109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"79'10","reported_seq":95,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:56.750060+0000","last_change":"2024-04-19T04:28:56.750060+0000","last_active":"2024-04-19T04:28:56.750060+0000","last_peered":"2024-04-19T04:28:56.750060+0000","last_clean":"2024-04-19T04:28:56.750060+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:28:56.750060+0000","last_undegraded":"2024-04-19T04:28:56.750060+0000","last_fullsized":"2024-04-19T04:28:56.750060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-04-19T04:28:56.749717+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-04-19T04:28:56.749717+0000","last_clean_scrub_stamp":"2024-04-19T04:28:56.749717+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:09:09.583526+0000","scrub_duration":0.010036193000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:23.193351+0000","last_change":"2024-04-19T04:28:23.193584+0000","last_active":"2024-04-19T04:28:23.193351+0000","last_peered":"2024-04-19T04:28:23.193351+0000","last_clean":"2024-04-19T04:28:23.193351+0000","last_became_active":"2024-04-19T04:28:02.841373+0000","last_became_peered":"2024-04-19T04:28:02.841373+0000","last_unstale":"2024-04-19T04:28:23.193351+0000","last_undegraded":"2024-04-19T04:28:23.193351+0000","last_fullsized":"2024-04-19T04:28:23.193351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:23.193301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:23.193301+0000","last_clean_scrub_stamp":"2024-04-19T04:28:23.193301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:26.999877+0000","scrub_duration":0.0032212959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.257608+0000","last_change":"2024-04-19T04:28:12.094542+0000","last_active":"2024-04-19T04:28:15.257608+0000","last_peered":"2024-04-19T04:28:15.257608+0000","last_clean":"2024-04-19T04:28:15.257608+0000","last_became_active":"2024-04-19T04:28:12.092784+0000","last_became_peered":"2024-04-19T04:28:12.092784+0000","last_unstale":"2024-04-19T04:28:15.257608+0000","last_undegraded":"2024-04-19T04:28:15.257608+0000","last_fullsized":"2024-04-19T04:28:15.257608+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:09.746871+0000","last_change":"2024-04-19T04:29:09.746871+0000","last_active":"2024-04-19T04:29:09.746871+0000","last_peered":"2024-04-19T04:29:09.746871+0000","last_clean":"2024-04-19T04:29:09.746871+0000","last_became_active":"2024-04-19T04:28:02.638431+0000","last_became_peered":"2024-04-19T04:28:02.638431+0000","last_unstale":"2024-04-19T04:29:09.746871+0000","last_undegraded":"2024-04-19T04:29:09.746871+0000","last_fullsized":"2024-04-19T04:29:09.746871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:09.746554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:09.746554+0000","last_clean_scrub_stamp":"2024-04-19T04:29:09.746554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:33.403481+0000","scrub_duration":0.0034424270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:27.190673+0000","last_change":"2024-04-19T04:28:27.190910+0000","last_active":"2024-04-19T04:28:27.190673+0000","last_peered":"2024-04-19T04:28:27.190673+0000","last_clean":"2024-04-19T04:28:27.190673+0000","last_became_active":"2024-04-19T04:28:02.838354+0000","last_became_peered":"2024-04-19T04:28:02.838354+0000","last_unstale":"2024-04-19T04:28:27.190673+0000","last_undegraded":"2024-04-19T04:28:27.190673+0000","last_fullsized":"2024-04-19T04:28:27.190673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:27.190624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:27.190624+0000","last_clean_scrub_stamp":"2024-04-19T04:28:27.190624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:58:16.070118+0000","scrub_duration":0.003493987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303518+0000","last_change":"2024-04-19T04:28:02.838446+0000","last_active":"2024-04-19T04:28:13.303518+0000","last_peered":"2024-04-19T04:28:13.303518+0000","last_clean":"2024-04-19T04:28:13.303518+0000","last_became_active":"2024-04-19T04:28:02.837994+0000","last_became_peered":"2024-04-19T04:28:02.837994+0000","last_unstale":"2024-04-19T04:28:13.303518+0000","last_undegraded":"2024-04-19T04:28:13.303518+0000","last_fullsized":"2024-04-19T04:28:13.303518+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:10.206873+0000","last_change":"2024-04-19T04:29:10.207103+0000","last_active":"2024-04-19T04:29:10.206873+0000","last_peered":"2024-04-19T04:29:10.206873+0000","last_clean":"2024-04-19T04:29:10.206873+0000","last_became_active":"2024-04-19T04:28:02.836818+0000","last_became_peered":"2024-04-19T04:28:02.836818+0000","last_unstale":"2024-04-19T04:29:10.206873+0000","last_undegraded":"2024-04-19T04:29:10.206873+0000","last_fullsized":"2024-04-19T04:29:10.206873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:10.206828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:10.206828+0000","last_clean_scrub_stamp":"2024-04-19T04:29:10.206828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:22:40.805733+0000","scrub_duration":0.0031759570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:07.525931+0000","last_change":"2024-04-19T04:29:07.526047+0000","last_active":"2024-04-19T04:29:07.525931+0000","last_peered":"2024-04-19T04:29:07.525931+0000","last_clean":"2024-04-19T04:29:07.525931+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:29:07.525931+0000","last_undegraded":"2024-04-19T04:29:07.525931+0000","last_fullsized":"2024-04-19T04:29:07.525931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:07.525913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:07.525913+0000","last_clean_scrub_stamp":"2024-04-19T04:29:07.525913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:34.284515+0000","scrub_duration":0.089503928999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:09.192639+0000","last_change":"2024-04-19T04:29:09.192879+0000","last_active":"2024-04-19T04:29:09.192639+0000","last_peered":"2024-04-19T04:29:09.192639+0000","last_clean":"2024-04-19T04:29:09.192639+0000","last_became_active":"2024-04-19T04:28:02.837400+0000","last_became_peered":"2024-04-19T04:28:02.837400+0000","last_unstale":"2024-04-19T04:29:09.192639+0000","last_undegraded":"2024-04-19T04:29:09.192639+0000","last_fullsized":"2024-04-19T04:29:09.192639+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:09.192594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:09.192594+0000","last_clean_scrub_stamp":"2024-04-19T04:29:09.192594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:24:09.830565+0000","scrub_duration":0.0033446000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:51.216552+0000","last_change":"2024-04-19T04:28:51.216788+0000","last_active":"2024-04-19T04:28:51.216552+0000","last_peered":"2024-04-19T04:28:51.216552+0000","last_clean":"2024-04-19T04:28:51.216552+0000","last_became_active":"2024-04-19T04:28:02.844057+0000","last_became_peered":"2024-04-19T04:28:02.844057+0000","last_unstale":"2024-04-19T04:28:51.216552+0000","last_undegraded":"2024-04-19T04:28:51.216552+0000","last_fullsized":"2024-04-19T04:28:51.216552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:51.216503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:51.216503+0000","last_clean_scrub_stamp":"2024-04-19T04:28:51.216503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:47:11.830384+0000","scrub_duration":0.003421365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:47.243501+0000","last_change":"2024-04-19T04:28:47.243752+0000","last_active":"2024-04-19T04:28:47.243501+0000","last_peered":"2024-04-19T04:28:47.243501+0000","last_clean":"2024-04-19T04:28:47.243501+0000","last_became_active":"2024-04-19T04:28:02.836492+0000","last_became_peered":"2024-04-19T04:28:02.836492+0000","last_unstale":"2024-04-19T04:28:47.243501+0000","last_undegraded":"2024-04-19T04:28:47.243501+0000","last_fullsized":"2024-04-19T04:28:47.243501+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:47.243453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:47.243453+0000","last_clean_scrub_stamp":"2024-04-19T04:28:47.243453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:57:57.196537+0000","scrub_duration":0.003301942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:52.410116+0000","last_change":"2024-04-19T04:28:52.410331+0000","last_active":"2024-04-19T04:28:52.410116+0000","last_peered":"2024-04-19T04:28:52.410116+0000","last_clean":"2024-04-19T04:28:52.410116+0000","last_became_active":"2024-04-19T04:28:12.095332+0000","last_became_peered":"2024-04-19T04:28:12.095332+0000","last_unstale":"2024-04-19T04:28:52.410116+0000","last_undegraded":"2024-04-19T04:28:52.410116+0000","last_fullsized":"2024-04-19T04:28:52.410116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:52.410070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:52.410070+0000","last_clean_scrub_stamp":"2024-04-19T04:28:52.410070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:41.851489+0000","scrub_duration":0.003375528,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:37.501444+0000","last_change":"2024-04-19T04:28:37.501685+0000","last_active":"2024-04-19T04:28:37.501444+0000","last_peered":"2024-04-19T04:28:37.501444+0000","last_clean":"2024-04-19T04:28:37.501444+0000","last_became_active":"2024-04-19T04:28:12.090262+0000","last_became_peered":"2024-04-19T04:28:12.090262+0000","last_unstale":"2024-04-19T04:28:37.501444+0000","last_undegraded":"2024-04-19T04:28:37.501444+0000","last_fullsized":"2024-04-19T04:28:37.501444+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-19T04:28:37.501393+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-19T04:28:37.501393+0000","last_clean_scrub_stamp":"2024-04-19T04:28:37.501393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:00:31.892502+0000","scrub_duration":0.0035120720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:33.511406+0000","last_change":"2024-04-19T04:28:33.511683+0000","last_active":"2024-04-19T04:28:33.511406+0000","last_peered":"2024-04-19T04:28:33.511406+0000","last_clean":"2024-04-19T04:28:33.511406+0000","last_became_active":"2024-04-19T04:28:12.092979+0000","last_became_peered":"2024-04-19T04:28:12.092979+0000","last_unstale":"2024-04-19T04:28:33.511406+0000","last_undegraded":"2024-04-19T04:28:33.511406+0000","last_fullsized":"2024-04-19T04:28:33.511406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:33.511357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:33.511357+0000","last_clean_scrub_stamp":"2024-04-19T04:28:33.511357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:09:11.578221+0000","scrub_duration":0.0033778150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":44,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:36.522753+0000","last_change":"2024-04-19T04:28:36.523143+0000","last_active":"2024-04-19T04:28:36.522753+0000","last_peered":"2024-04-19T04:28:36.522753+0000","last_clean":"2024-04-19T04:28:36.522753+0000","last_became_active":"2024-04-19T04:28:12.093915+0000","last_became_peered":"2024-04-19T04:28:12.093915+0000","last_unstale":"2024-04-19T04:28:36.522753+0000","last_undegraded":"2024-04-19T04:28:36.522753+0000","last_fullsized":"2024-04-19T04:28:36.522753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-19T04:28:36.522650+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-19T04:28:36.522650+0000","last_clean_scrub_stamp":"2024-04-19T04:28:36.522650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:16.283397+0000","scrub_duration":0.0035824300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.094707+0000","last_change":"2024-04-19T04:28:02.639054+0000","last_active":"2024-04-19T04:28:13.094707+0000","last_peered":"2024-04-19T04:28:13.094707+0000","last_clean":"2024-04-19T04:28:13.094707+0000","last_became_active":"2024-04-19T04:28:02.637952+0000","last_became_peered":"2024-04-19T04:28:02.637952+0000","last_unstale":"2024-04-19T04:28:13.094707+0000","last_undegraded":"2024-04-19T04:28:13.094707+0000","last_fullsized":"2024-04-19T04:28:13.094707+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"79'3","reported_seq":100,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:42.732840+0000","last_change":"2024-04-19T04:28:42.733097+0000","last_active":"2024-04-19T04:28:42.732840+0000","last_peered":"2024-04-19T04:28:42.732840+0000","last_clean":"2024-04-19T04:28:42.732840+0000","last_became_active":"2024-04-19T04:28:02.634226+0000","last_became_peered":"2024-04-19T04:28:02.634226+0000","last_unstale":"2024-04-19T04:28:42.732840+0000","last_undegraded":"2024-04-19T04:28:42.732840+0000","last_fullsized":"2024-04-19T04:28:42.732840+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:28:42.732789+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:28:42.732789+0000","last_clean_scrub_stamp":"2024-04-19T04:28:42.732789+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:39.702938+0000","scrub_duration":0.0066219249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:52.772097+0000","last_change":"2024-04-19T04:28:52.772390+0000","last_active":"2024-04-19T04:28:52.772097+0000","last_peered":"2024-04-19T04:28:52.772097+0000","last_clean":"2024-04-19T04:28:52.772097+0000","last_became_active":"2024-04-19T04:28:02.636266+0000","last_became_peered":"2024-04-19T04:28:02.636266+0000","last_unstale":"2024-04-19T04:28:52.772097+0000","last_undegraded":"2024-04-19T04:28:52.772097+0000","last_fullsized":"2024-04-19T04:28:52.772097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:52.772052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:52.772052+0000","last_clean_scrub_stamp":"2024-04-19T04:28:52.772052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:04.600653+0000","scrub_duration":0.0038532319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:15.257183+0000","last_change":"2024-04-19T04:28:12.095797+0000","last_active":"2024-04-19T04:28:15.257183+0000","last_peered":"2024-04-19T04:28:15.257183+0000","last_clean":"2024-04-19T04:28:15.257183+0000","last_became_active":"2024-04-19T04:28:12.095199+0000","last_became_peered":"2024-04-19T04:28:12.095199+0000","last_unstale":"2024-04-19T04:28:15.257183+0000","last_undegraded":"2024-04-19T04:28:15.257183+0000","last_fullsized":"2024-04-19T04:28:15.257183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":69,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:20.466271+0000","last_change":"2024-04-19T04:28:12.091303+0000","last_active":"2024-04-19T04:28:20.466271+0000","last_peered":"2024-04-19T04:28:20.466271+0000","last_clean":"2024-04-19T04:28:20.466271+0000","last_became_active":"2024-04-19T04:28:12.087884+0000","last_became_peered":"2024-04-19T04:28:12.087884+0000","last_unstale":"2024-04-19T04:28:20.466271+0000","last_undegraded":"2024-04-19T04:28:20.466271+0000","last_fullsized":"2024-04-19T04:28:20.466271+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303600+0000","last_change":"2024-04-19T04:28:02.846538+0000","last_active":"2024-04-19T04:28:13.303600+0000","last_peered":"2024-04-19T04:28:13.303600+0000","last_clean":"2024-04-19T04:28:13.303600+0000","last_became_active":"2024-04-19T04:28:02.846234+0000","last_became_peered":"2024-04-19T04:28:02.846234+0000","last_unstale":"2024-04-19T04:28:13.303600+0000","last_undegraded":"2024-04-19T04:28:13.303600+0000","last_fullsized":"2024-04-19T04:28:13.303600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:41.739248+0000","last_change":"2024-04-19T04:28:41.739248+0000","last_active":"2024-04-19T04:28:41.739248+0000","last_peered":"2024-04-19T04:28:41.739248+0000","last_clean":"2024-04-19T04:28:41.739248+0000","last_became_active":"2024-04-19T04:28:02.634433+0000","last_became_peered":"2024-04-19T04:28:02.634433+0000","last_unstale":"2024-04-19T04:28:41.739248+0000","last_undegraded":"2024-04-19T04:28:41.739248+0000","last_fullsized":"2024-04-19T04:28:41.739248+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:41.738950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:41.738950+0000","last_clean_scrub_stamp":"2024-04-19T04:28:41.738950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:20.301173+0000","scrub_duration":0.0033981039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303822+0000","last_change":"2024-04-19T04:28:02.844897+0000","last_active":"2024-04-19T04:28:13.303822+0000","last_peered":"2024-04-19T04:28:13.303822+0000","last_clean":"2024-04-19T04:28:13.303822+0000","last_became_active":"2024-04-19T04:28:02.844276+0000","last_became_peered":"2024-04-19T04:28:02.844276+0000","last_unstale":"2024-04-19T04:28:13.303822+0000","last_undegraded":"2024-04-19T04:28:13.303822+0000","last_fullsized":"2024-04-19T04:28:13.303822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705731,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220708,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151132,"statfs":{"total":96636764160,"available":96410759168,"internally_reserved":0,"allocated":946176,"data_stored":926258,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 04:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.74399999999999999},"min":{"1min":0.51300000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.77900000000000003,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.59399999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.84299999999999997,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.65800000000000003}]},{"osd":1,"last update":"Fri Apr 19 04:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.753},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.58799999999999997}]}]},{"osd":1,"up_from":72,"seq":309237645330,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44116,"kb_used_data":844,"kb_used_omap":6,"kb_used_meta":43257,"kb_avail":94327724,"statfs":{"total":96636764160,"available":96591589376,"internally_reserved":0,"allocated":864256,"data_stored":334760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6880,"internal_metadata":44295456},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 04:29:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Apr 19 04:29:01 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.71999999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298664,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297726,"kb_avail":94073176,"statfs":{"total":96636764160,"available":96330932224,"internally_reserved":0,"allocated":950272,"data_stored":924740,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":304871878},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 04:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.59799999999999998}]},{"osd":2,"last update":"Fri Apr 19 04:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.62,"15min":0.61399999999999999},"min":{"1min":0.58399999999999996,"5min":0.223,"15min":0.223},"max":{"1min":0.83899999999999997,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.628,"15min":0.77900000000000003},"min":{"1min":0.57699999999999996,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.86099999999999999,"5min":4.5,"15min":4.5},"last":0.67200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:29:21.920 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.921 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.921 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.921 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.921 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.921 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.921 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.921 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.922 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.922 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.922 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.922 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.922 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.922 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.922 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.923 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.923 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.923 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.923 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.923 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T04:24:09.083488+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.923 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.923 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.923 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.924 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.924 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.924 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.924 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.924 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.924 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.924 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.924 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.925 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.925 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.925 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.925 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.925 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.925 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:21.925 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T04:29:41.926 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:29:42.248 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:29:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:29:42.264 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-04-19T04:29:41.017516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":563488,"kb_used_data":2696,"kb_used_omap":9,"kb_used_meta":560758,"kb_avail":282552032,"statfs":{"total":289910292480,"available":289333280768,"internally_reserved":0,"allocated":2760704,"data_stored":2185758,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":10068,"internal_metadata":574216364},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004374"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:24.524670+0000","last_change":"2024-04-19T04:28:24.524670+0000","last_active":"2024-04-19T04:28:24.524670+0000","last_peered":"2024-04-19T04:28:24.524670+0000","last_clean":"2024-04-19T04:28:24.524670+0000","last_became_active":"2024-04-19T04:28:12.093175+0000","last_became_peered":"2024-04-19T04:28:12.093175+0000","last_unstale":"2024-04-19T04:28:24.524670+0000","last_undegraded":"2024-04-19T04:28:24.524670+0000","last_fullsized":"2024-04-19T04:28:24.524670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:24.524536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:24.524536+0000","last_clean_scrub_stamp":"2024-04-19T04:28:24.524536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:34:39.154898+0000","scrub_duration":0.080942869000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:25.440827+0000","last_change":"2024-04-19T04:28:25.440827+0000","last_active":"2024-04-19T04:28:25.440827+0000","last_peered":"2024-04-19T04:28:25.440827+0000","last_clean":"2024-04-19T04:28:25.440827+0000","last_became_active":"2024-04-19T04:28:12.092819+0000","last_became_peered":"2024-04-19T04:28:12.092819+0000","last_unstale":"2024-04-19T04:28:25.440827+0000","last_undegraded":"2024-04-19T04:28:25.440827+0000","last_fullsized":"2024-04-19T04:28:25.440827+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:25.440548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:25.440548+0000","last_clean_scrub_stamp":"2024-04-19T04:28:25.440548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:40.485315+0000","scrub_duration":0.0035723539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481982+0000","last_change":"2024-04-19T04:24:20.556199+0000","last_active":"2024-04-19T04:28:19.481982+0000","last_peered":"2024-04-19T04:28:19.481982+0000","last_clean":"2024-04-19T04:28:19.481982+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:28:19.481982+0000","last_undegraded":"2024-04-19T04:28:19.481982+0000","last_fullsized":"2024-04-19T04:28:19.481982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481947+0000","last_change":"2024-04-19T04:28:02.635437+0000","last_active":"2024-04-19T04:28:19.481947+0000","last_peered":"2024-04-19T04:28:19.481947+0000","last_clean":"2024-04-19T04:28:19.481947+0000","last_became_active":"2024-04-19T04:28:02.634355+0000","last_became_peered":"2024-04-19T04:28:02.634355+0000","last_unstale":"2024-04-19T04:28:19.481947+0000","last_undegraded":"2024-04-19T04:28:19.481947+0000","last_fullsized":"2024-04-19T04:28:19.481947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:34.505005+0000","last_change":"2024-04-19T04:28:34.505005+0000","last_active":"2024-04-19T04:28:34.505005+0000","last_peered":"2024-04-19T04:28:34.505005+0000","last_clean":"2024-04-19T04:28:34.505005+0000","last_became_active":"2024-04-19T04:28:12.088231+0000","last_became_peered":"2024-04-19T04:28:12.088231+0000","last_unstale":"2024-04-19T04:28:34.505005+0000","last_undegraded":"2024-04-19T04:28:34.505005+0000","last_fullsized":"2024-04-19T04:28:34.505005+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:34.504692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:34.504692+0000","last_clean_scrub_stamp":"2024-04-19T04:28:34.504692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:54:14.305698+0000","scrub_duration":0.021028397000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481959+0000","last_change":"2024-04-19T04:28:02.637742+0000","last_active":"2024-04-19T04:28:19.481959+0000","last_peered":"2024-04-19T04:28:19.481959+0000","last_clean":"2024-04-19T04:28:19.481959+0000","last_became_active":"2024-04-19T04:28:02.637276+0000","last_became_peered":"2024-04-19T04:28:02.637276+0000","last_unstale":"2024-04-19T04:28:19.481959+0000","last_undegraded":"2024-04-19T04:28:19.481959+0000","last_fullsized":"2024-04-19T04:28:19.481959+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:39.760873+0000","last_change":"2024-04-19T04:28:39.760873+0000","last_active":"2024-04-19T04:28:39.760873+0000","last_peered":"2024-04-19T04:28:39.760873+0000","last_clean":"2024-04-19T04:28:39.760873+0000","last_became_active":"2024-04-19T04:28:02.637086+0000","last_became_peered":"2024-04-19T04:28:02.637086+0000","last_unstale":"2024-04-19T04:28:39.760873+0000","last_undegraded":"2024-04-19T04:28:39.760873+0000","last_fullsized":"2024-04-19T04:28:39.760873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:39.760588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:39.760588+0000","last_clean_scrub_stamp":"2024-04-19T04:28:39.760588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:47:43.003181+0000","scrub_duration":0.020879537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.482078+0000","last_change":"2024-04-19T04:28:02.638186+0000","last_active":"2024-04-19T04:28:19.482078+0000","last_peered":"2024-04-19T04:28:19.482078+0000","last_clean":"2024-04-19T04:28:19.482078+0000","last_became_active":"2024-04-19T04:28:02.637746+0000","last_became_peered":"2024-04-19T04:28:02.637746+0000","last_unstale":"2024-04-19T04:28:19.482078+0000","last_undegraded":"2024-04-19T04:28:19.482078+0000","last_fullsized":"2024-04-19T04:28:19.482078+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:30.172464+0000","last_change":"2024-04-19T04:29:30.172655+0000","last_active":"2024-04-19T04:29:30.172464+0000","last_peered":"2024-04-19T04:29:30.172464+0000","last_clean":"2024-04-19T04:29:30.172464+0000","last_became_active":"2024-04-19T04:28:02.839203+0000","last_became_peered":"2024-04-19T04:28:02.839203+0000","last_unstale":"2024-04-19T04:29:30.172464+0000","last_undegraded":"2024-04-19T04:29:30.172464+0000","last_fullsized":"2024-04-19T04:29:30.172464+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:30.172421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:30.172421+0000","last_clean_scrub_stamp":"2024-04-19T04:29:30.172421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:42:16.051310+0000","scrub_duration":0.031415525999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:19.483877+0000","last_change":"2024-04-19T04:29:19.484216+0000","last_active":"2024-04-19T04:29:19.483877+0000","last_peered":"2024-04-19T04:29:19.483877+0000","last_clean":"2024-04-19T04:29:19.483877+0000","last_became_active":"2024-04-19T04:28:12.092924+0000","last_became_peered":"2024-04-19T04:28:12.092924+0000","last_unstale":"2024-04-19T04:29:19.483877+0000","last_undegraded":"2024-04-19T04:29:19.483877+0000","last_fullsized":"2024-04-19T04:29:19.483877+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:19.483790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:19.483790+0000","last_clean_scrub_stamp":"2024-04-19T04:29:19.483790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:54.022997+0000","scrub_duration":0.0033506920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481896+0000","last_change":"2024-04-19T04:28:02.636293+0000","last_active":"2024-04-19T04:28:19.481896+0000","last_peered":"2024-04-19T04:28:19.481896+0000","last_clean":"2024-04-19T04:28:19.481896+0000","last_became_active":"2024-04-19T04:28:02.635946+0000","last_became_peered":"2024-04-19T04:28:02.635946+0000","last_unstale":"2024-04-19T04:28:19.481896+0000","last_undegraded":"2024-04-19T04:28:19.481896+0000","last_fullsized":"2024-04-19T04:28:19.481896+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:35.526927+0000","last_change":"2024-04-19T04:28:35.527163+0000","last_active":"2024-04-19T04:28:35.526927+0000","last_peered":"2024-04-19T04:28:35.526927+0000","last_clean":"2024-04-19T04:28:35.526927+0000","last_became_active":"2024-04-19T04:28:12.094753+0000","last_became_peered":"2024-04-19T04:28:12.094753+0000","last_unstale":"2024-04-19T04:28:35.526927+0000","last_undegraded":"2024-04-19T04:28:35.526927+0000","last_fullsized":"2024-04-19T04:28:35.526927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:35.526884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:35.526884+0000","last_clean_scrub_stamp":"2024-04-19T04:28:35.526884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:06:35.618252+0000","scrub_duration":0.0031760289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:47.475887+0000","last_change":"2024-04-19T04:28:47.475887+0000","last_active":"2024-04-19T04:28:47.475887+0000","last_peered":"2024-04-19T04:28:47.475887+0000","last_clean":"2024-04-19T04:28:47.475887+0000","last_became_active":"2024-04-19T04:28:12.093267+0000","last_became_peered":"2024-04-19T04:28:12.093267+0000","last_unstale":"2024-04-19T04:28:47.475887+0000","last_undegraded":"2024-04-19T04:28:47.475887+0000","last_fullsized":"2024-04-19T04:28:47.475887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:47.475618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:47.475618+0000","last_clean_scrub_stamp":"2024-04-19T04:28:47.475618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:37.519624+0000","scrub_duration":0.022523944000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:23.449786+0000","last_change":"2024-04-19T04:28:23.449786+0000","last_active":"2024-04-19T04:28:23.449786+0000","last_peered":"2024-04-19T04:28:23.449786+0000","last_clean":"2024-04-19T04:28:23.449786+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:28:23.449786+0000","last_undegraded":"2024-04-19T04:28:23.449786+0000","last_fullsized":"2024-04-19T04:28:23.449786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:23.449500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:23.449500+0000","last_clean_scrub_stamp":"2024-04-19T04:28:23.449500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:20.102454+0000","scrub_duration":0.0033193469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481810+0000","last_change":"2024-04-19T04:24:20.551809+0000","last_active":"2024-04-19T04:28:19.481810+0000","last_peered":"2024-04-19T04:28:19.481810+0000","last_clean":"2024-04-19T04:28:19.481810+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:28:19.481810+0000","last_undegraded":"2024-04-19T04:28:19.481810+0000","last_fullsized":"2024-04-19T04:28:19.481810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:33.597905+0000","last_change":"2024-04-19T04:28:33.597905+0000","last_active":"2024-04-19T04:28:33.597905+0000","last_peered":"2024-04-19T04:28:33.597905+0000","last_clean":"2024-04-19T04:28:33.597905+0000","last_became_active":"2024-04-19T04:28:02.637920+0000","last_became_peered":"2024-04-19T04:28:02.637920+0000","last_unstale":"2024-04-19T04:28:33.597905+0000","last_undegraded":"2024-04-19T04:28:33.597905+0000","last_fullsized":"2024-04-19T04:28:33.597905+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:33.597411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:33.597411+0000","last_clean_scrub_stamp":"2024-04-19T04:28:33.597411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:50.250390+0000","scrub_duration":0.0037610339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:42.236628+0000","last_change":"2024-04-19T04:28:42.236755+0000","last_active":"2024-04-19T04:28:42.236628+0000","last_peered":"2024-04-19T04:28:42.236628+0000","last_clean":"2024-04-19T04:28:42.236628+0000","last_became_active":"2024-04-19T04:28:02.839071+0000","last_became_peered":"2024-04-19T04:28:02.839071+0000","last_unstale":"2024-04-19T04:28:42.236628+0000","last_undegraded":"2024-04-19T04:28:42.236628+0000","last_fullsized":"2024-04-19T04:28:42.236628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:42.236604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:42.236604+0000","last_clean_scrub_stamp":"2024-04-19T04:28:42.236604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:47:48.663058+0000","scrub_duration":0.070531359000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:06.456011+0000","last_change":"2024-04-19T04:29:06.456366+0000","last_active":"2024-04-19T04:29:06.456011+0000","last_peered":"2024-04-19T04:29:06.456011+0000","last_clean":"2024-04-19T04:29:06.456011+0000","last_became_active":"2024-04-19T04:28:02.638230+0000","last_became_peered":"2024-04-19T04:28:02.638230+0000","last_unstale":"2024-04-19T04:29:06.456011+0000","last_undegraded":"2024-04-19T04:29:06.456011+0000","last_fullsized":"2024-04-19T04:29:06.456011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:06.455968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:06.455968+0000","last_clean_scrub_stamp":"2024-04-19T04:29:06.455968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:03.426117+0000","scrub_duration":0.0030903710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:31.226313+0000","last_change":"2024-04-19T04:28:31.226446+0000","last_active":"2024-04-19T04:28:31.226313+0000","last_peered":"2024-04-19T04:28:31.226313+0000","last_clean":"2024-04-19T04:28:31.226313+0000","last_became_active":"2024-04-19T04:28:02.839362+0000","last_became_peered":"2024-04-19T04:28:02.839362+0000","last_unstale":"2024-04-19T04:28:31.226313+0000","last_undegraded":"2024-04-19T04:28:31.226313+0000","last_fullsized":"2024-04-19T04:28:31.226313+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:31.226291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:31.226291+0000","last_clean_scrub_stamp":"2024-04-19T04:28:31.226291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:43:05.235533+0000","scrub_duration":0.029412667999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:28.516191+0000","last_change":"2024-04-19T04:28:28.516191+0000","last_active":"2024-04-19T04:28:28.516191+0000","last_peered":"2024-04-19T04:28:28.516191+0000","last_clean":"2024-04-19T04:28:28.516191+0000","last_became_active":"2024-04-19T04:28:02.634835+0000","last_became_peered":"2024-04-19T04:28:02.634835+0000","last_unstale":"2024-04-19T04:28:28.516191+0000","last_undegraded":"2024-04-19T04:28:28.516191+0000","last_fullsized":"2024-04-19T04:28:28.516191+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:28.515710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:28.515710+0000","last_clean_scrub_stamp":"2024-04-19T04:28:28.515710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:46.923636+0000","scrub_duration":0.0034446709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:10.768430+0000","last_change":"2024-04-19T04:29:10.768757+0000","last_active":"2024-04-19T04:29:10.768430+0000","last_peered":"2024-04-19T04:29:10.768430+0000","last_clean":"2024-04-19T04:29:10.768430+0000","last_became_active":"2024-04-19T04:28:02.638546+0000","last_became_peered":"2024-04-19T04:28:02.638546+0000","last_unstale":"2024-04-19T04:29:10.768430+0000","last_undegraded":"2024-04-19T04:29:10.768430+0000","last_fullsized":"2024-04-19T04:29:10.768430+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:10.768364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:10.768364+0000","last_clean_scrub_stamp":"2024-04-19T04:29:10.768364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:36.009796+0000","scrub_duration":0.042629556999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:49.435023+0000","last_change":"2024-04-19T04:28:49.435301+0000","last_active":"2024-04-19T04:28:49.435023+0000","last_peered":"2024-04-19T04:28:49.435023+0000","last_clean":"2024-04-19T04:28:49.435023+0000","last_became_active":"2024-04-19T04:28:12.087571+0000","last_became_peered":"2024-04-19T04:28:12.087571+0000","last_unstale":"2024-04-19T04:28:49.435023+0000","last_undegraded":"2024-04-19T04:28:49.435023+0000","last_fullsized":"2024-04-19T04:28:49.435023+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:49.434979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:49.434979+0000","last_clean_scrub_stamp":"2024-04-19T04:28:49.434979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:46.111742+0000","scrub_duration":0.003316786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:34.194332+0000","last_change":"2024-04-19T04:28:34.194663+0000","last_active":"2024-04-19T04:28:34.194332+0000","last_peered":"2024-04-19T04:28:34.194332+0000","last_clean":"2024-04-19T04:28:34.194332+0000","last_became_active":"2024-04-19T04:28:02.840294+0000","last_became_peered":"2024-04-19T04:28:02.840294+0000","last_unstale":"2024-04-19T04:28:34.194332+0000","last_undegraded":"2024-04-19T04:28:34.194332+0000","last_fullsized":"2024-04-19T04:28:34.194332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:34.194285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:34.194285+0000","last_clean_scrub_stamp":"2024-04-19T04:28:34.194285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:53:04.918350+0000","scrub_duration":0.0033717299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:18.460467+0000","last_change":"2024-04-19T04:29:18.460690+0000","last_active":"2024-04-19T04:29:18.460467+0000","last_peered":"2024-04-19T04:29:18.460467+0000","last_clean":"2024-04-19T04:29:18.460467+0000","last_became_active":"2024-04-19T04:28:12.089918+0000","last_became_peered":"2024-04-19T04:28:12.089918+0000","last_unstale":"2024-04-19T04:29:18.460467+0000","last_undegraded":"2024-04-19T04:29:18.460467+0000","last_fullsized":"2024-04-19T04:29:18.460467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:18.460425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:18.460425+0000","last_clean_scrub_stamp":"2024-04-19T04:29:18.460425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:09:31.294234+0000","scrub_duration":0.0033207029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:29.524463+0000","last_change":"2024-04-19T04:29:29.524562+0000","last_active":"2024-04-19T04:29:29.524463+0000","last_peered":"2024-04-19T04:29:29.524463+0000","last_clean":"2024-04-19T04:29:29.524463+0000","last_became_active":"2024-04-19T04:28:12.091770+0000","last_became_peered":"2024-04-19T04:28:12.091770+0000","last_unstale":"2024-04-19T04:29:29.524463+0000","last_undegraded":"2024-04-19T04:29:29.524463+0000","last_fullsized":"2024-04-19T04:29:29.524463+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:29.524443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:29.524443+0000","last_clean_scrub_stamp":"2024-04-19T04:29:29.524443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:53.181371+0000","scrub_duration":0.054287891999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:31.121661+0000","last_change":"2024-04-19T04:29:31.122032+0000","last_active":"2024-04-19T04:29:31.121661+0000","last_peered":"2024-04-19T04:29:31.121661+0000","last_clean":"2024-04-19T04:29:31.121661+0000","last_became_active":"2024-04-19T04:28:02.845416+0000","last_became_peered":"2024-04-19T04:28:02.845416+0000","last_unstale":"2024-04-19T04:29:31.121661+0000","last_undegraded":"2024-04-19T04:29:31.121661+0000","last_fullsized":"2024-04-19T04:29:31.121661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:31.121613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:31.121613+0000","last_clean_scrub_stamp":"2024-04-19T04:29:31.121613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:10:28.928808+0000","scrub_duration":0.0037616049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481739+0000","last_change":"2024-04-19T04:24:20.554885+0000","last_active":"2024-04-19T04:28:19.481739+0000","last_peered":"2024-04-19T04:28:19.481739+0000","last_clean":"2024-04-19T04:28:19.481739+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:28:19.481739+0000","last_undegraded":"2024-04-19T04:28:19.481739+0000","last_fullsized":"2024-04-19T04:28:19.481739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:00.393690+0000","last_change":"2024-04-19T04:29:00.393991+0000","last_active":"2024-04-19T04:29:00.393690+0000","last_peered":"2024-04-19T04:29:00.393690+0000","last_clean":"2024-04-19T04:29:00.393690+0000","last_became_active":"2024-04-19T04:28:12.091969+0000","last_became_peered":"2024-04-19T04:28:12.091969+0000","last_unstale":"2024-04-19T04:29:00.393690+0000","last_undegraded":"2024-04-19T04:29:00.393690+0000","last_fullsized":"2024-04-19T04:29:00.393690+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:00.393643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:00.393643+0000","last_clean_scrub_stamp":"2024-04-19T04:29:00.393643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:43:09.339689+0000","scrub_duration":0.0029687910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:19.135747+0000","last_change":"2024-04-19T04:29:19.135893+0000","last_active":"2024-04-19T04:29:19.135747+0000","last_peered":"2024-04-19T04:29:19.135747+0000","last_clean":"2024-04-19T04:29:19.135747+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:29:19.135747+0000","last_undegraded":"2024-04-19T04:29:19.135747+0000","last_fullsized":"2024-04-19T04:29:19.135747+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:19.135719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:19.135719+0000","last_clean_scrub_stamp":"2024-04-19T04:29:19.135719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:18:22.526783+0000","scrub_duration":0.029313573999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:05.491064+0000","last_change":"2024-04-19T04:29:05.491373+0000","last_active":"2024-04-19T04:29:05.491064+0000","last_peered":"2024-04-19T04:29:05.491064+0000","last_clean":"2024-04-19T04:29:05.491064+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:29:05.491064+0000","last_undegraded":"2024-04-19T04:29:05.491064+0000","last_fullsized":"2024-04-19T04:29:05.491064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:05.491021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:05.491021+0000","last_clean_scrub_stamp":"2024-04-19T04:29:05.491021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:44.053244+0000","scrub_duration":0.0032047590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:13.152396+0000","last_change":"2024-04-19T04:29:13.152726+0000","last_active":"2024-04-19T04:29:13.152396+0000","last_peered":"2024-04-19T04:29:13.152396+0000","last_clean":"2024-04-19T04:29:13.152396+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:29:13.152396+0000","last_undegraded":"2024-04-19T04:29:13.152396+0000","last_fullsized":"2024-04-19T04:29:13.152396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:13.152340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:13.152340+0000","last_clean_scrub_stamp":"2024-04-19T04:29:13.152340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:11:50.888946+0000","scrub_duration":0.0034040730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:16.704532+0000","last_change":"2024-04-19T04:29:16.704756+0000","last_active":"2024-04-19T04:29:16.704532+0000","last_peered":"2024-04-19T04:29:16.704532+0000","last_clean":"2024-04-19T04:29:16.704532+0000","last_became_active":"2024-04-19T04:28:02.634586+0000","last_became_peered":"2024-04-19T04:28:02.634586+0000","last_unstale":"2024-04-19T04:29:16.704532+0000","last_undegraded":"2024-04-19T04:29:16.704532+0000","last_fullsized":"2024-04-19T04:29:16.704532+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:16.704476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:16.704476+0000","last_clean_scrub_stamp":"2024-04-19T04:29:16.704476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:05.468791+0000","scrub_duration":0.0032163460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:48.475080+0000","last_change":"2024-04-19T04:28:48.475080+0000","last_active":"2024-04-19T04:28:48.475080+0000","last_peered":"2024-04-19T04:28:48.475080+0000","last_clean":"2024-04-19T04:28:48.475080+0000","last_became_active":"2024-04-19T04:28:12.094558+0000","last_became_peered":"2024-04-19T04:28:12.094558+0000","last_unstale":"2024-04-19T04:28:48.475080+0000","last_undegraded":"2024-04-19T04:28:48.475080+0000","last_fullsized":"2024-04-19T04:28:48.475080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:48.474816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:48.474816+0000","last_clean_scrub_stamp":"2024-04-19T04:28:48.474816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:45.127770+0000","scrub_duration":0.003339912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"79'4","reported_seq":102,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:59.874932+0000","last_change":"2024-04-19T04:28:59.874932+0000","last_active":"2024-04-19T04:28:59.874932+0000","last_peered":"2024-04-19T04:28:59.874932+0000","last_clean":"2024-04-19T04:28:59.874932+0000","last_became_active":"2024-04-19T04:28:02.638666+0000","last_became_peered":"2024-04-19T04:28:02.638666+0000","last_unstale":"2024-04-19T04:28:59.874932+0000","last_undegraded":"2024-04-19T04:28:59.874932+0000","last_fullsized":"2024-04-19T04:28:59.874932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-04-19T04:28:59.874627+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-04-19T04:28:59.874627+0000","last_clean_scrub_stamp":"2024-04-19T04:28:59.874627+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:20:56.884252+0000","scrub_duration":0.0061750349999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:27.505148+0000","last_change":"2024-04-19T04:29:27.505394+0000","last_active":"2024-04-19T04:29:27.505148+0000","last_peered":"2024-04-19T04:29:27.505148+0000","last_clean":"2024-04-19T04:29:27.505148+0000","last_became_active":"2024-04-19T04:28:12.094722+0000","last_became_peered":"2024-04-19T04:28:12.094722+0000","last_unstale":"2024-04-19T04:29:27.505148+0000","last_undegraded":"2024-04-19T04:29:27.505148+0000","last_fullsized":"2024-04-19T04:29:27.505148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:27.505100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:27.505100+0000","last_clean_scrub_stamp":"2024-04-19T04:29:27.505100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:36:45.754653+0000","scrub_duration":0.021590518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:37.122068+0000","last_change":"2024-04-19T04:29:37.122327+0000","last_active":"2024-04-19T04:29:37.122068+0000","last_peered":"2024-04-19T04:29:37.122068+0000","last_clean":"2024-04-19T04:29:37.122068+0000","last_became_active":"2024-04-19T04:28:02.842525+0000","last_became_peered":"2024-04-19T04:28:02.842525+0000","last_unstale":"2024-04-19T04:29:37.122068+0000","last_undegraded":"2024-04-19T04:29:37.122068+0000","last_fullsized":"2024-04-19T04:29:37.122068+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:37.122023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:37.122023+0000","last_clean_scrub_stamp":"2024-04-19T04:29:37.122023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:58:29.627789+0000","scrub_duration":0.003440088,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.151861+0000","last_change":"2024-04-19T04:28:40.152096+0000","last_active":"2024-04-19T04:28:40.151861+0000","last_peered":"2024-04-19T04:28:40.151861+0000","last_clean":"2024-04-19T04:28:40.151861+0000","last_became_active":"2024-04-19T04:28:02.843099+0000","last_became_peered":"2024-04-19T04:28:02.843099+0000","last_unstale":"2024-04-19T04:28:40.151861+0000","last_undegraded":"2024-04-19T04:28:40.151861+0000","last_fullsized":"2024-04-19T04:28:40.151861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.151812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.151812+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.151812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:19.753268+0000","scrub_duration":0.0030712460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:29.541159+0000","last_change":"2024-04-19T04:28:29.541420+0000","last_active":"2024-04-19T04:28:29.541159+0000","last_peered":"2024-04-19T04:28:29.541159+0000","last_clean":"2024-04-19T04:28:29.541159+0000","last_became_active":"2024-04-19T04:28:12.091771+0000","last_became_peered":"2024-04-19T04:28:12.091771+0000","last_unstale":"2024-04-19T04:28:29.541159+0000","last_undegraded":"2024-04-19T04:28:29.541159+0000","last_fullsized":"2024-04-19T04:28:29.541159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:29.541116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:29.541116+0000","last_clean_scrub_stamp":"2024-04-19T04:28:29.541116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:42.022636+0000","scrub_duration":0.0033350189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:29.182019+0000","last_change":"2024-04-19T04:29:29.182338+0000","last_active":"2024-04-19T04:29:29.182019+0000","last_peered":"2024-04-19T04:29:29.182019+0000","last_clean":"2024-04-19T04:29:29.182019+0000","last_became_active":"2024-04-19T04:28:02.836984+0000","last_became_peered":"2024-04-19T04:28:02.836984+0000","last_unstale":"2024-04-19T04:29:29.182019+0000","last_undegraded":"2024-04-19T04:29:29.182019+0000","last_fullsized":"2024-04-19T04:29:29.182019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:29.181949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:29.181949+0000","last_clean_scrub_stamp":"2024-04-19T04:29:29.181949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:05:44.642227+0000","scrub_duration":0.072525754999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":82,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481303+0000","last_change":"2024-04-19T04:24:20.187299+0000","last_active":"2024-04-19T04:28:19.481303+0000","last_peered":"2024-04-19T04:28:19.481303+0000","last_clean":"2024-04-19T04:28:19.481303+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:28:19.481303+0000","last_undegraded":"2024-04-19T04:28:19.481303+0000","last_fullsized":"2024-04-19T04:28:19.481303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"79'2","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:14.682747+0000","last_change":"2024-04-19T04:29:14.683190+0000","last_active":"2024-04-19T04:29:14.682747+0000","last_peered":"2024-04-19T04:29:14.682747+0000","last_clean":"2024-04-19T04:29:14.682747+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:29:14.682747+0000","last_undegraded":"2024-04-19T04:29:14.682747+0000","last_fullsized":"2024-04-19T04:29:14.682747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-19T04:29:14.682697+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-19T04:29:14.682697+0000","last_clean_scrub_stamp":"2024-04-19T04:29:14.682697+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:35.626266+0000","scrub_duration":0.006337891,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:15.540432+0000","last_change":"2024-04-19T04:29:15.540650+0000","last_active":"2024-04-19T04:29:15.540432+0000","last_peered":"2024-04-19T04:29:15.540432+0000","last_clean":"2024-04-19T04:29:15.540432+0000","last_became_active":"2024-04-19T04:28:12.090379+0000","last_became_peered":"2024-04-19T04:28:12.090379+0000","last_unstale":"2024-04-19T04:29:15.540432+0000","last_undegraded":"2024-04-19T04:29:15.540432+0000","last_fullsized":"2024-04-19T04:29:15.540432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:15.540388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:15.540388+0000","last_clean_scrub_stamp":"2024-04-19T04:29:15.540388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:58:31.906342+0000","scrub_duration":0.0035449280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"79'3","reported_seq":46,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:30.448918+0000","last_change":"2024-04-19T04:29:30.449147+0000","last_active":"2024-04-19T04:29:30.448918+0000","last_peered":"2024-04-19T04:29:30.448918+0000","last_clean":"2024-04-19T04:29:30.448918+0000","last_became_active":"2024-04-19T04:28:12.089948+0000","last_became_peered":"2024-04-19T04:28:12.089948+0000","last_unstale":"2024-04-19T04:29:30.448918+0000","last_undegraded":"2024-04-19T04:29:30.448918+0000","last_fullsized":"2024-04-19T04:29:30.448918+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:29:30.448862+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:29:30.448862+0000","last_clean_scrub_stamp":"2024-04-19T04:29:30.448862+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:55.690294+0000","scrub_duration":0.0062853340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:57.409585+0000","last_change":"2024-04-19T04:28:57.409839+0000","last_active":"2024-04-19T04:28:57.409585+0000","last_peered":"2024-04-19T04:28:57.409585+0000","last_clean":"2024-04-19T04:28:57.409585+0000","last_became_active":"2024-04-19T04:28:12.093090+0000","last_became_peered":"2024-04-19T04:28:12.093090+0000","last_unstale":"2024-04-19T04:28:57.409585+0000","last_undegraded":"2024-04-19T04:28:57.409585+0000","last_fullsized":"2024-04-19T04:28:57.409585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:57.409536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:57.409536+0000","last_clean_scrub_stamp":"2024-04-19T04:28:57.409536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:58:14.062514+0000","scrub_duration":0.0034988459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"79'2","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:51.726306+0000","last_change":"2024-04-19T04:28:51.726306+0000","last_active":"2024-04-19T04:28:51.726306+0000","last_peered":"2024-04-19T04:28:51.726306+0000","last_clean":"2024-04-19T04:28:51.726306+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:28:51.726306+0000","last_undegraded":"2024-04-19T04:28:51.726306+0000","last_fullsized":"2024-04-19T04:28:51.726306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-19T04:28:51.725876+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-19T04:28:51.725876+0000","last_clean_scrub_stamp":"2024-04-19T04:28:51.725876+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:17.429863+0000","scrub_duration":0.0062414059999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:13.724370+0000","last_change":"2024-04-19T04:29:13.724590+0000","last_active":"2024-04-19T04:29:13.724370+0000","last_peered":"2024-04-19T04:29:13.724370+0000","last_clean":"2024-04-19T04:29:13.724370+0000","last_became_active":"2024-04-19T04:28:02.636231+0000","last_became_peered":"2024-04-19T04:28:02.636231+0000","last_unstale":"2024-04-19T04:29:13.724370+0000","last_undegraded":"2024-04-19T04:29:13.724370+0000","last_fullsized":"2024-04-19T04:29:13.724370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:13.724320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:13.724320+0000","last_clean_scrub_stamp":"2024-04-19T04:29:13.724320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:30:36.014677+0000","scrub_duration":0.0034525440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:19.699868+0000","last_change":"2024-04-19T04:29:19.700106+0000","last_active":"2024-04-19T04:29:19.699868+0000","last_peered":"2024-04-19T04:29:19.699868+0000","last_clean":"2024-04-19T04:29:19.699868+0000","last_became_active":"2024-04-19T04:28:02.634823+0000","last_became_peered":"2024-04-19T04:28:02.634823+0000","last_unstale":"2024-04-19T04:29:19.699868+0000","last_undegraded":"2024-04-19T04:29:19.699868+0000","last_fullsized":"2024-04-19T04:29:19.699868+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:19.699822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:19.699822+0000","last_clean_scrub_stamp":"2024-04-19T04:29:19.699822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:29:33.297820+0000","scrub_duration":0.003354863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:56.250577+0000","last_change":"2024-04-19T04:28:56.250708+0000","last_active":"2024-04-19T04:28:56.250577+0000","last_peered":"2024-04-19T04:28:56.250577+0000","last_clean":"2024-04-19T04:28:56.250577+0000","last_became_active":"2024-04-19T04:28:02.845461+0000","last_became_peered":"2024-04-19T04:28:02.845461+0000","last_unstale":"2024-04-19T04:28:56.250577+0000","last_undegraded":"2024-04-19T04:28:56.250577+0000","last_fullsized":"2024-04-19T04:28:56.250577+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:56.250557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:56.250557+0000","last_clean_scrub_stamp":"2024-04-19T04:28:56.250557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:56.014220+0000","scrub_duration":0.029538265000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:46.246893+0000","last_change":"2024-04-19T04:28:46.247247+0000","last_active":"2024-04-19T04:28:46.246893+0000","last_peered":"2024-04-19T04:28:46.246893+0000","last_clean":"2024-04-19T04:28:46.246893+0000","last_became_active":"2024-04-19T04:28:02.844927+0000","last_became_peered":"2024-04-19T04:28:02.844927+0000","last_unstale":"2024-04-19T04:28:46.246893+0000","last_undegraded":"2024-04-19T04:28:46.246893+0000","last_fullsized":"2024-04-19T04:28:46.246893+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:28:46.246777+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:28:46.246777+0000","last_clean_scrub_stamp":"2024-04-19T04:28:46.246777+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:37:56.201762+0000","scrub_duration":0.006831213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:58.824983+0000","last_change":"2024-04-19T04:28:58.825209+0000","last_active":"2024-04-19T04:28:58.824983+0000","last_peered":"2024-04-19T04:28:58.824983+0000","last_clean":"2024-04-19T04:28:58.824983+0000","last_became_active":"2024-04-19T04:28:02.635238+0000","last_became_peered":"2024-04-19T04:28:02.635238+0000","last_unstale":"2024-04-19T04:28:58.824983+0000","last_undegraded":"2024-04-19T04:28:58.824983+0000","last_fullsized":"2024-04-19T04:28:58.824983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:58.824931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:58.824931+0000","last_clean_scrub_stamp":"2024-04-19T04:28:58.824931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:33.364138+0000","scrub_duration":0.0033677389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481737+0000","last_change":"2024-04-19T04:28:02.638055+0000","last_active":"2024-04-19T04:28:19.481737+0000","last_peered":"2024-04-19T04:28:19.481737+0000","last_clean":"2024-04-19T04:28:19.481737+0000","last_became_active":"2024-04-19T04:28:02.637651+0000","last_became_peered":"2024-04-19T04:28:02.637651+0000","last_unstale":"2024-04-19T04:28:19.481737+0000","last_undegraded":"2024-04-19T04:28:19.481737+0000","last_fullsized":"2024-04-19T04:28:19.481737+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.710088+0000","last_change":"2024-04-19T04:28:40.710088+0000","last_active":"2024-04-19T04:28:40.710088+0000","last_peered":"2024-04-19T04:28:40.710088+0000","last_clean":"2024-04-19T04:28:40.710088+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:28:40.710088+0000","last_undegraded":"2024-04-19T04:28:40.710088+0000","last_fullsized":"2024-04-19T04:28:40.710088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.709702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.709702+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.709702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:24.831215+0000","scrub_duration":0.0033854829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:04.490301+0000","last_change":"2024-04-19T04:29:04.490555+0000","last_active":"2024-04-19T04:29:04.490301+0000","last_peered":"2024-04-19T04:29:04.490301+0000","last_clean":"2024-04-19T04:29:04.490301+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:29:04.490301+0000","last_undegraded":"2024-04-19T04:29:04.490301+0000","last_fullsized":"2024-04-19T04:29:04.490301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:04.490250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:04.490250+0000","last_clean_scrub_stamp":"2024-04-19T04:29:04.490250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:48.611763+0000","scrub_duration":0.003278235,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:06.705490+0000","last_change":"2024-04-19T04:29:06.705866+0000","last_active":"2024-04-19T04:29:06.705490+0000","last_peered":"2024-04-19T04:29:06.705490+0000","last_clean":"2024-04-19T04:29:06.705490+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:29:06.705490+0000","last_undegraded":"2024-04-19T04:29:06.705490+0000","last_fullsized":"2024-04-19T04:29:06.705490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:06.705384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:06.705384+0000","last_clean_scrub_stamp":"2024-04-19T04:29:06.705384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:57.321888+0000","scrub_duration":0.003745515,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.494052+0000","last_change":"2024-04-19T04:28:40.494052+0000","last_active":"2024-04-19T04:28:40.494052+0000","last_peered":"2024-04-19T04:28:40.494052+0000","last_clean":"2024-04-19T04:28:40.494052+0000","last_became_active":"2024-04-19T04:28:12.088043+0000","last_became_peered":"2024-04-19T04:28:12.088043+0000","last_unstale":"2024-04-19T04:28:40.494052+0000","last_undegraded":"2024-04-19T04:28:40.494052+0000","last_fullsized":"2024-04-19T04:28:40.494052+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.493585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.493585+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.493585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:22:36.746203+0000","scrub_duration":0.0035336780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:39.119137+0000","last_change":"2024-04-19T04:29:39.119269+0000","last_active":"2024-04-19T04:29:39.119137+0000","last_peered":"2024-04-19T04:29:39.119137+0000","last_clean":"2024-04-19T04:29:39.119137+0000","last_became_active":"2024-04-19T04:28:02.843639+0000","last_became_peered":"2024-04-19T04:28:02.843639+0000","last_unstale":"2024-04-19T04:29:39.119137+0000","last_undegraded":"2024-04-19T04:29:39.119137+0000","last_fullsized":"2024-04-19T04:29:39.119137+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:39.119118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:39.119118+0000","last_clean_scrub_stamp":"2024-04-19T04:29:39.119118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:21:58.336649+0000","scrub_duration":0.057465321999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'159","reported_seq":289,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:25.641453+0000","last_change":"2024-04-19T04:29:25.641698+0000","last_active":"2024-04-19T04:29:25.641453+0000","last_peered":"2024-04-19T04:29:25.641453+0000","last_clean":"2024-04-19T04:29:25.641453+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:29:25.641453+0000","last_undegraded":"2024-04-19T04:29:25.641453+0000","last_fullsized":"2024-04-19T04:29:25.641453+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'159","last_scrub_stamp":"2024-04-19T04:29:25.641417+0000","last_deep_scrub":"79'159","last_deep_scrub_stamp":"2024-04-19T04:29:25.641417+0000","last_clean_scrub_stamp":"2024-04-19T04:29:25.641417+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:59.525050+0000","scrub_duration":0.011440092000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481030+0000","last_change":"2024-04-19T04:28:02.639632+0000","last_active":"2024-04-19T04:28:19.481030+0000","last_peered":"2024-04-19T04:28:19.481030+0000","last_clean":"2024-04-19T04:28:19.481030+0000","last_became_active":"2024-04-19T04:28:02.639240+0000","last_became_peered":"2024-04-19T04:28:02.639240+0000","last_unstale":"2024-04-19T04:28:19.481030+0000","last_undegraded":"2024-04-19T04:28:19.481030+0000","last_fullsized":"2024-04-19T04:28:19.481030+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.302143+0000","last_change":"2024-04-19T04:28:02.842437+0000","last_active":"2024-04-19T04:28:13.302143+0000","last_peered":"2024-04-19T04:28:13.302143+0000","last_clean":"2024-04-19T04:28:13.302143+0000","last_became_active":"2024-04-19T04:28:02.841053+0000","last_became_peered":"2024-04-19T04:28:02.841053+0000","last_unstale":"2024-04-19T04:28:13.302143+0000","last_undegraded":"2024-04-19T04:28:13.302143+0000","last_fullsized":"2024-04-19T04:28:13.302143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:43.759501+0000","last_change":"2024-04-19T04:28:43.759738+0000","last_active":"2024-04-19T04:28:43.759501+0000","last_peered":"2024-04-19T04:28:43.759501+0000","last_clean":"2024-04-19T04:28:43.759501+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:28:43.759501+0000","last_undegraded":"2024-04-19T04:28:43.759501+0000","last_fullsized":"2024-04-19T04:28:43.759501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:43.759455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:43.759455+0000","last_clean_scrub_stamp":"2024-04-19T04:28:43.759455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:10.518057+0000","scrub_duration":0.0032782050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:32.629604+0000","last_change":"2024-04-19T04:29:32.629967+0000","last_active":"2024-04-19T04:29:32.629604+0000","last_peered":"2024-04-19T04:29:32.629604+0000","last_clean":"2024-04-19T04:29:32.629604+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:29:32.629604+0000","last_undegraded":"2024-04-19T04:29:32.629604+0000","last_fullsized":"2024-04-19T04:29:32.629604+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:32.629512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:32.629512+0000","last_clean_scrub_stamp":"2024-04-19T04:29:32.629512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:40.130427+0000","scrub_duration":0.0033463669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:27.119933+0000","last_change":"2024-04-19T04:29:27.120166+0000","last_active":"2024-04-19T04:29:27.119933+0000","last_peered":"2024-04-19T04:29:27.119933+0000","last_clean":"2024-04-19T04:29:27.119933+0000","last_became_active":"2024-04-19T04:28:02.839926+0000","last_became_peered":"2024-04-19T04:28:02.839926+0000","last_unstale":"2024-04-19T04:29:27.119933+0000","last_undegraded":"2024-04-19T04:29:27.119933+0000","last_fullsized":"2024-04-19T04:29:27.119933+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:27.119885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:27.119885+0000","last_clean_scrub_stamp":"2024-04-19T04:29:27.119885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:23.826940+0000","scrub_duration":0.0034871469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:14.506307+0000","last_change":"2024-04-19T04:29:14.506535+0000","last_active":"2024-04-19T04:29:14.506307+0000","last_peered":"2024-04-19T04:29:14.506307+0000","last_clean":"2024-04-19T04:29:14.506307+0000","last_became_active":"2024-04-19T04:28:02.638095+0000","last_became_peered":"2024-04-19T04:28:02.638095+0000","last_unstale":"2024-04-19T04:29:14.506307+0000","last_undegraded":"2024-04-19T04:29:14.506307+0000","last_fullsized":"2024-04-19T04:29:14.506307+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:14.506264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:14.506264+0000","last_clean_scrub_stamp":"2024-04-19T04:29:14.506264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:39:27.629645+0000","scrub_duration":0.003222464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:21.148937+0000","last_change":"2024-04-19T04:28:21.158508+0000","last_active":"2024-04-19T04:28:21.148937+0000","last_peered":"2024-04-19T04:28:21.148937+0000","last_clean":"2024-04-19T04:28:21.148937+0000","last_became_active":"2024-04-19T04:28:02.840328+0000","last_became_peered":"2024-04-19T04:28:02.840328+0000","last_unstale":"2024-04-19T04:28:21.148937+0000","last_undegraded":"2024-04-19T04:28:21.148937+0000","last_fullsized":"2024-04-19T04:28:21.148937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:21.148887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:21.148887+0000","last_clean_scrub_stamp":"2024-04-19T04:28:21.148887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:44:55.928928+0000","scrub_duration":0.0038294929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:46.483321+0000","last_change":"2024-04-19T04:28:46.483620+0000","last_active":"2024-04-19T04:28:46.483321+0000","last_peered":"2024-04-19T04:28:46.483321+0000","last_clean":"2024-04-19T04:28:46.483321+0000","last_became_active":"2024-04-19T04:28:12.087575+0000","last_became_peered":"2024-04-19T04:28:12.087575+0000","last_unstale":"2024-04-19T04:28:46.483321+0000","last_undegraded":"2024-04-19T04:28:46.483321+0000","last_fullsized":"2024-04-19T04:28:46.483321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:46.483271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:46.483271+0000","last_clean_scrub_stamp":"2024-04-19T04:28:46.483271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:13.971451+0000","scrub_duration":0.0034840449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:12.204141+0000","last_change":"2024-04-19T04:29:12.204263+0000","last_active":"2024-04-19T04:29:12.204141+0000","last_peered":"2024-04-19T04:29:12.204141+0000","last_clean":"2024-04-19T04:29:12.204141+0000","last_became_active":"2024-04-19T04:28:02.840839+0000","last_became_peered":"2024-04-19T04:28:02.840839+0000","last_unstale":"2024-04-19T04:29:12.204141+0000","last_undegraded":"2024-04-19T04:29:12.204141+0000","last_fullsized":"2024-04-19T04:29:12.204141+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:12.204121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:12.204121+0000","last_clean_scrub_stamp":"2024-04-19T04:29:12.204121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:20:20.194187+0000","scrub_duration":0.035589924000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481032+0000","last_change":"2024-04-19T04:28:02.635123+0000","last_active":"2024-04-19T04:28:19.481032+0000","last_peered":"2024-04-19T04:28:19.481032+0000","last_clean":"2024-04-19T04:28:19.481032+0000","last_became_active":"2024-04-19T04:28:02.634633+0000","last_became_peered":"2024-04-19T04:28:02.634633+0000","last_unstale":"2024-04-19T04:28:19.481032+0000","last_undegraded":"2024-04-19T04:28:19.481032+0000","last_fullsized":"2024-04-19T04:28:19.481032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481074+0000","last_change":"2024-04-19T04:28:02.638250+0000","last_active":"2024-04-19T04:28:19.481074+0000","last_peered":"2024-04-19T04:28:19.481074+0000","last_clean":"2024-04-19T04:28:19.481074+0000","last_became_active":"2024-04-19T04:28:02.637233+0000","last_became_peered":"2024-04-19T04:28:02.637233+0000","last_unstale":"2024-04-19T04:28:19.481074+0000","last_undegraded":"2024-04-19T04:28:19.481074+0000","last_fullsized":"2024-04-19T04:28:19.481074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:53.216978+0000","last_change":"2024-04-19T04:28:53.217334+0000","last_active":"2024-04-19T04:28:53.216978+0000","last_peered":"2024-04-19T04:28:53.216978+0000","last_clean":"2024-04-19T04:28:53.216978+0000","last_became_active":"2024-04-19T04:28:02.837829+0000","last_became_peered":"2024-04-19T04:28:02.837829+0000","last_unstale":"2024-04-19T04:28:53.216978+0000","last_undegraded":"2024-04-19T04:28:53.216978+0000","last_fullsized":"2024-04-19T04:28:53.216978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:53.216932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:53.216932+0000","last_clean_scrub_stamp":"2024-04-19T04:28:53.216932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:28:52.742878+0000","scrub_duration":0.0032988420000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:12.751225+0000","last_change":"2024-04-19T04:29:12.751447+0000","last_active":"2024-04-19T04:29:12.751225+0000","last_peered":"2024-04-19T04:29:12.751225+0000","last_clean":"2024-04-19T04:29:12.751225+0000","last_became_active":"2024-04-19T04:28:02.634103+0000","last_became_peered":"2024-04-19T04:28:02.634103+0000","last_unstale":"2024-04-19T04:29:12.751225+0000","last_undegraded":"2024-04-19T04:29:12.751225+0000","last_fullsized":"2024-04-19T04:29:12.751225+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:12.751168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:12.751168+0000","last_clean_scrub_stamp":"2024-04-19T04:29:12.751168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:41:03.146894+0000","scrub_duration":0.0031427569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:21.088958+0000","last_change":"2024-04-19T04:29:21.089183+0000","last_active":"2024-04-19T04:29:21.088958+0000","last_peered":"2024-04-19T04:29:21.088958+0000","last_clean":"2024-04-19T04:29:21.088958+0000","last_became_active":"2024-04-19T04:28:02.835057+0000","last_became_peered":"2024-04-19T04:28:02.835057+0000","last_unstale":"2024-04-19T04:29:21.088958+0000","last_undegraded":"2024-04-19T04:29:21.088958+0000","last_fullsized":"2024-04-19T04:29:21.088958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:21.088913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:21.088913+0000","last_clean_scrub_stamp":"2024-04-19T04:29:21.088913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:25:08.459261+0000","scrub_duration":0.0034193980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:12.560395+0000","last_change":"2024-04-19T04:29:12.560617+0000","last_active":"2024-04-19T04:29:12.560395+0000","last_peered":"2024-04-19T04:29:12.560395+0000","last_clean":"2024-04-19T04:29:12.560395+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:29:12.560395+0000","last_undegraded":"2024-04-19T04:29:12.560395+0000","last_fullsized":"2024-04-19T04:29:12.560395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:12.560352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:12.560352+0000","last_clean_scrub_stamp":"2024-04-19T04:29:12.560352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:21.470493+0000","scrub_duration":0.0033970480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:03.073729+0000","last_change":"2024-04-19T04:29:03.074082+0000","last_active":"2024-04-19T04:29:03.073729+0000","last_peered":"2024-04-19T04:29:03.073729+0000","last_clean":"2024-04-19T04:29:03.073729+0000","last_became_active":"2024-04-19T04:28:02.838918+0000","last_became_peered":"2024-04-19T04:28:02.838918+0000","last_unstale":"2024-04-19T04:29:03.073729+0000","last_undegraded":"2024-04-19T04:29:03.073729+0000","last_fullsized":"2024-04-19T04:29:03.073729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:03.073680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:03.073680+0000","last_clean_scrub_stamp":"2024-04-19T04:29:03.073680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:34:04.411572+0000","scrub_duration":0.0031316450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:33.545214+0000","last_change":"2024-04-19T04:29:33.545495+0000","last_active":"2024-04-19T04:29:33.545214+0000","last_peered":"2024-04-19T04:29:33.545214+0000","last_clean":"2024-04-19T04:29:33.545214+0000","last_became_active":"2024-04-19T04:28:12.091609+0000","last_became_peered":"2024-04-19T04:28:12.091609+0000","last_unstale":"2024-04-19T04:29:33.545214+0000","last_undegraded":"2024-04-19T04:29:33.545214+0000","last_fullsized":"2024-04-19T04:29:33.545214+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:33.545166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:33.545166+0000","last_clean_scrub_stamp":"2024-04-19T04:29:33.545166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:30:55.835523+0000","scrub_duration":0.0030524910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:43.453357+0000","last_change":"2024-04-19T04:28:43.453593+0000","last_active":"2024-04-19T04:28:43.453357+0000","last_peered":"2024-04-19T04:28:43.453357+0000","last_clean":"2024-04-19T04:28:43.453357+0000","last_became_active":"2024-04-19T04:28:12.091335+0000","last_became_peered":"2024-04-19T04:28:12.091335+0000","last_unstale":"2024-04-19T04:28:43.453357+0000","last_undegraded":"2024-04-19T04:28:43.453357+0000","last_fullsized":"2024-04-19T04:28:43.453357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:43.453308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:43.453308+0000","last_clean_scrub_stamp":"2024-04-19T04:28:43.453308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:37:50.638133+0000","scrub_duration":0.0032802869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:45.236169+0000","last_change":"2024-04-19T04:28:45.236529+0000","last_active":"2024-04-19T04:28:45.236169+0000","last_peered":"2024-04-19T04:28:45.236169+0000","last_clean":"2024-04-19T04:28:45.236169+0000","last_became_active":"2024-04-19T04:28:02.839883+0000","last_became_peered":"2024-04-19T04:28:02.839883+0000","last_unstale":"2024-04-19T04:28:45.236169+0000","last_undegraded":"2024-04-19T04:28:45.236169+0000","last_fullsized":"2024-04-19T04:28:45.236169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:28:45.236116+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:28:45.236116+0000","last_clean_scrub_stamp":"2024-04-19T04:28:45.236116+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:21.181858+0000","scrub_duration":0.0065909519999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:22.131544+0000","last_change":"2024-04-19T04:29:22.131770+0000","last_active":"2024-04-19T04:29:22.131544+0000","last_peered":"2024-04-19T04:29:22.131544+0000","last_clean":"2024-04-19T04:29:22.131544+0000","last_became_active":"2024-04-19T04:28:02.845256+0000","last_became_peered":"2024-04-19T04:28:02.845256+0000","last_unstale":"2024-04-19T04:29:22.131544+0000","last_undegraded":"2024-04-19T04:29:22.131544+0000","last_fullsized":"2024-04-19T04:29:22.131544+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:22.131495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:22.131495+0000","last_clean_scrub_stamp":"2024-04-19T04:29:22.131495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:58.086230+0000","scrub_duration":0.0032550890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:35.232642+0000","last_change":"2024-04-19T04:28:35.232894+0000","last_active":"2024-04-19T04:28:35.232642+0000","last_peered":"2024-04-19T04:28:35.232642+0000","last_clean":"2024-04-19T04:28:35.232642+0000","last_became_active":"2024-04-19T04:28:02.844128+0000","last_became_peered":"2024-04-19T04:28:02.844128+0000","last_unstale":"2024-04-19T04:28:35.232642+0000","last_undegraded":"2024-04-19T04:28:35.232642+0000","last_fullsized":"2024-04-19T04:28:35.232642+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:35.232595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:35.232595+0000","last_clean_scrub_stamp":"2024-04-19T04:28:35.232595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:17:35.552236+0000","scrub_duration":0.0033160400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"79'2","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:02.113554+0000","last_change":"2024-04-19T04:29:02.113900+0000","last_active":"2024-04-19T04:29:02.113554+0000","last_peered":"2024-04-19T04:29:02.113554+0000","last_clean":"2024-04-19T04:29:02.113554+0000","last_became_active":"2024-04-19T04:28:02.844483+0000","last_became_peered":"2024-04-19T04:28:02.844483+0000","last_unstale":"2024-04-19T04:29:02.113554+0000","last_undegraded":"2024-04-19T04:29:02.113554+0000","last_fullsized":"2024-04-19T04:29:02.113554+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-19T04:29:02.113502+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-19T04:29:02.113502+0000","last_clean_scrub_stamp":"2024-04-19T04:29:02.113502+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:57:58.962870+0000","scrub_duration":0.0066382589999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.480965+0000","last_change":"2024-04-19T04:24:16.144795+0000","last_active":"2024-04-19T04:28:19.480965+0000","last_peered":"2024-04-19T04:28:19.480965+0000","last_clean":"2024-04-19T04:28:19.480965+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:28:19.480965+0000","last_undegraded":"2024-04-19T04:28:19.480965+0000","last_fullsized":"2024-04-19T04:28:19.480965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:15.118479+0000","last_clean_scrub_stamp":"2024-04-19T04:24:15.118479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:03.475770+0000","last_change":"2024-04-19T04:29:03.476086+0000","last_active":"2024-04-19T04:29:03.475770+0000","last_peered":"2024-04-19T04:29:03.475770+0000","last_clean":"2024-04-19T04:29:03.475770+0000","last_became_active":"2024-04-19T04:28:12.088123+0000","last_became_peered":"2024-04-19T04:28:12.088123+0000","last_unstale":"2024-04-19T04:29:03.475770+0000","last_undegraded":"2024-04-19T04:29:03.475770+0000","last_fullsized":"2024-04-19T04:29:03.475770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:03.475686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:03.475686+0000","last_clean_scrub_stamp":"2024-04-19T04:29:03.475686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:48:06.718278+0000","scrub_duration":0.0036698009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:36.624976+0000","last_change":"2024-04-19T04:28:36.624976+0000","last_active":"2024-04-19T04:28:36.624976+0000","last_peered":"2024-04-19T04:28:36.624976+0000","last_clean":"2024-04-19T04:28:36.624976+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:28:36.624976+0000","last_undegraded":"2024-04-19T04:28:36.624976+0000","last_fullsized":"2024-04-19T04:28:36.624976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:36.624618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:36.624618+0000","last_clean_scrub_stamp":"2024-04-19T04:28:36.624618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:45.570664+0000","scrub_duration":0.0035750109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"79'10","reported_seq":95,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:56.750060+0000","last_change":"2024-04-19T04:28:56.750060+0000","last_active":"2024-04-19T04:28:56.750060+0000","last_peered":"2024-04-19T04:28:56.750060+0000","last_clean":"2024-04-19T04:28:56.750060+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:28:56.750060+0000","last_undegraded":"2024-04-19T04:28:56.750060+0000","last_fullsized":"2024-04-19T04:28:56.750060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-04-19T04:28:56.749717+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-04-19T04:28:56.749717+0000","last_clean_scrub_stamp":"2024-04-19T04:28:56.749717+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:09:09.583526+0000","scrub_duration":0.010036193000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:23.193351+0000","last_change":"2024-04-19T04:28:23.193584+0000","last_active":"2024-04-19T04:28:23.193351+0000","last_peered":"2024-04-19T04:28:23.193351+0000","last_clean":"2024-04-19T04:28:23.193351+0000","last_became_active":"2024-04-19T04:28:02.841373+0000","last_became_peered":"2024-04-19T04:28:02.841373+0000","last_unstale":"2024-04-19T04:28:23.193351+0000","last_undegraded":"2024-04-19T04:28:23.193351+0000","last_fullsized":"2024-04-19T04:28:23.193351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:23.193301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:23.193301+0000","last_clean_scrub_stamp":"2024-04-19T04:28:23.193301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:26.999877+0000","scrub_duration":0.0032212959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"79'5","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:32.522683+0000","last_change":"2024-04-19T04:29:32.523001+0000","last_active":"2024-04-19T04:29:32.522683+0000","last_peered":"2024-04-19T04:29:32.522683+0000","last_clean":"2024-04-19T04:29:32.522683+0000","last_became_active":"2024-04-19T04:28:12.092784+0000","last_became_peered":"2024-04-19T04:28:12.092784+0000","last_unstale":"2024-04-19T04:29:32.522683+0000","last_undegraded":"2024-04-19T04:29:32.522683+0000","last_fullsized":"2024-04-19T04:29:32.522683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-04-19T04:29:32.522633+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-04-19T04:29:32.522633+0000","last_clean_scrub_stamp":"2024-04-19T04:29:32.522633+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:41:22.918360+0000","scrub_duration":0.0090059019999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:09.746871+0000","last_change":"2024-04-19T04:29:09.746871+0000","last_active":"2024-04-19T04:29:09.746871+0000","last_peered":"2024-04-19T04:29:09.746871+0000","last_clean":"2024-04-19T04:29:09.746871+0000","last_became_active":"2024-04-19T04:28:02.638431+0000","last_became_peered":"2024-04-19T04:28:02.638431+0000","last_unstale":"2024-04-19T04:29:09.746871+0000","last_undegraded":"2024-04-19T04:29:09.746871+0000","last_fullsized":"2024-04-19T04:29:09.746871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:09.746554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:09.746554+0000","last_clean_scrub_stamp":"2024-04-19T04:29:09.746554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:33.403481+0000","scrub_duration":0.0034424270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:27.190673+0000","last_change":"2024-04-19T04:28:27.190910+0000","last_active":"2024-04-19T04:28:27.190673+0000","last_peered":"2024-04-19T04:28:27.190673+0000","last_clean":"2024-04-19T04:28:27.190673+0000","last_became_active":"2024-04-19T04:28:02.838354+0000","last_became_peered":"2024-04-19T04:28:02.838354+0000","last_unstale":"2024-04-19T04:28:27.190673+0000","last_undegraded":"2024-04-19T04:28:27.190673+0000","last_fullsized":"2024-04-19T04:28:27.190673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:27.190624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:27.190624+0000","last_clean_scrub_stamp":"2024-04-19T04:28:27.190624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:58:16.070118+0000","scrub_duration":0.003493987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:32.130199+0000","last_change":"2024-04-19T04:29:32.130571+0000","last_active":"2024-04-19T04:29:32.130199+0000","last_peered":"2024-04-19T04:29:32.130199+0000","last_clean":"2024-04-19T04:29:32.130199+0000","last_became_active":"2024-04-19T04:28:02.837994+0000","last_became_peered":"2024-04-19T04:28:02.837994+0000","last_unstale":"2024-04-19T04:29:32.130199+0000","last_undegraded":"2024-04-19T04:29:32.130199+0000","last_fullsized":"2024-04-19T04:29:32.130199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:32.130153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:32.130153+0000","last_clean_scrub_stamp":"2024-04-19T04:29:32.130153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:49.717986+0000","scrub_duration":0.003549759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:10.206873+0000","last_change":"2024-04-19T04:29:10.207103+0000","last_active":"2024-04-19T04:29:10.206873+0000","last_peered":"2024-04-19T04:29:10.206873+0000","last_clean":"2024-04-19T04:29:10.206873+0000","last_became_active":"2024-04-19T04:28:02.836818+0000","last_became_peered":"2024-04-19T04:28:02.836818+0000","last_unstale":"2024-04-19T04:29:10.206873+0000","last_undegraded":"2024-04-19T04:29:10.206873+0000","last_fullsized":"2024-04-19T04:29:10.206873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:10.206828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:10.206828+0000","last_clean_scrub_stamp":"2024-04-19T04:29:10.206828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:22:40.805733+0000","scrub_duration":0.0031759570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:07.525931+0000","last_change":"2024-04-19T04:29:07.526047+0000","last_active":"2024-04-19T04:29:07.525931+0000","last_peered":"2024-04-19T04:29:07.525931+0000","last_clean":"2024-04-19T04:29:07.525931+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:29:07.525931+0000","last_undegraded":"2024-04-19T04:29:07.525931+0000","last_fullsized":"2024-04-19T04:29:07.525931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:07.525913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:07.525913+0000","last_clean_scrub_stamp":"2024-04-19T04:29:07.525913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:34.284515+0000","scrub_duration":0.089503928999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:09.192639+0000","last_change":"2024-04-19T04:29:09.192879+0000","last_active":"2024-04-19T04:29:09.192639+0000","last_peered":"2024-04-19T04:29:09.192639+0000","last_clean":"2024-04-19T04:29:09.192639+0000","last_became_active":"2024-04-19T04:28:02.837400+0000","last_became_peered":"2024-04-19T04:28:02.837400+0000","last_unstale":"2024-04-19T04:29:09.192639+0000","last_undegraded":"2024-04-19T04:29:09.192639+0000","last_fullsized":"2024-04-19T04:29:09.192639+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:09.192594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:09.192594+0000","last_clean_scrub_stamp":"2024-04-19T04:29:09.192594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:24:09.830565+0000","scrub_duration":0.0033446000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:51.216552+0000","last_change":"2024-04-19T04:28:51.216788+0000","last_active":"2024-04-19T04:28:51.216552+0000","last_peered":"2024-04-19T04:28:51.216552+0000","last_clean":"2024-04-19T04:28:51.216552+0000","last_became_active":"2024-04-19T04:28:02.844057+0000","last_became_peered":"2024-04-19T04:28:02.844057+0000","last_unstale":"2024-04-19T04:28:51.216552+0000","last_undegraded":"2024-04-19T04:28:51.216552+0000","last_fullsized":"2024-04-19T04:28:51.216552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:51.216503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:51.216503+0000","last_clean_scrub_stamp":"2024-04-19T04:28:51.216503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:47:11.830384+0000","scrub_duration":0.003421365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:47.243501+0000","last_change":"2024-04-19T04:28:47.243752+0000","last_active":"2024-04-19T04:28:47.243501+0000","last_peered":"2024-04-19T04:28:47.243501+0000","last_clean":"2024-04-19T04:28:47.243501+0000","last_became_active":"2024-04-19T04:28:02.836492+0000","last_became_peered":"2024-04-19T04:28:02.836492+0000","last_unstale":"2024-04-19T04:28:47.243501+0000","last_undegraded":"2024-04-19T04:28:47.243501+0000","last_fullsized":"2024-04-19T04:28:47.243501+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:47.243453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:47.243453+0000","last_clean_scrub_stamp":"2024-04-19T04:28:47.243453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:57:57.196537+0000","scrub_duration":0.003301942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:52.410116+0000","last_change":"2024-04-19T04:28:52.410331+0000","last_active":"2024-04-19T04:28:52.410116+0000","last_peered":"2024-04-19T04:28:52.410116+0000","last_clean":"2024-04-19T04:28:52.410116+0000","last_became_active":"2024-04-19T04:28:12.095332+0000","last_became_peered":"2024-04-19T04:28:12.095332+0000","last_unstale":"2024-04-19T04:28:52.410116+0000","last_undegraded":"2024-04-19T04:28:52.410116+0000","last_fullsized":"2024-04-19T04:28:52.410116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:52.410070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:52.410070+0000","last_clean_scrub_stamp":"2024-04-19T04:28:52.410070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:41.851489+0000","scrub_duration":0.003375528,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":82,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:37.501685+0000","last_change":"2024-04-19T04:28:37.501685+0000","last_active":"2024-04-19T04:28:37.501685+0000","last_peered":"2024-04-19T04:28:37.501685+0000","last_clean":"2024-04-19T04:28:37.501685+0000","last_became_active":"2024-04-19T04:28:12.090262+0000","last_became_peered":"2024-04-19T04:28:12.090262+0000","last_unstale":"2024-04-19T04:28:37.501685+0000","last_undegraded":"2024-04-19T04:28:37.501685+0000","last_fullsized":"2024-04-19T04:28:37.501685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-19T04:28:37.501393+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-19T04:28:37.501393+0000","last_clean_scrub_stamp":"2024-04-19T04:28:37.501393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:00:31.892502+0000","scrub_duration":0.0035120720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:33.511683+0000","last_change":"2024-04-19T04:28:33.511683+0000","last_active":"2024-04-19T04:28:33.511683+0000","last_peered":"2024-04-19T04:28:33.511683+0000","last_clean":"2024-04-19T04:28:33.511683+0000","last_became_active":"2024-04-19T04:28:12.092979+0000","last_became_peered":"2024-04-19T04:28:12.092979+0000","last_unstale":"2024-04-19T04:28:33.511683+0000","last_undegraded":"2024-04-19T04:28:33.511683+0000","last_fullsized":"2024-04-19T04:28:33.511683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:33.511357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:33.511357+0000","last_clean_scrub_stamp":"2024-04-19T04:28:33.511357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:09:11.578221+0000","scrub_duration":0.0033778150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":44,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:36.522753+0000","last_change":"2024-04-19T04:28:36.523143+0000","last_active":"2024-04-19T04:28:36.522753+0000","last_peered":"2024-04-19T04:28:36.522753+0000","last_clean":"2024-04-19T04:28:36.522753+0000","last_became_active":"2024-04-19T04:28:12.093915+0000","last_became_peered":"2024-04-19T04:28:12.093915+0000","last_unstale":"2024-04-19T04:28:36.522753+0000","last_undegraded":"2024-04-19T04:28:36.522753+0000","last_fullsized":"2024-04-19T04:28:36.522753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-19T04:28:36.522650+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-19T04:28:36.522650+0000","last_clean_scrub_stamp":"2024-04-19T04:28:36.522650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:16.283397+0000","scrub_duration":0.0035824300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481476+0000","last_change":"2024-04-19T04:28:02.639054+0000","last_active":"2024-04-19T04:28:19.481476+0000","last_peered":"2024-04-19T04:28:19.481476+0000","last_clean":"2024-04-19T04:28:19.481476+0000","last_became_active":"2024-04-19T04:28:02.637952+0000","last_became_peered":"2024-04-19T04:28:02.637952+0000","last_unstale":"2024-04-19T04:28:19.481476+0000","last_undegraded":"2024-04-19T04:28:19.481476+0000","last_fullsized":"2024-04-19T04:28:19.481476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"79'3","reported_seq":101,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:42.733097+0000","last_change":"2024-04-19T04:28:42.733097+0000","last_active":"2024-04-19T04:28:42.733097+0000","last_peered":"2024-04-19T04:28:42.733097+0000","last_clean":"2024-04-19T04:28:42.733097+0000","last_became_active":"2024-04-19T04:28:02.634226+0000","last_became_peered":"2024-04-19T04:28:02.634226+0000","last_unstale":"2024-04-19T04:28:42.733097+0000","last_undegraded":"2024-04-19T04:28:42.733097+0000","last_fullsized":"2024-04-19T04:28:42.733097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:28:42.732789+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:28:42.732789+0000","last_clean_scrub_stamp":"2024-04-19T04:28:42.732789+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:39.702938+0000","scrub_duration":0.0066219249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:52.772390+0000","last_change":"2024-04-19T04:28:52.772390+0000","last_active":"2024-04-19T04:28:52.772390+0000","last_peered":"2024-04-19T04:28:52.772390+0000","last_clean":"2024-04-19T04:28:52.772390+0000","last_became_active":"2024-04-19T04:28:02.636266+0000","last_became_peered":"2024-04-19T04:28:02.636266+0000","last_unstale":"2024-04-19T04:28:52.772390+0000","last_undegraded":"2024-04-19T04:28:52.772390+0000","last_fullsized":"2024-04-19T04:28:52.772390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:52.772052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:52.772052+0000","last_clean_scrub_stamp":"2024-04-19T04:28:52.772052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:04.600653+0000","scrub_duration":0.0038532319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":46,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:21.482224+0000","last_change":"2024-04-19T04:29:21.482465+0000","last_active":"2024-04-19T04:29:21.482224+0000","last_peered":"2024-04-19T04:29:21.482224+0000","last_clean":"2024-04-19T04:29:21.482224+0000","last_became_active":"2024-04-19T04:28:12.095199+0000","last_became_peered":"2024-04-19T04:28:12.095199+0000","last_unstale":"2024-04-19T04:29:21.482224+0000","last_undegraded":"2024-04-19T04:29:21.482224+0000","last_fullsized":"2024-04-19T04:29:21.482224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:29:21.482172+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:29:21.482172+0000","last_clean_scrub_stamp":"2024-04-19T04:29:21.482172+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:21:18.491797+0000","scrub_duration":0.0063630429999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:25.498372+0000","last_change":"2024-04-19T04:29:25.498645+0000","last_active":"2024-04-19T04:29:25.498372+0000","last_peered":"2024-04-19T04:29:25.498372+0000","last_clean":"2024-04-19T04:29:25.498372+0000","last_became_active":"2024-04-19T04:28:12.087884+0000","last_became_peered":"2024-04-19T04:28:12.087884+0000","last_unstale":"2024-04-19T04:29:25.498372+0000","last_undegraded":"2024-04-19T04:29:25.498372+0000","last_fullsized":"2024-04-19T04:29:25.498372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:25.498329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:25.498329+0000","last_clean_scrub_stamp":"2024-04-19T04:29:25.498329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:19.741127+0000","scrub_duration":0.019490397999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303600+0000","last_change":"2024-04-19T04:28:02.846538+0000","last_active":"2024-04-19T04:28:13.303600+0000","last_peered":"2024-04-19T04:28:13.303600+0000","last_clean":"2024-04-19T04:28:13.303600+0000","last_became_active":"2024-04-19T04:28:02.846234+0000","last_became_peered":"2024-04-19T04:28:02.846234+0000","last_unstale":"2024-04-19T04:28:13.303600+0000","last_undegraded":"2024-04-19T04:28:13.303600+0000","last_fullsized":"2024-04-19T04:28:13.303600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:41.739248+0000","last_change":"2024-04-19T04:28:41.739248+0000","last_active":"2024-04-19T04:28:41.739248+0000","last_peered":"2024-04-19T04:28:41.739248+0000","last_clean":"2024-04-19T04:28:41.739248+0000","last_became_active":"2024-04-19T04:28:02.634433+0000","last_became_peered":"2024-04-19T04:28:02.634433+0000","last_unstale":"2024-04-19T04:28:41.739248+0000","last_undegraded":"2024-04-19T04:28:41.739248+0000","last_fullsized":"2024-04-19T04:28:41.739248+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:41.738950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:41.738950+0000","last_clean_scrub_stamp":"2024-04-19T04:28:41.738950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:20.301173+0000","scrub_duration":0.0033981039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:13.303822+0000","last_change":"2024-04-19T04:28:02.844897+0000","last_active":"2024-04-19T04:28:13.303822+0000","last_peered":"2024-04-19T04:28:13.303822+0000","last_clean":"2024-04-19T04:28:13.303822+0000","last_became_active":"2024-04-19T04:28:02.844276+0000","last_became_peered":"2024-04-19T04:28:02.844276+0000","last_unstale":"2024-04-19T04:28:13.303822+0000","last_undegraded":"2024-04-19T04:28:13.303822+0000","last_fullsized":"2024-04-19T04:28:13.303822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:19.147033+0000","last_clean_scrub_stamp":"2024-04-19T04:24:19.147033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705735,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220708,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151132,"statfs":{"total":96636764160,"available":96410759168,"internally_reserved":0,"allocated":946176,"data_stored":926258,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 04:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.74399999999999999},"min":{"1min":0.51300000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.77900000000000003,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.59399999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.84299999999999997,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.77800000000000002}]},{"osd":1,"last update":"Fri Apr 19 04:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69099999999999995}]}]},{"osd":1,"up_from":72,"seq":309237645334,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44116,"kb_used_data":844,"kb_used_omap":6,"kb_used_meta":43257,"kb_avail":94327724,"statfs":{"total":96636764160,"available":96591589376,"internally_reserved":0,"allocated":864256,"data_stored":334760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6880,"internal_metadata":44295456},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 04:29:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.64600000000000002}]},{"osd":2,"last update":"Fri Apr 19 04:29:01 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.752}]}]},{"osd":0,"up_from":9,"seq":38654705735,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298664,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297726,"kb_avail":94073176,"statfs":{"total":96636764160,"available":96330932224,"internally_reserved":0,"allocated":950272,"data_stored":924740,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":304871878},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 04:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Fri Apr 19 04:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.62,"15min":0.61399999999999999},"min":{"1min":0.58399999999999996,"5min":0.223,"15min":0.223},"max":{"1min":0.83899999999999997,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.628,"15min":0.77900000000000003},"min":{"1min":0.57699999999999996,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.86099999999999999,"5min":4.5,"15min":4.5},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:29:42.271 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:42.272 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:42.272 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:42.272 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:42.272 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:42.272 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:42.272 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:42.273 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:42.273 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:42.273 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:42.273 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:42.273 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:42.274 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:42.274 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-19T04:24:15.118479+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=15, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:42.274 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:42.274 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:42.275 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-19T04:24:19.147033+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:29:42.275 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T04:30:02.276 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:30:02.597 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:30:02.600 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:30:02.614 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-04-19T04:30:01.024911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":563488,"kb_used_data":2696,"kb_used_omap":9,"kb_used_meta":560758,"kb_avail":282552032,"statfs":{"total":289910292480,"available":289333280768,"internally_reserved":0,"allocated":2760704,"data_stored":2185758,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":10068,"internal_metadata":574216364},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004458"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:24.524670+0000","last_change":"2024-04-19T04:28:24.524670+0000","last_active":"2024-04-19T04:28:24.524670+0000","last_peered":"2024-04-19T04:28:24.524670+0000","last_clean":"2024-04-19T04:28:24.524670+0000","last_became_active":"2024-04-19T04:28:12.093175+0000","last_became_peered":"2024-04-19T04:28:12.093175+0000","last_unstale":"2024-04-19T04:28:24.524670+0000","last_undegraded":"2024-04-19T04:28:24.524670+0000","last_fullsized":"2024-04-19T04:28:24.524670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:24.524536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:24.524536+0000","last_clean_scrub_stamp":"2024-04-19T04:28:24.524536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:34:39.154898+0000","scrub_duration":0.080942869000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:25.440827+0000","last_change":"2024-04-19T04:28:25.440827+0000","last_active":"2024-04-19T04:28:25.440827+0000","last_peered":"2024-04-19T04:28:25.440827+0000","last_clean":"2024-04-19T04:28:25.440827+0000","last_became_active":"2024-04-19T04:28:12.092819+0000","last_became_peered":"2024-04-19T04:28:12.092819+0000","last_unstale":"2024-04-19T04:28:25.440827+0000","last_undegraded":"2024-04-19T04:28:25.440827+0000","last_fullsized":"2024-04-19T04:28:25.440827+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:25.440548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:25.440548+0000","last_clean_scrub_stamp":"2024-04-19T04:28:25.440548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:40.485315+0000","scrub_duration":0.0035723539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481982+0000","last_change":"2024-04-19T04:24:20.556199+0000","last_active":"2024-04-19T04:28:19.481982+0000","last_peered":"2024-04-19T04:28:19.481982+0000","last_clean":"2024-04-19T04:28:19.481982+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:28:19.481982+0000","last_undegraded":"2024-04-19T04:28:19.481982+0000","last_fullsized":"2024-04-19T04:28:19.481982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481947+0000","last_change":"2024-04-19T04:28:02.635437+0000","last_active":"2024-04-19T04:28:19.481947+0000","last_peered":"2024-04-19T04:28:19.481947+0000","last_clean":"2024-04-19T04:28:19.481947+0000","last_became_active":"2024-04-19T04:28:02.634355+0000","last_became_peered":"2024-04-19T04:28:02.634355+0000","last_unstale":"2024-04-19T04:28:19.481947+0000","last_undegraded":"2024-04-19T04:28:19.481947+0000","last_fullsized":"2024-04-19T04:28:19.481947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:34.505005+0000","last_change":"2024-04-19T04:28:34.505005+0000","last_active":"2024-04-19T04:28:34.505005+0000","last_peered":"2024-04-19T04:28:34.505005+0000","last_clean":"2024-04-19T04:28:34.505005+0000","last_became_active":"2024-04-19T04:28:12.088231+0000","last_became_peered":"2024-04-19T04:28:12.088231+0000","last_unstale":"2024-04-19T04:28:34.505005+0000","last_undegraded":"2024-04-19T04:28:34.505005+0000","last_fullsized":"2024-04-19T04:28:34.505005+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:34.504692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:34.504692+0000","last_clean_scrub_stamp":"2024-04-19T04:28:34.504692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:54:14.305698+0000","scrub_duration":0.021028397000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481959+0000","last_change":"2024-04-19T04:28:02.637742+0000","last_active":"2024-04-19T04:28:19.481959+0000","last_peered":"2024-04-19T04:28:19.481959+0000","last_clean":"2024-04-19T04:28:19.481959+0000","last_became_active":"2024-04-19T04:28:02.637276+0000","last_became_peered":"2024-04-19T04:28:02.637276+0000","last_unstale":"2024-04-19T04:28:19.481959+0000","last_undegraded":"2024-04-19T04:28:19.481959+0000","last_fullsized":"2024-04-19T04:28:19.481959+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:39.760873+0000","last_change":"2024-04-19T04:28:39.760873+0000","last_active":"2024-04-19T04:28:39.760873+0000","last_peered":"2024-04-19T04:28:39.760873+0000","last_clean":"2024-04-19T04:28:39.760873+0000","last_became_active":"2024-04-19T04:28:02.637086+0000","last_became_peered":"2024-04-19T04:28:02.637086+0000","last_unstale":"2024-04-19T04:28:39.760873+0000","last_undegraded":"2024-04-19T04:28:39.760873+0000","last_fullsized":"2024-04-19T04:28:39.760873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:39.760588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:39.760588+0000","last_clean_scrub_stamp":"2024-04-19T04:28:39.760588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:47:43.003181+0000","scrub_duration":0.020879537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.482078+0000","last_change":"2024-04-19T04:28:02.638186+0000","last_active":"2024-04-19T04:28:19.482078+0000","last_peered":"2024-04-19T04:28:19.482078+0000","last_clean":"2024-04-19T04:28:19.482078+0000","last_became_active":"2024-04-19T04:28:02.637746+0000","last_became_peered":"2024-04-19T04:28:02.637746+0000","last_unstale":"2024-04-19T04:28:19.482078+0000","last_undegraded":"2024-04-19T04:28:19.482078+0000","last_fullsized":"2024-04-19T04:28:19.482078+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:30.172464+0000","last_change":"2024-04-19T04:29:30.172655+0000","last_active":"2024-04-19T04:29:30.172464+0000","last_peered":"2024-04-19T04:29:30.172464+0000","last_clean":"2024-04-19T04:29:30.172464+0000","last_became_active":"2024-04-19T04:28:02.839203+0000","last_became_peered":"2024-04-19T04:28:02.839203+0000","last_unstale":"2024-04-19T04:29:30.172464+0000","last_undegraded":"2024-04-19T04:29:30.172464+0000","last_fullsized":"2024-04-19T04:29:30.172464+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:30.172421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:30.172421+0000","last_clean_scrub_stamp":"2024-04-19T04:29:30.172421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:42:16.051310+0000","scrub_duration":0.031415525999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:19.483877+0000","last_change":"2024-04-19T04:29:19.484216+0000","last_active":"2024-04-19T04:29:19.483877+0000","last_peered":"2024-04-19T04:29:19.483877+0000","last_clean":"2024-04-19T04:29:19.483877+0000","last_became_active":"2024-04-19T04:28:12.092924+0000","last_became_peered":"2024-04-19T04:28:12.092924+0000","last_unstale":"2024-04-19T04:29:19.483877+0000","last_undegraded":"2024-04-19T04:29:19.483877+0000","last_fullsized":"2024-04-19T04:29:19.483877+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:19.483790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:19.483790+0000","last_clean_scrub_stamp":"2024-04-19T04:29:19.483790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:54.022997+0000","scrub_duration":0.0033506920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481896+0000","last_change":"2024-04-19T04:28:02.636293+0000","last_active":"2024-04-19T04:28:19.481896+0000","last_peered":"2024-04-19T04:28:19.481896+0000","last_clean":"2024-04-19T04:28:19.481896+0000","last_became_active":"2024-04-19T04:28:02.635946+0000","last_became_peered":"2024-04-19T04:28:02.635946+0000","last_unstale":"2024-04-19T04:28:19.481896+0000","last_undegraded":"2024-04-19T04:28:19.481896+0000","last_fullsized":"2024-04-19T04:28:19.481896+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:35.526927+0000","last_change":"2024-04-19T04:28:35.527163+0000","last_active":"2024-04-19T04:28:35.526927+0000","last_peered":"2024-04-19T04:28:35.526927+0000","last_clean":"2024-04-19T04:28:35.526927+0000","last_became_active":"2024-04-19T04:28:12.094753+0000","last_became_peered":"2024-04-19T04:28:12.094753+0000","last_unstale":"2024-04-19T04:28:35.526927+0000","last_undegraded":"2024-04-19T04:28:35.526927+0000","last_fullsized":"2024-04-19T04:28:35.526927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:35.526884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:35.526884+0000","last_clean_scrub_stamp":"2024-04-19T04:28:35.526884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:06:35.618252+0000","scrub_duration":0.0031760289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:47.475887+0000","last_change":"2024-04-19T04:28:47.475887+0000","last_active":"2024-04-19T04:28:47.475887+0000","last_peered":"2024-04-19T04:28:47.475887+0000","last_clean":"2024-04-19T04:28:47.475887+0000","last_became_active":"2024-04-19T04:28:12.093267+0000","last_became_peered":"2024-04-19T04:28:12.093267+0000","last_unstale":"2024-04-19T04:28:47.475887+0000","last_undegraded":"2024-04-19T04:28:47.475887+0000","last_fullsized":"2024-04-19T04:28:47.475887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:47.475618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:47.475618+0000","last_clean_scrub_stamp":"2024-04-19T04:28:47.475618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:37.519624+0000","scrub_duration":0.022523944000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:23.449786+0000","last_change":"2024-04-19T04:28:23.449786+0000","last_active":"2024-04-19T04:28:23.449786+0000","last_peered":"2024-04-19T04:28:23.449786+0000","last_clean":"2024-04-19T04:28:23.449786+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:28:23.449786+0000","last_undegraded":"2024-04-19T04:28:23.449786+0000","last_fullsized":"2024-04-19T04:28:23.449786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:23.449500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:23.449500+0000","last_clean_scrub_stamp":"2024-04-19T04:28:23.449500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:20.102454+0000","scrub_duration":0.0033193469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481810+0000","last_change":"2024-04-19T04:24:20.551809+0000","last_active":"2024-04-19T04:28:19.481810+0000","last_peered":"2024-04-19T04:28:19.481810+0000","last_clean":"2024-04-19T04:28:19.481810+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:28:19.481810+0000","last_undegraded":"2024-04-19T04:28:19.481810+0000","last_fullsized":"2024-04-19T04:28:19.481810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:33.597905+0000","last_change":"2024-04-19T04:28:33.597905+0000","last_active":"2024-04-19T04:28:33.597905+0000","last_peered":"2024-04-19T04:28:33.597905+0000","last_clean":"2024-04-19T04:28:33.597905+0000","last_became_active":"2024-04-19T04:28:02.637920+0000","last_became_peered":"2024-04-19T04:28:02.637920+0000","last_unstale":"2024-04-19T04:28:33.597905+0000","last_undegraded":"2024-04-19T04:28:33.597905+0000","last_fullsized":"2024-04-19T04:28:33.597905+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:33.597411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:33.597411+0000","last_clean_scrub_stamp":"2024-04-19T04:28:33.597411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:50.250390+0000","scrub_duration":0.0037610339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:42.236628+0000","last_change":"2024-04-19T04:28:42.236755+0000","last_active":"2024-04-19T04:28:42.236628+0000","last_peered":"2024-04-19T04:28:42.236628+0000","last_clean":"2024-04-19T04:28:42.236628+0000","last_became_active":"2024-04-19T04:28:02.839071+0000","last_became_peered":"2024-04-19T04:28:02.839071+0000","last_unstale":"2024-04-19T04:28:42.236628+0000","last_undegraded":"2024-04-19T04:28:42.236628+0000","last_fullsized":"2024-04-19T04:28:42.236628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:42.236604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:42.236604+0000","last_clean_scrub_stamp":"2024-04-19T04:28:42.236604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:47:48.663058+0000","scrub_duration":0.070531359000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:06.456011+0000","last_change":"2024-04-19T04:29:06.456366+0000","last_active":"2024-04-19T04:29:06.456011+0000","last_peered":"2024-04-19T04:29:06.456011+0000","last_clean":"2024-04-19T04:29:06.456011+0000","last_became_active":"2024-04-19T04:28:02.638230+0000","last_became_peered":"2024-04-19T04:28:02.638230+0000","last_unstale":"2024-04-19T04:29:06.456011+0000","last_undegraded":"2024-04-19T04:29:06.456011+0000","last_fullsized":"2024-04-19T04:29:06.456011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:06.455968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:06.455968+0000","last_clean_scrub_stamp":"2024-04-19T04:29:06.455968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:03.426117+0000","scrub_duration":0.0030903710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:31.226313+0000","last_change":"2024-04-19T04:28:31.226446+0000","last_active":"2024-04-19T04:28:31.226313+0000","last_peered":"2024-04-19T04:28:31.226313+0000","last_clean":"2024-04-19T04:28:31.226313+0000","last_became_active":"2024-04-19T04:28:02.839362+0000","last_became_peered":"2024-04-19T04:28:02.839362+0000","last_unstale":"2024-04-19T04:28:31.226313+0000","last_undegraded":"2024-04-19T04:28:31.226313+0000","last_fullsized":"2024-04-19T04:28:31.226313+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:31.226291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:31.226291+0000","last_clean_scrub_stamp":"2024-04-19T04:28:31.226291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:43:05.235533+0000","scrub_duration":0.029412667999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:28.516191+0000","last_change":"2024-04-19T04:28:28.516191+0000","last_active":"2024-04-19T04:28:28.516191+0000","last_peered":"2024-04-19T04:28:28.516191+0000","last_clean":"2024-04-19T04:28:28.516191+0000","last_became_active":"2024-04-19T04:28:02.634835+0000","last_became_peered":"2024-04-19T04:28:02.634835+0000","last_unstale":"2024-04-19T04:28:28.516191+0000","last_undegraded":"2024-04-19T04:28:28.516191+0000","last_fullsized":"2024-04-19T04:28:28.516191+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:28.515710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:28.515710+0000","last_clean_scrub_stamp":"2024-04-19T04:28:28.515710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:46.923636+0000","scrub_duration":0.0034446709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:10.768430+0000","last_change":"2024-04-19T04:29:10.768757+0000","last_active":"2024-04-19T04:29:10.768430+0000","last_peered":"2024-04-19T04:29:10.768430+0000","last_clean":"2024-04-19T04:29:10.768430+0000","last_became_active":"2024-04-19T04:28:02.638546+0000","last_became_peered":"2024-04-19T04:28:02.638546+0000","last_unstale":"2024-04-19T04:29:10.768430+0000","last_undegraded":"2024-04-19T04:29:10.768430+0000","last_fullsized":"2024-04-19T04:29:10.768430+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:10.768364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:10.768364+0000","last_clean_scrub_stamp":"2024-04-19T04:29:10.768364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:36.009796+0000","scrub_duration":0.042629556999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:49.435023+0000","last_change":"2024-04-19T04:28:49.435301+0000","last_active":"2024-04-19T04:28:49.435023+0000","last_peered":"2024-04-19T04:28:49.435023+0000","last_clean":"2024-04-19T04:28:49.435023+0000","last_became_active":"2024-04-19T04:28:12.087571+0000","last_became_peered":"2024-04-19T04:28:12.087571+0000","last_unstale":"2024-04-19T04:28:49.435023+0000","last_undegraded":"2024-04-19T04:28:49.435023+0000","last_fullsized":"2024-04-19T04:28:49.435023+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:49.434979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:49.434979+0000","last_clean_scrub_stamp":"2024-04-19T04:28:49.434979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:46.111742+0000","scrub_duration":0.003316786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:34.194332+0000","last_change":"2024-04-19T04:28:34.194663+0000","last_active":"2024-04-19T04:28:34.194332+0000","last_peered":"2024-04-19T04:28:34.194332+0000","last_clean":"2024-04-19T04:28:34.194332+0000","last_became_active":"2024-04-19T04:28:02.840294+0000","last_became_peered":"2024-04-19T04:28:02.840294+0000","last_unstale":"2024-04-19T04:28:34.194332+0000","last_undegraded":"2024-04-19T04:28:34.194332+0000","last_fullsized":"2024-04-19T04:28:34.194332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:34.194285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:34.194285+0000","last_clean_scrub_stamp":"2024-04-19T04:28:34.194285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:53:04.918350+0000","scrub_duration":0.0033717299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:18.460467+0000","last_change":"2024-04-19T04:29:18.460690+0000","last_active":"2024-04-19T04:29:18.460467+0000","last_peered":"2024-04-19T04:29:18.460467+0000","last_clean":"2024-04-19T04:29:18.460467+0000","last_became_active":"2024-04-19T04:28:12.089918+0000","last_became_peered":"2024-04-19T04:28:12.089918+0000","last_unstale":"2024-04-19T04:29:18.460467+0000","last_undegraded":"2024-04-19T04:29:18.460467+0000","last_fullsized":"2024-04-19T04:29:18.460467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:18.460425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:18.460425+0000","last_clean_scrub_stamp":"2024-04-19T04:29:18.460425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:09:31.294234+0000","scrub_duration":0.0033207029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:29.524463+0000","last_change":"2024-04-19T04:29:29.524562+0000","last_active":"2024-04-19T04:29:29.524463+0000","last_peered":"2024-04-19T04:29:29.524463+0000","last_clean":"2024-04-19T04:29:29.524463+0000","last_became_active":"2024-04-19T04:28:12.091770+0000","last_became_peered":"2024-04-19T04:28:12.091770+0000","last_unstale":"2024-04-19T04:29:29.524463+0000","last_undegraded":"2024-04-19T04:29:29.524463+0000","last_fullsized":"2024-04-19T04:29:29.524463+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:29.524443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:29.524443+0000","last_clean_scrub_stamp":"2024-04-19T04:29:29.524443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:53.181371+0000","scrub_duration":0.054287891999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:31.121661+0000","last_change":"2024-04-19T04:29:31.122032+0000","last_active":"2024-04-19T04:29:31.121661+0000","last_peered":"2024-04-19T04:29:31.121661+0000","last_clean":"2024-04-19T04:29:31.121661+0000","last_became_active":"2024-04-19T04:28:02.845416+0000","last_became_peered":"2024-04-19T04:28:02.845416+0000","last_unstale":"2024-04-19T04:29:31.121661+0000","last_undegraded":"2024-04-19T04:29:31.121661+0000","last_fullsized":"2024-04-19T04:29:31.121661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:31.121613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:31.121613+0000","last_clean_scrub_stamp":"2024-04-19T04:29:31.121613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:10:28.928808+0000","scrub_duration":0.0037616049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481739+0000","last_change":"2024-04-19T04:24:20.554885+0000","last_active":"2024-04-19T04:28:19.481739+0000","last_peered":"2024-04-19T04:28:19.481739+0000","last_clean":"2024-04-19T04:28:19.481739+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:28:19.481739+0000","last_undegraded":"2024-04-19T04:28:19.481739+0000","last_fullsized":"2024-04-19T04:28:19.481739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:00.393690+0000","last_change":"2024-04-19T04:29:00.393991+0000","last_active":"2024-04-19T04:29:00.393690+0000","last_peered":"2024-04-19T04:29:00.393690+0000","last_clean":"2024-04-19T04:29:00.393690+0000","last_became_active":"2024-04-19T04:28:12.091969+0000","last_became_peered":"2024-04-19T04:28:12.091969+0000","last_unstale":"2024-04-19T04:29:00.393690+0000","last_undegraded":"2024-04-19T04:29:00.393690+0000","last_fullsized":"2024-04-19T04:29:00.393690+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:00.393643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:00.393643+0000","last_clean_scrub_stamp":"2024-04-19T04:29:00.393643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:43:09.339689+0000","scrub_duration":0.0029687910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:19.135747+0000","last_change":"2024-04-19T04:29:19.135893+0000","last_active":"2024-04-19T04:29:19.135747+0000","last_peered":"2024-04-19T04:29:19.135747+0000","last_clean":"2024-04-19T04:29:19.135747+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:29:19.135747+0000","last_undegraded":"2024-04-19T04:29:19.135747+0000","last_fullsized":"2024-04-19T04:29:19.135747+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:19.135719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:19.135719+0000","last_clean_scrub_stamp":"2024-04-19T04:29:19.135719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:18:22.526783+0000","scrub_duration":0.029313573999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:05.491064+0000","last_change":"2024-04-19T04:29:05.491373+0000","last_active":"2024-04-19T04:29:05.491064+0000","last_peered":"2024-04-19T04:29:05.491064+0000","last_clean":"2024-04-19T04:29:05.491064+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:29:05.491064+0000","last_undegraded":"2024-04-19T04:29:05.491064+0000","last_fullsized":"2024-04-19T04:29:05.491064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:05.491021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:05.491021+0000","last_clean_scrub_stamp":"2024-04-19T04:29:05.491021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:44.053244+0000","scrub_duration":0.0032047590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:13.152396+0000","last_change":"2024-04-19T04:29:13.152726+0000","last_active":"2024-04-19T04:29:13.152396+0000","last_peered":"2024-04-19T04:29:13.152396+0000","last_clean":"2024-04-19T04:29:13.152396+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:29:13.152396+0000","last_undegraded":"2024-04-19T04:29:13.152396+0000","last_fullsized":"2024-04-19T04:29:13.152396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:13.152340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:13.152340+0000","last_clean_scrub_stamp":"2024-04-19T04:29:13.152340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:11:50.888946+0000","scrub_duration":0.0034040730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:16.704532+0000","last_change":"2024-04-19T04:29:16.704756+0000","last_active":"2024-04-19T04:29:16.704532+0000","last_peered":"2024-04-19T04:29:16.704532+0000","last_clean":"2024-04-19T04:29:16.704532+0000","last_became_active":"2024-04-19T04:28:02.634586+0000","last_became_peered":"2024-04-19T04:28:02.634586+0000","last_unstale":"2024-04-19T04:29:16.704532+0000","last_undegraded":"2024-04-19T04:29:16.704532+0000","last_fullsized":"2024-04-19T04:29:16.704532+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:16.704476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:16.704476+0000","last_clean_scrub_stamp":"2024-04-19T04:29:16.704476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:05.468791+0000","scrub_duration":0.0032163460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:48.475080+0000","last_change":"2024-04-19T04:28:48.475080+0000","last_active":"2024-04-19T04:28:48.475080+0000","last_peered":"2024-04-19T04:28:48.475080+0000","last_clean":"2024-04-19T04:28:48.475080+0000","last_became_active":"2024-04-19T04:28:12.094558+0000","last_became_peered":"2024-04-19T04:28:12.094558+0000","last_unstale":"2024-04-19T04:28:48.475080+0000","last_undegraded":"2024-04-19T04:28:48.475080+0000","last_fullsized":"2024-04-19T04:28:48.475080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:48.474816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:48.474816+0000","last_clean_scrub_stamp":"2024-04-19T04:28:48.474816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:45.127770+0000","scrub_duration":0.003339912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"79'4","reported_seq":102,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:59.874932+0000","last_change":"2024-04-19T04:28:59.874932+0000","last_active":"2024-04-19T04:28:59.874932+0000","last_peered":"2024-04-19T04:28:59.874932+0000","last_clean":"2024-04-19T04:28:59.874932+0000","last_became_active":"2024-04-19T04:28:02.638666+0000","last_became_peered":"2024-04-19T04:28:02.638666+0000","last_unstale":"2024-04-19T04:28:59.874932+0000","last_undegraded":"2024-04-19T04:28:59.874932+0000","last_fullsized":"2024-04-19T04:28:59.874932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-04-19T04:28:59.874627+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-04-19T04:28:59.874627+0000","last_clean_scrub_stamp":"2024-04-19T04:28:59.874627+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:20:56.884252+0000","scrub_duration":0.0061750349999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:27.505148+0000","last_change":"2024-04-19T04:29:27.505394+0000","last_active":"2024-04-19T04:29:27.505148+0000","last_peered":"2024-04-19T04:29:27.505148+0000","last_clean":"2024-04-19T04:29:27.505148+0000","last_became_active":"2024-04-19T04:28:12.094722+0000","last_became_peered":"2024-04-19T04:28:12.094722+0000","last_unstale":"2024-04-19T04:29:27.505148+0000","last_undegraded":"2024-04-19T04:29:27.505148+0000","last_fullsized":"2024-04-19T04:29:27.505148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:27.505100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:27.505100+0000","last_clean_scrub_stamp":"2024-04-19T04:29:27.505100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:36:45.754653+0000","scrub_duration":0.021590518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:37.122068+0000","last_change":"2024-04-19T04:29:37.122327+0000","last_active":"2024-04-19T04:29:37.122068+0000","last_peered":"2024-04-19T04:29:37.122068+0000","last_clean":"2024-04-19T04:29:37.122068+0000","last_became_active":"2024-04-19T04:28:02.842525+0000","last_became_peered":"2024-04-19T04:28:02.842525+0000","last_unstale":"2024-04-19T04:29:37.122068+0000","last_undegraded":"2024-04-19T04:29:37.122068+0000","last_fullsized":"2024-04-19T04:29:37.122068+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:37.122023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:37.122023+0000","last_clean_scrub_stamp":"2024-04-19T04:29:37.122023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:58:29.627789+0000","scrub_duration":0.003440088,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.151861+0000","last_change":"2024-04-19T04:28:40.152096+0000","last_active":"2024-04-19T04:28:40.151861+0000","last_peered":"2024-04-19T04:28:40.151861+0000","last_clean":"2024-04-19T04:28:40.151861+0000","last_became_active":"2024-04-19T04:28:02.843099+0000","last_became_peered":"2024-04-19T04:28:02.843099+0000","last_unstale":"2024-04-19T04:28:40.151861+0000","last_undegraded":"2024-04-19T04:28:40.151861+0000","last_fullsized":"2024-04-19T04:28:40.151861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.151812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.151812+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.151812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:19.753268+0000","scrub_duration":0.0030712460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:29.541159+0000","last_change":"2024-04-19T04:28:29.541420+0000","last_active":"2024-04-19T04:28:29.541159+0000","last_peered":"2024-04-19T04:28:29.541159+0000","last_clean":"2024-04-19T04:28:29.541159+0000","last_became_active":"2024-04-19T04:28:12.091771+0000","last_became_peered":"2024-04-19T04:28:12.091771+0000","last_unstale":"2024-04-19T04:28:29.541159+0000","last_undegraded":"2024-04-19T04:28:29.541159+0000","last_fullsized":"2024-04-19T04:28:29.541159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:29.541116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:29.541116+0000","last_clean_scrub_stamp":"2024-04-19T04:28:29.541116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:42.022636+0000","scrub_duration":0.0033350189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:29.182019+0000","last_change":"2024-04-19T04:29:29.182338+0000","last_active":"2024-04-19T04:29:29.182019+0000","last_peered":"2024-04-19T04:29:29.182019+0000","last_clean":"2024-04-19T04:29:29.182019+0000","last_became_active":"2024-04-19T04:28:02.836984+0000","last_became_peered":"2024-04-19T04:28:02.836984+0000","last_unstale":"2024-04-19T04:29:29.182019+0000","last_undegraded":"2024-04-19T04:29:29.182019+0000","last_fullsized":"2024-04-19T04:29:29.182019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:29.181949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:29.181949+0000","last_clean_scrub_stamp":"2024-04-19T04:29:29.181949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:05:44.642227+0000","scrub_duration":0.072525754999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"79'12","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:55.744975+0000","last_change":"2024-04-19T04:29:55.745224+0000","last_active":"2024-04-19T04:29:55.744975+0000","last_peered":"2024-04-19T04:29:55.744975+0000","last_clean":"2024-04-19T04:29:55.744975+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:29:55.744975+0000","last_undegraded":"2024-04-19T04:29:55.744975+0000","last_fullsized":"2024-04-19T04:29:55.744975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-04-19T04:29:55.744918+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-04-19T04:29:55.744918+0000","last_clean_scrub_stamp":"2024-04-19T04:29:55.744918+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:39.067810+0000","scrub_duration":0.010162294000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"79'2","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:14.682747+0000","last_change":"2024-04-19T04:29:14.683190+0000","last_active":"2024-04-19T04:29:14.682747+0000","last_peered":"2024-04-19T04:29:14.682747+0000","last_clean":"2024-04-19T04:29:14.682747+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:29:14.682747+0000","last_undegraded":"2024-04-19T04:29:14.682747+0000","last_fullsized":"2024-04-19T04:29:14.682747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-19T04:29:14.682697+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-19T04:29:14.682697+0000","last_clean_scrub_stamp":"2024-04-19T04:29:14.682697+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:35.626266+0000","scrub_duration":0.006337891,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:15.540432+0000","last_change":"2024-04-19T04:29:15.540650+0000","last_active":"2024-04-19T04:29:15.540432+0000","last_peered":"2024-04-19T04:29:15.540432+0000","last_clean":"2024-04-19T04:29:15.540432+0000","last_became_active":"2024-04-19T04:28:12.090379+0000","last_became_peered":"2024-04-19T04:28:12.090379+0000","last_unstale":"2024-04-19T04:29:15.540432+0000","last_undegraded":"2024-04-19T04:29:15.540432+0000","last_fullsized":"2024-04-19T04:29:15.540432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:15.540388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:15.540388+0000","last_clean_scrub_stamp":"2024-04-19T04:29:15.540388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:58:31.906342+0000","scrub_duration":0.0035449280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"79'3","reported_seq":46,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:30.448918+0000","last_change":"2024-04-19T04:29:30.449147+0000","last_active":"2024-04-19T04:29:30.448918+0000","last_peered":"2024-04-19T04:29:30.448918+0000","last_clean":"2024-04-19T04:29:30.448918+0000","last_became_active":"2024-04-19T04:28:12.089948+0000","last_became_peered":"2024-04-19T04:28:12.089948+0000","last_unstale":"2024-04-19T04:29:30.448918+0000","last_undegraded":"2024-04-19T04:29:30.448918+0000","last_fullsized":"2024-04-19T04:29:30.448918+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:29:30.448862+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:29:30.448862+0000","last_clean_scrub_stamp":"2024-04-19T04:29:30.448862+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:55.690294+0000","scrub_duration":0.0062853340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:57.409585+0000","last_change":"2024-04-19T04:28:57.409839+0000","last_active":"2024-04-19T04:28:57.409585+0000","last_peered":"2024-04-19T04:28:57.409585+0000","last_clean":"2024-04-19T04:28:57.409585+0000","last_became_active":"2024-04-19T04:28:12.093090+0000","last_became_peered":"2024-04-19T04:28:12.093090+0000","last_unstale":"2024-04-19T04:28:57.409585+0000","last_undegraded":"2024-04-19T04:28:57.409585+0000","last_fullsized":"2024-04-19T04:28:57.409585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:57.409536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:57.409536+0000","last_clean_scrub_stamp":"2024-04-19T04:28:57.409536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:58:14.062514+0000","scrub_duration":0.0034988459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"79'2","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:51.726306+0000","last_change":"2024-04-19T04:28:51.726306+0000","last_active":"2024-04-19T04:28:51.726306+0000","last_peered":"2024-04-19T04:28:51.726306+0000","last_clean":"2024-04-19T04:28:51.726306+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:28:51.726306+0000","last_undegraded":"2024-04-19T04:28:51.726306+0000","last_fullsized":"2024-04-19T04:28:51.726306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-19T04:28:51.725876+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-19T04:28:51.725876+0000","last_clean_scrub_stamp":"2024-04-19T04:28:51.725876+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:17.429863+0000","scrub_duration":0.0062414059999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:13.724370+0000","last_change":"2024-04-19T04:29:13.724590+0000","last_active":"2024-04-19T04:29:13.724370+0000","last_peered":"2024-04-19T04:29:13.724370+0000","last_clean":"2024-04-19T04:29:13.724370+0000","last_became_active":"2024-04-19T04:28:02.636231+0000","last_became_peered":"2024-04-19T04:28:02.636231+0000","last_unstale":"2024-04-19T04:29:13.724370+0000","last_undegraded":"2024-04-19T04:29:13.724370+0000","last_fullsized":"2024-04-19T04:29:13.724370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:13.724320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:13.724320+0000","last_clean_scrub_stamp":"2024-04-19T04:29:13.724320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:30:36.014677+0000","scrub_duration":0.0034525440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:19.699868+0000","last_change":"2024-04-19T04:29:19.700106+0000","last_active":"2024-04-19T04:29:19.699868+0000","last_peered":"2024-04-19T04:29:19.699868+0000","last_clean":"2024-04-19T04:29:19.699868+0000","last_became_active":"2024-04-19T04:28:02.634823+0000","last_became_peered":"2024-04-19T04:28:02.634823+0000","last_unstale":"2024-04-19T04:29:19.699868+0000","last_undegraded":"2024-04-19T04:29:19.699868+0000","last_fullsized":"2024-04-19T04:29:19.699868+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:19.699822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:19.699822+0000","last_clean_scrub_stamp":"2024-04-19T04:29:19.699822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:29:33.297820+0000","scrub_duration":0.003354863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:56.250577+0000","last_change":"2024-04-19T04:28:56.250708+0000","last_active":"2024-04-19T04:28:56.250577+0000","last_peered":"2024-04-19T04:28:56.250577+0000","last_clean":"2024-04-19T04:28:56.250577+0000","last_became_active":"2024-04-19T04:28:02.845461+0000","last_became_peered":"2024-04-19T04:28:02.845461+0000","last_unstale":"2024-04-19T04:28:56.250577+0000","last_undegraded":"2024-04-19T04:28:56.250577+0000","last_fullsized":"2024-04-19T04:28:56.250577+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:56.250557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:56.250557+0000","last_clean_scrub_stamp":"2024-04-19T04:28:56.250557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:56.014220+0000","scrub_duration":0.029538265000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:46.246893+0000","last_change":"2024-04-19T04:28:46.247247+0000","last_active":"2024-04-19T04:28:46.246893+0000","last_peered":"2024-04-19T04:28:46.246893+0000","last_clean":"2024-04-19T04:28:46.246893+0000","last_became_active":"2024-04-19T04:28:02.844927+0000","last_became_peered":"2024-04-19T04:28:02.844927+0000","last_unstale":"2024-04-19T04:28:46.246893+0000","last_undegraded":"2024-04-19T04:28:46.246893+0000","last_fullsized":"2024-04-19T04:28:46.246893+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:28:46.246777+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:28:46.246777+0000","last_clean_scrub_stamp":"2024-04-19T04:28:46.246777+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:37:56.201762+0000","scrub_duration":0.006831213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:58.824983+0000","last_change":"2024-04-19T04:28:58.825209+0000","last_active":"2024-04-19T04:28:58.824983+0000","last_peered":"2024-04-19T04:28:58.824983+0000","last_clean":"2024-04-19T04:28:58.824983+0000","last_became_active":"2024-04-19T04:28:02.635238+0000","last_became_peered":"2024-04-19T04:28:02.635238+0000","last_unstale":"2024-04-19T04:28:58.824983+0000","last_undegraded":"2024-04-19T04:28:58.824983+0000","last_fullsized":"2024-04-19T04:28:58.824983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:58.824931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:58.824931+0000","last_clean_scrub_stamp":"2024-04-19T04:28:58.824931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:33.364138+0000","scrub_duration":0.0033677389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:49.632835+0000","last_change":"2024-04-19T04:29:49.633086+0000","last_active":"2024-04-19T04:29:49.632835+0000","last_peered":"2024-04-19T04:29:49.632835+0000","last_clean":"2024-04-19T04:29:49.632835+0000","last_became_active":"2024-04-19T04:28:02.637651+0000","last_became_peered":"2024-04-19T04:28:02.637651+0000","last_unstale":"2024-04-19T04:29:49.632835+0000","last_undegraded":"2024-04-19T04:29:49.632835+0000","last_fullsized":"2024-04-19T04:29:49.632835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:49.632785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:49.632785+0000","last_clean_scrub_stamp":"2024-04-19T04:29:49.632785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:12:59.944414+0000","scrub_duration":0.0031670999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.710088+0000","last_change":"2024-04-19T04:28:40.710088+0000","last_active":"2024-04-19T04:28:40.710088+0000","last_peered":"2024-04-19T04:28:40.710088+0000","last_clean":"2024-04-19T04:28:40.710088+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:28:40.710088+0000","last_undegraded":"2024-04-19T04:28:40.710088+0000","last_fullsized":"2024-04-19T04:28:40.710088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.709702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.709702+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.709702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:24.831215+0000","scrub_duration":0.0033854829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:04.490301+0000","last_change":"2024-04-19T04:29:04.490555+0000","last_active":"2024-04-19T04:29:04.490301+0000","last_peered":"2024-04-19T04:29:04.490301+0000","last_clean":"2024-04-19T04:29:04.490301+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:29:04.490301+0000","last_undegraded":"2024-04-19T04:29:04.490301+0000","last_fullsized":"2024-04-19T04:29:04.490301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:04.490250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:04.490250+0000","last_clean_scrub_stamp":"2024-04-19T04:29:04.490250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:48.611763+0000","scrub_duration":0.003278235,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:06.705490+0000","last_change":"2024-04-19T04:29:06.705866+0000","last_active":"2024-04-19T04:29:06.705490+0000","last_peered":"2024-04-19T04:29:06.705490+0000","last_clean":"2024-04-19T04:29:06.705490+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:29:06.705490+0000","last_undegraded":"2024-04-19T04:29:06.705490+0000","last_fullsized":"2024-04-19T04:29:06.705490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:06.705384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:06.705384+0000","last_clean_scrub_stamp":"2024-04-19T04:29:06.705384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:57.321888+0000","scrub_duration":0.003745515,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.494052+0000","last_change":"2024-04-19T04:28:40.494052+0000","last_active":"2024-04-19T04:28:40.494052+0000","last_peered":"2024-04-19T04:28:40.494052+0000","last_clean":"2024-04-19T04:28:40.494052+0000","last_became_active":"2024-04-19T04:28:12.088043+0000","last_became_peered":"2024-04-19T04:28:12.088043+0000","last_unstale":"2024-04-19T04:28:40.494052+0000","last_undegraded":"2024-04-19T04:28:40.494052+0000","last_fullsized":"2024-04-19T04:28:40.494052+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.493585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.493585+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.493585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:22:36.746203+0000","scrub_duration":0.0035336780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:39.119137+0000","last_change":"2024-04-19T04:29:39.119269+0000","last_active":"2024-04-19T04:29:39.119137+0000","last_peered":"2024-04-19T04:29:39.119137+0000","last_clean":"2024-04-19T04:29:39.119137+0000","last_became_active":"2024-04-19T04:28:02.843639+0000","last_became_peered":"2024-04-19T04:28:02.843639+0000","last_unstale":"2024-04-19T04:29:39.119137+0000","last_undegraded":"2024-04-19T04:29:39.119137+0000","last_fullsized":"2024-04-19T04:29:39.119137+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:39.119118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:39.119118+0000","last_clean_scrub_stamp":"2024-04-19T04:29:39.119118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:21:58.336649+0000","scrub_duration":0.057465321999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'159","reported_seq":289,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:25.641453+0000","last_change":"2024-04-19T04:29:25.641698+0000","last_active":"2024-04-19T04:29:25.641453+0000","last_peered":"2024-04-19T04:29:25.641453+0000","last_clean":"2024-04-19T04:29:25.641453+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:29:25.641453+0000","last_undegraded":"2024-04-19T04:29:25.641453+0000","last_fullsized":"2024-04-19T04:29:25.641453+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'159","last_scrub_stamp":"2024-04-19T04:29:25.641417+0000","last_deep_scrub":"79'159","last_deep_scrub_stamp":"2024-04-19T04:29:25.641417+0000","last_clean_scrub_stamp":"2024-04-19T04:29:25.641417+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:59.525050+0000","scrub_duration":0.011440092000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":101,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:45.666725+0000","last_change":"2024-04-19T04:29:45.666956+0000","last_active":"2024-04-19T04:29:45.666725+0000","last_peered":"2024-04-19T04:29:45.666725+0000","last_clean":"2024-04-19T04:29:45.666725+0000","last_became_active":"2024-04-19T04:28:02.639240+0000","last_became_peered":"2024-04-19T04:28:02.639240+0000","last_unstale":"2024-04-19T04:29:45.666725+0000","last_undegraded":"2024-04-19T04:29:45.666725+0000","last_fullsized":"2024-04-19T04:29:45.666725+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:45.666680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:45.666680+0000","last_clean_scrub_stamp":"2024-04-19T04:29:45.666680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:54:24.509719+0000","scrub_duration":0.0031594069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:45.150751+0000","last_change":"2024-04-19T04:29:45.150985+0000","last_active":"2024-04-19T04:29:45.150751+0000","last_peered":"2024-04-19T04:29:45.150751+0000","last_clean":"2024-04-19T04:29:45.150751+0000","last_became_active":"2024-04-19T04:28:02.841053+0000","last_became_peered":"2024-04-19T04:28:02.841053+0000","last_unstale":"2024-04-19T04:29:45.150751+0000","last_undegraded":"2024-04-19T04:29:45.150751+0000","last_fullsized":"2024-04-19T04:29:45.150751+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:45.150700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:45.150700+0000","last_clean_scrub_stamp":"2024-04-19T04:29:45.150700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:11:12.088151+0000","scrub_duration":0.003512416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:43.759501+0000","last_change":"2024-04-19T04:28:43.759738+0000","last_active":"2024-04-19T04:28:43.759501+0000","last_peered":"2024-04-19T04:28:43.759501+0000","last_clean":"2024-04-19T04:28:43.759501+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:28:43.759501+0000","last_undegraded":"2024-04-19T04:28:43.759501+0000","last_fullsized":"2024-04-19T04:28:43.759501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:43.759455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:43.759455+0000","last_clean_scrub_stamp":"2024-04-19T04:28:43.759455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:10.518057+0000","scrub_duration":0.0032782050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:32.629604+0000","last_change":"2024-04-19T04:29:32.629967+0000","last_active":"2024-04-19T04:29:32.629604+0000","last_peered":"2024-04-19T04:29:32.629604+0000","last_clean":"2024-04-19T04:29:32.629604+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:29:32.629604+0000","last_undegraded":"2024-04-19T04:29:32.629604+0000","last_fullsized":"2024-04-19T04:29:32.629604+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:32.629512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:32.629512+0000","last_clean_scrub_stamp":"2024-04-19T04:29:32.629512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:40.130427+0000","scrub_duration":0.0033463669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:27.119933+0000","last_change":"2024-04-19T04:29:27.120166+0000","last_active":"2024-04-19T04:29:27.119933+0000","last_peered":"2024-04-19T04:29:27.119933+0000","last_clean":"2024-04-19T04:29:27.119933+0000","last_became_active":"2024-04-19T04:28:02.839926+0000","last_became_peered":"2024-04-19T04:28:02.839926+0000","last_unstale":"2024-04-19T04:29:27.119933+0000","last_undegraded":"2024-04-19T04:29:27.119933+0000","last_fullsized":"2024-04-19T04:29:27.119933+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:27.119885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:27.119885+0000","last_clean_scrub_stamp":"2024-04-19T04:29:27.119885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:23.826940+0000","scrub_duration":0.0034871469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:14.506307+0000","last_change":"2024-04-19T04:29:14.506535+0000","last_active":"2024-04-19T04:29:14.506307+0000","last_peered":"2024-04-19T04:29:14.506307+0000","last_clean":"2024-04-19T04:29:14.506307+0000","last_became_active":"2024-04-19T04:28:02.638095+0000","last_became_peered":"2024-04-19T04:28:02.638095+0000","last_unstale":"2024-04-19T04:29:14.506307+0000","last_undegraded":"2024-04-19T04:29:14.506307+0000","last_fullsized":"2024-04-19T04:29:14.506307+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:14.506264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:14.506264+0000","last_clean_scrub_stamp":"2024-04-19T04:29:14.506264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:39:27.629645+0000","scrub_duration":0.003222464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:21.148937+0000","last_change":"2024-04-19T04:28:21.158508+0000","last_active":"2024-04-19T04:28:21.148937+0000","last_peered":"2024-04-19T04:28:21.148937+0000","last_clean":"2024-04-19T04:28:21.148937+0000","last_became_active":"2024-04-19T04:28:02.840328+0000","last_became_peered":"2024-04-19T04:28:02.840328+0000","last_unstale":"2024-04-19T04:28:21.148937+0000","last_undegraded":"2024-04-19T04:28:21.148937+0000","last_fullsized":"2024-04-19T04:28:21.148937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:21.148887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:21.148887+0000","last_clean_scrub_stamp":"2024-04-19T04:28:21.148887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:44:55.928928+0000","scrub_duration":0.0038294929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:46.483321+0000","last_change":"2024-04-19T04:28:46.483620+0000","last_active":"2024-04-19T04:28:46.483321+0000","last_peered":"2024-04-19T04:28:46.483321+0000","last_clean":"2024-04-19T04:28:46.483321+0000","last_became_active":"2024-04-19T04:28:12.087575+0000","last_became_peered":"2024-04-19T04:28:12.087575+0000","last_unstale":"2024-04-19T04:28:46.483321+0000","last_undegraded":"2024-04-19T04:28:46.483321+0000","last_fullsized":"2024-04-19T04:28:46.483321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:46.483271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:46.483271+0000","last_clean_scrub_stamp":"2024-04-19T04:28:46.483271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:13.971451+0000","scrub_duration":0.0034840449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:12.204141+0000","last_change":"2024-04-19T04:29:12.204263+0000","last_active":"2024-04-19T04:29:12.204141+0000","last_peered":"2024-04-19T04:29:12.204141+0000","last_clean":"2024-04-19T04:29:12.204141+0000","last_became_active":"2024-04-19T04:28:02.840839+0000","last_became_peered":"2024-04-19T04:28:02.840839+0000","last_unstale":"2024-04-19T04:29:12.204141+0000","last_undegraded":"2024-04-19T04:29:12.204141+0000","last_fullsized":"2024-04-19T04:29:12.204141+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:12.204121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:12.204121+0000","last_clean_scrub_stamp":"2024-04-19T04:29:12.204121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:20:20.194187+0000","scrub_duration":0.035589924000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":101,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:44.697676+0000","last_change":"2024-04-19T04:29:44.697951+0000","last_active":"2024-04-19T04:29:44.697676+0000","last_peered":"2024-04-19T04:29:44.697676+0000","last_clean":"2024-04-19T04:29:44.697676+0000","last_became_active":"2024-04-19T04:28:02.634633+0000","last_became_peered":"2024-04-19T04:28:02.634633+0000","last_unstale":"2024-04-19T04:29:44.697676+0000","last_undegraded":"2024-04-19T04:29:44.697676+0000","last_fullsized":"2024-04-19T04:29:44.697676+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:44.697628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:44.697628+0000","last_clean_scrub_stamp":"2024-04-19T04:29:44.697628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:42.440486+0000","scrub_duration":0.0034703999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:58.802323+0000","last_change":"2024-04-19T04:29:58.802663+0000","last_active":"2024-04-19T04:29:58.802323+0000","last_peered":"2024-04-19T04:29:58.802323+0000","last_clean":"2024-04-19T04:29:58.802323+0000","last_became_active":"2024-04-19T04:28:02.637233+0000","last_became_peered":"2024-04-19T04:28:02.637233+0000","last_unstale":"2024-04-19T04:29:58.802323+0000","last_undegraded":"2024-04-19T04:29:58.802323+0000","last_fullsized":"2024-04-19T04:29:58.802323+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:58.802266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:58.802266+0000","last_clean_scrub_stamp":"2024-04-19T04:29:58.802266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:55:10.441574+0000","scrub_duration":0.0033469329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:53.216978+0000","last_change":"2024-04-19T04:28:53.217334+0000","last_active":"2024-04-19T04:28:53.216978+0000","last_peered":"2024-04-19T04:28:53.216978+0000","last_clean":"2024-04-19T04:28:53.216978+0000","last_became_active":"2024-04-19T04:28:02.837829+0000","last_became_peered":"2024-04-19T04:28:02.837829+0000","last_unstale":"2024-04-19T04:28:53.216978+0000","last_undegraded":"2024-04-19T04:28:53.216978+0000","last_fullsized":"2024-04-19T04:28:53.216978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:53.216932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:53.216932+0000","last_clean_scrub_stamp":"2024-04-19T04:28:53.216932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:28:52.742878+0000","scrub_duration":0.0032988420000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:12.751225+0000","last_change":"2024-04-19T04:29:12.751447+0000","last_active":"2024-04-19T04:29:12.751225+0000","last_peered":"2024-04-19T04:29:12.751225+0000","last_clean":"2024-04-19T04:29:12.751225+0000","last_became_active":"2024-04-19T04:28:02.634103+0000","last_became_peered":"2024-04-19T04:28:02.634103+0000","last_unstale":"2024-04-19T04:29:12.751225+0000","last_undegraded":"2024-04-19T04:29:12.751225+0000","last_fullsized":"2024-04-19T04:29:12.751225+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:12.751168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:12.751168+0000","last_clean_scrub_stamp":"2024-04-19T04:29:12.751168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:41:03.146894+0000","scrub_duration":0.0031427569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:21.088958+0000","last_change":"2024-04-19T04:29:21.089183+0000","last_active":"2024-04-19T04:29:21.088958+0000","last_peered":"2024-04-19T04:29:21.088958+0000","last_clean":"2024-04-19T04:29:21.088958+0000","last_became_active":"2024-04-19T04:28:02.835057+0000","last_became_peered":"2024-04-19T04:28:02.835057+0000","last_unstale":"2024-04-19T04:29:21.088958+0000","last_undegraded":"2024-04-19T04:29:21.088958+0000","last_fullsized":"2024-04-19T04:29:21.088958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:21.088913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:21.088913+0000","last_clean_scrub_stamp":"2024-04-19T04:29:21.088913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:25:08.459261+0000","scrub_duration":0.0034193980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:12.560395+0000","last_change":"2024-04-19T04:29:12.560617+0000","last_active":"2024-04-19T04:29:12.560395+0000","last_peered":"2024-04-19T04:29:12.560395+0000","last_clean":"2024-04-19T04:29:12.560395+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:29:12.560395+0000","last_undegraded":"2024-04-19T04:29:12.560395+0000","last_fullsized":"2024-04-19T04:29:12.560395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:12.560352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:12.560352+0000","last_clean_scrub_stamp":"2024-04-19T04:29:12.560352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:21.470493+0000","scrub_duration":0.0033970480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:03.073729+0000","last_change":"2024-04-19T04:29:03.074082+0000","last_active":"2024-04-19T04:29:03.073729+0000","last_peered":"2024-04-19T04:29:03.073729+0000","last_clean":"2024-04-19T04:29:03.073729+0000","last_became_active":"2024-04-19T04:28:02.838918+0000","last_became_peered":"2024-04-19T04:28:02.838918+0000","last_unstale":"2024-04-19T04:29:03.073729+0000","last_undegraded":"2024-04-19T04:29:03.073729+0000","last_fullsized":"2024-04-19T04:29:03.073729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:03.073680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:03.073680+0000","last_clean_scrub_stamp":"2024-04-19T04:29:03.073680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:34:04.411572+0000","scrub_duration":0.0031316450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:33.545214+0000","last_change":"2024-04-19T04:29:33.545495+0000","last_active":"2024-04-19T04:29:33.545214+0000","last_peered":"2024-04-19T04:29:33.545214+0000","last_clean":"2024-04-19T04:29:33.545214+0000","last_became_active":"2024-04-19T04:28:12.091609+0000","last_became_peered":"2024-04-19T04:28:12.091609+0000","last_unstale":"2024-04-19T04:29:33.545214+0000","last_undegraded":"2024-04-19T04:29:33.545214+0000","last_fullsized":"2024-04-19T04:29:33.545214+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:33.545166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:33.545166+0000","last_clean_scrub_stamp":"2024-04-19T04:29:33.545166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:30:55.835523+0000","scrub_duration":0.0030524910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:43.453357+0000","last_change":"2024-04-19T04:28:43.453593+0000","last_active":"2024-04-19T04:28:43.453357+0000","last_peered":"2024-04-19T04:28:43.453357+0000","last_clean":"2024-04-19T04:28:43.453357+0000","last_became_active":"2024-04-19T04:28:12.091335+0000","last_became_peered":"2024-04-19T04:28:12.091335+0000","last_unstale":"2024-04-19T04:28:43.453357+0000","last_undegraded":"2024-04-19T04:28:43.453357+0000","last_fullsized":"2024-04-19T04:28:43.453357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:43.453308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:43.453308+0000","last_clean_scrub_stamp":"2024-04-19T04:28:43.453308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:37:50.638133+0000","scrub_duration":0.0032802869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:45.236169+0000","last_change":"2024-04-19T04:28:45.236529+0000","last_active":"2024-04-19T04:28:45.236169+0000","last_peered":"2024-04-19T04:28:45.236169+0000","last_clean":"2024-04-19T04:28:45.236169+0000","last_became_active":"2024-04-19T04:28:02.839883+0000","last_became_peered":"2024-04-19T04:28:02.839883+0000","last_unstale":"2024-04-19T04:28:45.236169+0000","last_undegraded":"2024-04-19T04:28:45.236169+0000","last_fullsized":"2024-04-19T04:28:45.236169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:28:45.236116+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:28:45.236116+0000","last_clean_scrub_stamp":"2024-04-19T04:28:45.236116+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:21.181858+0000","scrub_duration":0.0065909519999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:22.131544+0000","last_change":"2024-04-19T04:29:22.131770+0000","last_active":"2024-04-19T04:29:22.131544+0000","last_peered":"2024-04-19T04:29:22.131544+0000","last_clean":"2024-04-19T04:29:22.131544+0000","last_became_active":"2024-04-19T04:28:02.845256+0000","last_became_peered":"2024-04-19T04:28:02.845256+0000","last_unstale":"2024-04-19T04:29:22.131544+0000","last_undegraded":"2024-04-19T04:29:22.131544+0000","last_fullsized":"2024-04-19T04:29:22.131544+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:22.131495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:22.131495+0000","last_clean_scrub_stamp":"2024-04-19T04:29:22.131495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:58.086230+0000","scrub_duration":0.0032550890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:35.232894+0000","last_change":"2024-04-19T04:28:35.232894+0000","last_active":"2024-04-19T04:28:35.232894+0000","last_peered":"2024-04-19T04:28:35.232894+0000","last_clean":"2024-04-19T04:28:35.232894+0000","last_became_active":"2024-04-19T04:28:02.844128+0000","last_became_peered":"2024-04-19T04:28:02.844128+0000","last_unstale":"2024-04-19T04:28:35.232894+0000","last_undegraded":"2024-04-19T04:28:35.232894+0000","last_fullsized":"2024-04-19T04:28:35.232894+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:35.232595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:35.232595+0000","last_clean_scrub_stamp":"2024-04-19T04:28:35.232595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:17:35.552236+0000","scrub_duration":0.0033160400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"79'2","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:02.113554+0000","last_change":"2024-04-19T04:29:02.113900+0000","last_active":"2024-04-19T04:29:02.113554+0000","last_peered":"2024-04-19T04:29:02.113554+0000","last_clean":"2024-04-19T04:29:02.113554+0000","last_became_active":"2024-04-19T04:28:02.844483+0000","last_became_peered":"2024-04-19T04:28:02.844483+0000","last_unstale":"2024-04-19T04:29:02.113554+0000","last_undegraded":"2024-04-19T04:29:02.113554+0000","last_fullsized":"2024-04-19T04:29:02.113554+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-19T04:29:02.113502+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-19T04:29:02.113502+0000","last_clean_scrub_stamp":"2024-04-19T04:29:02.113502+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:57:58.962870+0000","scrub_duration":0.0066382589999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:43.726278+0000","last_change":"2024-04-19T04:29:43.726562+0000","last_active":"2024-04-19T04:29:43.726278+0000","last_peered":"2024-04-19T04:29:43.726278+0000","last_clean":"2024-04-19T04:29:43.726278+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:29:43.726278+0000","last_undegraded":"2024-04-19T04:29:43.726278+0000","last_fullsized":"2024-04-19T04:29:43.726278+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:43.726226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:43.726226+0000","last_clean_scrub_stamp":"2024-04-19T04:29:43.726226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:51:42.524758+0000","scrub_duration":0.003376446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:03.475770+0000","last_change":"2024-04-19T04:29:03.476086+0000","last_active":"2024-04-19T04:29:03.475770+0000","last_peered":"2024-04-19T04:29:03.475770+0000","last_clean":"2024-04-19T04:29:03.475770+0000","last_became_active":"2024-04-19T04:28:12.088123+0000","last_became_peered":"2024-04-19T04:28:12.088123+0000","last_unstale":"2024-04-19T04:29:03.475770+0000","last_undegraded":"2024-04-19T04:29:03.475770+0000","last_fullsized":"2024-04-19T04:29:03.475770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:03.475686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:03.475686+0000","last_clean_scrub_stamp":"2024-04-19T04:29:03.475686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:48:06.718278+0000","scrub_duration":0.0036698009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:36.624976+0000","last_change":"2024-04-19T04:28:36.624976+0000","last_active":"2024-04-19T04:28:36.624976+0000","last_peered":"2024-04-19T04:28:36.624976+0000","last_clean":"2024-04-19T04:28:36.624976+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:28:36.624976+0000","last_undegraded":"2024-04-19T04:28:36.624976+0000","last_fullsized":"2024-04-19T04:28:36.624976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:36.624618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:36.624618+0000","last_clean_scrub_stamp":"2024-04-19T04:28:36.624618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:45.570664+0000","scrub_duration":0.0035750109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"79'10","reported_seq":95,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:56.750060+0000","last_change":"2024-04-19T04:28:56.750060+0000","last_active":"2024-04-19T04:28:56.750060+0000","last_peered":"2024-04-19T04:28:56.750060+0000","last_clean":"2024-04-19T04:28:56.750060+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:28:56.750060+0000","last_undegraded":"2024-04-19T04:28:56.750060+0000","last_fullsized":"2024-04-19T04:28:56.750060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-04-19T04:28:56.749717+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-04-19T04:28:56.749717+0000","last_clean_scrub_stamp":"2024-04-19T04:28:56.749717+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:09:09.583526+0000","scrub_duration":0.010036193000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:23.193351+0000","last_change":"2024-04-19T04:28:23.193584+0000","last_active":"2024-04-19T04:28:23.193351+0000","last_peered":"2024-04-19T04:28:23.193351+0000","last_clean":"2024-04-19T04:28:23.193351+0000","last_became_active":"2024-04-19T04:28:02.841373+0000","last_became_peered":"2024-04-19T04:28:02.841373+0000","last_unstale":"2024-04-19T04:28:23.193351+0000","last_undegraded":"2024-04-19T04:28:23.193351+0000","last_fullsized":"2024-04-19T04:28:23.193351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:23.193301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:23.193301+0000","last_clean_scrub_stamp":"2024-04-19T04:28:23.193301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:26.999877+0000","scrub_duration":0.0032212959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"79'5","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:32.522683+0000","last_change":"2024-04-19T04:29:32.523001+0000","last_active":"2024-04-19T04:29:32.522683+0000","last_peered":"2024-04-19T04:29:32.522683+0000","last_clean":"2024-04-19T04:29:32.522683+0000","last_became_active":"2024-04-19T04:28:12.092784+0000","last_became_peered":"2024-04-19T04:28:12.092784+0000","last_unstale":"2024-04-19T04:29:32.522683+0000","last_undegraded":"2024-04-19T04:29:32.522683+0000","last_fullsized":"2024-04-19T04:29:32.522683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-04-19T04:29:32.522633+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-04-19T04:29:32.522633+0000","last_clean_scrub_stamp":"2024-04-19T04:29:32.522633+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:41:22.918360+0000","scrub_duration":0.0090059019999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:09.746871+0000","last_change":"2024-04-19T04:29:09.746871+0000","last_active":"2024-04-19T04:29:09.746871+0000","last_peered":"2024-04-19T04:29:09.746871+0000","last_clean":"2024-04-19T04:29:09.746871+0000","last_became_active":"2024-04-19T04:28:02.638431+0000","last_became_peered":"2024-04-19T04:28:02.638431+0000","last_unstale":"2024-04-19T04:29:09.746871+0000","last_undegraded":"2024-04-19T04:29:09.746871+0000","last_fullsized":"2024-04-19T04:29:09.746871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:09.746554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:09.746554+0000","last_clean_scrub_stamp":"2024-04-19T04:29:09.746554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:33.403481+0000","scrub_duration":0.0034424270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:27.190673+0000","last_change":"2024-04-19T04:28:27.190910+0000","last_active":"2024-04-19T04:28:27.190673+0000","last_peered":"2024-04-19T04:28:27.190673+0000","last_clean":"2024-04-19T04:28:27.190673+0000","last_became_active":"2024-04-19T04:28:02.838354+0000","last_became_peered":"2024-04-19T04:28:02.838354+0000","last_unstale":"2024-04-19T04:28:27.190673+0000","last_undegraded":"2024-04-19T04:28:27.190673+0000","last_fullsized":"2024-04-19T04:28:27.190673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:27.190624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:27.190624+0000","last_clean_scrub_stamp":"2024-04-19T04:28:27.190624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:58:16.070118+0000","scrub_duration":0.003493987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:32.130199+0000","last_change":"2024-04-19T04:29:32.130571+0000","last_active":"2024-04-19T04:29:32.130199+0000","last_peered":"2024-04-19T04:29:32.130199+0000","last_clean":"2024-04-19T04:29:32.130199+0000","last_became_active":"2024-04-19T04:28:02.837994+0000","last_became_peered":"2024-04-19T04:28:02.837994+0000","last_unstale":"2024-04-19T04:29:32.130199+0000","last_undegraded":"2024-04-19T04:29:32.130199+0000","last_fullsized":"2024-04-19T04:29:32.130199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:32.130153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:32.130153+0000","last_clean_scrub_stamp":"2024-04-19T04:29:32.130153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:49.717986+0000","scrub_duration":0.003549759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:10.206873+0000","last_change":"2024-04-19T04:29:10.207103+0000","last_active":"2024-04-19T04:29:10.206873+0000","last_peered":"2024-04-19T04:29:10.206873+0000","last_clean":"2024-04-19T04:29:10.206873+0000","last_became_active":"2024-04-19T04:28:02.836818+0000","last_became_peered":"2024-04-19T04:28:02.836818+0000","last_unstale":"2024-04-19T04:29:10.206873+0000","last_undegraded":"2024-04-19T04:29:10.206873+0000","last_fullsized":"2024-04-19T04:29:10.206873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:10.206828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:10.206828+0000","last_clean_scrub_stamp":"2024-04-19T04:29:10.206828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:22:40.805733+0000","scrub_duration":0.0031759570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:07.525931+0000","last_change":"2024-04-19T04:29:07.526047+0000","last_active":"2024-04-19T04:29:07.525931+0000","last_peered":"2024-04-19T04:29:07.525931+0000","last_clean":"2024-04-19T04:29:07.525931+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:29:07.525931+0000","last_undegraded":"2024-04-19T04:29:07.525931+0000","last_fullsized":"2024-04-19T04:29:07.525931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:07.525913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:07.525913+0000","last_clean_scrub_stamp":"2024-04-19T04:29:07.525913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:34.284515+0000","scrub_duration":0.089503928999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:09.192639+0000","last_change":"2024-04-19T04:29:09.192879+0000","last_active":"2024-04-19T04:29:09.192639+0000","last_peered":"2024-04-19T04:29:09.192639+0000","last_clean":"2024-04-19T04:29:09.192639+0000","last_became_active":"2024-04-19T04:28:02.837400+0000","last_became_peered":"2024-04-19T04:28:02.837400+0000","last_unstale":"2024-04-19T04:29:09.192639+0000","last_undegraded":"2024-04-19T04:29:09.192639+0000","last_fullsized":"2024-04-19T04:29:09.192639+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:09.192594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:09.192594+0000","last_clean_scrub_stamp":"2024-04-19T04:29:09.192594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:24:09.830565+0000","scrub_duration":0.0033446000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:51.216788+0000","last_change":"2024-04-19T04:28:51.216788+0000","last_active":"2024-04-19T04:28:51.216788+0000","last_peered":"2024-04-19T04:28:51.216788+0000","last_clean":"2024-04-19T04:28:51.216788+0000","last_became_active":"2024-04-19T04:28:02.844057+0000","last_became_peered":"2024-04-19T04:28:02.844057+0000","last_unstale":"2024-04-19T04:28:51.216788+0000","last_undegraded":"2024-04-19T04:28:51.216788+0000","last_fullsized":"2024-04-19T04:28:51.216788+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:51.216503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:51.216503+0000","last_clean_scrub_stamp":"2024-04-19T04:28:51.216503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:47:11.830384+0000","scrub_duration":0.003421365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:47.243501+0000","last_change":"2024-04-19T04:28:47.243752+0000","last_active":"2024-04-19T04:28:47.243501+0000","last_peered":"2024-04-19T04:28:47.243501+0000","last_clean":"2024-04-19T04:28:47.243501+0000","last_became_active":"2024-04-19T04:28:02.836492+0000","last_became_peered":"2024-04-19T04:28:02.836492+0000","last_unstale":"2024-04-19T04:28:47.243501+0000","last_undegraded":"2024-04-19T04:28:47.243501+0000","last_fullsized":"2024-04-19T04:28:47.243501+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:47.243453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:47.243453+0000","last_clean_scrub_stamp":"2024-04-19T04:28:47.243453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:57:57.196537+0000","scrub_duration":0.003301942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:52.410116+0000","last_change":"2024-04-19T04:28:52.410331+0000","last_active":"2024-04-19T04:28:52.410116+0000","last_peered":"2024-04-19T04:28:52.410116+0000","last_clean":"2024-04-19T04:28:52.410116+0000","last_became_active":"2024-04-19T04:28:12.095332+0000","last_became_peered":"2024-04-19T04:28:12.095332+0000","last_unstale":"2024-04-19T04:28:52.410116+0000","last_undegraded":"2024-04-19T04:28:52.410116+0000","last_fullsized":"2024-04-19T04:28:52.410116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:52.410070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:52.410070+0000","last_clean_scrub_stamp":"2024-04-19T04:28:52.410070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:41.851489+0000","scrub_duration":0.003375528,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":82,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:37.501685+0000","last_change":"2024-04-19T04:28:37.501685+0000","last_active":"2024-04-19T04:28:37.501685+0000","last_peered":"2024-04-19T04:28:37.501685+0000","last_clean":"2024-04-19T04:28:37.501685+0000","last_became_active":"2024-04-19T04:28:12.090262+0000","last_became_peered":"2024-04-19T04:28:12.090262+0000","last_unstale":"2024-04-19T04:28:37.501685+0000","last_undegraded":"2024-04-19T04:28:37.501685+0000","last_fullsized":"2024-04-19T04:28:37.501685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-19T04:28:37.501393+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-19T04:28:37.501393+0000","last_clean_scrub_stamp":"2024-04-19T04:28:37.501393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:00:31.892502+0000","scrub_duration":0.0035120720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:33.511683+0000","last_change":"2024-04-19T04:28:33.511683+0000","last_active":"2024-04-19T04:28:33.511683+0000","last_peered":"2024-04-19T04:28:33.511683+0000","last_clean":"2024-04-19T04:28:33.511683+0000","last_became_active":"2024-04-19T04:28:12.092979+0000","last_became_peered":"2024-04-19T04:28:12.092979+0000","last_unstale":"2024-04-19T04:28:33.511683+0000","last_undegraded":"2024-04-19T04:28:33.511683+0000","last_fullsized":"2024-04-19T04:28:33.511683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:33.511357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:33.511357+0000","last_clean_scrub_stamp":"2024-04-19T04:28:33.511357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:09:11.578221+0000","scrub_duration":0.0033778150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":44,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:36.522753+0000","last_change":"2024-04-19T04:28:36.523143+0000","last_active":"2024-04-19T04:28:36.522753+0000","last_peered":"2024-04-19T04:28:36.522753+0000","last_clean":"2024-04-19T04:28:36.522753+0000","last_became_active":"2024-04-19T04:28:12.093915+0000","last_became_peered":"2024-04-19T04:28:12.093915+0000","last_unstale":"2024-04-19T04:28:36.522753+0000","last_undegraded":"2024-04-19T04:28:36.522753+0000","last_fullsized":"2024-04-19T04:28:36.522753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-19T04:28:36.522650+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-19T04:28:36.522650+0000","last_clean_scrub_stamp":"2024-04-19T04:28:36.522650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:16.283397+0000","scrub_duration":0.0035824300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481476+0000","last_change":"2024-04-19T04:28:02.639054+0000","last_active":"2024-04-19T04:28:19.481476+0000","last_peered":"2024-04-19T04:28:19.481476+0000","last_clean":"2024-04-19T04:28:19.481476+0000","last_became_active":"2024-04-19T04:28:02.637952+0000","last_became_peered":"2024-04-19T04:28:02.637952+0000","last_unstale":"2024-04-19T04:28:19.481476+0000","last_undegraded":"2024-04-19T04:28:19.481476+0000","last_fullsized":"2024-04-19T04:28:19.481476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"79'3","reported_seq":101,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:42.733097+0000","last_change":"2024-04-19T04:28:42.733097+0000","last_active":"2024-04-19T04:28:42.733097+0000","last_peered":"2024-04-19T04:28:42.733097+0000","last_clean":"2024-04-19T04:28:42.733097+0000","last_became_active":"2024-04-19T04:28:02.634226+0000","last_became_peered":"2024-04-19T04:28:02.634226+0000","last_unstale":"2024-04-19T04:28:42.733097+0000","last_undegraded":"2024-04-19T04:28:42.733097+0000","last_fullsized":"2024-04-19T04:28:42.733097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:28:42.732789+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:28:42.732789+0000","last_clean_scrub_stamp":"2024-04-19T04:28:42.732789+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:39.702938+0000","scrub_duration":0.0066219249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:52.772390+0000","last_change":"2024-04-19T04:28:52.772390+0000","last_active":"2024-04-19T04:28:52.772390+0000","last_peered":"2024-04-19T04:28:52.772390+0000","last_clean":"2024-04-19T04:28:52.772390+0000","last_became_active":"2024-04-19T04:28:02.636266+0000","last_became_peered":"2024-04-19T04:28:02.636266+0000","last_unstale":"2024-04-19T04:28:52.772390+0000","last_undegraded":"2024-04-19T04:28:52.772390+0000","last_fullsized":"2024-04-19T04:28:52.772390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:52.772052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:52.772052+0000","last_clean_scrub_stamp":"2024-04-19T04:28:52.772052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:04.600653+0000","scrub_duration":0.0038532319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":46,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:21.482224+0000","last_change":"2024-04-19T04:29:21.482465+0000","last_active":"2024-04-19T04:29:21.482224+0000","last_peered":"2024-04-19T04:29:21.482224+0000","last_clean":"2024-04-19T04:29:21.482224+0000","last_became_active":"2024-04-19T04:28:12.095199+0000","last_became_peered":"2024-04-19T04:28:12.095199+0000","last_unstale":"2024-04-19T04:29:21.482224+0000","last_undegraded":"2024-04-19T04:29:21.482224+0000","last_fullsized":"2024-04-19T04:29:21.482224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:29:21.482172+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:29:21.482172+0000","last_clean_scrub_stamp":"2024-04-19T04:29:21.482172+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:21:18.491797+0000","scrub_duration":0.0063630429999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:25.498372+0000","last_change":"2024-04-19T04:29:25.498645+0000","last_active":"2024-04-19T04:29:25.498372+0000","last_peered":"2024-04-19T04:29:25.498372+0000","last_clean":"2024-04-19T04:29:25.498372+0000","last_became_active":"2024-04-19T04:28:12.087884+0000","last_became_peered":"2024-04-19T04:28:12.087884+0000","last_unstale":"2024-04-19T04:29:25.498372+0000","last_undegraded":"2024-04-19T04:29:25.498372+0000","last_fullsized":"2024-04-19T04:29:25.498372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:25.498329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:25.498329+0000","last_clean_scrub_stamp":"2024-04-19T04:29:25.498329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:19.741127+0000","scrub_duration":0.019490397999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:46.117999+0000","last_change":"2024-04-19T04:29:46.117999+0000","last_active":"2024-04-19T04:29:46.117999+0000","last_peered":"2024-04-19T04:29:46.117999+0000","last_clean":"2024-04-19T04:29:46.117999+0000","last_became_active":"2024-04-19T04:28:02.846234+0000","last_became_peered":"2024-04-19T04:28:02.846234+0000","last_unstale":"2024-04-19T04:29:46.117999+0000","last_undegraded":"2024-04-19T04:29:46.117999+0000","last_fullsized":"2024-04-19T04:29:46.117999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-19T04:29:46.117721+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-19T04:29:46.117721+0000","last_clean_scrub_stamp":"2024-04-19T04:29:46.117721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:11:30.642985+0000","scrub_duration":0.0034170009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:41.739248+0000","last_change":"2024-04-19T04:28:41.739248+0000","last_active":"2024-04-19T04:28:41.739248+0000","last_peered":"2024-04-19T04:28:41.739248+0000","last_clean":"2024-04-19T04:28:41.739248+0000","last_became_active":"2024-04-19T04:28:02.634433+0000","last_became_peered":"2024-04-19T04:28:02.634433+0000","last_unstale":"2024-04-19T04:28:41.739248+0000","last_undegraded":"2024-04-19T04:28:41.739248+0000","last_fullsized":"2024-04-19T04:28:41.739248+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:41.738950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:41.738950+0000","last_clean_scrub_stamp":"2024-04-19T04:28:41.738950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:20.301173+0000","scrub_duration":0.0033981039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:42.146372+0000","last_change":"2024-04-19T04:29:42.146662+0000","last_active":"2024-04-19T04:29:42.146372+0000","last_peered":"2024-04-19T04:29:42.146372+0000","last_clean":"2024-04-19T04:29:42.146372+0000","last_became_active":"2024-04-19T04:28:02.844276+0000","last_became_peered":"2024-04-19T04:28:02.844276+0000","last_unstale":"2024-04-19T04:29:42.146372+0000","last_undegraded":"2024-04-19T04:29:42.146372+0000","last_fullsized":"2024-04-19T04:29:42.146372+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-04-19T04:29:42.146318+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-04-19T04:29:42.146318+0000","last_clean_scrub_stamp":"2024-04-19T04:29:42.146318+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:07.224942+0000","scrub_duration":0.0080392180000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705739,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220708,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151132,"statfs":{"total":96636764160,"available":96410759168,"internally_reserved":0,"allocated":946176,"data_stored":926258,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 04:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.74399999999999999},"min":{"1min":0.51300000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.77900000000000003,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.59399999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.84299999999999997,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.66900000000000004}]},{"osd":1,"last update":"Fri Apr 19 04:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.76200000000000001}]}]},{"osd":1,"up_from":72,"seq":309237645338,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44116,"kb_used_data":844,"kb_used_omap":6,"kb_used_meta":43257,"kb_avail":94327724,"statfs":{"total":96636764160,"available":96591589376,"internally_reserved":0,"allocated":864256,"data_stored":334760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6880,"internal_metadata":44295456},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 04:29:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Apr 19 04:29:01 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.67100000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705739,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298664,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297726,"kb_avail":94073176,"statfs":{"total":96636764160,"available":96330932224,"internally_reserved":0,"allocated":950272,"data_stored":924740,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":304871878},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 04:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Apr 19 04:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.62,"15min":0.61399999999999999},"min":{"1min":0.58399999999999996,"5min":0.223,"15min":0.223},"max":{"1min":0.83899999999999997,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.628,"15min":0.77900000000000003},"min":{"1min":0.57699999999999996,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.86099999999999999,"5min":4.5,"15min":4.5},"last":0.62}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:30:02.619 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:30:02.619 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:30:02.620 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:30:02.620 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:30:02.620 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:30:02.620 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:30:02.620 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:30:02.621 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:30:02.622 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T04:30:22.622 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:30:22.952 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:30:22.953 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:30:22.966 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-04-19T04:30:21.032158+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":563488,"kb_used_data":2696,"kb_used_omap":9,"kb_used_meta":560758,"kb_avail":282552032,"statfs":{"total":289910292480,"available":289333280768,"internally_reserved":0,"allocated":2760704,"data_stored":2185758,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":10068,"internal_metadata":574216364},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004485"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:24.524670+0000","last_change":"2024-04-19T04:28:24.524670+0000","last_active":"2024-04-19T04:28:24.524670+0000","last_peered":"2024-04-19T04:28:24.524670+0000","last_clean":"2024-04-19T04:28:24.524670+0000","last_became_active":"2024-04-19T04:28:12.093175+0000","last_became_peered":"2024-04-19T04:28:12.093175+0000","last_unstale":"2024-04-19T04:28:24.524670+0000","last_undegraded":"2024-04-19T04:28:24.524670+0000","last_fullsized":"2024-04-19T04:28:24.524670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:24.524536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:24.524536+0000","last_clean_scrub_stamp":"2024-04-19T04:28:24.524536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:34:39.154898+0000","scrub_duration":0.080942869000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:25.440827+0000","last_change":"2024-04-19T04:28:25.440827+0000","last_active":"2024-04-19T04:28:25.440827+0000","last_peered":"2024-04-19T04:28:25.440827+0000","last_clean":"2024-04-19T04:28:25.440827+0000","last_became_active":"2024-04-19T04:28:12.092819+0000","last_became_peered":"2024-04-19T04:28:12.092819+0000","last_unstale":"2024-04-19T04:28:25.440827+0000","last_undegraded":"2024-04-19T04:28:25.440827+0000","last_fullsized":"2024-04-19T04:28:25.440827+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:25.440548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:25.440548+0000","last_clean_scrub_stamp":"2024-04-19T04:28:25.440548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:40.485315+0000","scrub_duration":0.0035723539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481982+0000","last_change":"2024-04-19T04:24:20.556199+0000","last_active":"2024-04-19T04:28:19.481982+0000","last_peered":"2024-04-19T04:28:19.481982+0000","last_clean":"2024-04-19T04:28:19.481982+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:28:19.481982+0000","last_undegraded":"2024-04-19T04:28:19.481982+0000","last_fullsized":"2024-04-19T04:28:19.481982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:30:13.649344+0000","last_change":"2024-04-19T04:30:13.649674+0000","last_active":"2024-04-19T04:30:13.649344+0000","last_peered":"2024-04-19T04:30:13.649344+0000","last_clean":"2024-04-19T04:30:13.649344+0000","last_became_active":"2024-04-19T04:28:02.634355+0000","last_became_peered":"2024-04-19T04:28:02.634355+0000","last_unstale":"2024-04-19T04:30:13.649344+0000","last_undegraded":"2024-04-19T04:30:13.649344+0000","last_fullsized":"2024-04-19T04:30:13.649344+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:30:13.649298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:30:13.649298+0000","last_clean_scrub_stamp":"2024-04-19T04:30:13.649298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:18:30.633306+0000","scrub_duration":0.003270415,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:34.505005+0000","last_change":"2024-04-19T04:28:34.505005+0000","last_active":"2024-04-19T04:28:34.505005+0000","last_peered":"2024-04-19T04:28:34.505005+0000","last_clean":"2024-04-19T04:28:34.505005+0000","last_became_active":"2024-04-19T04:28:12.088231+0000","last_became_peered":"2024-04-19T04:28:12.088231+0000","last_unstale":"2024-04-19T04:28:34.505005+0000","last_undegraded":"2024-04-19T04:28:34.505005+0000","last_fullsized":"2024-04-19T04:28:34.505005+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:34.504692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:34.504692+0000","last_clean_scrub_stamp":"2024-04-19T04:28:34.504692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:54:14.305698+0000","scrub_duration":0.021028397000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481959+0000","last_change":"2024-04-19T04:28:02.637742+0000","last_active":"2024-04-19T04:28:19.481959+0000","last_peered":"2024-04-19T04:28:19.481959+0000","last_clean":"2024-04-19T04:28:19.481959+0000","last_became_active":"2024-04-19T04:28:02.637276+0000","last_became_peered":"2024-04-19T04:28:02.637276+0000","last_unstale":"2024-04-19T04:28:19.481959+0000","last_undegraded":"2024-04-19T04:28:19.481959+0000","last_fullsized":"2024-04-19T04:28:19.481959+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:39.760873+0000","last_change":"2024-04-19T04:28:39.760873+0000","last_active":"2024-04-19T04:28:39.760873+0000","last_peered":"2024-04-19T04:28:39.760873+0000","last_clean":"2024-04-19T04:28:39.760873+0000","last_became_active":"2024-04-19T04:28:02.637086+0000","last_became_peered":"2024-04-19T04:28:02.637086+0000","last_unstale":"2024-04-19T04:28:39.760873+0000","last_undegraded":"2024-04-19T04:28:39.760873+0000","last_fullsized":"2024-04-19T04:28:39.760873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:39.760588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:39.760588+0000","last_clean_scrub_stamp":"2024-04-19T04:28:39.760588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:47:43.003181+0000","scrub_duration":0.020879537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:30:16.653700+0000","last_change":"2024-04-19T04:30:16.653995+0000","last_active":"2024-04-19T04:30:16.653700+0000","last_peered":"2024-04-19T04:30:16.653700+0000","last_clean":"2024-04-19T04:30:16.653700+0000","last_became_active":"2024-04-19T04:28:02.637746+0000","last_became_peered":"2024-04-19T04:28:02.637746+0000","last_unstale":"2024-04-19T04:30:16.653700+0000","last_undegraded":"2024-04-19T04:30:16.653700+0000","last_fullsized":"2024-04-19T04:30:16.653700+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:30:16.653651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:30:16.653651+0000","last_clean_scrub_stamp":"2024-04-19T04:30:16.653651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:02.907816+0000","scrub_duration":0.0032668609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:30.172464+0000","last_change":"2024-04-19T04:29:30.172655+0000","last_active":"2024-04-19T04:29:30.172464+0000","last_peered":"2024-04-19T04:29:30.172464+0000","last_clean":"2024-04-19T04:29:30.172464+0000","last_became_active":"2024-04-19T04:28:02.839203+0000","last_became_peered":"2024-04-19T04:28:02.839203+0000","last_unstale":"2024-04-19T04:29:30.172464+0000","last_undegraded":"2024-04-19T04:29:30.172464+0000","last_fullsized":"2024-04-19T04:29:30.172464+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:30.172421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:30.172421+0000","last_clean_scrub_stamp":"2024-04-19T04:29:30.172421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:42:16.051310+0000","scrub_duration":0.031415525999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:19.483877+0000","last_change":"2024-04-19T04:29:19.484216+0000","last_active":"2024-04-19T04:29:19.483877+0000","last_peered":"2024-04-19T04:29:19.483877+0000","last_clean":"2024-04-19T04:29:19.483877+0000","last_became_active":"2024-04-19T04:28:12.092924+0000","last_became_peered":"2024-04-19T04:28:12.092924+0000","last_unstale":"2024-04-19T04:29:19.483877+0000","last_undegraded":"2024-04-19T04:29:19.483877+0000","last_fullsized":"2024-04-19T04:29:19.483877+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:19.483790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:19.483790+0000","last_clean_scrub_stamp":"2024-04-19T04:29:19.483790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:54.022997+0000","scrub_duration":0.0033506920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:19.481896+0000","last_change":"2024-04-19T04:28:02.636293+0000","last_active":"2024-04-19T04:28:19.481896+0000","last_peered":"2024-04-19T04:28:19.481896+0000","last_clean":"2024-04-19T04:28:19.481896+0000","last_became_active":"2024-04-19T04:28:02.635946+0000","last_became_peered":"2024-04-19T04:28:02.635946+0000","last_unstale":"2024-04-19T04:28:19.481896+0000","last_undegraded":"2024-04-19T04:28:19.481896+0000","last_fullsized":"2024-04-19T04:28:19.481896+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:24:20.154964+0000","last_clean_scrub_stamp":"2024-04-19T04:24:20.154964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:35.526927+0000","last_change":"2024-04-19T04:28:35.527163+0000","last_active":"2024-04-19T04:28:35.526927+0000","last_peered":"2024-04-19T04:28:35.526927+0000","last_clean":"2024-04-19T04:28:35.526927+0000","last_became_active":"2024-04-19T04:28:12.094753+0000","last_became_peered":"2024-04-19T04:28:12.094753+0000","last_unstale":"2024-04-19T04:28:35.526927+0000","last_undegraded":"2024-04-19T04:28:35.526927+0000","last_fullsized":"2024-04-19T04:28:35.526927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:35.526884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:35.526884+0000","last_clean_scrub_stamp":"2024-04-19T04:28:35.526884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:06:35.618252+0000","scrub_duration":0.0031760289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:47.475887+0000","last_change":"2024-04-19T04:28:47.475887+0000","last_active":"2024-04-19T04:28:47.475887+0000","last_peered":"2024-04-19T04:28:47.475887+0000","last_clean":"2024-04-19T04:28:47.475887+0000","last_became_active":"2024-04-19T04:28:12.093267+0000","last_became_peered":"2024-04-19T04:28:12.093267+0000","last_unstale":"2024-04-19T04:28:47.475887+0000","last_undegraded":"2024-04-19T04:28:47.475887+0000","last_fullsized":"2024-04-19T04:28:47.475887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:47.475618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:47.475618+0000","last_clean_scrub_stamp":"2024-04-19T04:28:47.475618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:37.519624+0000","scrub_duration":0.022523944000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:23.449786+0000","last_change":"2024-04-19T04:28:23.449786+0000","last_active":"2024-04-19T04:28:23.449786+0000","last_peered":"2024-04-19T04:28:23.449786+0000","last_clean":"2024-04-19T04:28:23.449786+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:28:23.449786+0000","last_undegraded":"2024-04-19T04:28:23.449786+0000","last_fullsized":"2024-04-19T04:28:23.449786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:23.449500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:23.449500+0000","last_clean_scrub_stamp":"2024-04-19T04:28:23.449500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:20.102454+0000","scrub_duration":0.0033193469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:30:07.744191+0000","last_change":"2024-04-19T04:30:07.744580+0000","last_active":"2024-04-19T04:30:07.744191+0000","last_peered":"2024-04-19T04:30:07.744191+0000","last_clean":"2024-04-19T04:30:07.744191+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:30:07.744191+0000","last_undegraded":"2024-04-19T04:30:07.744191+0000","last_fullsized":"2024-04-19T04:30:07.744191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:30:07.744132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:30:07.744132+0000","last_clean_scrub_stamp":"2024-04-19T04:30:07.744132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:43.075844+0000","scrub_duration":0.0032714910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:33.597905+0000","last_change":"2024-04-19T04:28:33.597905+0000","last_active":"2024-04-19T04:28:33.597905+0000","last_peered":"2024-04-19T04:28:33.597905+0000","last_clean":"2024-04-19T04:28:33.597905+0000","last_became_active":"2024-04-19T04:28:02.637920+0000","last_became_peered":"2024-04-19T04:28:02.637920+0000","last_unstale":"2024-04-19T04:28:33.597905+0000","last_undegraded":"2024-04-19T04:28:33.597905+0000","last_fullsized":"2024-04-19T04:28:33.597905+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:33.597411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:33.597411+0000","last_clean_scrub_stamp":"2024-04-19T04:28:33.597411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:50.250390+0000","scrub_duration":0.0037610339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:42.236755+0000","last_change":"2024-04-19T04:28:42.236755+0000","last_active":"2024-04-19T04:28:42.236755+0000","last_peered":"2024-04-19T04:28:42.236755+0000","last_clean":"2024-04-19T04:28:42.236755+0000","last_became_active":"2024-04-19T04:28:02.839071+0000","last_became_peered":"2024-04-19T04:28:02.839071+0000","last_unstale":"2024-04-19T04:28:42.236755+0000","last_undegraded":"2024-04-19T04:28:42.236755+0000","last_fullsized":"2024-04-19T04:28:42.236755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:42.236604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:42.236604+0000","last_clean_scrub_stamp":"2024-04-19T04:28:42.236604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:47:48.663058+0000","scrub_duration":0.070531359000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:06.456011+0000","last_change":"2024-04-19T04:29:06.456366+0000","last_active":"2024-04-19T04:29:06.456011+0000","last_peered":"2024-04-19T04:29:06.456011+0000","last_clean":"2024-04-19T04:29:06.456011+0000","last_became_active":"2024-04-19T04:28:02.638230+0000","last_became_peered":"2024-04-19T04:28:02.638230+0000","last_unstale":"2024-04-19T04:29:06.456011+0000","last_undegraded":"2024-04-19T04:29:06.456011+0000","last_fullsized":"2024-04-19T04:29:06.456011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:06.455968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:06.455968+0000","last_clean_scrub_stamp":"2024-04-19T04:29:06.455968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:03.426117+0000","scrub_duration":0.0030903710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:31.226446+0000","last_change":"2024-04-19T04:28:31.226446+0000","last_active":"2024-04-19T04:28:31.226446+0000","last_peered":"2024-04-19T04:28:31.226446+0000","last_clean":"2024-04-19T04:28:31.226446+0000","last_became_active":"2024-04-19T04:28:02.839362+0000","last_became_peered":"2024-04-19T04:28:02.839362+0000","last_unstale":"2024-04-19T04:28:31.226446+0000","last_undegraded":"2024-04-19T04:28:31.226446+0000","last_fullsized":"2024-04-19T04:28:31.226446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:31.226291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:31.226291+0000","last_clean_scrub_stamp":"2024-04-19T04:28:31.226291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:43:05.235533+0000","scrub_duration":0.029412667999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:28.516191+0000","last_change":"2024-04-19T04:28:28.516191+0000","last_active":"2024-04-19T04:28:28.516191+0000","last_peered":"2024-04-19T04:28:28.516191+0000","last_clean":"2024-04-19T04:28:28.516191+0000","last_became_active":"2024-04-19T04:28:02.634835+0000","last_became_peered":"2024-04-19T04:28:02.634835+0000","last_unstale":"2024-04-19T04:28:28.516191+0000","last_undegraded":"2024-04-19T04:28:28.516191+0000","last_fullsized":"2024-04-19T04:28:28.516191+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:28.515710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:28.515710+0000","last_clean_scrub_stamp":"2024-04-19T04:28:28.515710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:46.923636+0000","scrub_duration":0.0034446709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:10.768430+0000","last_change":"2024-04-19T04:29:10.768757+0000","last_active":"2024-04-19T04:29:10.768430+0000","last_peered":"2024-04-19T04:29:10.768430+0000","last_clean":"2024-04-19T04:29:10.768430+0000","last_became_active":"2024-04-19T04:28:02.638546+0000","last_became_peered":"2024-04-19T04:28:02.638546+0000","last_unstale":"2024-04-19T04:29:10.768430+0000","last_undegraded":"2024-04-19T04:29:10.768430+0000","last_fullsized":"2024-04-19T04:29:10.768430+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:10.768364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:10.768364+0000","last_clean_scrub_stamp":"2024-04-19T04:29:10.768364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:36.009796+0000","scrub_duration":0.042629556999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:49.435023+0000","last_change":"2024-04-19T04:28:49.435301+0000","last_active":"2024-04-19T04:28:49.435023+0000","last_peered":"2024-04-19T04:28:49.435023+0000","last_clean":"2024-04-19T04:28:49.435023+0000","last_became_active":"2024-04-19T04:28:12.087571+0000","last_became_peered":"2024-04-19T04:28:12.087571+0000","last_unstale":"2024-04-19T04:28:49.435023+0000","last_undegraded":"2024-04-19T04:28:49.435023+0000","last_fullsized":"2024-04-19T04:28:49.435023+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:49.434979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:49.434979+0000","last_clean_scrub_stamp":"2024-04-19T04:28:49.434979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:46.111742+0000","scrub_duration":0.003316786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:34.194663+0000","last_change":"2024-04-19T04:28:34.194663+0000","last_active":"2024-04-19T04:28:34.194663+0000","last_peered":"2024-04-19T04:28:34.194663+0000","last_clean":"2024-04-19T04:28:34.194663+0000","last_became_active":"2024-04-19T04:28:02.840294+0000","last_became_peered":"2024-04-19T04:28:02.840294+0000","last_unstale":"2024-04-19T04:28:34.194663+0000","last_undegraded":"2024-04-19T04:28:34.194663+0000","last_fullsized":"2024-04-19T04:28:34.194663+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:34.194285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:34.194285+0000","last_clean_scrub_stamp":"2024-04-19T04:28:34.194285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:53:04.918350+0000","scrub_duration":0.0033717299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:18.460467+0000","last_change":"2024-04-19T04:29:18.460690+0000","last_active":"2024-04-19T04:29:18.460467+0000","last_peered":"2024-04-19T04:29:18.460467+0000","last_clean":"2024-04-19T04:29:18.460467+0000","last_became_active":"2024-04-19T04:28:12.089918+0000","last_became_peered":"2024-04-19T04:28:12.089918+0000","last_unstale":"2024-04-19T04:29:18.460467+0000","last_undegraded":"2024-04-19T04:29:18.460467+0000","last_fullsized":"2024-04-19T04:29:18.460467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:18.460425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:18.460425+0000","last_clean_scrub_stamp":"2024-04-19T04:29:18.460425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:09:31.294234+0000","scrub_duration":0.0033207029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:29.524463+0000","last_change":"2024-04-19T04:29:29.524562+0000","last_active":"2024-04-19T04:29:29.524463+0000","last_peered":"2024-04-19T04:29:29.524463+0000","last_clean":"2024-04-19T04:29:29.524463+0000","last_became_active":"2024-04-19T04:28:12.091770+0000","last_became_peered":"2024-04-19T04:28:12.091770+0000","last_unstale":"2024-04-19T04:29:29.524463+0000","last_undegraded":"2024-04-19T04:29:29.524463+0000","last_fullsized":"2024-04-19T04:29:29.524463+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:29.524443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:29.524443+0000","last_clean_scrub_stamp":"2024-04-19T04:29:29.524443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:53.181371+0000","scrub_duration":0.054287891999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:31.122032+0000","last_change":"2024-04-19T04:29:31.122032+0000","last_active":"2024-04-19T04:29:31.122032+0000","last_peered":"2024-04-19T04:29:31.122032+0000","last_clean":"2024-04-19T04:29:31.122032+0000","last_became_active":"2024-04-19T04:28:02.845416+0000","last_became_peered":"2024-04-19T04:28:02.845416+0000","last_unstale":"2024-04-19T04:29:31.122032+0000","last_undegraded":"2024-04-19T04:29:31.122032+0000","last_fullsized":"2024-04-19T04:29:31.122032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:31.121613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:31.121613+0000","last_clean_scrub_stamp":"2024-04-19T04:29:31.121613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:10:28.928808+0000","scrub_duration":0.0037616049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:30:17.617326+0000","last_change":"2024-04-19T04:30:17.617548+0000","last_active":"2024-04-19T04:30:17.617326+0000","last_peered":"2024-04-19T04:30:17.617326+0000","last_clean":"2024-04-19T04:30:17.617326+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:30:17.617326+0000","last_undegraded":"2024-04-19T04:30:17.617326+0000","last_fullsized":"2024-04-19T04:30:17.617326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:30:17.617271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:30:17.617271+0000","last_clean_scrub_stamp":"2024-04-19T04:30:17.617271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:15.648597+0000","scrub_duration":0.0030849660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:00.393690+0000","last_change":"2024-04-19T04:29:00.393991+0000","last_active":"2024-04-19T04:29:00.393690+0000","last_peered":"2024-04-19T04:29:00.393690+0000","last_clean":"2024-04-19T04:29:00.393690+0000","last_became_active":"2024-04-19T04:28:12.091969+0000","last_became_peered":"2024-04-19T04:28:12.091969+0000","last_unstale":"2024-04-19T04:29:00.393690+0000","last_undegraded":"2024-04-19T04:29:00.393690+0000","last_fullsized":"2024-04-19T04:29:00.393690+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:00.393643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:00.393643+0000","last_clean_scrub_stamp":"2024-04-19T04:29:00.393643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:43:09.339689+0000","scrub_duration":0.0029687910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:19.135893+0000","last_change":"2024-04-19T04:29:19.135893+0000","last_active":"2024-04-19T04:29:19.135893+0000","last_peered":"2024-04-19T04:29:19.135893+0000","last_clean":"2024-04-19T04:29:19.135893+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:29:19.135893+0000","last_undegraded":"2024-04-19T04:29:19.135893+0000","last_fullsized":"2024-04-19T04:29:19.135893+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:19.135719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:19.135719+0000","last_clean_scrub_stamp":"2024-04-19T04:29:19.135719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:18:22.526783+0000","scrub_duration":0.029313573999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:05.491064+0000","last_change":"2024-04-19T04:29:05.491373+0000","last_active":"2024-04-19T04:29:05.491064+0000","last_peered":"2024-04-19T04:29:05.491064+0000","last_clean":"2024-04-19T04:29:05.491064+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:29:05.491064+0000","last_undegraded":"2024-04-19T04:29:05.491064+0000","last_fullsized":"2024-04-19T04:29:05.491064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:05.491021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:05.491021+0000","last_clean_scrub_stamp":"2024-04-19T04:29:05.491021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:44.053244+0000","scrub_duration":0.0032047590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:13.152726+0000","last_change":"2024-04-19T04:29:13.152726+0000","last_active":"2024-04-19T04:29:13.152726+0000","last_peered":"2024-04-19T04:29:13.152726+0000","last_clean":"2024-04-19T04:29:13.152726+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:29:13.152726+0000","last_undegraded":"2024-04-19T04:29:13.152726+0000","last_fullsized":"2024-04-19T04:29:13.152726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:13.152340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:13.152340+0000","last_clean_scrub_stamp":"2024-04-19T04:29:13.152340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:11:50.888946+0000","scrub_duration":0.0034040730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:16.704532+0000","last_change":"2024-04-19T04:29:16.704756+0000","last_active":"2024-04-19T04:29:16.704532+0000","last_peered":"2024-04-19T04:29:16.704532+0000","last_clean":"2024-04-19T04:29:16.704532+0000","last_became_active":"2024-04-19T04:28:02.634586+0000","last_became_peered":"2024-04-19T04:28:02.634586+0000","last_unstale":"2024-04-19T04:29:16.704532+0000","last_undegraded":"2024-04-19T04:29:16.704532+0000","last_fullsized":"2024-04-19T04:29:16.704532+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:16.704476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:16.704476+0000","last_clean_scrub_stamp":"2024-04-19T04:29:16.704476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:05.468791+0000","scrub_duration":0.0032163460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:48.475080+0000","last_change":"2024-04-19T04:28:48.475080+0000","last_active":"2024-04-19T04:28:48.475080+0000","last_peered":"2024-04-19T04:28:48.475080+0000","last_clean":"2024-04-19T04:28:48.475080+0000","last_became_active":"2024-04-19T04:28:12.094558+0000","last_became_peered":"2024-04-19T04:28:12.094558+0000","last_unstale":"2024-04-19T04:28:48.475080+0000","last_undegraded":"2024-04-19T04:28:48.475080+0000","last_fullsized":"2024-04-19T04:28:48.475080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:48.474816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:48.474816+0000","last_clean_scrub_stamp":"2024-04-19T04:28:48.474816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:45.127770+0000","scrub_duration":0.003339912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"79'4","reported_seq":102,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:59.874932+0000","last_change":"2024-04-19T04:28:59.874932+0000","last_active":"2024-04-19T04:28:59.874932+0000","last_peered":"2024-04-19T04:28:59.874932+0000","last_clean":"2024-04-19T04:28:59.874932+0000","last_became_active":"2024-04-19T04:28:02.638666+0000","last_became_peered":"2024-04-19T04:28:02.638666+0000","last_unstale":"2024-04-19T04:28:59.874932+0000","last_undegraded":"2024-04-19T04:28:59.874932+0000","last_fullsized":"2024-04-19T04:28:59.874932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-04-19T04:28:59.874627+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-04-19T04:28:59.874627+0000","last_clean_scrub_stamp":"2024-04-19T04:28:59.874627+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:20:56.884252+0000","scrub_duration":0.0061750349999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:27.505148+0000","last_change":"2024-04-19T04:29:27.505394+0000","last_active":"2024-04-19T04:29:27.505148+0000","last_peered":"2024-04-19T04:29:27.505148+0000","last_clean":"2024-04-19T04:29:27.505148+0000","last_became_active":"2024-04-19T04:28:12.094722+0000","last_became_peered":"2024-04-19T04:28:12.094722+0000","last_unstale":"2024-04-19T04:29:27.505148+0000","last_undegraded":"2024-04-19T04:29:27.505148+0000","last_fullsized":"2024-04-19T04:29:27.505148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:27.505100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:27.505100+0000","last_clean_scrub_stamp":"2024-04-19T04:29:27.505100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:36:45.754653+0000","scrub_duration":0.021590518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:37.122327+0000","last_change":"2024-04-19T04:29:37.122327+0000","last_active":"2024-04-19T04:29:37.122327+0000","last_peered":"2024-04-19T04:29:37.122327+0000","last_clean":"2024-04-19T04:29:37.122327+0000","last_became_active":"2024-04-19T04:28:02.842525+0000","last_became_peered":"2024-04-19T04:28:02.842525+0000","last_unstale":"2024-04-19T04:29:37.122327+0000","last_undegraded":"2024-04-19T04:29:37.122327+0000","last_fullsized":"2024-04-19T04:29:37.122327+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:37.122023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:37.122023+0000","last_clean_scrub_stamp":"2024-04-19T04:29:37.122023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:58:29.627789+0000","scrub_duration":0.003440088,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.151861+0000","last_change":"2024-04-19T04:28:40.152096+0000","last_active":"2024-04-19T04:28:40.151861+0000","last_peered":"2024-04-19T04:28:40.151861+0000","last_clean":"2024-04-19T04:28:40.151861+0000","last_became_active":"2024-04-19T04:28:02.843099+0000","last_became_peered":"2024-04-19T04:28:02.843099+0000","last_unstale":"2024-04-19T04:28:40.151861+0000","last_undegraded":"2024-04-19T04:28:40.151861+0000","last_fullsized":"2024-04-19T04:28:40.151861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.151812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.151812+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.151812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:19.753268+0000","scrub_duration":0.0030712460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:29.541159+0000","last_change":"2024-04-19T04:28:29.541420+0000","last_active":"2024-04-19T04:28:29.541159+0000","last_peered":"2024-04-19T04:28:29.541159+0000","last_clean":"2024-04-19T04:28:29.541159+0000","last_became_active":"2024-04-19T04:28:12.091771+0000","last_became_peered":"2024-04-19T04:28:12.091771+0000","last_unstale":"2024-04-19T04:28:29.541159+0000","last_undegraded":"2024-04-19T04:28:29.541159+0000","last_fullsized":"2024-04-19T04:28:29.541159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:29.541116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:29.541116+0000","last_clean_scrub_stamp":"2024-04-19T04:28:29.541116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:42.022636+0000","scrub_duration":0.0033350189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:29.182019+0000","last_change":"2024-04-19T04:29:29.182338+0000","last_active":"2024-04-19T04:29:29.182019+0000","last_peered":"2024-04-19T04:29:29.182019+0000","last_clean":"2024-04-19T04:29:29.182019+0000","last_became_active":"2024-04-19T04:28:02.836984+0000","last_became_peered":"2024-04-19T04:28:02.836984+0000","last_unstale":"2024-04-19T04:29:29.182019+0000","last_undegraded":"2024-04-19T04:29:29.182019+0000","last_fullsized":"2024-04-19T04:29:29.182019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:29.181949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:29.181949+0000","last_clean_scrub_stamp":"2024-04-19T04:29:29.181949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:05:44.642227+0000","scrub_duration":0.072525754999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"79'12","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:55.744975+0000","last_change":"2024-04-19T04:29:55.745224+0000","last_active":"2024-04-19T04:29:55.744975+0000","last_peered":"2024-04-19T04:29:55.744975+0000","last_clean":"2024-04-19T04:29:55.744975+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:29:55.744975+0000","last_undegraded":"2024-04-19T04:29:55.744975+0000","last_fullsized":"2024-04-19T04:29:55.744975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-04-19T04:29:55.744918+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-04-19T04:29:55.744918+0000","last_clean_scrub_stamp":"2024-04-19T04:29:55.744918+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:39.067810+0000","scrub_duration":0.010162294000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"79'2","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:14.682747+0000","last_change":"2024-04-19T04:29:14.683190+0000","last_active":"2024-04-19T04:29:14.682747+0000","last_peered":"2024-04-19T04:29:14.682747+0000","last_clean":"2024-04-19T04:29:14.682747+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:29:14.682747+0000","last_undegraded":"2024-04-19T04:29:14.682747+0000","last_fullsized":"2024-04-19T04:29:14.682747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-19T04:29:14.682697+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-19T04:29:14.682697+0000","last_clean_scrub_stamp":"2024-04-19T04:29:14.682697+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:35.626266+0000","scrub_duration":0.006337891,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:15.540432+0000","last_change":"2024-04-19T04:29:15.540650+0000","last_active":"2024-04-19T04:29:15.540432+0000","last_peered":"2024-04-19T04:29:15.540432+0000","last_clean":"2024-04-19T04:29:15.540432+0000","last_became_active":"2024-04-19T04:28:12.090379+0000","last_became_peered":"2024-04-19T04:28:12.090379+0000","last_unstale":"2024-04-19T04:29:15.540432+0000","last_undegraded":"2024-04-19T04:29:15.540432+0000","last_fullsized":"2024-04-19T04:29:15.540432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:15.540388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:15.540388+0000","last_clean_scrub_stamp":"2024-04-19T04:29:15.540388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:58:31.906342+0000","scrub_duration":0.0035449280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"79'3","reported_seq":46,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:30.448918+0000","last_change":"2024-04-19T04:29:30.449147+0000","last_active":"2024-04-19T04:29:30.448918+0000","last_peered":"2024-04-19T04:29:30.448918+0000","last_clean":"2024-04-19T04:29:30.448918+0000","last_became_active":"2024-04-19T04:28:12.089948+0000","last_became_peered":"2024-04-19T04:28:12.089948+0000","last_unstale":"2024-04-19T04:29:30.448918+0000","last_undegraded":"2024-04-19T04:29:30.448918+0000","last_fullsized":"2024-04-19T04:29:30.448918+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:29:30.448862+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:29:30.448862+0000","last_clean_scrub_stamp":"2024-04-19T04:29:30.448862+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:55.690294+0000","scrub_duration":0.0062853340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:57.409585+0000","last_change":"2024-04-19T04:28:57.409839+0000","last_active":"2024-04-19T04:28:57.409585+0000","last_peered":"2024-04-19T04:28:57.409585+0000","last_clean":"2024-04-19T04:28:57.409585+0000","last_became_active":"2024-04-19T04:28:12.093090+0000","last_became_peered":"2024-04-19T04:28:12.093090+0000","last_unstale":"2024-04-19T04:28:57.409585+0000","last_undegraded":"2024-04-19T04:28:57.409585+0000","last_fullsized":"2024-04-19T04:28:57.409585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:57.409536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:57.409536+0000","last_clean_scrub_stamp":"2024-04-19T04:28:57.409536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:58:14.062514+0000","scrub_duration":0.0034988459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"79'2","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:51.726306+0000","last_change":"2024-04-19T04:28:51.726306+0000","last_active":"2024-04-19T04:28:51.726306+0000","last_peered":"2024-04-19T04:28:51.726306+0000","last_clean":"2024-04-19T04:28:51.726306+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:28:51.726306+0000","last_undegraded":"2024-04-19T04:28:51.726306+0000","last_fullsized":"2024-04-19T04:28:51.726306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-19T04:28:51.725876+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-19T04:28:51.725876+0000","last_clean_scrub_stamp":"2024-04-19T04:28:51.725876+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:17.429863+0000","scrub_duration":0.0062414059999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:13.724370+0000","last_change":"2024-04-19T04:29:13.724590+0000","last_active":"2024-04-19T04:29:13.724370+0000","last_peered":"2024-04-19T04:29:13.724370+0000","last_clean":"2024-04-19T04:29:13.724370+0000","last_became_active":"2024-04-19T04:28:02.636231+0000","last_became_peered":"2024-04-19T04:28:02.636231+0000","last_unstale":"2024-04-19T04:29:13.724370+0000","last_undegraded":"2024-04-19T04:29:13.724370+0000","last_fullsized":"2024-04-19T04:29:13.724370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:13.724320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:13.724320+0000","last_clean_scrub_stamp":"2024-04-19T04:29:13.724320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:30:36.014677+0000","scrub_duration":0.0034525440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:19.699868+0000","last_change":"2024-04-19T04:29:19.700106+0000","last_active":"2024-04-19T04:29:19.699868+0000","last_peered":"2024-04-19T04:29:19.699868+0000","last_clean":"2024-04-19T04:29:19.699868+0000","last_became_active":"2024-04-19T04:28:02.634823+0000","last_became_peered":"2024-04-19T04:28:02.634823+0000","last_unstale":"2024-04-19T04:29:19.699868+0000","last_undegraded":"2024-04-19T04:29:19.699868+0000","last_fullsized":"2024-04-19T04:29:19.699868+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:19.699822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:19.699822+0000","last_clean_scrub_stamp":"2024-04-19T04:29:19.699822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:29:33.297820+0000","scrub_duration":0.003354863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:56.250708+0000","last_change":"2024-04-19T04:28:56.250708+0000","last_active":"2024-04-19T04:28:56.250708+0000","last_peered":"2024-04-19T04:28:56.250708+0000","last_clean":"2024-04-19T04:28:56.250708+0000","last_became_active":"2024-04-19T04:28:02.845461+0000","last_became_peered":"2024-04-19T04:28:02.845461+0000","last_unstale":"2024-04-19T04:28:56.250708+0000","last_undegraded":"2024-04-19T04:28:56.250708+0000","last_fullsized":"2024-04-19T04:28:56.250708+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:56.250557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:56.250557+0000","last_clean_scrub_stamp":"2024-04-19T04:28:56.250557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:56.014220+0000","scrub_duration":0.029538265000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:46.247247+0000","last_change":"2024-04-19T04:28:46.247247+0000","last_active":"2024-04-19T04:28:46.247247+0000","last_peered":"2024-04-19T04:28:46.247247+0000","last_clean":"2024-04-19T04:28:46.247247+0000","last_became_active":"2024-04-19T04:28:02.844927+0000","last_became_peered":"2024-04-19T04:28:02.844927+0000","last_unstale":"2024-04-19T04:28:46.247247+0000","last_undegraded":"2024-04-19T04:28:46.247247+0000","last_fullsized":"2024-04-19T04:28:46.247247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:28:46.246777+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:28:46.246777+0000","last_clean_scrub_stamp":"2024-04-19T04:28:46.246777+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:37:56.201762+0000","scrub_duration":0.006831213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:58.824983+0000","last_change":"2024-04-19T04:28:58.825209+0000","last_active":"2024-04-19T04:28:58.824983+0000","last_peered":"2024-04-19T04:28:58.824983+0000","last_clean":"2024-04-19T04:28:58.824983+0000","last_became_active":"2024-04-19T04:28:02.635238+0000","last_became_peered":"2024-04-19T04:28:02.635238+0000","last_unstale":"2024-04-19T04:28:58.824983+0000","last_undegraded":"2024-04-19T04:28:58.824983+0000","last_fullsized":"2024-04-19T04:28:58.824983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:58.824931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:58.824931+0000","last_clean_scrub_stamp":"2024-04-19T04:28:58.824931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:33.364138+0000","scrub_duration":0.0033677389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:49.632835+0000","last_change":"2024-04-19T04:29:49.633086+0000","last_active":"2024-04-19T04:29:49.632835+0000","last_peered":"2024-04-19T04:29:49.632835+0000","last_clean":"2024-04-19T04:29:49.632835+0000","last_became_active":"2024-04-19T04:28:02.637651+0000","last_became_peered":"2024-04-19T04:28:02.637651+0000","last_unstale":"2024-04-19T04:29:49.632835+0000","last_undegraded":"2024-04-19T04:29:49.632835+0000","last_fullsized":"2024-04-19T04:29:49.632835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:49.632785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:49.632785+0000","last_clean_scrub_stamp":"2024-04-19T04:29:49.632785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:12:59.944414+0000","scrub_duration":0.0031670999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.710088+0000","last_change":"2024-04-19T04:28:40.710088+0000","last_active":"2024-04-19T04:28:40.710088+0000","last_peered":"2024-04-19T04:28:40.710088+0000","last_clean":"2024-04-19T04:28:40.710088+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:28:40.710088+0000","last_undegraded":"2024-04-19T04:28:40.710088+0000","last_fullsized":"2024-04-19T04:28:40.710088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.709702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.709702+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.709702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:24.831215+0000","scrub_duration":0.0033854829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:04.490301+0000","last_change":"2024-04-19T04:29:04.490555+0000","last_active":"2024-04-19T04:29:04.490301+0000","last_peered":"2024-04-19T04:29:04.490301+0000","last_clean":"2024-04-19T04:29:04.490301+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:29:04.490301+0000","last_undegraded":"2024-04-19T04:29:04.490301+0000","last_fullsized":"2024-04-19T04:29:04.490301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:04.490250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:04.490250+0000","last_clean_scrub_stamp":"2024-04-19T04:29:04.490250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:48.611763+0000","scrub_duration":0.003278235,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:06.705490+0000","last_change":"2024-04-19T04:29:06.705866+0000","last_active":"2024-04-19T04:29:06.705490+0000","last_peered":"2024-04-19T04:29:06.705490+0000","last_clean":"2024-04-19T04:29:06.705490+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:29:06.705490+0000","last_undegraded":"2024-04-19T04:29:06.705490+0000","last_fullsized":"2024-04-19T04:29:06.705490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:06.705384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:06.705384+0000","last_clean_scrub_stamp":"2024-04-19T04:29:06.705384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:57.321888+0000","scrub_duration":0.003745515,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.494052+0000","last_change":"2024-04-19T04:28:40.494052+0000","last_active":"2024-04-19T04:28:40.494052+0000","last_peered":"2024-04-19T04:28:40.494052+0000","last_clean":"2024-04-19T04:28:40.494052+0000","last_became_active":"2024-04-19T04:28:12.088043+0000","last_became_peered":"2024-04-19T04:28:12.088043+0000","last_unstale":"2024-04-19T04:28:40.494052+0000","last_undegraded":"2024-04-19T04:28:40.494052+0000","last_fullsized":"2024-04-19T04:28:40.494052+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.493585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.493585+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.493585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:22:36.746203+0000","scrub_duration":0.0035336780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:39.119269+0000","last_change":"2024-04-19T04:29:39.119269+0000","last_active":"2024-04-19T04:29:39.119269+0000","last_peered":"2024-04-19T04:29:39.119269+0000","last_clean":"2024-04-19T04:29:39.119269+0000","last_became_active":"2024-04-19T04:28:02.843639+0000","last_became_peered":"2024-04-19T04:28:02.843639+0000","last_unstale":"2024-04-19T04:29:39.119269+0000","last_undegraded":"2024-04-19T04:29:39.119269+0000","last_fullsized":"2024-04-19T04:29:39.119269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:39.119118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:39.119118+0000","last_clean_scrub_stamp":"2024-04-19T04:29:39.119118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:21:58.336649+0000","scrub_duration":0.057465321999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'159","reported_seq":290,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:25.641698+0000","last_change":"2024-04-19T04:29:25.641698+0000","last_active":"2024-04-19T04:29:25.641698+0000","last_peered":"2024-04-19T04:29:25.641698+0000","last_clean":"2024-04-19T04:29:25.641698+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:29:25.641698+0000","last_undegraded":"2024-04-19T04:29:25.641698+0000","last_fullsized":"2024-04-19T04:29:25.641698+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'159","last_scrub_stamp":"2024-04-19T04:29:25.641417+0000","last_deep_scrub":"79'159","last_deep_scrub_stamp":"2024-04-19T04:29:25.641417+0000","last_clean_scrub_stamp":"2024-04-19T04:29:25.641417+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:59.525050+0000","scrub_duration":0.011440092000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":101,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:45.666725+0000","last_change":"2024-04-19T04:29:45.666956+0000","last_active":"2024-04-19T04:29:45.666725+0000","last_peered":"2024-04-19T04:29:45.666725+0000","last_clean":"2024-04-19T04:29:45.666725+0000","last_became_active":"2024-04-19T04:28:02.639240+0000","last_became_peered":"2024-04-19T04:28:02.639240+0000","last_unstale":"2024-04-19T04:29:45.666725+0000","last_undegraded":"2024-04-19T04:29:45.666725+0000","last_fullsized":"2024-04-19T04:29:45.666725+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:45.666680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:45.666680+0000","last_clean_scrub_stamp":"2024-04-19T04:29:45.666680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:54:24.509719+0000","scrub_duration":0.0031594069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:45.150985+0000","last_change":"2024-04-19T04:29:45.150985+0000","last_active":"2024-04-19T04:29:45.150985+0000","last_peered":"2024-04-19T04:29:45.150985+0000","last_clean":"2024-04-19T04:29:45.150985+0000","last_became_active":"2024-04-19T04:28:02.841053+0000","last_became_peered":"2024-04-19T04:28:02.841053+0000","last_unstale":"2024-04-19T04:29:45.150985+0000","last_undegraded":"2024-04-19T04:29:45.150985+0000","last_fullsized":"2024-04-19T04:29:45.150985+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:45.150700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:45.150700+0000","last_clean_scrub_stamp":"2024-04-19T04:29:45.150700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:11:12.088151+0000","scrub_duration":0.003512416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:43.759501+0000","last_change":"2024-04-19T04:28:43.759738+0000","last_active":"2024-04-19T04:28:43.759501+0000","last_peered":"2024-04-19T04:28:43.759501+0000","last_clean":"2024-04-19T04:28:43.759501+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:28:43.759501+0000","last_undegraded":"2024-04-19T04:28:43.759501+0000","last_fullsized":"2024-04-19T04:28:43.759501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:43.759455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:43.759455+0000","last_clean_scrub_stamp":"2024-04-19T04:28:43.759455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:10.518057+0000","scrub_duration":0.0032782050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:32.629967+0000","last_change":"2024-04-19T04:29:32.629967+0000","last_active":"2024-04-19T04:29:32.629967+0000","last_peered":"2024-04-19T04:29:32.629967+0000","last_clean":"2024-04-19T04:29:32.629967+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:29:32.629967+0000","last_undegraded":"2024-04-19T04:29:32.629967+0000","last_fullsized":"2024-04-19T04:29:32.629967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:32.629512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:32.629512+0000","last_clean_scrub_stamp":"2024-04-19T04:29:32.629512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:40.130427+0000","scrub_duration":0.0033463669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:27.120166+0000","last_change":"2024-04-19T04:29:27.120166+0000","last_active":"2024-04-19T04:29:27.120166+0000","last_peered":"2024-04-19T04:29:27.120166+0000","last_clean":"2024-04-19T04:29:27.120166+0000","last_became_active":"2024-04-19T04:28:02.839926+0000","last_became_peered":"2024-04-19T04:28:02.839926+0000","last_unstale":"2024-04-19T04:29:27.120166+0000","last_undegraded":"2024-04-19T04:29:27.120166+0000","last_fullsized":"2024-04-19T04:29:27.120166+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:27.119885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:27.119885+0000","last_clean_scrub_stamp":"2024-04-19T04:29:27.119885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:23.826940+0000","scrub_duration":0.0034871469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:14.506307+0000","last_change":"2024-04-19T04:29:14.506535+0000","last_active":"2024-04-19T04:29:14.506307+0000","last_peered":"2024-04-19T04:29:14.506307+0000","last_clean":"2024-04-19T04:29:14.506307+0000","last_became_active":"2024-04-19T04:28:02.638095+0000","last_became_peered":"2024-04-19T04:28:02.638095+0000","last_unstale":"2024-04-19T04:29:14.506307+0000","last_undegraded":"2024-04-19T04:29:14.506307+0000","last_fullsized":"2024-04-19T04:29:14.506307+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:14.506264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:14.506264+0000","last_clean_scrub_stamp":"2024-04-19T04:29:14.506264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:39:27.629645+0000","scrub_duration":0.003222464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:21.158508+0000","last_change":"2024-04-19T04:28:21.158508+0000","last_active":"2024-04-19T04:28:21.158508+0000","last_peered":"2024-04-19T04:28:21.158508+0000","last_clean":"2024-04-19T04:28:21.158508+0000","last_became_active":"2024-04-19T04:28:02.840328+0000","last_became_peered":"2024-04-19T04:28:02.840328+0000","last_unstale":"2024-04-19T04:28:21.158508+0000","last_undegraded":"2024-04-19T04:28:21.158508+0000","last_fullsized":"2024-04-19T04:28:21.158508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:21.148887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:21.148887+0000","last_clean_scrub_stamp":"2024-04-19T04:28:21.148887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:44:55.928928+0000","scrub_duration":0.0038294929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":44,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:46.483620+0000","last_change":"2024-04-19T04:28:46.483620+0000","last_active":"2024-04-19T04:28:46.483620+0000","last_peered":"2024-04-19T04:28:46.483620+0000","last_clean":"2024-04-19T04:28:46.483620+0000","last_became_active":"2024-04-19T04:28:12.087575+0000","last_became_peered":"2024-04-19T04:28:12.087575+0000","last_unstale":"2024-04-19T04:28:46.483620+0000","last_undegraded":"2024-04-19T04:28:46.483620+0000","last_fullsized":"2024-04-19T04:28:46.483620+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:46.483271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:46.483271+0000","last_clean_scrub_stamp":"2024-04-19T04:28:46.483271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:13.971451+0000","scrub_duration":0.0034840449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:12.204263+0000","last_change":"2024-04-19T04:29:12.204263+0000","last_active":"2024-04-19T04:29:12.204263+0000","last_peered":"2024-04-19T04:29:12.204263+0000","last_clean":"2024-04-19T04:29:12.204263+0000","last_became_active":"2024-04-19T04:28:02.840839+0000","last_became_peered":"2024-04-19T04:28:02.840839+0000","last_unstale":"2024-04-19T04:29:12.204263+0000","last_undegraded":"2024-04-19T04:29:12.204263+0000","last_fullsized":"2024-04-19T04:29:12.204263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:12.204121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:12.204121+0000","last_clean_scrub_stamp":"2024-04-19T04:29:12.204121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:20:20.194187+0000","scrub_duration":0.035589924000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":101,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:44.697676+0000","last_change":"2024-04-19T04:29:44.697951+0000","last_active":"2024-04-19T04:29:44.697676+0000","last_peered":"2024-04-19T04:29:44.697676+0000","last_clean":"2024-04-19T04:29:44.697676+0000","last_became_active":"2024-04-19T04:28:02.634633+0000","last_became_peered":"2024-04-19T04:28:02.634633+0000","last_unstale":"2024-04-19T04:29:44.697676+0000","last_undegraded":"2024-04-19T04:29:44.697676+0000","last_fullsized":"2024-04-19T04:29:44.697676+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:44.697628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:44.697628+0000","last_clean_scrub_stamp":"2024-04-19T04:29:44.697628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:42.440486+0000","scrub_duration":0.0034703999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:58.802323+0000","last_change":"2024-04-19T04:29:58.802663+0000","last_active":"2024-04-19T04:29:58.802323+0000","last_peered":"2024-04-19T04:29:58.802323+0000","last_clean":"2024-04-19T04:29:58.802323+0000","last_became_active":"2024-04-19T04:28:02.637233+0000","last_became_peered":"2024-04-19T04:28:02.637233+0000","last_unstale":"2024-04-19T04:29:58.802323+0000","last_undegraded":"2024-04-19T04:29:58.802323+0000","last_fullsized":"2024-04-19T04:29:58.802323+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:58.802266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:58.802266+0000","last_clean_scrub_stamp":"2024-04-19T04:29:58.802266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:55:10.441574+0000","scrub_duration":0.0033469329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:53.217334+0000","last_change":"2024-04-19T04:28:53.217334+0000","last_active":"2024-04-19T04:28:53.217334+0000","last_peered":"2024-04-19T04:28:53.217334+0000","last_clean":"2024-04-19T04:28:53.217334+0000","last_became_active":"2024-04-19T04:28:02.837829+0000","last_became_peered":"2024-04-19T04:28:02.837829+0000","last_unstale":"2024-04-19T04:28:53.217334+0000","last_undegraded":"2024-04-19T04:28:53.217334+0000","last_fullsized":"2024-04-19T04:28:53.217334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:53.216932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:53.216932+0000","last_clean_scrub_stamp":"2024-04-19T04:28:53.216932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:28:52.742878+0000","scrub_duration":0.0032988420000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:12.751225+0000","last_change":"2024-04-19T04:29:12.751447+0000","last_active":"2024-04-19T04:29:12.751225+0000","last_peered":"2024-04-19T04:29:12.751225+0000","last_clean":"2024-04-19T04:29:12.751225+0000","last_became_active":"2024-04-19T04:28:02.634103+0000","last_became_peered":"2024-04-19T04:28:02.634103+0000","last_unstale":"2024-04-19T04:29:12.751225+0000","last_undegraded":"2024-04-19T04:29:12.751225+0000","last_fullsized":"2024-04-19T04:29:12.751225+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:12.751168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:12.751168+0000","last_clean_scrub_stamp":"2024-04-19T04:29:12.751168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:41:03.146894+0000","scrub_duration":0.0031427569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:21.089183+0000","last_change":"2024-04-19T04:29:21.089183+0000","last_active":"2024-04-19T04:29:21.089183+0000","last_peered":"2024-04-19T04:29:21.089183+0000","last_clean":"2024-04-19T04:29:21.089183+0000","last_became_active":"2024-04-19T04:28:02.835057+0000","last_became_peered":"2024-04-19T04:28:02.835057+0000","last_unstale":"2024-04-19T04:29:21.089183+0000","last_undegraded":"2024-04-19T04:29:21.089183+0000","last_fullsized":"2024-04-19T04:29:21.089183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:21.088913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:21.088913+0000","last_clean_scrub_stamp":"2024-04-19T04:29:21.088913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:25:08.459261+0000","scrub_duration":0.0034193980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:12.560395+0000","last_change":"2024-04-19T04:29:12.560617+0000","last_active":"2024-04-19T04:29:12.560395+0000","last_peered":"2024-04-19T04:29:12.560395+0000","last_clean":"2024-04-19T04:29:12.560395+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:29:12.560395+0000","last_undegraded":"2024-04-19T04:29:12.560395+0000","last_fullsized":"2024-04-19T04:29:12.560395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:12.560352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:12.560352+0000","last_clean_scrub_stamp":"2024-04-19T04:29:12.560352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:21.470493+0000","scrub_duration":0.0033970480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:03.074082+0000","last_change":"2024-04-19T04:29:03.074082+0000","last_active":"2024-04-19T04:29:03.074082+0000","last_peered":"2024-04-19T04:29:03.074082+0000","last_clean":"2024-04-19T04:29:03.074082+0000","last_became_active":"2024-04-19T04:28:02.838918+0000","last_became_peered":"2024-04-19T04:28:02.838918+0000","last_unstale":"2024-04-19T04:29:03.074082+0000","last_undegraded":"2024-04-19T04:29:03.074082+0000","last_fullsized":"2024-04-19T04:29:03.074082+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:03.073680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:03.073680+0000","last_clean_scrub_stamp":"2024-04-19T04:29:03.073680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:34:04.411572+0000","scrub_duration":0.0031316450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:33.545214+0000","last_change":"2024-04-19T04:29:33.545495+0000","last_active":"2024-04-19T04:29:33.545214+0000","last_peered":"2024-04-19T04:29:33.545214+0000","last_clean":"2024-04-19T04:29:33.545214+0000","last_became_active":"2024-04-19T04:28:12.091609+0000","last_became_peered":"2024-04-19T04:28:12.091609+0000","last_unstale":"2024-04-19T04:29:33.545214+0000","last_undegraded":"2024-04-19T04:29:33.545214+0000","last_fullsized":"2024-04-19T04:29:33.545214+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:33.545166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:33.545166+0000","last_clean_scrub_stamp":"2024-04-19T04:29:33.545166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:30:55.835523+0000","scrub_duration":0.0030524910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:43.453593+0000","last_change":"2024-04-19T04:28:43.453593+0000","last_active":"2024-04-19T04:28:43.453593+0000","last_peered":"2024-04-19T04:28:43.453593+0000","last_clean":"2024-04-19T04:28:43.453593+0000","last_became_active":"2024-04-19T04:28:12.091335+0000","last_became_peered":"2024-04-19T04:28:12.091335+0000","last_unstale":"2024-04-19T04:28:43.453593+0000","last_undegraded":"2024-04-19T04:28:43.453593+0000","last_fullsized":"2024-04-19T04:28:43.453593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:43.453308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:43.453308+0000","last_clean_scrub_stamp":"2024-04-19T04:28:43.453308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:37:50.638133+0000","scrub_duration":0.0032802869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:45.236529+0000","last_change":"2024-04-19T04:28:45.236529+0000","last_active":"2024-04-19T04:28:45.236529+0000","last_peered":"2024-04-19T04:28:45.236529+0000","last_clean":"2024-04-19T04:28:45.236529+0000","last_became_active":"2024-04-19T04:28:02.839883+0000","last_became_peered":"2024-04-19T04:28:02.839883+0000","last_unstale":"2024-04-19T04:28:45.236529+0000","last_undegraded":"2024-04-19T04:28:45.236529+0000","last_fullsized":"2024-04-19T04:28:45.236529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:28:45.236116+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:28:45.236116+0000","last_clean_scrub_stamp":"2024-04-19T04:28:45.236116+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:21.181858+0000","scrub_duration":0.0065909519999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:22.131770+0000","last_change":"2024-04-19T04:29:22.131770+0000","last_active":"2024-04-19T04:29:22.131770+0000","last_peered":"2024-04-19T04:29:22.131770+0000","last_clean":"2024-04-19T04:29:22.131770+0000","last_became_active":"2024-04-19T04:28:02.845256+0000","last_became_peered":"2024-04-19T04:28:02.845256+0000","last_unstale":"2024-04-19T04:29:22.131770+0000","last_undegraded":"2024-04-19T04:29:22.131770+0000","last_fullsized":"2024-04-19T04:29:22.131770+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:22.131495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:22.131495+0000","last_clean_scrub_stamp":"2024-04-19T04:29:22.131495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:58.086230+0000","scrub_duration":0.0032550890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:35.232894+0000","last_change":"2024-04-19T04:28:35.232894+0000","last_active":"2024-04-19T04:28:35.232894+0000","last_peered":"2024-04-19T04:28:35.232894+0000","last_clean":"2024-04-19T04:28:35.232894+0000","last_became_active":"2024-04-19T04:28:02.844128+0000","last_became_peered":"2024-04-19T04:28:02.844128+0000","last_unstale":"2024-04-19T04:28:35.232894+0000","last_undegraded":"2024-04-19T04:28:35.232894+0000","last_fullsized":"2024-04-19T04:28:35.232894+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:35.232595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:35.232595+0000","last_clean_scrub_stamp":"2024-04-19T04:28:35.232595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:17:35.552236+0000","scrub_duration":0.0033160400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"79'2","reported_seq":44,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:02.113900+0000","last_change":"2024-04-19T04:29:02.113900+0000","last_active":"2024-04-19T04:29:02.113900+0000","last_peered":"2024-04-19T04:29:02.113900+0000","last_clean":"2024-04-19T04:29:02.113900+0000","last_became_active":"2024-04-19T04:28:02.844483+0000","last_became_peered":"2024-04-19T04:28:02.844483+0000","last_unstale":"2024-04-19T04:29:02.113900+0000","last_undegraded":"2024-04-19T04:29:02.113900+0000","last_fullsized":"2024-04-19T04:29:02.113900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-19T04:29:02.113502+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-19T04:29:02.113502+0000","last_clean_scrub_stamp":"2024-04-19T04:29:02.113502+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:57:58.962870+0000","scrub_duration":0.0066382589999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:43.726278+0000","last_change":"2024-04-19T04:29:43.726562+0000","last_active":"2024-04-19T04:29:43.726278+0000","last_peered":"2024-04-19T04:29:43.726278+0000","last_clean":"2024-04-19T04:29:43.726278+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:29:43.726278+0000","last_undegraded":"2024-04-19T04:29:43.726278+0000","last_fullsized":"2024-04-19T04:29:43.726278+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:43.726226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:43.726226+0000","last_clean_scrub_stamp":"2024-04-19T04:29:43.726226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:51:42.524758+0000","scrub_duration":0.003376446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:03.476086+0000","last_change":"2024-04-19T04:29:03.476086+0000","last_active":"2024-04-19T04:29:03.476086+0000","last_peered":"2024-04-19T04:29:03.476086+0000","last_clean":"2024-04-19T04:29:03.476086+0000","last_became_active":"2024-04-19T04:28:12.088123+0000","last_became_peered":"2024-04-19T04:28:12.088123+0000","last_unstale":"2024-04-19T04:29:03.476086+0000","last_undegraded":"2024-04-19T04:29:03.476086+0000","last_fullsized":"2024-04-19T04:29:03.476086+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:03.475686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:03.475686+0000","last_clean_scrub_stamp":"2024-04-19T04:29:03.475686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:48:06.718278+0000","scrub_duration":0.0036698009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:36.624976+0000","last_change":"2024-04-19T04:28:36.624976+0000","last_active":"2024-04-19T04:28:36.624976+0000","last_peered":"2024-04-19T04:28:36.624976+0000","last_clean":"2024-04-19T04:28:36.624976+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:28:36.624976+0000","last_undegraded":"2024-04-19T04:28:36.624976+0000","last_fullsized":"2024-04-19T04:28:36.624976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:36.624618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:36.624618+0000","last_clean_scrub_stamp":"2024-04-19T04:28:36.624618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:45.570664+0000","scrub_duration":0.0035750109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"79'10","reported_seq":95,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:56.750060+0000","last_change":"2024-04-19T04:28:56.750060+0000","last_active":"2024-04-19T04:28:56.750060+0000","last_peered":"2024-04-19T04:28:56.750060+0000","last_clean":"2024-04-19T04:28:56.750060+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:28:56.750060+0000","last_undegraded":"2024-04-19T04:28:56.750060+0000","last_fullsized":"2024-04-19T04:28:56.750060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-04-19T04:28:56.749717+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-04-19T04:28:56.749717+0000","last_clean_scrub_stamp":"2024-04-19T04:28:56.749717+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:09:09.583526+0000","scrub_duration":0.010036193000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:23.193584+0000","last_change":"2024-04-19T04:28:23.193584+0000","last_active":"2024-04-19T04:28:23.193584+0000","last_peered":"2024-04-19T04:28:23.193584+0000","last_clean":"2024-04-19T04:28:23.193584+0000","last_became_active":"2024-04-19T04:28:02.841373+0000","last_became_peered":"2024-04-19T04:28:02.841373+0000","last_unstale":"2024-04-19T04:28:23.193584+0000","last_undegraded":"2024-04-19T04:28:23.193584+0000","last_fullsized":"2024-04-19T04:28:23.193584+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:23.193301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:23.193301+0000","last_clean_scrub_stamp":"2024-04-19T04:28:23.193301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:26.999877+0000","scrub_duration":0.0032212959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"79'5","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:32.522683+0000","last_change":"2024-04-19T04:29:32.523001+0000","last_active":"2024-04-19T04:29:32.522683+0000","last_peered":"2024-04-19T04:29:32.522683+0000","last_clean":"2024-04-19T04:29:32.522683+0000","last_became_active":"2024-04-19T04:28:12.092784+0000","last_became_peered":"2024-04-19T04:28:12.092784+0000","last_unstale":"2024-04-19T04:29:32.522683+0000","last_undegraded":"2024-04-19T04:29:32.522683+0000","last_fullsized":"2024-04-19T04:29:32.522683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-04-19T04:29:32.522633+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-04-19T04:29:32.522633+0000","last_clean_scrub_stamp":"2024-04-19T04:29:32.522633+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:41:22.918360+0000","scrub_duration":0.0090059019999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:09.746871+0000","last_change":"2024-04-19T04:29:09.746871+0000","last_active":"2024-04-19T04:29:09.746871+0000","last_peered":"2024-04-19T04:29:09.746871+0000","last_clean":"2024-04-19T04:29:09.746871+0000","last_became_active":"2024-04-19T04:28:02.638431+0000","last_became_peered":"2024-04-19T04:28:02.638431+0000","last_unstale":"2024-04-19T04:29:09.746871+0000","last_undegraded":"2024-04-19T04:29:09.746871+0000","last_fullsized":"2024-04-19T04:29:09.746871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:09.746554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:09.746554+0000","last_clean_scrub_stamp":"2024-04-19T04:29:09.746554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:33.403481+0000","scrub_duration":0.0034424270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:27.190910+0000","last_change":"2024-04-19T04:28:27.190910+0000","last_active":"2024-04-19T04:28:27.190910+0000","last_peered":"2024-04-19T04:28:27.190910+0000","last_clean":"2024-04-19T04:28:27.190910+0000","last_became_active":"2024-04-19T04:28:02.838354+0000","last_became_peered":"2024-04-19T04:28:02.838354+0000","last_unstale":"2024-04-19T04:28:27.190910+0000","last_undegraded":"2024-04-19T04:28:27.190910+0000","last_fullsized":"2024-04-19T04:28:27.190910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:27.190624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:27.190624+0000","last_clean_scrub_stamp":"2024-04-19T04:28:27.190624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:58:16.070118+0000","scrub_duration":0.003493987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:32.130199+0000","last_change":"2024-04-19T04:29:32.130571+0000","last_active":"2024-04-19T04:29:32.130199+0000","last_peered":"2024-04-19T04:29:32.130199+0000","last_clean":"2024-04-19T04:29:32.130199+0000","last_became_active":"2024-04-19T04:28:02.837994+0000","last_became_peered":"2024-04-19T04:28:02.837994+0000","last_unstale":"2024-04-19T04:29:32.130199+0000","last_undegraded":"2024-04-19T04:29:32.130199+0000","last_fullsized":"2024-04-19T04:29:32.130199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:32.130153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:32.130153+0000","last_clean_scrub_stamp":"2024-04-19T04:29:32.130153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:49.717986+0000","scrub_duration":0.003549759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:10.207103+0000","last_change":"2024-04-19T04:29:10.207103+0000","last_active":"2024-04-19T04:29:10.207103+0000","last_peered":"2024-04-19T04:29:10.207103+0000","last_clean":"2024-04-19T04:29:10.207103+0000","last_became_active":"2024-04-19T04:28:02.836818+0000","last_became_peered":"2024-04-19T04:28:02.836818+0000","last_unstale":"2024-04-19T04:29:10.207103+0000","last_undegraded":"2024-04-19T04:29:10.207103+0000","last_fullsized":"2024-04-19T04:29:10.207103+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:10.206828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:10.206828+0000","last_clean_scrub_stamp":"2024-04-19T04:29:10.206828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:22:40.805733+0000","scrub_duration":0.0031759570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:07.525931+0000","last_change":"2024-04-19T04:29:07.526047+0000","last_active":"2024-04-19T04:29:07.525931+0000","last_peered":"2024-04-19T04:29:07.525931+0000","last_clean":"2024-04-19T04:29:07.525931+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:29:07.525931+0000","last_undegraded":"2024-04-19T04:29:07.525931+0000","last_fullsized":"2024-04-19T04:29:07.525931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:07.525913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:07.525913+0000","last_clean_scrub_stamp":"2024-04-19T04:29:07.525913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:34.284515+0000","scrub_duration":0.089503928999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:09.192639+0000","last_change":"2024-04-19T04:29:09.192879+0000","last_active":"2024-04-19T04:29:09.192639+0000","last_peered":"2024-04-19T04:29:09.192639+0000","last_clean":"2024-04-19T04:29:09.192639+0000","last_became_active":"2024-04-19T04:28:02.837400+0000","last_became_peered":"2024-04-19T04:28:02.837400+0000","last_unstale":"2024-04-19T04:29:09.192639+0000","last_undegraded":"2024-04-19T04:29:09.192639+0000","last_fullsized":"2024-04-19T04:29:09.192639+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:09.192594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:09.192594+0000","last_clean_scrub_stamp":"2024-04-19T04:29:09.192594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:24:09.830565+0000","scrub_duration":0.0033446000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:51.216788+0000","last_change":"2024-04-19T04:28:51.216788+0000","last_active":"2024-04-19T04:28:51.216788+0000","last_peered":"2024-04-19T04:28:51.216788+0000","last_clean":"2024-04-19T04:28:51.216788+0000","last_became_active":"2024-04-19T04:28:02.844057+0000","last_became_peered":"2024-04-19T04:28:02.844057+0000","last_unstale":"2024-04-19T04:28:51.216788+0000","last_undegraded":"2024-04-19T04:28:51.216788+0000","last_fullsized":"2024-04-19T04:28:51.216788+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:51.216503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:51.216503+0000","last_clean_scrub_stamp":"2024-04-19T04:28:51.216503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:47:11.830384+0000","scrub_duration":0.003421365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:47.243501+0000","last_change":"2024-04-19T04:28:47.243752+0000","last_active":"2024-04-19T04:28:47.243501+0000","last_peered":"2024-04-19T04:28:47.243501+0000","last_clean":"2024-04-19T04:28:47.243501+0000","last_became_active":"2024-04-19T04:28:02.836492+0000","last_became_peered":"2024-04-19T04:28:02.836492+0000","last_unstale":"2024-04-19T04:28:47.243501+0000","last_undegraded":"2024-04-19T04:28:47.243501+0000","last_fullsized":"2024-04-19T04:28:47.243501+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:47.243453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:47.243453+0000","last_clean_scrub_stamp":"2024-04-19T04:28:47.243453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:57:57.196537+0000","scrub_duration":0.003301942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:52.410116+0000","last_change":"2024-04-19T04:28:52.410331+0000","last_active":"2024-04-19T04:28:52.410116+0000","last_peered":"2024-04-19T04:28:52.410116+0000","last_clean":"2024-04-19T04:28:52.410116+0000","last_became_active":"2024-04-19T04:28:12.095332+0000","last_became_peered":"2024-04-19T04:28:12.095332+0000","last_unstale":"2024-04-19T04:28:52.410116+0000","last_undegraded":"2024-04-19T04:28:52.410116+0000","last_fullsized":"2024-04-19T04:28:52.410116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:52.410070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:52.410070+0000","last_clean_scrub_stamp":"2024-04-19T04:28:52.410070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:41.851489+0000","scrub_duration":0.003375528,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":82,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:37.501685+0000","last_change":"2024-04-19T04:28:37.501685+0000","last_active":"2024-04-19T04:28:37.501685+0000","last_peered":"2024-04-19T04:28:37.501685+0000","last_clean":"2024-04-19T04:28:37.501685+0000","last_became_active":"2024-04-19T04:28:12.090262+0000","last_became_peered":"2024-04-19T04:28:12.090262+0000","last_unstale":"2024-04-19T04:28:37.501685+0000","last_undegraded":"2024-04-19T04:28:37.501685+0000","last_fullsized":"2024-04-19T04:28:37.501685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-19T04:28:37.501393+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-19T04:28:37.501393+0000","last_clean_scrub_stamp":"2024-04-19T04:28:37.501393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:00:31.892502+0000","scrub_duration":0.0035120720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:33.511683+0000","last_change":"2024-04-19T04:28:33.511683+0000","last_active":"2024-04-19T04:28:33.511683+0000","last_peered":"2024-04-19T04:28:33.511683+0000","last_clean":"2024-04-19T04:28:33.511683+0000","last_became_active":"2024-04-19T04:28:12.092979+0000","last_became_peered":"2024-04-19T04:28:12.092979+0000","last_unstale":"2024-04-19T04:28:33.511683+0000","last_undegraded":"2024-04-19T04:28:33.511683+0000","last_fullsized":"2024-04-19T04:28:33.511683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:33.511357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:33.511357+0000","last_clean_scrub_stamp":"2024-04-19T04:28:33.511357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:09:11.578221+0000","scrub_duration":0.0033778150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":44,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:36.522753+0000","last_change":"2024-04-19T04:28:36.523143+0000","last_active":"2024-04-19T04:28:36.522753+0000","last_peered":"2024-04-19T04:28:36.522753+0000","last_clean":"2024-04-19T04:28:36.522753+0000","last_became_active":"2024-04-19T04:28:12.093915+0000","last_became_peered":"2024-04-19T04:28:12.093915+0000","last_unstale":"2024-04-19T04:28:36.522753+0000","last_undegraded":"2024-04-19T04:28:36.522753+0000","last_fullsized":"2024-04-19T04:28:36.522753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-19T04:28:36.522650+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-19T04:28:36.522650+0000","last_clean_scrub_stamp":"2024-04-19T04:28:36.522650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:16.283397+0000","scrub_duration":0.0035824300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:30:10.720347+0000","last_change":"2024-04-19T04:30:10.720700+0000","last_active":"2024-04-19T04:30:10.720347+0000","last_peered":"2024-04-19T04:30:10.720347+0000","last_clean":"2024-04-19T04:30:10.720347+0000","last_became_active":"2024-04-19T04:28:02.637952+0000","last_became_peered":"2024-04-19T04:28:02.637952+0000","last_unstale":"2024-04-19T04:30:10.720347+0000","last_undegraded":"2024-04-19T04:30:10.720347+0000","last_fullsized":"2024-04-19T04:30:10.720347+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:30:10.720275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:30:10.720275+0000","last_clean_scrub_stamp":"2024-04-19T04:30:10.720275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:40.004038+0000","scrub_duration":0.065152865000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"79'3","reported_seq":101,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:42.733097+0000","last_change":"2024-04-19T04:28:42.733097+0000","last_active":"2024-04-19T04:28:42.733097+0000","last_peered":"2024-04-19T04:28:42.733097+0000","last_clean":"2024-04-19T04:28:42.733097+0000","last_became_active":"2024-04-19T04:28:02.634226+0000","last_became_peered":"2024-04-19T04:28:02.634226+0000","last_unstale":"2024-04-19T04:28:42.733097+0000","last_undegraded":"2024-04-19T04:28:42.733097+0000","last_fullsized":"2024-04-19T04:28:42.733097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:28:42.732789+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:28:42.732789+0000","last_clean_scrub_stamp":"2024-04-19T04:28:42.732789+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:39.702938+0000","scrub_duration":0.0066219249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:52.772390+0000","last_change":"2024-04-19T04:28:52.772390+0000","last_active":"2024-04-19T04:28:52.772390+0000","last_peered":"2024-04-19T04:28:52.772390+0000","last_clean":"2024-04-19T04:28:52.772390+0000","last_became_active":"2024-04-19T04:28:02.636266+0000","last_became_peered":"2024-04-19T04:28:02.636266+0000","last_unstale":"2024-04-19T04:28:52.772390+0000","last_undegraded":"2024-04-19T04:28:52.772390+0000","last_fullsized":"2024-04-19T04:28:52.772390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:52.772052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:52.772052+0000","last_clean_scrub_stamp":"2024-04-19T04:28:52.772052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:04.600653+0000","scrub_duration":0.0038532319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":46,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:21.482224+0000","last_change":"2024-04-19T04:29:21.482465+0000","last_active":"2024-04-19T04:29:21.482224+0000","last_peered":"2024-04-19T04:29:21.482224+0000","last_clean":"2024-04-19T04:29:21.482224+0000","last_became_active":"2024-04-19T04:28:12.095199+0000","last_became_peered":"2024-04-19T04:28:12.095199+0000","last_unstale":"2024-04-19T04:29:21.482224+0000","last_undegraded":"2024-04-19T04:29:21.482224+0000","last_fullsized":"2024-04-19T04:29:21.482224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:29:21.482172+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:29:21.482172+0000","last_clean_scrub_stamp":"2024-04-19T04:29:21.482172+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:21:18.491797+0000","scrub_duration":0.0063630429999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:25.498372+0000","last_change":"2024-04-19T04:29:25.498645+0000","last_active":"2024-04-19T04:29:25.498372+0000","last_peered":"2024-04-19T04:29:25.498372+0000","last_clean":"2024-04-19T04:29:25.498372+0000","last_became_active":"2024-04-19T04:28:12.087884+0000","last_became_peered":"2024-04-19T04:28:12.087884+0000","last_unstale":"2024-04-19T04:29:25.498372+0000","last_undegraded":"2024-04-19T04:29:25.498372+0000","last_fullsized":"2024-04-19T04:29:25.498372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:25.498329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:25.498329+0000","last_clean_scrub_stamp":"2024-04-19T04:29:25.498329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:19.741127+0000","scrub_duration":0.019490397999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:46.117999+0000","last_change":"2024-04-19T04:29:46.117999+0000","last_active":"2024-04-19T04:29:46.117999+0000","last_peered":"2024-04-19T04:29:46.117999+0000","last_clean":"2024-04-19T04:29:46.117999+0000","last_became_active":"2024-04-19T04:28:02.846234+0000","last_became_peered":"2024-04-19T04:28:02.846234+0000","last_unstale":"2024-04-19T04:29:46.117999+0000","last_undegraded":"2024-04-19T04:29:46.117999+0000","last_fullsized":"2024-04-19T04:29:46.117999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-19T04:29:46.117721+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-19T04:29:46.117721+0000","last_clean_scrub_stamp":"2024-04-19T04:29:46.117721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:11:30.642985+0000","scrub_duration":0.0034170009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:41.739248+0000","last_change":"2024-04-19T04:28:41.739248+0000","last_active":"2024-04-19T04:28:41.739248+0000","last_peered":"2024-04-19T04:28:41.739248+0000","last_clean":"2024-04-19T04:28:41.739248+0000","last_became_active":"2024-04-19T04:28:02.634433+0000","last_became_peered":"2024-04-19T04:28:02.634433+0000","last_unstale":"2024-04-19T04:28:41.739248+0000","last_undegraded":"2024-04-19T04:28:41.739248+0000","last_fullsized":"2024-04-19T04:28:41.739248+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:41.738950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:41.738950+0000","last_clean_scrub_stamp":"2024-04-19T04:28:41.738950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:20.301173+0000","scrub_duration":0.0033981039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:42.146662+0000","last_change":"2024-04-19T04:29:42.146662+0000","last_active":"2024-04-19T04:29:42.146662+0000","last_peered":"2024-04-19T04:29:42.146662+0000","last_clean":"2024-04-19T04:29:42.146662+0000","last_became_active":"2024-04-19T04:28:02.844276+0000","last_became_peered":"2024-04-19T04:28:02.844276+0000","last_unstale":"2024-04-19T04:29:42.146662+0000","last_undegraded":"2024-04-19T04:29:42.146662+0000","last_fullsized":"2024-04-19T04:29:42.146662+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-04-19T04:29:42.146318+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-04-19T04:29:42.146318+0000","last_clean_scrub_stamp":"2024-04-19T04:29:42.146318+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:07.224942+0000","scrub_duration":0.0080392180000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705743,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220708,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151132,"statfs":{"total":96636764160,"available":96410759168,"internally_reserved":0,"allocated":946176,"data_stored":926258,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 04:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.74399999999999999},"min":{"1min":0.51300000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.77900000000000003,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.59399999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.84299999999999997,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.70799999999999996}]},{"osd":1,"last update":"Fri Apr 19 04:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69499999999999995,"15min":0.69999999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.78300000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.746},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.81200000000000006,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.626}]}]},{"osd":1,"up_from":72,"seq":309237645342,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44116,"kb_used_data":844,"kb_used_omap":6,"kb_used_meta":43257,"kb_avail":94327724,"statfs":{"total":96636764160,"available":96591589376,"internally_reserved":0,"allocated":864256,"data_stored":334760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6880,"internal_metadata":44295456},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 04:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61799999999999999,"15min":0.61399999999999999},"min":{"1min":0.52400000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.623,"15min":0.627},"min":{"1min":0.52200000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Apr 19 04:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.57999999999999996,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69199999999999995,"15min":0.69299999999999995},"min":{"1min":0.625,"5min":0.621,"15min":0.621},"max":{"1min":0.752,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.68500000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705743,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298664,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297726,"kb_avail":94073176,"statfs":{"total":96636764160,"available":96330932224,"internally_reserved":0,"allocated":950272,"data_stored":924740,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":304871878},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 04:30:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.55000000000000004,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.50700000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Apr 19 04:30:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63300000000000001,"15min":0.61899999999999999},"min":{"1min":0.57699999999999996,"5min":0.223,"15min":0.223},"max":{"1min":0.79700000000000004,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58699999999999997,"15min":0.76500000000000001},"min":{"1min":0.55600000000000005,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76200000000000001,"5min":1.7110000000000001,"15min":4.5},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:30:22.971 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:30:22.971 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:30:22.972 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T04:24:20.154964+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=24, tm_sec=20, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=4, tm_min=28, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T04:30:22.973 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T04:30:42.974 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T04:30:43.302 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:30:43.304 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-19T04:30:43.317 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2024-04-19T04:30:43.040168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":563488,"kb_used_data":2696,"kb_used_omap":9,"kb_used_meta":560758,"kb_avail":282552032,"statfs":{"total":289910292480,"available":289333280768,"internally_reserved":0,"allocated":2760704,"data_stored":2185758,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":10068,"internal_metadata":574216364},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004350"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:33.775165+0000","last_change":"2024-04-19T04:28:24.524670+0000","last_active":"2024-04-19T04:28:33.775165+0000","last_peered":"2024-04-19T04:28:33.775165+0000","last_clean":"2024-04-19T04:28:33.775165+0000","last_became_active":"2024-04-19T04:28:12.093175+0000","last_became_peered":"2024-04-19T04:28:12.093175+0000","last_unstale":"2024-04-19T04:28:33.775165+0000","last_undegraded":"2024-04-19T04:28:33.775165+0000","last_fullsized":"2024-04-19T04:28:33.775165+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:24.524536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:24.524536+0000","last_clean_scrub_stamp":"2024-04-19T04:28:24.524536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:34:39.154898+0000","scrub_duration":0.080942869000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:33.775073+0000","last_change":"2024-04-19T04:28:25.440827+0000","last_active":"2024-04-19T04:28:33.775073+0000","last_peered":"2024-04-19T04:28:33.775073+0000","last_clean":"2024-04-19T04:28:33.775073+0000","last_became_active":"2024-04-19T04:28:12.092819+0000","last_became_peered":"2024-04-19T04:28:12.092819+0000","last_unstale":"2024-04-19T04:28:33.775073+0000","last_undegraded":"2024-04-19T04:28:33.775073+0000","last_fullsized":"2024-04-19T04:28:33.775073+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:25.440548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:25.440548+0000","last_clean_scrub_stamp":"2024-04-19T04:28:25.440548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:40.485315+0000","scrub_duration":0.0035723539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:30:30.629376+0000","last_change":"2024-04-19T04:30:30.629376+0000","last_active":"2024-04-19T04:30:30.629376+0000","last_peered":"2024-04-19T04:30:30.629376+0000","last_clean":"2024-04-19T04:30:30.629376+0000","last_became_active":"2024-04-19T04:24:20.555530+0000","last_became_peered":"2024-04-19T04:24:20.555530+0000","last_unstale":"2024-04-19T04:30:30.629376+0000","last_undegraded":"2024-04-19T04:30:30.629376+0000","last_fullsized":"2024-04-19T04:30:30.629376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:30:30.629068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:30:30.629068+0000","last_clean_scrub_stamp":"2024-04-19T04:30:30.629068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:36:52.081738+0000","scrub_duration":0.0033664419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:30:13.649674+0000","last_change":"2024-04-19T04:30:13.649674+0000","last_active":"2024-04-19T04:30:13.649674+0000","last_peered":"2024-04-19T04:30:13.649674+0000","last_clean":"2024-04-19T04:30:13.649674+0000","last_became_active":"2024-04-19T04:28:02.634355+0000","last_became_peered":"2024-04-19T04:28:02.634355+0000","last_unstale":"2024-04-19T04:30:13.649674+0000","last_undegraded":"2024-04-19T04:30:13.649674+0000","last_fullsized":"2024-04-19T04:30:13.649674+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:30:13.649298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:30:13.649298+0000","last_clean_scrub_stamp":"2024-04-19T04:30:13.649298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:18:30.633306+0000","scrub_duration":0.003270415,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:34.505005+0000","last_change":"2024-04-19T04:28:34.505005+0000","last_active":"2024-04-19T04:28:34.505005+0000","last_peered":"2024-04-19T04:28:34.505005+0000","last_clean":"2024-04-19T04:28:34.505005+0000","last_became_active":"2024-04-19T04:28:12.088231+0000","last_became_peered":"2024-04-19T04:28:12.088231+0000","last_unstale":"2024-04-19T04:28:34.505005+0000","last_undegraded":"2024-04-19T04:28:34.505005+0000","last_fullsized":"2024-04-19T04:28:34.505005+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:34.504692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:34.504692+0000","last_clean_scrub_stamp":"2024-04-19T04:28:34.504692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:54:14.305698+0000","scrub_duration":0.021028397000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:30:20.623370+0000","last_change":"2024-04-19T04:30:20.623615+0000","last_active":"2024-04-19T04:30:20.623370+0000","last_peered":"2024-04-19T04:30:20.623370+0000","last_clean":"2024-04-19T04:30:20.623370+0000","last_became_active":"2024-04-19T04:28:02.637276+0000","last_became_peered":"2024-04-19T04:28:02.637276+0000","last_unstale":"2024-04-19T04:30:20.623370+0000","last_undegraded":"2024-04-19T04:30:20.623370+0000","last_fullsized":"2024-04-19T04:30:20.623370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:30:20.623318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:30:20.623318+0000","last_clean_scrub_stamp":"2024-04-19T04:30:20.623318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:15:34.189835+0000","scrub_duration":0.003130791,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:39.760873+0000","last_change":"2024-04-19T04:28:39.760873+0000","last_active":"2024-04-19T04:28:39.760873+0000","last_peered":"2024-04-19T04:28:39.760873+0000","last_clean":"2024-04-19T04:28:39.760873+0000","last_became_active":"2024-04-19T04:28:02.637086+0000","last_became_peered":"2024-04-19T04:28:02.637086+0000","last_unstale":"2024-04-19T04:28:39.760873+0000","last_undegraded":"2024-04-19T04:28:39.760873+0000","last_fullsized":"2024-04-19T04:28:39.760873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:39.760588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:39.760588+0000","last_clean_scrub_stamp":"2024-04-19T04:28:39.760588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:47:43.003181+0000","scrub_duration":0.020879537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:30:16.653700+0000","last_change":"2024-04-19T04:30:16.653995+0000","last_active":"2024-04-19T04:30:16.653700+0000","last_peered":"2024-04-19T04:30:16.653700+0000","last_clean":"2024-04-19T04:30:16.653700+0000","last_became_active":"2024-04-19T04:28:02.637746+0000","last_became_peered":"2024-04-19T04:28:02.637746+0000","last_unstale":"2024-04-19T04:30:16.653700+0000","last_undegraded":"2024-04-19T04:30:16.653700+0000","last_fullsized":"2024-04-19T04:30:16.653700+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:30:16.653651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:30:16.653651+0000","last_clean_scrub_stamp":"2024-04-19T04:30:16.653651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:02.907816+0000","scrub_duration":0.0032668609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:30.172655+0000","last_change":"2024-04-19T04:29:30.172655+0000","last_active":"2024-04-19T04:29:30.172655+0000","last_peered":"2024-04-19T04:29:30.172655+0000","last_clean":"2024-04-19T04:29:30.172655+0000","last_became_active":"2024-04-19T04:28:02.839203+0000","last_became_peered":"2024-04-19T04:28:02.839203+0000","last_unstale":"2024-04-19T04:29:30.172655+0000","last_undegraded":"2024-04-19T04:29:30.172655+0000","last_fullsized":"2024-04-19T04:29:30.172655+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:30.172421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:30.172421+0000","last_clean_scrub_stamp":"2024-04-19T04:29:30.172421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:42:16.051310+0000","scrub_duration":0.031415525999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:19.483877+0000","last_change":"2024-04-19T04:29:19.484216+0000","last_active":"2024-04-19T04:29:19.483877+0000","last_peered":"2024-04-19T04:29:19.483877+0000","last_clean":"2024-04-19T04:29:19.483877+0000","last_became_active":"2024-04-19T04:28:12.092924+0000","last_became_peered":"2024-04-19T04:28:12.092924+0000","last_unstale":"2024-04-19T04:29:19.483877+0000","last_undegraded":"2024-04-19T04:29:19.483877+0000","last_fullsized":"2024-04-19T04:29:19.483877+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:19.483790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:19.483790+0000","last_clean_scrub_stamp":"2024-04-19T04:29:19.483790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:54.022997+0000","scrub_duration":0.0033506920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:30:29.649394+0000","last_change":"2024-04-19T04:30:29.649647+0000","last_active":"2024-04-19T04:30:29.649394+0000","last_peered":"2024-04-19T04:30:29.649394+0000","last_clean":"2024-04-19T04:30:29.649394+0000","last_became_active":"2024-04-19T04:28:02.635946+0000","last_became_peered":"2024-04-19T04:28:02.635946+0000","last_unstale":"2024-04-19T04:30:29.649394+0000","last_undegraded":"2024-04-19T04:30:29.649394+0000","last_fullsized":"2024-04-19T04:30:29.649394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:30:29.649345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:30:29.649345+0000","last_clean_scrub_stamp":"2024-04-19T04:30:29.649345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:01.823877+0000","scrub_duration":0.021723282999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:35.527163+0000","last_change":"2024-04-19T04:28:35.527163+0000","last_active":"2024-04-19T04:28:35.527163+0000","last_peered":"2024-04-19T04:28:35.527163+0000","last_clean":"2024-04-19T04:28:35.527163+0000","last_became_active":"2024-04-19T04:28:12.094753+0000","last_became_peered":"2024-04-19T04:28:12.094753+0000","last_unstale":"2024-04-19T04:28:35.527163+0000","last_undegraded":"2024-04-19T04:28:35.527163+0000","last_fullsized":"2024-04-19T04:28:35.527163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:35.526884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:35.526884+0000","last_clean_scrub_stamp":"2024-04-19T04:28:35.526884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:06:35.618252+0000","scrub_duration":0.0031760289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:47.475887+0000","last_change":"2024-04-19T04:28:47.475887+0000","last_active":"2024-04-19T04:28:47.475887+0000","last_peered":"2024-04-19T04:28:47.475887+0000","last_clean":"2024-04-19T04:28:47.475887+0000","last_became_active":"2024-04-19T04:28:12.093267+0000","last_became_peered":"2024-04-19T04:28:12.093267+0000","last_unstale":"2024-04-19T04:28:47.475887+0000","last_undegraded":"2024-04-19T04:28:47.475887+0000","last_fullsized":"2024-04-19T04:28:47.475887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:47.475618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:47.475618+0000","last_clean_scrub_stamp":"2024-04-19T04:28:47.475618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:37.519624+0000","scrub_duration":0.022523944000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:23.449786+0000","last_change":"2024-04-19T04:28:23.449786+0000","last_active":"2024-04-19T04:28:23.449786+0000","last_peered":"2024-04-19T04:28:23.449786+0000","last_clean":"2024-04-19T04:28:23.449786+0000","last_became_active":"2024-04-19T04:24:20.550485+0000","last_became_peered":"2024-04-19T04:24:20.550485+0000","last_unstale":"2024-04-19T04:28:23.449786+0000","last_undegraded":"2024-04-19T04:28:23.449786+0000","last_fullsized":"2024-04-19T04:28:23.449786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:23.449500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:23.449500+0000","last_clean_scrub_stamp":"2024-04-19T04:28:23.449500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:20.102454+0000","scrub_duration":0.0033193469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:30:07.744191+0000","last_change":"2024-04-19T04:30:07.744580+0000","last_active":"2024-04-19T04:30:07.744191+0000","last_peered":"2024-04-19T04:30:07.744191+0000","last_clean":"2024-04-19T04:30:07.744191+0000","last_became_active":"2024-04-19T04:24:20.550011+0000","last_became_peered":"2024-04-19T04:24:20.550011+0000","last_unstale":"2024-04-19T04:30:07.744191+0000","last_undegraded":"2024-04-19T04:30:07.744191+0000","last_fullsized":"2024-04-19T04:30:07.744191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:30:07.744132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:30:07.744132+0000","last_clean_scrub_stamp":"2024-04-19T04:30:07.744132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:43.075844+0000","scrub_duration":0.0032714910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:33.597905+0000","last_change":"2024-04-19T04:28:33.597905+0000","last_active":"2024-04-19T04:28:33.597905+0000","last_peered":"2024-04-19T04:28:33.597905+0000","last_clean":"2024-04-19T04:28:33.597905+0000","last_became_active":"2024-04-19T04:28:02.637920+0000","last_became_peered":"2024-04-19T04:28:02.637920+0000","last_unstale":"2024-04-19T04:28:33.597905+0000","last_undegraded":"2024-04-19T04:28:33.597905+0000","last_fullsized":"2024-04-19T04:28:33.597905+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:33.597411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:33.597411+0000","last_clean_scrub_stamp":"2024-04-19T04:28:33.597411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:50.250390+0000","scrub_duration":0.0037610339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:42.236755+0000","last_change":"2024-04-19T04:28:42.236755+0000","last_active":"2024-04-19T04:28:42.236755+0000","last_peered":"2024-04-19T04:28:42.236755+0000","last_clean":"2024-04-19T04:28:42.236755+0000","last_became_active":"2024-04-19T04:28:02.839071+0000","last_became_peered":"2024-04-19T04:28:02.839071+0000","last_unstale":"2024-04-19T04:28:42.236755+0000","last_undegraded":"2024-04-19T04:28:42.236755+0000","last_fullsized":"2024-04-19T04:28:42.236755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:42.236604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:42.236604+0000","last_clean_scrub_stamp":"2024-04-19T04:28:42.236604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:47:48.663058+0000","scrub_duration":0.070531359000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:06.456011+0000","last_change":"2024-04-19T04:29:06.456366+0000","last_active":"2024-04-19T04:29:06.456011+0000","last_peered":"2024-04-19T04:29:06.456011+0000","last_clean":"2024-04-19T04:29:06.456011+0000","last_became_active":"2024-04-19T04:28:02.638230+0000","last_became_peered":"2024-04-19T04:28:02.638230+0000","last_unstale":"2024-04-19T04:29:06.456011+0000","last_undegraded":"2024-04-19T04:29:06.456011+0000","last_fullsized":"2024-04-19T04:29:06.456011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:06.455968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:06.455968+0000","last_clean_scrub_stamp":"2024-04-19T04:29:06.455968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:03.426117+0000","scrub_duration":0.0030903710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:31.226446+0000","last_change":"2024-04-19T04:28:31.226446+0000","last_active":"2024-04-19T04:28:31.226446+0000","last_peered":"2024-04-19T04:28:31.226446+0000","last_clean":"2024-04-19T04:28:31.226446+0000","last_became_active":"2024-04-19T04:28:02.839362+0000","last_became_peered":"2024-04-19T04:28:02.839362+0000","last_unstale":"2024-04-19T04:28:31.226446+0000","last_undegraded":"2024-04-19T04:28:31.226446+0000","last_fullsized":"2024-04-19T04:28:31.226446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:31.226291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:31.226291+0000","last_clean_scrub_stamp":"2024-04-19T04:28:31.226291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:43:05.235533+0000","scrub_duration":0.029412667999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:28.516191+0000","last_change":"2024-04-19T04:28:28.516191+0000","last_active":"2024-04-19T04:28:28.516191+0000","last_peered":"2024-04-19T04:28:28.516191+0000","last_clean":"2024-04-19T04:28:28.516191+0000","last_became_active":"2024-04-19T04:28:02.634835+0000","last_became_peered":"2024-04-19T04:28:02.634835+0000","last_unstale":"2024-04-19T04:28:28.516191+0000","last_undegraded":"2024-04-19T04:28:28.516191+0000","last_fullsized":"2024-04-19T04:28:28.516191+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:28.515710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:28.515710+0000","last_clean_scrub_stamp":"2024-04-19T04:28:28.515710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:46.923636+0000","scrub_duration":0.0034446709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:10.768430+0000","last_change":"2024-04-19T04:29:10.768757+0000","last_active":"2024-04-19T04:29:10.768430+0000","last_peered":"2024-04-19T04:29:10.768430+0000","last_clean":"2024-04-19T04:29:10.768430+0000","last_became_active":"2024-04-19T04:28:02.638546+0000","last_became_peered":"2024-04-19T04:28:02.638546+0000","last_unstale":"2024-04-19T04:29:10.768430+0000","last_undegraded":"2024-04-19T04:29:10.768430+0000","last_fullsized":"2024-04-19T04:29:10.768430+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:10.768364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:10.768364+0000","last_clean_scrub_stamp":"2024-04-19T04:29:10.768364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:36.009796+0000","scrub_duration":0.042629556999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:49.435301+0000","last_change":"2024-04-19T04:28:49.435301+0000","last_active":"2024-04-19T04:28:49.435301+0000","last_peered":"2024-04-19T04:28:49.435301+0000","last_clean":"2024-04-19T04:28:49.435301+0000","last_became_active":"2024-04-19T04:28:12.087571+0000","last_became_peered":"2024-04-19T04:28:12.087571+0000","last_unstale":"2024-04-19T04:28:49.435301+0000","last_undegraded":"2024-04-19T04:28:49.435301+0000","last_fullsized":"2024-04-19T04:28:49.435301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:49.434979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:49.434979+0000","last_clean_scrub_stamp":"2024-04-19T04:28:49.434979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:46.111742+0000","scrub_duration":0.003316786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:34.194663+0000","last_change":"2024-04-19T04:28:34.194663+0000","last_active":"2024-04-19T04:28:34.194663+0000","last_peered":"2024-04-19T04:28:34.194663+0000","last_clean":"2024-04-19T04:28:34.194663+0000","last_became_active":"2024-04-19T04:28:02.840294+0000","last_became_peered":"2024-04-19T04:28:02.840294+0000","last_unstale":"2024-04-19T04:28:34.194663+0000","last_undegraded":"2024-04-19T04:28:34.194663+0000","last_fullsized":"2024-04-19T04:28:34.194663+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:34.194285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:34.194285+0000","last_clean_scrub_stamp":"2024-04-19T04:28:34.194285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:53:04.918350+0000","scrub_duration":0.0033717299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:18.460467+0000","last_change":"2024-04-19T04:29:18.460690+0000","last_active":"2024-04-19T04:29:18.460467+0000","last_peered":"2024-04-19T04:29:18.460467+0000","last_clean":"2024-04-19T04:29:18.460467+0000","last_became_active":"2024-04-19T04:28:12.089918+0000","last_became_peered":"2024-04-19T04:28:12.089918+0000","last_unstale":"2024-04-19T04:29:18.460467+0000","last_undegraded":"2024-04-19T04:29:18.460467+0000","last_fullsized":"2024-04-19T04:29:18.460467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:18.460425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:18.460425+0000","last_clean_scrub_stamp":"2024-04-19T04:29:18.460425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:09:31.294234+0000","scrub_duration":0.0033207029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:29.524562+0000","last_change":"2024-04-19T04:29:29.524562+0000","last_active":"2024-04-19T04:29:29.524562+0000","last_peered":"2024-04-19T04:29:29.524562+0000","last_clean":"2024-04-19T04:29:29.524562+0000","last_became_active":"2024-04-19T04:28:12.091770+0000","last_became_peered":"2024-04-19T04:28:12.091770+0000","last_unstale":"2024-04-19T04:29:29.524562+0000","last_undegraded":"2024-04-19T04:29:29.524562+0000","last_fullsized":"2024-04-19T04:29:29.524562+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:29.524443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:29.524443+0000","last_clean_scrub_stamp":"2024-04-19T04:29:29.524443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:53.181371+0000","scrub_duration":0.054287891999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:31.122032+0000","last_change":"2024-04-19T04:29:31.122032+0000","last_active":"2024-04-19T04:29:31.122032+0000","last_peered":"2024-04-19T04:29:31.122032+0000","last_clean":"2024-04-19T04:29:31.122032+0000","last_became_active":"2024-04-19T04:28:02.845416+0000","last_became_peered":"2024-04-19T04:28:02.845416+0000","last_unstale":"2024-04-19T04:29:31.122032+0000","last_undegraded":"2024-04-19T04:29:31.122032+0000","last_fullsized":"2024-04-19T04:29:31.122032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:31.121613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:31.121613+0000","last_clean_scrub_stamp":"2024-04-19T04:29:31.121613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:10:28.928808+0000","scrub_duration":0.0037616049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:30:17.617326+0000","last_change":"2024-04-19T04:30:17.617548+0000","last_active":"2024-04-19T04:30:17.617326+0000","last_peered":"2024-04-19T04:30:17.617326+0000","last_clean":"2024-04-19T04:30:17.617326+0000","last_became_active":"2024-04-19T04:24:20.552686+0000","last_became_peered":"2024-04-19T04:24:20.552686+0000","last_unstale":"2024-04-19T04:30:17.617326+0000","last_undegraded":"2024-04-19T04:30:17.617326+0000","last_fullsized":"2024-04-19T04:30:17.617326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:30:17.617271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:30:17.617271+0000","last_clean_scrub_stamp":"2024-04-19T04:30:17.617271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:15.648597+0000","scrub_duration":0.0030849660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:00.393991+0000","last_change":"2024-04-19T04:29:00.393991+0000","last_active":"2024-04-19T04:29:00.393991+0000","last_peered":"2024-04-19T04:29:00.393991+0000","last_clean":"2024-04-19T04:29:00.393991+0000","last_became_active":"2024-04-19T04:28:12.091969+0000","last_became_peered":"2024-04-19T04:28:12.091969+0000","last_unstale":"2024-04-19T04:29:00.393991+0000","last_undegraded":"2024-04-19T04:29:00.393991+0000","last_fullsized":"2024-04-19T04:29:00.393991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:00.393643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:00.393643+0000","last_clean_scrub_stamp":"2024-04-19T04:29:00.393643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:43:09.339689+0000","scrub_duration":0.0029687910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:19.135893+0000","last_change":"2024-04-19T04:29:19.135893+0000","last_active":"2024-04-19T04:29:19.135893+0000","last_peered":"2024-04-19T04:29:19.135893+0000","last_clean":"2024-04-19T04:29:19.135893+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:29:19.135893+0000","last_undegraded":"2024-04-19T04:29:19.135893+0000","last_fullsized":"2024-04-19T04:29:19.135893+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:19.135719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:19.135719+0000","last_clean_scrub_stamp":"2024-04-19T04:29:19.135719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:18:22.526783+0000","scrub_duration":0.029313573999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:05.491373+0000","last_change":"2024-04-19T04:29:05.491373+0000","last_active":"2024-04-19T04:29:05.491373+0000","last_peered":"2024-04-19T04:29:05.491373+0000","last_clean":"2024-04-19T04:29:05.491373+0000","last_became_active":"2024-04-19T04:24:20.554363+0000","last_became_peered":"2024-04-19T04:24:20.554363+0000","last_unstale":"2024-04-19T04:29:05.491373+0000","last_undegraded":"2024-04-19T04:29:05.491373+0000","last_fullsized":"2024-04-19T04:29:05.491373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:05.491021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:05.491021+0000","last_clean_scrub_stamp":"2024-04-19T04:29:05.491021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:44.053244+0000","scrub_duration":0.0032047590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:13.152726+0000","last_change":"2024-04-19T04:29:13.152726+0000","last_active":"2024-04-19T04:29:13.152726+0000","last_peered":"2024-04-19T04:29:13.152726+0000","last_clean":"2024-04-19T04:29:13.152726+0000","last_became_active":"2024-04-19T04:28:02.842341+0000","last_became_peered":"2024-04-19T04:28:02.842341+0000","last_unstale":"2024-04-19T04:29:13.152726+0000","last_undegraded":"2024-04-19T04:29:13.152726+0000","last_fullsized":"2024-04-19T04:29:13.152726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:13.152340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:13.152340+0000","last_clean_scrub_stamp":"2024-04-19T04:29:13.152340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:11:50.888946+0000","scrub_duration":0.0034040730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:16.704756+0000","last_change":"2024-04-19T04:29:16.704756+0000","last_active":"2024-04-19T04:29:16.704756+0000","last_peered":"2024-04-19T04:29:16.704756+0000","last_clean":"2024-04-19T04:29:16.704756+0000","last_became_active":"2024-04-19T04:28:02.634586+0000","last_became_peered":"2024-04-19T04:28:02.634586+0000","last_unstale":"2024-04-19T04:29:16.704756+0000","last_undegraded":"2024-04-19T04:29:16.704756+0000","last_fullsized":"2024-04-19T04:29:16.704756+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:16.704476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:16.704476+0000","last_clean_scrub_stamp":"2024-04-19T04:29:16.704476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:05.468791+0000","scrub_duration":0.0032163460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:48.475080+0000","last_change":"2024-04-19T04:28:48.475080+0000","last_active":"2024-04-19T04:28:48.475080+0000","last_peered":"2024-04-19T04:28:48.475080+0000","last_clean":"2024-04-19T04:28:48.475080+0000","last_became_active":"2024-04-19T04:28:12.094558+0000","last_became_peered":"2024-04-19T04:28:12.094558+0000","last_unstale":"2024-04-19T04:28:48.475080+0000","last_undegraded":"2024-04-19T04:28:48.475080+0000","last_fullsized":"2024-04-19T04:28:48.475080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:48.474816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:48.474816+0000","last_clean_scrub_stamp":"2024-04-19T04:28:48.474816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:45.127770+0000","scrub_duration":0.003339912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"79'4","reported_seq":102,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:59.874932+0000","last_change":"2024-04-19T04:28:59.874932+0000","last_active":"2024-04-19T04:28:59.874932+0000","last_peered":"2024-04-19T04:28:59.874932+0000","last_clean":"2024-04-19T04:28:59.874932+0000","last_became_active":"2024-04-19T04:28:02.638666+0000","last_became_peered":"2024-04-19T04:28:02.638666+0000","last_unstale":"2024-04-19T04:28:59.874932+0000","last_undegraded":"2024-04-19T04:28:59.874932+0000","last_fullsized":"2024-04-19T04:28:59.874932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-04-19T04:28:59.874627+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-04-19T04:28:59.874627+0000","last_clean_scrub_stamp":"2024-04-19T04:28:59.874627+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:20:56.884252+0000","scrub_duration":0.0061750349999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:27.505148+0000","last_change":"2024-04-19T04:29:27.505394+0000","last_active":"2024-04-19T04:29:27.505148+0000","last_peered":"2024-04-19T04:29:27.505148+0000","last_clean":"2024-04-19T04:29:27.505148+0000","last_became_active":"2024-04-19T04:28:12.094722+0000","last_became_peered":"2024-04-19T04:28:12.094722+0000","last_unstale":"2024-04-19T04:29:27.505148+0000","last_undegraded":"2024-04-19T04:29:27.505148+0000","last_fullsized":"2024-04-19T04:29:27.505148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:27.505100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:27.505100+0000","last_clean_scrub_stamp":"2024-04-19T04:29:27.505100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:36:45.754653+0000","scrub_duration":0.021590518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:37.122327+0000","last_change":"2024-04-19T04:29:37.122327+0000","last_active":"2024-04-19T04:29:37.122327+0000","last_peered":"2024-04-19T04:29:37.122327+0000","last_clean":"2024-04-19T04:29:37.122327+0000","last_became_active":"2024-04-19T04:28:02.842525+0000","last_became_peered":"2024-04-19T04:28:02.842525+0000","last_unstale":"2024-04-19T04:29:37.122327+0000","last_undegraded":"2024-04-19T04:29:37.122327+0000","last_fullsized":"2024-04-19T04:29:37.122327+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:37.122023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:37.122023+0000","last_clean_scrub_stamp":"2024-04-19T04:29:37.122023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:58:29.627789+0000","scrub_duration":0.003440088,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.152096+0000","last_change":"2024-04-19T04:28:40.152096+0000","last_active":"2024-04-19T04:28:40.152096+0000","last_peered":"2024-04-19T04:28:40.152096+0000","last_clean":"2024-04-19T04:28:40.152096+0000","last_became_active":"2024-04-19T04:28:02.843099+0000","last_became_peered":"2024-04-19T04:28:02.843099+0000","last_unstale":"2024-04-19T04:28:40.152096+0000","last_undegraded":"2024-04-19T04:28:40.152096+0000","last_fullsized":"2024-04-19T04:28:40.152096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.151812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.151812+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.151812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:19.753268+0000","scrub_duration":0.0030712460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:29.541420+0000","last_change":"2024-04-19T04:28:29.541420+0000","last_active":"2024-04-19T04:28:29.541420+0000","last_peered":"2024-04-19T04:28:29.541420+0000","last_clean":"2024-04-19T04:28:29.541420+0000","last_became_active":"2024-04-19T04:28:12.091771+0000","last_became_peered":"2024-04-19T04:28:12.091771+0000","last_unstale":"2024-04-19T04:28:29.541420+0000","last_undegraded":"2024-04-19T04:28:29.541420+0000","last_fullsized":"2024-04-19T04:28:29.541420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:29.541116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:29.541116+0000","last_clean_scrub_stamp":"2024-04-19T04:28:29.541116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:42.022636+0000","scrub_duration":0.0033350189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:29.182338+0000","last_change":"2024-04-19T04:29:29.182338+0000","last_active":"2024-04-19T04:29:29.182338+0000","last_peered":"2024-04-19T04:29:29.182338+0000","last_clean":"2024-04-19T04:29:29.182338+0000","last_became_active":"2024-04-19T04:28:02.836984+0000","last_became_peered":"2024-04-19T04:28:02.836984+0000","last_unstale":"2024-04-19T04:29:29.182338+0000","last_undegraded":"2024-04-19T04:29:29.182338+0000","last_fullsized":"2024-04-19T04:29:29.182338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:29.181949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:29.181949+0000","last_clean_scrub_stamp":"2024-04-19T04:29:29.181949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:05:44.642227+0000","scrub_duration":0.072525754999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"79'12","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:55.744975+0000","last_change":"2024-04-19T04:29:55.745224+0000","last_active":"2024-04-19T04:29:55.744975+0000","last_peered":"2024-04-19T04:29:55.744975+0000","last_clean":"2024-04-19T04:29:55.744975+0000","last_became_active":"2024-04-19T04:24:20.187027+0000","last_became_peered":"2024-04-19T04:24:20.187027+0000","last_unstale":"2024-04-19T04:29:55.744975+0000","last_undegraded":"2024-04-19T04:29:55.744975+0000","last_fullsized":"2024-04-19T04:29:55.744975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-04-19T04:29:55.744918+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-04-19T04:29:55.744918+0000","last_clean_scrub_stamp":"2024-04-19T04:29:55.744918+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:39.067810+0000","scrub_duration":0.010162294000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"79'2","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:14.682747+0000","last_change":"2024-04-19T04:29:14.683190+0000","last_active":"2024-04-19T04:29:14.682747+0000","last_peered":"2024-04-19T04:29:14.682747+0000","last_clean":"2024-04-19T04:29:14.682747+0000","last_became_active":"2024-04-19T04:24:20.185484+0000","last_became_peered":"2024-04-19T04:24:20.185484+0000","last_unstale":"2024-04-19T04:29:14.682747+0000","last_undegraded":"2024-04-19T04:29:14.682747+0000","last_fullsized":"2024-04-19T04:29:14.682747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-19T04:29:14.682697+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-19T04:29:14.682697+0000","last_clean_scrub_stamp":"2024-04-19T04:29:14.682697+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:35.626266+0000","scrub_duration":0.006337891,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:15.540650+0000","last_change":"2024-04-19T04:29:15.540650+0000","last_active":"2024-04-19T04:29:15.540650+0000","last_peered":"2024-04-19T04:29:15.540650+0000","last_clean":"2024-04-19T04:29:15.540650+0000","last_became_active":"2024-04-19T04:28:12.090379+0000","last_became_peered":"2024-04-19T04:28:12.090379+0000","last_unstale":"2024-04-19T04:29:15.540650+0000","last_undegraded":"2024-04-19T04:29:15.540650+0000","last_fullsized":"2024-04-19T04:29:15.540650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:15.540388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:15.540388+0000","last_clean_scrub_stamp":"2024-04-19T04:29:15.540388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:58:31.906342+0000","scrub_duration":0.0035449280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"79'3","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:30.449147+0000","last_change":"2024-04-19T04:29:30.449147+0000","last_active":"2024-04-19T04:29:30.449147+0000","last_peered":"2024-04-19T04:29:30.449147+0000","last_clean":"2024-04-19T04:29:30.449147+0000","last_became_active":"2024-04-19T04:28:12.089948+0000","last_became_peered":"2024-04-19T04:28:12.089948+0000","last_unstale":"2024-04-19T04:29:30.449147+0000","last_undegraded":"2024-04-19T04:29:30.449147+0000","last_fullsized":"2024-04-19T04:29:30.449147+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:29:30.448862+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:29:30.448862+0000","last_clean_scrub_stamp":"2024-04-19T04:29:30.448862+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:55.690294+0000","scrub_duration":0.0062853340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:57.409585+0000","last_change":"2024-04-19T04:28:57.409839+0000","last_active":"2024-04-19T04:28:57.409585+0000","last_peered":"2024-04-19T04:28:57.409585+0000","last_clean":"2024-04-19T04:28:57.409585+0000","last_became_active":"2024-04-19T04:28:12.093090+0000","last_became_peered":"2024-04-19T04:28:12.093090+0000","last_unstale":"2024-04-19T04:28:57.409585+0000","last_undegraded":"2024-04-19T04:28:57.409585+0000","last_fullsized":"2024-04-19T04:28:57.409585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:57.409536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:57.409536+0000","last_clean_scrub_stamp":"2024-04-19T04:28:57.409536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:58:14.062514+0000","scrub_duration":0.0034988459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"79'2","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:51.726306+0000","last_change":"2024-04-19T04:28:51.726306+0000","last_active":"2024-04-19T04:28:51.726306+0000","last_peered":"2024-04-19T04:28:51.726306+0000","last_clean":"2024-04-19T04:28:51.726306+0000","last_became_active":"2024-04-19T04:24:20.185647+0000","last_became_peered":"2024-04-19T04:24:20.185647+0000","last_unstale":"2024-04-19T04:28:51.726306+0000","last_undegraded":"2024-04-19T04:28:51.726306+0000","last_fullsized":"2024-04-19T04:28:51.726306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-19T04:28:51.725876+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-19T04:28:51.725876+0000","last_clean_scrub_stamp":"2024-04-19T04:28:51.725876+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:17.429863+0000","scrub_duration":0.0062414059999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:13.724370+0000","last_change":"2024-04-19T04:29:13.724590+0000","last_active":"2024-04-19T04:29:13.724370+0000","last_peered":"2024-04-19T04:29:13.724370+0000","last_clean":"2024-04-19T04:29:13.724370+0000","last_became_active":"2024-04-19T04:28:02.636231+0000","last_became_peered":"2024-04-19T04:28:02.636231+0000","last_unstale":"2024-04-19T04:29:13.724370+0000","last_undegraded":"2024-04-19T04:29:13.724370+0000","last_fullsized":"2024-04-19T04:29:13.724370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:13.724320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:13.724320+0000","last_clean_scrub_stamp":"2024-04-19T04:29:13.724320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:30:36.014677+0000","scrub_duration":0.0034525440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:19.699868+0000","last_change":"2024-04-19T04:29:19.700106+0000","last_active":"2024-04-19T04:29:19.699868+0000","last_peered":"2024-04-19T04:29:19.699868+0000","last_clean":"2024-04-19T04:29:19.699868+0000","last_became_active":"2024-04-19T04:28:02.634823+0000","last_became_peered":"2024-04-19T04:28:02.634823+0000","last_unstale":"2024-04-19T04:29:19.699868+0000","last_undegraded":"2024-04-19T04:29:19.699868+0000","last_fullsized":"2024-04-19T04:29:19.699868+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:19.699822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:19.699822+0000","last_clean_scrub_stamp":"2024-04-19T04:29:19.699822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:29:33.297820+0000","scrub_duration":0.003354863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:56.250708+0000","last_change":"2024-04-19T04:28:56.250708+0000","last_active":"2024-04-19T04:28:56.250708+0000","last_peered":"2024-04-19T04:28:56.250708+0000","last_clean":"2024-04-19T04:28:56.250708+0000","last_became_active":"2024-04-19T04:28:02.845461+0000","last_became_peered":"2024-04-19T04:28:02.845461+0000","last_unstale":"2024-04-19T04:28:56.250708+0000","last_undegraded":"2024-04-19T04:28:56.250708+0000","last_fullsized":"2024-04-19T04:28:56.250708+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:56.250557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:56.250557+0000","last_clean_scrub_stamp":"2024-04-19T04:28:56.250557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:31:56.014220+0000","scrub_duration":0.029538265000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:46.247247+0000","last_change":"2024-04-19T04:28:46.247247+0000","last_active":"2024-04-19T04:28:46.247247+0000","last_peered":"2024-04-19T04:28:46.247247+0000","last_clean":"2024-04-19T04:28:46.247247+0000","last_became_active":"2024-04-19T04:28:02.844927+0000","last_became_peered":"2024-04-19T04:28:02.844927+0000","last_unstale":"2024-04-19T04:28:46.247247+0000","last_undegraded":"2024-04-19T04:28:46.247247+0000","last_fullsized":"2024-04-19T04:28:46.247247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:28:46.246777+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:28:46.246777+0000","last_clean_scrub_stamp":"2024-04-19T04:28:46.246777+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:37:56.201762+0000","scrub_duration":0.006831213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:58.824983+0000","last_change":"2024-04-19T04:28:58.825209+0000","last_active":"2024-04-19T04:28:58.824983+0000","last_peered":"2024-04-19T04:28:58.824983+0000","last_clean":"2024-04-19T04:28:58.824983+0000","last_became_active":"2024-04-19T04:28:02.635238+0000","last_became_peered":"2024-04-19T04:28:02.635238+0000","last_unstale":"2024-04-19T04:28:58.824983+0000","last_undegraded":"2024-04-19T04:28:58.824983+0000","last_fullsized":"2024-04-19T04:28:58.824983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:58.824931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:58.824931+0000","last_clean_scrub_stamp":"2024-04-19T04:28:58.824931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:33.364138+0000","scrub_duration":0.0033677389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:49.632835+0000","last_change":"2024-04-19T04:29:49.633086+0000","last_active":"2024-04-19T04:29:49.632835+0000","last_peered":"2024-04-19T04:29:49.632835+0000","last_clean":"2024-04-19T04:29:49.632835+0000","last_became_active":"2024-04-19T04:28:02.637651+0000","last_became_peered":"2024-04-19T04:28:02.637651+0000","last_unstale":"2024-04-19T04:29:49.632835+0000","last_undegraded":"2024-04-19T04:29:49.632835+0000","last_fullsized":"2024-04-19T04:29:49.632835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:49.632785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:49.632785+0000","last_clean_scrub_stamp":"2024-04-19T04:29:49.632785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:12:59.944414+0000","scrub_duration":0.0031670999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.710088+0000","last_change":"2024-04-19T04:28:40.710088+0000","last_active":"2024-04-19T04:28:40.710088+0000","last_peered":"2024-04-19T04:28:40.710088+0000","last_clean":"2024-04-19T04:28:40.710088+0000","last_became_active":"2024-04-19T04:24:20.554813+0000","last_became_peered":"2024-04-19T04:24:20.554813+0000","last_unstale":"2024-04-19T04:28:40.710088+0000","last_undegraded":"2024-04-19T04:28:40.710088+0000","last_fullsized":"2024-04-19T04:28:40.710088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.709702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.709702+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.709702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:24.831215+0000","scrub_duration":0.0033854829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:04.490301+0000","last_change":"2024-04-19T04:29:04.490555+0000","last_active":"2024-04-19T04:29:04.490301+0000","last_peered":"2024-04-19T04:29:04.490301+0000","last_clean":"2024-04-19T04:29:04.490301+0000","last_became_active":"2024-04-19T04:24:20.183235+0000","last_became_peered":"2024-04-19T04:24:20.183235+0000","last_unstale":"2024-04-19T04:29:04.490301+0000","last_undegraded":"2024-04-19T04:29:04.490301+0000","last_fullsized":"2024-04-19T04:29:04.490301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:04.490250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:04.490250+0000","last_clean_scrub_stamp":"2024-04-19T04:29:04.490250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:48.611763+0000","scrub_duration":0.003278235,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:06.705490+0000","last_change":"2024-04-19T04:29:06.705866+0000","last_active":"2024-04-19T04:29:06.705490+0000","last_peered":"2024-04-19T04:29:06.705490+0000","last_clean":"2024-04-19T04:29:06.705490+0000","last_became_active":"2024-04-19T04:24:20.552145+0000","last_became_peered":"2024-04-19T04:24:20.552145+0000","last_unstale":"2024-04-19T04:29:06.705490+0000","last_undegraded":"2024-04-19T04:29:06.705490+0000","last_fullsized":"2024-04-19T04:29:06.705490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:06.705384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:06.705384+0000","last_clean_scrub_stamp":"2024-04-19T04:29:06.705384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:57.321888+0000","scrub_duration":0.003745515,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:40.494052+0000","last_change":"2024-04-19T04:28:40.494052+0000","last_active":"2024-04-19T04:28:40.494052+0000","last_peered":"2024-04-19T04:28:40.494052+0000","last_clean":"2024-04-19T04:28:40.494052+0000","last_became_active":"2024-04-19T04:28:12.088043+0000","last_became_peered":"2024-04-19T04:28:12.088043+0000","last_unstale":"2024-04-19T04:28:40.494052+0000","last_undegraded":"2024-04-19T04:28:40.494052+0000","last_fullsized":"2024-04-19T04:28:40.494052+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:40.493585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:40.493585+0000","last_clean_scrub_stamp":"2024-04-19T04:28:40.493585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:22:36.746203+0000","scrub_duration":0.0035336780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:39.119269+0000","last_change":"2024-04-19T04:29:39.119269+0000","last_active":"2024-04-19T04:29:39.119269+0000","last_peered":"2024-04-19T04:29:39.119269+0000","last_clean":"2024-04-19T04:29:39.119269+0000","last_became_active":"2024-04-19T04:28:02.843639+0000","last_became_peered":"2024-04-19T04:28:02.843639+0000","last_unstale":"2024-04-19T04:29:39.119269+0000","last_undegraded":"2024-04-19T04:29:39.119269+0000","last_fullsized":"2024-04-19T04:29:39.119269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:39.119118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:39.119118+0000","last_clean_scrub_stamp":"2024-04-19T04:29:39.119118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:21:58.336649+0000","scrub_duration":0.057465321999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'159","reported_seq":290,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:25.641698+0000","last_change":"2024-04-19T04:29:25.641698+0000","last_active":"2024-04-19T04:29:25.641698+0000","last_peered":"2024-04-19T04:29:25.641698+0000","last_clean":"2024-04-19T04:29:25.641698+0000","last_became_active":"2024-04-19T04:24:10.103458+0000","last_became_peered":"2024-04-19T04:24:10.103458+0000","last_unstale":"2024-04-19T04:29:25.641698+0000","last_undegraded":"2024-04-19T04:29:25.641698+0000","last_fullsized":"2024-04-19T04:29:25.641698+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'159","last_scrub_stamp":"2024-04-19T04:29:25.641417+0000","last_deep_scrub":"79'159","last_deep_scrub_stamp":"2024-04-19T04:29:25.641417+0000","last_clean_scrub_stamp":"2024-04-19T04:29:25.641417+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:59.525050+0000","scrub_duration":0.011440092000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":102,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:45.666956+0000","last_change":"2024-04-19T04:29:45.666956+0000","last_active":"2024-04-19T04:29:45.666956+0000","last_peered":"2024-04-19T04:29:45.666956+0000","last_clean":"2024-04-19T04:29:45.666956+0000","last_became_active":"2024-04-19T04:28:02.639240+0000","last_became_peered":"2024-04-19T04:28:02.639240+0000","last_unstale":"2024-04-19T04:29:45.666956+0000","last_undegraded":"2024-04-19T04:29:45.666956+0000","last_fullsized":"2024-04-19T04:29:45.666956+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:45.666680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:45.666680+0000","last_clean_scrub_stamp":"2024-04-19T04:29:45.666680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:54:24.509719+0000","scrub_duration":0.0031594069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:45.150985+0000","last_change":"2024-04-19T04:29:45.150985+0000","last_active":"2024-04-19T04:29:45.150985+0000","last_peered":"2024-04-19T04:29:45.150985+0000","last_clean":"2024-04-19T04:29:45.150985+0000","last_became_active":"2024-04-19T04:28:02.841053+0000","last_became_peered":"2024-04-19T04:28:02.841053+0000","last_unstale":"2024-04-19T04:29:45.150985+0000","last_undegraded":"2024-04-19T04:29:45.150985+0000","last_fullsized":"2024-04-19T04:29:45.150985+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:45.150700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:45.150700+0000","last_clean_scrub_stamp":"2024-04-19T04:29:45.150700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:11:12.088151+0000","scrub_duration":0.003512416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:43.759738+0000","last_change":"2024-04-19T04:28:43.759738+0000","last_active":"2024-04-19T04:28:43.759738+0000","last_peered":"2024-04-19T04:28:43.759738+0000","last_clean":"2024-04-19T04:28:43.759738+0000","last_became_active":"2024-04-19T04:24:20.551558+0000","last_became_peered":"2024-04-19T04:24:20.551558+0000","last_unstale":"2024-04-19T04:28:43.759738+0000","last_undegraded":"2024-04-19T04:28:43.759738+0000","last_fullsized":"2024-04-19T04:28:43.759738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:43.759455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:43.759455+0000","last_clean_scrub_stamp":"2024-04-19T04:28:43.759455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:10.518057+0000","scrub_duration":0.0032782050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:32.629967+0000","last_change":"2024-04-19T04:29:32.629967+0000","last_active":"2024-04-19T04:29:32.629967+0000","last_peered":"2024-04-19T04:29:32.629967+0000","last_clean":"2024-04-19T04:29:32.629967+0000","last_became_active":"2024-04-19T04:24:16.143353+0000","last_became_peered":"2024-04-19T04:24:16.143353+0000","last_unstale":"2024-04-19T04:29:32.629967+0000","last_undegraded":"2024-04-19T04:29:32.629967+0000","last_fullsized":"2024-04-19T04:29:32.629967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:32.629512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:32.629512+0000","last_clean_scrub_stamp":"2024-04-19T04:29:32.629512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:40.130427+0000","scrub_duration":0.0033463669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:27.120166+0000","last_change":"2024-04-19T04:29:27.120166+0000","last_active":"2024-04-19T04:29:27.120166+0000","last_peered":"2024-04-19T04:29:27.120166+0000","last_clean":"2024-04-19T04:29:27.120166+0000","last_became_active":"2024-04-19T04:28:02.839926+0000","last_became_peered":"2024-04-19T04:28:02.839926+0000","last_unstale":"2024-04-19T04:29:27.120166+0000","last_undegraded":"2024-04-19T04:29:27.120166+0000","last_fullsized":"2024-04-19T04:29:27.120166+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:27.119885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:27.119885+0000","last_clean_scrub_stamp":"2024-04-19T04:29:27.119885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:23.826940+0000","scrub_duration":0.0034871469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:14.506307+0000","last_change":"2024-04-19T04:29:14.506535+0000","last_active":"2024-04-19T04:29:14.506307+0000","last_peered":"2024-04-19T04:29:14.506307+0000","last_clean":"2024-04-19T04:29:14.506307+0000","last_became_active":"2024-04-19T04:28:02.638095+0000","last_became_peered":"2024-04-19T04:28:02.638095+0000","last_unstale":"2024-04-19T04:29:14.506307+0000","last_undegraded":"2024-04-19T04:29:14.506307+0000","last_fullsized":"2024-04-19T04:29:14.506307+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:14.506264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:14.506264+0000","last_clean_scrub_stamp":"2024-04-19T04:29:14.506264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:39:27.629645+0000","scrub_duration":0.003222464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:21.158508+0000","last_change":"2024-04-19T04:28:21.158508+0000","last_active":"2024-04-19T04:28:21.158508+0000","last_peered":"2024-04-19T04:28:21.158508+0000","last_clean":"2024-04-19T04:28:21.158508+0000","last_became_active":"2024-04-19T04:28:02.840328+0000","last_became_peered":"2024-04-19T04:28:02.840328+0000","last_unstale":"2024-04-19T04:28:21.158508+0000","last_undegraded":"2024-04-19T04:28:21.158508+0000","last_fullsized":"2024-04-19T04:28:21.158508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:21.148887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:21.148887+0000","last_clean_scrub_stamp":"2024-04-19T04:28:21.148887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:44:55.928928+0000","scrub_duration":0.0038294929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":44,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:46.483620+0000","last_change":"2024-04-19T04:28:46.483620+0000","last_active":"2024-04-19T04:28:46.483620+0000","last_peered":"2024-04-19T04:28:46.483620+0000","last_clean":"2024-04-19T04:28:46.483620+0000","last_became_active":"2024-04-19T04:28:12.087575+0000","last_became_peered":"2024-04-19T04:28:12.087575+0000","last_unstale":"2024-04-19T04:28:46.483620+0000","last_undegraded":"2024-04-19T04:28:46.483620+0000","last_fullsized":"2024-04-19T04:28:46.483620+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:46.483271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:46.483271+0000","last_clean_scrub_stamp":"2024-04-19T04:28:46.483271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:13.971451+0000","scrub_duration":0.0034840449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:12.204263+0000","last_change":"2024-04-19T04:29:12.204263+0000","last_active":"2024-04-19T04:29:12.204263+0000","last_peered":"2024-04-19T04:29:12.204263+0000","last_clean":"2024-04-19T04:29:12.204263+0000","last_became_active":"2024-04-19T04:28:02.840839+0000","last_became_peered":"2024-04-19T04:28:02.840839+0000","last_unstale":"2024-04-19T04:29:12.204263+0000","last_undegraded":"2024-04-19T04:29:12.204263+0000","last_fullsized":"2024-04-19T04:29:12.204263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:12.204121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:12.204121+0000","last_clean_scrub_stamp":"2024-04-19T04:29:12.204121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:20:20.194187+0000","scrub_duration":0.035589924000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":102,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:44.697951+0000","last_change":"2024-04-19T04:29:44.697951+0000","last_active":"2024-04-19T04:29:44.697951+0000","last_peered":"2024-04-19T04:29:44.697951+0000","last_clean":"2024-04-19T04:29:44.697951+0000","last_became_active":"2024-04-19T04:28:02.634633+0000","last_became_peered":"2024-04-19T04:28:02.634633+0000","last_unstale":"2024-04-19T04:29:44.697951+0000","last_undegraded":"2024-04-19T04:29:44.697951+0000","last_fullsized":"2024-04-19T04:29:44.697951+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:44.697628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:44.697628+0000","last_clean_scrub_stamp":"2024-04-19T04:29:44.697628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:42.440486+0000","scrub_duration":0.0034703999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":99,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:58.802663+0000","last_change":"2024-04-19T04:29:58.802663+0000","last_active":"2024-04-19T04:29:58.802663+0000","last_peered":"2024-04-19T04:29:58.802663+0000","last_clean":"2024-04-19T04:29:58.802663+0000","last_became_active":"2024-04-19T04:28:02.637233+0000","last_became_peered":"2024-04-19T04:28:02.637233+0000","last_unstale":"2024-04-19T04:29:58.802663+0000","last_undegraded":"2024-04-19T04:29:58.802663+0000","last_fullsized":"2024-04-19T04:29:58.802663+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:58.802266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:58.802266+0000","last_clean_scrub_stamp":"2024-04-19T04:29:58.802266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:55:10.441574+0000","scrub_duration":0.0033469329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:53.217334+0000","last_change":"2024-04-19T04:28:53.217334+0000","last_active":"2024-04-19T04:28:53.217334+0000","last_peered":"2024-04-19T04:28:53.217334+0000","last_clean":"2024-04-19T04:28:53.217334+0000","last_became_active":"2024-04-19T04:28:02.837829+0000","last_became_peered":"2024-04-19T04:28:02.837829+0000","last_unstale":"2024-04-19T04:28:53.217334+0000","last_undegraded":"2024-04-19T04:28:53.217334+0000","last_fullsized":"2024-04-19T04:28:53.217334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:53.216932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:53.216932+0000","last_clean_scrub_stamp":"2024-04-19T04:28:53.216932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:28:52.742878+0000","scrub_duration":0.0032988420000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":99,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:12.751447+0000","last_change":"2024-04-19T04:29:12.751447+0000","last_active":"2024-04-19T04:29:12.751447+0000","last_peered":"2024-04-19T04:29:12.751447+0000","last_clean":"2024-04-19T04:29:12.751447+0000","last_became_active":"2024-04-19T04:28:02.634103+0000","last_became_peered":"2024-04-19T04:28:02.634103+0000","last_unstale":"2024-04-19T04:29:12.751447+0000","last_undegraded":"2024-04-19T04:29:12.751447+0000","last_fullsized":"2024-04-19T04:29:12.751447+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:12.751168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:12.751168+0000","last_clean_scrub_stamp":"2024-04-19T04:29:12.751168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:41:03.146894+0000","scrub_duration":0.0031427569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:21.089183+0000","last_change":"2024-04-19T04:29:21.089183+0000","last_active":"2024-04-19T04:29:21.089183+0000","last_peered":"2024-04-19T04:29:21.089183+0000","last_clean":"2024-04-19T04:29:21.089183+0000","last_became_active":"2024-04-19T04:28:02.835057+0000","last_became_peered":"2024-04-19T04:28:02.835057+0000","last_unstale":"2024-04-19T04:29:21.089183+0000","last_undegraded":"2024-04-19T04:29:21.089183+0000","last_fullsized":"2024-04-19T04:29:21.089183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:21.088913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:21.088913+0000","last_clean_scrub_stamp":"2024-04-19T04:29:21.088913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:25:08.459261+0000","scrub_duration":0.0034193980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:12.560617+0000","last_change":"2024-04-19T04:29:12.560617+0000","last_active":"2024-04-19T04:29:12.560617+0000","last_peered":"2024-04-19T04:29:12.560617+0000","last_clean":"2024-04-19T04:29:12.560617+0000","last_became_active":"2024-04-19T04:24:20.554498+0000","last_became_peered":"2024-04-19T04:24:20.554498+0000","last_unstale":"2024-04-19T04:29:12.560617+0000","last_undegraded":"2024-04-19T04:29:12.560617+0000","last_fullsized":"2024-04-19T04:29:12.560617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:12.560352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:12.560352+0000","last_clean_scrub_stamp":"2024-04-19T04:29:12.560352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:21.470493+0000","scrub_duration":0.0033970480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:03.074082+0000","last_change":"2024-04-19T04:29:03.074082+0000","last_active":"2024-04-19T04:29:03.074082+0000","last_peered":"2024-04-19T04:29:03.074082+0000","last_clean":"2024-04-19T04:29:03.074082+0000","last_became_active":"2024-04-19T04:28:02.838918+0000","last_became_peered":"2024-04-19T04:28:02.838918+0000","last_unstale":"2024-04-19T04:29:03.074082+0000","last_undegraded":"2024-04-19T04:29:03.074082+0000","last_fullsized":"2024-04-19T04:29:03.074082+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:03.073680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:03.073680+0000","last_clean_scrub_stamp":"2024-04-19T04:29:03.073680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:34:04.411572+0000","scrub_duration":0.0031316450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:33.545495+0000","last_change":"2024-04-19T04:29:33.545495+0000","last_active":"2024-04-19T04:29:33.545495+0000","last_peered":"2024-04-19T04:29:33.545495+0000","last_clean":"2024-04-19T04:29:33.545495+0000","last_became_active":"2024-04-19T04:28:12.091609+0000","last_became_peered":"2024-04-19T04:28:12.091609+0000","last_unstale":"2024-04-19T04:29:33.545495+0000","last_undegraded":"2024-04-19T04:29:33.545495+0000","last_fullsized":"2024-04-19T04:29:33.545495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:33.545166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:33.545166+0000","last_clean_scrub_stamp":"2024-04-19T04:29:33.545166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:30:55.835523+0000","scrub_duration":0.0030524910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:43.453593+0000","last_change":"2024-04-19T04:28:43.453593+0000","last_active":"2024-04-19T04:28:43.453593+0000","last_peered":"2024-04-19T04:28:43.453593+0000","last_clean":"2024-04-19T04:28:43.453593+0000","last_became_active":"2024-04-19T04:28:12.091335+0000","last_became_peered":"2024-04-19T04:28:12.091335+0000","last_unstale":"2024-04-19T04:28:43.453593+0000","last_undegraded":"2024-04-19T04:28:43.453593+0000","last_fullsized":"2024-04-19T04:28:43.453593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:43.453308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:43.453308+0000","last_clean_scrub_stamp":"2024-04-19T04:28:43.453308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:37:50.638133+0000","scrub_duration":0.0032802869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:45.236529+0000","last_change":"2024-04-19T04:28:45.236529+0000","last_active":"2024-04-19T04:28:45.236529+0000","last_peered":"2024-04-19T04:28:45.236529+0000","last_clean":"2024-04-19T04:28:45.236529+0000","last_became_active":"2024-04-19T04:28:02.839883+0000","last_became_peered":"2024-04-19T04:28:02.839883+0000","last_unstale":"2024-04-19T04:28:45.236529+0000","last_undegraded":"2024-04-19T04:28:45.236529+0000","last_fullsized":"2024-04-19T04:28:45.236529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:28:45.236116+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:28:45.236116+0000","last_clean_scrub_stamp":"2024-04-19T04:28:45.236116+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:21.181858+0000","scrub_duration":0.0065909519999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:22.131770+0000","last_change":"2024-04-19T04:29:22.131770+0000","last_active":"2024-04-19T04:29:22.131770+0000","last_peered":"2024-04-19T04:29:22.131770+0000","last_clean":"2024-04-19T04:29:22.131770+0000","last_became_active":"2024-04-19T04:28:02.845256+0000","last_became_peered":"2024-04-19T04:28:02.845256+0000","last_unstale":"2024-04-19T04:29:22.131770+0000","last_undegraded":"2024-04-19T04:29:22.131770+0000","last_fullsized":"2024-04-19T04:29:22.131770+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:22.131495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:22.131495+0000","last_clean_scrub_stamp":"2024-04-19T04:29:22.131495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:58.086230+0000","scrub_duration":0.0032550890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:35.232894+0000","last_change":"2024-04-19T04:28:35.232894+0000","last_active":"2024-04-19T04:28:35.232894+0000","last_peered":"2024-04-19T04:28:35.232894+0000","last_clean":"2024-04-19T04:28:35.232894+0000","last_became_active":"2024-04-19T04:28:02.844128+0000","last_became_peered":"2024-04-19T04:28:02.844128+0000","last_unstale":"2024-04-19T04:28:35.232894+0000","last_undegraded":"2024-04-19T04:28:35.232894+0000","last_fullsized":"2024-04-19T04:28:35.232894+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:35.232595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:35.232595+0000","last_clean_scrub_stamp":"2024-04-19T04:28:35.232595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:17:35.552236+0000","scrub_duration":0.0033160400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"79'2","reported_seq":44,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:02.113900+0000","last_change":"2024-04-19T04:29:02.113900+0000","last_active":"2024-04-19T04:29:02.113900+0000","last_peered":"2024-04-19T04:29:02.113900+0000","last_clean":"2024-04-19T04:29:02.113900+0000","last_became_active":"2024-04-19T04:28:02.844483+0000","last_became_peered":"2024-04-19T04:28:02.844483+0000","last_unstale":"2024-04-19T04:29:02.113900+0000","last_undegraded":"2024-04-19T04:29:02.113900+0000","last_fullsized":"2024-04-19T04:29:02.113900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-19T04:29:02.113502+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-19T04:29:02.113502+0000","last_clean_scrub_stamp":"2024-04-19T04:29:02.113502+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:57:58.962870+0000","scrub_duration":0.0066382589999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:43.726278+0000","last_change":"2024-04-19T04:29:43.726562+0000","last_active":"2024-04-19T04:29:43.726278+0000","last_peered":"2024-04-19T04:29:43.726278+0000","last_clean":"2024-04-19T04:29:43.726278+0000","last_became_active":"2024-04-19T04:24:16.143677+0000","last_became_peered":"2024-04-19T04:24:16.143677+0000","last_unstale":"2024-04-19T04:29:43.726278+0000","last_undegraded":"2024-04-19T04:29:43.726278+0000","last_fullsized":"2024-04-19T04:29:43.726278+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:43.726226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:43.726226+0000","last_clean_scrub_stamp":"2024-04-19T04:29:43.726226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:51:42.524758+0000","scrub_duration":0.003376446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:03.476086+0000","last_change":"2024-04-19T04:29:03.476086+0000","last_active":"2024-04-19T04:29:03.476086+0000","last_peered":"2024-04-19T04:29:03.476086+0000","last_clean":"2024-04-19T04:29:03.476086+0000","last_became_active":"2024-04-19T04:28:12.088123+0000","last_became_peered":"2024-04-19T04:28:12.088123+0000","last_unstale":"2024-04-19T04:29:03.476086+0000","last_undegraded":"2024-04-19T04:29:03.476086+0000","last_fullsized":"2024-04-19T04:29:03.476086+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:03.475686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:03.475686+0000","last_clean_scrub_stamp":"2024-04-19T04:29:03.475686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:48:06.718278+0000","scrub_duration":0.0036698009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:36.624976+0000","last_change":"2024-04-19T04:28:36.624976+0000","last_active":"2024-04-19T04:28:36.624976+0000","last_peered":"2024-04-19T04:28:36.624976+0000","last_clean":"2024-04-19T04:28:36.624976+0000","last_became_active":"2024-04-19T04:24:20.554197+0000","last_became_peered":"2024-04-19T04:24:20.554197+0000","last_unstale":"2024-04-19T04:28:36.624976+0000","last_undegraded":"2024-04-19T04:28:36.624976+0000","last_fullsized":"2024-04-19T04:28:36.624976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:36.624618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:36.624618+0000","last_clean_scrub_stamp":"2024-04-19T04:28:36.624618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:45.570664+0000","scrub_duration":0.0035750109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"79'10","reported_seq":95,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:56.750060+0000","last_change":"2024-04-19T04:28:56.750060+0000","last_active":"2024-04-19T04:28:56.750060+0000","last_peered":"2024-04-19T04:28:56.750060+0000","last_clean":"2024-04-19T04:28:56.750060+0000","last_became_active":"2024-04-19T04:24:20.185569+0000","last_became_peered":"2024-04-19T04:24:20.185569+0000","last_unstale":"2024-04-19T04:28:56.750060+0000","last_undegraded":"2024-04-19T04:28:56.750060+0000","last_fullsized":"2024-04-19T04:28:56.750060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-04-19T04:28:56.749717+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-04-19T04:28:56.749717+0000","last_clean_scrub_stamp":"2024-04-19T04:28:56.749717+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:09:09.583526+0000","scrub_duration":0.010036193000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:23.193584+0000","last_change":"2024-04-19T04:28:23.193584+0000","last_active":"2024-04-19T04:28:23.193584+0000","last_peered":"2024-04-19T04:28:23.193584+0000","last_clean":"2024-04-19T04:28:23.193584+0000","last_became_active":"2024-04-19T04:28:02.841373+0000","last_became_peered":"2024-04-19T04:28:02.841373+0000","last_unstale":"2024-04-19T04:28:23.193584+0000","last_undegraded":"2024-04-19T04:28:23.193584+0000","last_fullsized":"2024-04-19T04:28:23.193584+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:23.193301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:23.193301+0000","last_clean_scrub_stamp":"2024-04-19T04:28:23.193301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:26.999877+0000","scrub_duration":0.0032212959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"79'5","reported_seq":49,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:32.523001+0000","last_change":"2024-04-19T04:29:32.523001+0000","last_active":"2024-04-19T04:29:32.523001+0000","last_peered":"2024-04-19T04:29:32.523001+0000","last_clean":"2024-04-19T04:29:32.523001+0000","last_became_active":"2024-04-19T04:28:12.092784+0000","last_became_peered":"2024-04-19T04:28:12.092784+0000","last_unstale":"2024-04-19T04:29:32.523001+0000","last_undegraded":"2024-04-19T04:29:32.523001+0000","last_fullsized":"2024-04-19T04:29:32.523001+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-04-19T04:29:32.522633+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-04-19T04:29:32.522633+0000","last_clean_scrub_stamp":"2024-04-19T04:29:32.522633+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:41:22.918360+0000","scrub_duration":0.0090059019999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":98,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:09.746871+0000","last_change":"2024-04-19T04:29:09.746871+0000","last_active":"2024-04-19T04:29:09.746871+0000","last_peered":"2024-04-19T04:29:09.746871+0000","last_clean":"2024-04-19T04:29:09.746871+0000","last_became_active":"2024-04-19T04:28:02.638431+0000","last_became_peered":"2024-04-19T04:28:02.638431+0000","last_unstale":"2024-04-19T04:29:09.746871+0000","last_undegraded":"2024-04-19T04:29:09.746871+0000","last_fullsized":"2024-04-19T04:29:09.746871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:09.746554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:09.746554+0000","last_clean_scrub_stamp":"2024-04-19T04:29:09.746554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:33.403481+0000","scrub_duration":0.0034424270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:27.190910+0000","last_change":"2024-04-19T04:28:27.190910+0000","last_active":"2024-04-19T04:28:27.190910+0000","last_peered":"2024-04-19T04:28:27.190910+0000","last_clean":"2024-04-19T04:28:27.190910+0000","last_became_active":"2024-04-19T04:28:02.838354+0000","last_became_peered":"2024-04-19T04:28:02.838354+0000","last_unstale":"2024-04-19T04:28:27.190910+0000","last_undegraded":"2024-04-19T04:28:27.190910+0000","last_fullsized":"2024-04-19T04:28:27.190910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:27.190624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:27.190624+0000","last_clean_scrub_stamp":"2024-04-19T04:28:27.190624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:58:16.070118+0000","scrub_duration":0.003493987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:32.130571+0000","last_change":"2024-04-19T04:29:32.130571+0000","last_active":"2024-04-19T04:29:32.130571+0000","last_peered":"2024-04-19T04:29:32.130571+0000","last_clean":"2024-04-19T04:29:32.130571+0000","last_became_active":"2024-04-19T04:28:02.837994+0000","last_became_peered":"2024-04-19T04:28:02.837994+0000","last_unstale":"2024-04-19T04:29:32.130571+0000","last_undegraded":"2024-04-19T04:29:32.130571+0000","last_fullsized":"2024-04-19T04:29:32.130571+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:32.130153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:32.130153+0000","last_clean_scrub_stamp":"2024-04-19T04:29:32.130153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:49.717986+0000","scrub_duration":0.003549759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:10.207103+0000","last_change":"2024-04-19T04:29:10.207103+0000","last_active":"2024-04-19T04:29:10.207103+0000","last_peered":"2024-04-19T04:29:10.207103+0000","last_clean":"2024-04-19T04:29:10.207103+0000","last_became_active":"2024-04-19T04:28:02.836818+0000","last_became_peered":"2024-04-19T04:28:02.836818+0000","last_unstale":"2024-04-19T04:29:10.207103+0000","last_undegraded":"2024-04-19T04:29:10.207103+0000","last_fullsized":"2024-04-19T04:29:10.207103+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:10.206828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:10.206828+0000","last_clean_scrub_stamp":"2024-04-19T04:29:10.206828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:22:40.805733+0000","scrub_duration":0.0031759570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":84,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:07.526047+0000","last_change":"2024-04-19T04:29:07.526047+0000","last_active":"2024-04-19T04:29:07.526047+0000","last_peered":"2024-04-19T04:29:07.526047+0000","last_clean":"2024-04-19T04:29:07.526047+0000","last_became_active":"2024-04-19T04:24:20.552246+0000","last_became_peered":"2024-04-19T04:24:20.552246+0000","last_unstale":"2024-04-19T04:29:07.526047+0000","last_undegraded":"2024-04-19T04:29:07.526047+0000","last_fullsized":"2024-04-19T04:29:07.526047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:07.525913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:07.525913+0000","last_clean_scrub_stamp":"2024-04-19T04:29:07.525913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:34.284515+0000","scrub_duration":0.089503928999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:09.192879+0000","last_change":"2024-04-19T04:29:09.192879+0000","last_active":"2024-04-19T04:29:09.192879+0000","last_peered":"2024-04-19T04:29:09.192879+0000","last_clean":"2024-04-19T04:29:09.192879+0000","last_became_active":"2024-04-19T04:28:02.837400+0000","last_became_peered":"2024-04-19T04:28:02.837400+0000","last_unstale":"2024-04-19T04:29:09.192879+0000","last_undegraded":"2024-04-19T04:29:09.192879+0000","last_fullsized":"2024-04-19T04:29:09.192879+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:09.192594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:09.192594+0000","last_clean_scrub_stamp":"2024-04-19T04:29:09.192594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:24:09.830565+0000","scrub_duration":0.0033446000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:51.216788+0000","last_change":"2024-04-19T04:28:51.216788+0000","last_active":"2024-04-19T04:28:51.216788+0000","last_peered":"2024-04-19T04:28:51.216788+0000","last_clean":"2024-04-19T04:28:51.216788+0000","last_became_active":"2024-04-19T04:28:02.844057+0000","last_became_peered":"2024-04-19T04:28:02.844057+0000","last_unstale":"2024-04-19T04:28:51.216788+0000","last_undegraded":"2024-04-19T04:28:51.216788+0000","last_fullsized":"2024-04-19T04:28:51.216788+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:51.216503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:51.216503+0000","last_clean_scrub_stamp":"2024-04-19T04:28:51.216503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:47:11.830384+0000","scrub_duration":0.003421365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:47.243752+0000","last_change":"2024-04-19T04:28:47.243752+0000","last_active":"2024-04-19T04:28:47.243752+0000","last_peered":"2024-04-19T04:28:47.243752+0000","last_clean":"2024-04-19T04:28:47.243752+0000","last_became_active":"2024-04-19T04:28:02.836492+0000","last_became_peered":"2024-04-19T04:28:02.836492+0000","last_unstale":"2024-04-19T04:28:47.243752+0000","last_undegraded":"2024-04-19T04:28:47.243752+0000","last_fullsized":"2024-04-19T04:28:47.243752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:47.243453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:47.243453+0000","last_clean_scrub_stamp":"2024-04-19T04:28:47.243453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:57:57.196537+0000","scrub_duration":0.003301942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:52.410116+0000","last_change":"2024-04-19T04:28:52.410331+0000","last_active":"2024-04-19T04:28:52.410116+0000","last_peered":"2024-04-19T04:28:52.410116+0000","last_clean":"2024-04-19T04:28:52.410116+0000","last_became_active":"2024-04-19T04:28:12.095332+0000","last_became_peered":"2024-04-19T04:28:12.095332+0000","last_unstale":"2024-04-19T04:28:52.410116+0000","last_undegraded":"2024-04-19T04:28:52.410116+0000","last_fullsized":"2024-04-19T04:28:52.410116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:52.410070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:52.410070+0000","last_clean_scrub_stamp":"2024-04-19T04:28:52.410070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:41.851489+0000","scrub_duration":0.003375528,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":82,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:37.501685+0000","last_change":"2024-04-19T04:28:37.501685+0000","last_active":"2024-04-19T04:28:37.501685+0000","last_peered":"2024-04-19T04:28:37.501685+0000","last_clean":"2024-04-19T04:28:37.501685+0000","last_became_active":"2024-04-19T04:28:12.090262+0000","last_became_peered":"2024-04-19T04:28:12.090262+0000","last_unstale":"2024-04-19T04:28:37.501685+0000","last_undegraded":"2024-04-19T04:28:37.501685+0000","last_fullsized":"2024-04-19T04:28:37.501685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-19T04:28:37.501393+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-19T04:28:37.501393+0000","last_clean_scrub_stamp":"2024-04-19T04:28:37.501393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:00:31.892502+0000","scrub_duration":0.0035120720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:33.511683+0000","last_change":"2024-04-19T04:28:33.511683+0000","last_active":"2024-04-19T04:28:33.511683+0000","last_peered":"2024-04-19T04:28:33.511683+0000","last_clean":"2024-04-19T04:28:33.511683+0000","last_became_active":"2024-04-19T04:28:12.092979+0000","last_became_peered":"2024-04-19T04:28:12.092979+0000","last_unstale":"2024-04-19T04:28:33.511683+0000","last_undegraded":"2024-04-19T04:28:33.511683+0000","last_fullsized":"2024-04-19T04:28:33.511683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:33.511357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:33.511357+0000","last_clean_scrub_stamp":"2024-04-19T04:28:33.511357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:09:11.578221+0000","scrub_duration":0.0033778150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":44,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:36.522753+0000","last_change":"2024-04-19T04:28:36.523143+0000","last_active":"2024-04-19T04:28:36.522753+0000","last_peered":"2024-04-19T04:28:36.522753+0000","last_clean":"2024-04-19T04:28:36.522753+0000","last_became_active":"2024-04-19T04:28:12.093915+0000","last_became_peered":"2024-04-19T04:28:12.093915+0000","last_unstale":"2024-04-19T04:28:36.522753+0000","last_undegraded":"2024-04-19T04:28:36.522753+0000","last_fullsized":"2024-04-19T04:28:36.522753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-19T04:28:36.522650+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-19T04:28:36.522650+0000","last_clean_scrub_stamp":"2024-04-19T04:28:36.522650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:16.283397+0000","scrub_duration":0.0035824300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:30:10.720347+0000","last_change":"2024-04-19T04:30:10.720700+0000","last_active":"2024-04-19T04:30:10.720347+0000","last_peered":"2024-04-19T04:30:10.720347+0000","last_clean":"2024-04-19T04:30:10.720347+0000","last_became_active":"2024-04-19T04:28:02.637952+0000","last_became_peered":"2024-04-19T04:28:02.637952+0000","last_unstale":"2024-04-19T04:30:10.720347+0000","last_undegraded":"2024-04-19T04:30:10.720347+0000","last_fullsized":"2024-04-19T04:30:10.720347+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:30:10.720275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:30:10.720275+0000","last_clean_scrub_stamp":"2024-04-19T04:30:10.720275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:40.004038+0000","scrub_duration":0.065152865000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"79'3","reported_seq":101,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:42.733097+0000","last_change":"2024-04-19T04:28:42.733097+0000","last_active":"2024-04-19T04:28:42.733097+0000","last_peered":"2024-04-19T04:28:42.733097+0000","last_clean":"2024-04-19T04:28:42.733097+0000","last_became_active":"2024-04-19T04:28:02.634226+0000","last_became_peered":"2024-04-19T04:28:02.634226+0000","last_unstale":"2024-04-19T04:28:42.733097+0000","last_undegraded":"2024-04-19T04:28:42.733097+0000","last_fullsized":"2024-04-19T04:28:42.733097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:28:42.732789+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:28:42.732789+0000","last_clean_scrub_stamp":"2024-04-19T04:28:42.732789+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:39.702938+0000","scrub_duration":0.0066219249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:52.772390+0000","last_change":"2024-04-19T04:28:52.772390+0000","last_active":"2024-04-19T04:28:52.772390+0000","last_peered":"2024-04-19T04:28:52.772390+0000","last_clean":"2024-04-19T04:28:52.772390+0000","last_became_active":"2024-04-19T04:28:02.636266+0000","last_became_peered":"2024-04-19T04:28:02.636266+0000","last_unstale":"2024-04-19T04:28:52.772390+0000","last_undegraded":"2024-04-19T04:28:52.772390+0000","last_fullsized":"2024-04-19T04:28:52.772390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:52.772052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:52.772052+0000","last_clean_scrub_stamp":"2024-04-19T04:28:52.772052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:04.600653+0000","scrub_duration":0.0038532319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":46,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:21.482224+0000","last_change":"2024-04-19T04:29:21.482465+0000","last_active":"2024-04-19T04:29:21.482224+0000","last_peered":"2024-04-19T04:29:21.482224+0000","last_clean":"2024-04-19T04:29:21.482224+0000","last_became_active":"2024-04-19T04:28:12.095199+0000","last_became_peered":"2024-04-19T04:28:12.095199+0000","last_unstale":"2024-04-19T04:29:21.482224+0000","last_undegraded":"2024-04-19T04:29:21.482224+0000","last_fullsized":"2024-04-19T04:29:21.482224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-19T04:29:21.482172+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-19T04:29:21.482172+0000","last_clean_scrub_stamp":"2024-04-19T04:29:21.482172+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:21:18.491797+0000","scrub_duration":0.0063630429999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:25.498372+0000","last_change":"2024-04-19T04:29:25.498645+0000","last_active":"2024-04-19T04:29:25.498372+0000","last_peered":"2024-04-19T04:29:25.498372+0000","last_clean":"2024-04-19T04:29:25.498372+0000","last_became_active":"2024-04-19T04:28:12.087884+0000","last_became_peered":"2024-04-19T04:28:12.087884+0000","last_unstale":"2024-04-19T04:29:25.498372+0000","last_undegraded":"2024-04-19T04:29:25.498372+0000","last_fullsized":"2024-04-19T04:29:25.498372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:29:25.498329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:29:25.498329+0000","last_clean_scrub_stamp":"2024-04-19T04:29:25.498329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:19.741127+0000","scrub_duration":0.019490397999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:46.117999+0000","last_change":"2024-04-19T04:29:46.117999+0000","last_active":"2024-04-19T04:29:46.117999+0000","last_peered":"2024-04-19T04:29:46.117999+0000","last_clean":"2024-04-19T04:29:46.117999+0000","last_became_active":"2024-04-19T04:28:02.846234+0000","last_became_peered":"2024-04-19T04:28:02.846234+0000","last_unstale":"2024-04-19T04:29:46.117999+0000","last_undegraded":"2024-04-19T04:29:46.117999+0000","last_fullsized":"2024-04-19T04:29:46.117999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-19T04:29:46.117721+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-19T04:29:46.117721+0000","last_clean_scrub_stamp":"2024-04-19T04:29:46.117721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:11:30.642985+0000","scrub_duration":0.0034170009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:28:41.739248+0000","last_change":"2024-04-19T04:28:41.739248+0000","last_active":"2024-04-19T04:28:41.739248+0000","last_peered":"2024-04-19T04:28:41.739248+0000","last_clean":"2024-04-19T04:28:41.739248+0000","last_became_active":"2024-04-19T04:28:02.634433+0000","last_became_peered":"2024-04-19T04:28:02.634433+0000","last_unstale":"2024-04-19T04:28:41.739248+0000","last_undegraded":"2024-04-19T04:28:41.739248+0000","last_fullsized":"2024-04-19T04:28:41.739248+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T04:28:41.738950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T04:28:41.738950+0000","last_clean_scrub_stamp":"2024-04-19T04:28:41.738950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:20.301173+0000","scrub_duration":0.0033981039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T04:29:42.146662+0000","last_change":"2024-04-19T04:29:42.146662+0000","last_active":"2024-04-19T04:29:42.146662+0000","last_peered":"2024-04-19T04:29:42.146662+0000","last_clean":"2024-04-19T04:29:42.146662+0000","last_became_active":"2024-04-19T04:28:02.844276+0000","last_became_peered":"2024-04-19T04:28:02.844276+0000","last_unstale":"2024-04-19T04:29:42.146662+0000","last_undegraded":"2024-04-19T04:29:42.146662+0000","last_fullsized":"2024-04-19T04:29:42.146662+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-04-19T04:29:42.146318+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-04-19T04:29:42.146318+0000","last_clean_scrub_stamp":"2024-04-19T04:29:42.146318+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:07.224942+0000","scrub_duration":0.0080392180000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69334,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705747,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220708,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151132,"statfs":{"total":96636764160,"available":96410759168,"internally_reserved":0,"allocated":946176,"data_stored":926258,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 04:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.56399999999999995,"15min":0.73499999999999999},"min":{"1min":0.57499999999999996,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.80300000000000005,"5min":1.4139999999999999,"15min":5.1470000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.60799999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.77800000000000002,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.627}]},{"osd":1,"last update":"Fri Apr 19 04:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69499999999999995,"15min":0.69999999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.78300000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.81200000000000006,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.68799999999999994}]}]},{"osd":1,"up_from":72,"seq":309237645346,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44116,"kb_used_data":844,"kb_used_omap":6,"kb_used_meta":43257,"kb_avail":94327724,"statfs":{"total":96636764160,"available":96591589376,"internally_reserved":0,"allocated":864256,"data_stored":334760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6880,"internal_metadata":44295456},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 04:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61799999999999999,"15min":0.61399999999999999},"min":{"1min":0.52400000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.623,"15min":0.627},"min":{"1min":0.52200000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.71899999999999997}]},{"osd":2,"last update":"Fri Apr 19 04:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.57999999999999996,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69199999999999995,"15min":0.69299999999999995},"min":{"1min":0.625,"5min":0.621,"15min":0.621},"max":{"1min":0.752,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.68300000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705747,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298664,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297726,"kb_avail":94073176,"statfs":{"total":96636764160,"available":96330932224,"internally_reserved":0,"allocated":950272,"data_stored":924740,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":304871878},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 04:30:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.55000000000000004,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.50700000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Apr 19 04:30:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63300000000000001,"15min":0.61899999999999999},"min":{"1min":0.57699999999999996,"5min":0.223,"15min":0.223},"max":{"1min":0.79700000000000004,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.628},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58699999999999997,"15min":0.76500000000000001},"min":{"1min":0.55600000000000005,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76200000000000001,"5min":1.7110000000000001,"15min":4.5},"last":0.65800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34667,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5286,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T04:30:43.324 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-19T04:30:43.654 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-19T04:30:43.654 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T04:30:43.987 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:30:43.987 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T04:24:20.525070+0000","modified":"2024-04-19T04:24:22.534106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6803/1858240019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1858240019},{"type":"v1","addr":"172.21.15.7:6803","nonce":1858240019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T04:30:43.990 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 5 2024-04-19T04:30:44.001 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T04:30:44.338 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:30:44.339 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T04:24:20.525070+0000","modified":"2024-04-19T04:24:22.534106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6803/1858240019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1858240019},{"type":"v1","addr":"172.21.15.7:6803","nonce":1858240019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T04:30:44.342 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 5 2024-04-19T04:30:44.353 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T04:30:44.652 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-19T04:30:44.653 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":79,"fsid":"7aba6173-85fe-4265-947d-27b4a313af4e","created":"2024-04-19T04:23:58.837304+0000","modified":"2024-04-19T04:28:13.077866+0000","last_up_change":"2024-04-19T04:28:01.596258+0000","last_in_change":"2024-04-19T04:24:00.437672+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T04:24:08.928860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T04:24:14.725769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T04:24:19.096707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T04:24:19.528844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28ba89d9-eaaf-4fb5-86bc-783b607a4cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":18128},{"type":"v1","addr":"172.21.15.27:6801","nonce":18128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":18128},{"type":"v1","addr":"172.21.15.27:6803","nonce":18128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":18128},{"type":"v1","addr":"172.21.15.27:6807","nonce":18128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":18128},{"type":"v1","addr":"172.21.15.27:6805","nonce":18128}]},"public_addr":"172.21.15.27:6801/18128","cluster_addr":"172.21.15.27:6803/18128","heartbeat_back_addr":"172.21.15.27:6807/18128","heartbeat_front_addr":"172.21.15.27:6805/18128","state":["exists","up"]},{"osd":1,"uuid":"9d5408b5-b74c-4e5e-858c-e0c8b593204e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":37,"up_from":72,"up_thru":72,"down_at":38,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1427},{"type":"v1","addr":"172.21.15.66:6801","nonce":1427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1427},{"type":"v1","addr":"172.21.15.66:6803","nonce":1427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1427},{"type":"v1","addr":"172.21.15.66:6807","nonce":1427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1427},{"type":"v1","addr":"172.21.15.66:6805","nonce":1427}]},"public_addr":"172.21.15.66:6801/1427","cluster_addr":"172.21.15.66:6803/1427","heartbeat_back_addr":"172.21.15.66:6807/1427","heartbeat_front_addr":"172.21.15.66:6805/1427","state":["exists","up"]},{"osd":2,"uuid":"9b600dc4-4425-4873-82d8-5434ca838bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":18250},{"type":"v1","addr":"172.21.15.172:6801","nonce":18250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":18250},{"type":"v1","addr":"172.21.15.172:6803","nonce":18250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":18250},{"type":"v1","addr":"172.21.15.172:6807","nonce":18250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":18250},{"type":"v1","addr":"172.21.15.172:6805","nonce":18250}]},"public_addr":"172.21.15.172:6801/18250","cluster_addr":"172.21.15.172:6803/18250","heartbeat_back_addr":"172.21.15.172:6807/18250","heartbeat_front_addr":"172.21.15.172:6805/18250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.749539+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.573103+0000","dead_epoch":37},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T04:24:05.812945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T04:30:44.667 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-19T04:30:45.018 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-19T04:30:45.030 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-19T04:30:45.044 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-19T04:30:46.034 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-19T04:30:47.032 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-04-19T04:30:47.044 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-19T04:30:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-04-19T04:30:48.051 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-19T04:30:48.051 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-19T04:30:48.051 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T04:30:48.063 INFO:tasks.ceph.mds.a:Stopped 2024-04-19T04:30:48.063 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-19T04:30:48.064 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-19T04:30:48.064 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T04:30:48.165 INFO:tasks.ceph.osd.0:Stopped 2024-04-19T04:30:48.166 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-19T04:30:48.166 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T04:30:48.263 INFO:tasks.ceph.osd.1:Stopped 2024-04-19T04:30:48.263 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-19T04:30:48.263 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T04:30:48.355 INFO:tasks.ceph.osd.2:Stopped 2024-04-19T04:30:48.355 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-19T04:30:48.356 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-19T04:30:48.356 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T04:30:48.386 INFO:tasks.ceph.mgr.x:Stopped 2024-04-19T04:30:48.387 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-19T04:30:48.387 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T04:30:48.460 INFO:tasks.ceph.mgr.y:Stopped 2024-04-19T04:30:48.460 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-19T04:30:48.461 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-19T04:30:48.461 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T04:30:48.510 INFO:tasks.ceph.mon.a:Stopped 2024-04-19T04:30:48.510 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-19T04:30:48.510 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T04:30:48.566 INFO:tasks.ceph.mon.b:Stopped 2024-04-19T04:30:48.567 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-19T04:30:48.567 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T04:30:48.627 INFO:tasks.ceph.mon.c:Stopped 2024-04-19T04:30:48.628 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-19T04:30:48.628 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-04-19T04:30:48.648 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi027.front.sepia.ceph.com 2024-04-19T04:30:48.649 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-19T04:30:48.845 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi066.front.sepia.ceph.com 2024-04-19T04:30:48.845 DEBUG:teuthology.orchestra.run.smithi066:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-19T04:30:48.976 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-19T04:30:48.977 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-19T04:30:49.242 INFO:tasks.ceph:Archiving mon data... 2024-04-19T04:30:49.243 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943/data/mon.a.tgz 2024-04-19T04:30:49.243 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-04-19T04:30:49.250 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.IO6DXsLZnq 2024-04-19T04:30:49.250 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.IO6DXsLZnq 2024-04-19T04:30:49.396 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.IO6DXsLZnq 2024-04-19T04:30:49.419 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.IO6DXsLZnq is 398KB 2024-04-19T04:30:49.488 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.IO6DXsLZnq 2024-04-19T04:30:49.495 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943/data/mon.b.tgz 2024-04-19T04:30:49.495 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-04-19T04:30:49.502 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.doydmgRp1p 2024-04-19T04:30:49.502 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.doydmgRp1p 2024-04-19T04:30:49.640 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.doydmgRp1p 2024-04-19T04:30:49.707 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.doydmgRp1p is 548KB 2024-04-19T04:30:49.775 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.doydmgRp1p 2024-04-19T04:30:49.781 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943/data/mon.c.tgz 2024-04-19T04:30:49.782 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-04-19T04:30:49.789 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.SZbNk6di9p 2024-04-19T04:30:49.789 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.SZbNk6di9p 2024-04-19T04:30:49.926 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.SZbNk6di9p 2024-04-19T04:30:49.950 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.SZbNk6di9p is 548KB 2024-04-19T04:30:50.020 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.SZbNk6di9p 2024-04-19T04:30:50.027 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-19T04:30:50.027 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T04:30:50.029 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T04:30:50.032 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T04:30:50.034 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T04:30:50.062 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-19T04:30:50.062 DEBUG:teuthology.orchestra.run.smithi007:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T04:30:50.082 DEBUG:teuthology.orchestra.run.smithi027:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T04:30:50.089 DEBUG:teuthology.orchestra.run.smithi066:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T04:30:50.091 DEBUG:teuthology.orchestra.run.smithi172:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T04:30:50.110 INFO:teuthology.orchestra.run.smithi007.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T04:30:50.116 INFO:teuthology.orchestra.run.smithi066.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T04:30:50.117 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T04:30:50.123 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T04:30:50.131 INFO:tasks.ceph:Archiving crash dumps... 2024-04-19T04:30:50.133 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943/remote/smithi007/crash 2024-04-19T04:30:50.134 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T04:30:50.151 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943/remote/smithi027/crash 2024-04-19T04:30:50.152 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T04:30:50.167 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943/remote/smithi066/crash 2024-04-19T04:30:50.168 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T04:30:50.197 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943/remote/smithi172/crash 2024-04-19T04:30:50.199 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T04:30:50.216 INFO:tasks.ceph:Compressing logs... 2024-04-19T04:30:50.217 DEBUG:teuthology.orchestra.run.smithi007:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T04:30:50.222 DEBUG:teuthology.orchestra.run.smithi027:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T04:30:50.225 DEBUG:teuthology.orchestra.run.smithi066:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T04:30:50.227 DEBUG:teuthology.orchestra.run.smithi172:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T04:31:27.566 INFO:tasks.ceph:Archiving logs... 2024-04-19T04:31:27.567 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943/remote/smithi007/log 2024-04-19T04:31:27.568 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T04:31:27.855 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943/remote/smithi027/log 2024-04-19T04:31:27.856 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T04:31:32.138 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943/remote/smithi066/log 2024-04-19T04:31:32.140 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T04:31:33.112 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943/remote/smithi172/log 2024-04-19T04:31:33.113 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T04:31:36.312 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-19T04:31:36.324 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-19T04:31:36.324 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T04:31:36.326 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T04:31:36.329 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T04:31:36.331 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T04:31:36.425 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-19T04:31:36.435 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-19T04:31:36.435 DEBUG:teuthology.orchestra.run.smithi007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T04:31:36.438 DEBUG:teuthology.orchestra.run.smithi027:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T04:31:36.440 DEBUG:teuthology.orchestra.run.smithi066:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T04:31:36.442 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T04:31:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T04:31:36.458 INFO:teuthology.orchestra.run.smithi007.stdout:============================================================================== 2024-04-19T04:31:36.458 INFO:teuthology.orchestra.run.smithi007.stdout:+hv01.front.sepi 67.205.162.81 3 u 63 64 377 0.093 -0.927 0.862 2024-04-19T04:31:36.458 INFO:teuthology.orchestra.run.smithi007.stdout:+hv02.front.sepi 63.231.80.2 3 u 51 64 377 0.071 2.911 1.070 2024-04-19T04:31:36.459 INFO:teuthology.orchestra.run.smithi007.stdout:*hv03.front.sepi 74.6.168.72 3 u 51 64 377 0.096 2.177 1.184 2024-04-19T04:31:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2024-04-19T04:31:36.460 INFO:teuthology.orchestra.run.smithi027.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T04:31:36.460 INFO:teuthology.orchestra.run.smithi027.stdout:============================================================================== 2024-04-19T04:31:36.461 INFO:teuthology.orchestra.run.smithi027.stdout:+hv01.front.sepi 67.205.162.81 3 u 54 64 377 0.053 -2.950 0.698 2024-04-19T04:31:36.461 INFO:teuthology.orchestra.run.smithi027.stdout:+hv02.front.sepi 63.231.80.2 3 u 60 64 377 0.075 0.755 0.230 2024-04-19T04:31:36.461 INFO:teuthology.orchestra.run.smithi027.stdout:*hv03.front.sepi 74.6.168.72 3 u 56 64 377 0.078 -0.010 0.385 2024-04-19T04:31:36.461 INFO:teuthology.orchestra.run.smithi027.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2024-04-19T04:31:36.464 INFO:teuthology.orchestra.run.smithi172.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T04:31:36.464 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================== 2024-04-19T04:31:36.464 INFO:teuthology.orchestra.run.smithi172.stdout:+hv01.front.sepi 67.205.162.81 3 u 64 64 377 0.067 -1.897 0.290 2024-04-19T04:31:36.464 INFO:teuthology.orchestra.run.smithi172.stdout:*hv02.front.sepi 63.231.80.2 3 u 57 64 377 0.080 1.043 0.120 2024-04-19T04:31:36.464 INFO:teuthology.orchestra.run.smithi172.stdout:+hv03.front.sepi 74.6.168.72 3 u 59 64 377 0.079 -0.031 0.037 2024-04-19T04:31:36.464 INFO:teuthology.orchestra.run.smithi172.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2024-04-19T04:31:36.486 INFO:teuthology.orchestra.run.smithi066.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T04:31:36.486 INFO:teuthology.orchestra.run.smithi066.stdout:============================================================================== 2024-04-19T04:31:36.486 INFO:teuthology.orchestra.run.smithi066.stdout: hv01.front.sepi 67.205.162.81 3 u 28 64 1 0.171 -3.275 0.000 2024-04-19T04:31:36.487 INFO:teuthology.orchestra.run.smithi066.stdout: hv02.front.sepi 63.231.80.2 3 u 32 64 1 0.090 0.015 0.000 2024-04-19T04:31:36.487 INFO:teuthology.orchestra.run.smithi066.stdout: hv03.front.sepi 74.6.168.72 3 u 28 64 1 0.098 -0.849 0.000 2024-04-19T04:31:36.487 INFO:teuthology.orchestra.run.smithi066.stdout: hv04.front.sepi .STEP. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T04:31:36.488 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-19T04:31:36.500 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-19T04:31:36.500 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-19T04:31:36.511 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-19T04:31:36.521 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-19T04:31:36.531 INFO:teuthology.task.internal:Duration was 1039.354373 seconds 2024-04-19T04:31:36.532 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-19T04:31:36.541 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-19T04:31:36.541 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T04:31:36.544 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T04:31:36.546 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T04:31:36.548 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T04:31:36.602 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-19T04:31:36.602 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi007.front.sepia.ceph.com 2024-04-19T04:31:36.602 DEBUG:teuthology.orchestra.run.smithi007:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T04:31:36.614 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi027.front.sepia.ceph.com 2024-04-19T04:31:36.615 DEBUG:teuthology.orchestra.run.smithi027:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T04:31:36.631 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi066.front.sepia.ceph.com 2024-04-19T04:31:36.631 DEBUG:teuthology.orchestra.run.smithi066:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T04:31:36.649 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-04-19T04:31:36.649 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T04:31:36.665 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-19T04:31:36.666 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T04:31:36.668 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T04:31:36.670 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T04:31:36.672 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T04:31:36.746 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-19T04:31:36.746 DEBUG:teuthology.orchestra.run.smithi007:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T04:31:36.750 DEBUG:teuthology.orchestra.run.smithi027:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T04:31:36.752 DEBUG:teuthology.orchestra.run.smithi066:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T04:31:36.755 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T04:31:36.875 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-19T04:31:36.886 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-19T04:31:36.886 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T04:31:36.903 DEBUG:teuthology.orchestra.run.smithi027:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T04:31:36.920 DEBUG:teuthology.orchestra.run.smithi066:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T04:31:36.937 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T04:31:36.954 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-19T04:31:36.965 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T04:31:36.968 DEBUG:teuthology.orchestra.run.smithi027:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T04:31:36.970 DEBUG:teuthology.orchestra.run.smithi066:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T04:31:36.972 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T04:31:36.981 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = core 2024-04-19T04:31:36.983 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = core 2024-04-19T04:31:36.987 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-04-19T04:31:37.019 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = core 2024-04-19T04:31:37.053 DEBUG:teuthology.orchestra.run.smithi007:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T04:31:37.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T04:31:37.059 DEBUG:teuthology.orchestra.run.smithi027:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T04:31:37.064 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T04:31:37.065 DEBUG:teuthology.orchestra.run.smithi066:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T04:31:37.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T04:31:37.070 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T04:31:37.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T04:31:37.076 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-19T04:31:37.087 INFO:teuthology.task.internal:Transferring archived files... 2024-04-19T04:31:37.089 DEBUG:teuthology.misc:Transferring archived files from smithi007:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943/remote/smithi007 2024-04-19T04:31:37.089 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T04:31:37.115 DEBUG:teuthology.misc:Transferring archived files from smithi027:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943/remote/smithi027 2024-04-19T04:31:37.115 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T04:31:37.145 DEBUG:teuthology.misc:Transferring archived files from smithi066:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943/remote/smithi066 2024-04-19T04:31:37.145 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T04:31:37.170 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662943/remote/smithi172 2024-04-19T04:31:37.170 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T04:31:37.196 INFO:teuthology.task.internal:Removing archive directory... 2024-04-19T04:31:37.196 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T04:31:37.198 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T04:31:37.200 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T04:31:37.209 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T04:31:37.239 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-19T04:31:37.252 INFO:teuthology.task.internal:Not uploading archives. 2024-04-19T04:31:37.252 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-19T04:31:37.262 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-19T04:31:37.262 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T04:31:37.265 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T04:31:37.267 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T04:31:37.269 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T04:31:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 04:31 /home/ubuntu/cephtest 2024-04-19T04:31:37.273 INFO:teuthology.orchestra.run.smithi027.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 04:31 /home/ubuntu/cephtest 2024-04-19T04:31:37.275 INFO:teuthology.orchestra.run.smithi066.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 04:31 /home/ubuntu/cephtest 2024-04-19T04:31:37.277 INFO:teuthology.orchestra.run.smithi172.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 04:31 /home/ubuntu/cephtest 2024-04-19T04:31:37.279 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-19T04:31:37.291 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-19T04:31:37.317 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/ubuntu_20.04 tasks/admin_socket_objecter_requests thrashosds-health} duration: 1039.354373216629 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-19T04:31:37.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T04:31:37.396 INFO:teuthology.run:pass